KR20210102010A - Method and apparatus for operating of electronic device having flexible display - Google Patents

Abstract

Various embodiments of the present invention relate to an electronic device having a flexible display (or foldable display) and an operating method thereof. An electronic device in accordance with various embodiments comprises a camera device, a first display, a second display, and a processor. The processor identifies a state of the electronic device based on the execution of the camera device, identifies an operation mode of the camera device and a display operating in response to the execution of the camera device based on the state of the electronic device, updates the settings of the camera device based at least on the operation mode of the camera device and the identified display, and displays a preview obtained from the camera device through the identified display, based on the updated setting. Various embodiments are possible. The present invention can provide an efficient camera mode switching experience.

Description

Operating method and apparatus of an electronic device having a flexible display TECHNICAL FIELD

Various embodiments of the present disclosure relate to an electronic device having a flexible display (or foldable display) and an operating method thereof.

With the recent development of digital technology, various types of electronic devices such as mobile communication terminals, smart phones, tablets, personal computers, notebooks, or wearable devices are widely used. have.

The electronic device may have a limited size for portability, which limits the size of the display. Accordingly, in recent years, various types of electronic devices that provide an expanded screen in the electronic device by a multi display have been developed. For example, a plurality of displays are provided to provide an extended screen by multi-display. For another example, the screen size of the electronic device is gradually increasing in a display having a limited size, and is designed to provide various services to a user through a large screen.

Recently, electronic devices may have a new form factor such as a multi-display (eg, dual display) device (eg, a foldable device). The foldable device is equipped with a foldable (or bendable) display (eg, a foldable display or a flexible display) and can be used by folding or unfolding. In addition, as the multi-display is implemented, the need for development of a user interface (UI) corresponding to the multi-display and its operation is increasing.

Various embodiments disclose a method and apparatus for operating a camera device and a display in an electronic device (eg, a foldable device) having at least two display surfaces.

Various embodiments provide a method and apparatus for efficiently controlling a camera device and an operation related to photographing using the camera device based on physical characteristics in which the electronic device is folded or unfolded.

In various embodiments, when the camera device is operated based on a change in the state of the electronic device, the settings of the camera device are controlled based on the folded state, the unfolded state, or the intermediate state of the electronic device, and a user interface is provided through the display accordingly. Disclosed is a method and apparatus capable of doing so.

An electronic device according to various embodiments of the present disclosure includes a camera device, a first display, a second display, and a processor, wherein the processor identifies a state of the electronic device based on execution of the camera device and, based on the state of the electronic device, identify an operation mode of the camera device and a display operating in response to the execution of the camera device, and at least based on the operation mode of the camera device and the identified display, the A setting of the camera device may be updated, and a preview obtained from the camera device may be displayed through the identified display based on the updated setting.

A method of operating an electronic device according to various embodiments of the present disclosure includes an operation of identifying a state of the electronic device based on execution of a camera device, an operation mode of the camera device based on the state of the electronic device, and identifying a display operating in response to the execution of the camera device, updating a setting of the camera device based at least on an operation mode of the camera device and the identified display, based on the updated setting and displaying a preview obtained from the camera device through the identified display.

In various embodiments of the present disclosure in order to solve the above problems, a computer-readable recording medium recording a program for executing the method in a processor may be included.

Further scope of applicability of the present disclosure will become apparent from the following detailed description. However, it should be understood that the detailed description and specific embodiments, such as preferred embodiments of the present disclosure, are given by way of illustration only, since various changes and modifications within the spirit and scope of the present disclosure may be clearly understood by those skilled in the art.

According to an electronic device and an operating method thereof according to various embodiments of the present disclosure, in an electronic device having a flexible display, a camera device and/or a display of the electronic device are set in a state (eg, an unfolded state, a folded state, or an intermediate state) of the electronic device. Alternatively, an efficient camera mode switching experience may be provided by performing event processing corresponding to a state change. According to various embodiments, the electronic device may provide a seamless camera use experience to the user by processing an event according to the state change when the state of the electronic device is changed by the user during the operation of the camera device. can According to various embodiments, an electronic device may provide a front-facing (eg, front camera mode, selfie mode) and a rear-captured (eg, rear camera mode) experience to a user by using a single camera device, , it is possible to provide a preview optimized for the display according to the user's shooting mode.

In connection with the description of the drawings, the same or similar reference numerals may be used for the same or similar components.
1 is a block diagram of an electronic device in a network environment according to various embodiments of the present disclosure;
2 is a block diagram of a display device according to various embodiments.
3A is a front perspective view of an electronic device illustrating a flat state or unfolding state according to various embodiments of the present disclosure;
3B is a plan view illustrating a front surface of an electronic device in an unfolded state according to various embodiments of the present disclosure;
3C is a plan view illustrating a rear surface of an electronic device in an unfolded state according to various embodiments of the present disclosure;
4A is a perspective view of an electronic device illustrating a folding state according to various embodiments of the present disclosure;
4B is a perspective view of an electronic device illustrating an intermediate state according to various embodiments of the present disclosure;
5 is a diagram schematically illustrating a configuration of an electronic device according to various embodiments of the present disclosure;
6 is a flowchart illustrating a method of operating an electronic device according to various embodiments of the present disclosure;
7 is a flowchart illustrating a method of operating an electronic device according to various embodiments of the present disclosure;
8 is a flowchart illustrating a method of operating an electronic device according to various embodiments of the present disclosure;
9 is a flowchart illustrating a method of operating an electronic device according to various embodiments of the present disclosure;
10 is a flowchart illustrating a method of operating an electronic device according to various embodiments of the present disclosure;
11 is a flowchart illustrating a method of operating an electronic device according to various embodiments of the present disclosure;
12A, 12B, and 12C are diagrams for explaining an example in which a camera device and a display operate in an electronic device according to various embodiments of the present disclosure;
13 is a flowchart illustrating a method of operating an electronic device according to various embodiments of the present disclosure;
14 is a flowchart illustrating a method of operating an electronic device according to various embodiments of the present disclosure;
15A, 15B, and 15C are diagrams for explaining an example of an electronic device operating in an intermediate state according to various embodiments of the present disclosure;
16A, 16B, 16C, 16D, and 16E are diagrams for explaining an example of providing a sub-region in an intermediate state of an electronic device according to various embodiments of the present disclosure;
17 is a flowchart illustrating a method of operating an electronic device according to various embodiments of the present disclosure;
18 is a flowchart illustrating a method of operating an electronic device according to various embodiments of the present disclosure;
19 is a diagram for describing an example of an operation in an unfolded state of an electronic device according to various embodiments of the present disclosure;
20 is a flowchart illustrating a method of operating an electronic device according to various embodiments of the present disclosure;
21A and 21B are diagrams for explaining an example of an interface provided for displaying a multi-preview in an electronic device according to various embodiments of the present disclosure;
22 to 24 are diagrams for explaining an example of switching an electronic device from an unfolded state to an intermediate state according to various embodiments of the present disclosure;
25 and 26 are diagrams for explaining an example of using an electronic device in an intermediate state according to various embodiments of the present disclosure;
27 and 28 are diagrams for explaining an example of a photographing operation using an electronic device in an intermediate state of the electronic device according to various embodiments of the present disclosure;
29 and 30 are diagrams for explaining an example of switching an electronic device from an intermediate state to an unfolded state according to various embodiments of the present disclosure;
31 is a diagram for explaining another example of a preview area and a sub area in an intermediate state of an electronic device.
32 and 33 are diagrams for explaining an example of a screen configuration in an intermediate state of an electronic device according to various embodiments of the present disclosure;
34 to 46 are diagrams for explaining an example of automatically controlling preview movement in an electronic device according to various embodiments of the present disclosure;
47 is a diagram for explaining an example of preview switching in an intermediate state of an electronic device according to various embodiments of the present disclosure;

1 is a block diagram of an electronic device 101 in a network environment 100 according to various embodiments of the present disclosure.

Referring to FIG. 1 , in a network environment 100 , the electronic device 101 communicates with the electronic device 102 through a first network 198 (eg, a short-range wireless communication network) or a second network 199 . It may communicate with the electronic device 104 or the server 108 through (eg, a long-distance wireless communication network). According to an embodiment, the electronic device 101 may communicate with the electronic device 104 through the server 108 . According to an embodiment, the electronic device 101 includes a processor 120 , a memory 130 , an input device 150 , a sound output device 155 , a display device 160 , an audio module 170 , and a sensor module ( 176 , interface 177 , haptic module 179 , camera module 180 , power management module 188 , battery 189 , communication module 190 , subscriber identification module 196 , or antenna module 197 . ) may be included. In some embodiments, at least one of these components (eg, the display device 160 or the camera module 180 ) may be omitted or one or more other components may be added to the electronic device 101 . In some embodiments, some of these components may be implemented as one integrated circuit. For example, the sensor module 176 (eg, a fingerprint sensor, an iris sensor, or an illuminance sensor) may be implemented while being embedded in the display device 160 (eg, a display).

The processor 120, for example, executes software (eg, the program 140) to execute at least one other component (eg, hardware or software component) of the electronic device 101 connected to the processor 120 . It can control and perform various data processing or operations. According to an embodiment, as at least part of data processing or operation, the processor 120 stores commands or data received from other components (eg, the sensor module 176 or the communication module 190 ) into a volatile memory (volatile memory). ) 132 , may process commands or data stored in the volatile memory 132 , and store the resulting data in a non-volatile memory 134 . According to an embodiment, the processor 120 includes a main processor 121 (eg, a central processing unit (CPU) or an application processor (AP)), and a coprocessor that can be operated independently or together with the processor 120 . 123 (eg, a graphic processing unit (GPU), an image signal processor (ISP), a sensor hub processor, or a communication processor (CP)). can Additionally or alternatively, the auxiliary processor 123 may be configured to use less power than the main processor 121 or to be specialized for a designated function. The auxiliary processor 123 may be implemented separately from or as a part of the main processor 121 .

The auxiliary processor 123 is, for example, on behalf of the main processor 121 while the main processor 121 is in an inactive (eg, sleep) state, or the main processor 121 is At least one of the components of the electronic device 101 (eg, the display device 160 and the sensor module 176 ) together with the main processor 121 while in an active (eg, application execution) state ), or at least some of functions or states related to the communication module 190). According to an embodiment, the coprocessor 123 (eg, an image signal processor or a communication processor) may be implemented as part of another functionally related component (eg, the camera module 180 or the communication module 190). have.

The memory 130 may store various data used by at least one component of the electronic device 101 (eg, the processor 120 or the sensor module 176 ). The data may include, for example, input data or output data for software (eg, the program 140 ) and instructions related thereto. The memory 130 may include a volatile memory 132 or a non-volatile memory 134 .

The program 140 may be stored as software in the memory 130 , and may include, for example, an operating system (OS) 142 , middleware 144 , or an application 146 . .

The input device 150 may receive a command or data to be used by a component (eg, the processor 120 ) of the electronic device 101 from the outside (eg, a user) of the electronic device 101 . The input device 150 may include, for example, a microphone, a mouse, a keyboard, or a digital pen (eg, a stylus pen).

The sound output device 155 may output a sound signal to the outside of the electronic device 101 . The sound output device 155 may include, for example, a speaker or a receiver. The speaker can be used for general purposes such as multimedia playback or recording playback, and the receiver can be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from or as part of the speaker.

The display device 160 may visually provide information to the outside (eg, a user) of the electronic device 101 . The display device 160 may include, for example, a display, a hologram device, or a projector and a control circuit for controlling the corresponding device. According to an embodiment, the display device 160 includes a touch circuitry configured to sense a touch or a sensor circuit configured to measure the intensity of a force generated by the touch (eg, a pressure sensor). may include.

The audio module 170 may convert a sound into an electric signal or, conversely, convert an electric signal into a sound. According to an embodiment, the audio module 170 acquires a sound through the input device 150 , or an external electronic device (eg, a sound output device 155 ) connected directly or wirelessly with the electronic device 101 . The sound may be output through the electronic device 102 (eg, a speaker or headphones).

The sensor module 176 detects an operating state (eg, power or temperature) of the electronic device 101 or an external environmental state (eg, user state), and generates an electrical signal or data value corresponding to the sensed state. can do. According to an embodiment, the sensor module 176 may include, for example, a gesture sensor, a gyro sensor, a barometer sensor, a magnetic sensor, and an acceleration sensor. ), grip sensor, proximity sensor, color sensor (eg, RGB (red, green, blue) sensor), IR (infrared) sensor, biometric sensor, temperature It may include a temperature sensor, a humidity sensor, or an illumination sensor.

The interface 177 may support one or more designated protocols that may be used to directly or wirelessly connect to an external electronic device (eg, the electronic device 102 ) of the electronic device 101 . According to an embodiment, the interface 177 may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, a secure digital (SD) card interface, or an audio interface.

The connection terminal 178 may include a connector through which the electronic device 101 can be physically connected to an external electronic device (eg, the electronic device 102 ). According to an embodiment, the connection terminal 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (eg, a headphone connector).

The haptic module 179 may convert an electrical signal into a mechanical stimulus (eg, vibration or movement) or an electrical stimulus that the user can perceive through tactile or kinesthetic sense. According to an embodiment, the haptic module 179 may include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

The camera module 180 may capture still images and moving images. According to an embodiment, the camera module 180 may include one or more lenses, image sensors, image signal processors, or flashes.

The power management module 188 may manage power supplied to the electronic device 101 . According to an embodiment, the power management module 188 may be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

The battery 189 may supply power to at least one component of the electronic device 101 . According to one embodiment, battery 189 may include, for example, a non-rechargeable primary cell, a rechargeable secondary cell, or a fuel cell.

The communication module 190 is a direct (eg, wired) communication channel or a wireless communication channel between the electronic device 101 and an external electronic device (eg, the electronic device 102, the electronic device 104, or the server 108). It can support establishment and communication through the established communication channel. The communication module 190 may include one or more communication processors that operate independently of the processor 120 (eg, an application processor) and support direct (eg, wired) communication or wireless communication. According to one embodiment, the communication module 190 is a wireless communication module 192 (eg, a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 194 (eg, : It may include a local area network (LAN) communication module, or a power line communication module). A corresponding communication module among these communication modules is a first network 198 (eg, a short-range communication network such as Bluetooth, Wi-Fi direct, or infrared data association (IrDA)) or a second network 199 (eg, a cellular network, the Internet). , or a computer network (eg, a telecommunication network such as a LAN or a wide area network (WAN)). These various types of communication modules may be integrated into one component (eg, a single chip) or may be implemented as a plurality of components (eg, multiple chips) separate from each other.

The wireless communication module 192 communicates with the first network 198 or the second network 199 using subscriber information (eg, international mobile subscriber identity (IMSI)) stored in the subscriber identification module 196 . The electronic device 101 may be identified and authenticated within the same communication network.

The antenna module 197 may transmit or receive a signal or power to the outside (eg, an external electronic device). According to an embodiment, the antenna module 197 may include one antenna including a conductor formed on a substrate (eg, a PCB) or a radiator formed of a conductive pattern. According to an embodiment, the antenna module 197 may include a plurality of antennas. In this case, at least one antenna suitable for a communication method used in a communication network such as the first network 198 or the second network 199 is connected from the plurality of antennas by, for example, the communication module 190 . can be selected. A signal or power may be transmitted or received between the communication module 190 and an external electronic device through the selected at least one antenna. According to some embodiments, other components (eg, RFIC) other than the radiator may be additionally formed as a part of the antenna module 197 .

At least some of the components are connected to each other through a communication method between peripheral devices (eg, a bus, general purpose input and output (GPIO), serial peripheral interface (SPI), or mobile industry processor interface (MIPI)), and a signal (eg commands or data) can be exchanged with each other.

According to an embodiment, the command or data may be transmitted or received between the electronic device 101 and the external electronic device 104 through the server 108 connected to the second network 199 . Each of the electronic devices 102 and 104 may be the same or a different type of the electronic device 101 .

According to an embodiment, all or part of the operations executed in the electronic device 101 may be executed in one or more of the external electronic devices 102 , 104 , or 108 . For example, when the electronic device 101 needs to perform a function or service automatically or in response to a request from a user or other device, the electronic device 101 may perform the function or service itself instead of executing the function or service itself. Alternatively or additionally, one or more external electronic devices 102 and 104 may be requested to perform at least a part of a function or a service thereof. The one or more external electronic devices 102 and 104 that have received the request execute at least a part of the requested function or service, or an additional function or service related to the request, and send a result of the execution to the electronic device 101 can transmit The electronic device 101 may process the result as it is or additionally and provide it as at least a part of a response to the request. For this, for example, cloud computing, distributed computing, or client-server computing technology may be used.

2 is a block diagram 200 of a display device 160 according to various embodiments of the present disclosure.

Referring to FIG. 2 , the display device 160 may include a display 210 and a display driver IC (DDI, display driver IC) 230 for controlling the display 210 . The DDI 230 may include an interface module 231 , a memory 233 (eg, a buffer memory), an image processing module 235 , or a mapping module 237 .

The DDI 230 transmits, for example, image data or image information including an image control signal corresponding to a command for controlling the image data to other components of the electronic device 101 through the interface module 231 . can be received from For example, the image information includes the processor 120 (eg, the main processor 121 (eg, an application processor) or the auxiliary processor 123 (eg, a graphic processing unit) operated independently of the function of the main processor 121 ). ) can be received from The DDI 230 may communicate with the touch circuit 250 or the sensor module 176 through the interface module 231 . Also, the DDI 230 may store at least a portion of the received image information in the memory 233, for example, in units of frames.

The image processing module 235 may, for example, pre-process or post-process at least a portion of the image data based on at least a characteristic of the image data or a characteristic of the display 210 ( e.g. resolution, brightness, or resizing).

The mapping module 237 may generate a voltage value or a current value corresponding to the image data pre-processed or post-processed by the image processing module 235 . According to an embodiment, the generation of the voltage value or the current value may be, for example, a property of pixels of the display 210 (eg, an arrangement of pixels (RGB stripe or pentile structure), or each of the sub-pixels). size) at least in part. At least some pixels of the display 210 are driven based at least in part on the voltage value or the current value, so that visual information (eg, text, image, or icon) corresponding to the image data is displayed on the display 210 . can be displayed through

According to an embodiment, the display device 160 may further include a touch circuit 250 . The touch circuit 250 may include a touch sensor 251 and a touch sensor IC 253 for controlling the touch sensor 251 . The touch sensor IC 253 may control the touch sensor 251 to detect a touch input or a hovering input for a specific location of the display 210 , for example. For example, the touch sensor IC 253 may detect a touch input or a hovering input by measuring a change in a signal (eg, voltage, light amount, resistance, or electric charge amount) for a specific position of the display 210 . The touch sensor IC 253 may provide information (eg, location, area, pressure, or time) regarding the sensed touch input or hovering input to the processor 120 . According to an embodiment, at least a part of the touch circuit 250 (eg, the touch sensor IC 253 ) may be a part of the DDI 230 , the display 210 , or another part disposed outside the display device 160 . It may be included as part of a component (eg, the coprocessor 123 ).

According to an embodiment, the display device 160 may further include at least one sensor (eg, a fingerprint sensor, an iris sensor, a pressure sensor, or an illuminance sensor) of the sensor module 176 , or a control circuit therefor. In this case, the at least one sensor or a control circuit therefor may be embedded in a part of the display device 160 (eg, the display 210 or the DDI 230 ) or a part of the touch circuit 250 . For example, when the sensor module 176 embedded in the display device 160 includes a biometric sensor (eg, a fingerprint sensor), the biometric sensor provides biometric information related to a touch input through a partial area of the display 210 . (eg, fingerprint image) can be acquired. As another example, when the sensor module 176 embedded in the display device 160 includes a pressure sensor, the pressure sensor may acquire pressure information related to a touch input through a part or the entire area of the display 210 . can According to an embodiment, the touch sensor 251 or the sensor module 176 may be disposed between pixels of a pixel layer of the display 210 or above or below the pixel layer.

The electronic device 101 according to various embodiments disclosed in this document may have various types of devices. The electronic device 101 may include, for example, a portable communication device (eg, a smart phone), a portable multimedia device, a portable medical device, a camera, a wearable device, or a home appliance device. The electronic device 101 according to the embodiment of this document is not limited to the above-described devices.

The various embodiments of this document and the terms used therein are not intended to limit the technical features described in this document to specific embodiments, and various modifications, equivalents, or alternatives of the embodiments are not intended. should be understood as including In connection with the description of the drawings, like reference numerals may be used for similar or related components. The singular form of the noun corresponding to the item may include one or more of the item, unless the relevant context clearly dictates otherwise.

As used herein, "A or B", "at least one of A and B", "at least one of A or B", "A, B or C", "at least one of A, B and C" and "A; Each of the phrases such as “at least one of B, or C” may include any one of the items listed together in the corresponding one of the phrases, or all possible combinations thereof. Terms such as “first”, “second”, or “first” or “second” may be used simply to distinguish the component from other such components, and may refer to components in other aspects (e.g., importance or order) is not limited. A reference in which one (e.g. first) component is "coupled" or "connected" to another (e.g. second) component with or without the terms "functionally" or "communicatively" If used, it means that one component can be connected to the other component directly (eg, by wire), wirelessly, or through a third component.

As used herein, the term “module” may include a unit implemented in hardware, software or firmware, for example, logic, logic block, component ), or the term "circuit" can be used interchangeably. A module may be an integrally formed part or a minimum unit or a part of the part that performs one or more functions. According to an embodiment, the module may be implemented in the form of an application-specific integrated circuit (ASIC).

Various embodiments of the present document include one or more stored in a storage medium (eg, the internal memory 136 or the external memory 138) readable by a machine (eg, the electronic device 101). It may be implemented as software (eg, the program 140) including instructions. For example, the processor (eg, the processor 120 ) of the device (eg, the electronic device 101 ) may call at least one of one or more instructions stored from a storage medium and execute it. This makes it possible for the device to be operated to perform at least one function according to the at least one command called. The one or more instructions may include code generated by a compiler or code that may be executed by an interpreter. The device-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' only means that the storage medium is a tangible device and does not contain a signal (eg, electromagnetic wave), and this term refers to the case where data is semi-permanently stored in the storage medium and It does not distinguish between temporary storage cases.

According to one embodiment, the method according to various embodiments disclosed in this document may be provided as included in a computer program product. Computer program products may be traded between sellers and buyers as commodities. The computer program product is distributed in the form of a machine-readable storage medium (eg CD-ROM, compact disc read only memory), or via an application store (eg Play Store ^TM ) or on two user devices (eg CD-ROM). : can be distributed (eg, downloaded or uploaded) directly between smartphones) and online. In the case of online distribution, at least a part of the computer program product may be temporarily stored or temporarily created in a machine-readable storage medium such as a memory of a server of a manufacturer, a server of an application store, or a memory of a relay server.

According to various embodiments, each component (eg, a module or a program) of the above-described components may include a singular or a plurality of entities. According to various embodiments, one or more components or operations among the above-described corresponding components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (eg, a module or a program) may be integrated into one component. In this case, the integrated component may perform one or more functions of each component of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. . According to various embodiments, operations performed by a module, program, or other component are executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations are executed in a different order. , may be omitted, or one or more other operations may be added.

Before describing various embodiments of the present disclosure, an electronic device 101 to which embodiments of the present disclosure may be applied will be described.

3A is a perspective view of an electronic device illustrating a flat state or unfolding state according to various embodiments of the present disclosure; 3B is a plan view illustrating a front surface of an electronic device in an unfolded state according to various embodiments of the present disclosure; 3C is a plan view illustrating a rear surface of an electronic device in an unfolded state according to various embodiments of the present disclosure;

4A is a perspective view of an electronic device illustrating a folding state according to various embodiments of the present disclosure; 4B is a perspective view of an electronic device illustrating an intermediate state according to various embodiments of the present disclosure;

Referring to FIGS. 3A to 4B , the electronic device 101 is a pair of housings 310 and 320 (eg, foldable) that are rotatably coupled to face each other based on a hinge module (not shown) and to be folded. housing) may be included. According to an embodiment, the electronic device 101 includes a display 210 (eg, a flexible display 300 (or a foldable display or a second display) disposed in an area formed by a pair of housings 310 and 320 ). (eg, the display 210 of Fig. 2). According to one embodiment, the first housing 310 and the second housing 320 are disposed on both sides with respect to the folding axis (axis A), and , may have a substantially symmetrical shape with respect to the folding axis (axis A). According to an embodiment, the first housing 310 and the second housing 320 may be in an unfolded state ( The angle or distance between each other may vary depending on whether the flat state or the unfolding state, the folding state, or the intermediate state or the half folding state.

According to various embodiments, the pair of housings 310 and 320 may include a first housing 310 (eg, a first housing structure) coupled to a hinge module and a second housing 320 (eg, coupled to a hinge module). : second housing structure). According to an embodiment, the first housing 310 is, in the unfolded state, a first surface 311 facing a first direction (eg, a front direction) (z-axis direction) and a first surface 311 facing the first surface 311 . A second surface 312 facing a second direction (eg, a rear direction) (-z axis direction) may be included. According to an embodiment, in the opened state, the second housing 320 has a third surface 321 facing the first direction (z-axis direction) and a fourth surface 322 facing the second direction (-z-axis direction). ) may be included. According to an embodiment, in the unfolded state, the first surface 311 of the first housing 310 and the third surface 321 of the second housing 320 of the electronic device 101 are substantially identical to each other. It may be operated in such a way that the first surface 311 and the third surface 321 face each other in the folded state in the direction (z-axis direction). According to an embodiment, in the unfolded state, the second surface 312 of the first housing 310 and the fourth surface 322 of the second housing 320 of the electronic device 101 are substantially the same. It may be operated to face a direction (−z-axis direction), and in a folded state, the second surface 312 and the fourth surface 322 may face opposite directions to each other. For example, in the folded state, the second surface 312 may face a first direction (z-axis direction), and the fourth surface 322 may face a second direction (−z-axis direction).

According to various embodiments, the first housing 310 is coupled to the first side frame 313 and the first side frame 313 that at least partially form an exterior of the electronic device 101 , and the electronic device 101 . ) may include a first back cover 314 forming at least a portion of the second surface 312 . According to an embodiment, the first side frame 313 includes a first side surface 313a, a second side surface 313b extending from one end of the first side surface 313a, and the other end of the first side surface 313a. A third side surface 313c may be included. According to an embodiment, the first side frame 313 may be formed in a rectangular (eg, square or rectangular) shape through the first side surface 313a, the second side surface 313b, and the third side surface 313c. .

According to various embodiments, the second housing 320 is coupled to the second side frame 323 and the second side frame 323 that at least partially form an exterior of the electronic device 101 , and the electronic device 101 . ) may include a second back cover 324 forming at least a portion of the fourth surface 322 . According to an embodiment, the second side frame 323 includes a fourth side surface 323a, a fifth side surface 323b extending from one end of the fourth side surface 323a, and the other end of the fourth side surface 323b. A sixth side surface 323c may be included. According to an embodiment, the second side frame 323 may be formed in a rectangular shape through the fourth side surface 323a, the fifth side surface 323b, and the sixth side surface 323c.

According to various embodiments, the pair of housings 310 and 320 is not limited to the illustrated shape and combination, and may be implemented by a combination and/or combination of other shapes or parts. For example, the first side frame 313 may be integrally formed with the first rear cover 314 , and the second side frame 323 may be integrally formed with the second rear cover 324 .

According to various embodiments, in the opened state, the electronic device 101 has a certain gap between the second side surface 313b of the first side frame 313 and the fifth side surface 323b of the second side frame 323 . Can be connected without (gap). According to an embodiment, in the electronic device 101, in the unfolded state, the third side surface 313c of the first side frame 313 and the sixth side surface 323c of the second side frame 323 have a certain gap ( can be connected without gap). According to an embodiment, in the unfolded state, the combined length of the second side surface 313b and the fifth side surface 323b of the electronic device 101 is that of the first side surface 313a and/or the fourth side surface 323a. It may be configured to be longer than the length. In addition, the combined length of the third side surface 313c and the sixth side surface 323c may be configured to be longer than the length of the first side surface 313a and/or the fourth side surface 323a.

According to various embodiments, the first side frame 313 and/or the second side frame 323 may be formed of a metal or may further include a polymer injected into the metal. According to one embodiment, the first side frame 313 and/or the second side frame 323 are at least electrically segmented through at least one segmented portion 3161 , 3162 and/or 3261 , 3262 formed of a polymer. It may include one conductive portion 316 and/or 326 . In this case, the at least one conductive portion 316 and/or 326 is electrically connected to a wireless communication circuit (eg, the wireless communication module 192 of FIG. 1 ) included in the electronic device 101 , thereby designating at least one band. It can be used as an antenna operating in (eg, legacy band).

According to various embodiments, the first back cover 314 and/or the second back cover 324 may be, for example, coated or colored glass, ceramic, polymer or metal (eg, aluminum, stainless steel). It may be formed of at least one of steel (STS, stainless steel, or magnesium) or a combination of at least two.

According to various embodiments, the flexible display 300 extends from the first surface 311 of the first housing 310 to at least a portion of the third surface 321 of the second housing 320 across the hinge module. can be arranged as much as possible. For example, the flexible display 300 includes a first flat portion 330a substantially corresponding to the first surface 311 , a second flat portion 330b corresponding to the third surface 321 , and a first flat portion substantially. It may connect the second flat portion 330b to the 330a and include a bendable portion 330c corresponding to the hinge module. According to an embodiment, the electronic device 101 includes a first protective cover 315 (eg, a first protective frame or a first decoration member) coupled along an edge of the first housing 310 . can do. According to an embodiment, the electronic device 101 may include a second protective cover 325 (eg, a second protective frame or a second decorative member) coupled along an edge of the second housing 320 . According to an embodiment, the first protective cover 315 and/or the second protective cover 325 may be formed of a metal or a polymer material. According to an embodiment, the first protective cover 315 and/or the second protective cover 325 may be used as a decorative member. According to an embodiment, the flexible display 300 may be positioned such that an edge of the first flat portion 330a is interposed between the first housing 310 and the first protective cover 315 . According to an embodiment, the flexible display 300 may be positioned such that an edge of the second flat portion 330b is interposed between the second housing 320 and the second protective cover 325 . According to an embodiment, the flexible display 300 may be positioned so that an edge of the flexible display 300 corresponding to the protective cap is protected through a protective cap (not shown) disposed in an area corresponding to the hinge module. Accordingly, the flexible display 300 may have an edge substantially protected from the outside. According to an embodiment, the electronic device 101 supports the hinge module, is exposed to the outside when the electronic device 101 is in a folded state, and is drawn into the first space and the second space when the electronic device 101 is in an unfolded state. It may include a hinge housing 341 (eg, a hinge cover) disposed invisibly from the.

According to various embodiments, the electronic device 101 may include a sub-display 331 (or a first display) (eg, the display 210 of FIG. 2 ) that is separately disposed from the flexible display 300 . According to an embodiment, the sub-display 331 is disposed to be at least partially exposed on the second surface 312 of the first housing 310 , and thus, when in a folded state, replaces the display function of the flexible display 300 . can For example, the sub-display 331 may display status information of the electronic device 101 in the folded state. According to an embodiment, the sub-display 331 may be arranged to be visible from the outside through at least a partial area of the first rear cover 314 . In some embodiments, the sub-display 331 may be disposed on the fourth surface 322 of the second housing 320 . In this case, the sub-display 331 may be disposed to be visible from the outside through at least a partial area of the second rear cover 324 .

According to various embodiments, the electronic device 101 includes an input device 303 (eg, a microphone), sound output devices 301 and 302 , a sensor module 304 , camera devices 305 and 308 , and a key input device. 306 or at least one of a connector port 307 . In the illustrated embodiment, an input device 303 (eg, a microphone), a sound output device 301 , 302 , a sensor module 304 , a camera device 305 , 308 , a key input device 306 and/or a connector The port 307 refers to a hole or shape formed in the first housing 310 or the second housing 320 , but a substantial electronic component ( For example, it can be defined to include an input device, a sound output device, a sensor module, or a camera device).

According to various embodiments, the input device 303 may include at least one microphone 303 disposed in the second housing 320 . In some embodiments, the input device 303 may include a plurality of microphones 303 arranged to sense the direction of the sound. In some embodiments, the plurality of microphones 303 may be disposed at appropriate locations in the first housing 310 and/or the second housing 320 . According to an embodiment, the sound output devices 301 and 302 may include speakers 301 and 302 . According to an embodiment, the speakers 301 and 302 may include a receiver 301 for a call disposed in the first housing 310 and a speaker 302 disposed in the second housing 320 . In some embodiments, the input device 303 , the sound output devices 301 , 302 , and the connector port 307 are provided in a space provided in the first housing 310 and/or the second housing 320 of the electronic device 101 . It may be disposed on the , and may be exposed to the external environment through at least one hole formed in the first housing 310 and/or the second housing 320 . According to an embodiment, at least one connector port 307 may be used to transmit/receive power and/or data to/from an external electronic device. In some embodiments, the at least one connector port 307 (eg, an ear jack hole) may accommodate a connector (eg, an ear jack) for transmitting and receiving audio signals to and from an external electronic device. In some embodiments, the holes formed in the first housing 310 and/or the second housing 320 may be commonly used for the input device 303 and the sound output devices 301 and 302 . In some embodiments, the sound output devices 301 and 302 may include a speaker (eg, a piezo speaker) that is operated while excluding holes formed in the first housing 310 and/or the second housing 320 . have.

According to various embodiments, the sensor module 304 may generate an electrical signal or data value corresponding to an internal operating state of the electronic device 101 or an external environmental state. The sensor module 304 may detect the external environment, for example, through the first surface 311 of the first housing 310 . In some embodiments, the electronic device 101 may further include at least one sensor module disposed to detect an external environment through the second surface 312 of the first housing 310 . According to an embodiment, the sensor module 304 (eg, an illuminance sensor and/or a proximity sensor) is disposed below (eg, under panel) the flexible display 300 through the flexible display 300 to an external environment. may be arranged to detect (eg, as an under display sensor or an in display sensor). According to one embodiment, the sensor module 304 includes a gesture sensor, a gyro sensor, a barometer sensor, a magnetic sensor, an acceleration sensor, a grip sensor ( grip sensor), color sensor (eg, RGB (red, green, blue) sensor), IR (infrared) sensor, biometric sensor, temperature sensor, humidity sensor , an illuminance sensor or an ambient light sensor (ALS), a proximity sensor, and/or an ultrasonic sensor.

According to various embodiments, the camera device 305 , 308 includes a first camera device 305 (eg, a front camera device) and a first housing disposed on the first surface 311 of the first housing 310 . and a second camera device 308 (eg, a rear camera device) disposed on the second side 312 of 310 . The electronic device 101 may further include a flash 309 disposed near the second camera device 308 . According to one embodiment, the camera device 305 , 308 may include one or more lenses, an image sensor, and/or an image signal processor. The flash 309 may include, for example, a luminous element such as a light emitting diode (LED), an IR LED, a semiconductor laser (LD), or a xenon lamp. have. According to an embodiment, the camera devices 305 and 308 have two or more lenses (eg, a wide-angle lens, an ultra-wide-angle lens, or a telephoto lens) and image sensors on one side (eg, a first side) of the electronic device 101 . 311), the second surface 312, the third surface 321, or the fourth surface 322). In some embodiments, the camera device 305 , 308 may include lenses and an image sensor for time of flight (TOF).

According to various embodiments, the key input device 306 (eg, a key button) may be disposed on the third side surface 313c of the first side frame 313 of the first housing 310 . In some embodiments, the key input device 306 may be configured to use at least one of the other sides 313a , 313b of the first housing 310 and/or the sides 323a , 323b , 323c of the second housing 320 . It can also be placed on the side. In some embodiments, the electronic device 101 may not include some or all of the key input devices 306 and the not included key input devices 306 may be in another form, such as soft keys, on the flexible display 300 . may be implemented as In some embodiments, the key input device 306 may be implemented using a pressure sensor included in the flexible display 300 .

According to various embodiments, some camera devices 305 or sensor modules 304 among the camera devices 305 and 308 may be disposed to be exposed through the flexible display 300 . For example, the first camera device 305 or the sensor module 304 may come into contact with the external environment through an opening (eg, a through hole) formed at least partially in the flexible display 300 in the internal space of the electronic device 101 . It can be arranged so that As another example, some sensor modules 304 may be arranged to perform their functions without being visually exposed through the flexible display 300 in the internal space of the electronic device 101 . For example, in this case, in the flexible display 300 , the opening may not be necessary for the area facing the sensor module.

Referring to FIG. 4B , the electronic device 101 may be operated to maintain an intermediate state through a hinge module. In this case, the electronic device 101 may control the flexible display 300 to display different contents in the display area corresponding to the first surface 311 and the display area corresponding to the third surface 321 . . According to an embodiment, the electronic device 101 is substantially unfolded based on a predetermined angle of inflection (eg, an angle between the first housing 310 and the second housing 320 in an intermediate state) through the hinge module. It may be operated in a state (eg, an unfolded state of FIG. 3A ) and/or a substantially folded state (eg, a folded state of FIG. 4A ). For example, when a pressing force is provided in the unfolding direction (B direction) in a state in which the electronic device 101 is unfolded at a predetermined inflection angle through the hinge module, the electronic device 101 enters an unfolded state (eg, the unfolded state of FIG. 3A ). It can be operated to transition. For example, the electronic device 101 is in a folded state (eg, the folded state of FIG. 4A ) when a pressing force is provided in a direction to be folded (direction C) in a state in which it is unfolded at a predetermined inflection angle through the hinge module. may be operated to transition to . In an embodiment, the electronic device 101 may be operated to maintain an unfolded state (not shown) at various angles through a hinge module.

Hereinafter, according to various embodiments, a specific embodiment of controlling a camera device and an operation related to photographing using the camera device based on a physical characteristic in which the electronic device 101 is folded or unfolded will be described.

5 is a diagram schematically illustrating a configuration of an electronic device according to various embodiments of the present disclosure;

For example, FIG. 5 illustrates a camera device (eg, a first camera device 305 (or a front camera device) and a second camera according to a state change of the display 210 in the electronic device 101 according to various embodiments of the present disclosure). device 308 (or rear camera device) and/or display 210 (eg, first display 331 (or sub-display), second display 300 (or main or flexible display)); An example of a state control system 500 that executes (or processes) a function related thereto may be shown.

In various embodiments, state control system 500 is included as a hardware module in at least one processor (eg, processor 120 of FIG. 1 ) including processing circuitry, or software It may be included as a module (software module). According to one embodiment, the state control system 500 according to the embodiment shown in FIG. 5 may be driven as a part of the processor 120 and/or may be a separate hardware configuration operated independently of the processor 120 . have. According to an embodiment, the state control system 500 according to the embodiment shown in FIG. 5 may be software (eg, the program 140 of FIG. 1 ). For example, the state control system 500 in the form of software is stored in the form of instructions (or instructions) in a memory (eg, the memory 130 of FIG. 1 ), and at least one processor (eg, the memory 130 of FIG. 1 ) The operations of the state control system 500 may be executed by the processor 120 of the

Referring to FIG. 5 , the electronic device 101 may include camera devices 305 , 308a , and 308b , a state control system 500 , a buffer 550 , and displays 300 and 331 .

According to an embodiment, the camera devices 305 , 308a and 308b include a first camera device 305 (eg, a front camera device), a second camera device 308a (eg, a first rear camera device), and / or a third camera device 308b (eg, a second rear camera device). According to some embodiments, the electronic device 101 may include at least three or more N camera devices. The camera devices 305 , 308a , and 308b may express various preview angles and/or camera resolutions based on the screen size and/or screen resolution of the displays 300 and 331 on which the preview is provided, for example, a second The camera device 308a and/or the third camera device 308b may include a higher-spec camera device than the first camera device 305 . According to an embodiment, the second camera device 308a and/or the third camera device 308b may be arranged such that a wide-angle lens, an ultra-wide-angle lens, and/or a telephoto lens are positioned on one side of the electronic device 101 . have. For example, the second camera device 308a and/or the third camera device 308b may operate as a camera for the purpose of giving a specific effect, such as bokeh, out-focusing, wide-angle and/or telephoto shooting. have. According to an embodiment, one or more additional cameras may be disposed on the rear surface of the electronic device 101 to provide a user with various camera photographing experiences.

According to an embodiment, the first display 331 may operate as a sub-display of the electronic device 101 . According to an embodiment, the first display 331 stores the image obtained from the camera devices 305, 308a, and 308b in a designated buffer (eg, a first preview buffer 560 (or a sub-preview buffer)). You can display the preview by receiving it through . According to an embodiment, the first display 331 may replace the display function of the second display 300 when the electronic device 101 is in a folded state. According to an embodiment, in the first display 331 , in the unfolded state of the electronic device 101 , an image in which at least a portion of the preview displayed through the second display 300 is cropped or the preview is resized ( resize) (eg, reduced) may be displayed independently or simultaneously with the second display 300 .

According to an embodiment, the second display 300 may operate as a main display of the electronic device 101 . According to an embodiment, the second display 300 receives the image obtained from the camera devices 305 , 308a , and 308b through a designated buffer (eg, the second preview buffer 570 (or the main preview buffer)). A preview can be displayed. According to an embodiment, the second display 300 may operate in an unfolded state, a folded state, or an intermediate state based on a folding axis (eg, axis A of FIGS. 3A to 4B ). According to an embodiment, the second display 300 may operate in an off state when the electronic device 101 is in a folded state. According to an embodiment, the second display 300 may perform a display function corresponding to the unfolded state of the electronic device 101 in the unfolded state. According to an embodiment, the second display 300 may perform a display function corresponding to the intermediate state when the electronic device 101 is in an intermediate state.

According to an embodiment, the buffer 550 includes a first preview buffer 560 that receives images obtained from the camera devices 305 , 308a , and 308b and provides a preview for the first display 331 , and the camera device. The second preview buffer 570 may include a second preview buffer 570 that receives images obtained from 305 , 308a , and 308b and provides a preview for the second display 300 . According to some embodiments, the buffer 550 outputs multiple displays at the same time, and for quick mode conversion, a shared buffer that integrates the first preview buffer 560 and the second preview buffer 570 into one. may include

According to an embodiment, the state control system 500 may be configured to, based on the physical characteristics of the electronic device 101 being folded or unfolded, the camera devices 305 , 308a , 308b , the displays 300 , 331 , and/or Operations related to photographing using the camera devices 305 , 308a , and 308b may be controlled. According to an embodiment, the state control system 500 controls the camera devices 305, 308a, 308b) and/or a function related to controlling the display 210 (eg, the first display 331 and the second display 300) may be executed (or processed).

According to one embodiment, the state control system 500 may include an event monitor 510 and/or a state manager 520 .

According to an embodiment, the event monitor 510 may include a folded state and an unfolded state of the electronic device 101 based on at least one state detection sensor (eg, the sensor module 176 of FIG. 1 ) of the electronic device 101 . Alternatively, an intermediate state can be monitored. According to an embodiment, the state detection sensor includes, for example, a proximity sensor, an illuminance sensor, a magnetic sensor, a hall sensor, a gesture sensor, a bending sensor, an infrared sensor, a touch sensor, a pressure sensor, a gyro sensor, an angle sensor, and a grip sensor. and/or an infrared camera or a combination thereof. According to an embodiment, the state detection sensor may be located on either side of the electronic device 101 (eg, a folding shaft, a housing end, a lower end of the display 210 , such as an under panel, and/or the display 210 ). bezel of the electronic device 101) to measure the unfolding (or folding) angle of the electronic device 101. The unfolding angle is divided by the folding axis of the electronic device 101 (eg, axis A in FIGS. 3A to 4B ). The angle between the two display surfaces (or the housing) and the folding axis may be indicated.

According to an embodiment, the event monitor 510 measures an unfolding angle to determine whether the electronic device 101 is in a fully folded state (eg, a folded state), a fully unfolded state (eg, an unfolded state), or is unfolded at a predetermined angle. It can identify whether it is in a (or collapsed) state (eg, an intermediate state). For example, when the unfolding angle is about 180 degrees or close to the unfolding angle, the event monitor 510 may determine that the display 210 of the electronic device 101 is fully unfolded (eg, unfolded state). As another example, when the unfolding angle is about 0 degrees or close to this, the event monitor 510 may determine that the display 210 of the electronic device 201 is completely folded (eg, in a folded state). . As another example, when the unfolding angle of the event monitor 510 is about 90 degrees or an angle close to it (eg, 80 degrees to about 100 degrees), the display 210 of the electronic device 101 is unfolded to an intermediate degree. (or folded) (eg intermediate state).

According to various embodiments, when the measured unfolding angle is within a predetermined angle range, the event monitor 510 may display ( 210) may be determined to be folded, bent, or unfolded to a predetermined degree. According to an embodiment, the event monitor 510 may provide a monitoring result (eg, state information (or trigger) related to an unfolded state, a folded state, or an intermediate state of the electronic device 101 ) to the state manager 520 . can

According to an embodiment, while the event monitor 510 displays a preview of an image acquired from the camera device 305 , 308a , 308b in operation through the second display 300 , the first display 331 is turned - Events related to turn-on or turn-off can be monitored. For example, the event monitor 510 monitors an on event of the first display 331 while displaying a preview through the second display 300, or monitors the first display 331 and the second display ( 300) while simultaneously displaying previews, an off event of the first display 331 may be monitored. According to an embodiment, the event monitor 510 may provide a monitoring result (eg, status information (or trigger) related to an on or off event) to the status manager 520 .

According to one embodiment, the state manager 520 may be configured to, based on a trigger provided from the event monitor 510 , a camera device 305 , 308a , 308b , a display 300 , 331 , and/or a camera device 305 , Operations related to photographing using 308a and 308b may be controlled. According to an embodiment, the state manager 520 may include a folding/unfolding manager 530 and/or a preview manager 540 .

According to an embodiment, the folding/unfolding manager 530 displays the camera devices 305 , 308a , 308b and/or the displays 300 , 331 of the electronic device 101 , the state (eg, the state of the electronic device 101 ). : Efficient camera mode switching and error handling by performing event processing corresponding to the unfolded state, collapsed state, or intermediate state) or state change experience can be provided.

According to an embodiment, the folding/unfolding manager 530 performs the camera device 305 , 308a , 308b in an unfolded state, a folded state, or an intermediate state of the electronic device 101 based on a trigger of the event monitor 510 . operation and/or operation of the displays 300 and 331 may be controlled. According to an embodiment, the folding/unfolding manager 530 changes a state of the electronic device 101 from an unfolded state to a folded state or an intermediate state, and/or a folded state, based on a trigger of the event monitor 510 . It is possible to identify a state change from the to the unfolded state or an intermediate state, and to control the operation of the camera devices 305 , 308a , and 308b and/or the operation of the displays 300 and 331 based on the identified state change.

For example, when the state of the electronic device 101 is changed, the folding/unfolding manager 530 does not restart the running application (eg, a camera application), and the active camera devices 305 , 308a , and 308b . By controlling the preview interruption, preview loading entry time delay, errors of the camera devices 305, 308a, 308b and/or application errors that occur in the state change of the electronic device 101 by controlling It can provide continuity to the user's experience of using the application. As another example, the folding/unfolding manager 530 sets the operating camera devices 305 , 308a , and 308b in a front camera mode (eg, a selfie mode) or You can make it work in rear camera mode. For example, the folding/unfolding manager 530 operates in a front camera mode through a front camera setting using a rear camera device (eg, the second camera device 308a or the third camera device 308b), or You can set the camera to operate in rear camera mode. According to an embodiment, the folding/unfolding manager 530 changes the Folding State during a process and/or during execution of the camera devices 305 , 308a , and 308b according to a user input in the electronic device 101 . can be continuously monitored, and when the folding state is changed and interrupt control is required, the folding state can be notified through a call back.

According to one embodiment, the folding/unfolding manager 530 receives parameters such as camera resolution, camera identifier (ID) and/or setting information from the event monitor 510 (or camera devices 305, 308a, 308b). can be transmitted, and information of the camera devices 305, 308a, and 308b currently in use (or currently connected) can be received. According to an embodiment, the folding/unfolding manager 530 may provide a screen resolution from the event monitor 510 (or the displays 300 and 331 ) and/or the currently used (or currently connected) displays 300 and 331 . information can be transmitted.

According to an embodiment, the folding/unfolding manager 530 is a necessary camera based on state information (eg, a trigger related to an unfolded state, a folded state or an intermediate state, or a state change trigger) received from the event monitor 510 . Set the properties (or options) of the devices 305, 308a, 308b and/or the displays 300, 331, and view the camera connection information of the currently connected camera devices 305, 308a, 308b. You can use it to handle the necessary tasks. For example, the folding/unfolding manager 530 maintains the application (eg, the camera application) without restarting, and sets the property of the currently connected camera device to correspond to the state change, so that the user is disconnected. It can be configured to provide seamless camera control.

Table 1 below may show, for example, an example of explaining parameters for seamless control of the camera devices 305 , 308a , and 308b in the folding/unfolding manager 520 .

Class CameraFoldStateManager{

boolean mFoldStateEnabled // Folding State call back enable variable
boolean mIsFolded // current folding state

void enable()
void setFoldStateEnabled(boolean enable) // Set folding state enable
void registerListener(FoldStateListener listener) // Register call back
void notifyFoldStateChanged(boolean isFolded) // Function to send call back
...
}

interface FoldStateListener {
void onFoldStateChanged(boolean isFolded) // Function for call back
}
Class HardwareCameraConnection {
int mConnectionState //Current connection information (ex. Preparing, starting, previewing ??)

void onFoldStateChanged(boolean isFolded) // Handling according to Folding State and connection state
}

Class CameraPreviewConnection{
int mCaptureState // Current capture state information (ex. capturing, start, stop, pause, recording??)

void onFoldStateChanged(boolean isFolded) //Processing according to Folding State and Capture State
}

Class ParameterControl{
int mCameraId; // Camera information in use
int mDisplayId // Information about the screen being used
int mResolution // camera resolution in use
void onFoldStateChanged(boolean isFolded) // Set parameters according to Folding State

}

As exemplified in <Table 1>, the Folding State can inform the current Folding State where necessary in each part in the form of a call back. For example, where Folding State is required, connection control (eg, HardwareCameraConnection control in <Table 1>) of camera devices 305, 308a, 308b, and preview control of camera devices 305, 308a, 308b (eg: CameraPreviewConnection control) part of <Table 1> and parameter control (eg, ParameterControl of <Table 1>) part of the camera devices 305, 308a, 308b. The Folding State can be received and applied to the part. According to an embodiment, the folding/unfolding manager 530 may notify the corresponding control part of the call back when a folding state change is detected in the registered call back. After checking the current folding state, the folding/unfolding manager 530 sets at least one of a necessary parameter (eg, camera parameters), a camera identifier (eg, Camera ID), and/or a display identifier (eg, display ID). It can be applied according to the Folding State.

According to an embodiment, when the folding/unfolding manager 530 identifies a state change of the electronic device 101 by the event monitor 510, the attribute ( Examples: camera resolution, standard, wide angle, telephoto, and/or special effects) and/or properties of the connected display 300 , 331 (eg screen size and/or screen resolution) may be identified. For example, the folding/unfolding manager 530 checks a camera connection state and/or a preview state of the currently connected camera devices 305, 308a, and 308b to the corresponding camera devices 305, 308a. , 308b) and/or a preview through the associated display 300, 331 may be controlled.

According to an embodiment, the folding/unfolding manager 530 is displayed on the camera devices 305 , 308a , 308b of the electronic device 101 and the second display 300 based on the intermediate state of the electronic device 101 . It is possible to provide an optimized user experience according to the intermediate state by controlling the position and/or layout of the preview.

According to an embodiment, the folding/unfolding manager 530 is configured to operate while the camera devices 305, 308a, and 308b are operating, based on a trigger related to an intermediate state (eg, table mode) from the event monitor 510, The area of the second display 300 is divided into two areas, a first area and a second area, based on a folding axis (eg, axis A of FIGS. 3A to 4B ), and the first area is a preview area for previewing. , and another second area may be set as a preview-related sub area (eg, a control area, a review area, a sub preview area, or a rear preview area). .

According to an embodiment, the folding/unfolding manager 530 may reconfigure and provide a layout optimized for each area when the state of the electronic device 101 is changed from the unfolded state to the intermediate state. For example, when the folding/unfolding manager 530 transmits state information according to the change to the intermediate state from the event monitor 510 , based on the preview change of the camera devices 305 , 308a , 308b according to the state change. Accordingly, it is possible to automatically provide a change in the properties of the camera devices 305 , 308a , and 308b to provide an optimized user experience even in a state change situation to an intermediate state. According to an embodiment, the change in the properties of the camera devices 305 , 308a , 308b may include, for example, a preview, a focus (or focusing area) positioned on the preview, a tracking object, an ROI (eg, a touch input position). ), and/or the size and location of attributes such as the area of effect application.

Table 2 below shows, for example, camera devices 305, 308a, 308b and/or displays (eg, the second display ( 300)))).

Class LayoutImplement {
Boolean isHalfFolding // current half folding state (or intermediate state)
Object object; // object information detected from the sensor
CameraInstance camInstance; // Current camera information

void changePreviewLayout(); // change preview layout for half-folding state change
void changeObjectInformation(); // change object information for half-folding state change (AF object, effect ROI information etc.)
void changeCameraLayout(); // change camera layout for half-folding state change
...
}

Class CameraInstance {
Rect resolution; // camera resolution in use
int cameraID; // Camera information in use
int zoomLevel; // Zoom level received from user
Rect sensorCrop; // sensor field of view information

Rect getSensorCrop();
Rect getResolution();
void calculateZoom();
...
}

As exemplified in <Table 2>, <Table 2> may indicate an example for describing parameters for providing a user experience according to an intermediate state (or a half-folding state) of the electronic device 101 . Referring to <Table 2>, the LayoutImplement class for preview control includes information on camera devices 305, 308a, and 308b and/or object information detected from sensors (eg, camera devices 305, 308a, 308b), respectively. It is possible to receive and process the necessary parameters through (object information). For example, the parameter of each class may include a camera resolution, a camera identifier, and/or location information of a recognized object.

According to an embodiment, the folding/unfolding manager 530 may identify a state change to an intermediate state based on a trigger of the event monitor 510 while the camera function is being executed in the unfolded state. The folding/unfolding manager 530 determines the properties of the connected camera devices 305, 308a, and 308b based on the state change (eg, the focus position on the preview, the zoom in/out level input by the user, the user maintains the zoom position, preview resolution, and/or ratio information input by , and adjusts the preview and layout to correspond to a new user experience according to the intermediate state, thereby providing a preview to the user as it is in the existing setting state.

According to an embodiment, the folding/unfolding manager 530 divides the display (eg, the second display 300) into two regions (eg, the first region) based on the folded part (eg, the folding axis) in the intermediate state. The second area) may be divided (or divided) and provided as a separate area according to a preset purpose. For example, the folding/unfolding manager 530 provides the first area and the second area as a preview area and a control area, a preview area and a review area, a preview area and a sub preview area, or a preview area and a rear preview area. can do. According to an embodiment, the folding/unfolding manager 530 may include attributes (eg, Focus ROI, tracking object ROI, effect, recognition area, and/or user input location) of the camera device 305 , 308a , 308b in use. and size related information) may be newly calculated to correspond to the changed preview, and related setting information may be updated. The folding/unfolding manager 530 may provide a preview through the divided first area as it is in an existing setting state (eg, a setting state in an unfolded state) by using the updated setting information. The folding/unfolding manager 530 may configure and provide a layout (eg, a layout according to a designated sub-region associated with a preview) required for use of the camera device 305 , 308a , 308b through the divided second region. . According to an embodiment, when the folding/unfolding manager 530 changes the state from the intermediate state to the unfolded state, the display (eg, the second display 300) is set back to one area to configure the preview and layout, , it is possible to update the setting information in the same way as when changing to the intermediate state, and provide a preview as it is in the existing setting state by using the updated setting information.

According to an embodiment, the preview manager 540 may individually display a preview of a currently connected camera device (eg, 305, 308a, or 308b) on the first display 331 or the second display 300, or A function related to controlling to be displayed simultaneously on the first display 331 and the second display 300 may be executed (or processed). According to an embodiment, the preview manager 540 simultaneously controls the first display 331 and the second display 300 while the camera devices 305 , 308a , and 308b are being executed. of the preview can be provided seamlessly. According to an embodiment, the preview manager 540 displays a preview on the first display 331 and a sub-preview related to the preview on the second display 300 while the camera device 305 , 308a , 308b is running. and/or may provide operation information (eg, timer count, presence/absence of palm detection, and/or video recording time) related to the camera devices 305 , 308a and 308b .

According to an embodiment, when the preview manager 540 displays a preview of an image acquired from the camera device 305, 308a, or 308b, based on the folded state, the unfolded state, or the intermediate state of the electronic device 101, A preview may be displayed through the currently connected (or activated) display 300 or 331 . For example, the preview manager 540 may display previews of the camera devices 305 , 308a , and 308b through the first display 331 in the folded state of the electronic device 101 , and the electronic device 101 may Previews of the camera devices 305 , 308a , and 308b may be displayed through the second display 300 in the unfolded state or the intermediate state.

According to an embodiment, the preview manager 540 simultaneously displays the camera device 305 on the first display 331 and the second display 300 based on the trigger of the event monitor 510 in the unfolded state of the electronic device 101 . , 308a, 308b) may be displayed. According to an embodiment, the preview manager 540 may display an image obtained from the camera devices 305 , 308a , and 308b in the unfolded state of the electronic device 101 through the second preview buffer 570 on the second display 300 . , and a preview may be displayed through the second display 300 . According to an exemplary embodiment, the preview manager 540 may display an image obtained from the camera devices 305 , 308a , and 308b while displaying a preview on the second display 300 through the first preview buffer 560 . It may be transmitted to the display 331 , and a preview may be displayed through the first display 331 . According to an embodiment, the preview manager 540 may display an image in which at least a portion of the preview displayed through the second display 300 is cropped or an image in which the preview is resized (eg, reduced). The preview of the second display 300 may be simultaneously displayed through the first display 331 .

According to an embodiment, the preview manager 540 may generate an on/off event of the first display 331 while displaying a preview through the second display 300 in the unfolded state of the electronic device 101 . An interface (or object) (eg, a software button or a toggle button) may be provided, and a trigger according to an on/off event of the first display 331 based on the interface is transmitted from the event monitor 510 to the first display ( 331) can be controlled on/off. According to some embodiments, an interface capable of generating an on/off event of the first display 331 may be provided as a physical button (eg, a hardware key (eg, a key input device 306 )).

According to an embodiment, the preview manager 540 displays the preview on the second display 300 according to the execution of the camera device 305 , 308a , 308b from the first display 331 from the event monitor 510 . ) is transmitted, the first display 331 may be turned on (eg, to supply power to the first display 331), and a preview may be displayed on the first display 331 at the same time. have. According to an embodiment, an off event of the first display 331 is transmitted from the event monitor 510 while the preview manager 540 simultaneously displays previews on the first display 331 and the second display 300 . , the first display 331 is controlled to turn off (eg, to cut off power to the first display 331 ), the preview is not displayed on the first display 331 , and only the second display 300 is You can display a preview. According to an embodiment, when the preview manager 540 displays a preview on the first display 331 , an operation related to the operation of the camera devices 305 , 308a , 308b that can be displayed on the first display 331 . The display of information (eg, timer count, presence or absence of palm detection, and/or information such as video recording time) can also be controlled.

The electronic device 101 according to various embodiments of the present disclosure includes camera devices 305 and 308 , a first display 331 , a second display 300 , and a processor 120 , and the processor ( 120) identifies the state of the electronic device 101 based on the execution of the camera device, and determines the operation mode of the camera device and the execution of the camera device based on the state of the electronic device 101 identify a correspondingly operating display, update a setting of the camera device based at least on an operation mode of the camera device and the identified display, and display a preview obtained from the camera device based on the updated setting It can be displayed through the identified display.

According to various embodiments of the present disclosure, in the first state of the electronic device 101 , the processor 120 determines the camera device as a first operation mode, and based on the determination of the first operation mode, the first operation mode. establish a connection of a display, update a setting of the camera device based on at least the first operation mode and a property of the first display, and display preview data obtained from the camera device based on the updated setting in the first operation mode By transmitting to the first display, the preview may be displayed through the first display.

According to various embodiments, the processor 120 monitors a change in the state of the electronic device 101 and, based on the change in the state of the electronic device 101 , corrects the camera device for each process can be made to do.

According to various embodiments, the processor 120 may perform at least one of a process of connecting the camera device, a preview loading process in a connected state of the camera device, and an image capturing process, Detecting a state change of the electronic device 101, and performing at least one of disconnecting the camera device, refreshing the settings of the camera device, and/or connecting the camera device based on the process in which the change is detected, After the reconnection of the camera device, a preview corrected according to a new setting corresponding to a state change from the camera device may be displayed on a corresponding display.

According to various embodiments of the present disclosure, in the second state of the electronic device 101 , the processor 120 determines the camera device as a second operation mode, and based on the determination of the second operation mode, the second establish a connection of a display, update a setting of the camera device based on at least the second operation mode and a property of the second display, and display preview data obtained from the camera device based on the updated setting as the first By transmitting the second display, it is possible to display the preview through the second display.

According to various embodiments, in the third state of the electronic device 101 , the processor 120 determines the camera device as a third operation mode, and based on the determination of the third operation mode, the camera device is updated based on at least the third operation mode and a property of the second display connected in the third operation mode, and preview data obtained from the camera device based on the updated setting is used in the second operation mode. By transmitting to the display, the preview may be displayed through a designated partial area of the second display.

According to various embodiments, the processor 120 divides the second display into a first area and a second area based on a folding axis based on the determination of the third operation mode, and divides the first area into the camera A preview area for a preview of the device may be provided, and the second area may be provided as a sub-area associated with the preview.

According to various embodiments, the sub-region may be switched to have a different layout based on the operation of the camera device.

According to various embodiments, the processor 120 may update the setting of the camera device in response to a property of the first area of the second display.

According to various embodiments, the processor 120 provides a layout related to an interface for non-interaction with the user in the first area, and provides a layout related to the interface for interacting with the user in the second area. You can provide a layout.

According to various embodiments, the processor 120 identifies a layout related to a sub-region set in the second region based on a preview state or a user setting state of the first region, and selects the first region. A first user interface including the preview may be provided through the user interface, and a second user interface including operation information corresponding to a designated sub area may be provided through the second area.

According to various embodiments, while displaying a preview through the identified display, the processor 120 establishes a connection of another display based on a trigger for displaying a multi-preview, and sets the display and the other display. Previews can be displayed at the same time.

According to various embodiments, the processor 120 detects a trigger for displaying a multi-preview while displaying the main preview through the second display in the second state of the electronic device 101, and obtain a sub preview for the first display from the main preview of a display, display the main preview through the second display, and simultaneously display the sub preview through the first display.

According to various embodiments, the processor 120 may resize an image in which at least a portion of the main preview displayed through the second display is cropped, or the main preview displayed through the second display. The sub-preview may be generated based at least on the (resized) image.

According to various embodiments, the processor 120 may generate an on/off event of the first display based on a user input using a software interface, a physical interface, a voice interface, and/or a gesture interface. Thus, it is possible to detect a trigger for displaying the multi-preview.

According to various embodiments, the processor 120, the first display, is disposed on the rear surface of the electronic device, displays a preview of the camera device in a folded state of the electronic device, and unfolds the electronic device set to selectively display a preview according to an operation mode of the camera device in a state or an intermediate state, wherein the second display is disposed on the front side of the electronic device and is folded, bent, or unfolded based on a designated folding axis includes a flexible display, configured to display a preview of the camera device in an unfolded state or an intermediate state of the electronic device, and the first display and the second display operate at different screen sizes and/or screen resolutions can do.

Hereinafter, a method of operating the electronic device 101 according to various embodiments will be described in detail. According to various embodiments, operations performed by the electronic device 101 to be described below include at least one processor (eg, the processor 120 of FIG. 1 ) including at least one processing circuit of the electronic device 101 . ) (or the state manager 520 of Fig. 5) (hereinafter referred to as a 'processor 120'). According to an embodiment, operations performed by the electronic device 101 may include a memory (eg, : It is stored in the memory 130 of FIG. 1 (hereinafter referred to as 'memory 130') and, when executed, may be executed by instructions that cause the processor 120 to operate.

6 is a flowchart illustrating a method of operating an electronic device according to various embodiments of the present disclosure;

Referring to FIG. 6 , in operation 601 , the processor 120 of the electronic device 101 performs a camera device (eg, a front camera device 305 (or a first camera device 305 or a rear camera device 308 ) (or the second camera device 308. According to an embodiment, the processor 120 controls the user's camera devices 305 and 308 in the folded state, the unfolded state, or the intermediate state of the electronic device 101 . Based on the executing user input, the camera device 305, 308 may be executed. For example, the processor 120 identifies the camera device 305, 308 corresponding to the user input, and the corresponding camera device 305 , 308 may perform camera connection.

In operation 603 , the processor 120 may monitor a state change of the electronic device 101 based on the execution of the camera devices 305 and 308 . For example, the processor 120 monitors whether the electronic device 101 is in a folded state, an unfolded state, or an intermediate state, and changes a state from one state to another (eg, a state change from a folded state to an unfolded state). Alternatively, the state change from the unfolded state -> the folded state, the state change from the folded or unfolded state -> the intermediate state) can be monitored. According to an embodiment, the processor 120 determines whether the electronic device 101 is in a folded state, an unfolded state, or Intermediate status can be monitored. According to an embodiment, the processor 120 measures an unfolded (or folded) angle of the electronic device 101 based on sensor data of the state detection sensor, so that the electronic device 101 is in a fully folded state (eg, a folded state). ), a fully unfolded state (eg, an unfolded state), or an unfolded (or folded) state at an angle (eg, an intermediate state). According to an embodiment, when the measured unfolding angle is within a predetermined angle range based on data obtained from at least one sensor of the state detection sensor, the processor 120 is configured to perform the display 210 of the electronic device 101 . It may be determined that (eg, the second display 300 ) is folded, bent, or unfolded to a predetermined degree.

In operation 605, the processor 120 may identify an operation mode related to the state change. According to an embodiment, the processor 120 identifies an operation mode related to the control of the camera devices 305 and 308 and/or the displays 300 and 331 based on the status information or status change information according to the monitoring result. can do. For example, the processor 120 determines a first operation mode (eg, a front camera mode or a selfie mode) based on the folded state of the electronic device 101 , and the second operation mode based on the unfolded state of the electronic device 101 . A second operation mode (eg, a rear camera mode) may be determined, and a third operation mode (eg, a table mode) may be determined based on the intermediate state of the electronic device 101 .

In operation 607 , the processor 120 may process an operation related to the camera devices 305 and 308 and/or the displays 300 and 331 based on the identified operation mode. According to an embodiment, the processor 120 may update (or reset or reconfigure) the properties of the camera devices 305 and 308 and/or the properties of the displays 300 and 331 to correspond to the identified operation mode. According to various embodiments, a specific embodiment of processing an operation related to the camera devices 305 and 308 and/or the displays 300 and 331 based on the state or a change in the state of the electronic device 101 will be described later with reference to the drawings. is explained by

7 is a flowchart illustrating a method of operating an electronic device according to various embodiments of the present disclosure;

Referring to FIG. 7 , in operation 701 , the processor 120 of the electronic device 101 may execute a camera device (eg, a rear camera device 308 or a second camera device 308 ). According to an embodiment, the processor 120 may execute the camera device 308 based on a user input for executing the camera device 308 of the user in the folded state, the unfolded state, or the intermediate state of the electronic device 101 . have. For example, the processor 120 may identify the camera device 308 corresponding to the user input and perform camera connection of the corresponding camera device 308 .

In operation 703 , the processor 120 may identify the state of the electronic device 101 (or the second display 300 of the electronic device 101 ) based on the execution of the camera device 308 . According to an embodiment, the processor 120 determines whether the electronic device 101 is in a first state (eg, a folded state), a second state (eg, an unfolded state), or a second state based on the sensor data of the state detection sensor. It is possible to identify whether it is a 3 state (eg, an intermediate state).

In operation 703 , when the processor 120 identifies a first state (eg, a folded state) of the electronic device 101 , in operation 711 , the camera device 308 is executed as a mode for executing the designated first operation mode. can decide According to an embodiment, the first operation mode may include, for example, a state in which the camera device 308 is used in a front camera mode (or a selfie mode). According to an embodiment, the processor 120 may execute the first display 331 based on the determination of the first operation mode of the camera device 308 . For example, the processor 120 may connect the first display 331 .

In operation 713 , the processor 120 may identify a specified first setting value for setting the setting of the camera device 308 to correspond to the first operation mode, based on the determination of the first operation mode. For example, the first setting value is optimized for the properties (eg, screen size and/or screen resolution) of the display (eg, the first display 331 ) to which the camera device 308 is currently connected in the first operating mode. information (or parameters) (eg, camera resolution, standard, wide-angle, telephoto, and/or special shooting effects) specified for outputting the preview. For example, the first setting value may include a setting value for operating the camera device 308 in a front camera mode (or a selfie mode).

In operation 715 , the processor 120 may set a property (or option) of the camera device 308 based on the first setting value. For example, the processor 120 may configure a first attribute (eg, camera resolution, standard, wide-angle, telephoto, and/or special shooting effect) of the currently connected camera device 308 to be configured to operate in the first mode of operation. It can be updated with the set value.

In operation 717 , the processor 120 may obtain preview data from the camera device 308 . According to an embodiment, the processor 120 may transfer the image obtained from the camera device 308 to a designated buffer (eg, the first preview buffer 560 ).

In operation 719 , the processor 120 may provide a user interface through the currently connected first display 331 . According to an embodiment, the processor 120 displays the preview generated in the first preview buffer 560 through the first display 331 , and related operation information (eg, timer count, presence or absence of palm detection, and/or video recording time). For example, the first display 331 may receive preview data obtained from the camera device 308 through the first preview buffer 560 to display a preview.

In operation 703 , when the processor 120 identifies the second state (eg, unfolded state) of the electronic device 101 , in operation 731 , the processor 120 selects the designated second operation mode as a mode for executing the camera device 308 . can decide According to an embodiment, the second operation mode may include, for example, a state of using the camera device 308 as a rear camera mode. According to an embodiment, the processor 120 may execute the second display 300 based on the determination of the second operation mode of the camera device 308 . For example, the processor 120 may connect the second display 300 .

In operation 733 , the processor 120 may identify a specified second setting value for setting the setting of the camera device 308 to correspond to the second operation mode, based on the determination of the second operation mode. For example, the second setting value is optimized for the properties (eg, screen size and/or screen resolution) of the display (eg, the second display 300 ) to which the camera device 308 is currently connected in the second operating mode. information (or parameters) (eg, camera resolution, standard, wide-angle, telephoto, and/or special shooting effects) specified for outputting the preview. For example, the second setting value may include a setting value for operating the camera device 308 in the rear camera mode.

In operation 735 , the processor 120 may set a property (or option) of the camera device 308 based on the second setting value. For example, the processor 120 may set the properties of the currently connected camera device 308 (eg, camera resolution, standard, wide angle, telephoto, and/or special effects) to a second mode designated to operate in the second mode of operation. It can be updated with the set value.

In operation 737 , the processor 120 may obtain preview data from the camera device 308 . According to an embodiment, the processor 120 may transfer the image obtained from the camera device 308 to a designated buffer (eg, the second preview buffer 570 ).

In operation 739 , the processor 120 may provide a user interface through the currently connected second display 300 . According to an embodiment, the processor 120 displays the preview generated in the second preview buffer 570 through the second display 300 , and related operation information (eg, timer count, palm detection presence or absence, option setting information). , menu object, shooting object and/or video recording time). For example, the second display 300 may receive preview data obtained from the camera device 308 through the second preview buffer 570 and display the preview.

In operation 703 , when the processor 120 identifies a third state (eg, an intermediate state) of the electronic device 101 , in operation 751 , the processor 120 selects the designated third operation mode as a mode for executing the camera device 308 . can decide According to one embodiment, the third mode of operation is, for example, the camera device 308 into the rear camera mode (or the front camera mode by the front camera device 305 according to a user setting of the electronic device 101). operation and may include a state in which the electronic device 101 is used in the table mode. According to an embodiment, the processor 120 may execute the second display 300 based on the determination of the third operation mode of the camera device 308 . For example, the processor 120 may connect the second display 300 . According to some embodiments, in the intermediate state, the second display 300 may be already connected (eg, in use).

According to some embodiments, the electronic device 101 changes a state from a first state (eg, a folded state) to a third state (eg, an intermediate state) or a third state (eg, a second state (eg, an unfolded state)) : Intermediate state), the display may be different from the currently connected camera device. For example, when the state changes from the first state to the third state, the currently connected (or used) device may be the second camera device 308 (eg, a rear camera device) and the first display 331 . have. As another example, when the state changes from the second state to the third state, the currently connected (or used) device is the first camera device 305 (eg, front camera device) according to the camera device used by the user. Alternatively, it may be the second camera device 308 (eg, a rear camera device) and the second display 300 .

In operation 753 , the processor 120 may identify a specified third setting value for setting the setting of the camera device 308 to correspond to the third operation mode, based on the determination of the third operation mode. For example, the third setting value is optimized for the properties (eg, screen size and/or screen resolution) of the display (eg, the second display 300 ) to which the camera device 308 is currently connected in the third operation mode. information (or parameters) (eg, camera resolution, standard, wide-angle, telephoto, and/or special shooting effects) specified for outputting the preview. For example, the third setting value may include a setting value for operating the camera device 308 in the rear camera mode, and may include a setting that is the same as or similar to the second setting value. According to some embodiments, the third setting value is set according to whether the currently connected camera device is the first camera device 305 (eg, a front camera device) or the second camera device 308 (eg, a rear camera device). Other setting values (eg, fourth setting values) may be included.

In operation 755 , the processor 120 may set a property (or option) of the camera device 308 based on the third setting value. For example, the processor 120 may set the properties of the currently connected camera device 308 (eg, camera resolution, standard, wide angle, telephoto, and/or special shooting effect) to a third mode designated to operate in the third mode of operation. It can be updated with the set value.

In operation 757 , the processor 120 may configure the layout of the second display 300 by region division. According to an embodiment, the processor 120 divides (or divides) the area of the second display 300 into a first area and a second area based on a folding axis (eg, axis A of FIGS. 3A to 4B ). In addition, the first area may be provided as a preview area for preview, and the second area may be provided as a preview-related sub area (eg, a control area, a review area, a sub preview area, or a rear preview area). For example, the processor 120 may provide the first area and the second area as a preview area and a control area, a preview area and a review area, a preview area and a sub preview area, or a preview area and a back preview area. According to one embodiment, the processor 120 may change the properties of the camera device 308 in use (eg, information related to the location and size of the focus ROI, tracking object ROI, effect, recognition area, and/or user input) of the camera device 308 in use. It is also possible to update the related setting information by performing a new calculation to correspond to the preview. For example, the processor 120 may provide a preview through the divided first area as it is in an existing setting state (eg, a setting state in an unfolded state) by using the updated setting information.

In operation 759 , the processor 120 may obtain preview data from the camera device 308 . According to an embodiment, the processor 120 may transfer the image obtained from the camera device 308 to a designated buffer (eg, the second preview buffer 570 ).

In operation 761 , the processor 120 may provide a user interface through the currently connected second display 300 . According to an embodiment, the processor 120 displays the preview generated in the second preview buffer 570 through the first area of the second display 300 , and displays related operation information on the second display of the second display 300 . It can be displayed through two areas. For example, the second display 300 may receive preview data obtained from the camera device 308 through the second preview buffer 570 and display the preview through the first area.

According to various embodiments, the processor 120 may connect the first display 331 while displaying a preview through the connected second display 300 in the unfolded state or the intermediate state of the electronic device 101 , , an operation of simultaneously displaying a preview through the first display 331 and the second display 300 may be performed.

8 is a flowchart illustrating a method of operating an electronic device according to various embodiments of the present disclosure;

According to an embodiment, FIG. 8 shows a front camera mode through a setting used for a front camera using a rear camera device 308 (eg, a second camera device 308) in a state in which the electronic device 101 is folded. (or an example of operating in a selfie mode) may be shown.

Referring to FIG. 8 , in operation 801 , the processor 120 of the electronic device 101 may detect a folded state of the electronic device 101 . For example, the processor 120 may identify the state of the electronic device 101 based on a trigger for executing the camera device 308 , and determine the folded state of the electronic device 101 based on the identification result. can

In operation 803 , the processor 120 may determine a designated first operation mode as a mode for executing the camera device 308 based on the detection of the folded state. According to an embodiment, the first operation mode may include, for example, a state in which the camera device 308 is used in a front camera mode (or a selfie mode). According to an embodiment, the processor 120 may connect the first display 331 based on the determination of the first operation mode of the camera device 308 .

In operation 805 , the processor 120 may identify a first option assigned to the first operation mode. For example, the processor 120 may identify a first option designated for using the camera device 308 for a front-facing camera. For example, the first option may include various setting values (eg, timer, flash, flip, beauty, brightness) for use for the front camera of the camera device 308 . , focusing (AF), effect and/or quality).

In operation 807 , the processor 120 may perform image control for use for the front camera based on the first option to be identified. For example, the processor 120 controls the camera device 308 to operate according to the first operation mode (eg, image sensor control) to flip the image left and right (or reverse the left and right 180 degrees). can do.

In operation 809 , the processor 120 may perform image quality control for the front camera based on the identified first option. For example, the processor 120 may perform a beauty level, a brightness level, AF, front image quality tuning, shooting effect and/or face distortion correction and The same at least one image quality control may be performed. According to various embodiments, operations 807 and 809 are not limited to the illustrated order, and operations 807 and 809 may be performed sequentially, in parallel, in reverse order, or heuristically.

In operation 811 , the processor 120 may output a preview for the front camera through the first display 331 . According to an embodiment, the processor 120 may provide a preview in which the preview data obtained from the camera device 308 is controlled to an image and quality corresponding to the front camera through the first display 331 . An example of this is shown in FIG. 12A, which will be described later.

In operation 813 , the processor 120 may perform a photographing operation based on a user input. For example, the processor 120 may perform a capturing operation based on a controlled image and image quality based on a user input related to capturing an image or moving picture.

9 is a flowchart illustrating a method of operating an electronic device according to various embodiments of the present disclosure;

According to an exemplary embodiment, FIG. 9 shows a rear camera through a setting used for a rear camera using the rear camera device 308 (eg, the second camera device 308) in a state in which the electronic device 101 is unfolded. An example of operating in a mode can be shown.

Referring to FIG. 9 , in operation 901 , the processor 120 of the electronic device 101 may detect an unfolded state of the electronic device 101 . For example, the processor 120 may identify the state of the electronic device 101 based on a trigger for executing the camera device 308 , and determine the unfolded state of the electronic device 101 based on the identification result. can

In operation 903 , the processor 120 may determine a designated second operation mode as a mode for executing the camera device 308 based on the detection of the unfolded state. According to an embodiment, the second operation mode may include, for example, a state of using the camera device 308 as a rear camera mode. According to an embodiment, the processor 120 may connect the second display 300 based on the determination of the second operation mode of the camera device 308 .

In operation 905 , the processor 120 may identify a second option assigned to the second operation mode. For example, the processor 120 may identify a second option designated for using the camera device 308 for a rear camera purpose. For example, the second option may include various setting values for use for the rear camera of the camera device 308 (eg, timer, flash, beauty, brightness, focusing (AF)). , effect and/or quality).

In operation 907 , the processor 120 may perform image control for use for the rear camera based on the second option to be identified. For example, the processor 120 controls the camera device 308 (eg, image sensor control) to flip the image left and right (or reverse the left and right 180 degrees) so that the camera device 308 operates according to the second operation mode. Image control can be performed without

In operation 909 , the processor 120 may perform image quality control for the rear camera based on the identified second option. For example, the processor 120 may perform a beauty level, a brightness level, AF, front image quality tuning, shooting effect and/or face distortion correction and The same at least one image quality control may be performed. According to various embodiments, operations 907 and 909 are not limited to the illustrated order, and operations 907 and 909 may be performed sequentially, in parallel, in reverse order, or heuristically.

In operation 911 , the processor 120 may output a preview for the rear camera through the second display 300 . According to an embodiment, the processor 120 may provide a preview in which the preview data obtained from the camera device 308 is controlled to an image and quality corresponding to the rear camera through the second display 300 . An example of this is shown in FIG. 12B, which will be described later.

In operation 913 , the processor 120 may perform a photographing operation based on a user input. For example, the processor 120 may perform a capturing operation based on a controlled image and image quality based on a user input related to capturing an image or moving picture.

10 is a flowchart illustrating a method of operating an electronic device according to various embodiments of the present disclosure;

According to an embodiment, FIG. 10 illustrates a camera device according to a state change of the electronic device 101 while the camera device 308 (eg, a rear camera device) is executed in a folded state or an unfolded state of the electronic device 101 . An example of correcting the setting of (308) can be shown.

Referring to FIG. 10 , in operation 1001 , the processor 120 of the electronic device 101 may detect a user input related to the execution of the camera device 308 .

In operation 1003 , the processor 120 may execute the state manager 520 based on a user input executing the camera device 308 . According to an embodiment, the state manager 520 monitors the state and state change of the electronic device 101 , and based on the state or state change of the electronic device 101 , the camera devices 305 , 308 , and the display 300 . , 331 ), and/or an operation related to photographing using the camera devices 305 and 308 may be controlled. According to an embodiment, in operation 1003 , the camera device 308 may be in a state before being connected, and after operation 1003 , a process until the camera device 308 is substantially connected (or activated) is performed. can indicate

In operation 1005 , the processor 120 may identify the state of the electronic device 101 and/or monitor the state change based on the state manager 520 .

In operation 1007 , the processor 120 may control a corresponding operation based on the identified state of the electronic device 101 . According to an embodiment, the processor 120 may start the above-described operation of FIG. 8 based on the folded state or the above-described operation of FIG. 9 based on the unfolded state. For example, the processor 120 may use the camera device 308 to operate in the front camera mode through the front camera setting or in the rear camera mode through the rear camera setting. According to various embodiments, the processor 120 starts an operation corresponding to the state of the electronic device 101 and, while sequentially performing a process corresponding to the operation, is based on the state manager 520 . Thus, it is possible to continuously monitor the state change of the electronic device 101 .

In operation 1009 , while controlling an operation corresponding to the state of the electronic device 101 , the processor 120 may detect a change in the state of the electronic device 101 based on monitoring of the state manager 520 . For example, the processor 120 may cause the electronic device 101 to change a state from a first state (eg, a folded state) to a second state (eg, an unfolded state), and a third state from the first state (eg, a folded state). A state change to a state (eg, an intermediate state), or a first state (eg, a folded state) from a second state (eg, an unfolded state) or a third state (eg, an intermediate state) may be detected.

In operation 1011 , the processor 120 may perform a process-specific correction of the camera device 308 based on the detection of a state change of the electronic device 101 . According to an embodiment, the processor 120 may continuously monitor a state change during and/or during the execution of the camera device 308 through the state manager 520 , and respond to the state change. Accordingly, when interrupt control is required, the current state change can be notified to the necessary place through call back. For example, where a call back is required, the connection control of the camera device 308 (eg, HardwareCameraConnection control in <Table 1>) part, the preview control of the camera device 308 (eg, CameraPreviewConnection control in <Table 1>) As a part, parameter control of the camera device 308 (eg, ParameterControl in <Table 1>) part, the processor 120 may notify a necessary part of a state change in the form of a call back. According to an embodiment, the processor 120 sets the camera device 308 (eg, a parameter (eg, camera parameters), a camera identifier (eg, Camera ID)), and/or a display identifier (eg, : display ID) can be set (or updated) to correspond to the changed current state. According to an embodiment, the processor 120 may provide a corresponding preview through image and/or image quality control based on the setting according to the correction after correcting the camera device 308 to a setting corresponding to the state change. have. According to an exemplary embodiment, correction for each process will be described with reference to FIG. 11, which will be described later.

In operation 1013 , the processor 120 may control to display a preview through a designated display. According to an embodiment, the processor 120 may display a preview on the first display 331 or the second display 300 individually, or simultaneously on the first display 331 and the second display 300 . . According to an embodiment, the processor 120 disconnects the first display 331 and connects the second display 300 when the electronic device 101 changes state from the first state to the second state, 2 It is possible to control to display a preview through the display 300 . According to another embodiment, when the electronic device 101 changes state from the second state to the first state, the processor 120 disconnects the second display 300 and connects the first display 331 to the first 1 It is possible to control to display a preview through the display 331 . According to another embodiment, when the state is changed from the first state to the second state, the processor 120 maintains the connection of the first display 331 and connects the second display 300 to the first display 331 and It is possible to control to simultaneously display previews through the second display 300 .

11 is a flowchart illustrating a method of operating an electronic device according to various embodiments of the present disclosure;

According to an embodiment, FIG. 11 may show an example of performing correction for each process of the camera device 308 based on detection of a state change in the process of executing the camera device 308 .

Referring to FIG. 11 , in operation 1101 , the processor 120 of the electronic device 101 may detect a state change of the electronic device 101 .

In operation 1103 , the processor 120 may determine whether the camera device 308 is connected based on the detection of a state change. For example, when the processor 120 detects a state change in the process of executing the camera device 308 based on a user input, the processor 120 identifies whether the camera device 308 is substantially connected (or activated). can do.

In operation 1103 , when the camera device 308 is in an unconnected state (eg, 'No' in operation 1103 ), in operation 1113 , the processor 120 refreshes the settings of the camera device 308 (or parameters). can be reset). For example, when a state change occurs while the camera device 308 is connected (or before connection), the processor 120 uses a new setting corresponding to the state change to connect (eg, connect the camera device 308) to the camera device 308 . : hardware camera connection).

In operation 1103 , when the camera device 308 is in a connected state (eg, 'Yes' in operation 1103 ), in operation 1105 , the processor 120 may determine whether preview loading is complete. have. For example, when a state change occurs while the camera device 308 is connected, the processor 120 may identify whether the preview loading by the currently connected camera device 308 has been completed.

In operation 1105 , the processor 120 shuts down (or disconnects) the connection of the camera device 308 in operation 1111 when preview loading is not completed (eg, 'No' in operation 1105 ). )) can do. According to an embodiment, when a state change occurs during preview loading, the processor 120 may disconnect the currently connected camera device 308 (eg, hardware camera disconnection).

In operation 1113 , the processor 120 may refresh settings (or reset parameters) of the camera device 308 . For example, when a state change occurs during preview loading, the processor 120 disconnects the camera device 308 and connects (eg, the camera device 308) using a new setting corresponding to the state change. : hardware camera connection). An example of this is shown in Example A of FIG. 12C , which will be described later.

In operation 1105 , when preview loading is completed (eg, 'Yes' in operation 1105 ), in operation 1107 , the processor 120 may determine whether image capturing is being performed. For example, when a state change occurs in a state in which preview loading is completed, the processor 120 may identify whether image capturing is being performed by the currently connected camera device 308 .

In operation 1107 , when image capturing is not being performed (eg, 'No' in operation 1107 ), the processor 120 may proceed to operation 1111 and perform operations 1111 and subsequent operations.

In operation 1107 , when image capturing is being performed (eg, 'Yes' in operation 1107 ), in operation 1121 , the processor 120 may wait until capturing is completed. According to an embodiment, when an image (eg, a photo or a video) is being captured by the currently connected camera device 308 , the processor 120 does not immediately shut down the connection of the camera device 308 and completes the shooting. By waiting until , the captured photographing data may be stored in a memory (eg, the memory 130 of FIG. 1 ).

In operation 1111 , the processor 120 may shut down (or disconnect) the connection of the camera device 308 . According to an embodiment, when a state change occurs during image capturing, the processor 120 does not immediately shut down the connection of the camera device 308, but stores the captured data until now (or so far) and then The device 308 may be disconnected (eg, hardware camera disconnection). According to an embodiment, after disconnection of the camera device 308 , the processor 120 may proceed to operation 1113 and perform operations 1113 and subsequent operations. An example of this is shown in Example B of FIG. 12C , which will be described later.

In operation 1115 , after operation 1113 , the processor 120 may display a preview based on preview data obtained according to a new setting corresponding to a state change from the camera device 308 .

12A, 12B, and 12C are diagrams for explaining an example in which a camera device and a display operate in an electronic device according to various embodiments of the present disclosure;

Referring to FIG. 12A , FIG. 12A shows a front camera mode (or selfie mode) used for a front camera using a camera device 308 (eg, at least one of a rear camera device) in a folded state of the electronic device 101 . ) can be used as an example.

12A , the electronic device 101 may output a preview 1210 for the front camera through the first display 331 . According to an embodiment, the processor 120 may provide a preview 1210 in which the preview data obtained from the camera device 308 is controlled to an image and quality corresponding to the front camera through the first display 331 . have. According to an embodiment, when the electronic device 101 displays the preview 1210 on the first display 331 , operation information related to the operation of the camera device 308 that can be displayed on the first display 331 . 1220 (eg, information such as timer count, presence or absence of palm detection, and/or video recording time) may be provided together.

Referring to FIG. 12B , FIG. 12B shows an example of operating in the rear camera mode used for the rear camera using the camera device 308 (eg, at least one of the rear camera devices) in the unfolded state of the electronic device 101 . can represent

12B , the electronic device 101 may output a preview 1230 for the rear camera through the second display 300 . According to an embodiment, the electronic device 101 may provide a preview 1230 in which the preview data obtained from the camera device 308 is controlled to an image and image quality corresponding to the rear camera through the second display 300 . can In FIG. 12B , the front camera device 305 (eg, the first camera device 305 ) may be in an unconnected (or deactivated) state.

Referring to FIG. 12C , FIG. 12C shows a camera device 308 (eg, at least one of the rear camera devices) being loaded (eg, preview loading) (eg, Example A), or a camera device 308 (eg, : At least one of the rear camera devices) is connected and the electronic device 101 changes from a folded state to an unfolded state while shooting (eg, taking a selfie) using the camera device 308 (eg, Example B) An example that operates according to can be shown. In FIG. 12C , the front camera device 305 (eg, the first camera device 305) may be in an unconnected (or deactivated) state.

Referring to Example A of FIG. 12C , in Example A, a preview may not be displayed on the first display 331 . For example, in the folded state, the electronic device 101 may be in a state in which the preview is loaded by connecting the camera device 308 based on a user input (eg, taking a selfie). According to an embodiment, when a state change to the unfolded state is detected while the preview is being loaded, the electronic device 101 may forcibly shut down a connection (eg, a hardware camera connection) of the camera device 308 . According to an embodiment, when a state change occurs during preview loading, the electronic device 101 disconnects the currently connected camera device 308 (eg, hardware camera disconnection), and By refreshing the setting (or resetting the parameter), the camera device 308 may be connected (eg, hardware camera connection) using the new setting corresponding to the state change.

Referring to Example B of FIG. 12C , in Example B, a preview 1310 may be displayed on the first display 331 . For example, the electronic device 101 may be in a state in which the camera device 308 is connected in a folded state to complete preview loading, and image capture is performed in response to a user input. According to an embodiment, when the electronic device 101 detects a state change to the unfolded state while capturing an image (eg, a photo or a video) by the currently connected camera device 308, the camera device 308 Without immediately shutting down the connection, disconnection of the camera device 308 (eg, hardware camera disconnection) may be performed after photographing is completed. Thereafter, the electronic device 101 refreshes the settings of the camera device 308 (or resets parameters), and connects the camera device 308 (eg, hardware camera connection) using the new settings corresponding to the state change. can be done

After the operation according to Example A or Example B, the electronic device 101 provides preview data obtained according to a new setting corresponding to a state change from the camera device 308 as a preview 1330 through the second display 300 . can do.

According to various embodiments, the electronic device 101 may provide an efficient camera mode switching experience by using the camera device 308 to process a state or an event according to a state change of the electronic device 101 . According to an embodiment, the electronic device 101 may provide a seamless camera use experience to the user when a state of the camera device 308 is changed from a folded state to an unfolded state by the user during operation of the camera device 308 . . For example, the electronic device 101 may prevent an unexpected camera error and/or an application (eg, a camera application) failure by controlling an error that may occur according to a state change in advance.

13 is a flowchart illustrating a method of operating an electronic device according to various embodiments of the present disclosure;

According to an embodiment, FIG. 13 illustrates an example of providing a user interface according to an intermediate state of the electronic device 101 while the camera device 308 (eg, a rear camera device) of the electronic device 101 is running. can

Referring to FIG. 13 , in operation 1301 , the processor 120 of the electronic device 101 may monitor a state change of the electronic device 101 .

In operation 1303 , the processor 120 may detect an intermediate state of the electronic device 101 based on the monitoring result.

In operation 1305 , the processor 120 may determine a third operation mode designated as the mode for executing the camera device 308 based on the intermediate state detection. According to one embodiment, the third mode of operation is, for example, the camera device 308 into the rear camera mode (or the front camera mode by the front camera device 305 according to a user setting of the electronic device 101). operation and may include a state in which the electronic device 101 is used in the table mode. According to an embodiment, the processor 120 may execute the second display 300 based on the determination of the third operation mode of the camera device 308 . For example, the processor 120 may connect the second display 300 . According to some embodiments, in the intermediate state, the second display 300 may be already connected (eg, in use).

In operation 1307 , the processor 120 may configure a designated layout based on the third operation mode. According to an embodiment, the processor 120 may configure the layout of the second display 300 by region division. For example, the processor 120 divides (or divides) the area of the second display 300 into a first area and a second area based on a folding axis (eg, axis A in FIGS. 3A to 4B ), The first area may be provided as a preview area for preview, and the second area may be provided as a preview-related sub area (eg, a control area, a review area, a sub preview area, or a rear preview area).

In operation 1309 , the processor 120 may display a user interface. According to an embodiment, the processor 120 divides the first area and the second area into which the second display 300 is divided, a preview area and a control area, a preview area and a review area, a preview area and a sub preview area, or a preview area. It can be provided as an area and a rear preview area. An example of this is shown in Figures 15A to 16E, which will be described later.

14 is a flowchart illustrating a method of operating an electronic device according to various embodiments of the present disclosure;

According to an embodiment, FIG. 14 illustrates a camera device according to a state change (eg, an intermediate state) of the electronic device 101 while the camera device 308 (eg, a rear camera device) of the electronic device 101 is running. An example of correcting settings related to the execution of 308 and configuring the layout of the display 300 may be shown.

Referring to FIG. 14 , in operation 1401 , the processor 120 of the electronic device 101 may determine a table mode (eg, a third operation mode). According to an embodiment, the processor 120 switches to an intermediate state of the electronic device 101 based on the state manager 520 while the electronic device 101 executes the camera device 308 in the folded state or the unfolded state. state changes can be identified.

According to an embodiment, the processor 120 may execute the second display 300 based on the table mode determination of the camera device 308 . For example, the processor 120 may connect the second display 300 . According to some embodiments, in the intermediate state, the second display 300 may be already connected (eg, in use). According to some embodiments, the electronic device 101 changes a state from a first state (eg, a folded state) to a third state (eg, an intermediate state) or a third state (eg, a second state (eg, an unfolded state)) : Intermediate state), the display may be different from the currently connected camera device. For example, when the state changes from the first state to the third state, the currently connected (or used) device may be the second camera device 308 (eg, a rear camera device) and the first display 331 . have. As another example, when the state changes from the second state to the third state, the currently connected (or used) device is the first camera device 305 (eg, front camera device) according to the camera device used by the user. Alternatively, it may be the second camera device 308 (eg, a rear camera device) and the second display 300 .

In operation 1403 , the processor 120 may divide the area of the second display 300 into a first area and a second area based on a folded portion according to an intermediate state. According to an embodiment, the processor 120 divides (or divides) the second display 300 into two regions (eg, a first region and a second region) based on a folded portion (eg, a folding axis) in an intermediate state. ) to provide a separate area according to the purpose set in advance. For example, the processor 120 may provide the first area and the second area as a preview area and a control area, a preview area and a review area, a preview area and a sub preview area, or a preview area and a back preview area.

In operation 1405 , the processor 120 may identify attribute information of the camera device 308 based on the table mode determination of the electronic device 101 . According to an embodiment, the processor 120 determines, based on the table mode determination, a designated setting value for setting the settings of the camera device 308 to correspond to the table mode, and a display (eg, a second display) that can be used in the table mode. 2 The properties (eg, screen size and/or screen resolution) of the display 300 ) may be identified.

In operation 1407 , the processor 120 may update attribute (or option) information of the camera device 308 based on the first area for preview. For example, the processor 120 operates by optimizing the properties (eg, camera resolution, standard, wide-angle, telephoto, and/or special shooting effect) of the currently connected camera device 308 to the first area in the table mode. You can update the attribute information to do so. For example, the processor 120 may store attributes of the camera device 308 that were in use in the previous state (eg, information related to the location and size of the focus ROI, tracking object ROI, effect, recognition area, and/or user input). The related setting information may be updated by newly calculated to correspond to the preview changed according to the first area. According to an embodiment, the processor 120 may provide a preview through the divided first area as it is in an existing setting state (eg, a setting state in an unfolded state) by using the updated setting information. For example, the processor 120 may determine the properties of the camera device 308 (eg, a focus position on a preview, a zoom in/out level input by a user, a zoom position input by a user, a preview resolution and/or a ratio) information), and by adjusting the preview and layout to correspond to a new user experience according to the intermediate state, the preview can be provided to the user as it is in the existing setting state.

In operation 1409 , the processor 120 may identify layouts assigned to the first area and the second area. According to an embodiment, a layout designated for use of the camera device 308 may be identified through the first area and the second area. For example, the processor 120 sets the sub-region (eg, control region, review region, sub-region) in the second region based on a preview state (eg, whether an effect is applied or flip) of the first region or a user setting state of the first region. A layout related to the preview area or the rear preview area) may be identified. According to an embodiment, the processor 120 may identify a layout designated based on an interface (or object) designated to be provided with a preview in the first region and an interface (or object) associated with a sub-region allocated to the second region. can

In operation 1411, the processor 120 may provide a first user interface through the first area. According to an embodiment, the processor 120 may provide preview data obtained from the camera device 308 through the first area of the second display 300 .

In operation 1413 , the processor 120 may provide a second user interface through the second area. According to an embodiment, the processor 120 may provide a user interface corresponding to the sub-region designated in the second area. According to an embodiment, the processor 120 may provide various types of motion information related to the camera device 308 and/or a preview in a user interface according to a designated sub-region. According to various embodiments, operations 1411 and 1413 are not limited to the illustrated order, and operations 1411 and 1413 may be performed sequentially, in parallel, in reverse order, or heuristically.

According to various embodiments, the processor 120 may connect the first display 331 while displaying a preview through the connected second display 300 in an intermediate state of the electronic device 101 , An operation to simultaneously display a preview through the display 331 and the second display 300 may be performed.

According to various embodiments, when the state is changed from the intermediate state to the unfolded state, the processor 120 sets the display (eg, the second display 300 ) to one area again to configure the preview and layout, and the intermediate state It is possible to update the setting information in the same way as when changing to , and provide a preview as it is in the existing setting state using the updated setting information.

15A, 15B, and 15C are diagrams for explaining an example of an electronic device operating in an intermediate state according to various embodiments of the present disclosure;

Referring to FIG. 15A , FIG. 15A is a display 300 showing a preview 1510 of preview data obtained through a camera device (rear camera device 308 or front camera device 305) when the electronic device 101 is in an unfolded state. ) (eg, main or flexible display) may indicate an example of a displayed state.

As shown in FIG. 15A , the electronic device 101 performs a preview 1510 through a designated area of the display 300 (eg, as an area for preview, set as a partial screen or full screen of the display 300 ). can be displayed According to an embodiment, the electronic device 101 includes the preview 1510 together with the camera devices 305 and 308 and/or various motion information related to the preview 1510 (eg, timer count, presence or absence of palm detection, option setting information). , a menu object, a shooting object, and/or a video recording time) for layouts 1520 and 1530 may be provided through at least one designated area. According to an embodiment, the layouts 1520 and 1530 may be provided by overlapping (overlay or overlap) on the preview 1510 .

Referring to FIG. 15B , FIG. 15B may show an example of a conventional method in which the electronic device 101 is changed from an unfolded state to an intermediate state, and provides a preview 1510 and layouts 1520 and 1530 in the intermediate state. .

As shown in FIG. 15B , in the conventional method, the existing layout (eg, the layout in the unfolded state of FIG. 15A ) is maintained and provided regardless of the change in the state of the electronic device 101 to the intermediate state. . Accordingly, as in the example of FIG. 15B , in the existing method, a portion in which at least a portion of the preview screen 1510 is folded may occur due to maintenance of the existing layout. In addition, in the existing method, as a layout 1520 related to manipulation of the camera devices 305 and 308 is provided in a non-fixed portion, according to a user input for setting options or functions of the camera devices 305 and 308, Shaking and/or movement of the electronic device 101 may occur. In this case, the user is inconvenient to create a new composition, such as fixing the electronic device 101 to its original position.

Referring to FIG. 15C , FIG. 15C illustrates an example in which the electronic device 101 is changed from an unfolded state to an intermediate state and provides a preview 1550 and a layout 1580 in the intermediate state according to various embodiments of the present disclosure. have.

As shown in FIG. 15C , according to various embodiments, the electronic device 101 sets the display 300 in the first area 1560 and the second area based on the folded portion (eg, the folding axis A) in the intermediate state. The region 1570 may be divided (or divided) and provided as a preview region 1560 and a sub region 1570 . According to an embodiment, according to the division of the first area (or preview area) 1560 and the second area (or sub-area) 1570 , the electronic device 101 previews the camera devices 305 and 308 ( The user experience optimized for the intermediate state may be provided by controlling the position, the second, and/or the layout 1580 of the 1550 displayed on the first area 1560 . According to an embodiment, the electronic device 101 may change the properties of the camera devices 305 and 308 to correspond to the first area 1560 . For example, changing the properties of the camera device 305 , 308 may result in, for example, a focus (or focusing area) located on a preview, a tracking object, an ROI (eg, a touch input location), and/or an effect (effect) May include the size and position of attributes such as the area of application.

According to an embodiment, the electronic device 101 may provide a preview 1580 controlled according to a change in the properties of the camera devices 305 and 308 through the first area 1560 . For example, comparing FIGS. 15B and 15C , the preview 1550 may be adjusted and provided as a preview 1550 corresponding to the screen size of the first area 1560 . According to an embodiment, the electronic device 101 may non-interact with the user through the first area 1560 (or do not interact or require user input) through an interface (eg, information ) may be provided by further including a related layout.

According to an embodiment, the electronic device 101 may reconfigure the layout 1580 related to the camera devices 305 and 308 and/or the preview 1550 and provide it through the second area 1570 . For example, comparing FIGS. 15B and 15C, the layout 1520 of FIG. 15B is moved to the second area 1570, and the layouts 1520 and 1530 are combined as in the example of FIG. 15C. 1580) may be provided. According to an embodiment, the electronic device 101 may provide a layout related to an interface (eg, a software button) that interacts with the user (or requires a user input) through the second area 1570 .

According to various embodiments, the electronic device 101 may provide the first area 1560 and the second area 1570 as separate areas according to a preset purpose in an intermediate state. For example, the processor 120 divides the first area 1560 and the second area 1570 into a preview area and a control area, a preview area and a review area, a preview area and a sub preview area, or a preview area and a back preview area. can be provided as An example of designating and using the second region 1570 as various sub-regions according to various embodiments is illustrated in FIGS. 16A to 16E , which will be described later.

16A, 16B, 16C, 16D, and 16E are diagrams for explaining an example of providing a sub-region in an intermediate state of an electronic device according to various embodiments of the present disclosure;

16A to 16E , according to various embodiments, the electronic device 101 moves the display 300 to a first area 1560 based on a folded portion (eg, a folding axis A) in an intermediate state. and a second area 1570 may be divided (or divided) and provided as a preview area and a sub area.

Referring to FIG. 16A , FIG. 16A may show an example of providing a sub-region as a control region 1610 . For example, the electronic device 101 may provide the first area 1560 and the second area 1570 of the display 300 separately into a preview area and a control area 1610 , respectively. According to one embodiment, the control area 1610 selects a shooting effect (eg, auto, warm, calm, black and white, sharp, and/or cartoon-like effect) in the preview 1600 of the first area 1560 . A layout including at least one settable effect object 1615 and a photographing object 1601 (eg, a photographing button) may be provided and configured. According to an embodiment, an effect may be applied to the preview 1600 and displayed in response to the effect object 1615 selected in the control area 1610 .

Referring to FIG. 16B , FIG. 16B may show an example of providing a sub-region as a review area 1620 . For example, the electronic device 101 may provide the first area 1560 and the second area 1570 of the display 300 separately into a preview area and a review area 1620 , respectively. According to an embodiment, the review area 1620 may be used (or converted) as an area for providing a photographing result (eg, a photographed image 1625) when the review area 1620 is actually photographed based on the preview 1600 of the preview area. can According to an exemplary embodiment, when capturing is performed based on selection of the capturing object 1601 provided through the sub area, the sub area may be converted into the review area 1620 .

Referring to FIG. 16C , FIG. 16C may show an example of providing a sub region as a sub preview 1630 . For example, the electronic device 101 may provide the first area 1560 and the second area 1570 of the display 300 separately into a preview area and a sub preview area 1630 , respectively. According to an embodiment, the sub preview area 1630 overlaps the preview corresponding to the preview 1600 of the first area 1560 (eg, the original preview 1631) and the original preview 1631 to obtain a shooting effect. It may be provided in a layout including at least one effect object 1633 that can be selectively set and/or a photographing object 1601 . According to an embodiment, an effect corresponding to the effect object 1633 selected in the sub preview area 1630 may be applied to the preview 1600 and displayed, and the original preview 1631 may be displayed through the sub preview area 1630 . may be displayed. Through this, the user can easily recognize the difference between before the effect application and after the effect application.

Referring to FIG. 16D , FIG. 16D may show an example of providing a sub-region as a rear preview area 1640 . For example, the electronic device 101 may provide the first area 1560 and the second area 1570 of the display 300 separately into a preview area and a rear preview area 1640 , respectively. According to an embodiment, the electronic device 101 may connect the front camera device 305 and the rear camera device 308 based on a user input, respectively. According to an embodiment, when the front camera device 305 and the rear camera device 308 are used simultaneously, the electronic device 101 sets the first area 1560 to a preview area (eg, the front camera device 305 ). The front preview area) may be provided, and the second area 1570 may be provided as a preview area (eg, the rear preview area 1640 ) of the rear camera device 308 . According to an embodiment, the electronic device 101 displays the preview 1600 of the preview data obtained from the front camera device 305 through the first area 1560, based on the user input, the rear camera device ( 308 may be connected to display a preview 1645 of preview data obtained from the rear camera device 308 through the rear preview area 1640 . For example, the electronic device 101 may view the preview 1600 of the front camera device 305 and the preview 1645 of the rear camera device 308 through the first area 1560 and the second area 1570 . can be provided at the same time.

According to an embodiment, the electronic device 101 may switch roles of the first area 1560 and the second area 1570 based on a user input. For example, the electronic device 101 provides a preview 1600 of preview data obtained from the front camera device 305 through the second area 1570 , and provides a preview of preview data obtained from the rear camera device 308 . A preview 1645 may be provided through the first area 1560 .

Referring to FIG. 16E , in FIG. 16E , a second area 1570 is provided as a preview area 1650 of a camera device (eg, a front camera device 305 or a rear camera device 308 ) of the electronic device 101 , , an example of providing the first area 1560 as a preview area of a camera device (not shown) of an external electronic device (not shown) may be shown. According to an exemplary embodiment, the first area 1560 is provided as a preview area of the camera devices 305 and 308 of the electronic device 101 according to a setting of the electronic device 101 , and the second area 1570 is provided to the outside. It may be provided as the preview area 1650 of the camera device of the electronic device.

According to an embodiment, the electronic device 101 may execute a video call function based on a user input, and a first preview ( 1651 ) and the second preview 1653 of the camera device of the external electronic device received from the external electronic device of the other party may be simultaneously provided. In Example A, an example in which the first preview 1651 and the second preview 1653 are provided in the unfolded state of the electronic device 101 may be illustrated. In the case of Example B, in the intermediate state of the electronic device 101, the first preview 1651 and An example of providing the second preview 1653 may be shown. According to an embodiment, the electronic device 101 may configure and provide a layout including a control object 1655 related to a video call function through a sub-area (ie, the second area 1570 ).

According to various embodiments, in the first area 1560 , the electronic device 101 displays a layout related to an interface (eg, information) that does not interact with the user (or does not interact with or does not require user input). may be provided, and in the second area 1570 , a layout related to an interface (eg, a software button) that interacts with a user (or requires a user input) may be provided.

17 is a flowchart illustrating a method of operating an electronic device according to various embodiments of the present disclosure;

Referring to FIG. 17 , in operation 1701 , the processor 120 of the electronic device 101 may detect execution of a camera device (eg, the rear camera device 308 ). According to an embodiment, the processor 120 may execute the camera device 308 based on a user input for executing the camera device 308 of the user in the folded state, the unfolded state, or the intermediate state of the electronic device 101 . have.

In operation 1703 , the processor 120 may identify the state of the electronic device 101 (or the second display 300 of the electronic device 101 ) based on the detection of execution of the camera device 308 . According to an embodiment, the processor 120 determines whether the electronic device 101 is in a first state (eg, a folded state), a second state (eg, an unfolded state), or a second state based on the sensor data of the state detection sensor. It is possible to identify whether it is a 3 state (eg, an intermediate state).

In operation 1703 , when the processor 120 identifies a first state (eg, a folded state) of the electronic device 101 , in operation 1705 , a camera connection (or activation) of the camera device 308 and Display connection of the first display 331 may be performed.

In operation 1707 , the processor 120 may display a preview (eg, a first preview) through the currently connected first display 331 . According to an embodiment, the processor 120 transmits preview data obtained from the camera device 308 to the first display 331 through the first preview buffer 560 , and previews the data through the first display 331 . can be displayed.

In operation 1703 , when the processor 120 identifies a second state (eg, an unfolded state) (or a third state (eg, an intermediate state)) of the electronic device 101 , in operation 1709 , the camera device 308 may perform a camera connection and a display connection of the second display 300 .

In operation 1711 , the processor 120 may display a preview (eg, a second preview) through the currently connected second display 300 . According to an embodiment, the processor 120 transmits preview data obtained from the camera device 308 to the second display 300 through the second preview buffer 570 , and previews the data through the second display 300 . ) can be displayed.

According to an embodiment, the first preview and the second preview are a camera device that acquires preview data with different setting values according to properties (eg, screen size and/or screen resolution) of the connected first display 331 . According to the property of 308 (eg, camera resolution, standard, wide angle, telephoto, and/or special shooting effect), it may be provided as a preview of another property.

According to various embodiments, according to the execution of the camera device 308 , while displaying a preview through the first display 331 or the second display 300 as in operation 1707 or operation 1711 , another display that is not connected Through , a preview of the camera device 308 may be simultaneously displayed. According to an embodiment, the processor 120 may individually display a preview of the currently connected camera device 308 on the first display 331 or the second display 300 , or between the first display 331 and the second display 300 . The display 300 may be controlled to be displayed simultaneously. An example thereof is described with reference to the drawings to be described later.

18 is a flowchart illustrating a method of operating an electronic device according to various embodiments of the present disclosure;

Referring to FIG. 18 , in operation 1801 , the processor 120 of the electronic device 101 may display a preview (eg, a second preview) through the second display 300 in the unfolded state of the electronic device 101 . have.

In operation 1803, the processor 120 may detect a trigger for displaying a multi-preview. According to an embodiment, the processor 120 is software capable of generating an on/off event of the first display 331 while displaying a preview through the second display 300 in the unfolded state of the electronic device 101 . User input through a designated interface, such as a physical interface (eg, a software button or toggle button), a physical interface (eg, a hardware key), a voice interface (eg, voice commands), and/or a gesture interface (eg, palm detection). A trigger for multi-preview display can be detected based on the

In operation 1805 , the processor 120 may identify a designated area from a preview object (eg, a subject) of the second display 300 . According to an embodiment, the processor 120 extracts a keypoint (or feature) from the preview object of the second display 300 based on various image extraction algorithms, and extracts a keypoint (or feature) based on the extracted keypoint. e.g. face images). According to an embodiment, the image extraction algorithm includes, for example, edge detection, corner extraction (eg, Harris corner extraction, Shi & Tomasi corner extraction, features from accelerated segment test (FAST)), may include various algorithms such as Hough line transformation, image histogram, scale-invariant feature transform (SIFT), speeded-up robust features (SURF), and/or oriented FAST and rotated BRIEF (ORB). . According to some embodiments, the designated area may be a predetermined area (eg, part or all of the screen area) that is previously designated on the second display 300 .

In operation 1807 , the processor 120 may generate a preview object for the first display 331 based on the designated area. According to an embodiment, the processor 120 may crop at least a portion (eg, a designated area) of the preview displayed through the second display 300 , and generate the cropped image as a preview object. According to some embodiments, the preview object may include an image in which a preview displayed through the second display 300 is resized (eg, reduced).

In operation 1809 , the processor 120 may simultaneously display a preview on the first display 331 and the second display 300 . According to an embodiment, the processor 120 simultaneously provides a preview through the first display 331 and the second display 300 based on preview data obtained from one camera device 308 that is currently connected. can do. According to an embodiment, the processor 120 displays a first preview (eg, a main preview) on the second display 300 , and generates a second preview (eg, a main preview) on the first display 331 based on the first preview. Example: sub preview related to the main preview) can be displayed. According to some embodiments, when the processor 120 displays the second preview on the first display 331 , operation information related to the camera device 308 (eg, timer count, presence or absence of palm detection, and/or video recording) time) may be provided.

19 is a diagram for describing an example of an operation in an unfolded state of an electronic device according to various embodiments of the present disclosure;

According to an embodiment, FIG. 19 may show an example of simultaneously displaying a preview on the first display 331 and the second display 300 in the unfolded state of the electronic device 101 .

Referring to FIG. 19 , as shown in Example A, the electronic device 101 previews an image captured by a camera device (eg, a front camera device 305 or a rear camera device 308) in an unfolded state ( 1910) (eg, a main preview) may be displayed through the currently connected second display 300 .

According to an embodiment, when a trigger for displaying a multi-preview occurs while displaying the preview 1910 through the second display 300 as in Example A, the electronic device 101 , the first display 331 may be connected (eg, activated), and a preview 1920 (eg, sub-preview) for the first display 331 may be generated based on the preview 1910 displayed on the second display 300 . According to an embodiment, the electronic device 101 crops at least a portion 1950 (eg, a designated area) based on feature point extraction in the preview displayed through the second display 300 , and displays the cropped image as the first image. It can be generated as a preview 1920 of the display 331 . According to some embodiments, the preview 1920 of the first display 331 may include an image in which the preview 1910 displayed on the second display 300 is resized (eg, reduced).

According to an embodiment, in response to the trigger for displaying the multi-preview, the electronic device 101 simultaneously previews ( 1910, 1920) can be displayed. According to an embodiment, the electronic device 101 displays a first preview 1910 on the second display 300 , and a second preview is generated on the first display 331 based on the first preview 1910 . 1920 (eg, a sub preview related to the first preview 1910) may be displayed.

20 is a flowchart illustrating a method of operating an electronic device according to various embodiments of the present disclosure;

Referring to FIG. 20 , in operation 2001 , the processor 120 of the electronic device 101 may display a main preview through the second display 300 in the unfolded state of the electronic device 101 .

In operation 2003, the processor 120 may detect a trigger for displaying a multi-preview. According to an embodiment, the processor 120 is software capable of generating an on/off event of the first display 331 while displaying a preview through the second display 300 in the unfolded state of the electronic device 101 . User input through a designated interface, such as a physical interface (eg, a software button or toggle button), a physical interface (eg, a hardware key), a voice interface (eg, voice commands), and/or a gesture interface (eg, palm detection). A trigger for multi-preview display can be detected based on the

In operation 2005 , the processor 120 may stop displaying the main preview of the second display 300 and apply a specified effect based on the detection of a trigger for displaying the multi-preview. According to an embodiment, when an on event of the first display 331 occurs while the second display 300 is connected (or activated) and displaying the main preview, the preview is drawn on the second display 300 . Because it is not drawn, the preview may be cut off. Due to this, the user may feel the preview interruption. In various embodiments, in order to solve the visual inconvenience of the preview interruption, the processor 120 performs an on event of the first display 331 while the second display 300 is connected to display the main preview. , the display may be stopped by applying a specified effect (eg, a blur effect) to the main preview displayed on the second display 300 .

In operation 2007 , the processor 120 may turn on the first display 331 based on detection of a trigger for displaying a multi-preview. According to an embodiment, when an on event of the first display 331 occurs while the second display 300 is connected (or activated) and the main preview is displayed, the processor 120 performs the first display 331 . may be controlled to turn on (eg, to supply power to the first display 331 ) to connect (or activate) the first display 331 .

In operation 2009 , the processor 120 may attach a sub preview for the first display 331 . According to an embodiment, the processor 120 may attach a sub preview for the first display 331 based on the turn-on of the first display 331 . For example, the processor 120 may crop at least a portion of the main preview displayed on the second display 300 , and attach the cropped image as a sub preview. According to some embodiments, the sub-preview may include an image in which the main preview displayed through the second display 300 is resized (eg, reduced). According to an embodiment, when the processor 120 performs a sub-preview attachment for the first display 331 , operation information related to the operation of the camera devices 305 and 308 that can be displayed on the first display 331 . (eg, information such as timer count, presence of palm detection, and/or video recording time) may be identified.

In operation 2011 , the processor 120 may generate a preview buffer (eg, the first preview buffer 560 ) for the first display 331 . According to an embodiment, the processor 120 may transfer the images obtained from the camera devices 305 and 308 to the first preview buffer 560 while displaying the main preview through the second display 300 . According to an embodiment, the processor 120 may reconnect the second display 300 based on the generation of the first preview buffer 560 . According to various embodiments, operation 2005, operation 2007, operation 2009, and operation 2011 are not limited to the illustrated order, and operation 2005, operation 2007, operation 2009 and operation 2011 may be performed sequentially, in parallel, in reverse order, Alternatively, it may be performed heuristically.

In operation 2013 , the processor 120 may simultaneously display a preview through the first display 331 and the second display 300 . According to an embodiment, the processor 120 transmits the sub preview to the first display 331 through the first preview buffer 560 , and transmits the main preview to the second display 300 through the second preview buffer 570 . ) to display the sub preview through the first display 331 and display the main preview through the second display 300 . According to an embodiment, when resuming the display of the main preview through the second display 300 , the processor 120 may cancel and provide a specified effect. According to an embodiment, when the processor 120 displays the sub preview on the first display 331 , the operation information ( It is also possible to control the display of information such as timer count, presence or absence of palm detection, and/or video recording time).

In operation 2015 , the processor 120 may detect a trigger for canceling the multi-preview display while previews are simultaneously displayed through the first display 331 and the second display 300 . According to an embodiment, the processor 120 is a software interface capable of generating an on/off event of the first display 331 while displaying a preview through the first display 331 and the second display 300 . Based on user input through a designated interface (eg, a software button or toggle button), a physical interface (eg, a hardware key), a voice interface (eg, a voice command), and/or a gesture interface (eg, palm detection) A trigger for canceling the multi-preview display can be detected.

In operation 2017, the processor 120 may stop displaying the main preview on the second display 300 and apply a specified effect based on the detection of a trigger for canceling the multi-preview display. According to an embodiment, if an off event of the first display 331 occurs while previews are displayed through the first display 331 and the second display 300 , the preview is displayed on the second display 300 . Because it is not drawn, the preview may be cut off. In various embodiments, in order to solve the user's visual discomfort due to the interruption of the preview, the processor 120 controls the display of the first display 331 while the second display 300 is connected to display the main preview. When the on event occurs, the display may be stopped by applying a specified effect (eg, a blur effect) to the main preview displayed on the second display 300 .

In operation 2019 , the processor 120 may release a preview buffer (eg, the first preview buffer 560 ) for the first display 331 . According to an embodiment, the processor 120 displays the image obtained from the camera devices 305 and 308 on the first display 331 while displaying the preview through the first display 331 and the second display 300 . The first preview buffer 560 to be transmitted to may be released. According to an embodiment, the processor 120 may reconnect the second display 300 based on the termination of the first preview buffer 560 .

In operation 2021 , the processor 120 may detach the sub preview for the first display 331 . According to an embodiment, the processor 120 may detach the sub preview for the first display 331 . For example, the processor 120 may stop the process of generating a sub preview from the main preview displayed through the second display 300 .

In operation 2023 , the processor 120 may turn off the first display 331 . According to an embodiment, when an off event of the first display 331 occurs, the processor 120 turns off the first display 331 (eg, to cut off power to the first display 331 ). Accordingly, the connection of the first display 331 may be disconnected (or deactivated). According to an embodiment, the main preview may be displayed only on the second display 300 without displaying the sub-preview on the first display 331 . According to an embodiment, when resuming the display of the main preview through the second display 300 , the processor 120 may cancel and provide a specified effect. According to various embodiments, operations 2017, operation 2019, operation 2021, and operation 2023 are not limited to the illustrated order, and operations 2017, operation 2019, operation 2021 and operation 2023 are sequentially, in parallel, and in reverse order, Alternatively, it may be performed heuristically.

21A and 21B are diagrams for explaining an example of an interface provided for displaying a multi-preview in an electronic device according to various embodiments of the present disclosure;

According to an embodiment, in FIGS. 21A and 21B , an on/off event of the first display 331 may be generated while the main preview is displayed through the second display 300 in the unfolded state of the electronic device 101 . An example in which a software interface (eg, a software button 2100) is provided may be shown as an interface. According to some embodiments, the interface capable of generating an on/off event of the first display 331 is a physical interface (eg, a hardware key), a voice interface (eg, a voice command), and/or a gesture interface (eg, a It can be provided based on various interfaces such as palm detection).

Referring to FIG. 21A , FIG. 21A may show an example of an off state of the first display 331 while a preview is displayed through the second display 300 . As shown in FIG. 21A , the software button 2100 for the on/off event is in an inactive state and the first display 331 is in an off state, so that a sub preview may not be provided.

Referring to FIG. 21B , FIG. 21B may show an example of an on state of the first display 331 while a preview is displayed through the second display 300 . As shown in FIG. 21B , a software button 2100 for an on/off event is activated, and the first display 331 is turned on to provide a sub preview.

According to an embodiment, the software button 2100 for the on/off event of the multi-preview display may be provided on the preview of the second display 300, so as not to obscure the user's view (or affect the user's visibility) may be provided at a designated location). In some embodiments, the software button 2100 may be provided as a floating button on the preview.

According to an embodiment, the software button 2100 may be provided in an off state by default through the second display 300 , and may be switched to an on state based on a user input (eg, a touch). The electronic device 101 turns on the software button 2100 and turns on the first display 331 based on the user input of the software button 2100 to turn on the first display 331 and the second display ( 300) can provide a preview at the same time.

According to one embodiment, the software button 2100 provides text along with, for example, an on or off state so that the user can easily recognize the on/off state of the first display 331, and the software button (2100) A different color may be provided.

22 to 24 are diagrams for explaining an example of switching an electronic device from an unfolded state to an intermediate state according to various embodiments of the present disclosure;

According to an embodiment, FIGS. 22 to 24 may show an example of an operation of switching the electronic device from an unfolded state to an intermediate state (eg, a table mode or a flex mode).

Referring to FIG. 22 , FIG. 22 shows a display 300 showing a preview of preview data acquired through a camera device (rear camera device 308 or front camera device 305) in an unfolded state of the electronic device 101 (example) : An example of a state displayed through the main or flexible display) can be shown.

As shown in FIG. 22 , the electronic device 101 previews through a designated area of the display 300 (eg, an area for preview in an unfolded state, which is set as a partial screen or a full screen of the display 300 ). can be displayed. According to an embodiment, the electronic device 101 provides a preview together with the camera devices 305 and 308 and/or various motion information related to the preview (eg, timer count, palm detection presence or absence, option setting information, menu object, and shooting object). and/or video recording time) may be provided through at least one designated area.

Referring to FIG. 23 , FIG. 23 may show some examples of an operation in which the electronic device 101 is changed from an unfolded state to an intermediate state. According to an embodiment, the electronic device 101 represents an operation of proceeding to an intermediate state based on a predetermined angle of inflection (eg, an angle between the first housing 310 and the second housing 320 ) through the hinge module. can For example, an example in which the unfolding angle of the electronic device 101 is unfolded to about 135 degrees (eg, about 130 degrees to about 140 degrees) may be shown.

As shown in FIG. 23 , the electronic device 101 may adjust and provide the layout in the expanded state (eg, the layout in the expanded state of FIG. 22 ) according to the state change to the intermediate state. For example, the electronic device 101 may provide a graphic effect of moving (eg, reducing) the preview area (or the preview of the preview area) in the upper direction of the display 300 in a sliding manner. According to an embodiment, the electronic device 101 may provide a graphic effect that expands by adjusting the size (or ratio) of the sub region in response to a sliding movement (eg, a reduced graphic effect) in the upper direction of the preview region. .

Referring to FIG. 24 , FIG. 24 illustrates an example in which the electronic device 101 changes from an unfolded state to an intermediate state, and provides a preview and a layout (eg, a sub area) in the intermediate state according to various embodiments of the present disclosure. have.

As shown in FIG. 24 , according to various embodiments, the electronic device 101 moves the display 300 to a first area (eg, a preview area) based on a folded portion (eg, a folding axis A) in an intermediate state. and a second area (eg, a sub area), each of which may be provided as a preview area and a sub area. According to an embodiment, the electronic device 101 may provide a preview controlled according to a change in the properties of the camera devices 305 and 308 through the preview area. For example, referring to FIGS. 22 or 23 and 24 , the electronic device 101 may provide a preview corresponding to the screen size of the preview area by adjusting the preview.

According to an embodiment, the electronic device 101 may reconfigure a layout related to the camera devices 305 and 308 and/or a preview and provide it through the sub-region. For example, referring to FIGS. 22 or 23 and 24 , the first layout (eg, an object related to camera option setting) at the top of the display 300 is moved to a sub-region, as in the example of FIG. 24 . The first layout and the second layout (eg, an object related to a shooting option setting, a shooting object, a gallery entry object, and/or a camera switching object) may be provided as a combined layout.

According to various embodiments, in an intermediate state, the electronic device 101 may provide the preview area and the sub area as separate areas according to a preset purpose. For example, the electronic device 101 may provide a preview area and a control area. Various embodiments are not limited thereto, and the sub-region may be variously converted according to a preset purpose or progress of a photographing operation as shown in FIGS. 16A to 16E .

25 and 26 are diagrams for explaining an example of using an electronic device in an intermediate state according to various embodiments of the present disclosure;

25 and 26 show an example of an operation of switching a position between a preview area and a sub area using a designated area (eg, a transition area or a blank area) in an intermediate state (eg, FIG. 24 ). can indicate

According to various embodiments, in an intermediate state (eg, table mode or flex mode) of the electronic device 101 , a preview area provided in an upper direction of the display 300 and a sub provided in a lower direction of the display 300 . You can provide the ability to switch areas (eg, control areas). For example, the position at which the preview is displayed may be switched between the top and bottom of the display 300 .

Referring to FIG. 25 , when the electronic device 101 is switched to the intermediate state, at least a part of the sub-region (eg, an empty region) is configured for a user input (eg, a transition trigger input) for switching a region in which a preview is displayed. It can be activated as a transition area 2500 . According to an embodiment, the activation of the transition area 2500 activates a touch sensing function to receive a user input (eg, a touch, a tap, a double tap, a swipe, or a flick) through the transition area 2500 . It can include actions. For example, the electronic device 101 disables the transition region 2500 before the transition to the intermediate state as shown in FIGS. 22 and 23 to prevent malfunction due to touch input, and only touch input by a designated object is possible. can make it For example, the electronic device 101 may activate the transition area 2500 to detect a touch input by the transition area 2500 when it is switched to the intermediate state as shown in FIGS. 24 and 25 . For example, the electronic device 101 may detect a touch through the transition area 2500 .

According to various embodiments, the electronic device 101 may provide a function of switching the top/bottom of the camera preview based on the transition area 2500 in an intermediate state (eg, table mode or flex mode). For example, as in the example of FIG. 24 or 25 , the positions of the preview area disposed in the upper direction of the display 300 and the sub area (eg, the control area) disposed in the lower direction of the display 300 are mutually switched. A conversion function can be provided.

According to an embodiment, the user receives a preview area and a sub area through a user input (eg, a touch, a tap, a double tap, a swipe, or a flick) designated through the transition area 2500 in the intermediate state of the electronic device 101 . You can switch between them. According to an embodiment, the electronic device 101 detects a user input (eg, a transition trigger input) by a user through the transition area 2500 , and switches the preview area and the sub area based on the user input to provide can For example, when a double tap by the switch area 2500 is detected by the user, the electronic device 101 may switch and display the preview area and the sub area based on the double tap detection of the switch area 2500 . have. An example of this is shown in FIG. 26 .

26 , according to various embodiments, the electronic device 101 switches the preview area and the sub area of the display 300 based on the folded part (eg, the folding axis A) in the intermediate state. can provide For example, referring to FIGS. 25 and 26 , the preview area is displayed by moving from the top direction to the bottom direction of the display 300 , and the sub area is displayed by moving from the bottom direction to the top direction of the display 300 . can

According to various embodiments, a user input (eg, a transition trigger) for switching between the preview area and the sub-region in the intermediate state of the electronic device 101 is not limited to a trigger for the designated area 2500, and may be used in various ways. may be provided. According to an embodiment, the user input may be used as a transition trigger based on the user's voice and/or a specified motion (eg, additional folding of the electronic device 101, left and right shaking of the electronic device 101). According to an embodiment, the user input may change an angle in the intermediate state of the electronic device 101 (eg, a second angle specified from the first angle in the intermediate state (eg, the second angle is an angle smaller than the first angle). It can be used as a transition trigger based on the folding change). For example, the electronic device 101 may have a predetermined angle of inflection (eg, the first housing 310 and the second housing 320) through the hinge module in an intermediate state (eg, an angle of about 90 degrees) as illustrated in FIG. 25 . )), can be identified as a transition trigger to switch the display position of the preview, for example when folding from about 90 degrees to about 85 degrees (for example, from about 85 degrees to about 80 degrees). .

According to an embodiment, when switching between the preview area and the sub-region, the electronic device 101 may switch between the display area and the sub-region in such a way that they are exchanged as they are. For example, all objects in the layout constituting the display area and the sub area may be switched. According to an exemplary embodiment, when switching between the preview area and the sub-region, the electronic device 101 may maintain at least some objects of a layout constituting the display area and the sub-region without switching. According to an embodiment, as shown in FIG. 26 , some layouts (eg, objects related to shooting as part of the second layout (eg, shooting objects, gallery entry objects, and/or camera switching object) may be provided while being maintained in the switched preview area and superimposed (or allocated as a separate area) to the preview state of the switched preview area.

27 and 28 are diagrams for explaining an example of a photographing operation using an electronic device in an intermediate state of the electronic device according to various embodiments of the present disclosure;

According to an embodiment, as illustrated in FIG. 26 , in FIGS. 27 and 28 , in an intermediate state (eg, table mode or flex mode) of the electronic device 101, a preview area and a sub area are switched (eg, a camera). preview), and in this state, an example of a scenario used for actual photographing using the electronic device 101 may be shown.

For example, in the intermediate state of the electronic device 101 , the user switches the preview area for preview to the lower side of the display 300 , and checks the preview through the lower preview area, while checking the preview through the upper rear side of the display 300 . By using a camera (eg, the rear camera device 308) disposed in the , it is possible to conveniently perform shooting from various angles. For example, the user can produce various angles (eg, high angle and low angle) and can comfortably shoot an image from various angles.

According to an embodiment, as illustrated in FIG. 27 , the user may create a high angle. For example, the user holds the electronic device 101 so that the camera of the electronic device 101 (eg, the rear camera device 308) faces downward (or on the floor), and while checking the preview through the switch preview area , it is possible to conveniently perform shooting in a shooting direction facing the floor.

According to an embodiment, as illustrated in FIG. 28 , the user may produce a low angle. For example, the user holds the electronic device 101 such that the camera (eg, the rear camera device 308) of the electronic device 101 faces the front (eg, the user's gaze direction), or a designated area ( Example: while placed on a desk or floor), moving the electronic device 101 left and right and/or up and down, and previewing through a transition preview area (eg, FIG. 26 state) or a previous preview area (eg, FIG. 25 state) You can conveniently perform shooting in the shooting direction facing the front while checking .

For example, a user may change an intermediate state of the electronic device 101 and a position at which a preview is displayed to obtain an image (eg: photos and/or videos) more conveniently.

29 and 30 are diagrams for explaining an example of switching an electronic device from an intermediate state to an unfolded state according to various embodiments of the present disclosure;

According to an embodiment, FIGS. 29 and 30 may show an example of an operation of switching an electronic device from an intermediate state (eg, a table mode or a flex mode) to an unfolded state.

Referring to FIG. 29 , FIG. 29 may show some examples of an operation of changing the state of the electronic device 101 from an intermediate state (eg, a table mode or a flex mode) to an unfolded state. According to an embodiment, the electronic device 101 represents an operation of proceeding to an unfolded state based on a predetermined angle of inflection (eg, an angle between the first housing 310 and the second housing 320 ) through the hinge module. can For example, an example in which the unfolding angle of the electronic device 101 is unfolded to about 135 degrees (eg, about 130 degrees to about 140 degrees) may be shown.

As illustrated in FIG. 29 , the electronic device 101 may adjust and provide the layout in the intermediate state (eg, the layout in the intermediate state of FIG. 26 ) according to the state change in the unfolded state. For example, the electronic device 101 may provide a graphic effect of moving (eg, expanding) the preview area (or the preview of the preview area) in the upper direction of the display 300 in a sliding manner. According to an embodiment, the electronic device 101 may provide a graphic effect of reducing the size (or ratio) of the sub region in response to a sliding movement (eg, an extended graphic effect) in the upper direction of the preview region. .

Referring to FIG. 30 , FIG. 30 may show an example in which the electronic device 101 changes from an intermediate state to an unfolded state, and provides a preview and a layout in the unfolded state according to various embodiments of the present disclosure.

For example, in FIG. 30 , when the electronic device 101 changes the state from the state in which the preview area is displayed at the bottom to the unfolded state as in the example of FIG. 26 , a preview is displayed through the display 300 (eg, main or flexible display). An example of the state of

As shown in FIG. 30 , the electronic device 101 previews through a designated area of the display 300 (eg, an area for preview in an unfolded state, which is set as a partial screen or a full screen of the display 300 ). may be displayed corresponding to the bottom direction of the display 300 . According to an embodiment, the electronic device 101 provides a preview together with the camera devices 305 and 308 and/or various motion information related to the preview (eg, timer count, palm detection presence or absence, option setting information, menu object, and shooting object). and/or a layout for video recording time) may be provided through at least one designated area (eg, an upper direction of the display 300 ).

According to an embodiment, referring to FIGS. 22 and 30 , directions in which the preview areas are arranged may face each other. For example, when the electronic device 101 is in an intermediate state and the preview area is switched from a switched state (eg, a state displayed in the lower direction of the display 300 ) to an unfolded state, the switched state of the preview area is applied (or maintain) to provide a corresponding user interface. According to an embodiment, when the preview area is switched from the switched state to the expanded state, the electronic device 101 may provide the preview area in the default manner as shown in FIG. 22 according to a setting of the electronic device 101 .

31 is a diagram for explaining another example of a preview area and a sub area in an intermediate state of an electronic device.

31 , according to various embodiments, the electronic device 101 switches the preview area and the sub area of the display 300 based on the folded part (eg, the folding axis A) in the intermediate state. can provide For example, the preview area may be displayed by being moved from the top direction to the bottom direction of the display 300 , and the sub area may be displayed by being moved from the bottom direction to the top direction of the display 300 .

Referring to FIG. 31 , when switching between the preview area and the sub area, the electronic device 101 may switch between the display area and the sub area in such a way that they are exchanged as they are. For example, all objects of the layout constituting the display area and the sub area may be switched. For example, referring to FIGS. 26 and 31 , in the case of FIG. 26, when switching between the preview area and the sub area, at least some objects of the layout constituting the display area and the sub area are maintained without switching. , and in the case of FIG. 30 , an example of switching all objects of the layout constituting the display area and the sub area may be shown. For example, in FIG. 30 , only a preview is provided without including other layouts through the preview area.

.

32 and 33 are diagrams for explaining an example of a screen configuration in an intermediate state of an electronic device according to various embodiments of the present disclosure;

According to an embodiment, FIG. 32 may show an example of determining a position (eg, top or bottom) of a preview area in which a preview is to be displayed by using a recent preview position. According to an embodiment, FIG. 33 may show an example of determining a position (eg, top or bottom) of a preview area in which a preview is to be displayed using the most used preview position. According to an embodiment, FIGS. 32 and 33 may show examples of configuring a camera preview in an intermediate state (eg, table mode or flex mode). According to an embodiment, in the intermediate state of the electronic device 101, the preview position may be moved upward or downward based on the folded portion according to the user's intention, and a camera application screen configuration may be provided differently according to the preview position. can According to an embodiment, although FIGS. 32 and 33 are shown separately, various embodiments are not limited thereto, and the operation of FIG. 32 or 33 may be performed individually or two It may be performed sequentially, in parallel, or heuristically according to a weight for a condition (eg, a criterion for a recently used preview and a criterion for a preview with high user frequency (or priority)).

According to an exemplary embodiment, the method for selecting a camera preview position in the intermediate state of the electronic device 101 includes, for example, when a user folds the electronic device 101 in half to enter the intermediate state for the first time (eg, first time). , the preview is placed on the upper side according to the default setting, and thereafter, the position of the preview can be moved according to the user's intention. Thereafter, a method of selecting a position of a preview when entering an intermediate state may be performed as shown in FIG. 32 or FIG. 33 .

According to an embodiment, in FIGS. 32 and 33 , both examples may be identical in that the preview is placed at the top when the intermediate state is initially entered. According to some embodiments, depending on the intent of the camera application, it is also possible to place it underneath.

For example (eg, FIG. 32 ), when the user has already used the intermediate state of the electronic device 101, the camera application is configured by placing the previewer at the same position as the user's last preview position when entering the next intermediate state. can do.

As another example (eg, FIG. 33 ), when the user has already used the intermediate state of the electronic device 101, when the user enters the next intermediate state, the camera application is executed by placing a preview in the same position as the preview position frequently used by the user. configurable.

According to an embodiment, the electronic device 101 may configure various menu items according to the preview position in the intermediate state. For example, as a camera provides various functions, it is possible to provide various guides for better quality shooting through many buttons, menus, and image analysis. Due to this, various icons and/or pop-ups are configured on a narrow screen, and a complicated scene may be produced for the user. Various embodiments may improve this.

According to an embodiment, the shooting button, screen switching, and zoom button, which are elements most used in the camera application, may always be fixed regardless of the position of the preview. For example, since the most important elements are fixed regardless of the preview position, it can provide clear usability. In an object handling these elements, a priority may be set to high, so that it can be determined to be provided in a fixed position.

According to an embodiment, a notification pop-up (eg, shooting time, warning, simple notification, mode and/or effect description), which is an element used to check the current situation, and/or an area selection box (eg, super slow motion mode) You can check the elements of the motion recognition auto-detection area in , the effect area in food mode) or place them where the preview is located so that it is easy to use. In addition, users are paying attention to previews that require user interaction, such as pop-ups to provide information to users (detection of blur or eye close images) and tips for inducing changes to various settings such as night on, HDR on, and flash on/off. You can select a location to float in the area. It can be decided to be placed in the middle of the preview area by setting the priority to middle in the object.

According to one embodiment, finally, various operation (ratio, filter, ISO, shutter speed, flash, etc.) icons and shooting mode change icons are elements that have relatively low usage rates in an intermediate state, so the preview is displayed so that shooting is not inconvenient. By placing it on the opposite side of the location, you can create a comfortable shooting environment. The priority in such an object may be set to low to determine to be placed where there is no preview.

According to an embodiment, the above-mentioned elements may optimize the screen configuration in the intermediate state according to the user through the user's usage pattern learning. For example, even if night on is provided for low-light photography, it is not used, but if the user changes the shooting mode a lot, the shooting mode item can be placed in the preview area and noti, etc. can be moved to a place where there is no preview. For example, if the user changes the shooting mode more than the zoom in the middle, by changing the intermediate state configuration, the zoom can be positioned on the opposite side of the preview, and the shooting mode change icon can be positioned on the preview side.

34 to 46 are diagrams for explaining an example of automatically controlling preview movement in an electronic device according to various embodiments of the present disclosure;

According to an embodiment, a preview movement is performed by determining the angle at which the electronic device 101 is folded and the position of the user's gaze with the front camera and/or the state in which the electronic device 101 is placed with a sensor (eg, a 6-axis sensor). can be automatically controlled. According to an embodiment, in FIGS. 34 to 46 , reference numeral C may denote a camera, and reference numeral P may denote a preview.

34 to 39 may illustrate an example of setting a High/Low angle using a subject and a hinge angle in electronic autonomy, according to an embodiment.

34 to 36 , FIGS. 34 to 36 may show examples of subject recognition (eg, face, eyes, etc.) and angles of hinges defined at upper and lower ends. For example, when the subject is recognized at a high angle, the electronic device 101 may provide a preview and a control by disposing it at the bottom. According to an embodiment, the angle shown in FIGS. 34 to 36 may represent an angle exemplified based on the XY axis.

37 to 39 , FIGS. 37 to 39 may show examples of subject recognition (eg, face, eyes, etc.) and angles of hinges defined at upper and lower ends. For example, when the subject is recognized at a low angle, the electronic device 101 may provide a preview by arranging the control at the top and the bottom. According to an embodiment, the angle shown in FIGS. 37 to 39 may represent an angle exemplified based on the XY axis.

40 and 41 may illustrate an example of defining a preview position using a gaze position of a photographer in an electronic device, according to an embodiment.

According to an embodiment, the electronic device 101 may set the preview position through the gaze direction of the photographer. For example, the electronic device 101 may provide the preview by being positioned at the top when the photographer's gaze is directed upward, and may provide the preview by being positioned at the bottom when the photographer's gaze is downward.

According to some embodiments, the electronic device 101 may identify the user's gaze direction based on eye tracking. According to an embodiment, additional tracking may be performed to compensate for an unnecessary erroneous operation according to the user's gaze direction tracking (eg, a preview position change when the user moves the user's gaze for control). For example, by tracking the direction in which the user's movement progresses, whether to switch the preview according to the gaze direction may be determined.

42 may illustrate an example of setting a high/low angle using a device angle and a hinge angle in an electronic device, according to an embodiment.

Referring to FIG. 42 , according to an embodiment, the electronic device 101 may correct the angle of the hinge defined at upper and lower ends and a 6-axis sensor. For example, the electronic device 101 may recognize a high or low angle based on the angle, and define a preview and a controller position based on the high or low angle. According to an embodiment, the angle shown in FIG. 42 may represent an angle exemplified based on the XYZ axis.

For example, in a state in which the user holds the electronic device 101 , the correction may be performed using the defined upper and lower angles of the hinge and the 6-axis sensor.

43 to 46 may illustrate an example of setting a high/low angle using a fixed position and a hinge angle in an electronic device, according to an embodiment.

According to an embodiment, FIGS. 43 and 44 may represent a state (eg, a fixed state) in which the electronic device 101 is placed on a table. In this state, the electronic device 101 may move the upper and lower positions of the preview based on about 90 degrees (eg, a defined hinge angle) when photographing with the front camera.

According to an embodiment, FIGS. 45 and 46 may represent a state in which the electronic device 101 is placed on a table (eg, a fixed state). In this state, the electronic device 101 may move the preview to a lower position based on about 90 degrees (eg, a defined hinge angle) when the folder is folded when photographing with the rear camera.

47 is a diagram for describing an example of preview switching in an intermediate state of an electronic device according to various embodiments of the present disclosure;

As shown in FIG. 47 , FIG. 47 may show an example of providing previews obtained from different cameras through a preview area and a sub area, respectively. For example, according to an embodiment, when the front camera device 305 and the rear camera device 308 are used simultaneously, the electronic device 101 sets the first area to a preview area (eg, front preview) of the front camera device. area), and the second area may be provided as a preview area (eg, rear preview area) of the rear camera device 308 . According to an embodiment, while the preview 1600 of the preview data obtained from the front camera device 305 is displayed through the first area, the electronic device 101 controls the rear camera device 308 based on the user input. By connection, a preview of preview data obtained from the rear camera device 308 may be displayed through the rear preview area. For example, the electronic device 101 may simultaneously provide a preview of the front camera device 305 and a preview of the rear camera device 308 through the first area and the second area. According to some embodiments, the electronic device 101 provides the second area as a preview area of the camera device of the electronic device 101 (eg, the front camera device 305 or the rear camera device 308), and the first The area may be provided as a preview area of a camera device (not shown) of an external electronic device (not shown). According to an exemplary embodiment, the first area is provided as a preview area of the camera devices 305 and 308 of the electronic device 101 according to a setting of the electronic device 101 , and the second area is provided as a preview area of the camera device of the external electronic device. It can also be provided as a preview area.

According to various embodiments, the electronic device 101 may switch roles of the first area and the second area based on a user input. For example, the electronic device 101 may provide switching between each preview of the divided area.

According to one embodiment, in a state in which the rear camera is displayed at the top in the middle state and the front camera is displayed at the bottom, when a user generates a specific event, the rear camera image displayed at the top moves to the bottom, The front camera image displayed at the bottom can be moved to the top.

According to an embodiment, in a situation in which images of the front camera at the top and the rear camera at the bottom are respectively displayed, when a user input occurs, the upper and lower preview images may be switched.

According to an embodiment, the user input is, for example, when single-tap/double-tap an arbitrary area of the electronic device 101, when dragging/dropping a preview image to be moved to another area, and / or may include a case of pressing a pre-mapped hardware physical key (eg, volume up/down).

An operation method performed by the electronic device 101 according to various embodiments of the present disclosure includes an operation of identifying a state of the electronic device 101 based on execution of a camera device, and a state of the electronic device 101 . based on the operation mode of the camera device and the operation of identifying a display operating in response to the execution of the camera device, updating the settings of the camera device based at least on the operation mode of the camera device and the identified display and displaying a preview obtained from the camera device based on the updated setting through the identified display.

According to various embodiments, the method of the electronic device 101 includes an operation of determining the camera device as a corresponding operation mode based on the state of the electronic device 101, and a first operation mode determination based on the operation mode determination. An operation of establishing a connection of a display or a second display, an operation of updating the setting of the camera device based on at least a property of a display connecting with the operation mode, and preview data obtained from the camera device based on the updated setting and displaying a preview through the display connecting the .

According to various embodiments, in the method of the electronic device 101 , the process of the camera device is performed based on the operation of monitoring the state change of the electronic device 101 and the state change of the electronic device 101 . (Process) may include an operation of performing each correction.

According to various embodiments of the present disclosure, the method of the electronic device 101 includes dividing the display into a first region and a second region based on a folding axis, and previewing the first region for a preview of the camera device. It may include an operation of providing the region and an operation of providing the second region as a sub region associated with the preview.

According to various embodiments, the sub-region may be switched to have a different layout based on the operation of the camera device.

According to various embodiments, the first area may provide a layout related to an interface that interacts with a user, and the second area may provide a layout related to an interface that interacts with a user.

According to various embodiments, the method of the electronic device 101 includes detecting a trigger for displaying a multi-preview while displaying the main preview through the display, and selecting another display from the main preview of the display. The method may include obtaining a sub-preview for the display, displaying the main preview through the display, and simultaneously displaying the sub-preview through the other display.

According to various embodiments, the sub-preview is an image in which at least a portion of the main preview displayed through the display is cropped, or an image in which the main preview displayed through the display is resized. At least it can be created based on

Various embodiments of the present disclosure disclosed in the present specification and drawings are merely presented as specific examples to easily explain the technical content of the present disclosure and help the understanding of the present disclosure, and are not intended to limit the scope of the present disclosure. Therefore, the scope of the present disclosure should be construed as including all changes or modifications derived from the technical spirit of the present disclosure in addition to the embodiments disclosed herein as being included in the scope of the present disclosure.

101: electronic device
120: processor
130: memory
210, 300, 331: display
180, 305, 308, 308a, 308b: camera device
510: event monitor
520: state manager
530: folding/unfolding manager
540: Preview Manager

Claims (20)

In an electronic device,
camera device;
a first display;
a second display; and
A processor comprising:
based on the execution of the camera device, identify the state of the electronic device,
based on the state of the electronic device, identify an operation mode of the camera device and a display that operates in response to the execution of the camera device,
update the settings of the camera device based at least on the operating mode of the camera device and the identified display;
an electronic device configured to display a preview obtained from the camera device through the identified display based on the updated setting.
The method of claim 1, wherein the processor comprises:
determining the camera device as a first operation mode in the first state of the electronic device;
establishing a connection of the first display based on the determination of the first operation mode;
updating the settings of the camera device based on at least the first operation mode and the properties of the first display,
an electronic device configured to transmit preview data obtained from the camera device based on the updated setting to the first display and display a preview through the first display.
The method of claim 2, wherein the processor comprises:
monitoring the state change of the electronic device;
An electronic device configured to perform correction for each process of the camera device based on a change in the state of the electronic device.
The method of claim 3, wherein the processor comprises:
Detecting a state change of the electronic device in at least one of a process of connecting the camera device, a preview loading process in a connected state of the camera device, and an image capturing process,
performing at least one of disconnecting the camera device, refreshing the settings of the camera device, and/or connecting the camera device, based on the process in which the change is detected;
After the reconnection of the camera device, an electronic device configured to display a preview corrected according to a new setting corresponding to a state change from the camera device through a corresponding display.
The method of claim 1, wherein the processor comprises:
determining the camera device as a second operation mode in the second state of the electronic device;
establishing a connection of the second display based on the determination of the second operation mode;
updating the settings of the camera device based on at least the second operation mode and the properties of the second display,
an electronic device configured to transmit preview data obtained based on the updated setting from the camera device to the second display and display the preview through the second display.
The method of claim 1, wherein the processor comprises:
determining the camera device as a third operation mode in the third state of the electronic device;
updating the setting of the camera device based on the determination of the third operation mode based on at least the third operation mode and a property of the second display connected in the third operation mode;
an electronic device configured to transmit preview data obtained from the camera device based on the updated setting to the second display, and display the preview through a designated partial area of the second display.
The method of claim 6, wherein the processor comprises:
dividing the second display into a first area and a second area based on a folding axis based on the determination of the third operation mode;
providing the first area as a preview area for previewing the camera device;
set to provide the second region as a sub-region associated with the preview,
The electronic device of claim 1, wherein the sub-region is switched to have a different layout based on an operation of the camera device.
The method of claim 7, wherein the processor comprises:
An electronic device configured to update a setting of the camera device in response to a property of the first area of the second display.
The method of claim 7, wherein the processor comprises:
providing a layout related to an interface for non-interaction with a user in the first area;
An electronic device configured to provide a layout related to an interface interacting with a user in the second area.
The method of claim 7, wherein the processor comprises:
identify a layout related to a sub-region set in the second region based on a preview state or a user setting state of the first region;
providing a first user interface including the preview through the first area;
An electronic device configured to provide a second user interface including operation information corresponding to a sub-region designated through the second area.
The method of claim 1, wherein the processor comprises:
while displaying a preview through the identified display, establishing a connection of another display based on a trigger for displaying a multi-preview;
An electronic device configured to simultaneously display a preview through the display and the other display.
The method of claim 11 , wherein the processor comprises:
detecting a trigger for displaying a multi-preview while displaying the main preview through the second display in the second state of the electronic device;
obtain a sub-preview for the first display from the main preview of a second display;
The electronic device is configured to display the main preview through the second display and simultaneously display the sub preview through the first display.
The method of claim 12, wherein the processor comprises:
The sub-preview is generated based on at least an image in which at least a portion of the main preview displayed through the second display is cropped, or an image in which the main preview displayed through the second display is resized. An electronic device set up to do so.
The method of claim 12, wherein the processor comprises:
Electronic configured to detect a trigger for displaying the multi-preview based on a user input using a software interface, a physical interface, a voice interface, and/or a gesture interface capable of generating an on/off event of the first display Device.
According to claim 1,
The first display is disposed on the rear side of the electronic device, displays a preview of the camera device in a folded state of the electronic device, and previews according to an operation mode of the camera device in an unfolded state or an intermediate state of the electronic device is set to selectively display,
The second display includes a flexible display that is disposed on the front side of the electronic device and is folded, bent, or unfolded based on a designated folding axis, and a preview of the camera device in an unfolded state or an intermediate state of the electronic device is set to display,
The first display and the second display are set to operate at different screen sizes and/or screen resolutions.
A method of operating an electronic device, comprising:
Based on the execution of the camera device, the operation of identifying the state of the electronic device,
identifying an operation mode of the camera device and a display operating in response to execution of the camera device based on the state of the electronic device;
updating the settings of the camera device based at least on the identified display and the operating mode of the camera device;
and displaying a preview obtained from the camera device based on the updated setting through the identified display.
17. The method of claim 16,
determining the camera device as a corresponding operation mode based on the state of the electronic device;
establishing a connection of the first display or the second display based on the determination of the operation mode;
an operation of updating the settings of the camera device based on at least a property of a display linking the operation mode;
and displaying a preview through the display connecting the preview data obtained based on the updated setting from the camera device.
17. The method of claim 16,
monitoring the state change of the electronic device;
and performing correction for each process of the camera device based on a change in the state of the electronic device.
17. The method of claim 16,
dividing the display into a first area and a second area based on a folding axis;
providing the first area as a preview area for previewing the camera device;
providing the second region as a sub region associated with the preview;
The sub-region is switched to have a different layout based on the operation of the camera device,
The first area provides a layout related to an interface for non-interaction with the user,
wherein the second area provides a layout related to an interface for interacting with the user.
17. The method of claim 16,
Detecting a trigger for displaying a multi-preview while displaying the main preview through the display;
obtaining a sub-preview for another display from the main preview of the display;
displaying the main preview through the display and simultaneously displaying the sub preview through the other display;
The sub-preview is generated based on at least an image in which at least a portion of the main preview displayed through the display is cropped, or an image in which the main preview displayed through the display is resized. how to do it

Images