WO2021025534A1

WO2021025534A1 - Electronic device for providing camera preview image and operating method thereof

Info

Publication number: WO2021025534A1
Application number: PCT/KR2020/010497
Authority: WO
Inventors: 우광택; 오득규; 이창호; 김병국; 장종운; 김성준; 안진완
Original assignee: 삼성전자 주식회사
Priority date: 2019-08-07
Filing date: 2020-08-07
Publication date: 2021-02-11
Also published as: EP4002818A1; KR20210017282A; CN114208150A; US20220150345A1; EP4002818A4

Abstract

One embodiment of the present invention relates to an electronic device in which a foldable device comprising a plurality of cameras responds to folding or unfolding of the device so as to provide a preview image of a camera, and an operating method thereof. A foldable electronic device, according to one embodiment of the present invention, comprises: a plurality of cameras; at least one display; at least one processor operatively connected to the plurality of cameras and the at least one display; and at least one memory operatively connected to the at least one processor, wherein the at least one memory may store instructions that, when executed, cause the at least one processor, while a first preview image corresponding to a first camera from among the plurality of cameras is displayed on the at least one display, to select at least one other camera on the basis of an analysis result of at least one object included in the first preview image, to display a second preview image corresponding to the selected at least one camera in response to detection of the folding or unfolding of the electronic device, and to acquire a photographed image on the basis of the displayed second preview image.

Description

Electronic device for providing camera preview image and method of operation thereof

The present disclosure relates to an electronic device for providing a preview image of a camera in response to folding or unfolding of a foldable device including a plurality of cameras, and an operating method thereof.

With the recent development of digital technology, mobile communication terminals, smart phones, tablet PCs (personal computers), PDAs (personal digital assistants), electronic notebooks, notebooks, or wearable devices The same various types of electronic devices are widely used. The electronic device has reached a stage of mobile convergence that includes functions of other devices. For example, an electronic device has a call function such as voice and video calls, a message transmission/reception function such as SMS (short message service)/MMS (multimedia message service) and e-mail (e-mail), an electronic notebook function, and a photographing function. , A broadcast playback function, a video playback function, a music playback function, an Internet function, a messenger function, a game function, or a social networking service (SNS) function.

In addition, the electronic device may include a plurality of cameras including at least one front camera and at least one rear camera in order to satisfy various user needs related to a photographing function.

Since such an electronic device includes one display having a fixed size, the angle of view of the plurality of cameras is mainly fixed. Therefore, in order to shoot more people or a wider landscape, there is an inconvenience of having to provide additional equipment such as a selfie stick. However, even if additional equipment is provided, camera shooting itself is inconvenient, and since the size of the subject decreases compared to the fixed display size as the electronic device gets further away, it is difficult to accurately check the state of the subject while taking a picture.

In addition, the electronic device as described above may be implemented to be foldable. That is, the electronic device may be folded around the center region. An electronic device implemented in a foldable manner (hereinafter, referred to as a foldable electronic device) may include a more usable surface than an electronic device that is not. Accordingly, the foldable electronic device may include a plurality of cameras and a plurality of displays having different functions and capabilities. However, when taking a picture using a plurality of cameras and a plurality of displays, even if the camera to be used for taking a picture or the display on which the camera preview image is displayed is changed, parameters related to photography (eg, angle of view, resolution, aspect ratio) are the same There was a problem that was maintained. In other words, there is an inconvenience in that the user must manually manually set (or change) parameters related to photography. Accordingly, even if there is no explicit user input to set (or change) a function or effect related to taking a picture, various types of photography related to taking a picture using folding (or unfolding) of the foldable electronic device as a triggering event There is a need for services to be provided to users.

A foldable electronic device according to an embodiment of the present invention includes a plurality of cameras, at least one display, at least one processor operatively connected to the plurality of cameras and the at least one display, and the at least one And at least one memory operatively connected to the processor, and the at least one memory, when executed, the at least one processor, a first preview image corresponding to a first camera among the plurality of cameras While being displayed on the at least one display, in response to selecting at least one other camera based on the analysis result of at least one object included in the first preview image, and detecting folding or unfolding of the electronic device , Instructions for displaying a second preview image corresponding to the selected at least one camera and obtaining a photographed image based on the displayed second preview image may be stored.

In the method of operating a foldable electronic device according to an embodiment of the present invention, while a first preview image corresponding to a first camera among a plurality of cameras of the electronic device is displayed on at least one display of the electronic device, Selecting at least one other camera of the electronic device based on an analysis result of at least one object included in the first preview image, in response to detecting folding or unfolding of the electronic device, the selected at least one An operation of displaying a second preview image corresponding to the camera of the user may include an operation of obtaining a photographed image based on the displayed second preview image.

In a camera preview state, a foldable electronic device according to an embodiment of the present invention provides a setting related to display of a preview image (eg, a camera providing a preview image in response to folding and/or unfolding of the foldable electronic device). , Or the aspect ratio). The foldable electronic device according to an embodiment of the present invention selects a camera to provide a preview image in response to folding and/or unfolding of the foldable electronic device, and selects a new preview image, even if there is no explicit user input. It can be provided according to an optimal setting value according to the usage situation of the foldable electronic device. Through this, a continuous camera shooting environment suitable for the user's shooting situation may be provided.

1 is a block diagram of an electronic device in a network environment, according to an embodiment.

2 is a diagram illustrating an unfolded state of an electronic device according to an exemplary embodiment.

3 is a diagram illustrating a folded state of an electronic device according to an exemplary embodiment.

4 is an exploded perspective view of an electronic device according to an exemplary embodiment.

5 is a block diagram of an electronic device according to an exemplary embodiment.

6 is a flowchart illustrating an operation sequence of an electronic device according to an exemplary embodiment.

FIG. 7 is a detailed operation sequence for analyzing at least one object displayed in a first preview image by the electronic device and selecting at least one camera based on the analysis result according to an exemplary embodiment.

8 illustrates an example in which an electronic device analyzes at least one object displayed in a first preview image according to an exemplary embodiment.

9 is a flowchart illustrating an operation of an electronic device according to an exemplary embodiment.

10 illustrates a detailed operation sequence for displaying a second preview image corresponding to a selected camera by an electronic device according to an exemplary embodiment.

11 illustrates an electronic device according to an embodiment.

12 illustrates a detailed operation sequence for an electronic device to analyze at least one object displayed in a first preview image and select at least one camera based on an analysis result, according to an exemplary embodiment.

13 illustrates an electronic device according to an embodiment.

14 illustrates a detailed operation sequence for outputting a guide notification by an electronic device according to an exemplary embodiment.

15 illustrates an example in which an electronic device outputs a guide notification according to an embodiment.

16 illustrates an example in which an electronic device outputs a guide notification according to an embodiment.

17 illustrates a detailed operation sequence for outputting a guide notification by an electronic device according to an embodiment.

18 illustrates an example in which an electronic device outputs a guide notification according to an embodiment.

19 is a flowchart illustrating an operation of an electronic device according to an exemplary embodiment.

In connection with the description of the drawings, the same or similar reference numerals may be used for the same or similar components.

1 is a block diagram of an electronic device 10 in a network environment 1 according to an exemplary embodiment. Referring to FIG. 1, in a network environment 1, the electronic device 10 communicates with the electronic device 12 through a first network 198 (for example, a short-range wireless communication network), or a second network 199 It is possible to communicate with the electronic device 14 or the server 18 through (eg, a long-distance wireless communication network). According to an embodiment, the electronic device 10 may communicate with the electronic device 14 through the server 18. According to an embodiment, the electronic device 10 includes a processor 120, a memory 130, an input device 150, an audio output device 155, a display device 160, an audio module 170, and a sensor module ( 176, interface 177, haptic module 179, camera module 180, power management module 188, battery 189, communication module 190, subscriber identification module 196, or antenna module 197 ) Can be included. In an embodiment, at least one of these components (eg, the display device 160 or the camera module 180) may be omitted or one or more other components may be added to the electronic device 10. In one embodiment, some of these components may be implemented as one integrated circuit. For example, the sensor module 176 (eg, a fingerprint sensor, an iris sensor, or an illuminance sensor) may be implemented while being embedded in the display device 160 (eg, a display).

The processor 120, for example, executes software (eg, a program 141) to configure at least one other component (eg, a hardware or software component) of the electronic device 10 connected to the processor 120. It can be controlled and can perform various data processing or operations. According to an embodiment, as at least part of data processing or operation, the processor 120 may store commands or data received from other components (eg, the sensor module 176 or the communication module 190) to the volatile memory 132. The command or data stored in the volatile memory 132 may be processed, and result data may be stored in the nonvolatile memory 134. According to an embodiment, the processor 120 includes a main processor 121 (eg, a central processing unit or an application processor), and a secondary processor 123 (eg, a graphic processing unit, an image signal processor) that can be operated independently or together , A sensor hub processor, or a communication processor). Additionally or alternatively, the coprocessor 123 may be set to use lower power than the main processor 121 or to be specialized for a designated function. The secondary processor 123 may be implemented separately from the main processor 121 or as a part thereof.

The coprocessor 123 is, for example, on behalf of the main processor 121 while the main processor 121 is in an inactive (eg, sleep) state, or the main processor 121 is active (eg, an application is executed). ) While in the state, together with the main processor 121, at least one of the components of the electronic device 10 (for example, the display device 160, the sensor module 176, or the communication module 190) It is possible to control at least some of the functions or states related to. According to an embodiment, the coprocessor 123 (eg, an image signal processor or a communication processor) may be implemented as part of another functionally related component (eg, the camera module 180 or the communication module 190). have.

The memory 130 may store various data used by at least one component of the electronic device 10 (eg, the processor 120 or the sensor module 176 ). The data may include, for example, software (eg, the program 141) and input data or output data for commands related thereto. The memory 130 may include a volatile memory 132 or a nonvolatile memory 134.

The program 141 may be stored as software in the memory 130, and may include, for example, an operating system 142, middleware 144, or an application 146.

The input device 150 may receive a command or data to be used for a component of the electronic device 10 (eg, the processor 120) from an external device (eg, a user) of the electronic device 10. The input device 150 may include, for example, a microphone, a mouse, a keyboard, or a digital pen (eg, a stylus pen).

The sound output device 155 may output an sound signal to the outside of the electronic device 10. The sound output device 155 may include, for example, a speaker or a receiver. The speaker can be used for general purposes such as multimedia playback or recording playback, and the receiver can be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from the speaker or as part of it.

The display device 160 may visually provide information to the outside of the electronic device 10 (eg, a user). The display device 160 may include, for example, a display, a hologram device, or a projector and a control circuit for controlling the device. According to an embodiment, the display device 160 may include a touch circuitry set to sense a touch, or a sensor circuit (eg, a pressure sensor) set to measure the strength of a force generated by the touch. have.

The audio module 170 may convert sound into an electric signal or, conversely, convert an electric signal into sound. According to an embodiment, the audio module 170 acquires sound through the input device 150, the sound output device 155, or an external electronic device directly or wirelessly connected to the electronic device 10 (for example, Sound may be output through the electronic device 12) (for example, a speaker or headphones).

The sensor module 176 detects an operating state (eg, power or temperature) of the electronic device 10, or an external environmental state (eg, a user state), and generates an electrical signal or data value corresponding to the detected state. can do. According to an embodiment, the sensor module 176 may include, for example, a gesture sensor, a gyro sensor, an atmospheric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, It may include a temperature sensor, a humidity sensor, or an illuminance sensor.

The interface 177 may support one or more designated protocols that may be used to connect the electronic device 10 to an external electronic device (eg, electronic device 12) directly or wirelessly. According to an embodiment, the interface 177 may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

The connection terminal 178 may include a connector through which the electronic device 10 can be physically connected to an external electronic device (eg, the electronic device 12). According to an embodiment, the connection terminal 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (eg, a headphone connector).

The haptic module 179 may convert an electrical signal into a mechanical stimulus (eg, vibration or movement) or an electrical stimulus that a user can perceive through a tactile or motor sense. According to an embodiment, the haptic module 179 may include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

The camera module 180 may capture a still image and a video. According to an embodiment, the camera module 180 may include one or more lenses, image sensors, image signal processors, or flashes.

The power management module 188 may manage power supplied to the electronic device 10. According to an embodiment, the power management module 188 may be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

The battery 189 may supply power to at least one component of the electronic device 10. According to an embodiment, the battery 189 may include, for example, a non-rechargeable primary cell, a rechargeable secondary cell, or a fuel cell.

The communication module 190 includes a direct (eg, wired) communication channel or a wireless communication channel between the electronic device 10 and an external electronic device (eg, the electronic device 12, the electronic device 14, or the server 18). It is possible to support establishment and communication through the established communication channel. The communication module 190 operates independently of the processor 120 (eg, an application processor), and may include one or more communication processors that support direct (eg, wired) communication or wireless communication. According to an embodiment, the communication module 190 is a wireless communication module 192 (eg, a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 194 (eg : A LAN (local area network) communication module, or a power line communication module) may be included. Among these communication modules, a corresponding communication module is a first network 198 (for example, a short-range communication network such as Bluetooth, WiFi direct or IrDA (infrared data association)) or a second network 199 (for example, a cellular network, the Internet, or It can communicate with external electronic devices through a computer network (for example, a telecommunication network such as a LAN or WAN). These various types of communication modules may be integrated into one component (eg, a single chip), or may be implemented as a plurality of separate components (eg, multiple chips). The wireless communication module 192 uses subscriber information (e.g., International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module 196 in a communication network such as the first network 198 or the second network 199. The electronic device 10 can be checked and authenticated.

The antenna module 197 may transmit a signal or power to the outside (eg, an external electronic device) or receive from the outside. According to an embodiment, the antenna module 197 may include one antenna including a conductor formed on a substrate (eg, a PCB) or a radiator formed of a conductive pattern. According to an embodiment, the antenna module 197 may include a plurality of antennas. In this case, from this, at least one antenna suitable for a communication method used in a communication network such as the first network 198 or the second network 199 is, for example, by the communication module 190 Can be selected from antennas. The signal or power may be transmitted or received between the communication module 190 and an external electronic device through the at least one selected antenna. According to some embodiments, other components (eg, RFIC) other than the radiator may be additionally formed as a part of the antenna module 197.

At least some of the components are connected to each other through a communication method (e.g., bus, general purpose input and output (GPIO), serial peripheral interface (SPI), or mobile industry processor interface (MIPI))) between peripheral devices and signals ( E.g. commands or data) can be exchanged with each other.

According to an embodiment, commands or data may be transmitted or received between the electronic device 10 and the external electronic device 14 through the server 18 connected to the second network 199. Each of the external

electronic devices

12 and 14 may be a device of the same or different type as the electronic device 10. According to an embodiment, all or part of the operations executed by the electronic device 10 may be executed by one or more of the external

electronic devices

12, 14, or 18. For example, when the electronic device 10 needs to perform a function or service automatically or in response to a request from a user or another device, the electronic device 10 does not execute the function or service by itself. In addition or in addition, it is possible to request one or more external electronic devices to perform the function or at least part of the service. One or more external electronic devices receiving the request may execute at least a part of the requested function or service, or an additional function or service related to the request, and transmit a result of the execution to the electronic device 10. The electronic device 10 may process the result as it is or additionally and provide it as at least part of a response to the request. To this end, for example, cloud computing, distributed computing, or client-server computing technology may be used.

The electronic device according to the exemplary embodiment disclosed in this document may be a device of various types. The electronic device may include, for example, a portable communication device (eg, a smart phone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a home appliance. The electronic device according to the embodiment of the present document is not limited to the above-described devices.

An embodiment of the present document and terms used therein are not intended to limit the technical features described in this document to specific embodiments, and should be understood to include various modifications, equivalents, or substitutes for the corresponding embodiment. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or a plurality of the items unless clearly indicated otherwise in a related context. In this document, “A or B”, “at least one of A and B”, “or at least one of B”, “A, B or C”, “at least one of A, B and C”, and “A, Each of phrases such as "at least one of B or C" may include any one of the items listed together in the corresponding one of the phrases, or all possible combinations thereof. Terms such as "first", "second", or "first" or "second" may be used simply to distinguish the component from other corresponding components, and the components may be referred to in other aspects (eg, importance or Order) is not limited. Some (eg, first) component is referred to as “coupled” or “connected” to another (eg, second) component, with or without the terms “functionally” or “communicatively”. When mentioned, it means that any of the above components can be connected to the other components directly (eg by wire), wirelessly, or via a third component.

The term "module" used in this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic blocks, parts, or circuits. The module may be an integrally configured component or a minimum unit of the component or a part thereof that performs one or more functions. For example, according to an embodiment, the module may be implemented in the form of an application-specific integrated circuit (ASIC).

An embodiment of this document is one or more instructions stored in a storage medium (eg, internal memory 136 or external memory 138) that can be read by a machine (eg, electronic device 10). It may be implemented as software (eg, program 141) including them. For example, the processor (eg, the processor 120) of the device (eg, the electronic device 10) may call and execute at least one command among one or more commands stored from a storage medium. This makes it possible for the device to be operated to perform at least one function according to the at least one command invoked. The one or more instructions may include code generated by a compiler or code executable by an interpreter. A storage medium that can be read by a device may be provided in the form of a non-transitory storage medium. Here,'non-transient' only means that the storage medium is a tangible device and does not contain a signal (e.g., electromagnetic wave), and this term refers to the case where data is semi-permanently stored in the storage medium. It does not distinguish between temporary storage cases.

According to an embodiment, a method according to an embodiment disclosed in this document may be provided by being included in a computer program product. Computer program products can be traded between sellers and buyers as commodities. The computer program product is distributed in the form of a device-readable storage medium (e.g. compact disc read only memory (CD-ROM)), or through an application store (e.g. Play Store ^TM ) or two user devices ( It can be distributed (e.g., downloaded or uploaded) directly between, e.g. smartphones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily generated in a storage medium that can be read by a device such as a server of a manufacturer, a server of an application store, or a memory of a relay server.

According to an embodiment, each component (eg, module or program) of the above-described components may include a singular number or a plurality of entities. According to an embodiment, one or more components or operations among the above-described corresponding components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (eg, a module or a program) may be integrated into one component. In this case, the integrated component may perform one or more functions of each component of the plurality of components in the same or similar to that performed by the corresponding component among the plurality of components prior to the integration. . According to an embodiment, operations performed by a module, program, or other component may be sequentially, parallel, repetitively or heuristically executed, or one or more of the above operations may be executed in a different order or omitted. , Or one or more other actions may be added.

2 and 3, in one embodiment, the electronic device 10 includes a foldable housing 500, a hinge cover 530 covering a foldable portion of the foldable housing 500, and the It may include a flexible or foldable display 552 (hereinafter referred to as a second display) disposed in the space formed by the foldable housing 500. In this document, the surface on which the second display 552 is disposed is defined as the first surface or the front surface of the electronic device 10. In addition, the opposite surface of the front surface is defined as the second surface or the rear surface of the electronic device 10. Also, a surface surrounding the space between the front and rear surfaces is defined as a third surface or a side surface of the electronic device 10. The electronic device 10 may correspond to the electronic device 10 disclosed in FIG. 1.

In one embodiment, the foldable housing 500 includes a first housing structure 510, a second housing structure 520 including a sensor area 524, a first rear cover 580, and a second rear surface. A cover 590 may be included. The foldable housing 500 of the electronic device 10 is not limited to the shape and combination shown in FIGS. 2 and 3, and may be implemented by a combination and/or combination of other shapes or components. For example, in another embodiment, the first housing structure 510 and the first rear cover 580 may be integrally formed, and the second housing structure 520 and the second rear cover 590 are integrally formed. Can be formed.

In the illustrated embodiment, the first housing structure 510 and the second housing structure 520 are disposed on both sides around a folding axis (A axis), and may have a shape that is generally symmetric with respect to the folding axis A. . As will be described later, the first housing structure 510 and the second housing structure 520 have different angles or distances depending on whether the electronic device 10 is in an open state, a folded state, or an intermediate state. I can. In the illustrated embodiment, unlike the first housing structure 510, the second housing structure 520 may further include the sensor region 524 in which various sensors are disposed. In an embodiment, the second housing structure 520 and the first housing structure 510 may have a mutually symmetric shape in an area other than the sensor area 524.

In one embodiment, as shown in FIG. 2, the first housing structure 510 and the second housing structure 520 may form a recess for accommodating the second display 552 together. In the illustrated embodiment, due to the sensor region 524, the recess may have two or more different widths in a direction perpendicular to the folding axis A.

For example, the recess is (1) formed at the edge of the sensor region 524 of the first and second housing structures 520 parallel to the folding axis A of the first housing structure 510 The first width w1 between the first portion 520a, and (2) does not correspond to the sensor region 524 of the second portion 510b and the second housing structure 520 of the first housing structure 510. It may have a second width w2 formed by the second portion 520b parallel to the folding axis A while not being formed. In this case, the second width w2 may be formed longer than the first width w1. In other words, the first portion 510a of the first housing structure 510 having an asymmetric shape and the first portion 520a of the second housing structure 520 form a first width w1 of the recess. And, the second portion 510b of the first housing structure 510 having a mutually symmetrical shape and the second portion 520b of the second housing structure 520 form a second width w2 of the recess. I can. In an embodiment, the first portion 520a and the second portion 520b of the second housing structure 520 may have different distances from the folding axis A. The width of the recess is not limited to the illustrated example. In various embodiments, the recess may have a plurality of widths due to the shape of the sensor region 524 or a portion having an asymmetric shape of the first housing structure 510 and the second housing structure 520.

In one embodiment, at least a portion of the first housing structure 510 and the second housing structure 520 may be formed of a metal material or a non-metal material having a rigidity of a size selected to support the second display 552. .

In one embodiment, the sensor region 524 may be formed to have a predetermined region adjacent to one corner of the second housing structure 520. However, the arrangement, shape, and size of the sensor area 524 are not limited to the illustrated example. For example, in another embodiment, the sensor region 524 may be provided at another corner of the second housing structure 520 or any region between the upper and lower corners. In one embodiment, components for performing various functions built into the electronic device 10 are electronically transmitted through the sensor area 524 or through one or more openings provided in the sensor area 524. It may be exposed on the front of the device 10. In one embodiment, the components may include various types of sensors. The sensor may include, for example, at least one of a front camera, a receiver, and a proximity sensor. The front camera may correspond to at least one of the second front camera 542 and the third front camera 543. In an embodiment, the front camera may further include a fourth front camera (not shown), which is a camera for applying a special effect to a captured image. For example, the fourth front camera (not shown) may be a camera for applying a special effect (eg, bokeh or out-focusing, telephoto, blur) to a captured image.

The first rear cover 580 is disposed on one side of the folding shaft on the rear surface of the electronic device 10 and may have, for example, a substantially rectangular periphery, and the first housing structure 510 The edge may be wrapped by. Similarly, the second rear cover 590 may be disposed on the other side of the folding shaft on the rear surface of the electronic device 10, and the edge thereof may be wrapped by the second housing structure 520.

In the illustrated embodiment, the first rear cover 580 and the second rear cover 590 may have a substantially symmetrical shape around the folding axis (A axis). However, this is only an example, and the first rear cover 580 and the second rear cover 590 do not necessarily have mutually symmetrical shapes. In an embodiment, the electronic device 10 may include a first rear cover 580 and a second rear cover 590 having various shapes. In one embodiment, the first rear cover 580 may be integrally formed with the first housing structure 510, and the second rear cover 590 may be integrally formed with the second housing structure 520. .

In an embodiment, the first rear cover 580, the second rear cover 590, the first housing structure 510, and the second housing structure 520 are various components of the electronic device 10 (for example, A space in which a printed circuit board or a battery) can be disposed may be formed. In an embodiment, one or more components may be disposed or visually exposed on the rear surface of the electronic device 10. For example, at least a part of at least one front camera (eg, the first front camera 541) may be visually exposed on the first rear cover 580. For example, at least a part of the first display 551 may be visually exposed through the first rear area 582 of the first rear cover 580. In an embodiment, one or more components or sensors may be visually exposed through the second rear area 592 of the second rear cover 590. In an embodiment, the sensor may include a proximity sensor and/or a rear camera. The rear camera may correspond to at least one of a first rear camera 341, a second rear camera 342, and a third rear camera 343. In an embodiment, the rear camera may further include a fourth rear camera (not shown), which is a camera for applying a special effect to a captured image. For example, the fourth rear camera (not shown) may be a camera for applying special effects (eg, bokeh or out-focusing, telephoto, blur) to a captured image.

In an embodiment, the first front camera 541 may support (or correspond to the first field of view) a first field of view. The first view angle range may be a view angle range for displaying the preview image in a normal mode. The first angle of view range may correspond to a range of 40 degrees to 60 degrees.

In an embodiment, the second front camera 542 and the third front camera 543 may correspond to different functions or performances, respectively, and may have higher specifications than the first front camera 541. For example, the second front camera 542 may correspond to a second field of view (eg, 60 to 90 degrees) (or support a second field of view), and the third front camera 543 may be It may correspond to a range (90 degrees to 180 degrees), and the second angle of view range and the third angle of view range may be wider than that of the first angle of view range corresponding to the first front camera 541. The third view angle range may be a wider view angle range than the second view angle range. For another example, the second front camera 542 and the third front camera 543 may support higher resolution than the first front camera 541.

In an embodiment, the first rear camera 341, the second rear camera 342, and the third rear camera 343 may each correspond to different functions or performances. For example, the first rear camera 341 may correspond to a second field of view (or support a second field of view), and the second rear camera 342 may have a second field of view that is narrower than the second field of view. It may correspond to one angle of view range, and the first angle of view may correspond to a telephoto or close-up mode. The third rear camera 343 may correspond to a third view angle range, which is a wider view angle range than the second view angle range.

In an embodiment, the second view angle range corresponding to the first rear camera 341 may correspond to a view angle range for displaying the preview image in a wide angle mode.

In an embodiment, the second rear camera 342 may correspond to a tele camera for magnifying a subject.

In an embodiment, the third view angle range corresponding to the third rear camera 343 may correspond to a view angle range for displaying the preview image in the ultra wide angle mode.

Referring to FIG. 3, the hinge cover 530 is disposed between the first housing structure 510 and the second housing structure 520 to be configured to cover an internal part (eg, a hinge structure). I can. In an embodiment, the hinge cover 530 may include a first housing structure 510 and a second housing structure according to the state of the electronic device 10 (flat state or folded state). 520) may be covered by a part or exposed to the outside.

For example, as illustrated in FIG. 2, when the electronic device 10 is in an open state, the hinge cover 530 may be covered by the first housing structure 510 and the second housing structure 520 and may not be exposed. . For example, as shown in FIG. 3, when the electronic device 10 is in a folded state (eg, a fully folded state), the hinge cover 530 may include the first housing structure 510 and the second housing. It may be exposed to the outside between the structures 520. As an example, when the first housing structure 510 and the second housing structure 520 are in an intermediate state in which the first housing structure 510 and the second housing structure 520 are folded with a certain angle, the hinge cover 530 is the first housing structure It may be partially exposed to the outside between the 510 and the second housing structure 520. However, in this case, the exposed area may be less than the fully folded state. In one embodiment, the hinge cover 530 may include a curved surface.

The second display 552 may be disposed on a space formed by the foldable housing 500. For example, the second display 552 is mounted on a recess formed by the foldable housing 500 and may constitute most of the front surface of the electronic device 10.

Accordingly, the front surface of the electronic device 10 may include a second display 552 and a partial region of the first housing structure 510 adjacent to the second display 552 and a partial region of the second housing structure 520. have. Further, the rear surface of the electronic device 10 includes a first rear cover 580, a partial area of the first housing structure 510 adjacent to the first rear cover 580, a second rear cover 590, and a second rear cover. A partial region of the second housing structure 520 adjacent to 590 may be included.

The second display 552 may mean a display in which at least a partial area can be transformed into a flat surface or a curved surface. In one embodiment, the second display 552 includes a folding area 103 and a first area 101 disposed on one side (left side of the folding area 103 shown in FIG. 2) based on the folding area 103 And a second area 102 disposed on the other side (right side of the folding area 103 shown in FIG. 2 ).

The division of the area of the second display 552 shown in FIG. 2 is exemplary, and the second display 552 may be divided into a plurality (eg, 4 or more or 2) areas according to a structure or function. May be. For example, in the embodiment shown in FIG. 2, the area of the second display 552 may be divided by the folding area 103 extending parallel to the y-axis or the folding axis (A-axis), but in another embodiment The second display 552 may be divided based on another folding area (eg, a folding area parallel to the x-axis) or another folding axis (eg, a folding axis parallel to the x-axis).

The first region 101 and the second region 102 may have a shape that is generally symmetric about the folding region 103. However, unlike the first area 101, the second area 102 may include a notch cut according to the presence of the sensor area 524, but in other areas, the first area It may have a shape symmetrical to the region 101. In other words, the first region 101 and the second region 102 may include a portion having a shape symmetrical to each other and a portion having a shape asymmetrical to each other.

Hereinafter, the operation of the first housing structure 510 and the second housing structure 520 according to the state of the electronic device 10 (eg, a flat state and a folded state) and a second display ( 552) will be described.

In an embodiment, when the electronic device 10 is in a flat state (eg, FIG. 2), the first housing structure 510 and the second housing structure 520 form an angle of 180 degrees and move in the same direction. Can be arranged facing. The surface of the first area 101 and the surface of the second area 102 of the second display 552 form 180 degrees to each other, and may face the same direction (eg, the front direction of the electronic device). The folding area 103 may form the same plane as the first area 101 and the second area 102.

In an embodiment, when the electronic device 10 is in a folded state (eg, FIG. 3 ), the first housing structure 510 and the second housing structure 520 may be disposed to face each other. The surface of the first area 101 and the surface of the second area 102 of the second display 552 form a narrow angle (eg, between 0° and 10°) and may face each other. At least a portion of the folding area 103 may be formed of a curved surface having a predetermined curvature.

In an embodiment, when the electronic device 10 is in an intermediate state, the first housing structure 510 and the second housing structure 520 may be disposed at a certain angle to each other. . A surface of the first region 101 and a surface of the second region 102 of the second display 552 may form an angle that is larger than the folded state and smaller than the unfolded state. At least a portion of the folding area 103 may be formed as a curved surface having a predetermined curvature, and the curvature at this time may be smaller than that in the folded state.

Referring to FIG. 4, in an embodiment, the electronic device 10 includes a display unit 20, a bracket assembly 30, a substrate unit 600, a first housing structure 510, and a second housing structure 520. , A first rear cover 580 and a second rear cover 590 may be included. In this document, the display unit 20 may be referred to as a display module or a display assembly.

The display unit 20 may include a second display 552 and one or more plates or layers 140 on which the second display 552 is mounted. In an embodiment, the plate 140 may be disposed between the second display 552 and the bracket assembly 30. A second display 552 may be disposed on at least a portion of one surface of the plate 140 (eg, an upper surface with reference to FIG. 3 ). The plate 140 may be formed in a shape corresponding to the second display 552. For example, a partial region of the plate 140 may be formed in a shape corresponding to the notch 104 of the second display 552.

The bracket assembly 30 covers a hinge structure disposed between the first bracket 410, the second bracket 420, the first bracket 410 and the second bracket 420, and the hinge structure when viewed from the outside. It may include a hinge cover 530 and a wiring member 430 (eg, a flexible printed circuit (FPC)) crossing the first bracket 410 and the second bracket 420.

In one embodiment, the bracket assembly 30 may be disposed between the plate 140 and the substrate part 600. For example, the first bracket 410 may be disposed between the first region 101 and the first substrate 610 of the second display 552. The second bracket 420 may be disposed between the second region 102 and the second substrate 620 of the second display 552.

In an embodiment, at least a part of the wiring member 430 and the hinge structure 300 may be disposed inside the bracket assembly 30. The wiring member 430 may be disposed in a direction crossing the first bracket 410 and the second bracket 420 (eg, in the x-axis direction). The wiring member 430 may be disposed in a direction (eg, an x-axis direction) perpendicular to the folding axis (eg, y-axis or folding axis A of FIG. 1) of the folding area 103 of the electronic device 10. have.

The substrate part 600, as mentioned above, includes a first substrate 610 disposed on the first bracket 410 side and a second substrate 620 disposed on the second bracket 420 side. I can. The first and

second substrates

610 and 620 may include a bracket assembly 30, a first housing structure 510, a second housing structure 520, a first rear cover 580, and a second rear cover. It may be disposed inside the space formed by 590. Components for implementing various functions of the electronic device 10 may be mounted on the first substrate 610 and the second substrate 620.

The first housing structure 510 and the second housing structure 520 may be assembled with each other so as to be coupled to both sides of the bracket assembly 30 while the display unit 20 is coupled to the bracket assembly 30. As will be described later, the first housing structure 510 and the second housing structure 520 may slide on both sides of the bracket assembly 30 to be coupled to the bracket assembly 30.

In one embodiment, the first housing structure 510 may include a first rotation support surface 512, and the second housing structure 520 is a second rotation support corresponding to the first rotation support surface 512. It may include a face 522. The first rotation support surface 512 and the second rotation support surface 522 may include curved surfaces corresponding to the curved surfaces included in the hinge cover 530.

In an embodiment, the first rotation support surface 512 and the second rotation support surface 522 are the hinge cover 530 when the electronic device 10 is in an unfolded state (eg, the electronic device of FIG. 1 ). The hinge cover 530 may not be exposed to the rear surface of the electronic device 10 or may be exposed to a minimum. Meanwhile, the first rotation support surface 512 and the second rotation support surface 522 are curved surfaces included in the hinge cover 530 when the electronic device 10 is in a folded state (eg, the electronic device of FIG. 2 ). By rotating along the hinge cover 530 may be exposed to the rear surface of the electronic device 10 as much as possible.

5 is a block diagram of an electronic device 10 according to example embodiments.

5, the electronic device 10 includes a processor 120, a communication module 190, a memory 130, an input module 150, a first display 551, a second display 552, and a first display. To Nth cameras 561 to 569. In one embodiment, N may be a natural number of 3 or more.

In an embodiment, the processor 120 may control at least one component included in the electronic device 10. For example, the processor 120 may control the first display 551 to display a first preview image corresponding to the first camera 561. For example, the processor 120 may analyze at least one object included in the first preview image.

In one embodiment, the processor 120 may include an image analysis module 525 and a camera module 526. In one embodiment, the processor 120 may execute the image analysis module 525 and the camera module 526. In an embodiment, the processor 120 may control at least one component included in the electronic device 10 through the image analysis module 525 and the camera module 526. In an embodiment, the image analysis module 525 and the camera module 526 may be implemented as a physical circuit or a software program.

In an embodiment, the image analysis module 525 may analyze at least one object included in a preview image (eg, a first preview image) displayed on a display (eg, the first display 551 ). In an embodiment, when analyzing at least one object, the image analysis module 525 includes characteristic information of at least one object (eg, size, color, shape, shadow, geometric characteristic, motion information, or movement direction). Information) can be determined. In an embodiment, the image analysis module 525 may determine the type of at least one object (eg, person, animal, building, or food) in analyzing at least one object. Property information of the at least one object may be used to determine the type of at least one object.

In an embodiment, information about an object analysis result generated by the image analysis module 525 may be transmitted to the camera module 526.

In an embodiment, the camera module 526 may process data of a camera preview image input from the first to Nth cameras 561 to 569. For example, the camera module 526 transmits data of the first preview image input from the first camera 561 to the image analysis module 525, or receives object analysis result information from the image analysis module 525. can do. For example, the camera module 526 may control the first display 551 corresponding to the first camera 561 so that the first preview image input from the first camera 561 is displayed.

In one embodiment, the camera module 526 is at least one camera to be activated in response to folding and/or unfolding of the electronic device 10 based on the analysis result information of the object received from the image analysis module 525. (Example: the second camera 562) can be selected. In an embodiment, the camera module 526 transmits the object analysis result information (or information generated by processing the object analysis result information) received from the image analysis module 525 to the selected at least one camera. I can. In an embodiment, the camera module 526 may transmit the information to the at least one selected camera when a specified condition is satisfied. In an embodiment, the designated condition may be activation of the selected at least one camera (eg, the second camera 562). In an embodiment, the designated condition may be detection of folding of the electronic device 10 or detection of unfolding. In an embodiment, the camera module 526 may transmit the object analysis result information received from the image analysis module 525 or the information generated by processing the analysis result information of the object. 2 When activating the camera 562 (for example, when folding and/or unfolding of the electronic device 10 is detected), it may be transmitted to the at least one selected camera. At least one activated camera may recognize at least one subject using information from the camera module 526. At least one activated camera may recognize at least one subject faster than when the information is not used by using the information from the camera module 526.

In an embodiment, the first to Nth cameras 561 to 569 may include a plurality of cameras included in the electronic device 10. For example, the first camera 561 corresponds to the first front camera 541 disclosed in FIG. 2, and the second camera 562 and the third camera (not shown) are the second front camera disclosed in FIG. 2 ( 542) and the third front camera 543, respectively. However, this is only an example, and the first camera 561, the second camera 562, and the third camera (not shown) are the first rear camera 341, the second rear camera 342, and the third camera shown in FIG. 3 may correspond to the rear camera 343 respectively.

In an embodiment, at least one camera (eg, the first camera 561) among the first to Nth cameras 561 to 569 corresponds to the first display 551, and at least one other camera (eg, The second camera 561 and the third camera (not shown) may correspond to the second display 552. For example, a preview image of the first camera 561 is displayed on the first display 551, and a preview image of the second camera 562 or a third camera (not shown) is displayed on the second display 552 Can be.

In an embodiment, the first to Nth cameras 561 to 569 may support different angles of view. However, this is only an example, and at least two of the first to Nth cameras 561 to 569 may support the same angle of view range.

In an embodiment, the first camera 561 may support a first field of view. In an embodiment, the second camera 562 may support a second angle of view. In an embodiment, the third camera (not shown) may support a third field of view.

In an embodiment, the first angle of view range may be a range of angles of view for displaying the preview image in the normal mode. In an embodiment, the second angle of view range may be a view angle range for displaying the preview image in a wide angle mode. In an embodiment, the third angle of view range may be a view angle range for displaying the preview image in the ultra wide angle mode. In one embodiment, the first angle of view may have a range of 40 to 60 degrees (°). In one embodiment, the second angle of view may have a range of 60 to 90 degrees (°). In one embodiment, the third angle of view may have a range of 90 to 180 degrees (°).

In an embodiment, the first to Nth cameras 561 to 569 may have different resolutions. However, this is only an example, and at least two cameras of the first to Nth cameras 561 to 569 may have the same resolution.

In an embodiment, the first display 551 and the second display 552 may display content. For example, an execution screen of an application, an image (eg, a preview image of a camera), a video, a call/message notification, etc. may be displayed.

In an embodiment, the first display 551 may have a vertical length longer than a horizontal length. Accordingly, even in the case of a preview image corresponding to the same camera, when the horizontal length is displayed based on an aspect ratio longer than the vertical length, the margin may increase as compared to the vice versa.

In an embodiment, the second display 552 may have a horizontal length longer than a vertical length. Accordingly, even in the case of a preview image corresponding to the same camera, when the vertical length is displayed based on an aspect ratio longer than the horizontal length, the margin may be larger than that in the opposite case.

In an embodiment, the memory 130 may store instructions for the electronic device 10 to perform one or more operations according to embodiments of the present disclosure under the control of the processor 120. For example, the memory 130 may store a command that causes the processor 120 to select at least one camera based on the analysis result of at least one object displayed in the first preview image.

In another embodiment, the memory 130 may store user history data or user preference information related to camera shooting.

In an embodiment, the input module 150 may be used for the electronic device 10 to receive a user input. For example, the input module 150 may include a physical user interface such as a button. The electronic device 10 may receive a user input for acquiring a captured image and a user input for switching a camera or display through the input module 150.

In an embodiment, the sensor module 176 may be disposed within the foldable housing 500 or the hinge cover 530. In an embodiment, the sensor module 176 may include at least one of an angle sensor, a gyro sensor, an acceleration sensor, and a grip sensor. In one embodiment, the sensor information of the sensor module 176 is determined by the processor 120 to determine whether the current state of the electronic device 10 corresponds to an open state, a folded state, or an intermediate state, or the electronic device 10 ) Can be used to detect changes in state (e.g., folding (changing from unfolded to unfolded), or unfolding (changing from folded to unfolded).

The sensor module 176 may transmit sensor information used to detect folding or unfolding of the electronic device 10 to the processor 120 periodically or when an event occurs.

6 illustrates an operation sequence of an electronic device (eg, electronic device 10) according to example embodiments. 6 may be described with reference to components of the electronic device 10 of FIGS. 1 to 5.

The operations disclosed in FIG. 6 may be performed by the electronic device 10 under the control of the processor 120 of FIG. 5. Hereinafter, it is described that the electronic device 10 performs the operations disclosed in FIG. 6.

In operation 610, the electronic device 10 may display the first preview image. In an embodiment, the electronic device 10 displaying the first preview image may be in a folded state (eg, in-folded).

In an embodiment, the first preview image may be a preview image corresponding to the first front camera (eg, the first front camera 541). The electronic device 10 may display the first preview image on the first display 551 corresponding to the first front camera 541. The first front camera 541 may correspond to a first field of view.

In an embodiment, the first preview image may be a preview image corresponding to the first rear camera (eg, the first rear camera 341 ). The electronic device 10 may display the first preview image on the first display 551 corresponding to the first rear camera 341. The first rear camera 341 may correspond to a second field of view.

In operation 620, the electronic device 10 may analyze at least one object displayed in the first preview image. The electronic device 10 may analyze at least one object by performing a scene recognition function (eg, a face recognition function). When analyzing at least one object, the electronic device 10 may determine characteristic information (eg, size, color, shape, shade, and geometric characteristics) of at least one object. In analyzing at least one object, the electronic device 10 may determine the type of at least one object (eg, person, animal, building, food) based on the determined characteristic information.

In operation 630, the electronic device 10 may select at least one camera based on the analysis result.

In an embodiment, the electronic device 10 may select at least one camera from among all cameras included in the electronic device 10.

In an embodiment, the electronic device 10 may select at least one camera from among other cameras excluding a camera (eg, the first front camera 541) corresponding to the preview image currently being displayed.

In one embodiment, when the camera corresponding to the preview image currently displayed is a front camera, at least one camera may be selected from among the remaining front cameras, and the camera corresponding to the preview image currently displayed is a rear camera. In this case, at least one camera may be selected from among the remaining rear cameras.

In an embodiment, the electronic device 10 may select at least one camera in consideration of the current folding state of the electronic device 10. For example, if the electronic device 10 is currently in the folded state, the electronic device 10 may use cameras that can be effectively used for photographing when the electronic device 10 is unfolded in the future (for example, the second front camera 542 and the third Among the front cameras 543), at least one camera may be selected. For example, when the electronic device 10 is currently in the unfolded state, at least among cameras that can be effectively used for photographing when the electronic device 10 is folded in the future (for example, the first front camera 541), You can select one camera.

The electronic device 10 may select at least one camera further based on a display property (eg, a display size and a supported resolution).

The at least one camera selected in operation 630 may be activated in response to folding/unfolding of the electronic device 10 after that. For example, when the second front camera 542 is selected in operation 630, the electronic device 10 activates the selected second front camera 542 in response to an unfolding of the electronic device 10 in the future, A preview image of the selected second front camera 542 may be displayed.

In operation 640, the electronic device 10 may check whether folding or unfolding of the electronic device 10 is detected. For example, the electronic device 10 may confirm that the folding of the electronic device 10 is detected by confirming that the state of the electronic device 10 is changed from the open state (or the intermediate state) to the folded state. For example, by confirming that the state of the electronic device 10 is changed from the folded state to the unfolded state, it can be confirmed that the unfolding of the electronic device 10 is detected. The electronic device 10 may check whether folding or unfolding is detected using the sensor information of the sensor module 176. In an embodiment, the electronic device 10 may identify a change in the state of the electronic device 10. In one embodiment, the electronic device 10 identifies a change in a state of the electronic device 10 from a first state (eg, a folded state) to a state other than the first state (eg, an intermediate state or an unfolded state) can do. In an embodiment, when a change in the folding state of the electronic device 10 is identified, the electronic device 10 may determine that folding or unfolding is detected.

In operation 650, the electronic device 10 may display a second preview image corresponding to the selected camera.

In an embodiment, the electronic device 10 displaying the second preview image may be in an unfolded state.

In an embodiment, the electronic device 10 may display a second preview image corresponding to the selected camera on a corresponding display.

In an embodiment, the electronic device 10 may activate a selected camera and a display corresponding to the selected camera, and display a second preview image corresponding to the activated camera on the activated display. In an embodiment, the electronic device 10 may deactivate a camera corresponding to the first preview image and a display on which the first preview image is being displayed.

For example, when the selected camera is a second front camera (for example, the second front camera 542), the electronic device 10 may be configured with a second front camera 542 and a second front camera 542 corresponding to the second front camera 542. 2 The display 552 may be activated, and a second preview image corresponding to the second front camera 542 may be displayed on the second display 552.

In an embodiment, the electronic device 10 displays a second preview image corresponding to the second front camera 542 based on a specific angle of view included in the field of view corresponding to the second front camera 542. I can. For example, when the second front camera 542 corresponds to a second field of view (eg, 60 degrees to 90 degrees) for displaying the preview image in a wide-angle mode, the electronic device 10 is based on a 75-degree field of view. Thus, the second preview image can be displayed. In an embodiment, in determining a specific angle of view within the second angle of view, the electronic device 10 determines properties (eg, size, resolution) of the second display 552 corresponding to the second front camera 542. May be considered.

In an embodiment, the electronic device 10 determines an aspect ratio (eg, 16:9, 4:3, 1:1, 3:4, 9:16, Full) associated with the display of the second preview image. It may determine and display the second preview image based on the determined aspect ratio.

In an embodiment, the electronic device 10 provides an analysis result of at least one object displayed in the first preview image (eg, arrangement information of at least one object) or based on user preference information stored in the memory 130. 2 You can determine the aspect ratio of the preview image.

In an embodiment, the electronic device 10 may determine the aspect ratio of the second preview image further based on the size of the display corresponding to the selected camera or the ratio of the width and height.

In operation 660, the electronic device 10 may acquire a photographed image.

In an embodiment, in response to a user input for obtaining the captured image, the electronic device 10 may acquire the captured image based on the displayed second preview image. The user input for obtaining the photographed image may be a graphic user interface (eg, a photographing button) displayed on the second display 552 or a user input for a physical interface disposed on the foldable housing 500. In one embodiment, the graphic user interface may be displayed on the first display 551 and the second display 552 before and after folding or unfolding of the electronic device 10 is detected. However, the electronic device 10 may be folded. Alternatively, when unfolding is detected, the display position of the graphical user interface may be changed. For example, the photographing button displayed in the lower center of the first display 551 is a user's hand holding the electronic device 10 (eg, left hand) when folding or unfolding of the electronic device 10 is detected. It may be displayed on the lower left of the second display 552 so as to be close to.

In another embodiment, even if there is no explicit user input for acquiring the captured image, the electronic device 10 automatically captures the captured image when a preset time elapses after detecting folding or unfolding (or after displaying the second preview image). You can also get

In another embodiment, when the electronic device 10 receives a user input for acquiring a photographed image before detecting folding or unfolding, a preset time after detection of folding or unfolding (or after displaying the second preview image) After this elapses, a photographed image may be acquired.

FIG. 7 is for analyzing at least one object displayed in a first preview image by an electronic device (eg, the electronic device 10) according to an embodiment of the present invention, and selecting at least one camera based on the analysis result. It shows a detailed operation sequence. 8 illustrates an example in which the electronic device 10 analyzes at least one object displayed in a first preview image according to an embodiment of the present invention. 7 and 8 may be described with reference to configurations of the electronic device 10 of FIGS. 1 to 5.

Operations disclosed in FIG. 7 may be detailed operations of

operations

620 and 630 disclosed in FIG. 6.

The operations disclosed in FIG. 7 may be performed when the first preview image is a preview image corresponding to the front camera (eg, the first front camera 541 ).

In operation 710, the electronic device 10 may check the face of at least one person. The electronic device 10 may check that the first preview image includes at least one person's face, and determine at least one of the number, shape, size, and area ratio of the faces of the at least one person whose presence is confirmed. have. For example, referring to FIG. 8, the electronic device 10 may check the faces 820 and 830 of two people included in the first preview image 810.

In an embodiment, the electronic device 10 may check the face of a person (eg, face A 820) completely included in the first preview image, or the face of a person partially included in the first preview image (eg, : Face B (830) can also be checked. For example, if the electronic device 10 checks a specific face completely included in the first preview image and then part of the specific face is cut off on the screen of the first preview image, the specific face is partially included in the first preview image. It can be confirmed as included. As another example, the electronic device 10 checks a part (eg, one eye) of feature points (eg, eyebrows, eyes, nose, ears) that are considered to be generally included in the face, so that the first preview image is displayed. You can also check the partially included face.

In operation 720, the electronic device 10 may determine whether the number of the identified faces of at least one person is greater than or equal to the first threshold value. In an embodiment, the first threshold value may be 3. For example, when there are four faces of a person included in the first preview image, the electronic device 10 may determine that the number of the identified faces of at least one person is equal to or greater than the first threshold value.

When the number of the identified faces of the at least one person is greater than or equal to the first threshold value (YES in operation 720), the electronic device 10 operates in operation 760 with a camera corresponding to the third field of view (eg, a third front camera). (543)) can be selected. In an embodiment, the third angle of view range may correspond to a view angle range for displaying the preview image in an ultra wide angle mode.

When the number of the identified faces of the at least one person is less than the first threshold value (No in operation 720), the electronic device 10 may check in operation 730 whether a partially displayed person's face exists. . For example, it may be checked whether there is a face of a person whose part is cut off by a margin of the first preview image among the identified at least one person's face.

When a partially displayed human face exists (YES in operation 730), in operation 760, the electronic device 10 may select a camera corresponding to the third angle of view.

When the partially displayed human face does not exist (No in operation 730), in operation 740, the electronic device 10 determines whether a human face whose distance to the boundary line of the first preview image is less than or equal to the second threshold value exists. You can decide whether or not. For example, the electronic device 10 may determine whether a face of a person close to a boundary of the first preview image exists among the faces of a person that is fully displayed. Referring to FIG. 8, the electronic device 10 determines a closed curve corresponding to an outline of a face 820 of a person fully displayed and a center 815 of the closed curve, and determines the center 815 and the first of the determined closed curve. You can determine the distance to the borders of the preview image (eg, left border, right border, bottom border, upper border).

When there is a face of a person whose distance to the boundary line is less than or equal to the second threshold (YES in operation 740), the electronic device 10 may select a camera corresponding to the third field of view in operation 760.

When there is no face of a person whose distance to the boundary line is less than or equal to the second threshold (No in operation 740), in operation 750, the electronic device 10 determines that the face of the at least one identified person is in the first preview image. It can be checked whether the ratio of the area occupied by (ie, the ratio of the entire area of the first preview image and the area of the identified at least one person's face) is equal to or greater than the third threshold value.

When the ratio of the region is greater than or equal to the third threshold value (YES in operation 750), the electronic device 10 may select a camera corresponding to the third angle of view in operation 760.

When the ratio of the region is less than the third threshold (No in operation 750), the electronic device 10 may select a camera corresponding to the second field of view (eg, the second front camera 542) in operation 770. . In an embodiment, the second angle of view range may correspond to a relatively narrow angle of view range compared to the third angle of view. In an embodiment, the second view angle range may correspond to a view angle range for displaying the preview image in a wide angle mode.

According to the embodiment disclosed in FIG. 7, the electronic device 10 is activated in response to a folding or unfolding of the electronic device 10 in the future, based on the analysis result of the face of at least one person included in the first preview image. You can select the camera to be used.

The order of the plurality of operations disclosed in FIG. 7 may be changed from each other, and some operations may be omitted. For example, the electronic device 10 may perform operation 730 before operation 720, and may skip operation 750 after performing operation 740 and perform operation 770.

9 illustrates a sequence of operations of an electronic device (eg, electronic device 10) according to an embodiment of the present invention. 9 may be described with reference to components of the electronic device 10 of FIGS. 1 to 5.

In the description of operation 750 of FIG. 7, when the ratio of the area occupied by the identified at least one person's face in the first preview image is less than the third threshold, the camera corresponding to the second field of view range in operation 770 It can be selected as previously described.

FIG. 9 shows that when the ratio of the area occupied by the identified at least one person's face in the first preview image is less than a third threshold value, it may be additionally performed before a camera corresponding to the second field of view is selected. Explain the operation.

In an embodiment, when the ratio of the area occupied by the identified at least one person's face in the first preview image is less than the third threshold value, the electronic device 10 operates in operation 910. After moving in the first direction, it can be checked whether the movement in the second direction opposite to the first direction. Specifically, while the first preview image is displayed, the electronic device 10 may check whether the electronic device 10 has ever moved in the second direction within a specified time after the electronic device 10 has moved in the first direction. .

In an embodiment, while the first preview image is displayed, the electronic device 10 moves the second speed in the second direction within a specified time after the electronic device 10 is moved at the first speed in the first direction. You can also check whether you have ever been moved to.

In an embodiment, when the first direction is a direction of gravity (z- direction), the second direction may be a direction opposite to the direction of gravity (z+ direction).

In an embodiment, when the direction toward the user in the electronic device 10 is an x- direction and a direction away from the user is an x+ direction, the first direction may be a y+ direction perpendicular to the z and x axes, and the second The direction can be the y-direction.

The reason for confirming the movement of the electronic device in the first direction and the second direction in operation 910 is to check whether the user wants to take a camera with a wider angle of view. In general, when a plurality of subjects (eg, a plurality of people) are photographed at a relatively narrow angle of view, a case in which a part of the subject is not included in the screen may occur frequently. When the electronic device 10 is moved in a specific direction (ie, the first direction) to include the partial subject on the screen, a part of the other subject included in the screen may not be included in the screen before the movement. In this case, the user generally moves the electronic device 10 in the opposite direction (ie, the second direction) again, and as a result, the electronic device 10 moves in the first direction in operation 910 Operation 760 may be performed when it is determined that it has moved in the second direction.

In an embodiment, the electronic device 10 may select a camera corresponding to the third field of view in operation 760. For example, when the electronic device 10 is moved in the first direction and then in the second direction, it may be determined that it is impossible to capture a wider angle of view desired by the user with the currently activated camera and display. Accordingly, the electronic device 10 selects a camera (eg, the third front camera 543) corresponding to the third field of view, which is a relatively wide field of view, based on the determination that the user wants to take a camera with a wider field of view. I can.

In an embodiment, in operation 770, the electronic device 10 may select a camera corresponding to the second field of view. For example, if it is not confirmed that the electronic device 10 moves in the first direction and then moves in the second direction (No in operation 910), the electronic device 10 has a narrower field of view than the third field of view. A second front camera 542 corresponding to the second field of view may be selected.

In one embodiment, operation 910 is shown to be performed after operation 750 is performed, but any of operation 710 and operation 720, operation 720 and operation 730, operation 730 and operation 740, operation 740 and operation 750 It can also be done in one.

10 illustrates a detailed operation sequence for displaying a second preview image corresponding to a selected camera by an electronic device (eg, the electronic device 10) according to an embodiment of the present invention. 10 may be described with reference to components of the electronic device 10 of FIGS. 1 to 5.

The operations disclosed in FIG. 10 may be detailed operations of operation 650 disclosed in FIG. 6.

The electronic device 10 may determine whether the second front camera 542 is selected in operation 1010.

When the second front camera 542 is selected (YES in operation 1010), the electronic device 10 may display a second preview image based on a second angle of view included in the second angle of view in operation 1020. For example, when the second view angle range corresponds to 60 degrees to 90 degrees, the electronic device 10 may display the second preview image on the second display 552 based on the 75 degree view angle.

In an embodiment, the second field of view range may correspond to a field of view range for displaying the preview image in a wide-angle mode.

When the second front camera 542 is not selected (No in operation 1010), the electronic device 10 may determine whether the third front camera 543 is selected in operation 1030. When the third front camera 543 is not selected (No in operation 1030), the electronic device 10 may terminate the corresponding algorithm. When the third front camera 543 is selected (YES in operation 1030), in operation 1040, the electronic device 10 may display the second preview image based on the third field of view included in the third field of view. For example, when the third field of view range corresponds to 90 degrees to 180 degrees, the electronic device may display the second preview image on the second display 552 based on the 120 degree field of view.

In an embodiment, the third angle of view range may correspond to a view angle range for displaying the preview image in an ultra wide angle mode.

11 illustrates an electronic device 10 according to an embodiment of the present invention.

FIG. 11A shows an electronic device in a folded state, and FIG. 11B shows an electronic device in an unfolded state.

Referring to FIG. 11A, the electronic device 10 may display the first preview image 1110 on the first display 551. The first preview image 1110 may be a preview image of the first front camera 541. The first front camera 541 may support a first angle of view range or may correspond to a first angle of view range.

In an embodiment, the electronic device 10 may select at least one camera based on an analysis result of at least one object included in the first preview image 1110. For example, based on the distance between the faces of two people included in the first preview image 1110 and the boundary lines of the first preview image 1110, the electronic device 10 may use the second front camera 542 And, from among the third front cameras 543, a third front camera 543 supporting a relatively wider field of view may be selected.

Referring to FIG. 11B, the electronic device 10 may detect unfolding. In response to detecting the unfolding, the electronic device 10 activates the selected third front camera 543 and displays a second preview image 1120 corresponding to the activated third front camera 543. have. Accordingly, even if there is no explicit user input, the electronic device 10 may provide a preview image of a camera supporting a wider field of view to the user in response to the unfolding of the electronic device 10.

12 is a diagram for an electronic device (eg, electronic device 10) according to an embodiment of the present invention to analyze at least one object displayed in a first preview image and select at least one camera based on the analysis result. It shows a detailed operation sequence. 12 may be described with reference to components of the electronic device 10 of FIGS. 1 to 5.

Operations disclosed in FIG. 12 may be detailed operations of

operations

620 and 630 disclosed in FIG. 6.

The operations disclosed in FIG. 12 may be performed when the first preview image is a preview image corresponding to the first rear camera 341.

In operation 1210, the electronic device 10 may determine that the first preview image corresponds to the landscape image.

For example, if the electronic device 10 cannot check the face of at least one person in the first preview image, or when the size of the face of at least one person included in the first preview image is smaller than the reference value, the first It can be confirmed that the preview image corresponds to the landscape image.

For example, the electronic device 10 determines the type (eg, mountain, sea, tree, building) of the main subject (eg, the largest subject) included in the first preview image, and It may be confirmed that the first preview image corresponds to the landscape image based on the type.

In operation 1220, the electronic device 10 may check whether an arrangement of at least one object included in the first preview image corresponds to at least one pre-designated arrangement.

For example, when a main subject (or a subject having a certain size or larger) included in the first preview image is disposed symmetrically (e.g., left-right symmetrical, vertically symmetrical), the electronic device 10 includes at least one pre-designated arrangement. It can be determined that it corresponds to.

For another example, when a part of the main subject included in the first preview image is not cut out and visible in the first preview image, the electronic device 10 may determine that it corresponds to at least one predetermined arrangement.

For another example, when the length of a specific line or the size of a specific region calculated by the arrangement of at least one object included in the first preview image exceeds a specified value, the electronic device 10 May be determined to correspond to at least one pre-designated arrangement. For example, when a horizontal line or a horizon that exceeds a specified value is included in the first preview image, the electronic device 10 may determine that it corresponds to at least one predetermined arrangement. For another example, if the first preview image includes trees that are continuously arranged, and the line connecting the top portions of the trees has a constant slope of a certain length or more, the electronic device 10 is included in the first preview image. It may be determined that the arranged at least one object corresponds to at least one previously designated arrangement.

When the arrangement of at least one object included in the first preview image corresponds to at least one pre-designated arrangement (YES in operation 1220), the electronic device 10 selects a camera corresponding to the third field of view in operation 1230. I can. For example, the electronic device 10 may select the third rear camera 343 corresponding to the third field of view.

When the arrangement of at least one object included in the first preview image does not correspond to the at least one pre-designated arrangement (No in operation 1220), the electronic device 10 selects a camera corresponding to the second field of view in operation 1240. You can choose. For example, the electronic device 10 may select the first rear camera 341 corresponding to the first preview image as it is.

13 illustrates an electronic device 10 according to embodiments of the present invention.

FIG. 13A illustrates the electronic device in a folded state from multiple angles, and FIG. 13B illustrates the electronic device in an unfolded state.

13A, an electronic device 10 including a first rear camera 341, a second rear camera 342, and a third rear camera 343 is provided on the first display 551. 1 A preview image 1310 can be displayed. The first preview image 1310 may be a preview image of the first rear camera 341. The first rear camera 341 may correspond to a second field of view.

In an embodiment, the electronic device 10 is a first indicator indicating which camera corresponds to the currently displayed preview image by overlapping at least a part of the first preview image 1310 on the first display 551 (1330) can be displayed. The first indicator 1330 is objects indicating the activation or deactivation state of the first rear camera 341, the second rear camera 342, and the third rear camera 343 (corresponding to the first rear camera 341). A first object 1331, a second object 1332 corresponding to the second rear camera 342, and a third object 1333 corresponding to the third rear camera 343) may be included. Since the preview image currently displayed on the first display 551 corresponds to the first rear camera 341, the first object 1331 corresponding to the first rear camera 341 is the second rear camera 342 The second object 1332 corresponding to, and the third object 1333 corresponding to the third rear camera 343 may be displayed differently (eg, color, shape, and shade).

In an embodiment, the electronic device 10 may confirm that the first preview image 1310 corresponds to the landscape image. Based on the determination that the object (road 1311) included in the first preview image 1310 is arranged symmetrically to the left, the electronic device 10 displays at least one object included in the first preview image 1310. It can be confirmed that the arrangement corresponds to at least one pre-designated arrangement. Accordingly, the electronic device 10 may select the third rear camera 343 corresponding to a relatively wider field of view.

Referring to FIG. 13B, in response to unfolding of the electronic device 10, the electronic device 10 may display the second preview image 1320 on the second display 552. The second preview image 1320 may be a preview image of the selected third rear camera 343. The third rear camera 343 may correspond to a third view angle range, which is a wider view angle range than the second view angle range.

In an embodiment, the electronic device 10 includes a second indicator indicating which camera corresponds to the currently displayed preview image by overlapping at least a part on the second display 552 and the second preview image 1320 1340) can be displayed. The second indicator 1340 is objects indicating an activation or deactivation state of the first rear camera 341, the second rear camera 342, and the third rear camera 343 after the electronic device 10 is unfolded. (A first object 1341 corresponding to the first rear camera 341, a second object 1342 corresponding to the second rear camera 342, a third object 1343 corresponding to the third rear camera 343) )). Since the preview image currently displayed on the second display 552 corresponds to the third rear camera 343, the third object 1343 corresponding to the third rear camera 343 is a third object 1343 corresponding to the first rear camera. It may be displayed to be distinguished from the first object 1341 and the second object 1342 corresponding to the second rear camera.

14 illustrates a detailed operation sequence for outputting a guide notification by an electronic device (eg, the electronic device 10) according to an embodiment of the present invention. 14 may be described with reference to components of the electronic device 10 of FIGS. 1 to 5.

The operation disclosed in FIG. 14 may be performed after operation 630 disclosed in FIG. 6 is performed.

In an embodiment, in operation 1410, the electronic device 10 may output a notification guiding folding or unfolding for photographing a different angle of view. For example, the electronic device 10 may output a notification guiding the unfolding of the electronic device 10 to capture a wider angle of view, and the electronic device 10 may be used to capture a narrower angle of view. You can also output a notification that guides the folding.

In an embodiment, the electronic device 10 may display a notification guiding unfolding on the first display 551 in the form of a pop-up window, or may output a notification to a speaker (for example, the sound output device 155). In an embodiment, the electronic device 10 may display a notification for guiding folding on the second display 552 in the form of a pop-up window, or may output a notification to a speaker (eg, the sound output device 155).

In an embodiment, the electronic device 10 may determine whether to output a notification guiding folding (or unfolding). The electronic device 10 may determine whether to output a notification guiding folding (or unpooling) according to the selected camera. For example, if the selected camera can be used for photographing a currently displayed subject even if the electronic device 10 is not folded (or unfolded), the electronic device 10 sends a notification to guide folding (or unfolding). May not be printed. For another example, when the camera is not changed, the electronic device 10 may not output a notification guiding folding (or unfolding).

In an embodiment, the electronic device 10 may output a notification guiding folding (or unfolding) at a specified time point. While the first preview image is being displayed, when a time when a user input for photographing is not received is longer than a specified time, the electronic device 10 may output a notification guiding folding (or unfolding).

In an embodiment, the electronic device 10 may output a notification guiding folding (or unfolding) for a specified guide time.

In another embodiment, while a notification is being output, when a user input for acquiring a captured image is detected based on the first preview image, the electronic device 10 may immediately remove the output notification.

15 illustrates an example in which the electronic device 10 outputs a guide notification according to an embodiment of the present invention.

Referring to FIG. 15A, the electronic device 10 may display the first preview image 1510 on the first display 551. The first preview image 1510 may correspond to the first front camera 541. The first front camera 541 may correspond to a first field of view.

In an embodiment, the electronic device 10 may select the third front camera 543 based on an analysis result of at least one object included in the first preview image 1510. The selected third front camera 543 may be activated in response to detection of an unfolding of the electronic device 10.

In an embodiment, the electronic device 10 may display an unfolding guide notification 1530 guiding the unfolding of the electronic device 10 on the first display 551. The unfolding guide notification 1530 may include a plurality of objects. When the electronic device is unfolded, the plurality of objects may respectively correspond to a plurality of cameras that can be used for photographing a currently displayed subject. For example, a first object 1531 corresponding to the second front camera 542, a second object 1532 corresponding to the third front camera 543, and a second object corresponding to a fourth front camera (not shown). 3 The object 1533 may be included in the unfolding guide notification 1530. The first object 1531, the second object 1532, and the third object 1533 may each include an indication indicating the performance or angle of view range of a corresponding camera, and a photographing mode. For example, the first object 1531 may include a text object (“wide”) indicating a field of view supported by the corresponding second front camera 542. For example, the second object 1532 may include a text object (“ultra wide”) indicating a field of view range supported by the corresponding third front camera 543. For example, the third object 1533 may include a text object (“tele”) representing a field of view range supported by the corresponding first front camera 541.

In an embodiment, among objects included in the unfolding guide notification 1530, the object corresponding to the camera selected based on an analysis result of at least one object included in the first preview image 1510 is the remaining object. They can be marked to be distinguished from them. For example, when the third front camera 543 is selected, the electronic device 10 displays a second object 1532 corresponding to the third front camera 543 among objects included in the unfolding guide notification 1530. ) Can be displayed to be distinguished from other objects. The electronic device 10 may induce a user selection for the second object 1532 by displaying the second object 1532 to be distinguished from other objects.

Referring to FIG. 15B, the electronic device 10 may receive a user input for an unfolding guide notification 1530. For example, the electronic device 10 may receive a user input for the second object 1532 included in the unfolding guide notification 1530 and displayed to be distinguished from other objects. For another example, even if the second object 1532 is displayed to be distinguished from other objects, the electronic device 10 may be used for an object different from the second object 1532 (for example, the first object 1531). It can also receive user input.

Although not shown, when a user input for the unfolding guide notification 1530 is not received for a specified time after the unfolding guide notification 1530 is displayed, the electronic device 10 sends the displayed unfolding guide notification 1530 Can be removed.

Referring to FIG. 15C, in response to detecting the unfolding of the electronic device 10, the electronic device 10 may display a second preview image 1520 on the second display 552. The second preview image 1520 may be a preview image of a camera (eg, a third front camera 543) corresponding to an object (eg, the second object 1532) for which a user input is received. The third front camera 543 may support a third view angle range, which is a view angle range for displaying the preview image in an ultra wide angle mode, and the electronic device 10 provides a second preview based on a specific view angle included in the third view angle range. An image 1520 may be displayed.

In an embodiment, the electronic device 10 may display a view angle change menu 1540. The view angle change menu 1540 may indicate that the second preview image 1520 is currently being displayed based on the ultra wide angle mode. The view angle change menu 1540 may further include icons for displaying a preview image at a view angle corresponding to a wide-angle mode or a telephoto mode. For example, when an icon for displaying a preview image at a view angle corresponding to the wide-angle mode is selected from the view angle switching menu 1540, the electronic device 10 activates the second front camera 542 and the second front camera The preview image of 542 may be displayed on the second display 552.

16 illustrates an example in which the electronic device 10 outputs a guide notification according to an embodiment of the present invention.

FIG. 16A shows the electronic device 10 in a folded state from multiple angles, and FIG. 16B shows the electronic device 10 in an unfolded state.

Referring to FIG. 16A, the electronic device 10 may display the first preview image 1610 on the first display 551. The first preview image 1610 may be a preview image of the first rear camera 341. The first rear camera 341 may correspond to a second field of view.

In an embodiment, the electronic device 10 may select the third rear camera 343 based on an analysis result of at least one object included in the first preview image 1610. The third rear camera 343 may correspond to a third view angle range, which is a wider view angle range than the second view angle range.

In an embodiment, the electronic device 10 may display a first indicator 1630 indicating which camera corresponds to the currently displayed preview image by at least partially overlapping the first preview image 1610. .

The first indicator 1630 is objects indicating an activation or deactivation state of the first rear camera 341, the second rear camera 342, and the third rear camera 343 (corresponding to the first rear camera 341). A first object 1631, a second object 1632 corresponding to the second rear camera 342, and a third object 1633 corresponding to the third rear camera 343) may be included. Since the preview image currently displayed on the first display 551 corresponds to the first rear camera 341, the first object 1631 corresponding to the first rear camera 341 is the second rear camera 342 The second object 1632 corresponding to, and the third object 1633 corresponding to the third rear camera 343 may be displayed differently (eg, color, shape, and shade).

In an embodiment, the electronic device may display an unfolding guide notification 1650. The unfolding guide notification 1650 may include a text or image object that proposes unfolding of the electronic device 10 in order to capture a complete subject. By displaying the unfolding guide notification 1650, the electronic device 10 can provide the user with information about the angle of view that can be used for photographing a subject after the electronic device 10 is unfolded. have. The unfolding guide notification 1650 may include information on the selected camera. For example, the unfolding guide notification 1650 may include a text object such as "If unfolding is performed for complete photographing of a subject, it is converted to an ultra wide-angle photographing mode."

Referring to FIG. 16B, in response to unfolding of the electronic device 10, the electronic device 10 may display a second preview image 1620 on the second display 552. The second preview image 1620 may be a preview image of the selected third rear camera 343.

In an embodiment, the electronic device 10 may display a second indicator 1640 indicating which camera corresponds to the currently displayed preview image by at least partially overlapping the second preview image 1620. .

The second indicator 1640 is an object indicating an activation or deactivation state of the first rear camera 341, the second rear camera 342, and the third rear camera 343 (corresponding to the first rear camera 341). A first object 1641, a second object 1642 corresponding to the second rear camera 342, and a third object 1643 corresponding to the third rear camera 343) may be included.

17 illustrates a detailed operation sequence for an electronic device (eg, the electronic device 10) to output a guide notification according to an embodiment of the present invention.

The operations disclosed in FIG. 17 may be performed after operation 650 disclosed in FIG. 6 is performed and before operation 660 is performed.

The operations disclosed in FIG. 17 may be performed when the first preview image and the second preview image correspond to a landscape image.

The operations disclosed in FIG. 17 may be performed when at least one object included in the second preview image corresponds to at least one pre-designated arrangement (eg, arrangement illustrated in FIG. 12 ).

In an embodiment, in operation 1710, the electronic device 10 may output a notification guiding the movement of the electronic device 10. For example, the electronic device 10 may output a notification guiding the electronic device 10 to move or rotate in a designated direction in order to generate a panoramic photo.

Referring to FIG. 18B showing the electronic device in the unfolded state, the electronic device 10 may output a notification 1850 proposing a panorama photographing mode for photographing a complete landscape.

In an embodiment, the electronic device 10 may detect movement of the electronic device in operation 1720. The electronic device 10 may detect the movement (or rotation) of the electronic device proposed in operation 1710. The electronic device 10 may obtain image information for generating a panoramic picture based on a camera movement caused by the detected movement of the electronic device 10. The acquired image information may be used to generate a panorama photo in operation 660.

18 illustrates an example in which the electronic device 10 outputs a guide notification according to an embodiment of the present invention.

FIG. 18A shows the electronic device 10 in the unfolded state at the first view point, and FIG. 18B shows the electronic device 10 in the unfolded state at the second view point.

In an embodiment, the electronic device 10 may select a third rear camera (eg, the third rear camera 343) based on the analysis result of at least one object included in the first preview image 1821. have.

In an embodiment, referring to FIG. 18A, the electronic device 10 is at least partially superimposed on the first preview image 1821 to indicate which camera corresponds to the currently displayed preview image. 2 The indicator 1840 may be displayed.

The second indicator 1840 activates or deactivates the first rear camera (eg, the first rear camera 341), the second rear camera (eg, the second rear camera 342), and the third rear camera 343 Objects representing the state (a first object 1841 corresponding to the first rear camera 341, a second object 1842 corresponding to the second rear camera 342, and the third rear camera 343) A third object 1843) may be included. Since the preview image currently displayed on the first display 551 corresponds to the third rear camera 343, the third object 1843 is distinguished from the first object 1841 and the second object 1842 ( Example: color, shape, shade) can be displayed.

In an embodiment, referring to FIG. 18A, the electronic device 10 includes the type of the main subject (eg, the largest subject) included in the first preview image 1821 (eg, mountain). , Tree), and it can be confirmed that the first preview image 1821 corresponds to the landscape image based on the determined object type.

In an embodiment, referring to FIG. 18B, a panorama guide notification 1850 for panoramic photographing may be displayed. The panorama guide notification 1850 may include a text or image object suggesting movement of the electronic device 10 to capture a complete landscape. The electronic device 10 may provide information on panoramic photographing of the electronic device 10 to a user by displaying the panorama guide notification 1850 by overlapping the second preview image 1825.

19 illustrates a sequence of operations of an electronic device (eg, electronic device 10) according to an embodiment of the present invention.

Operations disclosed in FIG. 19 may be performed by the electronic device 10 under the control of the processor 120 of FIG. 5. Hereinafter, it is described that the electronic device 10 performs the operations disclosed in FIG. 19.

Since

operations

1910, 1920, 1940, and 1950 are substantially the same as

operations

610, 640, 650, and 660 disclosed in FIG. 6, detailed descriptions will be omitted.

In an embodiment, in operation 1930, the electronic device 10 may select at least one camera based on at least one of the at least one object analysis result displayed in the first preview image or user preference information.

In an embodiment, unlike the embodiment disclosed in FIG. 6, the electronic device 10 may perform an operation of selecting at least one camera after folding or unfolding of the electronic device is detected.

In an embodiment, the electronic device 10 may select at least one camera based on the analysis result of at least one object displayed in the first preview image. For example, when the number of faces of a person included in the first preview image is greater than or equal to a first threshold, the electronic device 10 may be configured to be relatively wide among the second and third front cameras. You can select a third front camera that supports the angle of view.

In an embodiment, the electronic device 10 may select at least one camera based on user preference information stored in the memory 130.

For example, the electronic device 10 determines the type of the first preview image (for example, a portrait picture, a landscape picture), the number of times a user takes a specific type of picture using the second front camera 542, and 3 A second front camera 542 may be selected using information on the number of times a specific type of picture is taken using the front camera 543.

For example, the electronic device 10 determines the number of times the user takes a picture using only the second front camera 542, and the user takes a picture simultaneously using the second front camera 542 and the fourth front camera. The number of times may be compared, and a second front camera 542 and a fourth front camera (not shown) may be selected using the comparison result.

Computer-readable recording media include hard disks, floppy disks, magnetic media (e.g. magnetic tape), optical recording media (e.g. CD-ROM, DVD, magnetic-optical media (e.g. floppy disk)), internal memory, etc. The instruction may include a code generated by a compiler or a code executable by an interpreter A module or program module according to various embodiments may include at least one or more of the above-described components, or , Some may be omitted, or other components may be further included Operations performed by modules, program modules, or other components according to various embodiments may be sequentially, parallel, repetitively or heuristically executed, or at least Some operations may be executed in a different order, omitted, or other operations may be added.

In addition, the embodiments disclosed in the present specification and the drawings are merely provided specific examples for easy explanation and understanding of the present invention, and are not intended to limit the scope of the present invention. Therefore, the scope of the present invention should be construed that all changes or modified forms derived based on the technical idea of the present invention in addition to the embodiments disclosed herein are included in the scope of the present invention.

Claims

In a foldable electronic device,

A plurality of cameras;

At least one display;

At least one processor operatively connected to the plurality of cameras and the at least one display;

Including at least one memory operatively connected to the at least one processor,

The at least one memory, when executed, the at least one processor,

While a first preview image corresponding to a first camera among the plurality of cameras is displayed on the at least one display, based on the analysis result of at least one object included in the first preview image, at least one other Select a camera,

In response to detecting folding or unfolding of the electronic device, displaying a second preview image corresponding to the selected at least one camera,

An electronic device that stores instructions for obtaining a photographed image based on the displayed second preview image.
The method of claim 1

The at least one display includes a first display and a second display physically separated from the first display,

The first preview image is displayed on the first display,

The second preview image is displayed on the second display.
The method of claim 2,

The analysis result of the at least one object is

An electronic device comprising at least one of the shape of the object, the size of the object, the type of the object, the number of the objects, and a ratio of the specific size of the object on the screen.
The method of claim 3,

The instructions, the at least one processor,

Based on at least one of the number of objects of a specific type, the number of objects of a specific type cut off by a screen, and a ratio of the objects of a specific type on the screen, the first camera supports a wider field of view than the first camera. An electronic device configured to select one of two cameras or a third camera that is narrower than the second camera and supports a wider field of view than the first camera.
The method of claim 2,

The instructions, the at least one processor,

An electronic device configured to select one of a second camera or a third camera based on a movement of the electronic device while the first preview image is displayed.
The method of claim 4,

The instructions, the at least one processor,

After selecting the other camera above,

Set to determine at least one of an angle of view of the other camera to be used to acquire the second preview image or an aspect ratio of the acquired second preview image to be displayed on the second display, based on an attribute of the second display Electronic device.
The method of claim 6,

The property of the second display is at least one of a size and a resolution of the second display.
The method of claim 4,

The memory is configured to store at least one user preference information,

The instructions, the at least one processor,

An electronic device configured to further select a fourth camera corresponding to a special photographing effect based on at least one of the analysis result of the at least one object or the at least one user preference information.
The method of claim 1,

The instructions, the at least one processor,

An electronic device configured to output a notification suggesting folding or unfolding of the electronic device for photographing a different angle of view before the folding or unfolding of the electronic device is detected.
The method of claim 9,

The notification includes at least one object each corresponding to at least one camera included in the plurality of cameras,

The instructions, the at least one processor,

An electronic device configured to output an object corresponding to the selected camera among the at least one object to be distinguished from other objects.
In the method of operating a foldable electronic device,

Based on the analysis result of at least one object included in the first preview image while a first preview image corresponding to the first camera among the plurality of cameras of the electronic device is displayed on at least one display of the electronic device Thus, selecting at least one other camera of the electronic device;

Displaying a second preview image corresponding to the at least one selected camera in response to detecting folding or unfolding of the electronic device;

And obtaining a captured image based on the displayed second preview image.
The method of claim 11,

The at least one display includes a first display and a second display physically separated from the first display,

The first preview image is displayed on the first display,

The second preview image is displayed on the second display.
The method of claim 12,

The analysis result of the at least one object is

The method comprising at least one of the shape of the object, the size of the object, the type of the object, the number of the objects, and a ratio of the specific size of the object on the screen.
The method of claim 13,

The operation of selecting the other camera,

Based on at least one of the number of objects of a specific type, the number of objects of a specific type cut off by a screen, and a ratio of the objects of a specific type on the screen, the first camera supports a wider field of view than the first camera. And selecting one of two cameras or a third camera that is narrower than the second camera and supports a wider field of view than the first camera.
The method of claim 12,

The operation of selecting the other camera,

And selecting one of a second camera or a third camera based on a movement of the electronic device while the first preview image is displayed.