KR20230163849A - Electronic device including a plurality of cameras and method for shooting thereof - Google Patents

Abstract

An electronic device according to various embodiments includes a housing, a first camera located on a first side of the housing, a second camera located on a second side of the housing facing the first side, a memory, and a processor, and the processor includes a memory Based on the results learned from the usage pattern information stored in the In response to at least one object being included in at least one of the images, a first point in time at which at least one object begins to be included in the timeline of the video is displayed, and a first image captured using a first camera is displayed. In response to the fact that at least one object is included, the shooting cycle of the first camera is adjusted to be short, and in response to the shooting cycle of the first camera being shortened, the shooting cycle of the second camera is set to be the same as the shooting cycle of the first camera. You can change it.

Description

Electronic device including a plurality of cameras and a shooting method of the electronic device {ELECTRONIC DEVICE INCLUDING A PLURALITY OF CAMERAS AND METHOD FOR SHOOTING THEREOF}

Various embodiments disclosed in this document relate to an electronic device including a plurality of cameras and a photographing method of the electronic device, for example, an electronic device and an electronic device that captures, stores, and plays a plurality of videos through a plurality of cameras. It is about how to operate.

Various embodiments disclosed in this document may include type-lapse video shooting using a dual camera and a method of using the same. Various embodiments disclosed in this document may include the field of various AI technologies for expanding user experience using time-lapse video.

Recently, as the use of cameras in electronic devices such as smartphones has become more active, smartphones are being developed that include various types of cameras, such as ultra-wide-angle cameras, wide-angle cameras, and telephoto cameras, and have them placed on the front and/or back. An ultra-wide-angle camera is a camera that includes a lens with a wide angle of view. The angle of view is approximately 120 degrees or more, and it can take pictures with an angle of view similar to the human field of view. A wide-angle camera is a camera that includes a lens with an angle of view of approximately 70 to 80 degrees, and may be a camera used for general smartphone photography. A telephoto camera is a camera that includes a telephoto lens for photographing distant subjects, and can obtain high-quality photos at magnifications ranging from about 2x zoom to about 10x zoom or higher.

Electronic devices include various cameras and can capture videos by selecting an appropriate camera according to various subjects and various shooting environments.

A back to back camera may refer to cameras arranged on an electronic device in a manner in which at least two cameras are facing different directions, as if they are leaning against each other. For example, the back to back camera may include a front camera disposed on the same side as the display and a rear camera disposed on the other side facing the display. An electronic device implemented with a back to back camera can provide a dual camera shooting function using a front camera and a rear camera, but it may be difficult to provide a time lapse function using a front camera and a rear camera. The time lapse function may refer to a function of compressing the playback section of an image captured over a long period of time and playing it back for a short period of time.

The user experience in a time-lapse situation that can be provided by an electronic device including a plurality of cameras (e.g., back to back dual cameras) may be limited. An electronic device including a plurality of cameras (e.g., back to back dual cameras) according to various embodiments of this document can solve the problem of limited user experience during time-lapse shooting.

An electronic device according to various embodiments includes a housing, a first camera located on a first side of the housing, a second camera located on a second side of the housing facing the first side, a memory, and a processor, and the processor includes a memory Based on the results learned from the usage pattern information stored in the In response to at least one object being included in at least one of the images, a first point in time at which at least one object begins to be included in the timeline of the video is displayed, and a first image captured using a first camera is displayed. In response to the fact that at least one object is included, the shooting cycle of the first camera is adjusted to be short, and in response to the shooting cycle of the first camera being shortened, the shooting cycle of the second camera is set to be the same as the shooting cycle of the first camera. You can change it.

A method of operating an electronic device including a plurality of cameras includes determining at least one object that serves as an editing standard for a video based on a result learned from usage pattern information stored in a memory, and an operation of determining at least one object that is a reference for editing a video, captured using a first camera, A first point in time at which at least one object begins to be included in the timeline of the video in response to at least one object being included in at least one of the first video or the second video captured using a second camera. An operation of displaying, an operation of briefly adjusting the shooting cycle of the first camera in response to at least one object being included in the first image captured using the first camera, and an operation of briefly adjusting the shooting cycle of the first camera. It may include an operation of changing the shooting cycle of the second camera to be the same as the shooting cycle of the first camera.

According to various embodiments, an electronic device can provide a user-friendly shooting function when providing a time-lapse shooting function in a situation where two or more cameras are mounted on the front and back of the main body of the electronic device.

According to various embodiments, an electronic device may detect a specific event (salient event) on at least one camera among a plurality of cameras and adjust the shooting cycle of the remaining cameras based on the camera that detected the specific event (salient event). there is. Therefore, it is possible to prevent the quality of time-lapse video from deteriorating due to a desynchronization phenomenon that occurs when the shooting cycle of one camera is different from that of another camera.

According to various embodiments, an electronic device may record the time point at which a specific event (salient event) occurs and display the time point at which a specific event (salient event) occurs on a timeline so that a user can quickly find the time point at which the specific event (salient event) occurs.

According to various embodiments, an electronic device may provide a user with information including at least one of a time-lapse video shooting angle and viewpoint based on information on the occurrence of a previously detected specific event (salient event). The electronic device may provide information to the user so that time-lapse video shooting can be resumed in a situation where time-lapse video shooting is interrupted.

1 is a block diagram of an electronic device in a network environment, according to various embodiments.
FIG. 2A is a block diagram of an electronic device 200 (eg, the electronic device 101 of FIG. 1 ) according to various embodiments.
FIG. 2B is a diagram illustrating an example in which the electronic device 200 is implemented in the form of a foldable phone.
FIG. 3A is a front perspective view illustrating a flat state or unfolding state of an electronic device including a second type according to various embodiments.
FIG. 3B is a plan view illustrating the front of the electronic device in the unfolded state of FIG. 3A according to various embodiments.
FIG. 3C is a plan view illustrating the rear of the electronic device in the unfolded state of FIG. 3A according to various embodiments.
FIG. 4A illustrates a situation in which an electronic device according to a comparative example simultaneously captures and stores a plurality of images according to a simultaneous capture mode.
FIG. 4B illustrates a situation in which an electronic device (e.g., the electronic device 200 of FIG. 2A) according to various embodiments of this document simultaneously captures and stores a plurality of images according to a simultaneous capture mode.
FIG. 5 illustrates an image capturing situation using a plurality of cameras of an electronic device according to various embodiments.
FIGS. 6A to 6D show examples of user interfaces for switching between and playing a plurality of videos of an electronic device according to various embodiments.
FIG. 7 is a flow chart illustrating a method of photographing an electronic device according to various embodiments.

1 is a block diagram of an electronic device 101 in a network environment 100, according to various embodiments. Referring to FIG. 1, in the network environment 100, the electronic device 101 communicates with the electronic device 102 through a first network 198 (e.g., a short-range wireless communication network) or a second network 199. It is possible to communicate with at least one of the electronic device 104 or the server 108 through (e.g., a long-distance wireless communication network). According to one embodiment, the electronic device 101 may communicate with the electronic device 104 through the server 108. According to one embodiment, the electronic device 101 includes a processor 120, a memory 130, an input module 150, an audio output module 155, a display module 160, an audio module 170, and a sensor module ( 176), interface 177, connection terminal 178, haptic module 179, camera module 180, power management module 188, battery 189, communication module 190, subscriber identification module 196 , or may include an antenna module 197. In some embodiments, at least one of these components (eg, the connection terminal 178) may be omitted or one or more other components may be added to the electronic device 101. In some embodiments, some of these components (e.g., sensor module 176, camera module 180, or antenna module 197) are integrated into one component (e.g., display module 160). It can be.

The processor 120, for example, executes software (e.g., program 140) to operate at least one other component (e.g., hardware or software component) of the electronic device 101 connected to the processor 120. It can be controlled and various data processing or calculations can be performed. According to one embodiment, as at least part of data processing or computation, the processor 120 stores commands or data received from another component (e.g., sensor module 176 or communication module 190) in volatile memory 132. The commands or data stored in the volatile memory 132 can be processed, and the resulting data can be stored in the non-volatile memory 134. According to one embodiment, the processor 120 includes a main processor 121 (e.g., a central processing unit or an application processor) or an auxiliary processor 123 that can operate independently or together (e.g., a graphics processing unit, a neural network processing unit ( It may include a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor). For example, if the electronic device 101 includes a main processor 121 and a secondary processor 123, the secondary processor 123 may be set to use lower power than the main processor 121 or be specialized for a designated function. You can. The auxiliary processor 123 may be implemented separately from the main processor 121 or as part of it.

The auxiliary processor 123 may, for example, act on behalf of the main processor 121 while the main processor 121 is in an inactive (e.g., sleep) state, or while the main processor 121 is in an active (e.g., application execution) state. ), together with the main processor 121, at least one of the components of the electronic device 101 (e.g., the display module 160, the sensor module 176, or the communication module 190) At least some of the functions or states related to can be controlled. According to one embodiment, co-processor 123 (e.g., image signal processor or communication processor) may be implemented as part of another functionally related component (e.g., camera module 180 or communication module 190). there is. According to one embodiment, the auxiliary processor 123 (eg, neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. Artificial intelligence models can be created through machine learning. For example, such learning may be performed in the electronic device 101 itself on which the artificial intelligence model is performed, or may be performed through a separate server (e.g., server 108). Learning algorithms may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but It is not limited. An artificial intelligence model may include multiple artificial neural network layers. Artificial neural networks include deep neural network (DNN), convolutional neural network (CNN), recurrent neural network (RNN), restricted boltzmann machine (RBM), belief deep network (DBN), bidirectional recurrent deep neural network (BRDNN), It may be one of deep Q-networks or a combination of two or more of the above, but is not limited to the examples described above. In addition to hardware structures, artificial intelligence models may additionally or alternatively include software structures.

The memory 130 may store various data used by at least one component (eg, the processor 120 or the sensor module 176) of the electronic device 101. Data may include, for example, input data or output data for software (e.g., program 140) and instructions related thereto. Memory 130 may include volatile memory 132 or non-volatile memory 134.

The program 140 may be stored as software in the memory 130 and may include, for example, an operating system 142, middleware 144, or application 146.

The input module 150 may receive commands or data to be used in a component of the electronic device 101 (e.g., the processor 120) from outside the electronic device 101 (e.g., a user). The input module 150 may include, for example, a microphone, mouse, keyboard, keys (eg, buttons), or digital pen (eg, stylus pen).

The sound output module 155 may output sound signals to the outside of the electronic device 101. The sound output module 155 may include, for example, a speaker or a receiver. Speakers can be used for general purposes such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from the speaker or as part of it.

The display module 160 can visually provide information to the outside of the electronic device 101 (eg, a user). The display module 160 may include, for example, a display, a hologram device, or a projector, and a control circuit for controlling the device. According to one embodiment, the display module 160 may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of force generated by the touch.

The audio module 170 can convert sound into an electrical signal or, conversely, convert an electrical signal into sound. According to one embodiment, the audio module 170 acquires sound through the input module 150, the sound output module 155, or an external electronic device (e.g., directly or wirelessly connected to the electronic device 101). Sound may be output through the electronic device 102 (e.g., speaker or headphone).

The sensor module 176 detects the operating state (e.g., power or temperature) of the electronic device 101 or the external environmental state (e.g., user state) and generates an electrical signal or data value corresponding to the detected state. can do. According to one embodiment, the sensor module 176 includes, for example, a gesture sensor, a gyro sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, It may include a temperature sensor, humidity sensor, or light sensor.

The interface 177 may support one or more designated protocols that can be used to connect the electronic device 101 directly or wirelessly with an external electronic device (eg, the electronic device 102). According to one embodiment, the interface 177 may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

The connection terminal 178 may include a connector through which the electronic device 101 can be physically connected to an external electronic device (eg, the electronic device 102). According to one embodiment, the connection terminal 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (eg, a headphone connector).

The haptic module 179 can convert electrical signals into mechanical stimulation (e.g., vibration or movement) or electrical stimulation that the user can perceive through tactile or kinesthetic senses. According to one embodiment, the haptic module 179 may include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

The camera module 180 can capture still images and moving images. According to one embodiment, the camera module 180 may include one or more lenses, image sensors, image signal processors, or flashes.

The power management module 188 can manage power supplied to the electronic device 101. According to one embodiment, the power management module 188 may be implemented as at least a part of, for example, a power management integrated circuit (PMIC).

The battery 189 may supply power to at least one component of the electronic device 101. According to one embodiment, the battery 189 may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

Communication module 190 is configured to provide a direct (e.g., wired) communication channel or wireless communication channel between electronic device 101 and an external electronic device (e.g., electronic device 102, electronic device 104, or server 108). It can support establishment and communication through established communication channels. Communication module 190 operates independently of processor 120 (e.g., an application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module 190 is a wireless communication module 192 (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 194 (e.g., : LAN (local area network) communication module, or power line communication module) may be included. Among these communication modules, the corresponding communication module is a first network 198 (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network 199 (e.g., legacy It may communicate with an external electronic device 104 through a telecommunication network such as a cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., LAN or WAN). These various types of communication modules may be integrated into one component (e.g., a single chip) or may be implemented as a plurality of separate components (e.g., multiple chips). The wireless communication module 192 uses subscriber information (e.g., International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module 196 within a communication network such as the first network 198 or the second network 199. The electronic device 101 can be confirmed or authenticated.

The wireless communication module 192 may support 5G networks after 4G networks and next-generation communication technologies, for example, NR access technology (new radio access technology). NR access technology provides high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and access to multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low latency). -latency communications)) can be supported. The wireless communication module 192 may support high frequency bands (eg, mmWave bands), for example, to achieve high data rates. The wireless communication module 192 uses various technologies to secure performance in high frequency bands, for example, beamforming, massive array multiple-input and multiple-output (MIMO), and full-dimensional multiplexing. It can support technologies such as input/output (FD-MIMO: full dimensional MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module 192 may support various requirements specified in the electronic device 101, an external electronic device (e.g., electronic device 104), or a network system (e.g., second network 199). According to one embodiment, the wireless communication module 192 supports Peak data rate (e.g., 20 Gbps or more) for realizing eMBB, loss coverage (e.g., 164 dB or less) for realizing mmTC, or U-plane latency (e.g., 164 dB or less) for realizing URLLC. Example: Downlink (DL) and uplink (UL) each of 0.5 ms or less, or round trip 1 ms or less) can be supported.

The antenna module 197 may transmit signals or power to or receive signals or power from the outside (e.g., an external electronic device). According to one embodiment, the antenna module 197 may include an antenna including a radiator made of a conductor or a conductive pattern formed on a substrate (eg, PCB). According to one embodiment, the antenna module 197 may include a plurality of antennas (eg, an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network such as the first network 198 or the second network 199 is connected to the plurality of antennas by, for example, the communication module 190. can be selected Signals or power may be transmitted or received between the communication module 190 and an external electronic device through the at least one selected antenna. According to some embodiments, in addition to the radiator, other components (eg, radio frequency integrated circuit (RFIC)) may be additionally formed as part of the antenna module 197.

According to various embodiments, the antenna module 197 may form a mmWave antenna module. According to one embodiment, a mmWave antenna module includes: a printed circuit board, an RFIC disposed on or adjacent to a first side (e.g., bottom side) of the printed circuit board and capable of supporting a designated high frequency band (e.g., mmWave band); And a plurality of antennas (e.g., array antennas) disposed on or adjacent to the second side (e.g., top or side) of the printed circuit board and capable of transmitting or receiving signals in the designated high frequency band. can do.

At least some of the components are connected to each other through a communication method between peripheral devices (e.g., bus, general purpose input and output (GPIO), serial peripheral interface (SPI), or mobile industry processor interface (MIPI)) and signal ( (e.g. commands or data) can be exchanged with each other.

According to one embodiment, commands or data may be transmitted or received between the electronic device 101 and the external electronic device 104 through the server 108 connected to the second network 199. Each of the external electronic devices 102 or 104 may be of the same or different type as the electronic device 101. According to one embodiment, all or part of the operations performed in the electronic device 101 may be executed in one or more of the external electronic devices 102, 104, or 108. For example, when the electronic device 101 needs to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device 101 may perform the function or service instead of executing the function or service on its own. Alternatively, or additionally, one or more external electronic devices may be requested to perform at least part of the function or service. One or more external electronic devices that have received the request may execute at least part of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device 101. The electronic device 101 may process the result as is or additionally and provide it as at least part of a response to the request. For this purpose, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology can be used. The electronic device 101 may provide an ultra-low latency service using, for example, distributed computing or mobile edge computing. In another embodiment, the external electronic device 104 may include an Internet of Things (IoT) device. Server 108 may be an intelligent server using machine learning and/or neural networks. According to one embodiment, the external electronic device 104 or server 108 may be included in the second network 199. The electronic device 101 may be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

Electronic devices according to various embodiments disclosed in this document may be of various types. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to embodiments of this document are not limited to the above-described devices.

The various embodiments of this document and the terms used herein are not intended to limit the technical features described in this document to specific embodiments, and should be understood to include various changes, equivalents, or replacements of the embodiments. In connection with the description of the drawings, similar reference numbers may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the above items, unless the relevant context clearly indicates otherwise. As used herein, “A or B”, “at least one of A and B”, “at least one of A or B”, “A, B or C”, “at least one of A, B and C”, and “A Each of phrases such as “at least one of , B, or C” may include any one of the items listed together in the corresponding phrase, or any possible combination thereof. Terms such as "first", "second", or "first" or "second" may be used simply to distinguish one component from another, and to refer to that component in other respects (e.g., importance or order) is not limited. One (e.g., first) component is said to be “coupled” or “connected” to another (e.g., second) component, with or without the terms “functionally” or “communicatively.” When mentioned, it means that any of the components can be connected to the other components directly (e.g. wired), wirelessly, or through a third component.

The term “module” used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and is interchangeable with terms such as logic, logic block, component, or circuit, for example. It can be used as A module may be an integrated part or a minimum unit of the parts or a part thereof that performs one or more functions. For example, according to one embodiment, the module may be implemented in the form of an application-specific integrated circuit (ASIC).

Various embodiments of the present document are one or more instructions stored in a storage medium (e.g., built-in memory 136 or external memory 138) that can be read by a machine (e.g., electronic device 101). It may be implemented as software (e.g., program 140) including these. For example, a processor (e.g., processor 120) of a device (e.g., electronic device 101) may call at least one command among one or more commands stored from a storage medium and execute it. This allows the device to be operated to perform at least one function according to the at least one instruction called. The one or more instructions may include code generated by a compiler or code that can be executed by an interpreter. A storage medium that can be read by a device may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' only means that the storage medium is a tangible device and does not contain signals (e.g. electromagnetic waves), and this term refers to cases where data is semi-permanently stored in the storage medium. There is no distinction between temporary storage cases.

According to one embodiment, methods according to various embodiments disclosed in this document may be included and provided in a computer program product. Computer program products are commodities and can be traded between sellers and buyers. The computer program product may be distributed in the form of a machine-readable storage medium (e.g. compact disc read only memory (CD-ROM)) or through an application store (e.g. Play StoreTM) or on two user devices (e.g. It can be distributed (e.g. downloaded or uploaded) directly between smart phones) or online. In the case of online distribution, at least a portion of the computer program product may be at least temporarily stored or temporarily created in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

According to various embodiments, each component (e.g., module or program) of the above-described components may include a single or plural entity, and some of the plurality of entities may be separately placed in other components. there is. According to various embodiments, one or more of the components or operations described above may be omitted, or one or more other components or operations may be added. Alternatively or additionally, multiple components (eg, modules or programs) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each component of the plurality of components in the same or similar manner as those performed by the corresponding component of the plurality of components prior to the integration. . According to various embodiments, operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, or omitted. Alternatively, one or more other operations may be added.

FIG. 2A is a block diagram of an electronic device 200 (eg, the electronic device 101 of FIG. 1 ) according to various embodiments. The electronic device 200 of FIG. 2A may include various electronic devices, such as a smartphone or tablet. For example, the shape of the electronic device 200 may include various shapes such as a bar shape, a folding structure (e.g., a foldable phone), and an unfolding structure (e.g., a rollable phone), and is not limited to the examples described below. .

Referring to FIG. 2A, the electronic device 200 includes a memory 210 (e.g., memory 130 in FIG. 1), a processor 220 (e.g., processor 120 in FIG. 1), and a camera 230 ( For example, it may include a camera 180 in FIG. 1) and/or a display 240 (for example, the display module 160 in FIG. 1). The components included in FIG. 2 are some of the components included in the electronic device 200, and the electronic device 200 may also include various other components as shown in FIG. 1 .

The camera 230 according to various embodiments includes a first camera 231 (e.g., camera 180 in FIG. 1), a second camera 232 (e.g., camera 180 in FIG. 1), and a third camera ( 233) (eg, camera 180 of FIG. 1). Here, the camera 230 is shown as including three cameras (e.g., the first camera 231, the second camera 232, and the third camera 233), but this is an example and an embodiment of the present disclosure. They are not limited to this and may include four or more cameras. A plurality of cameras including the first camera 231, the second camera 232, and the third camera 233 may be implemented as one or more modules, for example, each may be implemented as a separate module. . Even when implemented as separate modules, the plurality of cameras including the first camera 231, the second camera 232, and the third camera 233 are located on the same side of the housing of the electronic device 200 and/or with each other. It can be mounted in a variety of positions, including on different sides.

FIG. 2B is a diagram illustrating an example in which the electronic device 200 is implemented in the form of a foldable phone. According to various embodiments, the electronic device 200 may be implemented in the form of a foldable phone in addition to a general bar-shaped smart phone. As shown in FIG. 2B, when the electronic device 200 is implemented in the form of a foldable phone, a plurality of cameras (e.g., the first camera 231, the second camera 232, and the third camera (in FIG. 2A) are used. 233)) is a front camera 201, a rear camera 202 that is exposed to the outside when folded, and/or an internal camera 203 that is folded inward when folded, and can be mounted on different surfaces or positions, respectively. According to one embodiment, the electronic device 200 in the form of a foldable phone is photographed by the front camera 201 and the rear camera 202 depending on the folding angle, for example, at different positions when unfolded (a). When folded in the same direction, at an angle halfway between the unfolded and folded states (e.g., a 90-degree angle) (b) to the left or right of the middle angle, respectively, when folded at a 180-degree angle (c) at the front and back at an angle of 180 degrees. Images can be taken from various angles, positions, and/or directions, including directions. Additionally, the shooting direction of the internal camera 203 may change depending on changes in the shooting directions of the front camera 201 and the rear camera 202, and shooting may not be possible in the folded state.

The first camera 231 according to various embodiments may include at least one of an ultra-wide-angle camera, a wide-angle camera, a first telephoto camera, and a second telephoto camera.

An ultra wide camera may be a camera that includes an ultra wide angle lens and is used to photograph a nearby subject. The ultra-wide-angle camera may be a camera with the widest angle of view among cameras included in the electronic device 200.

A wide-angle camera may be a camera that includes a wide-angle lens and is used to photograph a nearby subject. The wide-angle camera may be a camera with the second widest angle of view among cameras included in the electronic device 200.

The first telephoto camera may be a camera used to photograph a distant subject, including a telephoto lens capable of taking N1 magnification. The first telephoto camera may be a camera with the second narrowest angle of view among cameras included in the electronic device 200.

The second telephoto camera may include a telephoto lens capable of taking N2 magnification and may be a camera for photographing a distant subject. The second telephoto camera may be a camera with the narrowest angle of view among cameras included in the electronic device 200.

The second camera 232 according to various embodiments may include at least one of an ultra-wide-angle camera, a wide-angle camera, a first telephoto camera, and a second telephoto camera. The second camera 232 may be disposed at a different position on the electronic device 200 than the first camera 231 and the third camera 233 and may be implemented as a camera having a different viewing angle.

The third camera 233 according to various embodiments may include at least one camera among an ultra-wide-angle camera, a wide-angle camera, a first telephoto camera, and a second telephoto camera. The third camera 233 may be disposed at a different location on the electronic device 200 than the first camera 231 and the second camera 232 and may be implemented as a camera having a different viewing angle.

The location where the plurality of cameras including the first camera 231, the second camera 232, and the third camera 233 according to various embodiments are placed on the electronic device 200 is the front of the electronic device 200. It may include, but is not limited to, various positions facing the rear. For example, the first camera 231 and the second camera 232 may be implemented as a front camera, and the third camera 233 may be implemented as a rear camera. For example, three front cameras (first camera 231 to third camera 233) and two rear cameras (not shown) (e.g., the same as the second camera 232 and the third camera 233 or It can be implemented with a similar camera)).

As described above, a plurality of cameras including the first camera 231, the second camera 232, and the third camera 233 are used as the front camera 201 of the foldable electronic device 200, as shown in FIG. 2B. ), when implemented as the rear camera 202 and/or the internal camera 203, each camera may capture various images at different angles, positions, and/or directions, as described above. In this case, a file containing a captured image may include information about the image capturing angle, location, and/or direction as additional information.

According to various embodiments, the display 240 can display content including various texts and images, icons, and menus, and can perform various operations in response to touch input detected through an input sensor (not shown).

According to various embodiments, the processor 220 may provide a user interface for simultaneously capturing and storing a plurality of images according to the execution of an application that uses a camera, for example, an image capture app. For example, the shooting mode for shooting multiple images simultaneously and saving them separately (hereinafter referred to as simultaneous shooting mode) can be selected through the camera's settings menu or through a menu (e.g. toggle switch) provided on the shooting app. there is.

According to various embodiments, the processor 220 may provide a user interface for selecting two or more cameras to perform shooting among a plurality of cameras according to a simultaneous shooting mode. For example, the processor 220 may display an icon for selecting two or more cameras among a plurality of cameras including the first camera 231, the second camera 232, and the third camera 233. For example, the processor 220 displays preview images of images input from a plurality of cameras including the first camera 231, the second camera 232, and the third camera 233, for example, in the form of thumbnails. It can be displayed on the display 240. For example, the processor 230 may capture images through two or more cameras selected from among a plurality of thumbnail preview images.

According to various embodiments, the processor 220 processes two or more camera images captured according to the same start and end point in real time in a simultaneous shooting mode and integrates them into independent image files that are related depending on the image format, respectively, or into one file. This can be stored in the memory 210. Hereinafter, the case where two or more camera images are stored as a plurality of independent image files will be described in more detail, but the embodiments are not limited to this and can also be applied to the case where images from two or more cameras are stored together as a single file.

According to various embodiments, when saving an image file, the processor 220 stores various information such as shooting information for the corresponding image, for example, camera information including angle of view information or camera location information (including shooting angle and/or direction). can be saved as file additional information. Additionally, the processor 220 may store information, such as a separator or identifier indicating correlation between image files, as additional file information. Additional information such as time information, camera angle of view or position information, shooting angle and/or direction information, and correlation information for the video file may be attached to each video file and/or stored in the memory 210 as a separate file. . For example, shooting information such as camera position information and angle of view information along with the storage location (path) of each image in a separate management information storage file such as the content management hub of the memory 210 (e.g., front 'Directorsview_Front') ', wide angle 'Directorsview_Wide') can be saved.

According to various embodiments, the processor 220 displays two or more video files stored as related files on the display 240 according to the execution of an app for video playback (e.g., gallery app, video playback app), and displays two or more video files stored as related files on the display 240. The video of a selected file among files can be played through the display 240. For example, when displaying two or more related image files on the display 240, the processor 220 may indicate that the two or more image files are related files. The processor 22 displays related files, for example, an icon representing a simultaneous shooting mode and/or an icon containing consecutive numbers on the thumbnails representing the files, and/or divides the thumbnails into a border or box. This can be done in a variety of ways, such as grouping.

According to various embodiments, the processor 220 commands commands to select and play, stop, or switch to another related video file one of a plurality of related video files through a display 240 that includes an input sensor (not shown). A control signal containing can be received.

According to various embodiments, the processor 220 plays a file selected among two or more related video files through the display 240, indicating that the image being played is an image captured according to the simultaneous shooting mode and that there is another image captured simultaneously. You can. For example, the processor 220 may play the selected video file on a large screen or full screen through the display 240 while displaying other video files in a preview form on a small screen, such as a thumbnail, on a portion of the large screen. For example, the processor 220 plays the selected video file on a large screen or full screen through the display 240, while displaying an icon indicating the simultaneous shooting mode at the top of the screen or in a carousel format (e.g., multiple files in the same space). A graphical user interface (which can indicate the existence of a plurality of files by displaying images and/or text representing each one at a time) can be provided to indicate that there are other image files captured simultaneously.

According to various embodiments, the processor 220 plays a selected file among two or more related video files according to time information, and when receiving a command to switch to another file among the two or more video files, stops playing the video file being played. Depending on the playback time information of the video file, the video of another file can be played. For example, if the playback time at the time of receiving the change command during playback of the video file after the start time is 15 seconds, the processor 220 stops playback of the video file being played according to the change command at the 15 second point and plays another video file. You can continue playing at the 15 second mark.

FIG. 3A is a front perspective view illustrating a flat state or unfolding state of an electronic device including a second type according to various embodiments.

FIG. 3B is a plan view illustrating the front of the electronic device in the unfolded state of FIG. 3A according to various embodiments.

FIG. 3C is a plan view illustrating the rear of the electronic device in the unfolded state of FIG. 3A according to various embodiments.

Referring to FIGS. 3A to 3C, the electronic device 300 includes a pair of housings 310 that face each other and are rotatably coupled to be folded based on a hinge device (e.g., the hinge device 340 in FIG. 3B). , 320) (e.g., foldable housing). In some embodiments, the hinge device (eg, hinge device 340 in FIG. 3B) may be arranged in the X-axis direction or in the Y-axis direction. In some embodiments, two or more hinge devices (eg, hinge device 340 in FIG. 3B) may be arranged to fold in the same direction or in different directions. According to one embodiment, the electronic device 300 may include a display (eg, display 240 of FIG. 2) disposed in an area formed by a pair of housings 310 and 320. The display 240 may have the form of a flexible display (eg, a foldable display). According to one embodiment, the first housing 310 and the second housing 320 are disposed on both sides about the folding axis (axis A) and may have a shape that is substantially symmetrical with respect to the folding axis (axis A). there is. According to one embodiment, the first housing 310 and the second housing 320 are configured to determine whether the electronic device 300 is in a flat state or unfolding state, a folding state, or an intermediate state. Depending on whether they are in an intermediate state, the angle or distance between them may vary.

According to various embodiments, the pair of housings 310 and 320 includes a first housing 310 (e.g., a first housing structure) coupled with a hinge device (e.g., the hinge device 340 in FIG. 3B) and a hinge device. It may include a second housing 320 (e.g., a second housing structure) coupled to (e.g., the hinge device 340 of FIG. 3B). According to one embodiment, the first housing 310, in the unfolded state, has a first surface 311 facing in a first direction (e.g., front direction) (z-axis direction) and a first surface 311 facing the first surface 311. It may include a second surface 312 facing a second direction (eg, rear direction) (-z axis direction). According to one embodiment, in the unfolded state, the second housing 320 has a third side 321 facing the first direction (z-axis direction) and a fourth side 322 facing the second direction (-z-axis direction). ) may include. According to one embodiment, the electronic device 300, in the unfolded state, has a first surface 311 of the first housing 310 and a third surface 321 of the second housing 320 that are substantially the same. It may be operated in such a way that it faces the direction (z-axis direction) and the first surface 311 and the third surface 321 face each other in the folded state. According to one embodiment, the electronic device 300, in the unfolded state, has a second surface 312 of the first housing 310 and a fourth surface 322 of the second housing 320 that are substantially the same. direction (-z-axis direction), and in the folded state, the second surface 312 and the fourth surface 322 may be operated to face opposite directions. For example, in the folded state, the second side 312 may face a first direction (z-axis direction), and the fourth side 322 may face a second direction (-z-axis direction).

According to various embodiments, the first housing 310 is coupled to the first side member 313 and the first side member 313, which at least partially forms the exterior of the electronic device 300, It may include a first rear cover 314 that forms at least a portion of the second surface 312 of . According to one embodiment, the first side member 313 includes a first side 313a, a second side 313b extending from one end of the first side 313a, and a second side extending from the other end of the first side 313a. It may include a third side 313c. According to one embodiment, the first side member 313 may be formed into a rectangular (e.g., square or rectangular) shape through the first side 313a, the second side 313b, and the third side 313c. .

According to various embodiments, the second housing 320 is coupled to the second side member 323 and the second side member 323, which at least partially forms the exterior of the electronic device 300, It may include a second rear cover 324 forming at least a portion of the fourth surface 322 of . According to one embodiment, the second side member 323 includes a fourth side 323a, a fifth side 323b extending from one end of the fourth side 323a, and a fifth side 323b extending from the other end of the fourth side 323a. It may include a sixth side 323c. According to one embodiment, the second side member 323 may be formed into a rectangular shape through the fourth side 323a, the fifth side 323b, and the sixth side 323c.

According to various embodiments, the pair of housings 310 and 320 is not limited to the shape and combination shown, and may be implemented by combining and/or combining other shapes or parts. For example, in some embodiments, the first side member 313 may be formed integrally with the first rear cover 314, and the second side member 323 may be formed integrally with the second rear cover 324. can be formed.

According to various embodiments, in the unfolded state, the electronic device 300 has a certain gap between the second side 313b of the first side member 313 and the fifth side 323b of the second side member 323. It can be connected without a gap. According to one embodiment, when the electronic device 300 is unfolded, the third side 313c of the first side member 313 and the sixth side 323c of the second side member 323 have a certain gap ( It can be connected without a gap. According to one embodiment, in the unfolded state, the electronic device 300 has a total length of the second side 313b and the fifth side 323b that is longer than that of the first side 313a and/or the fourth side 323a. It may be configured to be longer than the length. Additionally, the total length of the third side 313c and the sixth side 323c may be longer than the length of the first side 313a and/or the fourth side 323a.

According to various embodiments, the first rear cover 314 and/or the second rear cover 324 may be, for example, coated or colored glass, ceramic, polymer, or metal (e.g., aluminum, stainless steel (STS)). , or magnesium) or a combination of at least two.

According to various embodiments, the display 240 is connected to the second housing 320 from the first side 311 of the first housing 310 across a hinge device (e.g., the hinge device 340 in FIG. 3B). It may be arranged to extend to at least part of the three sides 321. For example, the display 240 includes a first part 330a substantially corresponding to the first surface 311, a second part 330b corresponding to the second surface 321, and a first part 330a. It connects the second part 330b and may include a hinge device (eg, the hinge device 340 of FIG. 3B) and a corresponding third part 330c (eg, a bendable area). According to one embodiment, the electronic device 300 may include a first protective cover 315 (eg, a first protective frame or a first decorative member) coupled along an edge of the first housing 310. According to one embodiment, the electronic device 300 may include a second protective cover 325 (eg, a second protective frame or a second decorative member) coupled along an edge of the second housing 320. According to one embodiment, the first protective cover 315 and/or the second protective cover 325 may be formed of metal or polymer material. According to one embodiment, the first protective cover 315 and/or the second protective cover 325 may be used as a decoration member. According to one embodiment, the display 240 may be positioned so that the edge of the first portion 330a is interposed between the first housing 310 and the first protective cover 315. According to one embodiment, the display 240 may be positioned so that the edge of the second portion 330b is interposed between the second housing 320 and the second protective cover 325. According to one embodiment, the display 240 is connected to the display 240 corresponding to the protective cap through a protective cap 335 disposed in an area corresponding to a hinge device (e.g., the hinge device 340 in FIG. 3B). It can be positioned so that the edges are protected. Accordingly, the edges of the display 240 can be substantially protected from the outside. According to one embodiment, the electronic device 300 supports a hinge device (e.g., the hinge device 340 in FIG. 3B), is exposed to the outside when the electronic device 300 is in the folded state, and is exposed to the outside when the electronic device 300 is in the unfolded state. , the hinge housing 341 (e.g., disposed to be invisible from the outside by being introduced into the first space (e.g., the inner space of the first housing 310) and the second space (e.g., the inner space of the second housing 320) : Hinge cover) may be included. In some embodiments, the display 240 may extend from at least a portion of the second side 312 to at least a portion of the fourth side 322 . In this case, the electronic device 300 may be folded so that the display 240 is exposed to the outside (out-folding method).

According to various embodiments, the electronic device 300 may include a sub-display 331 disposed separately from the display 240. According to one embodiment, the sub-display 331 is disposed to be at least partially exposed to the second surface 312 of the first housing 310, thereby replacing the display function of the display 240 when in the folded state. Status information of the electronic device 300 may be displayed. According to one embodiment, the sub-display 331 may be arranged to be visible from the outside through at least a partial area of the first rear cover 314. In some embodiments, the sub-display 331 may be disposed on the fourth side 322 of the second housing 320. In this case, the sub-display 331 may be arranged to be visible from the outside through at least a partial area of the second rear cover 324.

According to various embodiments, the electronic device 300 includes an input device 303 (e.g., a microphone), an audio output device 301 and 302, a sensor module 304, a camera device 305 and 308, and a key input device ( It may include at least one of 306) or connector port 307. In the illustrated embodiment, an input device 303 (e.g., a microphone), an audio output device 301, 302, a sensor module 304, a camera device 305, 308, a key input device 306, or a connector port ( 307) refers to a hole or shape formed in the first housing 310 or the second housing 320, but is disposed inside the electronic device 300 and operates through the hole or shape. may be defined to include an input device, an audio output device, a sensor module, or a camera device).

According to various embodiments, the input device 303 may include at least one microphone 303 disposed in the second housing 320. In some embodiments, the input device 303 may include a plurality of microphones 303 arranged to detect the direction of sound. In some embodiments, a plurality of microphones 303 may be placed at appropriate positions in the first housing 310 and/or the second housing 320. According to one embodiment, the sound output devices 301 and 302 may include speakers 301 and 302. According to one embodiment, the speakers 301 and 302 may include a call receiver 301 disposed in the first housing 310 and a speaker 302 disposed in the second housing 320. In some embodiments, the input device 303, the audio output devices 301 and 302, and the connector port 307 are space provided in the first housing 310 and/or the second housing 320 of the electronic device 300. and may be exposed to the external environment through at least one hole formed in the first housing 310 and/or the second housing 320. According to one embodiment, at least one connector port 307 may be used to transmit and receive power and/or data with an external electronic device. In some embodiments, at least one connector port (eg, ear jack hole) may accommodate a connector (eg, ear jack) for transmitting and receiving audio signals to and from an external electronic device. In some embodiments, the hole formed in the first housing 310 and/or the second housing 320 may be commonly used for the input device 303 and the audio output devices 301 and 302. In some embodiments, the sound output devices 301 and 302 may include a speaker (e.g., a piezo speaker) that operates without the hole formed in the first housing 310 and/or the second housing 320. .

According to various embodiments, the sensor module 304 may generate an electrical signal or data value corresponding to the internal operating state of the electronic device 300 or the external environmental state. The sensor module 304 may detect the external environment through, for example, the first surface 311 of the first housing 310. In some embodiments, the electronic device 300 may further include at least one sensor module disposed to detect the external environment through the second surface 312 of the first housing 310. According to one embodiment, the sensor module 304 (eg, an illumination sensor) may be disposed below the display 240 to detect the external environment through the display 240 . According to one embodiment, the sensor module 304 includes a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, and an illumination sensor. , it may include at least one of a proximity sensor, a biometric sensor, an ultrasonic sensor, or an illumination sensor 304.

According to various embodiments, the camera devices 305 and 308 include a first camera device 305 (e.g., a front camera device) disposed on the first side 311 of the first housing 310 and the first housing. It may include a second camera device 308 disposed on the second surface 312 of 310 . The electronic device 300 may further include a flash 309 disposed near the second camera device 308. According to one embodiment, the camera devices 305 and 308 may include one or more lenses, an image sensor, and/or an image signal processor. Flash 309 may include, for example, a light emitting diode or a xenon lamp. According to one embodiment, the camera devices 305 and 308 include two or more lenses (e.g., a wide-angle lens, an ultra-wide-angle lens, or a telephoto lens) and image sensors that are positioned on one side (e.g., the first side) of the electronic device 300. 311), the second side 312, the third side 321, or the fourth side 322). In some embodiments, the camera devices 305 and 308 may include time of flight (TOF) lenses and/or an image sensor.

According to various embodiments, the key input device 306 (eg, key button) may be disposed on the third side 313c of the first side member 313 of the first housing 310. In some embodiments, the key input device 306 is connected to at least one of the different sides 313a, 313b of the first housing 310 and/or the sides 323a, 323b, and 323c of the second housing 320. It may also be placed on the side. In some embodiments, the electronic device 300 may not include some or all of the key input devices 306 and the key input devices 306 that are not included may be displayed on the display 240 in the form of soft keys, etc. It may be implemented. In some embodiments, key input device 306 may be implemented using a pressure sensor included in display 240.

According to various embodiments, some of the camera devices 305 and 308 (eg, the first camera device 305) or the sensor module 304 may be arranged to be exposed through the display 240. For example, the first camera device 305 or the sensor module 304 may come into contact with the external environment through an opening (e.g., a through hole) formed at least partially in the display 240 in the internal space of the electronic device 300. can be placed. In another embodiment, some sensor modules 304 may be arranged to perform their functions in the internal space of the electronic device 300 without being visually exposed through the display 240. For example, in this case, the area of the display 240 facing the sensor module may not require opening.

FIG. 4A illustrates a situation in which an electronic device according to a comparative example simultaneously captures and stores a plurality of images according to a simultaneous capture mode.

FIG. 4B illustrates a situation in which an electronic device (e.g., the electronic device 200 of FIG. 2A) according to various embodiments of this document simultaneously captures and stores a plurality of images according to a simultaneous capture mode.

According to FIG. 4A, a general electronic device can receive images captured from each of the front camera (eg, first camera) and rear camera (eg, second camera) as a buffer. A typical electronic device may include a buffer for storing images captured by each camera. A general electronic device may store information about the image 431 captured using a front camera (eg, first camera) in a first buffer. A typical electronic device can store information about the image 432 captured using a rear camera (eg, a second camera) in a second buffer.

A typical electronic device can display an image captured using a front camera (e.g., a first camera) and an image captured using a rear camera (e.g., a second camera) in a picture in picture (PIP) manner (412a) ). PIP may refer to a method of displaying an image captured using a front camera by overlaying an image captured using a rear camera. Conversely, a typical electronic device may display an image captured using a rear camera (e.g., a second camera) and an image captured using a front camera (e.g., a first camera) using a PIP method.

A general electronic device can detect a specific event (salient event) in the image 431 captured using a front camera (eg, first camera). A specific event (salient event) may mean a situation in which an object that did not exist on the screen captured for a specified time suddenly appears (for example, a situation in which a bird suddenly appears on the screen while shooting a landscape). The situation in which a bird appears on the screen is only an example, and the type of specific event (salient event) is not limited to this.

According to FIG. 4A, a general electronic device can detect a specific event (salient event) on the third frame 401 of an image 431 captured using a front camera (eg, first camera). In response to detecting a specific event (salient event), a general electronic device may display a first tag indicating a detection point of a specific event (salient event) in a first buffer. A general electronic device can detect a specific event (salient event) on the second frame 403 of the image 432 captured using a rear camera (eg, a second camera). In response to detecting a specific event (salient event), a general electronic device may display a second tag in a second buffer indicating a point in time at which the specific event (salient event) is detected.

A typical electronic device can integrate an image 431 captured using a front camera (eg, a first camera) and an image 432 captured using a rear camera (eg, a second camera). A general electronic device may require a process of displaying the first tag on the image 432 captured using a rear camera (eg, a second camera). A general electronic device may require a process of displaying a second tag on the image 431 captured using a front camera (eg, first camera).

In addition, a general electronic device adjusts the shooting cycle of the image 431 captured using a front camera (e.g., a first camera) and the image 432 captured using a rear camera (e.g., a second camera) to be the same. This can be difficult to do.

FIG. 4B illustrates a situation in which an electronic device (e.g., the electronic device 200 of FIG. 2A) according to various embodiments of this document simultaneously captures and stores a plurality of images according to a simultaneous capture mode.

According to FIG. 4B, the electronic device 200 according to various embodiments uses a front camera (e.g., the first camera 231 in FIG. 2a) and a rear camera (e.g., the second camera 232 in FIG. 2a), respectively. The captured image can be transmitted to a buffer (e.g., buffer 212 in FIG. 2A). The electronic device 200 may include a buffer 212 for storing images captured by each camera. Unlike the general electronic device of FIG. 4A, the electronic device 200 can store images captured from each camera in one buffer (or integrated buffer).

The electronic device 200 may store images captured from each camera in one buffer 212. The electronic device 200 may perform at least one of detection of a specific event (salient event), buffer storage, buffer management, or timestamp management based on one buffer 212. A specific event (salient event) may mean a situation in which an object that did not exist on the screen captured for a specified time suddenly appears (for example, a situation in which a bird suddenly appears on the screen while shooting a landscape). A timestamp may refer to a mark written at a specific location on the timeline. The electronic device 200 may provide the user with information indicating at what point in time a specific event existed using a timestamp.

According to FIG. 4B, the electronic device 200 may detect a specific event on the third frame 405 of the first image 431 captured by the first camera 231. Additionally, the electronic device 200 may detect a specific event on the third frame 407 of the second image 432 captured by the second camera 232. The electronic device 200 may record a specific event detection point in one buffer 212 in response to detecting a specific event. The electronic device 200 may store and manage the first image 431 and the second image 432 together on the buffer 212 (412b). The electronic device 200 displays a specific event detection point (e.g., the third frame 405) on the timeline of the first image 431 stored in the buffer 212 and displays the time of the second image 432. You can control it to be displayed simultaneously on the line. Conversely, the electronic device 200 displays a specific event detection point (e.g., the second frame 407) on the timeline of the second image 432 stored in the buffer 212 and displays the You can control it to be displayed simultaneously on the timeline.

According to one embodiment, under the control of the processor 220, when a specific event is detected, the electronic device 200 selects any of the screens captured using the first to third cameras 231 to 233 to detect the event. You can adjust the weight that indicates whether to use the screen. The electronic device 200 may determine a camera that serves as a standard for time-lapse photography by adjusting the weight. For example, the electronic device 200 may perform time-lapse photography based only on a specific event that occurs on the first camera 231. Alternatively, the electronic device 200 may perform time-lapse photography based only on specific events that occur on the second camera 232. Alternatively, the electronic device 200 may perform time-lapse photography by considering all specific events that occur on the first camera 231 and the second camera 232.

According to one embodiment, the electronic device 200, under the control of the processor 220, can make a plurality of images captured on the first camera 231 and the second camera 232 have the same time information. The electronic device 200 may integrate images captured on the first camera 231 and the second camera 232.

During the integration process, the electronic device 200 may make the frames of images captured on the first camera 231 and the second camera 232 the same. For example, the electronic device 200 may make the frames per second (fps) of images captured on the first camera 231 and the second camera 232 the same. Alternatively, the electronic device 200 may synchronize images captured on the first camera 231 and the second camera 232 to display the same viewpoint. The electronic device 200 may obtain playback point information and timestamps of images during the integration process. The electronic device 200 selects the first image 431 captured on the first camera 231 and the second image 432 captured on the second camera 232 based on the playback point information and timestamp of the images. It can be converted to . During the video conversion process, the electronic device 200 may maintain the frame index of the first video 431 that was originally being played. The electronic device 200 can efficiently convert images by maintaining the frame index.

According to one embodiment, the electronic device 200 may manage the occurrence of a specific event using one buffer 212 or memory 210 in response to the occurrence of a specific event. A typical electronic device can store data indicating the occurrence of a specific event in memory separately from the front camera image and the rear camera image. In general, in response to a user adding a tag at a specific point in time, an electronic device can store data indicating the tag in memory separately from the image from the front camera and the image from the rear camera.

The electronic device 200 according to various embodiments of this document may manage data indicating the occurrence of a specific event as one file rather than storing it separately from the front camera image and the rear camera image. The electronic device 200 may add data indicating the tag to one file in response to the user adding a tag at a specific time. The electronic device 200 can store data indicating the occurrence of a specific event in a single file without having to store data separately in the image captured using the front camera and the image captured using the rear camera. The electronic device 200 manages data indicating a tag as a single file, and when a tag is added to one image, the electronic device 200 can control the tag to be added to the image captured using the opposite camera. In response to adding a tag to the image of one camera (e.g., the first image 431 captured by the first camera 231), the electronic device 200 adds an image of the opposite camera (e.g., the second image 431). A tag can be controlled to be added to the second image 432 captured by the camera 232 at the same time.

The electronic device 200 may synchronize the first image 431 and the second image 432 with detection information and store them on the buffer 212. Detection information may include at least one of timing information indicating at what point in the timeline an event occurred, type information indicating what type of event occurred, or camera information indicating on which camera the event occurred. .

The electronic device 200 may integrate and play the first image 431 and the second image 432 that share one timeline. The electronic device 200 may provide a user interface that can determine which of the first image 431 and the second image 432 to display. The electronic device 200 may display images played on a display (eg, the display 240 of FIG. 2A) differently based on user selection. Alternatively, the electronic device 200 may display the first image 431 and the second image 432 in different ways based on user selection. For example, the electronic device 200 may display the first image 431 and the second image 432 on the display 240 in a side-by-side manner based on user selection. The electronic device 200 may display the first image 431 at the top of the display 240 and the second image 432 at the bottom of the display 240 based on user selection.

According to one embodiment, the electronic device 200 may display the time when a specific event occurs on a timeline. The electronic device 200 may change the video playback time to the time when a specific event occurs based on the user's selection. The electronic device 200 may play at least one of the first image 431 or the second image 432 based on the user's selection.

FIG. 5 illustrates an image capturing situation using a plurality of cameras of an electronic device according to various embodiments.

In Figure 531, the electronic device (e.g., the electronic device 200 in FIG. 2A) may include at least one camera (e.g., the first camera 231 in FIG. 2A) on its rear side. The electronic device 200 may capture images using the first camera 231 disposed on the rear or first side of the electronic device 200 under the control of the processor 220. The electronic device 200 stores the image captured using the first camera 231 on one memory (e.g., memory 210 in FIG. 2A) or one buffer (e.g., buffer 212 in FIG. 2A). You can save it.

In Figure 532, the electronic device 200 may include at least one camera (eg, the second camera 232 in Figure 2A) on the rear side. The electronic device 200 may capture images using the second camera 232 disposed on the front or second side of the electronic device 200. The electronic device 200 may store an image captured using the second camera 232 in one memory 210 or one buffer 212. The first side and the second side may be located in opposite directions or facing each other on the electronic device 200.

The processor 220 can integrate and manage a plurality of images stored in one memory 210 or one buffer 212 and provide convenience functions to the user. Hereinafter, convenience functions provided to users of the electronic device 200 will be described in FIGS. 6A to 6D.

FIGS. 6A to 6D show examples of user interfaces for switching between and playing a plurality of videos of an electronic device according to various embodiments.

According to FIG. 6A, an electronic device (e.g., the electronic device 200 of FIG. 2a) determines the occurrence time of a specific event of the first image and the second image under the control of a processor (e.g., the processor 220 of FIG. 2a). You can check it. The first image may refer to an image captured by the first camera 631. The second image may refer to an image captured by the second camera 632. The first camera 631 may be placed on the first side of the electronic device 200. The second camera 632 may be disposed on a second side of the electronic device 200 that is opposite to the first side.

According to FIG. 6A, the processor 220 may change the capturing cycle of the first camera 631 and the second camera 632 in response to detecting a specific event 613a in the first image. The processor 220 can control the first video and the second video to have the same playback time by synchronizing them.

According to one embodiment, the processor 220 may synchronize the first image and the second image to display the same timeline. The processor 220 may determine at least one object that serves as an editing standard for the video based on a result learned from usage pattern information stored in a memory (e.g., memory 210 in FIG. 2A).

The processor 220 may display an indicator for at least one of the first time point and the second time point on the timeline. The first viewpoint may mean a viewpoint at which at least one object is included in the first camera 631. The second viewpoint may mean a viewpoint at which at least one object is included in the second camera 632.

The processor 220 may detect a specific event 613a on the second frame 613 of the first image. The processor 220 may change the playback period of the second frame 613 in response to detecting a specific event 613a. For example, the first frame 611 before the second frame 613 may have a playback period of 60 frames/sec or 1 frame/min. In response to detecting a specific event 613a, the processor 220 may adjust the playback period of the second frame 613 to be shorter than that of the first frame 611 (eg, 1 frame/sec). The processor 220 may automatically change the period of the second frame 613 of the second image to be the same as that of the second frame 613 of the first image. The mentioned regeneration cycle is only an example and the regeneration cycle is not limited to this. The processor 220 may change the playback period of the third frame 615 in response to not detecting a specific event 613a in the third frame 615 of the first image. The processor 220 may change the playback period of the third frame 615 to be longer than that of the second frame 613.

The processor 220 may detect a specific event 617a on the fourth frame 617 of the second image. The processor 220 may change the playback period of the fourth frame 617 to be relatively shorter than the playback period of the second frame 615 before the fourth frame 617. The processor 220 may maintain a changed playback cycle in response to the specific event 619a being continuously detected on the fifth frame 619 of the second image.

The number of cameras, the playback cycle, and the position of the frame where the specific event 619a appears are all examples and are not limited thereto.

According to FIG. 6B, the processor 220 may display a point in time at which the specific event is included in the timeline of the integrated image in response to detecting a specific event in the first image. The processor 220 may display the point in time at which a specific event is included on the timeline of the integrated video in the form of a tag.

In Figure 621, processor 220 may recognize a touch input on a display (e.g., display 240 in Figure 2A). The processor 220 may change the playback time of the image based on a touch input on the timeline. The processor 220 can change the playback time of the image based on a touch input on the tag.

In Figure 623, the processor 220 can change the video playback time to a time when a specific event 623a is included based on a touch input on the tag. The processor 220 may use a tag to provide the user with information indicating when a specific event 623a is included.

According to one embodiment, the processor 220 may display an indicator for the first viewpoint on the timeline of the video. The first viewpoint refers to the point at which at least one object begins to be included in the timeline of the video in response to at least one object being included in at least one of the first camera 631 or the second camera 632. It can mean.

According to one embodiment, the processor 220 may move the playback time of the video to the first view point based on the user input to the indicator.

According to FIG. 6C, the processor 220 may provide a user interface for continuing time-lapse photography in response to the electronic device 200 moving during time-lapse photography. The processor 220 may use previous time-lapse shooting information in response to time-lapse shooting being stopped and then resumed. Time-lapse shooting information includes the shooting angles of the first camera 631 and the second camera 632 used for shooting, the shooting time of the first camera 631 and the second camera 632, or the first camera 631 and It may include at least one of the points in time at which a specific event appears in the image captured by the second camera 632. Based on time-lapse shooting information, the processor 220 can provide the user with a shooting environment that is relatively the same as the previous shooting compared to a general electronic device.

According to FIG. 6C, time-lapse shooting may be stopped when the first frame 631a of the first image captured by the first camera 631 is displayed. The processor 220 may stop time-lapse shooting at the point when the first frame 631a is displayed, and may receive an input to start time-lapse shooting again. The processor 220 may provide a user interface for performing time-lapse photography based on input for time-lapse photography. The user interface determines the angle at which the surrounding objects are displayed (e.g. a tree at 60 degrees from the ground), the composition in which the surrounding objects are displayed (e.g. a roof and a tree, a roof and an urn), or the number of surrounding objects at which they are displayed (e.g. 4 jar) may contain information about at least one of the jars. Processor 220 may provide a user interface to help a user adjust the position of a camera or an electronic device. For example, the processor 220 may provide the user with information indicating that the angle at which surrounding objects are displayed is different compared to the previous capture. This is only an example, and the information displayed on the user interface is not limited to this.

According to one embodiment, the processor 220 extracts at least one first feature point from the first image taken at the time when time-lapse shooting is stopped, and at least one first feature point from the second image taken at the time when time-lapse shooting is to be resumed. One second feature point can be extracted. The processor 220 calculates the degree of tilt and distortion by comparing the first feature point with the second feature point, and based on the degree of tilt and distortion, configures the user interface so that the second feature point is mapped with the first feature point. can be provided.

According to one embodiment, the processor 220 may provide a user interface to allow the user to adjust the position of the electronic device 200 or the position of the camera. The processor 220 may provide a user interface to help the user continue shooting in the same composition as before stopping time-lapse shooting.

According to one embodiment, the processor 220 displays information indicating that time-lapse photography is ready to resume based on the second feature point being mapped to the first feature point by exceeding a preset level (e.g., in FIG. 2A). It can be displayed on the display 240).

According to one embodiment, the processor 220 may extract the first feature point and the second feature point using at least one of information about the focal length, subject distance, shooting direction, and zoom ratio.

According to one embodiment, the processor 220 may store the third point in time when time-lapse photography was stopped on the memory 210. The processor 220 may provide information about the difference between a third viewpoint and a fourth viewpoint to resume time-lapse photography, based on an input for resuming time-lapse photography.

According to one embodiment, the processor 220 may provide the user with information indicating that time-lapse photography is ready based on the fact that the third and fourth viewpoints match by exceeding a preset level.

According to FIG. 6D, the processor 220 can change the image displayed on the display 240 based on the user input on the tag 645. The processor 220 may change the first image displayed on the display 240 to the second image based on the user input on the tag 645. The first image may refer to an image captured by the front camera of the electronic device 200. The second image may refer to an image captured by the rear camera of the electronic device 200.

The processor 220 displays a tag 645 on the display 240 to provide the user with information about the image currently being displayed (e.g., whether the image is captured by the front camera or the rear camera). can do. The processor 220 may change the image displayed on the display 240 based on the user input on the tag 645.

According to various embodiments, the processor 220 may stop playing the first image and play the second image. In this case, the processor 220 may control the second video to be played at a time corresponding to the playback time information 640 at the time when playback of the first video is stopped.

FIG. 7 is a flow chart illustrating a method of photographing an electronic device according to various embodiments.

Operations described with reference to FIG. 7 may be implemented based on instructions that can be stored in a computer recording medium or memory (eg, memory 210 in FIG. 2A). The illustrated method 700 can be executed by the electronic device previously described with reference to FIGS. 1 to 6D (e.g., the electronic device 200 of FIG. 2A), and technical features described above will be omitted below.

In operation 710, the processor (e.g., processor 220 of FIG. 2A) may determine at least one object that serves as an editing standard for the video based on a result learned from usage pattern information stored in the memory 210. A specific event (salient event) is when at least one object is detected by at least one of a first camera (e.g., the first camera 231 in FIG. 2A) or a second camera (e.g., the second camera 232 in FIG. 2A). It may mean an event that appears. The first camera 231 may refer to a camera located in the front of the housing (not shown) of the electronic device 200. The second camera 232 may refer to a camera located on the rear side of the housing (not shown) of the electronic device 200.

In operation 720, the processor 220 includes at least one object in the timeline of the video in response to at least one object being included in at least one of the first camera 231 or the second camera 232. It can indicate the first point in time when something starts to happen. The processor 220 may move the playback point of the video to the first point in time based on the user input for the first point in the timeline. The processor 220 may display a first point in time on a timeline to provide the user with information about when a specific event (salient event) occurred.

In operation 730, the processor 220 may shorten the shooting cycle of the first camera 231 in response to the inclusion of at least one object on the first camera 231. The processor 220 can shorten the shooting cycle of the first camera 231 to improve the frame and quality of the image. The processor 220 maintains the shooting cycle of the first camera 231 relatively long before a specific event (salient event) occurs, and can reduce power consumption and capacity consumption of the memory 210. The processor 220 may shorten the shooting cycle of the first camera 231 based on the first time point when a specific event (salient event) occurs. The processor 220 may improve the frame and image quality of the image in response to the inclusion of at least one object in the image and provide the image to the user.

In operation 735, the processor 220 may change the shooting cycle of the second camera 232 to be the same as the shooting cycle of the first camera 231 in response to shortening the shooting cycle of the first camera 231. . Electronic devices can generally separately store images from multiple cameras. Electronic devices can generally adjust the camera's shooting cycle when a specific event (salient event) occurs on one camera. However, it may be difficult for general electronic devices to automatically change the shooting cycle of other cameras where a specific event (salient event) has not occurred. A general electronic device may provide a user with a first image captured by a camera in which a specific event (salient event) occurred and a second image captured by a camera in which a specific event (salient event) did not occur. At this time, the shooting cycle of the first image and the second image may be different. Therefore, images captured on the front camera and images captured on the rear camera may be created with different frames and quality.

The electronic device 200 according to various embodiments of this document may, under the control of the processor 220, change the shooting cycle of the first camera 231 where a specific event (salient event) occurs to be shorter than before (e.g. : 1 frame/sec). At the same time, the electronic device 200 may change the photographing cycle of the second camera 232, in which no specific event (salient event) occurs, to be the same as the photographing cycle of the first camera 231. The electronic device 200 can provide high-quality images from the time a specific event (salient event) occurs, and control the image captured by the front camera and the image captured by the rear camera to have the same image quality.

In operation 740, the processor 220 may shorten the shooting cycle of the first camera 232 in response to the fact that at least one object is included in the second camera 232. The processor 220 can shorten the shooting cycle of the second camera 232 to improve the frame and quality of the image. The processor 220 maintains the shooting cycle of the second camera 232 relatively long before a specific event (salient event) occurs, and can reduce power consumption and capacity consumption of the memory 210. The processor 220 may shorten the shooting cycle of the first camera 232 based on the second time point when a specific event (salient event) occurs.

In operation 745, the processor 220 may change the photographing cycle of the first camera 231 to be the same as that of the second camera 232 in response to shortening the photographing cycle of the second camera 232. . The electronic device 200 can provide high-quality images from the time a specific event (salient event) occurs, and control the image captured by the front camera and the image captured by the rear camera to have the same image quality.

Operation 730 or operation 740 may be performed depending on which camera, the first camera 231 or the second camera 232, detects a specific event (salient event). When both the first camera 231 and the second camera 232 detect a specific event (salient event), both operations 730 and 740 may be performed. Additionally, operations 730 and 740 may not necessarily occur consecutively. Only operations 730 and 735 may occur, and operations 740 and 745 may not occur. Conversely, only operations 740 and 745 may occur, and operations 730 and 735 may not occur.

An electronic device according to various embodiments includes a housing, a first camera located on a first side of the housing, a second camera located on a second side of the housing facing the first side, a memory, and a processor, and the processor includes a memory Based on the results learned from the usage pattern information stored in the In response to at least one object being included in at least one of the images, a first point in time at which at least one object begins to be included in the timeline of the video is displayed, and a first image captured using a first camera is displayed. In response to the fact that at least one object is included, the shooting cycle of the first camera is adjusted to be short, and in response to the shooting cycle of the first camera being shortened, the shooting cycle of the second camera is set to be the same as the shooting cycle of the first camera. You can change it.

A method of operating an electronic device including a plurality of cameras includes determining at least one object that serves as an editing standard for a video based on a result learned from usage pattern information stored in a memory, and capturing information captured using a first camera. A first point in time at which at least one object begins to be included in the timeline of the video in response to at least one object being included in at least one of the first video or the second video captured using the second camera. An operation of displaying, an operation of briefly adjusting the shooting cycle of the first camera in response to at least one object being included in the first image captured using the first camera, and an operation of briefly adjusting the shooting cycle of the first camera. It may include an operation of changing the shooting cycle of the second camera to be the same as the shooting cycle of the first camera.

Claims (20)

In electronic devices,
housing;
a first camera located on a first side of the housing;
a second camera located on a second side of the housing facing the first side;
memory; and
Includes a processor,
The processor is
Based on results learned from usage pattern information stored in the memory, determine at least one object that serves as an editing standard for the video,
In response to the fact that the at least one object is included in at least one of the first image captured using the first camera or the second image captured using the second camera, the video is displayed on the timeline of the video. Indicates the first point in time at which at least one object begins to be included,
Shortening the shooting cycle of the first camera in response to the fact that the at least one object is included in the first image captured using the first camera,
An electronic device that changes the shooting cycle of the second camera to be the same as the shooting cycle of the first camera in response to shortening the shooting cycle of the first camera.
According to clause 1,
The processor is
Displaying an indicator for the first viewpoint on the timeline of the video,
An electronic device that moves the playback time of the video to the first view point based on a user input to the indicator.
According to clause 2,
The processor is
Shortening the shooting cycle of the second camera in response to the inclusion of the at least one object in the second image captured using the second camera,
An electronic device that changes the shooting cycle of the first camera to be the same as the shooting cycle of the second camera in response to shortening the shooting cycle of the second camera.
According to clause 1,
The processor is
Extracting at least one first feature point from the first image captured at the time when time-lapse shooting was stopped,
Extracting at least one second feature point from the second image captured at the time of resuming the time-lapse shooting,
Calculate the degree of tilt and distortion of the first feature point compared to the second feature point,
An electronic device that provides a user interface that induces a user input to map the second feature point to the first feature point based on the degree of tilt and distortion.
According to clause 4,
The processor is
Based on the mapping of the second feature point to the first feature point exceeding a preset level
An electronic device that displays information on a display indicating that time-lapse photography is ready to resume.
According to clause 4,
The processor is
An electronic device that extracts the first feature point and the second feature point using at least one of information about focal distance, subject distance, shooting direction, and zoom ratio.
According to clause 1,
The processor is
Store the third point in time at which time-lapse shooting was stopped in the memory,
An electronic device that provides information about a difference between the first time point and a fourth time point to resume time lapse shooting, based on the input for resuming time lapse shooting.
According to clause 7,
The processor is
An electronic device that provides information indicating that time-lapse photography is ready, based on the third viewpoint and the fourth viewpoint matching more than a preset level.
In electronic devices,
housing;
a first camera located on a first side of the housing;
a second camera located on a second side of the housing facing the first side
memory; and
Includes a processor,
The processor is
Obtaining a first image using the first camera and acquiring a second image using the second camera,
storing the first image and the second image on the memory,
Based on results learned from usage pattern information stored in the memory, determine at least one object that serves as an editing standard for the video,
In response to the fact that the at least one object is included in the first image captured using the first camera, a first viewpoint at which the at least one object is included is recorded on the timeline of the first image, and the first An electronic device that controls the first viewpoint to be recorded on the timeline of the second video in response to recording the first viewpoint on the timeline of the video.
According to clause 9,
The processor is
Synchronize the first video and the second video to display the same timeline,
An electronic device that displays an indicator for the first time point on the timeline.
According to claim 10,
The processor is
An electronic device that moves the playback time of the first image and the second video to the first view based on a user input to an indicator indicating the first view.
According to clause 9,
The processor is
Stop playing the first image in response to receiving a touch input on the display on which the first image is output,
An electronic device configured to play the second video based on interrupted playback time information of the first video.
According to clause 9,
The processor is
Extracting at least one first feature point from the first image captured at the time when time-lapse shooting was stopped,
Extracting at least one second feature point from the second image captured at the time of resuming the time-lapse shooting,
Calculate the degree of tilt and distortion of the first feature point compared to the second feature point,
An electronic device that provides a user interface to map the second feature point to the first feature point based on the degree of tilt and degree of distortion.
According to clause 13,
The processor is
Based on the mapping of the second feature point to the first feature point exceeding a preset level
An electronic device that displays information on a display indicating that time-lapse photography is ready to resume.
According to clause 13,
The processor is
An electronic device that extracts the first feature point and the second feature point using at least one of information about focal distance, subject distance, shooting direction, and zoom ratio.
According to clause 9,
The processor is
Store the third point in time at which time-lapse shooting was stopped in the memory,
An electronic device that provides information about a difference between the first time point and a fourth time point to resume time lapse shooting, based on the input for resuming time lapse shooting.
According to clause 16,
The processor is
An electronic device that provides information indicating that time-lapse photography is ready, based on the third viewpoint and the fourth viewpoint matching more than a preset level.
In a method of operating an electronic device including a plurality of cameras,
An operation of determining at least one object that serves as an editing standard for a video based on a result learned from usage pattern information stored in a memory;
In response to the fact that the at least one object is included in at least one of a first image captured using a first camera or a second image captured using a second camera, the at least one object is included in the timeline of the video An operation indicating a first point in time at which an object of begins to be included;
An operation of shortening the shooting cycle of the first camera in response to the fact that the at least one object is included in the first image captured using the first camera; And
A method comprising changing the shooting cycle of the second camera to be the same as the shooting cycle of the first camera in response to shortening the shooting cycle of the first camera.
According to clause 18,
An operation of extracting at least one first feature point from a first image captured when time-lapse photography is stopped;
extracting at least one second feature point from a second image captured at the time of resuming the time-lapse photography;
An operation of calculating a degree of tilt and distortion of the first feature point compared to the second feature point; And
The method further includes providing a user interface to map the second feature point to the first feature point based on the degree of tilt and degree of distortion.
According to clause 18,
The operation of displaying a first point in time at which the at least one object begins to be included in the timeline of the video is
An operation of displaying an indicator for the first viewpoint on the timeline of the video; And
The method further includes moving a playback point of the video to the first point of view based on a user input to the indicator.

Images