KR20220147324A - Electronic device and method of operation thereof - Google Patents

Abstract

Disclosed is an electronic device that comprises a camera, a microphone, a display, a memory, and a processor operatively coupled to the camera, the microphone, the display, and the memory. The memory, when executed, may store one or more instructions configured to cause the processor to: acquire a plurality of images including a first image and a second image by using the camera; store, as a first file together with the first image, a first video acquired by using the camera and the microphone before a first designated time from a first time point at which the first image is acquired; store, as a second file together with the second image, a second video acquired by using the camera and the microphone before the first designated time from a second time point at which the second image is acquired; and link and play the first video and the second video on the basis of information related to a connection between the first video and the second video. Various other embodiments identified through the specification are possible. The present invention can provide new content by integrating (or connecting) short videos into a continuous long video.

Description

Electronic device and method of operation of electronic device

Embodiments disclosed in this document relate to an electronic device and an operating method of the electronic device.

When taking a photo recently, it supports a multimedia format that can provide a short video of the moment when the photo was taken by storing the video and audio of the video of about 3 to 5 seconds at the time of taking the photo along with the photo. Electronic devices are gradually increasing. This format has the advantage of being able to shoot quickly and having a small capacity, as well as the advantages of being able to take a picture with a relatively small capacity, and having the advantage of being able to feel the atmosphere of the time when the picture was taken with a relatively small file in a short period of time.

An electronic device that supports a multimedia format that stores a short video together with a picture at the time the picture was taken can only store a short video of about 3 to 5 seconds in a file of the corresponding format, so users can use the same When multiple shots are taken at the same time period, only a plurality of short videos can be individually viewed, and it may be difficult to combine the short videos shot at the same time zone. Accordingly, various embodiments disclosed in this document can provide new content by integrating (or concatenating) a video shot at the same time period and stored in a plurality of files divided into several seconds into a continuous long-time video. An object of the present invention is to provide an electronic device and an operating method thereof.

In addition, a user can merge short videos that are divided and stored in a plurality of files by using a video and audio editing tool. For example, when data stored in different files is duplicated, the video frame and audio frame stored in each file Because it is necessary to remove duplicate frames by using sync mapping or a separate duplicate frame detection algorithm-based tool, short videos of the same time period stored in multiple files are connected without overlapping sections. It takes a lot of time to create one video. Accordingly, various embodiments disclosed in this document are intended to provide an electronic device capable of connecting and playing short videos of the same time period divided and stored in a plurality of files without using a separate tool without using a duplicate section and an operating method thereof .

An electronic device according to an embodiment disclosed in this document includes a camera, a microphone, a display, a memory, and a processor operatively connected to the camera, the microphone, the display, and the memory, wherein the memory, when executed In, the processor acquires a plurality of images including a first image and a second image by using the camera, and the camera and the microphone from a first designated time before the first time point at which the first image is acquired stores the first video acquired using the as a first file together with the first image, and acquired using the camera and the microphone before the first specified time from the second time point when the second image was acquired One that stores a second video as a second file together with the second image, and connects and plays the first video and the second video based on information related to the connection between the first video and the second video The above instructions may be stored.

Also, in the method of operating an electronic device according to an embodiment disclosed in this document, a plurality of images including a first image and a second image are acquired using a camera of the electronic device, and the first image is acquired. A first video acquired by using the camera and a microphone of the electronic device from a first time point before a first designated time is stored as a first file together with the first image, and a second image obtained by acquiring the second image A second video acquired by using the camera and the microphone from a point in time before the first designated time is stored as a second file together with the second image, and information related to a connection between the first video and the second video Based on the , the first video and the second video may be connected and played.

According to various embodiments disclosed in this document, an electronic device capable of providing new content by integrating (or linking) a video shot at the same time period and stored in a plurality of files divided into several seconds into a continuous long-time video and an operating method thereof.

Also, according to various embodiments disclosed in this document, it is possible to provide an electronic device capable of connecting and playing short videos of the same time period divided and stored in a plurality of files without using a separate tool without using an overlapping section and an operating method thereof. .

In addition, various effects directly or indirectly identified through this document may be provided.

1 is a block diagram of an electronic device in a network environment, according to various embodiments of the present disclosure;
2 is a block diagram of an electronic device according to an exemplary embodiment.
3 is a flowchart illustrating an operation of an electronic device according to an exemplary embodiment.
4 is a flowchart illustrating an operation of an electronic device according to an exemplary embodiment.
5 is a flowchart illustrating an operation of an electronic device according to an exemplary embodiment.
6 is a diagram for describing an operation of an electronic device according to an exemplary embodiment.
7 is a diagram illustrating a structure of a file generated by an electronic device according to an exemplary embodiment.
8 is a flowchart illustrating an operation of an electronic device according to an exemplary embodiment.
9 is a diagram for describing an operation of an electronic device according to an exemplary embodiment.
10 is a diagram illustrating a user interface provided by an electronic device according to an exemplary embodiment.
In connection with the description of the drawings, the same or similar reference numerals may be used for the same or similar components.

1 is a block diagram of an electronic device 101 in a network environment 100, according to various embodiments. Referring to FIG. 1 , in a network environment 100 , the electronic device 101 communicates with the electronic device 102 through a first network 198 (eg, a short-range wireless communication network) or a second network 199 . It may communicate with at least one of the electronic device 104 and the server 108 through (eg, a long-distance wireless communication network). According to an embodiment, the electronic device 101 may communicate with the electronic device 104 through the server 108 . According to an embodiment, the electronic device 101 includes a processor 120 , a memory 130 , an input module 150 , a sound output module 155 , a display module 160 , an audio module 170 , and a sensor module ( 176), interface 177, connection terminal 178, haptic module 179, camera module 180, power management module 188, battery 189, communication module 190, subscriber identification module 196 , or an antenna module 197 . In some embodiments, at least one of these components (eg, the connection terminal 178 ) may be omitted or one or more other components may be added to the electronic device 101 . In some embodiments, some of these components (eg, sensor module 176 , camera module 180 , or antenna module 197 ) are integrated into one component (eg, display module 160 ). can be

The processor 120, for example, executes software (eg, a program 140) to execute at least one other component (eg, a hardware or software component) of the electronic device 101 connected to the processor 120. It can control and perform various data processing or operations. According to one embodiment, as at least part of data processing or operation, the processor 120 converts commands or data received from other components (eg, the sensor module 176 or the communication module 190 ) to the volatile memory 132 . may be stored in , process commands or data stored in the volatile memory 132 , and store the result data in the non-volatile memory 134 . According to an embodiment, the processor 120 is the main processor 121 (eg, a central processing unit or an application processor) or a secondary processor 123 (eg, a graphic processing unit, a neural network processing unit (eg, a graphic processing unit, a neural network processing unit) a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor). For example, when the electronic device 101 includes the main processor 121 and the sub-processor 123 , the sub-processor 123 uses less power than the main processor 121 or is set to be specialized for a specified function. can The auxiliary processor 123 may be implemented separately from or as a part of the main processor 121 .

The secondary processor 123 may, for example, act on behalf of the main processor 121 while the main processor 121 is in an inactive (eg, sleep) state, or when the main processor 121 is active (eg, executing an application). ), together with the main processor 121, at least one of the components of the electronic device 101 (eg, the display module 160, the sensor module 176, or the communication module 190) It is possible to control at least some of the related functions or states. According to an embodiment, the coprocessor 123 (eg, an image signal processor or a communication processor) may be implemented as part of another functionally related component (eg, the camera module 180 or the communication module 190). have. According to an embodiment, the auxiliary processor 123 (eg, a neural network processing device) may include a hardware structure specialized for processing an artificial intelligence model. Artificial intelligence models can be created through machine learning. Such learning may be performed, for example, in the electronic device 101 itself on which the artificial intelligence model is performed, or may be performed through a separate server (eg, the server 108). The learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but in the above example not limited The artificial intelligence model may include a plurality of artificial neural network layers. Artificial neural networks include deep neural networks (DNNs), convolutional neural networks (CNNs), recurrent neural networks (RNNs), restricted boltzmann machines (RBMs), deep belief networks (DBNs), bidirectional recurrent deep neural networks (BRDNNs), It may be one of deep Q-networks or a combination of two or more of the above, but is not limited to the above example. The artificial intelligence model may include, in addition to, or alternatively, a software structure in addition to the hardware structure.

The memory 130 may store various data used by at least one component of the electronic device 101 (eg, the processor 120 or the sensor module 176 ). The data may include, for example, input data or output data for software (eg, the program 140 ) and instructions related thereto. The memory 130 may include a volatile memory 132 or a non-volatile memory 134 .

The program 140 may be stored as software in the memory 130 , and may include, for example, an operating system 142 , middleware 144 , or an application 146 .

The input module 150 may receive a command or data to be used in a component (eg, the processor 120 ) of the electronic device 101 from the outside (eg, a user) of the electronic device 101 . The input module 150 may include, for example, a microphone, a mouse, a keyboard, a key (eg, a button), or a digital pen (eg, a stylus pen).

The sound output module 155 may output a sound signal to the outside of the electronic device 101 . The sound output module 155 may include, for example, a speaker or a receiver. The speaker can be used for general purposes such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from or as part of the speaker.

The display module 160 may visually provide information to the outside (eg, a user) of the electronic device 101 . The display module 160 may include, for example, a control circuit for controlling a display, a hologram device, or a projector and a corresponding device. According to an embodiment, the display module 160 may include a touch sensor configured to sense a touch or a pressure sensor configured to measure the intensity of a force generated by the touch.

The audio module 170 may convert a sound into an electric signal or, conversely, convert an electric signal into a sound. According to an embodiment, the audio module 170 acquires a sound through the input module 150 , or an external electronic device (eg, a sound output module 155 ) connected directly or wirelessly with the electronic device 101 . The electronic device 102) (eg, a speaker or headphones) may output a sound.

The sensor module 176 detects an operating state (eg, power or temperature) of the electronic device 101 or an external environmental state (eg, user state), and generates an electrical signal or data value corresponding to the sensed state. can do. According to an embodiment, the sensor module 176 may include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, It may include a temperature sensor, a humidity sensor, or an illuminance sensor.

The interface 177 may support one or more designated protocols that may be used by the electronic device 101 to directly or wirelessly connect with an external electronic device (eg, the electronic device 102 ). According to an embodiment, the interface 177 may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

The connection terminal 178 may include a connector through which the electronic device 101 can be physically connected to an external electronic device (eg, the electronic device 102 ). According to an embodiment, the connection terminal 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (eg, a headphone connector).

The haptic module 179 may convert an electrical signal into a mechanical stimulus (eg, vibration or movement) or an electrical stimulus that the user can perceive through tactile or kinesthetic sense. According to an embodiment, the haptic module 179 may include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

The camera module 180 may capture still images and moving images. According to an embodiment, the camera module 180 may include one or more lenses, image sensors, image signal processors, or flashes.

The power management module 188 may manage power supplied to the electronic device 101 . According to an embodiment, the power management module 188 may be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

The battery 189 may supply power to at least one component of the electronic device 101 . According to one embodiment, battery 189 may include, for example, a non-rechargeable primary cell, a rechargeable secondary cell, or a fuel cell.

The communication module 190 is a direct (eg, wired) communication channel or a wireless communication channel between the electronic device 101 and an external electronic device (eg, the electronic device 102, the electronic device 104, or the server 108). It can support establishment and communication performance through the established communication channel. The communication module 190 may include one or more communication processors that operate independently of the processor 120 (eg, an application processor) and support direct (eg, wired) communication or wireless communication. According to one embodiment, the communication module 190 is a wireless communication module 192 (eg, a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 194 (eg, : LAN (local area network) communication module, or a power line communication module) may be included. A corresponding communication module among these communication modules is a first network 198 (eg, a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network 199 (eg, legacy It may communicate with the external electronic device 104 through a cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (eg, a telecommunication network such as a LAN or a WAN). These various types of communication modules may be integrated into one component (eg, a single chip) or may be implemented as a plurality of components (eg, multiple chips) separate from each other. The wireless communication module 192 uses the subscriber information (eg, International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module 196 within a communication network such as the first network 198 or the second network 199 . The electronic device 101 may be identified or authenticated.

The wireless communication module 192 may support a 5G network after a 4G network and a next-generation communication technology, for example, a new radio access technology (NR). NR access technology is a high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and access to multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low -latency communications)). The wireless communication module 192 may support a high frequency band (eg, mmWave band) in order to achieve a high data rate, for example. The wireless communication module 192 uses various techniques for securing performance in a high frequency band, for example, beamforming, massive multiple-input and multiple-output (MIMO), all-dimensional multiplexing. Technologies such as full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna may be supported. The wireless communication module 192 may support various requirements specified in the electronic device 101 , an external electronic device (eg, the electronic device 104 ), or a network system (eg, the second network 199 ). According to one embodiment, the wireless communication module 192 is configured to implement a peak data rate (eg, 20 Gbps or more) for realization of eMBB, loss coverage for realization of mMTC (eg, 164 dB or less), or U-plane latency (for URLLC realization) ( Example: Downlink (DL) and uplink (UL) may support 0.5 ms or less, or 1 ms or less round trip respectively).

The antenna module 197 may transmit or receive a signal or power to the outside (eg, an external electronic device). According to an embodiment, the antenna module 197 may include an antenna including a conductor formed on a substrate (eg, a PCB) or a radiator formed of a conductive pattern. According to an embodiment, the antenna module 197 may include a plurality of antennas (eg, an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network such as the first network 198 or the second network 199 is connected from the plurality of antennas by, for example, the communication module 190 . can be selected. A signal or power may be transmitted or received between the communication module 190 and an external electronic device through the selected at least one antenna. According to some embodiments, other components (eg, a radio frequency integrated circuit (RFIC)) other than the radiator may be additionally formed as a part of the antenna module 197 .

According to various embodiments, the antenna module 197 may form a mmWave antenna module. According to one embodiment, the mmWave antenna module comprises a printed circuit board, an RFIC disposed on or adjacent to a first side (eg, bottom side) of the printed circuit board and capable of supporting a designated high frequency band (eg, mmWave band); and a plurality of antennas (eg, an array antenna) disposed on or adjacent to a second side (eg, top or side) of the printed circuit board and capable of transmitting or receiving signals of the designated high frequency band. can do.

At least some of the components are connected to each other through a communication method between peripheral devices (eg, a bus, general purpose input and output (GPIO), serial peripheral interface (SPI), or mobile industry processor interface (MIPI)) and a signal ( eg commands or data) can be exchanged with each other.

According to an embodiment, the command or data may be transmitted or received between the electronic device 101 and the external electronic device 104 through the server 108 connected to the second network 199 . Each of the external electronic devices 102 or 104 may be the same as or different from the electronic device 101 . According to an embodiment, all or a part of operations executed in the electronic device 101 may be executed in one or more external electronic devices 102 , 104 , or 108 . For example, when the electronic device 101 needs to perform a function or service automatically or in response to a request from a user or other device, the electronic device 101 may perform the function or service itself instead of executing the function or service itself. Alternatively or additionally, one or more external electronic devices may be requested to perform at least a part of the function or the service. One or more external electronic devices that have received the request may execute at least a part of the requested function or service, or an additional function or service related to the request, and transmit a result of the execution to the electronic device 101 . The electronic device 101 may process the result as it is or additionally and provide it as at least a part of a response to the request. For this purpose, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used. The electronic device 101 may provide an ultra-low latency service using, for example, distributed computing or mobile edge computing. In another embodiment, the external electronic device 104 may include an Internet of things (IoT) device. The server 108 may be an intelligent server using machine learning and/or neural networks. According to an embodiment, the external electronic device 104 or the server 108 may be included in the second network 199 . The electronic device 101 may be applied to an intelligent service (eg, smart home, smart city, smart car, or health care) based on 5G communication technology and IoT-related technology.

The electronic device according to various embodiments disclosed in this document may have various types of devices. The electronic device may include, for example, a portable communication device (eg, a smart phone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a home appliance device. The electronic device according to the embodiment of the present document is not limited to the above-described devices.

The various embodiments of this document and the terms used therein are not intended to limit the technical features described in this document to specific embodiments, and should be understood to include various modifications, equivalents, or substitutions of the embodiments. In connection with the description of the drawings, like reference numerals may be used for similar or related components. The singular form of the noun corresponding to the item may include one or more of the item, unless the relevant context clearly dictates otherwise. As used herein, "A or B", "at least one of A and B", "at least one of A or B", "A, B or C", "at least one of A, B and C", and "A , B, or C" each may include any one of the items listed together in the corresponding one of the phrases, or all possible combinations thereof. Terms such as “first”, “second”, or “first” or “second” may simply be used to distinguish an element from other such elements, and may refer elements to other aspects (e.g., importance or order) is not limited. It is said that one (eg, first) component is "coupled" or "connected" to another (eg, second) component, with or without the terms "functionally" or "communicatively". When referenced, it means that one component can be connected to the other component directly (eg by wire), wirelessly, or through a third component.

The term “module” used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and is interchangeable with terms such as, for example, logic, logic block, component, or circuit. can be used as A module may be an integrally formed part or a minimum unit or a part of the part that performs one or more functions. For example, according to an embodiment, the module may be implemented in the form of an application-specific integrated circuit (ASIC).

Various embodiments of the present document include one or more instructions stored in a storage medium (eg, the internal memory 136 or the external memory 138) readable by a machine (eg, the electronic device 101). may be implemented as software (eg, the program 140) including For example, the processor (eg, the processor 120 ) of the device (eg, the electronic device 101 ) may call at least one of one or more instructions stored from a storage medium and execute it. This makes it possible for the device to be operated to perform at least one function according to the called at least one command. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The device-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' only means that the storage medium is a tangible device and does not contain a signal (eg, electromagnetic wave), and this term refers to the case where data is semi-permanently stored in the storage medium and It does not distinguish between temporary storage cases.

According to one embodiment, the method according to various embodiments disclosed in this document may be provided in a computer program product (computer program product). Computer program products may be traded between sellers and buyers as commodities. The computer program product is distributed in the form of a machine-readable storage medium (eg compact disc read only memory (CD-ROM)), or via an application store (eg Play Store ^™ ) or on two user devices ( It can be distributed (eg downloaded or uploaded) directly, online between smartphones (eg: smartphones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily created in a machine-readable storage medium such as a memory of a server of a manufacturer, a server of an application store, or a relay server.

According to various embodiments, each component (eg, a module or a program) of the above-described components may include a singular or a plurality of entities, and some of the plurality of entities may be separately disposed in other components. have. According to various embodiments, one or more components or operations among the above-described corresponding components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (eg, a module or a program) may be integrated into one component. In this case, the integrated component may perform one or more functions of each component of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. . According to various embodiments, operations performed by a module, program, or other component are executed sequentially, in parallel, repeatedly, or heuristically, or one or more of the operations are executed in a different order, or omitted. or one or more other operations may be added.

Hereinafter, a configuration and operation of an electronic device according to an exemplary embodiment will be described with reference to FIGS. 2 and 3 .

2 is a block diagram 200 of an electronic device according to an exemplary embodiment.

Referring to FIG. 2 , the electronic device 201 (eg, the electronic device 101 of FIG. 1 ) includes a camera 210 (eg, the camera module 180 of FIG. 1 ) and a microphone 220 (eg, FIG. 1 ). of input module 150 ), display 230 (eg, display module 160 of FIG. 1 ), memory 240 (eg, memory 130 of FIG. 1 ), and processor 250 (eg, FIG. 1 ). 1 processor 120).

According to an embodiment, the camera 210 may capture a still image (or an image) (eg, a photo) and a moving picture. According to an embodiment, the camera 210 may acquire image data corresponding to a still image and video data corresponding to a moving image.

According to an embodiment, the microphone 220 may convert a sound input from the outside (eg, a user) of the electronic device 201 into audio data. According to an embodiment, the microphone 220 may be activated together when the camera 210 starts recording a video to acquire audio data corresponding to the video. According to an embodiment, the audio data may correspond to video data obtained by the camera 210 .

According to an embodiment, the display 230 may visually provide information to the outside (eg, a user) of the electronic device 201 . According to an embodiment, the display 230 may display images and videos. According to an embodiment, the display 230 may display a user interface (UI). According to an embodiment, the display 230 may include a touch sensor configured to sense a touch or a pressure sensor configured to measure the intensity of a force generated by the touch. For example, the display 230 may receive a touch input corresponding to the user interface.

According to an embodiment, the memory 240 may store one or more instructions executed by the processor 250 . According to an embodiment, the memory 240 may store image data and video data acquired by the camera 210 . According to an embodiment, the memory 240 may store audio data acquired by the microphone 220 . According to an embodiment, the memory 240 may include a buffer for temporarily storing video data and audio data corresponding to the video data. For example, the buffer may be a ring buffer. According to an embodiment, the buffer may store video data and audio data in chronological order according to the size of the buffer, and when the buffer is full, the oldest data may be removed and new data may be stored. According to an embodiment, an operation of temporarily storing video data and audio data in a buffer may be referred to as buffering.

According to an embodiment, the processor 250 may control the operation of the electronic device 201 by executing instructions stored in the memory 240 . According to an embodiment, the processor 250 records an image (or still image) (eg, a photo) acquired using the camera 210 with a video acquired using the camera 210 and the microphone 220 . It can be saved as one file. According to an embodiment, the processor 250 may generate one file by storing the image and the video in a container format. According to an embodiment, the container format may refer to a file format capable of storing different types of data and metadata in one file. For example, a container format including an image and a moving picture may include, but is not limited to, a joint photographic experts group (JPEG) and/or a high efficiency image container (HEIC). For example, a container format including an image and a video may include an image file compressed using a specified codec and a video file compressed using a specified codec. For example, in the JPEG container format, an image file in JPEG format is included in the frame area, and a video file in MP4 (MPEG-4) format including an image of the first specified time (eg, 3 seconds) is included in the metadata area ( Example: user data area).

According to an embodiment, the processor 250 acquires video data using the camera 210 and acquires audio data using the microphone 220 as a function of storing images and videos in a container format is executed. can For example, the function may be referred to as a motion photo function. According to an embodiment, the processor 250 may store the video data and audio data obtained by using the camera 210 and the microphone 220 in the buffer in units of frames.

According to an embodiment, the processor 250 may determine an image at a point in time (or frame) at which image capture is requested in response to a user input for capturing an image (eg, taking a photo). Hereinafter, a time point at which capture is requested may be referred to as a capture time point. According to an embodiment, the processor 250 may determine a time point (or frame) corresponding to before or after the first specified time from the time point at which image capture is requested. According to an embodiment, the first specified time (eg, 3 seconds) may include a time preset in the electronic device 201 or a time set based on a user input. According to an embodiment, the processor 250 may specify a location on the buffer based on the determined time point (or frame). According to an embodiment, the processor 250 includes image data corresponding to the image for which capture is requested based on the location on the specified buffer and the first specified time from the time when the capture is requested to the time when the capture is requested (or , video data and audio data corresponding to a moving picture corresponding to a first specified length of time (from a time point at which capture is requested to a time point after the first specified time) may be extracted from the buffer. Hereinafter, the video corresponding to the first specified length of time will be mainly described in the case of a video corresponding to the first specified length of time from the time when the capture of the image is requested to the time when the capture is requested from before the first specified time. , described may be equally or similarly applied to a moving picture corresponding to a first specified length of time from a point in time when capturing of an image is requested to a point in time after the first designated time. According to an embodiment, the processor 250 may store image data, video data, and audio data extracted from the buffer in one file. For example, the processor 250 encodes the extracted image (eg, one image frame) into a JPEG format, and encodes the extracted video data (eg, a plurality of image frames) and audio data into an MP4 format. One image may be included in the image area of the JPEG format, and video data of the MP4 format may be encoded by being included in the metadata area (eg, user data area).

According to an embodiment, the processor 250 stores the image for which capture is requested and the video obtained by using the camera 210 and the microphone 220 from a first specified time before the capture request as a single file. can According to an embodiment, the captured image and the moving picture stored as one file are moving images acquired from the time when the processor 250 acquires the captured image to the time when the captured image is acquired from before a first specified time. can As described above, the processor 250 may buffer video data and audio data obtained by using the camera 210 and the microphone 220 after the motion photo function is executed. According to an embodiment, the processor 250 extracts image data corresponding to the capture time from the buffer, and video data and audio data corresponding to the time points from the first specified time before the capture time to the capture time. It can be saved in one file. For example, the capture time point may be determined as a timer executed by an operating system (eg, the operating system 142 of FIG. 1 ) or may be determined as a timer executed by a camera application, and there is no limitation. According to another embodiment, the processor 250 may extract video data and audio data from a capture point in a specified number of frames. For example, 90 image frames (eg, frames corresponding to 3 seconds in the case of a moving picture having a frame rate of 30 fps) may be extracted as video data from the capture time. Hereinafter, for convenience of description, it will be mainly described that the processor 250 extracts video data and audio data for a specified time.

According to an embodiment, the processor 250 may capture a plurality of images. The processor 250 may generate a plurality of files by capturing a plurality of images. According to an embodiment, the processor 250 may store (or insert) information on the relationship between a plurality of files in a file when each file is created. For example, it can be stored in the metadata area (eg, user data area) in JPEG format. According to another example, the processor 250 may store information on the relationship between a plurality of files in separate data (eg, a file). For example, the separate file may include indexes for a plurality of files and information on relationships between the plurality of files in a table format. Hereinafter, for convenience of description, it will be mainly described that the processor 250 stores information on the relationship between the plurality of files in each of the plurality of files. According to an embodiment, the information indicating the relation between the plurality of files may include information on the relation between the moving pictures included in each of the plurality of files. According to an embodiment, the relevance between moving pictures may mean that the moving pictures are temporally or scenewisely related to each other. According to an embodiment, the information on the relationship between the videos may be referred to as information related to the connection of a plurality of videos (eg, the first video and the second video). According to an embodiment, the processor 250 may connect and play a plurality of videos based on information related to the connection of the plurality of videos. For example, a method for the processor 250 to connect and play a plurality of videos may include loading the plurality of videos into the memory 240 and sequentially playing each video. For another example, the method for the processor 250 to connect and play a plurality of moving images may include generating and playing one moving image by connecting a plurality of moving images (eg, frames included in the plurality of moving images). may be

For example, information related to the linking of a plurality of videos includes information for determining whether videos included in different files are linked and the order in which they are linked, and whether videos included in different files are duplicated and/or a duplicate part is determined It may include at least one of information for According to an embodiment, when a plurality of videos are reproduced, the processor 250 may determine whether to connect a plurality of videos and a connection order based on information related to the connection of the plurality of videos. According to an embodiment, the processor 250 determines whether there is overlap between a plurality of videos based on information related to the connection of the plurality of videos, and if there is a duplicate part (or overlapping section), there is no duplicate part during playback. Multiple videos can be linked and played.

According to an embodiment, the processor 250 may store (or insert) a group ID in the file when the file is created. For example, the group ID may be included in the metadata area (eg, user data area) of the container format. In another embodiment, the motion photo file and the corresponding group ID may be stored in a separate data table (or file), but for convenience of description, the embodiment will be mainly described as an embodiment stored in a container format. According to an embodiment, the group ID may be information for determining whether to link videos included in different files. According to an embodiment, the group ID may be a unique ID (UID). According to an embodiment, the processor 250 may group the files by storing the group ID in the file. According to an embodiment, the processor 250 may identify the group of the file based on the group ID. For example, the processor 250 may identify files storing the same group ID as the same group, and may identify files storing different group IDs as different groups. According to an embodiment, the processor 250 may determine whether to connect the videos included in the plurality of files based on the group ID. For example, the processor 250 may determine to link videos included in files storing the same group ID, and determine not to link videos included in files storing different group IDs. have.

According to an embodiment, after the motion photo function is executed (or in a state in which the motion photo function is executed), the processor 250 stores the captured image within a second specified time from the first time the image is captured. You can store the same group ID as the group ID stored in the file where the first captured image is saved. According to an embodiment, the second specified time may be a threshold value at which the processor 250 determines a plurality of files as the same group, and may be a value preset in the electronic device 201 or set by a user input. . According to an embodiment, the first designated time and the second designated time may be the same or different values. When the first designated time and the second designated time have the same value, one stored setting value may be used. According to an embodiment, the time point at which the image is captured may correspond to the time point at which the captured image is saved as a file together with the moving picture or the time point at which the file is generated. The value at the point in time at which the image is captured may be stored at least temporarily in the memory 240 . For example, the time point at which the image is captured is stored in the memory 240 as a reference value for group ID assignment and is reset when a second specified time elapses, or is updated to the value of the first image capture time after the second specified time elapses. can be According to an embodiment, the processor 250 limits files to which the same group ID is assigned (granted, or inserted) to within a second specified time from the point in time when the first image is captured, so as to The same group ID can be assigned to , and the number of files to which the same group ID is assigned can be limited.

According to an embodiment, when capturing an image, the processor 250 stores the currently captured image in a file in which it is stored based on whether the image is captured within a second specified time from the capturing time of the most recently captured image before the capturing time of the corresponding image. You can store the group ID. For example, when the second image is captured within a second specified time from the first time point at which the first image is captured, the processor 250 may include a group ID stored in a file in which the first image is stored in a file in which the second image is stored, and You can store the same group ID. When the second image is captured after a second specified time has elapsed from the first point in time at which the first image was captured, the processor 250 includes a group ID stored in a file in which the first image is stored in a file in which the second image is stored, and You can store different group IDs. According to one embodiment, the processor 250 assigns a group ID based on whether the currently captured image was captured within a second specified time from the time the most recently captured image was captured prior to the capture of the image, thereby It may be determined whether the video included in the file to be created has temporal connection (or continuity) with the video included in the most recently created file before the creation of the file.

According to various embodiments, the processor 250 may recognize a type of a scene of a video stored together with an image in a file. According to one embodiment, the processor 250 is a type of scene of a video based on an object in the video, motion information (eg, a shooting direction or a shooting angle) of the camera 210 when shooting a video, or sound information of the video can be recognized According to an embodiment, the processor 250 may determine whether the first video stored in the first file has the same scene type as the second video stored in the second file. For example, when objects recognized from the first video and the second video are the same or similar to each other, the processor 250 may determine that the scene types of the first video and the second video are the same. As another example, the processor 250 determines that the objects recognized from the first video and the second video are the same or similar to each other, and that the photographing direction or photographing angle of the camera 210 when the first video and the second video are photographed are similar. Accordingly, it may be determined that the scene types of the first video and the second video are the same. As another example, the processor 250 may determine that the scene types of the first video and the second video are the same as the background music or the speaker recognized from the first video and the second video is determined to be the same.

According to various embodiments, the processor 250 may store the recognized scene type information in a file together with an image and a moving picture. For example, the type information may be stored in a metadata area (eg, a user data area) within the container format of the motion photo file or stored in a separate file. According to an embodiment, the scene type information may refer to information that is a basis for the processor 250 to determine whether the scene types of a plurality of moving pictures are the same. For example, the scene type information may include at least one of object information recognized from a moving image, motion information of the camera 210 when capturing a moving image, or sound information recognized from a moving image. For example, the object information may include at least one of whether an area recognized as a recognized object changes by more than a specified value, a type of a recognized object (eg, a person, a tree), or whether a background is changed. . The motion information of the camera 210 is determined by determining whether the motion of the electronic device 201 detected through at least one motion sensor (eg, a geomagnetic sensor or an acceleration sensor) included in the electronic device 201 is equal to or greater than a threshold value. can be The sound information may include a similarity (eg, a main voice or a background sound) of data input from the microphone 220 of the electronic device 201 .

According to various embodiments, the processor 250 determines that the first video stored in the first file has the same scene type as the second video stored in the second file, so that the first file and the second file have the same group. IDs may be stored, and different group IDs may be stored in the first file and the second file when it is determined that the type of the scene of the first video is not the same as that of the second video. For example, the processor 250 recognizes the type of the scene of the first moving picture stored in the file when the first file is created, and is based on the type information of the scene of the second moving picture stored in the second file created before the first file. Based on this, it may be determined whether to store the same group ID as the group ID stored in the second file in the first file or a different group ID in the first file.

According to an embodiment, the processor 250 may store a sequence number in files storing the same group ID according to a file creation order. According to an embodiment, the sequence number may be information indicating the number of files generated within a group to which the corresponding file belongs. According to an embodiment, the file creation order may correspond to the captured order of images stored in the file. For example, the processor 250 may generate a first file including the first image by capturing the first image at the first time point, and may generate a first file including the first image at a second time point within a second specified time from the first time point. As the second image is captured, a second file including the second image may be generated. In this case, the processor 250 may assign the same group ID to the first file and the second file, and the file in which the first file and the second file have the same group ID as the number of generated files A sequence number indicating recognition may be assigned. For example, the processor 250 inserts the group ID and sequence number into the first file that stores the image first captured at the first time point, and stores the image captured within a second specified time from the first time point. The same group ID as the group ID inserted into the first file may be inserted into the file, and a sequence number increased from the sequence number inserted into the first file may be inserted. According to one embodiment, the processor 250 may increment the sequence number by one each time the newly captured image is incremented by one that satisfies the condition regarding whether the first captured image was captured within a second specified time from the first time point at which the captured image was captured. can be increased by one.

According to various embodiments, the processor 250 may generate a unique identifier by combining the unique number assigned to the electronic device 201 and information on the shooting time of the image or video. The processor 250 may store the unique identifier generated based on the unique number of the electronic device 201 and the photographing time information in a file in place of the aforementioned group ID and sequence number.

According to an embodiment, the processor 250 may store duplicate information in the plurality of files to determine whether or not there is a duplicate between a plurality of moving pictures included in the plurality of files and a duplicate part (or overlapping section). According to an embodiment, when a plurality of moving images are reproduced, the processor 250 may determine whether or not there is overlap between the plurality of moving images and/or overlapping frames based on duplicate information stored in files including each moving image. According to an embodiment, the processor 250 may store duplicate information in a file when a file is created. For example, when generating a file as the image is captured, the processor 250 extracts a video obtained from the first specified time from the time of capturing the image to the time of capturing the image from the buffer, and the video is stored in the buffer. Location information can be stored together with images and videos in a file as redundant information. For example, the location information where the video is stored in the buffer is the first file among at least one file having the same group ID by the processor 250 (eg, the file having the earliest creation time, or the sequence number of the file) When the position at which the beginning of the video included in the smallest file) is stored in the buffer is set to 0, it may indicate the relative position where the currently stored video is stored in the buffer. For example, since the processor 250 stores the video in frame units when storing the video in the buffer, the location of the buffer may correspond to a frame number. For example, location information where a video is stored in the buffer may include frame number information including a start frame number and an end frame number of the corresponding video.

In various embodiments, for convenience of description, it has been described that various information (eg, group ID, sequence number, unique identifier, object information, or duplicate information) is stored in one file together with images and videos, but images and videos It can also be saved in a file separate from the saved file.

According to an embodiment, the processor 250 may display at least one file (or a file list) on the display 230 . For example, the processor 250 may display at least one file (or a list of files) by displaying an image (eg, a thumbnail image) included in the file on the display 230 . According to an embodiment, the processor 250 may receive a user input for selecting one of at least one file (eg, a motion photo file) displayed on the display 230 , and in response to the file selection input, the selected file and You can additionally select other files from the same group. The processor 250 may select files having the same group ID as the group ID stored in the selected file. According to an embodiment, the processor 250 may connect and play a plurality of videos included in a plurality of selected files.

According to an embodiment, the processor 250 may identify the group ID of the first file in response to an input for selecting the first file, and search for a file having the same group ID as the group ID of the first file. According to an embodiment, the processor 250 may arrange the first file and at least one file having the same group ID as the group ID of the first file based on a sequence number stored in each file. For example, the processor 250 may arrange a plurality of files in an increasing sequence number. According to an embodiment, the processor 250 may extract (or separate) a video from a plurality of arranged files. For example, the processor 250 may extract a plurality of moving images by loading the moving images from each of the arranged files into the memory 240 in frame order. According to an embodiment, the processor 250 may generate a playlist in which a plurality of extracted moving pictures are arranged in the order in which files including each moving picture are arranged. According to an embodiment, the playlist may include a plurality of extracted videos, a plurality of frames included in a plurality of videos, or a video generated based on a plurality of frames included in a plurality of videos. can

According to an embodiment, the processor 250 may determine whether a plurality of videos are overlapped based on overlap information included in the plurality of files, and determine the overlapping portion (or overlapping section). For example, the duplicate information may include a start frame number and an end frame number of at least one video. According to an embodiment, the processor 250 may identify overlapping frame numbers between a plurality of moving images. According to an embodiment, the processor 250 may remove overlapping frames between a plurality of videos based on overlapping frame numbers. The processor 250 may generate a playlist including a plurality of videos from which overlapping frames are removed. For example, when the processor 250 removes overlapping frames between a plurality of videos, skipping a frame that overlaps with a video played earlier when a video played later among the plurality of videos is played can mean As another example, when the processor 250 removes overlapping frames between a plurality of moving images, the processor 250 generates one image in which the plurality of moving images are connected and stores the image in the memory 240 . Each frame may be copied from , but overlapping frames between a plurality of moving images may mean copying only once.

According to various embodiments, the processor 250 may insert a designated effect between two consecutive moving images after removing overlapping frames. According to an embodiment, the specified effect may mean an animation effect that connects a frame to a frame. For example, the designated effect may include a transition effect. According to an embodiment, the processor 250 may naturally connect and reproduce the moving images by inserting a specified effect between the moving images having no overlapping portions.

According to an embodiment, the processor 250 may display on the display 230 a user interface (eg, a play button) that connects a plurality of videos to play them as one video. According to an embodiment, the processor 250 may connect and play a plurality of videos in response to a user input for selecting a user interface. According to an embodiment, the processor 250 may play a plurality of videos by connecting them without overlapping parts. For example, the processor 250 may reproduce a plurality of moving pictures in the order in which they are arranged, and when reproducing a moving picture, the processor 250 may play a frame having a larger frame number than a frame number of a moving picture played before the corresponding moving picture. For example, when a video reproduced later among a plurality of videos is reproduced, the processor 250 may skip a frame that overlaps with a video reproduced earlier to play it.

According to an embodiment, the processor 250 may generate and store a video to which the plurality of videos are linked in response to receiving a user input for storing the video played by connecting the plurality of videos.

Although not shown in FIG. 2 , the electronic device 201 may include a communication circuit (not shown) (eg, the communication module 190 of FIG. 1 ). According to one embodiment, the processor 250 uses a communication circuit to communicate with a server (eg, the server 108 of FIG. 1 ) or an external electronic device (eg, the electronic device 102 or 104 of FIG. 1 ) and data. can send and receive According to an embodiment, the processor 250 may transmit one video generated by connecting a plurality of videos included in a plurality of files to an external electronic device or a server.

According to an embodiment, the processor 250 may store the group ID, sequence number, and duplicate information in the metadata area of the file. According to an embodiment, the group ID, sequence number, and duplicate information may correspond to metadata. According to various embodiments, the processor 250 may transmit a plurality of videos and metadata corresponding to each of the plurality of videos to an external electronic device or a server. According to various embodiments, the external electronic device may connect and reproduce the plurality of videos by itself based on the plurality of videos received from the electronic device 201 or the server and metadata thereof. According to various embodiments, the external electronic device may change the metadata based on the plurality of videos received from the electronic device 201 or the server and the metadata. For example, the electronic device determines the group ID based on the time at which the video is captured, but the external electronic device may determine the group ID based on the type of scene of the video. According to various embodiments, the external electronic device may connect and play at least some of the plurality of videos received from the server 201 or the electronic device based on the changed metadata.

Hereinafter, an operation of an electronic device according to an exemplary embodiment will be described with reference to FIG. 3 .

3 is a flowchart 300 illustrating an operation of an electronic device according to an exemplary embodiment. Operations of the electronic device (eg, the electronic device 201 of FIG. 2 ) described below may be performed by a processor (eg, the processor 250 of FIG. 2 ) of the electronic device.

In operation 301, the electronic device may acquire a plurality of images including a first image and a second image. According to an embodiment, the electronic device may acquire a plurality of images including the first image and the second image by using a camera (eg, the camera 210 of FIG. 2 ). According to an embodiment, the operation of the electronic device acquiring the image may include the operation of capturing the image in response to a user input. According to an embodiment, the electronic device may capture an image (eg, a first image or a second image) in response to receiving a user input for capturing the image. For example, the electronic device may acquire a first image upon receiving a user input for capturing an image at a first time point, and obtain a second image upon receiving a user input for capturing an image at a second time point. can According to an embodiment, as the motion photo function is executed, the electronic device may buffer video data and audio data obtained using a camera and a microphone (eg, the microphone 220 of FIG. 2 ). According to an embodiment, the video data may include image data corresponding to each frame. According to an embodiment, the electronic device may acquire an image of a frame corresponding to an image capture point in response to receiving a user input for capturing an image. For example, the electronic device may acquire an image of a frame corresponding to a first viewpoint as a first image and acquire an image of a frame corresponding to a second viewpoint as a second image.

For convenience, the operation of acquiring the first image and the operation of acquiring the second image have been described as integrated into operation 301, but the present invention is not limited thereto, and the operation of acquiring the first image and acquiring the second image are separately performed can be performed. According to an embodiment, the electronic device may perform operation 303 after acquiring the first image, and perform operation 305 after acquiring the second image.

In operation 303, the electronic device may store the first moving picture acquired before the first specified time from the first time point at which the first image is acquired as a first file together with the first image. According to an embodiment, the first time point may be a time point at which the electronic device captures the first image in response to a user input. According to an embodiment, the first designated time may include a time preset in the electronic device or a time set based on a user input. According to an embodiment, the electronic device may extract video data and audio data corresponding to a moving picture acquired from the first time point before the first specified time to the first time point from the buffer. For example, when the first designated time is 3 seconds, the electronic device may obtain a 3 second-long video obtained from a time point 3 seconds before the first time point to the first time point from the buffer. According to an embodiment, the first image may be an image corresponding to the last frame (or end frame) of the moving picture. According to an embodiment, the electronic device may store the first image and the first video in one file. According to an embodiment, the first file may be a file in a container format.

In operation 305, the electronic device may store the second video acquired before the first specified time from the second time point at which the second image is acquired as a second file together with the second image. According to an embodiment, the second time point may be a time point at which the electronic device captures the second image in response to a user input. According to an embodiment, the electronic device may extract video data and audio data corresponding to a moving picture acquired from the second time point before the first specified time to the second time point from the buffer. For example, when the first designated time is 3 seconds, the electronic device may acquire a video having a length of 3 seconds obtained from a time point 3 seconds before the second time point to the second time point. According to an embodiment, the second image may be an image corresponding to the last frame (or end frame) of the video. According to an embodiment, the electronic device may store the second image and the second video in one file. According to an embodiment, the second file may be a file in a container format.

Although not shown in FIG. 3 , when the electronic device generates the first file and the second file, the first video and the second video included in the first file and the second file in the metadata area of the first file and the second file It is possible to store information for determining whether videos are connected and the order in which they are connected. According to an embodiment, the information for determining whether to connect the first video and the second video may include group IDs stored in the first file and the second file. According to an embodiment, the information for determining the connection order of the first video and the second video may include sequence numbers stored in the first file and the second file.

According to an embodiment, the electronic device may determine whether the interval between the first time point and the second time point is less than a specified threshold value. According to an embodiment, the specified threshold value may be a value indicating time. As it is determined that the interval between the first time point and the second time point is less than a specified threshold value (eg, 30 seconds), the electronic device may store the same group ID in the first file and the second file. The electronic device may store different group IDs in the first file and the second file as it is determined that the interval between the first time point and the second time point is equal to or greater than a specified threshold value.

According to an embodiment, the electronic device may recognize the types of scenes of the first video and the second video. For example, the electronic device may recognize the type of scene based on at least one of object information recognized from a moving picture, camera movement information when capturing a moving picture, and sound information recognized from a moving picture. According to an embodiment, as the first video and the second video are recognized as the same type of scene, the electronic device may store the same group ID in the first file and the second file. Since the first video and the second video are not recognized as the same type of scene, the electronic device may store different group IDs in the first file and the second file.

According to an embodiment, the electronic device may store the sequence number in the first file and the second file in which the same group ID is stored according to the time order of the first time point and the second time point. For example, when the first time point precedes the second time point, the electronic device may store a sequence number increased from the sequence number stored in the first file in the second file. According to an exemplary embodiment, an operation of the electronic device inserting a group ID and a sequence number into the first file and the second file will be described below with reference to FIGS. 4 and 5 .

Although not shown in FIG. 3 , in the metadata area of the first file and the second file, the electronic device determines whether the first video and the second video included in the first file and the second file overlap and the overlapping part (or overlapping part) section) may be stored. According to an embodiment, the information for determining whether the first video and the second video overlap and the overlapping portion may include redundant information stored in the first file and the second file. According to an embodiment, the duplicate information may include information indicating a location in which the electronic device acquires the first video and the second video and temporarily stores it. For example, the duplicate information may include location information of a buffer in which video data and audio data corresponding to the first video and the second video are stored. According to an embodiment, the electronic device may store video data and audio data in a buffer in units of frames, and may number each frame according to a storage order. According to an embodiment, location information of the buffer may correspond to frame number information. For example, the duplicate information may be frame number information including a start frame number and an end frame number of video data and audio data corresponding to each moving picture. An embodiment in which the electronic device stores duplicate information in a file according to an embodiment will be described below with reference to FIG. 6 .

A structure of a file generated by an electronic device storing an image together with a moving picture as one file according to an exemplary embodiment will be described below with reference to FIG. 7 .

In operation 307, the electronic device may connect and play the first video and the second video. According to an embodiment, the electronic device may connect and play the first video and the second video based on information related to the connection of the first video and the second video. According to an embodiment, the electronic device may determine that the first video and the second video are related to each other when the first video and the second video are videos captured in the same time zone or are recognized as the same scene type. According to an embodiment, the information related to the connection of the first video and the second video may include information for determining whether the first video and the second video are connected and the connection order, or whether the first video and the second video overlap. And it may include at least one of information for determining the overlapping portion (or overlapping section).

According to an embodiment, the electronic device may determine whether to connect the first video and the second video based on the group ID stored in the first file and the second file. For example, when the group ID stored in the first file is the same as the group ID stored in the second file, the electronic device may additionally select the second file in response to an input for selecting the first file, and include the first video and It may be decided to connect and play the second video.

According to an embodiment, the electronic device may determine a connection order of the first video and the second video based on sequence numbers stored in the first file and the second file. According to an embodiment, the electronic device may determine to arrange the first video and the second video according to the increasing sequence of the sequence number, and to connect the first video and the second video according to the arrangement order. For example, when the sequence number stored in the first file is smaller than the sequence number stored in the second file, the electronic device may determine to play the first video before the second video.

According to an embodiment, the electronic device may determine whether the first video and the second video overlap based on overlap information stored in the first file and the second file. For example, when the frame numbers of the first video and the second video overlap, it may be determined that the first video and the second video overlap. According to an embodiment, when it is determined that the first video and the second video overlap, the overlapping portions of the first video and the second video may be removed and reproduced. For example, when the start frame number of the first video is 0, the end frame number is 130, the start frame number of the second video is 70, and the end frame number is 220, the electronic device plays the first video Afterwards, the second video may be played from the frame having the frame number 131 . According to an embodiment, when it is determined that the first video and the second video do not overlap, a specified effect may be inserted between the first video and the second video to be played. For example, when the start frame number of the first video is 0, the end frame number is 130, the start frame number of the second video is 135, and the end frame number is 220, the electronic device plays the first video After that, a screen corresponding to the specified effect may be output, and the second video may be continuously played.

According to an embodiment, the electronic device may receive a user input for selecting a first file from among at least one file displayed on a display (eg, the display 230 of FIG. 2 ). The electronic device may additionally select the second file based on the first file and information related to the connection of the first video and the second video stored in the second file. For example, the electronic device may additionally select a second file in which the same group ID as the group ID stored in the first file is stored.

According to an embodiment, the electronic device arranges the first file and the second file according to sequence numbers stored in the first file and the second file, and extracts the first video and the second video from the first file and the second file (or separate), and a user interface for connecting and playing the first video and the second video according to the arrangement order of the first file and the second file may be displayed on the display. For example, the user interface may include a play button.

According to an embodiment, in response to receiving a user input for selecting a user interface, the electronic device may connect and play the first video and the second video. Since the operation of connecting and reproducing the first video and the second video by the electronic device according to an exemplary embodiment has been described above, the redundant description will be omitted or simplified.

Although not shown in FIG. 3 , the electronic device generates a third video in which the first video and the second video are connected in response to a user input for storing the reproduced first video and the second video, and the third video can be saved.

Hereinafter, an operation of inserting a group ID and a sequence number into a file by the electronic device according to an exemplary embodiment will be described with reference to FIG. 4 .

4 is a flowchart 400 illustrating an operation of an electronic device according to an exemplary embodiment. Operations of the electronic device (eg, the electronic device 201 of FIG. 2 ) described below may be performed by a processor (eg, the processor 250 of FIG. 2 ) of the electronic device.

According to an embodiment, the electronic device may be in a state in which a motion photo function is being executed. According to an embodiment, the electronic device may buffer video data and audio data obtained by using a camera (eg, the camera 210 of FIG. 2 ) and a microphone (eg, the microphone 220 of FIG. 2 ). According to an embodiment, the video data may include image data corresponding to each frame.

In operation 401, the electronic device may capture a first image at a first time point. According to an embodiment, the electronic device may acquire an image of a frame corresponding to an image capture point in response to receiving a user input for capturing an image. According to an embodiment, the operation of capturing an image may mean taking a photo.

In operation 403, the electronic device may store the first video acquired from the first time point before the first specified time as a first file together with the first image. According to an embodiment, the first designated time may include a time preset in the electronic device or a time set based on a user input. According to an embodiment, the electronic device may extract video data and audio data corresponding to a moving picture acquired from the first time point before the first specified time to the first time point from the buffer. For example, when the first designated time is 3 seconds, the electronic device may obtain a 3-second video obtained from a time point 3 seconds before the first time point to the first time point from the buffer. According to an embodiment, the electronic device may store the first image and the first video in one first file. According to an embodiment, the first file may be a file in a container format.

In operation 405, the electronic device may determine whether the first image is the first image captured after the camera is executed. According to an embodiment, the operation of the electronic device executing the camera may include the operation of the electronic device executing the motion photo function. For example, when a user executes a motion photo function of a camera application and then performs an input for first taking a photo, the electronic device may capture an image for the first time after running the camera in response to the input. According to an embodiment, as it is determined that the first image is the first image captured while the motion photo function is executed (operation 405 - YES), the electronic device may perform operation 407 , and the first image may display the motion photo function In this execution state, as it is determined that the image is not the first captured image (operation 405 - NO), operation 409 may be performed.

In operation 407, the electronic device may insert the group ID and sequence number into the first file. According to an embodiment, the electronic device may insert a unique ID (UID) for identifying a group to which the file belongs to the first file. According to an embodiment, the electronic device may insert into the first file a sequence number indicating that the first file is a file that is first created in a group to which it belongs. According to an embodiment, the creation order of the file may correspond to the capturing order of images stored in the file. According to an embodiment, the electronic device may store the group ID and the sequence number in the metadata area of the first file.

In operation 409, the electronic device may determine whether an interval between the first time point and a second time point that is a second image capture point before the first time point is less than a specified threshold value. According to an embodiment, the second image includes an image stored in a file first created in a group to which a file created by the electronic device before the first time point belongs, or an image most recently captured by the electronic device before the first time point can do. According to an embodiment, the specified threshold value may be a value indicating time. According to an embodiment, the specified threshold value may be preset in the electronic device or may be set based on a user input. For example, when the specified threshold value is 1 minute, when the first time point is within 1 minute from the second time point, the electronic device may determine that the interval between the first time point and the second time point is less than the specified threshold value, When the time point is a time point after 1 minute has elapsed from the second time point, it may be determined that the interval between the first time point and the second time point is not less than a specified threshold value. According to an embodiment, when it is determined that the interval between the first time point and the second time point before the first time point is less than a specified threshold value (operation 409 - YES), the electronic device performs operation 411, and the first time point and the first time point As it is determined that the interval of the second time point before the time point is not less than the specified threshold (operation 409 - NO), operation 413 may be performed.

In operation 411, the electronic device inserts the same group ID into the first file and increases the sequence number to insert it. According to an embodiment, the electronic device may insert the same group ID as the group ID inserted into the second file in which the second image is stored into the first file. According to an embodiment, the electronic device may increase the sequence number by one whenever the number of files satisfying the specified condition increases by one. According to an embodiment, the specified condition is that an image (eg, a second image) stored in a file (eg, a second file) first generated in a group to which a file generated before the first time and the first time is included is captured. It may include whether the interval between time points (eg, the second time point) is less than a specified threshold value. According to an embodiment, the electronic device may insert the increased sequence number into the first file.

In operation 413, the electronic device may change and insert the group ID into the first file and insert the sequence number. According to an embodiment, the electronic device may insert a group ID different from the group ID inserted into the second file in which the second image is stored into the first file. According to an embodiment, the electronic device may be the first file created in the group to which the first file belongs. The electronic device may insert into the first file a sequence number indicating that the first file is a file that is first created in a group to which it belongs.

Hereinafter, an operation of inserting a group ID and a sequence number into a file by an electronic device according to various embodiments will be described with reference to FIG. 5 .

5 is a flowchart 500 illustrating an operation of an electronic device according to an exemplary embodiment. Operations of the electronic device (eg, the electronic device 201 of FIG. 2 ) described below may be performed by a processor (eg, the processor 250 of FIG. 2 ) of the electronic device.

According to an embodiment, the electronic device may be in a state in which a motion photo function is being executed. According to an embodiment, the electronic device may buffer video data and audio data obtained by using a camera (eg, the camera 210 of FIG. 2 ) and a microphone (eg, the microphone 220 of FIG. 2 ). According to an embodiment, the video data may include image data corresponding to each frame.

In operation 501, the electronic device may capture a first image at a first time point. According to an embodiment, operation 501 may correspond to operation 401 of FIG. 4 , and the above description for operation 401 may be equally applied.

In operation 503, the electronic device may store the first video acquired from the first time point before the first specified time as a first file together with the first image. According to an embodiment, operation 503 may correspond to operation 403 of FIG. 4 , and the above description for operation 403 may be equally applied.

In operation 505, the electronic device may recognize the type of the scene of the first video. According to an embodiment, the electronic device selects the type of the scene of the video based on the object in the first video, motion information of the camera when the first video is captured (eg, a shooting direction or a shooting angle), or sound information of the video. can recognize

In operation 507, the electronic device may determine whether the scene type of the first video is the same as that of the second video acquired from the second point of view before the first point of time before the first specified time. For example, when objects recognized from the first video and the second video are the same, the electronic device may determine that the scene types of the first video and the second video are the same. As another example, in the electronic device, when it is determined that objects recognized from the first moving image and the second moving image are the same, and that the shooting directions or shooting angles of the cameras when the first moving image and the second moving image are captured are similar, the first moving image and the second moving image are similar. 2 It can be determined that the types of scenes in the video are the same. As another example, the electronic device may determine that the scene types of the first video and the second video are the same as the background music recognized from the first video and the second video or the speaker is the same.

According to an embodiment, the electronic device performs operation 509 as it is determined that the scene types of the first moving image and the second moving image are the same (operation 507 - YES), and the types of the scenes of the first moving image and the second moving image are determined to be the same. As it is determined to be the same (operation 507-NO), operation 511 may be performed.

In operation 509, the electronic device inserts the same group ID into the first file and increases the sequence number to insert it. According to an embodiment, the electronic device may insert the same group ID as the group ID inserted into the second file in which the second video is stored into the first file. According to an embodiment, the electronic device may increase the sequence number by one whenever the number of files satisfying the specified condition increases by one. According to an embodiment, the specified condition may include whether the scene type of the first video and the video (eg, second video) stored in a file (eg, second file) generated before the first time point is the same. can According to an embodiment, the electronic device may insert the increased sequence number into the first file.

In operation 511, the electronic device may change and insert the group ID into the first file and insert the sequence number. According to an embodiment, the electronic device may insert a group ID different from the group ID inserted into the second file in which the second video is stored into the first file. According to an embodiment, the electronic device may be the first file created in the group to which the first file belongs. The electronic device may insert into the first file a sequence number indicating that the first file is a file that is first created in a group to which it belongs.

Hereinafter, an operation in which the electronic device stores duplicate information in a file according to an exemplary embodiment will be described with reference to FIG. 6 .

6 is a diagram 600 for explaining an operation of an electronic device according to an exemplary embodiment. Operations of the electronic device (eg, the electronic device 201 of FIG. 2 ) described below may be performed by a processor (eg, the processor 250 of FIG. 2 ) of the electronic device.

According to an embodiment, the electronic device may be in a state in which a motion photo function is being executed. According to an embodiment, the electronic device stores video data and audio data obtained using a camera (eg, the camera 210 of FIG. 2 ) and a microphone (eg, the microphone 220 of FIG. 2 ) in a buffer. can be saved For example, the buffer may be a ring buffer.

According to an embodiment, the electronic device may generate a first file by first capturing an image after executing the motion photo function, and may generate a group ID and store the group ID in the first file. According to an embodiment, the electronic device may reset the frame numbers of the first video frame and the first audio frame of the moving picture stored in the first file to 0. According to an embodiment, since the electronic device sequentially stores audio data and video data in frame units in a buffer, each frame may be numbered according to the sequentially stored order.

6 illustrates audio data and video data stored in a buffer of an electronic device in a bar form according to an embodiment, and the X axis may mean a time axis or a frame axis. The length of the bar corresponding to the audio data and the video data shown in FIG. 6 may correspond to a time length or a frame length. For example, the length of the X-axis shown in FIG. 6 may be a threshold value preset in the electronic device. According to an embodiment, the threshold value may be a reference value for the electronic device to determine a plurality of files or a plurality of videos as the same group. According to an embodiment, a number such as 100, 200, or 300 shown under the X-axis may mean a frame number numbered by the electronic device in the audio frame and the video frame.

According to an embodiment, as the first image is captured at the first time point, the electronic device may store the first video 610 acquired from the first time point before a first specified time in the first file together with the first image. have. According to an embodiment, the electronic device may reset the frame numbers of the first audio frame and the video frame of the first moving picture 610 to 0 according to the first image being the first image captured after the motion photo function is executed. According to an embodiment, the electronic device may store duplicate information ([0, 130]) including the start frame number (0) and the end frame number 130 of the first video in the first file. According to an embodiment, the first image may correspond to a frame to which a frame number 130 is assigned among the frames of the first video.

According to an embodiment, as the second image is captured at the second time point, the electronic device may store the second video 620 acquired from the second time point before the first specified time in the second file together with the second image. have. According to an embodiment, when it is determined that the interval between the second time point and the first time point is less than a specified threshold value, the electronic device may store the same group ID as the group ID stored in the first file in the second file. According to an embodiment, the electronic device may store duplicate information ([70, 220]) including the start frame number 70 and the end frame number 220 of the second video in the second file. According to an embodiment, the second image may correspond to a frame to which a frame number 220 is assigned among the frames of the second video.

According to an embodiment, as the third image is captured at the third time point, the electronic device may store the third video 630 acquired before the first specified time from the third time point in the third file together with the third image. have. According to an embodiment, when it is determined that the interval between the third time point and the first time point is less than a specified threshold value, the electronic device may store the same group ID as the group ID stored in the first file in the third file. According to an embodiment, the electronic device may store duplicate information ([200, 330]) including the start frame number 200 and the end frame number 330 of the third video in the third file. According to an embodiment, the third image may correspond to a frame to which a frame number of 330 is assigned among frames of the third video.

According to an embodiment, as the fourth image is captured at the fourth time point, the electronic device may store the fourth video 640 acquired before the first specified time from the fourth time point in the fourth file together with the fourth image. have. According to an embodiment, when it is determined that the interval between the fourth time point and the first time point is less than a specified threshold value, the electronic device may store the same group ID as the group ID stored in the first file in the fourth file. According to an embodiment, the electronic device may store duplicate information ([300, 420]) including the start frame number 300 and the end frame number 420 of the fourth video in the fourth file. According to an embodiment, the fourth image may correspond to a frame to which a frame number of 420 is assigned among frames of the fourth video.

According to an embodiment, the electronic device stores duplicate information in the first file to the fourth file to determine whether or not there is a duplicate between the first file to the fourth file and a duplicate part (or a duplicate section) based on the duplicate information. can For example, the electronic device may identify that the first video and the second video overlap from a frame having a frame number of 70 to a frame having a frame number of 130 based on overlap information of the first file and the second file. According to an embodiment, when the first video and the second video are connected and played, the electronic device plays the first video from frame number 0 to frame number 130, and then plays the second video from frame number 131 to frame number 220 can be played up to

Hereinafter, a structure of a file generated by an electronic device storing an image together with a moving picture as one file according to an exemplary embodiment will be described with reference to FIG. 7 .

7 is a diagram 700 illustrating a structure of a file generated by an electronic device according to an exemplary embodiment. Operations of the electronic device (eg, the electronic device 201 of FIG. 2 ) described below may be performed by a processor (eg, the processor 250 of FIG. 2 ) of the electronic device.

According to an embodiment, the electronic device may create one file 701 in which an image and a moving picture are stored together. According to an embodiment, the file 701 is a container format, and may store different types of data and metadata together.

Referring to FIG. 7 , for example, the file 701 may include video data 710 and image data 720 . According to an embodiment, the video data 710 may be data including both an image and an audio. According to an embodiment, the file 701 may include metadata 730 .

According to an embodiment, the metadata 730 includes a group ID (Group ID) 731 for determining whether to connect the video data 710 included in the file 701 with the video data included in another file. can do. According to an embodiment, based on the group ID 731 , the electronic device includes whether the file 701 and the other file belong to the same group, or the video data 710 included in the file 701 is different from the file 701 . You can decide whether to play the video data by concatenating it.

According to an embodiment, the metadata 730 includes a sequence number 732 for determining a concatenation order of the video data 710 included in the file 701 and the video data included in another file. can do. According to an embodiment, the electronic device may identify the number of the file 701 in the group to which the file 701 belongs, based on the sequence number 732 . According to an embodiment, when the electronic device connects and plays the video data 710 included in the file 701 with the video data included in another file in the group to which the file 701 belongs based on the sequence number 732, You can determine the connection order or playback order of

According to an embodiment, the metadata 730 includes duplicate information for determining whether there is a duplicate between the video data 710 included in the file 701 and the video data included in another file, and a duplicate part (or overlapping section). may include. According to an embodiment, the redundancy information may include video redundancy information 733 and audio redundancy information 734 . According to an embodiment, the electronic device may store the video data 710 in a buffer in units of frames, and may number each frame according to the storage order. According to an embodiment, the video redundancy information 733 may include location information in which the image data of the video data 710 is stored in a buffer, and the audio redundancy information 734 includes the audio data of the video data 710 in the buffer. It may include location information stored in the . For example, the video redundancy information 734 may include frame number information including a start frame number and an end frame number of the image data of the video data 710 , and the audio redundancy information 734 may include the video data 710 . ) may include frame number information including a start frame number and an end frame number of the voice data. For example, the electronic device determines whether there is a duplicate frame of the video data 710 included in the file 701 and the video data included in another file based on the video redundancy information 733 and the audio redundancy information 734 ; A duplicate frame number can be determined.

According to an embodiment, the electronic device may manage a plurality of files stored in the electronic device including the file 701 based on the metadata 730 . For example, the electronic device may copy, delete, or transmit at least one data (eg, image data) included in a plurality of files having the same group ID at once. According to an embodiment, the transmission may include transmission by the electronic device to an external electronic device communicatively connected to the electronic device.

Hereinafter, an operation in which an electronic device connects and reproduces a plurality of videos included in a plurality of files according to an embodiment will be described with reference to FIG. 8 .

8 is a flowchart 800 illustrating an operation of an electronic device according to an exemplary embodiment. Operations of the electronic device (eg, the electronic device 201 of FIG. 2 ) described below may be performed by a processor (eg, the processor 250 of FIG. 2 ) of the electronic device.

According to an embodiment, the electronic device may display at least one file on a display (eg, the display 230 of FIG. 2 ). For example, the electronic device may arrange and display images included in at least one file in a specified form through an application (eg, a gallery application) for viewing images and videos stored in the electronic device. According to an embodiment, the electronic device may perform the operations illustrated in FIG. 8 while displaying at least one file on the display.

In operation 801, the electronic device may receive an input for selecting a first file. According to an embodiment, the electronic device may receive an input for selecting an image representing the first file displayed on the display. For example, the input for selecting the first file may include a touch input for an image representing the first file or a voice input for referring to an image representing the first file.

In operation 803, the electronic device may identify the group ID of the first file. According to an embodiment, in response to receiving an input for selecting the first file, the electronic device may identify the group ID stored in the first file.

In operation 805, the electronic device may select the second file having the identified group ID. According to an embodiment, the electronic device may search for a second file in which a group ID identical to the identified group ID is stored from the first file. According to an embodiment, the electronic device may select the first file in response to receiving an input for selecting the first file, and may additionally select a second file having a group ID identified from the first file. According to an embodiment, even when receiving only an input for selecting the first file, the electronic device may designate (or select) the first file and files other than the first file belonging to the same group as the first file.

According to an embodiment, the electronic device may create a playlist including moving pictures included in the selected first file and the second file. According to an embodiment, the electronic device may determine the playback order of moving pictures included in each file based on sequence numbers stored in the first file and the second file.

In operation 807, the electronic device may determine whether a duplicate exists between the first video stored in the first file and the second video stored in the second file. According to an embodiment, the electronic device may determine whether the first video and the second video overlap and the overlapping portion (or overlapping section) based on the overlapping information stored in the first file and the overlapping information stored in the second file. have. According to an embodiment, since the method of determining whether or not overlapping videos stored in each of the plurality of files are overlapped and the overlapping portion based on the overlap information stored in the plurality of files by the electronic device has been described above, the redundant description will be omitted or simplified. According to an embodiment, the electronic device performs operation 811 as it is determined that there is a duplicate between the first video stored in the first file and the second video stored in the second file (operation 809 - YES), and the electronic device As it is determined that there is no overlap between the first video stored in the first file and the second video stored in the second file (operation 809 - NO), operation 809 may be performed.

In operation 809, the electronic device may insert a transition (or transition) effect between the first video and the second video. For example, as it is determined that there is no overlap between the first video and the second video, the electronic device converts between the last frame of the first video and the first frame of the second video for a natural connection between the first video and the second video Effects can be inserted. According to an embodiment, the transformation effect may be an animation effect that connects frames to frames.

In operation 811, the electronic device may remove overlapping frames of the first video and the second video. For example, as it is determined that there is overlap between the first video and the second video, the electronic device identifies overlapping frames of the first video and the second video, and overlaps frames of the second video after the last frame of the first video It can be set to play from the frame after the frame.

In operation 813, the electronic device may connect and play the first video and the second video. According to an embodiment, the electronic device may connect and play the first video and the second video as if they were one video. For example, when playing by connecting a first video and a second video having overlapping sections, the electronic device may play the second video from a frame after the overlapping frame after the first video is reproduced. When the second video is reproduced after the first video is reproduced, the electronic device may reproduce a frame corresponding to a frame number greater than the frame number of the last frame of the first video first. As another example, when the first video and the second video having no overlapping section are connected and played, the electronic device may play the second video after outputting a conversion effect inserted after the first video is played.

In the above-described embodiment, the case in which the electronic device receives a user input for selecting one file is taken as an example, but the present invention is not limited thereto, and the electronic device may receive a user input for selecting a plurality of files, or Videos included in each of a plurality of files may be linked and played.

Hereinafter, an operation in which an electronic device connects and reproduces a plurality of videos included in a plurality of files according to an embodiment will be described with reference to FIG. 9 .

9 is a diagram 900 for explaining an operation of an electronic device according to an exemplary embodiment. Operations of the electronic device (eg, the electronic device 201 of FIG. 2 ) described below may be performed by a processor (eg, the processor 250 of FIG. 2 ) of the electronic device.

According to an embodiment, when the electronic device receives an input for selecting the first file, the second file, the third file, the fourth file, and the fifth file, the first video 901 included in the first file; The second video 902 included in the second file, the third video 903 included in the third file, the fourth video 904 included in the fourth file, and the fifth video included in the fifth file ( 905) can be created. According to an embodiment, the input for selecting the first file, the second file, the third file, the fourth file, and the fifth file is the first file, the second file, the third file, the fourth file, or the third file. may include an input for selecting one of the five files, and the electronic device selects a file having the same group ID as the selected one of the first file, the second file, the third file, the fourth file, and the fifth file. In addition, the first file, the second file, the third file, the fourth file, and the fifth file may be selected by additional selection.

According to an embodiment, the electronic device performs a first video 901, a second video 902, A third video 903 , a fourth video 904 , and a fifth video 905 may be arranged. For example, the electronic device assigns the first video 901 , the second video 902 , the third video 903 , the fourth video 904 , and the fifth video 905 to a sequence number corresponding to each video. can be arranged in increasing order.

According to an embodiment, the electronic device performs a first video 901, a second video 902, Whether the third video 903 , the fourth video 904 , and the fifth video 905 overlap and the overlapping section may be identified. For example, the electronic device uses a first overlapping section 921 that is an overlapping section of the second video 902 and the third video 903 , and a third overlapping section of the third video 903 and the fourth video 904 . A third overlapping section 923 that is an overlapping section of the second overlapping section 922 , the fourth video 904 , and the fifth video 905 may be identified. According to an embodiment, the overlapping section may correspond to a frame overlapping between a plurality of videos.

According to an embodiment, the electronic device may remove the first overlapping section 921 , the second overlapping section 922 , and the third overlapping section 923 . For example, in the playlist, the electronic device excludes the first overlapping section 921 of the frames of the third video 903 and excluding the second overlapping section 922 of the frames of the fourth video 904, Among the frames of the fifth video 905 , the third overlapping section 923 may be excluded.

According to an embodiment, as it is identified that there is no overlap between the first video 901 and the second video 902 , the electronic device inserts a specified animation effect between the first video 901 and the second video 902 . can do. For example, the electronic device may insert the first animation effect 915 between the last frame of the first video 901 and the first frame of the second video 902 in the playlist.

According to an embodiment, the electronic device receives an input for playing the first video 901 , the second video 902 , the third video 903 , the fourth video 904 , and the fifth video 905 . The first video 901 , the second video 902 , the third video 903 , the fourth video 904 , and the fifth video 905 may be connected and played according to the playlist generated upon reception. . According to an embodiment, the electronic device combines the reproduced first video 901 , the second video 902 , the third video 903 , the fourth video 904 , and the fifth video 905 as one video. As a user input for saving as It is possible to create and store a video 930 connected to .

Hereinafter, a user interface provided by an electronic device according to an embodiment will be described with reference to FIG. 10 .

10 is a diagram 1000 illustrating a user interface provided by an electronic device according to an exemplary embodiment. Operations of the electronic device 1001 (eg, the electronic device 201 of FIG. 2 ) described below may be performed by a processor (eg, the processor 250 of FIG. 2 ) of the electronic device 1001 . The first screen S1 , the second screen S2 , and the third screen S3 are the user displayed by the electronic device 1001 on the display of the electronic device 1001 (eg, the display 230 of FIG. 2 ). It can represent an interface.

Referring to the first screen S1 , the electronic device 1001 may display at least one file on the display. According to an embodiment, each of the at least one file may include a group ID (eg, ID1 or ID2). According to an embodiment, the electronic device 1001 may receive an input for selecting the first file 1010 . For example, the input for selecting the first file 1010 may include a touch input (eg, a long press) for a display area in which the first file 1010 is displayed.

Referring to the second screen S2 , when the electronic device 1001 receives an input for selecting the first file 1010 , the electronic device 1001 has the same group ID as the group ID (eg, ID1) of the first file 1010 . Additional files can be selected. According to an embodiment, the electronic device 1001 may display the first user interface 1020 (eg, a play button) for playing back moving pictures included in the selected files. According to an embodiment, the electronic device 1001 may receive an input for selecting the first user interface 1020 . For example, an input for selecting the first user interface 1020 may include a touch input (eg, a tap) for the first user interface 1020 .

Referring to the third screen S3 , the electronic device 1001 may connect and play videos included in the selected files. According to an exemplary embodiment, the method described above with reference to FIG. 8 may be applied to a method for the electronic device 1001 to connect and play a moving picture included in the selected files.

According to an embodiment disclosed in this document, an electronic device (eg, the electronic device 101 of FIG. 1 , or the electronic device 201 of FIG. 2 ) includes a camera (eg, the camera module 180 of FIG. 1 ); or the camera 210 of FIG. 2 ), a microphone (eg, the input module 150 of FIG. 1 , or the microphone 220 of FIG. 2 ), a display (eg, the display module 160 of FIG. 1 , or of FIG. 2 ). display 230), a memory (eg, memory 130 of FIG. 1, or memory 240 of FIG. 2), and a processor operatively coupled with the camera, the microphone, the display and the memory (eg, FIG. 1 , or processor 250 of FIG. 2 ), wherein the memory, when executed, causes the processor to use the camera to generate a plurality of images including a first image and a second image. is obtained, and a first moving picture acquired using the camera and the microphone from a first specified time before a first specified time from the first time point at which the first image is acquired is stored as a first file together with the first image, A second video acquired using the camera and the microphone from a second time point at which the second image is acquired before the first specified time is stored as a second file together with the second image, and the first video and the second video are stored. One or more instructions for linking and playing the first video and the second video based on information related to the connection of two videos may be stored.

According to an embodiment disclosed in this document, the instructions, the processor determines whether the interval between the first time point and the second time point is less than a specified threshold value, the first time point and the second time point When it is determined that the interval of ' is less than the specified threshold value, the same group ID may be stored in the first file and the second file.

According to an embodiment disclosed in this document, the instructions are sequenced by the processor according to the time sequence of the first time point and the second time point in the first file and the second file in which the same group ID is stored. You can save the number.

According to an embodiment disclosed in this document, the instructions are such that the processor stores duplicate information for determining whether the first video and the second video overlap in the first file and the second file. and, the duplicate information may include information indicating a location where the processor obtains and temporarily stores the first and second moving images.

According to an embodiment disclosed in this document, in the instructions, the processor determines whether to connect the first video and the second video based on the group ID, and the first video and the second video When it is determined to connect , the first video and the second video may be arranged based on the sequence number, and the first video and the second video may be connected according to the arrangement order.

According to an embodiment disclosed in this document, in the instructions, the processor determines whether the first video and the second video overlap based on the overlap information, and the first video and the second video When it is determined that the images overlap, the overlapping portions of the first video and the second video may be removed to be reproduced.

According to an embodiment disclosed in this document, the instructions insert a specified effect between the first video and the second video as the processor determines that the first video and the second video do not overlap. so you can play it.

According to an embodiment disclosed in this document, the instructions, the processor receives a user input for selecting the first file from among at least one file displayed on the display, the first file and the second file A user interface for further selecting the second file based on the information related to the connection of the first video and the second video stored in the display, and connecting the first video and the second video to play. display, receive a user input for selecting the user interface, and connect and play the first video and the second video.

According to one embodiment disclosed in this document, the instructions, when the processor receives a user input for storing the reproduced first video and the second video, the first video and the second video A connected third video may be created and the third video may be stored.

According to an embodiment disclosed in this document, in the instructions, the processor recognizes the types of scenes of the first video and the second video, and the first video and the second video are of the same type. As recognized as , the same group ID may be stored in the first file and the second file.

According to an embodiment disclosed in this document, a method of operating an electronic device (eg, the electronic device 101 of FIG. 1 or the electronic device 201 of FIG. 2 ) may include a camera of the electronic device (eg, FIG. 1 ). A plurality of images including a first image and a second image are acquired using the camera module 180 of the camera module 180, or the camera 210 of FIG. A first video acquired by using the camera and the microphone of the electronic device (eg, the input module 150 of FIG. 1 or the microphone 220 of FIG. 2 ) from before a time is a first file together with the first image and save a second video acquired using the camera and the microphone from the second time point at which the second image is acquired by using the camera and the microphone before the first designated time as a second file together with the second image, and The first video and the second video may be connected and played based on information related to the connection of the first video and the second video.

According to an embodiment disclosed in this document, in the method of operating the electronic device, it is determined whether an interval between the first time point and the second time point is less than a specified threshold value, and the first time point and the second time point are The same group ID may be stored in the first file and the second file when it is determined that the interval of is less than the specified threshold value.

According to an embodiment disclosed in this document, in the method of operating the electronic device, in the first file and the second file in which the same group ID is stored, according to a time sequence of the first time point and the second time point, the You can store sequence numbers.

According to an exemplary embodiment disclosed in this document, the method of operating the electronic device includes storing duplicate information for determining whether the first video and the second video overlap in the first file and the second file; , the duplicate information may include information indicating a location where the electronic device obtains and temporarily stores the first and second moving images.

According to an embodiment disclosed in this document, the method of operating the electronic device includes determining whether to connect the first video and the second video based on the group ID, and the first video and the second video As it is determined to connect , the first video and the second video may be arranged based on the sequence number, and the first video and the second video may be connected according to the arrangement order.

According to an embodiment disclosed in this document, the method of operating the electronic device includes determining whether the first video and the second video overlap based on the overlap information, and the first video and the second video When it is determined that the images overlap, the overlapping portions of the first video and the second video may be removed and reproduced.

According to an embodiment disclosed in this document, in the method of operating the electronic device, a specified effect is inserted between the first video and the second video as it is determined that the first video and the second video do not overlap. can be played by

According to an embodiment disclosed in this document, the method of operating the electronic device includes at least one displayed on a display (eg, the display module 160 of FIG. 1 or the display 230 of FIG. 2 ) of the electronic device. Receives a user input for selecting the first file from among files, and adds the second file based on information related to the connection of the first video and the second video stored in the first file and the second file A user interface for connecting and playing the first video and the second video may be displayed on the display.

According to an embodiment disclosed in this document, in the method of operating the electronic device, upon receiving a user input for storing the reproduced first video and second video, the first video and the second video are displayed. A connected third video may be created and the third video may be stored.

According to an embodiment disclosed in this document, the method of operating the electronic device recognizes a scene type of the first moving image and the second moving image, and the first moving image and the second moving image are of the same type. As recognized as , the same group ID may be stored in the first file and the second file.

Claims (20)

In an electronic device,
camera;
MIC;
display;
Memory; and
a processor operatively coupled to the camera, the microphone, the display, and the memory;
The memory, when executed, causes the processor to:
Acquire a plurality of images including a first image and a second image using the camera,
Store a first video acquired using the camera and the microphone as a first file together with the first image from before a first specified time from the first time point at which the first image was acquired,
Stores a second video acquired using the camera and the microphone from a second time point at which the second image is acquired by using the camera and the microphone from before the first designated time as a second file together with the second image,
and storing one or more instructions for linking and playing the first video and the second video based on information related to the connection between the first video and the second video. The method according to claim 1,
The instructions, the processor,
It is determined whether the interval between the first time point and the second time point is less than a specified threshold value,
and store the same group ID in the first file and the second file when it is determined that the interval between the first time point and the second time point is less than the specified threshold value. 3. The method according to claim 2,
The instructions, the processor,
and to store a sequence number in the first file and the second file in which the same group ID is stored according to a time sequence of the first time point and the second time point. 3. The method according to claim 2,
The instructions, the processor,
to store duplicate information for determining whether the first video and the second video overlap in the first file and the second file;
The duplicate information includes information indicating a location where the processor obtains the first video and the second video and temporarily stores them. 4. The method of claim 3,
The instructions, the processor,
determining whether to connect the first video and the second video based on the group ID;
When it is determined that the first video and the second video are linked, the first video and the second video are arranged based on the sequence number,
and to connect the first video and the second video according to the arranged order. 5. The method according to claim 4,
The instructions, the processor,
Determining whether the first video and the second video overlap based on the overlap information,
and removing the overlapping portion of the first video and the second video to be played back when it is determined that the first video and the second video overlap. 7. The method of claim 6,
The instructions, the processor,
and inserting a specified effect between the first moving image and the second moving image to play the first moving image and the second moving image when it is determined that the first moving image and the second moving image do not overlap. The method according to claim 1,
The instructions, the processor,
receiving a user input for selecting the first file from among at least one file displayed on the display;
and further selecting the second file based on information related to the connection of the first video and the second video stored in the first file and the second file,
displaying a user interface on the display to connect and play the first video and the second video,
receiving user input selecting the user interface;
An electronic device that connects and plays the first video and the second video. 9. The method of claim 8,
The instructions, the processor,
In response to receiving a user input for storing the reproduced first video and second video, a third video in which the first video and the second video are connected is generated,
an electronic device to store the third video. 3. The method according to claim 2,
The instructions, the processor,
Recognizing the types of scenes of the first video and the second video,
and store the same group ID in the first file and the second file as the first video and the second video are recognized as the same type of scene. A method of operating an electronic device, comprising:
acquiring a plurality of images including a first image and a second image by using the camera of the electronic device;
storing a first moving picture obtained using the camera and the microphone of the electronic device from a first designated time before a first specified time from the first time point at which the first image is acquired as a first file together with the first image,
Stores a second video acquired using the camera and the microphone from a second time point at which the second image is acquired by using the camera and the microphone from before the first designated time as a second file together with the second image,
The method of connecting and playing the first video and the second video based on information related to the connection between the first video and the second video. 12. The method of claim 11,
It is determined whether the interval between the first time point and the second time point is less than a specified threshold value,
and storing the same group ID in the first file and the second file as the interval between the first time point and the second time point is determined to be less than the specified threshold value. 13. The method of claim 12,
and storing the sequence number in the first file and the second file in which the same group ID is stored according to a time sequence of the first time point and the second time point. 13. The method of claim 12,
Storing redundant information for determining whether the first video and the second video overlap in the first file and the second file,
The duplicate information includes information indicating a location where the electronic device obtains the first video and the second video and temporarily stores them. 14. The method of claim 13,
determining whether to connect the first video and the second video based on the group ID;
When it is determined that the first video and the second video are linked, the first video and the second video are arranged based on the sequence number,
Concatenating the first video and the second video according to the arranged order, the method. 15. The method of claim 14,
Determining whether the first video and the second video overlap based on the overlap information,
When it is determined that the first video and the second video overlap, the overlapping portion of the first video and the second video is removed and reproduced. 17. The method of claim 16,
When it is determined that the first video and the second video do not overlap, a specified effect is inserted between the first video and the second video and played back. 12. The method of claim 11,
receiving a user input for selecting the first file from among at least one file displayed on a display of the electronic device;
and further selecting the second file based on information related to the connection of the first video and the second video stored in the first file and the second file,
A method of displaying a user interface on the display to connect and play the first video and the second video. 19. The method of claim 18,
In response to receiving a user input for storing the reproduced first video and second video, a third video in which the first video and the second video are connected is generated,
storing the third video. 13. The method of claim 12,
Recognizing the types of scenes of the first video and the second video,
and storing the same group ID in the first file and the second file as the first video and the second video are recognized as the same type of scene.

Images