KR102498815B1 - Electronic device and method for editing video thereof - Google Patents

Abstract

An electronic device is disclosed. An electronic device according to an embodiment includes a display displaying a multi-view video and a user interface for editing the multi-view video, a memory storing the multi-view video, and a processor electrically connected to the display and the memory. and, when the multi-view video is opened for editing, the processor provides a preview of the opened multi-view video in an editing area having an aspect ratio corresponding to the opened multi-view video, and is applied when the opened multi-view video is played. Provides a guide for inserting an object on the editing area based on a field of view (FOV), inserts the object into an opened multi-view video, and converts the opened multi-view video into one file. It can be set to save as . In addition to this, various embodiments identified through the specification are possible.

Description

Electronic device and video editing method of electronic device {ELECTRONIC DEVICE AND METHOD FOR EDITING VIDEO THEREOF}

Embodiments disclosed in this document relate to a technology for editing a video in an electronic device.

Thanks to the development of electronic technology, various types of electronic products are being developed and supplied. Recently, interest in wearable electronic devices that can be worn on the user's body has been expanding, and in particular, development of head mounted devices (HMDs) that can be worn on the user's head is actively developing. It is being done.

When the user's movement is detected, the head-mounted device may provide the user with an image or sound corresponding to the movement. For example, a head-mounted device may play multi-view video (e.g., immersive video or omnidirectional video) in which the viewpoint changes in various ways according to the user's movement. there is. The multi-view video may be reproduced by conventional electronic devices such as smart phones, tablet PCs or desktops as well as head-mounted devices.

In order to edit the multi-view video described above, a complicated process is required compared to editing a typical single-view video. In addition, when a multi-view video to be reproduced on a head-mounted device is edited on a general electronic device such as a smart phone, a tablet PC, or a desktop, distortion unintended by the editor may occur in the multi-view video. Also, if the multi-view video is re-edited to remove unintended distortion, it may take a lot of time to render the multi-view video.

Embodiments disclosed in this document prevent the occurrence of unintentional distortion when editing multi-view video and provide a user interface suitable for multi-view video in order to solve the above problems and problems raised in this document. An object of the present invention is to provide an electronic device, method, or integrated editing program capable of doing this.

An electronic device according to an embodiment disclosed in this document includes a display for displaying a multi-view video and a user interface for editing the multi-view video, a memory for storing the multi-view video, and a display and memory and a processor electrically connected to the open multi-view video, when the multi-view video is opened for editing, the processor provides a preview of the opened multi-view video in an editing area having an aspect ratio corresponding to the opened multi-view video, and Based on the field of view (FOV) applied at the time of reproduction, a guide for inserting an object on the editing area is provided, an object is inserted into an open multi-view video, and an open multi-view into which the object is inserted is provided. It can be set to save the video as a single file.

In addition, the method according to an embodiment disclosed in this document includes, when a multi-view video is opened for editing, providing a preview of the opened multi-view video in an editing area having an aspect ratio corresponding to the opened multi-view video; An operation of providing a guide for inserting an object into an editing area based on a field of view (FOV) applied when reproducing the opened multi-view video, an operation of inserting an object into the opened multi-view video, and It may include an operation of saving an opened multi-view video into which an object is inserted as a single file.

In addition, a storage medium according to an embodiment disclosed in this document stores computer readable instructions executed by at least one processor, and the instruction is an open multi-view video when a multi-view video is opened for editing. An operation of providing a preview of the opened multi-view video in the editing area having an aspect ratio corresponding to , and inserting an object into the editing area based on a field of view (FOV) applied when reproducing the opened multi-view video. It may be set to perform an operation of providing a guide for the video, an operation of inserting an object into the opened multi-view video, and an operation of saving the opened multi-view video into which the object is inserted as a single file.

According to embodiments disclosed in this document, by providing a preview of a multi-view video in an editing area suitable for a multi-view video, a phenomenon in which objects are distorted when another object is inserted into the multi-view video can be prevented.

Also, according to the embodiments disclosed in this document, convenience for a user editing a multi-view video may be improved by providing a guide capable of preventing object distortion.

Also, according to the embodiments disclosed in this document, multi-view videos edited differently according to playback modes are stored as a single file, so that the multi-view videos can be edited to efficiently manage data.

In addition to this, various effects identified directly or indirectly through this document may be provided.

1 illustrates an environment in which an electronic device operates according to an exemplary embodiment.
2 is a block diagram illustrating a configuration of an electronic device according to an exemplary embodiment.
3 is a flowchart illustrating a video editing method of an electronic device according to an exemplary embodiment.
4 illustrates an exemplary screen output by an electronic device according to an embodiment.
5 illustrates an exemplary screen output by an electronic device according to an embodiment.
6 illustrates an exemplary screen output by an electronic device according to an embodiment.
7 illustrates an exemplary screen output by an electronic device according to an embodiment.
8 illustrates an exemplary screen output by an electronic device according to an embodiment.
9 illustrates an exemplary screen output by an electronic device according to an embodiment.
10 illustrates an exemplary screen output by an electronic device according to an embodiment.
11 illustrates an exemplary screen output by an electronic device according to an embodiment.
12 illustrates a schematic data structure of a multi-view video stored in an electronic device according to an embodiment.
13 illustrates an exemplary screen output by an electronic device according to an embodiment.
14 illustrates an exemplary screen output by an electronic device according to an embodiment.
15 illustrates electronic devices in a network environment according to various embodiments.
16 is a block diagram of an electronic device according to various embodiments.
17 is a block diagram of program modules according to various embodiments.

Hereinafter, various embodiments of the present invention will be described with reference to the accompanying drawings. However, it should be understood that this is not intended to limit the present invention to the specific embodiments, and includes various modifications, equivalents, and/or alternatives of the embodiments of the present invention. In connection with the description of the drawings, like reference numerals may be used for like elements.

In this document, expressions such as "has", "may have", "includes", or "may include" refer to the presence of a corresponding feature (eg, numerical value, function, operation, or component such as a part). , which does not preclude the existence of additional features.

In this document, expressions such as "A or B", "at least one of A and/and B", or "one or more of A or/and B" may include all possible combinations of the items listed together. . For example, "A or B", "at least one of A and B", or "at least one of A or B" includes (1) at least one A, (2) at least one B, Or (3) may refer to all cases including at least one A and at least one B.

Expressions such as "first", "second", "first", or "second" as used herein may modify various elements, in any order and/or importance, and may refer to one element as another. It is used to distinguish from components, but does not limit the components. For example, a first user device and a second user device may represent different user devices regardless of order or importance. For example, without departing from the scope of rights described in this document, a first element may be called a second element, and similarly, the second element may also be renamed to the first element.

A component (e.g., a first component) is "(operatively or communicatively) coupled with/to" another component (e.g., a second component); When referred to as "connected to", it should be understood that the certain component may be directly connected to the other component or connected through another component (eg, a third component). On the other hand, when an element (eg, a first element) is referred to as being “directly connected” or “directly connected” to another element (eg, a second element), the element and the above It may be understood that other components (eg, a third component) do not exist between the other components.

As used in this document, the expression "configured to" means "suitable for", "having the capacity to", depending on the situation. ", "designed to", "adapted to", "made to", or "capable of" can be used interchangeably. The term "configured (or set) to" may not necessarily mean only "specifically designed to" hardware. Instead, in some contexts, the phrase "device configured to" may mean that the device is "capable of" in conjunction with other devices or components. For example, the phrase "a processor configured (or set) to perform A, B, and C" may include a dedicated processor (eg, an embedded processor) to perform those operations, or one or more software programs stored in a memory device that executes By doing so, it may mean a general-purpose processor (eg, CPU or application processor) capable of performing corresponding operations.

Terms used in this document are only used to describe a specific embodiment, and may not be intended to limit the scope of other embodiments. Singular expressions may include plural expressions unless the context clearly dictates otherwise. Terms used herein, including technical or scientific terms, may have the same meaning as commonly understood by a person of ordinary skill in the technical field described in this document. Among the terms used in this document, the terms defined in general dictionaries may be interpreted as having the same or similar meaning to the meaning in the context of the related art, and unless explicitly defined in this document, in an ideal or excessively formal meaning. not interpreted In some cases, even terms defined in this document cannot be interpreted to exclude the embodiments of this document.

An electronic device according to various embodiments of the present document may include, for example, a smartphone, a tablet personal computer (PC), a mobile phone, a video phone, an e-book reader, Desktop PC, laptop PC, netbook computer, workstation, server, personal digital assistant (PDA), portable multimedia player (PMP), MP3 player, mobile medical device, It may include at least one of a camera or a wearable device. According to various embodiments, the wearable device is an accessory type (eg, a watch, a ring, a bracelet, an anklet, a necklace, glasses, a contact lens, or a head-mounted-device (HMD)), a fabric or a clothing integral type ( For example, it may include at least one of an electronic clothing), a body attachment type (eg, a skin pad or tattoo), or a body implant type (eg, an implantable circuit).

In some embodiments, the electronic device may be a home appliance. Home appliances include, for example, televisions, DVD players (Digital Video Disk players), audio systems, refrigerators, air conditioners, vacuum cleaners, ovens, microwave ovens, washing machines, air purifiers, set-top boxes, and home automation. Home automation control panel, security control panel, TV box (e.g. Samsung HomeSync™, Apple TV™, or Google TV™), game console (e.g. Xbox™, PlayStation™), electronics It may include at least one of a dictionary, an electronic key, a camcorder, or an electronic picture frame.

In another embodiment, the electronic device may include various types of medical devices (e.g., various portable medical measuring devices (blood glucose meter, heart rate monitor, blood pressure monitor, body temperature monitor, etc.), magnetic resonance angiography (MRA), magnetic resonance imaging (MRI), CT (computed tomography), camera, or ultrasonicator, etc.), navigation device, satellite navigation system (GNSS (Global Navigation Satellite System)), EDR (event data recorder), FDR (flight data recorder), automotive infotainment ) devices, marine electronics (e.g. marine navigation systems, gyrocompasses, etc.), avionics, security devices, automotive head units, industrial or home robots, automatic teller's machines (ATMs) of financial institutions , point of sales (POS) in stores, or internet of things devices (e.g. light bulbs, sensors, electric or gas meters, sprinklers, smoke alarms, thermostats, street lights, toasters) , Exercise equipment, hot water tank, heater, boiler, etc.) may include at least one.

According to some embodiments, the electronic device may be a piece of furniture or a building/structure, an electronic board, an electronic signature receiving device, a projector, or various measuring devices (eg, Water, electricity, gas, radio wave measuring devices, etc.) may include at least one. In various embodiments, the electronic device may be one or a combination of more than one of the various devices described above. An electronic device according to some embodiments may be a flexible electronic device. In addition, the electronic device according to the embodiment of this document is not limited to the above-described devices, and may include new electronic devices according to technological development.

Hereinafter, an electronic device according to various embodiments will be described with reference to the accompanying drawings. In this document, the term user may refer to a person using an electronic device or a device using an electronic device (eg, an artificial intelligence electronic device).

1 illustrates an environment in which an electronic device operates according to an exemplary embodiment.

Referring to FIG. 1 , the electronic device 100 according to an embodiment may edit a multi-view video. A multi-view video is a video that can be reproduced from two or more viewpoints. Multi-view video may be, for example, video such as immersive video or omnidirectional video. The multi-view video edited by the electronic device 100 may be reproduced from various viewpoints according to eye movement or a user's input (eg, a drag input) on a computing device such as a head-mounted device, a mobile device, or a desktop. .

The electronic device 100 may request an editor for a multi-view video from the server 20 and obtain an editor for a multi-view video from the server 20 . In FIG. 1 , the electronic device 100 is illustrated as acquiring an editor from the server 20, but is not limited thereto, and the editor may be stored in the electronic device 100 during manufacture.

The electronic device 100 may obtain a multi-view video from the multi-view camera 10 . The multi-view camera 10 may include two or more lenses or lens arrays. For example, the multi-view camera 10 may include two lenses or a lens array having an angle of view of 180 degrees or more. The multi-view camera 10 can generate two or more videos at the same time. A multi-view video including two or more videos photographed by the multi-view camera 10 may be provided to the electronic device 100 .

The electronic device 100 may edit the multi-view video obtained from the multi-view camera 10 using a multi-view video editor. The electronic device 100 may edit a multi-view video according to a user's manipulation. The electronic device 100, for example, stitches two or more videos received from the multi-view camera 10, provides a preview of the multi-view video, inserts an object into the multi-view video, and edits the edited video. Multi-view video can be saved.

The electronic device 100 shown in FIG. 1 may be combined with a head wearable device. In FIG. 1 , the electronic device 100 is illustrated as a smart phone, but is not limited thereto, and the electronic device 100 may be a head-mounted device or other types of computing devices such as a tablet PC, desktop, or laptop. there is.

2 is a block diagram illustrating a configuration of an electronic device according to an exemplary embodiment.

Referring to FIG. 2 , an electronic device 100 according to an embodiment may include an input/output interface 110, a communication circuit 120, a display 130, a memory 140, and a processor 150.

The input/output interface 110 according to an embodiment may be electrically connected to the multi-view camera 10 . The input/output interface 110 may include, for example, a universal serial bus (USB) or the like. The input/output interface 110 may receive multi-view video from the multi-view camera 10 . The input/output interface 110 is connected to an external device other than the server 20 and may receive an editor for a multi-view image from the other external device.

The communication circuit 120 according to an embodiment may communicate with the server 20 . The communication circuit 120 may receive, for example, an editor for a multi-view image from the server 20 . The communication circuit 120 may communicate with the multi-view camera 10 . The communication circuitry 120 may receive multi-view video from the multi-view camera 10 .

According to an embodiment, the display 130 may display a multi-view video and a user interface for editing the multi-view video. For example, the display 130 may display an execution screen of an editor for a multi-view video, display a user interface for editing a multi-view video on the execution screen, or preview the multi-view video on the execution screen. can also be displayed.

The memory 140 according to an embodiment may store multi-view video obtained from the multi-view camera 10 . The memory 140 may store an editor for a multi-view video obtained from the server 20 . The editor for the multi-view video may be pre-stored in the memory 140 at the time of manufacture, or may be obtained from an external device other than the server 20 and then stored in the memory 140 . Commands included in the editor may be executed by the processor 150 .

The processor 150 according to an embodiment may be electrically connected to the input/output interface 110, the communication circuit 120, the display 130, and the memory 140. The processor 150 may execute an editor for a multi-view video and edit the multi-view video.

The processor 150 may open a multi-view video to be edited. When a multi-view video is opened, the processor 150 may stitch a plurality of videos included in the opened multi-view video so that they are matched with each other. For example, the processor 150 may match two or more images captured through each of two or more lenses or lens arrays included in the multi-view camera 10 . The processor 150 may overlap two or more images and then align them.

The processor 150 may provide a preview of the opened multi-view video in an editing area having an aspect ratio corresponding to the opened multi-view video. The processor 150 may select an editing area suitable for a multi-view video. The processor 150 may support two or more types of editing regions. The editing area may include, for example, a panorama type, a virtual reality (VR) type, or a front-rear type. The panorama type may be a type in which the entire multi-view video is spread out in a rectangular area having an aspect ratio of 2:1. The VR type may be a type that selects a part of a multi-view video based on a field of view (FOV) and displays the selected part of the multi-view video in a rectangular area having an aspect ratio of 2:1. The front-rear type may be a type in which a front image and a rear image of a multi-view video are separately and simultaneously displayed. The editing area may refer to a canvas provided by an image or video editor. The processor 150 may project a multi-view video onto one or more editing areas among a plurality of types of editing areas. The processor 150 may provide a preview of the multi-view video by projecting the multi-view video onto the editing area.

The processor 150 may insert an object into a multi-view video. The object may include, for example, a single-view image including at least one of text, still image, and moving image. A single view image may be an image that can be output from one view point. An object may include a multi-viewpoint image.

The processor 150 may provide a guide for inserting an object into the editing area. When an object is inserted into a multi-view video, the inserted object may be distorted. For example, when the inserted object is a single view image or when the object is inserted in a peripheral area of a panorama type editing area, the object may be more seriously distorted. Accordingly, the processor 150 may provide a guide on the editing area to reduce object distortion.

According to an embodiment, the processor 150 may provide a guide for inserting an object into the editing area based on a field of view (FOV) applied when reproducing an opened multi-view video.

According to an embodiment, the processor 150 may obtain information about the field of view to provide a guide. For example, the processor 150 may obtain information on the field of view based on a value input by a user or a previously stored value. The field of view may be set at various angles, and may be, for example, about 92°. For another example, the processor 150 may obtain information about the field of view from an external device functionally connected to the electronic device 100 . When the electronic device 100 is a smart phone and the external device is a head-mounted device, the processor 150 may obtain information about a field of view supported by the head-mounted device from the head-mounted device.

According to an embodiment, the processor 150 may provide a guide to a central region of the editing region that the eyes can reach. By providing a guide in the central region where the user can see, distortion of the object can be reduced when the user inserts the object along the guide. For user convenience, when an object is inserted at a location out of the guide, the processor 150 may output a notification including, for example, sound, vibration, and/or a message.

The processor 150 may insert an object into the opened multi-view video. The processor 150 may insert an object at a time and location specified by a user within the multi-view video. In addition to object insertion, the processor 150 may perform various editing such as, for example, insertion of a transition effect, split, or crop. After editing is performed (eg, an object is inserted), the processor 150 may provide a preview of the multi-view video including the object in the editing area.

According to an embodiment, the processor 150 may store time information and coordinate information corresponding to a designated region so that the designated region is displayed when the stored multi-view video is reproduced. For example, when an object is inserted at a specified time interval (eg, 1 minute 40 seconds to 1 minute 50 seconds) and designated coordinates (eg, r=1, θ=90°, φ=90°) , The processor 150 may store time information corresponding to the designated time interval and coordinate information corresponding to the designated coordinates together with the multi-view video so that the object is displayed when the multi-view video is reproduced. The processor 150 may tag a designated area, and the tag may be stored in a unit (eg, moov atom) including information about a video file during rendering. When playing a multi-view video, a player for playing the multi-view video can automatically change a viewing point of the multi-view video based on time information and coordinate information. For example, the player can automatically change the viewing point of a multi-view video based on a tag stored in a unit including information about a video file.

According to an embodiment, the processor 150 may store a magnification for enlarging the specified area so that the specified area is enlarged when the stored multi-view video is reproduced. If the magnification factor is stored, the player may magnify and display the image at the designated coordinate at the designated magnification during the designated time interval based on the time information, the coordinate information, and the magnification. When the designated area is enlarged, the processor 150 may increase the audio volume corresponding to the enlarged area.

The processor 150 may store the multi-view video when editing such as object insertion is completed. The processor 150 may store the multi-view video as an integrated file.

According to an embodiment, the processor 150 may insert identification information for distinguishing a stored multi-view video from a single-view video into a multi-view video. The identification information may be, for example, extensible metadata platform (XMP). When the stored multi-view video is reproduced, the player for playing the multi-view video can identify whether the reproduced video is a multi-view video by checking the identification information.

3 is a flowchart illustrating a video editing method of an electronic device according to an exemplary embodiment.

The flowchart shown in FIG. 3 may consist of operations processed in the electronic device 100 shown in FIGS. 1 and 2 . Therefore, even if the content is omitted below, the description of the electronic device 100 with reference to FIGS. 1 and 2 may also be applied to the flowchart shown in FIG. 3 .

Referring to FIG. 3 , in operation 310, the electronic device 100 may select an editing mode for a multi-view video. For example, after executing a video editor, the electronic device 100 may enter a mode for editing a multi-view video or a mode for editing a typical single-view video. The electronic device 100 may output a user interface for selecting one of the two modes. The user interface will be described in detail with reference to FIG. 4 below.

In operation 320, the electronic device 100 may stitch a plurality of videos included in the multi-view video. For example, the electronic device 100 may stitch two or more videos provided from a multi-view camera into one multi-view video. The electronic device 100 may generate one multi-view video after arranging two or more videos to match each other.

In operation 330, the electronic device 100 may provide a user interface including a menu for multi-view video. For example, the electronic device 100 may provide a user interface for inserting an effect usable only in a multi-view video.

In operation 340, the electronic device 100 may provide a preview of the multi-view video in an editing area corresponding to the multi-view video. For example, the electronic device 100 may provide a preview of the multi-view video to a panorama-type editing area in which all of one frame included in the multi-view video is displayed in a 2:1 rectangular area. For another example, the electronic device 100 may provide a preview of the multi-view video to a VR type editing area in which a part of one frame included in the multi-view video is displayed in a 2:1 rectangular area based on the field of view. can The electronic device 100 may simultaneously provide previews of multi-view videos in two or more editing areas.

In operation 350, the electronic device 100 may provide a guide for inserting an object into the editing area based on the field of view. For example, the electronic device 100 may display a guide line corresponding to the range of the field of view when reproducing a multi-view video in the center of the editing area. The provision of the guide will be described in detail with reference to FIG. 9 below.

In operation 360, the electronic device 100 may insert an object into the multi-view video. For example, the electronic device 100 may insert an object including a multi-view image or a single-view image. A single-view image may include text, still images, or moving images. The electronic device 100 may output a notification when an object is inserted at a location out of the provided guide.

In operation 370, the electronic device 100 may provide a preview of the multi-view video into which the object is inserted. For example, the electronic device 100 may provide a preview of a multi-view video into which an object is inserted so that the user can check the displayed time, position, and size of the object when the multi-view video is played.

In operation 380, the electronic device 100 may insert identification information into the multi-view video. For example, the electronic device 100 may insert XMP as identification information into a multi-view video.

In operation 390, the electronic device 100 may store the edited multi-view video. For example, the electronic device 100 may store a multi-view video including the above object and XMP. The electronic device 100 may store the multi-view video in an mp4 format, for example.

4 illustrates an exemplary screen output by an electronic device according to an embodiment.

When the video editor is executed, the electronic device may display the screen 400 shown in FIG. 4 on the display. According to an embodiment, the electronic device may display a user interface for selecting an editing mode for a multi-view video or an editing mode for a single-view video on a display. Referring to FIG. 4 , the electronic device may display, for example, a first button for selecting an editing mode for a multi-view video and a second button for selecting an editing mode for a single-view video on a display. The electronic device may display a user interface for selecting recently opened videos as well as the first button and the second button.

For example, when an input such as a touch or a mouse click is applied to the first button, the electronic device may enter an editing mode for a multi-view video. When an editing mode for a multi-view video is selected, the electronic device may display a user interface including one or more menus for the multi-view video on the display. For example, the electronic device may display a user interface for an editing tool applicable only to the multi-view video or display an editing area for the multi-view video. After editing of the multi-view video is completed, the electronic device may display the user interface shown in FIGS. 13 and 14 on the display.

For another example, when an input is applied to the second button, the electronic device may enter an editing mode for a single view video. When the editing mode for the single-view video is selected, the electronic device may display a user interface including one or more menus for the single-view video on the display.

5 illustrates an exemplary screen output by an electronic device according to an embodiment.

Referring to FIG. 5 , the electronic device may display a screen for editing a multi-view video on a display. The electronic device may display a library 510 on the left side of the display, a preview window 520 on the right side of the display, and a timeline 530 on the lower side of the display.

The electronic device may display the original multi-view video in the library 510 . For example, when a multi-view video is opened, the electronic device may display a thumbnail of the opened multi-view video in the library 510 .

The electronic device may provide a preview of the opened multi-view video in the preview window 520 . The electronic device may provide a preview of the opened multi-view video in an editing area having an aspect ratio corresponding to the opened multi-view video. The electronic device may provide a preview to one or more editing areas among a plurality of types of editing areas. For example, if “View1” is selected, the electronic device may provide a preview in a panorama type editing area having an aspect ratio of 2:1. The electronic device may provide a preview to the editing area of the panorama type by, for example, projecting the entire area of the omnidirectional video onto the flat editing area. The electronic device may enlarge or reduce the preview when an input is applied to a zoom icon indicated as “Zoom -,+” in the preview window 520 . After the preview is enlarged, the electronic device may move the area displayed as the preview when an input is applied to the movement icon displayed as “Up/down/left/right” on the preview window 520. When an input is applied to the play button, rewind button, or fast forward button displayed on the preview window 520, the electronic device may execute a function corresponding to each button.

The electronic device may display on the timeline 530 in chronological order related to editing of the multi-view video. For example, the electronic device may display thumbnails, texts, or animations of other objects inserted into the multi-view video on the timeline 530 .

6 illustrates an exemplary screen output by an electronic device according to an embodiment.

Referring to FIG. 6 , the electronic device may display a screen for editing a multi-view video on a display. The electronic device may display a library 610 on the left side of the display, a preview window 620 on the right side of the display, and a timeline 630 on the lower side of the display. The library 610 , the preview window 620 and the timeline 630 may respectively correspond to the library 510 , the preview window 520 and the timeline 530 shown in FIG. 5 .

The electronic device may provide a preview of the opened multi-view video in the preview window 620 . For example, if “View2” is selected, the electronic device may provide a preview in a VR-type editing area having an aspect ratio of 2:1. The electronic device may provide a preview to the VR-type editing area by, for example, projecting a part of the omnidirectional video selected based on the field of view onto the flat editing area. The electronic device may display another area of the omnidirectional video in the editing area according to a gaze movement or a movement command input (eg, an input applied to a movement icon).

According to an embodiment, the electronic device may provide a preview to two or more edit regions among a plurality of types of edit regions. For example, the electronic device may simultaneously provide a preview to the panorama type editing area shown in FIG. 5 and the VR type editing area shown in FIG. 6 . When an input is applied to the “Add view” button in the preview window 620, the electronic device may add another type of editing area. For example, as shown in FIG. 10 , the electronic device may simultaneously provide a preview to a panorama type editing area and a VR type editing area.

7 illustrates an exemplary screen output by an electronic device according to an embodiment.

Referring to FIG. 7 , the electronic device may insert an object, for example, an image 711 into a multi-view video. The inserted image 711 may be a single view image. The electronic device may display a preview of the image in the preview window 520 shown in FIG. 5 . For example, the electronic device may display a preview of the image 711 in the editing area 710 of a panorama type. If the resolution of the image 711 is lower than the resolution of the editing area 710, the electronic device may display a remaining area of the editing area 710 after the image 711 is inserted as a letterbox.

When a preview is displayed in the panoramic editing area 710, the user of the electronic device can check how the image 711 is displayed when a multi-view video is played on a head-mounted device or a multi-view video is played in VR mode. can't Accordingly, the electronic device may display a preview of the image 711 in the VR type editing area as described with reference to FIG. 8 below.

8 illustrates an exemplary screen output by an electronic device according to an embodiment.

Referring to FIG. 8 , the electronic device may insert an object, for example, an image 811 into a multi-view video. Image 811 may be the same as image 711 shown in FIG. 7 . The electronic device may display a preview of the image in the preview window 620 shown in FIG. 6 . For example, the electronic device may display a preview of the image 811 in the VR type editing area 810 . If the resolution of the image 811 is lower than the resolution of the editing area 810, the electronic device may display a remaining area of the editing area 810 after the image 811 is inserted as a letterbox.

When a single-view image 811 is inserted into a multi-view video, the image 811 may be distorted as shown in FIG. 8 . In particular, a corner portion of image 811 may be more distorted than a central portion of the image. The above-described distortion may occur because the flat image 811 is projected in a sphere shape on the VR type editing area 810 . Since the distortion of the image 811 may be checked during editing through a preview provided in the VR type editing area 810, the user's convenience in editing the multi-view video may be reconsidered. As described below with reference to FIG. 9 , the electronic device may provide a guide for inserting an object.

9 illustrates an exemplary screen output by an electronic device according to an embodiment.

Referring to FIG. 9 , the electronic device may provide a guide for inserting an object, for example, an image 911 into a multi-view video. The editing area 910 and the image 911 may be the same as the editing area 710 and the image 711 shown in FIG. 7 , respectively.

The electronic device may display a line 912 guiding insertion of the image 911 on the editing area. According to an embodiment, the electronic device may provide a guide based on the width of the field of view. The electronic device may display, for example, a guide line 912 having a width of 3/8 of the width of the panorama type editing area 910 . A guide line 912 may be displayed in the center of the editing area 910 . As described with reference to FIG. 8 , the image 911 may be more seriously distorted as it moves out of the center of the editing area 910 . Accordingly, the electronic device may provide a guide line 912 having a width corresponding to the width of the field of view in the central portion of the editing area 910 where distortion of the image 911 may be reduced. The width of the guide line 912 (3/8 of the width of the editing area 910) may be changed according to a field of view applied when a multi-view video is reproduced. The electronic device may display a grid 913 in the editing area.

According to an embodiment, when an object is inserted into an open multi-view video, the electronic device may change the size of the object according to a user's input. When one of the points displayed on the guide line 912 is dragged, the electronic device can change the image to correspond to the drag input. For example, the electronic device may change the image so that the upper right corner of the image 911 is rounded when a point displayed at the upper right of the guide line 912 is dragged in a lower left direction. When a flat image 911 is inserted into a multi-view video, distortion is generated in which the corner of the image 911 spreads widely, so the electronic device reduces the image 911 by reducing the corner of the image 911 by user manipulation. distortion can be reduced.

10 illustrates an exemplary screen output by an electronic device according to an embodiment.

Referring to FIG. 10 , the electronic device may insert an object, eg, text, into a panorama type editing area 1010 . According to an embodiment, when an object is inserted into an open multi-view video, the electronic device may copy the object and automatically insert the object into another area outside the area where the object is inserted. For example, the electronic device may insert text into the first area 1011 that is the central area of the editing area 1010 . When the multi-view video is reproduced, the text inserted in the first area 1011 may not be output on the display when the viewing point of the multi-view video is toward the periphery of the editing area 1010 . When text is inserted into the first area 1011, the electronic device copies the text inserted into the first area 1011, and the second area 1012 and the third area 1013 are areas outside the first area 1011. ) to automatically insert the duplicated text. By inserting text into the second area 1012 and the third area 1013 , the text may be output on the display even when the viewing point of the multi-view video is toward the periphery of the editing area 1010 .

According to an embodiment, when an object is inserted into an open multi-view video, the electronic device automatically adjusts the position of the object to the center of the editing area, and when the stored multi-view video is played, the object is inserted so that the object is output. Time information and coordinate information of the central part may be stored. For example, when text is inserted into the editing area 101, the electronic device may adjust the location of the text to the first area 1011. The electronic device may store information about a reproduction time of a frame in which text is inserted and coordinate information of the first region 1011 in a multi-view video. When a multi-view video is played, the device reproducing the multi-view video looks at the multi-view video so that the first area 1011 is displayed at the time when the frame in which the text is inserted is output based on the time information and the coordinate information. can be moved.

11 illustrates an exemplary screen output by an electronic device according to an embodiment.

Referring to FIG. 11 , the electronic device may provide a preview to each of two or more types of editing areas 1111 and 1112 . For example, the electronic device may display a panorama type editing area 1111 and a VR type editing area 1112 on the preview window 1110 . The electronic device may provide a preview of a multi-view image to each of the panorama type editing area 1111 and the VR type editing area 1112 .

According to an embodiment, the electronic device may insert objects in different positions or sizes on two or more types of editing areas. For example, the electronic device may insert text 1121. The electronic device may provide a preview of the multiview video in which the text 1121 is inserted in each of the panorama type editing area 1111 and the VR type editing area 1112 .

As shown in FIG. 11, when a multi-view video is played in panorama mode, all text 1121 can be displayed, but when a multi-view video is played in VR mode, only a part of text 1121 is displayed due to a limited field of view. can be displayed If the text 1121 is reduced so that all of the text 1121 is displayed when the multi-view video is played in the VR mode, the text 1121 may be output too small when the multi-view video is played in the panorama mode.

The electronic device according to an embodiment may insert the text 1121 at different positions or sizes according to the playback mode so that the text 1121 can be easily recognized in any playback mode. For example, the electronic device may insert text 1121 into the panorama type editing area 1111 with a size larger than that shown in FIG. 11 and insert text 1121 into the VR type editing area 1112 in FIG. It can be inserted smaller than the size shown in. When the multi-view video is played in the panorama mode, the text 1121 can be displayed in the size displayed in the panorama type editing area 1111, and when the multi-view video is played in the VR mode, the text 1121 is displayed in the VR mode. It can be displayed in the size displayed in the edit area 1112 of the type. When an input is applied to the apply button 1122, the electronic device may insert text into the multi-view video.

According to an embodiment, the electronic device may store multi-view videos in which objects are inserted in different positions or sizes according to two or more types of editing areas as a single file. For example, in the electronic device, text 1121 is inserted in a panorama type editing area 1111 with a size of 40 points and text 1121 is inserted in a VR type editing area 1112 with a size of 20 points. A point video can be saved as a single file. A file may include metadata, multi-view video, and objects. Information about the text 1121, the size of the text 1121, and the location of the text 1121 may be stored in meta data. The structure of metadata of stored files will be described with reference to FIG. 12 below.

12 illustrates a schematic data structure of a multi-view video stored in an electronic device according to an embodiment.

Referring to FIG. 12 , meta data of a multi-view video may include at least a header 1210, an object descriptor 1220, and a video scene descriptor 1230. Meta data may include information about the object, the size of the object, the location of the object, the time the object was inserted, and/or the frame in which the object was inserted. Meta data may be formed in a virtual reality modeling language (VRML) format, for example.

The header 1210 may define a playback mode of a multi-view video. The reproduction mode may include, for example, a panorama mode, a VR mode, and a front/rear mode. The header 1210 may include information about the number of playback modes and values corresponding to each playback mode.

The object descriptor 1220 may include information about a source of an object. The object descriptor 1220 may include information indicating text, image, or video inserted into the multi-view video.

The video scene descriptor 1230 may include information about how each object defined in the object descriptor 1220 is displayed in each playback mode defined in the header 1210 . The video scene descriptor 1230 may separately include, for example, information about how an object is displayed in a panorama mode and information about how an object is displayed in a VR mode. The video scene descriptor 1230 may include, for example, information about a size of an object, a position of the object, a start time, an end time, a frame in which the object is displayed, and/or a duration in which the object is displayed.

When the multi-view video including the above-described meta data is reproduced in one of the reproduction modes defined in the header 1210, the object described in the object descriptor 1220 is reproduced selected from among the aspects described in the video scene descriptor 1230. It may be output according to an aspect corresponding to the mode. Therefore, an object inserted into a multi-view video can be displayed in different sizes, at different positions, and at different times according to the reproduction mode.

13 illustrates an exemplary screen output by an electronic device according to an embodiment.

According to an embodiment, when an editing mode for a multi-view video is selected, the electronic device may display a user interface including one or more menus for the multi-view video on the display. Referring to FIG. 13 , the electronic device may display a screen 1300 for saving a multi-view video. The screen 1300 may include a first button 1310 and a second button 1320 for selecting a format. The electronic device may display only buttons corresponding to formats suitable for multi-view video. For example, when an input is applied to the first button 1310, the electronic device may store a multi-view video in H.264 format. For another example, if an input is applied to the second button 1320, the electronic device may store the multi-view video in the H.265 format.

Since multi-view video cannot be encoded in a format such as, for example, windows media video (WMV), the electronic device may not display a button for selecting a format unsuitable for multi-view video, such as WMV.

When the H.264 format is selected, the electronic device selects the profile (e.g. MPEG-4, 2560×1280/30p, 40 Mbps), country (e.g. South Korea), broadcast standard (NTSC: national television system committee) and output folder, etc. can be specified. When an input is applied to the start (strat) button, the electronic device may encode a multi-view video.

14 illustrates an exemplary screen output by an electronic device according to an embodiment.

According to an embodiment, when an editing mode for a multi-view video is selected, the electronic device may display a user interface including one or more menus for the multi-view video on the display. Referring to FIG. 14 , the electronic device may display a screen 1400 for uploading a multi-view video. The screen 1400 may include a first button 1410 and a second button 1420 for selecting a site to upload a multi-view video to. The electronic device may display only buttons corresponding to sites supporting reproduction of multi-view videos. For example, when an input is applied to the first button 1410, the electronic device can upload a multi-view video to “Facebook”. For another example, when an input is applied to the second button 1420, the electronic device may upload a multi-view video to “Youtube”. The electronic device may not display a button for selecting a site that does not support reproduction of a multi-view video.

15 illustrates electronic devices in a network environment according to various embodiments.

Referring to FIG. 15 , electronic devices 1501 , 1502 , and 1504 or a server 1506 according to various embodiments may be connected to each other through a network 1562 or short-range communication 1564 . The electronic device 1501 may include a bus 1510, a processor 1520, a memory 1530, an input/output interface 1550, a display 1560, and a communication interface 1570. In some embodiments, the electronic device 1501 may omit at least one of the components or may additionally include other components.

Bus 1510 may include, for example, circuitry that couples components 1520-1570 together and carries communications (eg, control messages and/or data) between components.

The processor 1520 may include one or more of a central processing unit (CPU), an application processor (AP), or a communication processor (CP). The processor 1520 may, for example, execute calculations or data processing related to control and/or communication of at least one other element of the electronic device 1501.

The memory 1530 may include volatile and/or non-volatile memory. The memory 1530 may store, for example, commands or data related to at least one other component of the electronic device 1501 . According to one embodiment, the memory 1530 may store software and/or programs 1540 . The program 1540 includes, for example, a kernel 1541, middleware 1543, an application programming interface (API) 1545, and/or an application program (or “application”) 1547, etc. can include At least a part of the kernel 1541, middleware 1543, or API 1545 may be referred to as an Operating System (OS).

Kernel 1541, for example, includes system resources (eg middleware 1543, API 1545, or application program 1547) used to execute operations or functions implemented in other programs (eg middleware 1543). : The bus 1510, the processor 1520, or the memory 1530, etc.) may be controlled or managed. In addition, the kernel 1541 may provide an interface capable of controlling or managing system resources by accessing individual components of the electronic device 1501 from the middleware 1543, API 1545, or application program 1547. can

The middleware 1543 may perform an intermediary role so that the API 1545 or the application program 1547 communicates with the kernel 1541 to exchange data.

Also, the middleware 1543 may process one or more job requests received from the application program 1547 according to priority. For example, the middleware 1543 may use system resources (eg, a bus 1510, a processor 1520, or a memory 1530) of the electronic device 1501 for at least one of the application programs 1547. You can give priority. For example, the middleware 1543 may perform scheduling or load balancing for the one or more task requests by processing the one or more task requests according to the priority assigned to the at least one task.

The API 1545 is an interface for the application 1547 to control functions provided by the kernel 1541 or the middleware 1543, for example, file control, window control, image processing, or text. It may include at least one interface or function (eg, command) for control.

The input/output interface 1550 may serve as an interface capable of transferring commands or data input from a user or other external device to other component(s) of the electronic device 1501, for example. Also, the input/output interface 1550 may output commands or data received from other element(s) of the electronic device 1501 to a user or other external device.

The display 1560 may be, for example, a liquid crystal display (LCD), a light-emitting diode (LED) display, an organic light-emitting diode (OLED) display, or a microelectromechanical device. systems (microelectromechanical systems, MEMS) displays, or electronic paper (electronic paper) displays. The display 1560 may display, for example, various contents (eg, text, image, video, icon, symbol, etc.) to the user. The display 1560 may include a touch screen, and may receive, for example, a touch, gesture, proximity, or hovering input using an electronic pen or a part of the user's body.

The communication interface 1570 establishes communication between the electronic device 1501 and an external device (eg, the first external electronic device 1502, the second external electronic device 1504, or the server 1506). can For example, the communication interface 1570 may be connected to the network 1562 through wireless or wired communication to communicate with the external device (eg, the second external electronic device 1504 or the server 1506).

Wireless communication is, for example, a cellular communication protocol, for example, LTE (Long-Term Evolution), LTE-A (LTE-Advanced), CDMA (Code Division Multiple Access), WCDMA (Wideband CDMA), UMTS (Universal Mobile) At least one of Telecommunications System), WiBro (Wireless Broadband), or GSM (Global System for Mobile Communications) may be used. Wireless communication may also include, for example, short range communication 1564 . The short-range communication 1564 may include, for example, at least one of Wireless Fidelity (Wi-Fi), Bluetooth, Near Field Communication (NFC), magnetic stripe transmission (MST), or GNSS.

The MST generates a pulse according to transmission data using an electromagnetic signal, and the pulse may generate a magnetic field signal. The electronic device 1501 transmits the magnetic field signal to a point of sales (POS), the POS detects the magnetic field signal using an MST reader, and converts the detected magnetic field signal into an electrical signal, thereby generating the data can be restored.

GNSS depends on the region of use or bandwidth, for example, GPS (Global Positioning System), Glonass (Global Navigation Satellite System), Beidou Navigation Satellite System (hereinafter "Beidou") or Galileo (the European global satellite-based navigation system) may include at least one of them. Hereinafter, in this document, "GPS" may be interchangeably used with "GNSS". Wired communication may include, for example, at least one of universal serial bus (USB), high definition multimedia interface (HDMI), recommended standard-232 (RS-232), or plain old telephone service (POTS). . The network 1562 may include at least one of a telecommunications network, for example, a computer network (eg, a LAN or WAN), the Internet, or a telephone network.

Each of the first and second external electronic devices 1502 and 1504 may be the same as or different from the electronic device 1501 . According to one embodiment, server 1506 may include a group of one or more servers. According to various embodiments, all or part of operations executed in the electronic device 1501 may be executed in one or more electronic devices (eg, the electronic devices 1502 and 1504 or the server 1506). According to one embodiment, when the electronic device 1501 needs to perform a certain function or service automatically or upon request, the electronic device 1501 instead of or in addition to executing the function or service by itself, At least some related functions may be requested from another device (eg, the electronic device 1502 or 1504 or the server 1506). Other electronic devices (eg, the electronic devices 1502 and 1504 or the server 1506 ) may execute the requested function or additional function and deliver the result to the electronic device 1501 . The electronic device 1501 may provide the requested function or service by directly or additionally processing the received result. To this end, for example, cloud computing, distributed computing, or client-server computing technology may be used.

16 is a block diagram of an electronic device according to various embodiments.

Referring to FIG. 16 , an electronic device 1601 may include all or part of the electronic device 1501 shown in FIG. 15 , for example. The electronic device 1601 includes one or more processors (eg AP) 1610, a communication module 1620, a subscriber identification module 1624, a memory 1630, a sensor module 1640, an input device 1650, a display ( 1660), an interface 1670, an audio module 1680, a camera module 1691, a power management module 1695, a battery 1696, an indicator 1697, and a motor 1698.

The processor 1610 may control a plurality of hardware or software components connected to the processor 1610 by driving, for example, an operating system or an application program, and may perform various data processing and calculations. The processor 1610 may be implemented as, for example, a system on chip (SoC). According to one embodiment, the processor 1610 may further include a graphic processing unit (GPU) and/or an image signal processor. The processor 1610 may include at least some of the components shown in FIG. 16 (eg, the cellular module 1621). The processor 1610 loads and processes commands or data received from at least one of the other components (eg, non-volatile memory) into the volatile memory, and stores various data in the non-volatile memory. there is.

The communication module 1620 may have the same or similar configuration as the communication interface 1570 of FIG. 15 . The communication module 1620 may include, for example, a cellular module 1621, a Wi-Fi module 1622, a Bluetooth module 1623, a GNSS module 1624 (eg, a GPS module, a Glonass module, a Beidou module, or a Galileo module). module), an NFC module 1625, an MST module 1626, and a radio frequency (RF) module 1627.

The cellular module 1621 may provide, for example, a voice call, a video call, a text service, or an Internet service through a communication network. According to an embodiment, the cellular module 1621 may identify and authenticate the electronic device 1601 within a communication network using the subscriber identification module (eg, SIM card) 1629 . According to one embodiment, the cellular module 1621 may perform at least some of the functions that the processor 1610 may provide. According to one embodiment, the cellular module 1621 may include a communication processor (CP).

Each of the Wi-Fi module 1622, Bluetooth module 1623, GNSS module 1624, NFC module 1625, or MST module 1626, for example, processes data transmitted and received through the corresponding module. It may include a processor for According to some embodiments, at least some (e.g., two or more) may be included in one integrated chip (IC) or IC package.

The RF module 1627 may transmit and receive communication signals (eg, RF signals), for example. The RF module 1627 may include, for example, a transceiver, a power amp module (PAM), a frequency filter, a low noise amplifier (LNA), or an antenna. According to another embodiment, at least one of the cellular module 1621, the Wi-Fi module 1622, the Bluetooth module 1623, the GNSS module 1624, the NFC module 1625, and the MST module 1626 is a separate RF RF signals can be transmitted and received through the module.

The subscriber identification module 1629 may include, for example, a card including the subscriber identification module and/or an embedded SIM, and unique identification information (eg, integrated circuit card identifier (ICCID)) or Subscriber information (eg, international mobile subscriber identity (IMSI)) may be included.

The memory 1630 (eg, the memory 1530) may include, for example, an internal memory 1632 or an external memory 1634. The built-in memory 1632 may include, for example, volatile memory (e.g., dynamic RAM (DRAM), static RAM (SRAM), or synchronous dynamic RAM (SDRAM)), non-volatile memory (e.g., OTPROM (one time programmable ROM), PROM (programmable ROM), EPROM (erasable and programmable ROM), EEPROM (electrically erasable and programmable ROM), mask ROM, flash ROM, flash memory (e.g. NAND flash) (NAND flash, NOR flash, etc.), a hard drive, or a solid state drive (SSD).

The external memory 1634 is a flash drive, for example, compact flash (CF), secure digital (SD), Micro-SD, Mini-SD, extreme digital (xD), MultiMediaCard (MMC), or memory. A stick (memory stick) and the like may be further included. The external memory 1634 may be functionally and/or physically connected to the electronic device 1601 through various interfaces.

The security module 1636 is a module including a storage space with a relatively higher security level than the memory 1630, and may be a circuit that guarantees safe data storage and a protected execution environment. The security module 1636 may be implemented as a separate circuit and may include a separate processor. The security module 1636 includes, for example, a removable smart chip, a secure digital (SD) card, or an embedded secure element (eSE) embedded in a fixed chip of the electronic device 1601. can include Also, the security module 1636 may be driven by an operating system different from the operating system (OS) of the electronic device 1601 . For example, the security module 1636 may operate based on a java card open platform (JCOP) operating system.

The sensor module 1640 may, for example, measure a physical quantity or detect an operating state of the electronic device 1601 and convert the measured or sensed information into an electrical signal. The sensor module 1640 includes, for example, a gesture sensor 1640A, a gyro sensor 1640B, an air pressure sensor 1640C, a magnetic sensor 1640D, an acceleration sensor 1640E, a grip sensor 1640F, and a proximity sensor ( 1640G), color sensor (1640H) (e.g. RGB sensor), bio sensor (1640I), temperature/humidity sensor (1640J), illuminance sensor (1640K), or UV (ultra violet) sensor (1640M) can do. Additionally or alternatively, the sensor module 1640 may include, for example, an E-nose sensor, an electromyography (EMG) sensor, an electroencephalogram (EEG) sensor, an electrocardiogram (ECG) sensor, an infrared (IR) sensor, and an iris sensor. sensor and/or a fingerprint sensor. The sensor module 1640 may further include a control circuit for controlling one or more sensors included therein. In some embodiments, the electronic device 1601 further includes a processor, either as part of the processor 1610 or separately, configured to control the sensor module 1640 while the processor 1610 is in a sleep state, The sensor module 1640 may be controlled.

The input device 1650 may include, for example, a touch panel 1652, a (digital) pen sensor 1654, a key 1656, or an ultrasonic input device ( 1658) may be included. The touch panel 1652 may use at least one of, for example, a capacitive type, a pressure-sensitive type, an infrared type, or an ultrasonic type. Also, the touch panel 1652 may further include a control circuit. The touch panel 1652 may further include a tactile layer to provide a tactile response to the user.

The (digital) pen sensor 1654 may be part of a touch panel or may include a separate recognition sheet. Keys 1656 may include, for example, physical buttons, optical keys, or keypads. The ultrasonic input device 1658 may detect ultrasonic waves generated from an input tool through a microphone (eg, the microphone 1688) and check data corresponding to the detected ultrasonic waves.

The display 1660 (eg, the display 1560 ) may include a panel 1662 , a hologram device 1664 , or a projector 1666 . The panel 1662 may include the same or similar configuration as the display 1560 of FIG. 15 . The panel 1662 may be implemented to be flexible, transparent, or wearable, for example. The panel 1662 and the touch panel 1652 may be configured as one module. The hologram device 1664 may display a 3D image in the air by using light interference. The projector 1666 may display an image by projecting light onto a screen. The screen may be located inside or outside the electronic device 1601, for example. According to one embodiment, the display 1660 may further include a control circuit for controlling the panel 1662 , the hologram device 1664 , or the projector 1666 .

Interface 1670 may include, for example, HDMI 1672, USB 1674, optical interface 1676, or D-sub (D-subminiature) 1678. Interface 1670 may be included in, for example, communication interface 1570 shown in FIG. 15 . Additionally or alternatively, interface 1670 may include, for example, a mobile high-definition link (MHL) interface, an SD card/MMC interface, or an infrared data association (IrDA) compliant interface.

The audio module 1680 may, for example, convert a sound and an electrical signal in both directions. At least some components of the audio module 1680 may be included in the input/output interface 1550 shown in FIG. 15 , for example. The audio module 1680 may process sound information input or output through, for example, the speaker 1682, the receiver 1684, the earphone 1686, or the microphone 1688.

The camera module 1691 is, for example, a device capable of capturing still images and moving images. According to an embodiment, the camera module 1691 includes one or more image sensors (eg, a front sensor or a rear sensor), a lens, and an image signal processor (ISP). , or a flash (eg, LED or xenon lamp).

The power management module 1695 may manage power of the electronic device 1601 , for example. According to one embodiment, the power management module 1695 may include a power management integrated circuit (PMIC), a charger integrated circuit (IC), or a battery or fuel gauge. A PMIC may have a wired and/or wireless charging method. The wireless charging method includes, for example, a magnetic resonance method, a magnetic induction method, or an electromagnetic wave method, and may further include an additional circuit for wireless charging, for example, a coil loop, a resonance circuit, or a rectifier. there is. The battery gauge may measure, for example, the remaining capacity of the battery 1696, voltage, current, or temperature during charging. Battery 1696 may include, for example, a rechargeable battery and/or a solar battery.

The indicator 1697 may indicate a specific state of the electronic device 1601 or a part thereof (eg, the processor 1610), for example, a booting state, a message state, or a charging state. The motor 1698 may convert electrical signals into mechanical vibrations, and may generate vibrations or haptic effects. Although not shown, the electronic device 1601 may include a processing device (eg, GPU) for supporting mobile TV. A processing device for supporting mobile TV may process media data according to standards such as Digital Multimedia Broadcasting (DMB), Digital Video Broadcasting (DVB), or MediaFLO ^™ .

Each of the components described in this document may be composed of one or more components, and the name of the corresponding component may vary depending on the type of electronic device. In various embodiments, an electronic device may include at least one of the components described in this document, and some components may be omitted or additional components may be included. In addition, some of the components of the electronic device according to various embodiments are combined to form one entity, so that the functions of the corresponding components before being combined can be performed the same.

17 is a block diagram of program modules according to various embodiments.

According to one embodiment, the program module 1710 (eg, the program 1540) is an operating system (OS) that controls resources related to an electronic device (eg, the electronic device 1501) and/or is driven on the operating system. It may include various applications (eg, the application program 1547). The operating system may be, for example, Android, iOS, Windows, Symbian, Tizen, or bada.

The program module 1710 may include a kernel 1720, middleware 1730, an API 1760, and/or an application 1770. At least a part of the program module 1710 may be preloaded on the electronic device or downloaded from an external electronic device (eg, the electronic devices 1502 and 1504, the server 1506, etc.).

The kernel 1720 (eg, the kernel 1541) may include, for example, a system resource manager 1721 or a device driver 1723. The system resource manager 1721 may control, allocate, or recover system resources. According to one embodiment, the system resource manager 1721 may include a process management unit, a memory management unit, or a file system management unit. The device driver 1723 may include, for example, a display driver, a camera driver, a Bluetooth driver, a shared memory driver, a USB driver, a keypad driver, a Wi-Fi driver, an audio driver, or an inter-process communication (IPC) driver. can

The middleware 1730, for example, provides functions commonly required by the application 1770 or provides various functions through the API 1760 so that the application 1770 can efficiently use limited system resources inside the electronic device. Functions may be provided as an application 1770 . According to one embodiment, the middleware 1730 (eg, the middleware 1543) includes a runtime library 1735, an application manager 1741, a window manager 1742, and a multimedia manager. ) (1743), resource manager (1744), power manager (1745), database manager (1746), package manager (1747), connectivity manager ) 1748, notification manager 1749, location manager 1750, graphic manager 1751, security manager 1752, or payment manager 1754 ) may include at least one of

The runtime library 1735 may include, for example, a library module used by a compiler to add new functions through a programming language while the application 1770 is being executed. The runtime library 1735 may perform functions related to input/output management, memory management, or arithmetic functions.

The application manager 1741 may manage the life cycle of at least one application among the applications 1770 . The window manager 1742 may manage GUI resources used in the screen. The multimedia manager 1743 may determine a format necessary for reproducing various media files and encode or decode the media file using a codec suitable for the format. The resource manager 1744 may manage resources such as source code, memory, or storage space of at least one of the applications 1770 .

For example, the power manager 1745 may operate together with a basic input/output system (BIOS) to manage a battery or power supply and provide power information required for operation of the electronic device. The database manager 1746 may create, search, or change a database to be used by at least one of the applications 1770 . The package manager 1747 may manage installation or update of applications distributed in the form of package files.

The connection manager 1748 may manage a wireless connection such as Wi-Fi or Bluetooth. The notification manager 1749 can display or notify events such as arriving messages, appointments, and proximity notifications in a non-intrusive way to the user. The location manager 1750 may manage location information of an electronic device. The graphic manager 1751 may manage graphic effects to be provided to users or user interfaces related thereto. The security manager 1752 may provide various security functions necessary for system security or user authentication. According to one embodiment, when the electronic device (eg, the electronic device 1501) includes a phone function, the middleware 1730 further includes a telephony manager for managing the voice or video call function of the electronic device. can do.

The middleware 1730 may include a middleware module forming a combination of various functions of the aforementioned components. The middleware 1730 may provide modules specialized for each type of operating system to provide differentiated functions. Also, the middleware 1730 may dynamically delete some existing components or add new components.

The API 1760 (eg, the API 1545) is, for example, a set of API programming functions, and may be provided in different configurations depending on the operating system. For example, in the case of Android or iOS, one API set can be provided for each platform, and in the case of Tizen, two or more API sets can be provided for each platform.

The application 1770 (eg, application program 1547) includes, for example, a home 1771, a dialer 1772, an SMS/MMS 1773, an instant message (IM) 1774, a browser 1775, Camera (1776), Alarm (1777), Contacts (1778), Voice Dial (1779), Email (1780), Calendar (1781), Media Player (1782), Album (1783), or Clock (1784), Health Care It may include one or more applications capable of performing functions such as health care (eg, measurement of exercise or blood sugar) or provision of environment information (eg, provision of atmospheric pressure, humidity, or temperature information).

According to one embodiment, the application 1770 is an application that supports information exchange between an electronic device (eg, the electronic device 1501) and an external electronic device (eg, the electronic devices 1502 and 1504) (hereinafter, the description of For convenience, an "information exchange application") may be included. The information exchange application may include, for example, a notification relay application for delivering specific information to an external electronic device or a device management application for managing an external electronic device.

For example, the notification delivery application transmits notification information generated from other applications (eg, SMS/MMS applications, e-mail applications, health management applications, or environmental information applications) of the electronic device to an external electronic device (eg, the electronic device 1502 ). , 1504)). Also, the notification delivery application may receive notification information from an external electronic device and provide the notification information to the user.

The device management application is, for example, at least one function of an external electronic device (eg, electronic device 1502, 1504) that communicates with the electronic device (eg, turn-on of the external electronic device itself (or some component)). /Turn-off or adjust the brightness (or resolution) of the display), manage applications running on the external electronic device or services provided by the external electronic device (eg call service or message service, etc.) update) can be done.

According to an embodiment, the application 1770 may include an application (eg, a health management application of a mobile medical device) designated according to attributes of external electronic devices (eg, the electronic devices 1502 and 1504). According to an embodiment, the application 1770 may include an application received from an external electronic device (eg, the server 1506 or the electronic devices 1502 and 1504). According to one embodiment, the application 1770 may include a preloaded application or a third party application downloadable from a server. Names of components of the program module 1710 according to the illustrated embodiment may vary depending on the type of operating system.

According to various embodiments, at least a portion of the program module 1710 may be implemented as software, firmware, hardware, or a combination of at least two or more of these. At least a part of the program module 1710 may be implemented (eg, executed) by a processor (eg, the processor 1610). At least some of the program modules 1710 may include, for example, modules, programs, routines, sets of instructions, or processes for performing one or more functions.

The term "module" used in this document may refer to a unit including one or a combination of two or more of, for example, hardware, software, or firmware. “Module” may be used interchangeably with terms such as, for example, unit, logic, logical block, component, or circuit. A “module” may be a minimum unit or part of an integrally formed part. A “module” may be a minimal unit or part thereof that performs one or more functions. A “module” may be implemented mechanically or electronically. For example, a "module" is any known or future developed application-specific integrated circuit (ASIC) chip, field-programmable gate arrays (FPGAs), or programmable-logic device that performs certain operations. may contain at least one.

At least some of devices (eg, modules or functions thereof) or methods (eg, operations) according to various embodiments of the present disclosure are, for example, computer-readable storage media in the form of program modules. It can be implemented as a command stored in . When the command is executed by a processor (eg, the processor 1520), the one or more processors may perform a function corresponding to the command. The computer-readable storage medium may be, for example, the memory 1530.

Computer-readable recording media include hard disks, floppy disks, magnetic media (eg magnetic tape), optical media (eg CD-ROM, DVD (Digital Versatile Disc), magnetic- It may include a magneto-optical media (eg, a floptical disk), a hardware device (eg, ROM, RAM, or flash memory), etc. In addition, program instructions are created by a compiler. It may include high-level language codes that can be executed by a computer using an interpreter, etc. as well as machine language codes such as those described above. Yes, and vice versa.

A module or program module according to various embodiments may include at least one or more of the aforementioned components, some may be omitted, or additional components may be further included. Operations performed by modules, program modules, or other components according to various embodiments may be executed in a sequential, parallel, repetitive, or heuristic manner. Also, some actions may be performed in a different order, omitted, or other actions may be added.

And the embodiments disclosed in this document are presented for explanation and understanding of the disclosed technical content, and do not limit the scope of the present invention. Therefore, the scope of this document should be construed to include all changes or various other embodiments based on the technical spirit of the present invention.

Claims (20)

a display displaying a multi-view video and a user interface for editing the multi-view video;
a memory for storing the multi-view video; and
A processor electrically connected to the display and the memory;
the processor,
When the multi-view video is opened for editing, providing a preview of the opened multi-view video in an editing area having an aspect ratio corresponding to the opened multi-view video;
Providing a guide for inserting an object into the editing area based on a field of view (FOV) applied when the opened multi-view video is reproduced;
outputting a notification when the object is inserted at a location out of the guide;
Inserting the object into the opened multi-view video;
The electronic device configured to store the opened multi-view video into which the object is inserted as a single file. According to claim 1,
the processor,
The electronic device configured to display on the display a user interface for selecting an editing mode for the multi-view video or an editing mode for the single-view video. According to claim 2,
the processor,
The electronic device, configured to display a user interface including one or more menus for the multi-view video on the display when an editing mode for the multi-view video is selected. According to claim 1,
the processor,
The electronic device, configured to stitch the plurality of videos so that the plurality of videos included in the opened multi-view video are matched with each other. According to claim 1,
the processor,
It is set to provide the preview to one or more editing areas among a plurality of types of editing areas;
The plurality of types of editing areas include at least two of a panoramic type, a virtual reality (VR) type, or a front-rear type editing area. ◈Claim 6 was abandoned when the registration fee was paid.◈ According to claim 1,
the processor,
The electronic device is configured to provide the preview in the editing area having an aspect ratio of 2:1. ◈Claim 7 was abandoned when the registration fee was paid.◈ According to claim 1,
the processor,
An electronic device set to provide the guide based on the width of the field of view. ◈Claim 8 was abandoned when the registration fee was paid.◈ According to claim 1,
the processor,
An electronic device configured to display a line guiding insertion of the object on the editing area. delete ◈Claim 10 was abandoned when the registration fee was paid.◈ According to claim 1,
the processor,
An electronic device configured to acquire information about the field of view based on a value input by a user or a pre-stored value or from an external device functionally connected to the electronic device. ◈Claim 11 was abandoned when the registration fee was paid.◈ According to claim 1,
The electronic device, wherein the object is a single-view image including at least one of text, still image, and moving image. ◈Claim 12 was abandoned when the registration fee was paid.◈ According to claim 1,
the processor,
When the object is inserted into the opened multi-view video, the electronic device is configured to change the size of the object according to a user's input. According to claim 1,
the processor,
and when the object is inserted into the opened multi-view video, duplicate the object and automatically insert the object into another area outside the area where the object is inserted. According to claim 1,
the processor,
When the object is inserted into the opened multi-view video, the position of the object is automatically adjusted to the central part of the editing area, and the inserted time information so that the object is output when the stored multi-view video is played. and set to store coordinate information of the central portion. ◈Claim 15 was abandoned when the registration fee was paid.◈ According to claim 1,
the processor,
The electronic device configured to insert identification information for distinguishing the stored multi-view video from a single-view video into the opened multi-view video. ◈Claim 16 was abandoned when the registration fee was paid.◈ According to claim 1,
the processor,
The electronic device configured to store time information and coordinate information corresponding to the designated region so that the designated region is displayed when the stored multi-view video is reproduced. ◈Claim 17 was abandoned when the registration fee was paid.◈ 17. The method of claim 16,
the processor,
The electronic device configured to store a magnification for enlarging the specified area so that the specified area is enlarged when the stored multi-view video is reproduced. According to claim 1,
the processor,
providing the preview to each of two or more types of editing areas;
inserting the objects in different positions or sizes on the two or more types of editing areas;
The electronic device is configured to save the opened multi-view video in which the object is inserted at the different position or size according to the two or more types of editing areas as the one file. In the video editing method,
if the multi-view video is opened for editing, providing a preview of the opened multi-view video in an editing area having an aspect ratio corresponding to the opened multi-view video;
providing a guide for inserting an object into the editing area based on a field of view (FOV) applied when the opened multi-view video is reproduced;
outputting a notification when the object is inserted at a location out of the guide;
inserting the object into the opened multi-view video; and
and saving the opened multi-view video into which the object is inserted as a single file. A computer recording medium in which computer readable instructions are stored and executed by at least one processor,
The command is
if the multi-view video is opened for editing, providing a preview of the opened multi-view video in an editing area having an aspect ratio corresponding to the opened multi-view video;
providing a guide for inserting an object into the editing area based on a field of view (FOV) applied when the opened multi-view video is reproduced;
outputting a notification when the object is inserted at a location out of the guide;
inserting the object into the opened multi-view video; and
A computer recording medium configured to perform an operation of saving the opened multi-view video into which the object is inserted as a single file.

Images