KR102446194B1 - Terminal, method for contrlling thereof and recording medium on which a program for implemeting the method - Google Patents

Abstract

In response to a camera, a display for outputting a live area generated by processing data input from the camera in real time, and a first user input for selecting a first location of the live area, the terminal of the present disclosure controls the camera and a control unit for performing photographing of the main content through the control unit and controlling the subsequently additionally photographed or recorded first additional content to be linked to an insert point on the main content, wherein the control unit includes: In response to a second user input for selecting an insert point on the main content, the first additional content may be controlled to be output, and the position of the insert point on the main content may be set to be the same as the selected first position. .

Description

A terminal, a control method thereof, and a recording medium recording a program for implementing the method

The present disclosure provides an input for selecting an insert point on the main content in a state in which the main content is output by performing additional content association with the main content based on the shooting/recording and the inserting point of the main content in the capturing/recording step of the content. It relates to a terminal for outputting additional content in response to this and a method for controlling the same.

Conventionally, in order to output additional content in response to an input for selecting an insert point of the main content, the pre-stored main content and the pre-stored addition are performed in the stage where the content shooting/recording is already completed rather than the content shooting/recording stage. Separate programming was required to link the content based on the insert point. In this case, a separate task of linking contents after shooting/recording is required, and new programming is required every time linking is performed. Accordingly, the efficiency is reduced in terms of time and cost, and there is a cumbersome aspect.

In addition, since the main content and the additional content must be filmed/recorded separately, the main content and the additional content cannot be filmed/recorded at the same time. There was a disadvantage in that it was not possible to adaptively select whether to record or not.

Accordingly, in the present disclosure, a separate programming process after storage is omitted by simultaneously performing shooting/recording of main content and linking of main content and additional content in the content capturing/recording step.

In addition, in the content shooting/recording step, shooting/recording of main content and shooting/recording of additional content can be simultaneously performed, so that a plurality of contents can be shot/recorded simultaneously or separately.

The terminal of the present disclosure includes a camera; a display for outputting a live area generated by processing data input from the camera in real time; In response to a first user input for selecting the first location of the live area, the main content is captured through the camera, and the additionally captured or recorded first additional content is subsequently recorded at an insert point on the main content. a control unit for controlling to be linked, wherein the control unit controls the output of the first additional content in response to a second user input for selecting an insert point on the main content in a state in which the main content is output, , the position of the insert point on the main content may be set to be the same as the selected first position.

In the terminal of the present disclosure, after the main content is captured, the control unit selects a second location of the live area while the display outputs the live area for photographing or recording the first additional content in response to a third user input to perform shooting or recording of the first additional content through the camera, and subsequently capturing or recording second additional content to be linked to an insert point on the first additional content and the control unit, in a state in which the first additional content is output, controls to output the second additional content in response to a third user input for selecting an insert point on the first additional content, and The position of the insert point on the first additional content may be set to be the same as the selected second position.

In the terminal of the present disclosure, the camera includes a first camera unit for wide-angle photographing or recording, and a second camera unit for enlarged photographing or recording, and in response to the first user input, photographing the main content and capturing or recording the first additional content, wherein the capturing of the main content is performed through any one of the first camera unit and the second camera unit, and the photographing or recording of the first additional content is , can be done through the other one.

In the terminal of the present disclosure, the first user input is to touch one of at least one candidate, and the at least one candidate is set based on an insert point set in a second main content different from the main content. can

In the terminal of the present disclosure, the first additional content may be an enlarged photographing or recording of a focused portion on the live area.

In the terminal of the present disclosure, in response to a second user input for selecting a plurality of positions of the live area, the main content is captured through the camera, and the first additional content is additionally captured or recorded subsequently. a control unit for controlling to be linked to an insert point on the main content, wherein the control unit selects an insert point associated with the first additional content on the main content in a state in which the main content is output to a third user input In response, the first additional content may be controlled to be output, and the position of the insert point associated with the first additional content on the main content may be set to be the same as any one of the plurality of positions.

In the terminal of the present disclosure, any one of the plurality of first locations may have the highest matching rate with the first additional content among things corresponding to each of the plurality of first locations.

In the terminal of the present disclosure, when the first user input is a touch input for dragging in one direction on the live area, a position first touched by the touch input is selected as the first position, and the drag direction of the touch input is selected as the first position. In the first direction, the first additional content may be set as a still picture type, and in the second direction, the first additional content may be set as a moving picture type.

The terminal of the present disclosure includes a camera; a display for outputting a live area generated by processing data input from the camera in real time; In response to a first user input for selecting the first location of the live area, recording of the main content of the video type is performed through the camera, and the first additional content additionally captured subsequently is inserted at an insert point on the main content a control unit for controlling to be linked to, wherein the control unit controls the output of the first additional content in response to a second user input for selecting an insert point on the main content while the main content is output and an insert point on the main content may be set to be the same as the selected first position.

In the terminal of the present disclosure, after the main content is recorded, the control unit selects a second location of the live area while the display outputs the live area for shooting or recording the first additional content in response to a third user input to perform shooting or recording of the first additional content through the camera, and subsequently capturing or recording second additional content to be linked to an insert point on the first additional content and the control unit, in a state in which the first additional content is output, controls to output the second additional content in response to a third user input for selecting an insert point on the first additional content, and The position of the insert point on the first additional content may be set to be the same as the selected second position.

In the terminal of the present disclosure, the camera includes a first camera unit for wide-angle photographing or recording and a second camera unit for enlarged photographing or recording, and in response to the first user input, recording of the main content and capturing or recording the first additional content, wherein the recording of the main content is performed through any one of the first camera unit and the second camera unit, and the photographing or recording of the first additional content is , can be done through the other one.

In the terminal of the present disclosure, the first user input is to touch one of at least one candidate, and the at least one candidate is set based on an insert point set in a second main content different from the main content. can

In the terminal of the present disclosure, the first additional content may be an enlarged photographing or recording of a focused portion on the live area.

In the terminal of the present disclosure, in response to a second user input for selecting a plurality of positions of the live area, recording of the main content is performed through the camera, and the first additional content additionally photographed or recorded subsequently is a control unit for controlling to be linked to an insert point on the main content, wherein the control unit selects an insert point associated with the first additional content on the main content in a state in which the main content is output to a third user input In response, the first additional content may be controlled to be output, and the position of the insert point associated with the first additional content on the main content may be set to be the same as any one of the plurality of positions.

In the terminal of the present disclosure, any one of the plurality of first locations may have the highest matching rate with the first additional content among things corresponding to each of the plurality of first locations.

In the terminal of the present disclosure, when the first user input is a touch input for dragging in one direction on the live area, a position first touched by the touch input is selected as the first position, and the drag direction of the touch input is selected as the first position. In the first direction, the first additional content may be set as a still picture type, and in the second direction, the first additional content may be set as a moving picture type.

The terminal control method and the recording medium recording the terminal control method of the present disclosure may include: a main content capturing step of capturing main content in response to a first user input for selecting a first location of a live area of a display; an insert point setting step of setting an insert point at the same location as the selected first location on the captured main content; and an associating step of associating the subsequently additionally photographed or recorded first additional content with the insert point, wherein the live area is an area generated by processing data input from a camera in real time, and on the main content The insert point may be characterized in that the first additional content is output in response to a second user input for selecting an insert point on the main content in a state in which the main content is output.

In the present disclosure, by performing shooting/recording of the main content and linking the main content and the additional content in parallel in the content shooting/recording step, the linking procedure can be simplified, and the efficiency of time and cost can be improved.

In the present disclosure, shooting/recording of main content and shooting/recording of additional content can be simultaneously performed in the shooting/recording step, so that, depending on the shooting/recording environment, whether to shoot/record a plurality of contents separately or simultaneously You can adaptively select whether to record or not.

1 is a block diagram of a terminal according to the present disclosure.
2 is a diagram illustrating an example of an image type content capturing screen.
3 is a diagram illustrating an example of a video-type content recording screen.
4 is a diagram illustrating a process of associating pre-stored additional content based on an insert point to pre-stored main content.
5 and 6 are diagrams illustrating an output form of main content stored in an image type.
7 illustrates an output form of additional content associated with the stored main content of the image type.
8 and 9 are diagrams illustrating an output form of stored main content of a moving picture type.
10 illustrates an output form of additional content associated with the main stored content of the moving picture type.
11 is a diagram illustrating a method of simultaneously capturing an image type of main content and setting an insert point on the main content.
12 is a diagram illustrating an example of a user input for capturing main content.
13 is a diagram illustrating an example of setting any one of at least one candidate as an insert point.
14 illustrates an embodiment in which a plurality of insert points are set by an input of simultaneously touching a plurality of points.
15 illustrates an embodiment in which a plurality of insert points are set by an input of sequentially touching a plurality of points.
16 shows an example of a user input for capturing additional content of an image type.
17 illustrates an example of a user input for recording additional content of a video type.
18 is a diagram illustrating a method of concurrently performing video-type main content recording and inserting point setting on the main content.
19 is a diagram illustrating an example of a user input for recording main content.
20 is a diagram illustrating an example of setting any one of at least one candidate as an insert point.
21 shows an embodiment in which a plurality of insert points are set by an input of simultaneously touching a plurality of points.
22 illustrates an embodiment in which a plurality of insert points are set by an input of sequentially touching a plurality of points.

Hereinafter, embodiments of the present disclosure will be described in detail with reference to the accompanying drawings so that those of ordinary skill in the art to which the present disclosure pertains can easily implement them. However, the present disclosure may be embodied in several different forms and is not limited to the embodiments described herein.

In describing the embodiments of the present disclosure, if it is determined that a detailed description of a well-known configuration or function may obscure the gist of the present disclosure, a detailed description thereof will be omitted. And, in the drawings, parts not related to the description of the present disclosure are omitted, and similar reference numerals are attached to similar parts.

In the present disclosure, when a component is "connected", "coupled" or "connected" to another component, it is not only a direct connection relationship, but also an indirect connection relationship in which another component exists in the middle. may also include. Also, when it is said that a component includes "includes" or "has" another component, it means that another component may be further included without excluding other components unless otherwise stated. .

In the present disclosure, terms such as first, second, etc. are used only for the purpose of distinguishing one component from other components, and unless otherwise specified, do not limit the order or importance between the components. Accordingly, within the scope of the present disclosure, a first component in one embodiment may be referred to as a second component in another embodiment, and similarly, a second component in one embodiment is referred to as a first component in another embodiment. can also be called

In the present disclosure, components that are distinguished from each other are for clearly explaining each characteristic, and do not necessarily mean that the components are separated. That is, a plurality of components may be integrated to form one hardware or software unit, or one component may be distributed to form a plurality of hardware or software units. Accordingly, even if not specifically mentioned, such integrated or dispersed embodiments are also included in the scope of the present disclosure.

In the present disclosure, components described in various embodiments do not necessarily mean essential components, and some may be optional components. Accordingly, an embodiment composed of a subset of components described in one embodiment is also included in the scope of the present disclosure. In addition, embodiments including other components in addition to components described in various embodiments are also included in the scope of the present disclosure.

The content of the present disclosure may include not only text-based content, but also multimedia content such as images, videos, and music.

The content described in the present disclosure is an image (eg, a file having an extension such as jpg, gif, tif, or bmp) or a video (eg, a file having an extension such as mpeg, avi, mp4, wmv or mov) It may include multimedia content, such as, and will be described based on this. However, the content is a presentation document (eg, a file with an extension of ppt(x)) other than multimedia content, a spreadsheet document (eg, a file with an extension of xsl(x)), a word processing document (eg, For example, a file with an extension of doc(x), hwp, txt or pdf), a website (eg, a file with an extension of html), or an e-book (eg, a file with an extension such as epub), etc. of text-based content.

Among the contents of the present disclosure, the contents interconnected by the insert point may be divided into main content and additional content.

The additional content of the present disclosure may be content linked to an insert point included in the main content and output in response to a user input to the insert point. In addition, when the main content is stored, the coordinates of the insert point associated with the main content and the additional content may be stored in association. As an example, the coordinates of the insert point and link information of additional content associated with the insert point may be included on the metadata of the main content. For example, the main content and the additional content may be merged and stored into one file, and the header of the insert point and link information of the additional content may be included in the merged file header.

The main content of the present disclosure may mean content including at least one insert point.

As an example of the present disclosure, when an insert point linking the first additional content and the second additional content is set in the first additional content associated with the main content, in the relationship between the second additional content and the first additional content, the first addition The content may perform the role of the main content. That is, the additional content may also be the main content in relation to other additional content.

1 is a block diagram of a terminal according to the present disclosure.

The terminal described in the present disclosure may be a mobile terminal such as a smart phone, a tablet PC (Personal Computer), a laptop, or a PDA (Personal Digital Assistants), or a fixed terminal such as a PC (Personal Computer) or a smart TV. have. However, for convenience of description, it is assumed that the terminal is a mobile terminal in the drawings and embodiments to be described later.

Referring to FIG. 1 , a terminal according to the present disclosure may include a communication unit 110 , a camera 120 , a user input unit 130 , a display 140 , a memory 150 , and a control unit 160 .

The communication unit 110 allows the terminal to communicate with other terminals. The communication unit 110 may perform communication in a wireless manner or may perform communication in a wired manner. For example, in order to perform communication in a wireless manner, the communication unit 110 may include at least one of a mobile communication module and a wireless Internet module. The mobile communication module is for performing communication through a mobile communication base station such as LTE, HSDPA or CDMA, and the wireless Internet module is for performing communication through a wireless LAN (Wi-Fi). The wired method may include LAN, USB, HDMI, RGB or DVI.

The camera 120 may perform a process of photographing a subject based on input infrared or visible light, converting it into an electrical signal, and storing the image or video file format. The camera 120 includes at least one camera unit, and each camera unit may capture or record content. In addition, the camera unit may include a camera unit for wide-angle photographing/recording and a camera unit for enlarged photographing/recording.

The user input unit 130 may receive a user input. The user input unit 130 includes a button input unit that receives a button input in the form of a button exposed on the outside of the terminal, a touch input unit that receives a touch input that touches the display 140 , and a motion sensor that monitors movement. It may include at least one of an input unit or an audio input unit that receives an audio input (eg, a voice input) from an audio recognition sensor.

The touch input unit may include at least one touch sensor for receiving a touch input. In this case, when the display 140 and the touch input unit form a mutually layered structure, such a structure may be referred to as a 'display'. In such a display structure, various types of touch inputs such as selecting or dragging an object output on the display may be received using a pointer.

The motion input unit may include at least one or more motion recognition sensors for receiving the motion input. Through the motion sensor, various motion inputs specified by at least one of a type of motion, a position, a vector, a motion input time, or the number of motion inputs may be received. As another example, the controller 160 may analyze a user's motion through an image input through the camera 120 and receive a motion input based on a result of the analysis.

The motion input unit may include at least one gyro sensor or an acceleration sensor for receiving a motion input of the terminal itself. Various motion inputs specified by at least one of a position of the terminal, a motion vector, a motion input time, and a motion type may be received through the gyro sensor or the acceleration sensor.

The motion input unit may include at least one or more biosensors for receiving the eye motion input. Through the biosensor, various motion inputs specified by at least one of the user's eye position, motion type, motion vector, and motion input time may be received.

The display 140 outputs information processed by the terminal. For example, the display 140 serves to output an execution screen of an application driven in the terminal, a user interface on the execution screen, or a graphic user interface. When the application relates to camera photography, the execution screen may include a screen to be photographed or photographed by the camera.

The memory 150 stores data for application execution and data processed in the terminal. The memory 150 is a hard disk, a solid state disk (SSD), a flash memory 150 (Flash Memory), a card-type storage device (eg, SD or XD memory 150, etc.), RAM (Random Access Memory) ) or ROM (Read Only Memory) may include at least one storage medium. Web storage that can be accessed remotely through the communication unit 110 may also be included in the category of the memory 150 .

The controller 160 controls the overall operation of the terminal. The controller 160 may process signals, data, or information input or output through components constituting the terminal. In addition, the controller 160 may execute an application stored in the memory 150 . The controller 160 may include an operation/control device such as a central processing unit (CPU), a graphic processing unit (GPU), a micro controller unit (MCU), or a micro processing unit (MPU).

The terminal does not have to include all the components shown in FIG. 1 , and some of the components shown in FIG. 1 may not be included depending on the implementation. The present disclosure will be described in detail based on the above description.

The user input of the present disclosure may be at least one of a touch input, a button input, a motion input, and an audio input. That is, the input of the present disclosure may also include a combination of different types of inputs (touch input, button input, motion input, audio input, etc.).

The touch input may be an input received by a touch sensor of the touch input unit of the terminal. The touch input may be specified by at least one of a touch position, a touch pattern, a touch intensity (touch pressure), a touch time, or the number of touches.

The button input may be an input received by a button input unit of the terminal. The button input may be specified by at least one of a button type, the number of buttons, a button pattern, an input strength (input pressure), an input time, or the number of times of input.

The motion input may be an input received by a motion sensor of a motion input unit of the terminal. The motion input may be specified by at least one of a motion position, a motion recognition shape, a motion vector, a motion input time, or the number of motion inputs.

For example, when the motion input is a motion input of the terminal itself, the terminal itself can be determined by at least one of the location of the terminal, the shape of the motion recognition of the terminal, the motion vector of the terminal, the time of inputting the motion of the terminal, the number of times of inputting the motion of the terminal, and the like. A motion input may be specified. For example, when the motion input is an eye motion input, the eye motion input may be specified by at least one of a position of an eye motion, an eye motion recognition shape, an eye motion vector, an eye motion input time, or the number of eye motion input. have.

The audio input may be an input received by an audio recognition sensor of an audio input unit of the terminal. The audio input may be specified by at least one of an amplitude of an audio frequency, a waveform, a period, or audio content, and the like.

Hereinafter, description is mainly based on a touch input, but the description may be applied to other user inputs (such as a button input, a motion input, or an audio input) other than the touch input.

2 is a diagram illustrating an example of an image type content capturing screen.

The content capturing screen may be a screen output to a display for capturing an image when the content type is an image. The content capturing screen may include at least one of a live area, a preview area, an execution area of a shooting command, and an area related to shooting settings.

FIG. 2(a) is an example of a content shooting screen, and a preview area 201, a live area 202, an execution area 203 for shooting commands, and an area 204 for shooting settings are output. 2(b) is an example of another content shooting screen, in which a preview area 211, a live area 212, a shooting command execution area 213, and a shooting setting area 214 are output. shows what to do

The live area may be an area for outputting an image based on data input to the camera in real time. The live area may be output to an area 202 separate from the preview area 201 as shown in FIG. 2(a) or may be output in a pop-up window format 212 on the preview area 211 as shown in FIG. 2(b). Here, the pop-up window may be moved by a touch input and may be sized.

The preview area may be an area in which the content to be captured and the content linked based on the insert point are output. Also, in the preview area, a mark (a dot, a number, etc.) indicating an insertion point of the content together with the content may be output. The indication of the insert point may be output at the position of the corresponding insert point. In the example of (a) (b) of FIG. 2 , the content associated with the content to be photographed is output together with the dot indicating the insert point in the preview areas 201 and 211 .

In the execution area of the photographing command, when a touch input is applied to the execution area of the photographing command, a photographing command set in the execution area of the photographing command may be executed. For example, if there is a touch input in the execution area of the photographing command, a photographing command set in the execution area of the photographing command may be executed, and image photographing may be performed through the camera. In the example of FIG. 2(a)(b), a button shape for executing an image capturing command is output to the image capturing command execution areas 203 and 213 .

In the photographing setting area, when a touch input is applied to the photographing setting area, a command (eg, brightness, contrast, saturation, focal length change command) set in the photographing setting area may be executed. Accordingly, it is possible to change the shooting settings (brightness, contrast, saturation, focal length, etc.) through a touch input in the region related to the shooting setting.

3 is a diagram illustrating an example of a video-type content recording screen.

The content recording screen may be a screen output to a display for recording a video when the content type is a video. The content recording screen may include at least one of a live area, a preview area, a recording-related command execution area, and a recording setting area.

3(a) is an example of a content recording screen, showing a preview area 301, a live area 302, an execution area 303 for recording-related commands, and an area 304 for recording settings. 3(b) is an example of another content recording screen, a preview area 311, a live area 312, a recording-related command execution area 313, and a recording setting area 314. shows the output.

The live area may be an area for outputting an image based on data input to the camera in real time. The live area may be output to an area 302 separate from the preview area 301 as shown in FIG. 3A , or may be output in the form of a pop-up window 312 on the preview area 311 as shown in FIG. 3B . Here, the pop-up window may be moved by a touch input and may be sized.

The preview area may be an area in which the content to be captured and the content linked based on the insert point are output. Also, in the preview area, a mark (a dot, a number, etc.) indicating an insertion point of the content together with the content may be output. The indication of the insert point may be output at the position of the corresponding insert point. In the example of (a) (b) of FIG. 3 , the content associated with the content to be photographed is output together with the dot indicating the insert point in the preview areas 301 and 311 .

In the execution area of the recording-related command, when there is a touch input in the execution area of the recording-related command, the recording-related command (recording start command, recording pause command, recording resume command, or recording end command) set in the execution area of the recording-related command etc.) can be executed. For example, if there is a touch input in the execution area of the recording-related command, the recording-related command set in the execution area of the recording-related command is executed, and the start/pause/resume/end of video recording through the camera is performed. can In the example of Fig. 3(a)(b), a button shape for executing a video recording start command is output to the execution areas 303 and 313 of the recording related command.

In the recording setting area, when a touch input is applied to the recording setting area, a command (eg, brightness, contrast, saturation, focal length change command) set in the recording setting area may be executed. For example, the recording settings (brightness, contrast, saturation, focal length, etc.) may be changed through a touch input in the recording setting area.

4 is a diagram illustrating a process of associating pre-stored additional content based on an insert point to pre-stored main content.

The controller 160 may set an insert point of the pre-stored main content through editing of the pre-stored main content, and link the pre-stored additional content to the pre-stored main content based on the set insert point. .

Referring to FIG. 4 , the controller 160 may output the pre-stored main content to the display for editing of the pre-stored main content. While the pre-stored main content is being output to the display for editing of the pre-stored main content, the controller 160 executes an insert point setting command in response to a user input for setting the insert point to set the insert point. can Here, the insert point may be a link between the pre-stored main content and the pre-stored additional content.

When an insert point is set in the pre-stored main content, the control unit 160, in response to a user input for selecting pre-stored additional content to be linked to the pre-stored main content based on the insert point, the user Additional content selected by input may be associated with the pre-stored main content based on the insert point.

In the example of FIG. 4, while the pre-stored main content for editing the main content is output to the display (401), the insert point can be set through the touch input 402 for setting the insert point, and at the set insert point By the touch input 404 for selecting the pre-stored additional content 403 to be associated, it is possible to associate the main content with the selected additional content.

5 and 6 are diagrams illustrating an output form of main content stored in an image type.

When outputting the main content to the display 140 , the controller 160 may output a mark (a dot, a number, etc.) indicating an insert point on the main content together with the main content.

Referring to FIG. 5A , the insertion point of the main content may be displayed as a dot 501 on the main content and output together with the main content. When there are a plurality of insert points of the main content, each insert point may be displayed as a dot on the main content and output together with the main content. That is, a plurality of points may be output on the main content to identify each insert point. The controller 160 may output additional content associated with the insert point indicated by the corresponding dot in response to a touch input to the dot indicating the inserting point on the output main content.

Referring to FIG. 5B , the insertion point of the main content may be displayed as numbers 502 and 503 on the main content and output together with the main content. When there are a plurality of insert points of the main content, each insert point may be displayed as a number on the main content and output together with the main content. That is, a plurality of numbers may be output on the main content to identify each insert point. The number indicating the insert point may be determined by a user input or may be automatically determined according to an order in which the insert point is set. As an example of the latter case, the first insert point initially set on the main content may be displayed 502 on the main content as the number '1'. The second insert point set next to the first insert point may be displayed 503 on the main content as the number '2'. In response to a touch input for a number indicating an insert point on the output main content, the controller 160 may output additional content associated with the insert point of the corresponding number.

Referring to FIG. 6 , the number of insert points of the main content may be output together with the main content. In FIG. 6(a) , the number of insert points '4' of the main content is output at the lower right of the screen together with the main content. The controller 160 may output the number of insert points on the screen in response to a touch input for the number of insert points. In Figure 6 (b), in response to the touch input 601 for the part '4' indicating the number of insert points, numbers 1, 2, 3, and 4 of the insert point of the main content are output at the bottom of the screen and have. The controller 160 may display the insert point of each number as a dot in response to the output number of the insert point, or may output additional content associated with the insert point of each number. In FIG. 6(c) , in response to the touch input 602 for the number '2' of the insert point, additional content 603 associated with the insert point corresponding to the number '2' of the insert point is output. .

7 illustrates an output form of additional content associated with the stored main content of the image type.

The form in which the additional content is output includes output to the full screen of the display (FIG. 7(a)), output to a partial area (FIG. 7(b)), or output to a pop-up window (FIG. 7(c)), etc. may include

When the additional content is output to the partial region, it may indicate that the additional content is output to the second region while the output of the main content is maintained in the first region of the display. In this case, the first area and the second area may partially overlap.

When the additional content is output as a pop-up window, it may indicate that the additional content is output to the pop-up window area overlaid on the main content while the output of the main content is maintained on the entire screen or a partial area of the display. Here, the pop-up window may be moved by a touch input and may be sized.

8 and 9 are diagrams illustrating an output form of stored main content of a moving picture type.

When outputting the main content to the display 140 , the controller 160 displays a display (a dot, a number, etc.) indicating an insertion point of the main content together with the main content during the running time of the main content. It can be printed during the valid time of the point.

Referring to FIG. 8(a) , the insert point of the main content may be displayed as a dot 801 on the main content during the effective time of the corresponding insert point during the running time of the main content, and may be output together with the main content. When there are a plurality of insert points of the main content, each insert point may be displayed as a dot on the main content during the effective time of each insert point, and may be output together with the main content. That is, a plurality of points may be output on the main content to identify each insert point. The controller 160 may output additional content associated with the insert point indicated by the corresponding dot in response to a touch input to the dot indicating the inserting point on the output main content.

Referring to FIG. 8(b), the insert point of the main content is displayed as numbers 802 and 803 on the main content during the effective time of the corresponding insert point during the running time of the main content, and can be output together with the main content. have. When there are a plurality of insert points of the main content, each insert point may be displayed as a number on the main content during the effective time of each insert point, and may be output together with the main content. That is, a plurality of numbers may be output on the main content to identify each insert point. The number indicating the insert point may be determined by a user input or may be automatically determined according to an order in which the insert point is set. As an example of the latter case, the first insert point initially set on the main content may be displayed 802 on the main content as the number '1'. The second insert point set next to the first insert point may be displayed 803 on the main content as the number '2'. In response to a touch input for a number indicating an insert point on the output main content, the controller 160 may output additional content associated with the insert point of the corresponding number.

Referring to FIG. 9 , the number of insert points of the main content may be output together with the main content. In FIG. 9(a) , the number of insert points '4' of the main content is output at the lower right of the screen together with the main content. The controller 160 may output the number of insert points on the screen in response to a touch input for the number of insert points. In Figure 9 (b), in response to the touch input 901 for the part '4' indicating the number of insert points, numbers 1, 2, 3, and 4 of the insert point of the main content are output at the bottom of the screen, and have. The controller 160 may display the insert point of each number as a dot in response to the output number of the insert point, or may output additional content associated with the insert point of each number. In FIG. 9(c), in response to the touch input 902 for the number '2' of the insert point, additional content 903 associated with the insert point corresponding to the number '2' of the insert point is output. .

The number of insert points of the main content output together with the main content may vary according to a running time at which the main content is output. For example, when the effective time of the first insert point is '00:05~00:10' and the effective time of the second insert point is '00:07~00:10', '00' in the running time of the main content During the time of :00~00:05', the number of insert points '0' is output, and during the time of '00:05~00:07' during the running time of the main content, the number of insert points '1' is output and, during a time of '00:07 to 00:10' among the running time of the main content, the number of insert points '2' may be output.

When the effective time of the insert point is discontinuous and includes a plurality of continuous sections (time sections), in response to a user input for outputting additional content, additional content can be output only in the plurality of continuous sections have.

For example, in response to a user input for outputting additional content, if the end point of the first section arrives while the additional content is output in the first section, the additional content will not be output until just before the start time of the second section. can In this case, from the start time of the second section to the end time of the second section, the additional content may be output again without a user input for separately outputting the additional content.

10 illustrates an output form of additional content associated with the main stored content of the moving picture type.

The form in which the additional content is output includes output to the entire screen of the display (FIG. 10(a)), output to a partial area (FIG. 10(b), or output to a pop-up window (FIG. 10(c)), etc. can do.

When the additional content is output to the partial region, it may indicate that the additional content is output to the second region while the output of the main content is maintained in the first region of the display. In this case, the first area and the second area may partially overlap.

When the additional content is output as a pop-up window, it may indicate that the additional content is output to the pop-up window area overlaid on the main content while the output of the main content is maintained on the entire screen or a partial area of the display. Here, the pop-up window may be moved by a touch input and may be sized.

The output of the additional content may be output only during the effective time of the associated insertion point of the additional content during the running time of the main content. Accordingly, while the additional content is being output, when the effective time of the insert point associated with the additional content is expired, the output of the additional content may be terminated.

The embodiment of linking the pre-stored additional content to the aforementioned pre-stored main content is, after shooting/recording and storage of the main content and shooting/recording and storage of the additional content are separately performed, linking the main content and the additional content I had to do an edit. That is, since filming/recording, storage, and editing of content are performed separately, efficiency is reduced in terms of time and cost, and there is a cumbersome aspect.

Accordingly, a new embodiment in which shooting/recording of content and setting of an insert point are performed in parallel is proposed below. Here, the content may be at least one of main content or additional content.

< When the main content is an image type >

11 is a diagram illustrating a method of simultaneously capturing an image type of main content and setting an insert point on the main content.

Referring to FIG. 11 , a method of simultaneously capturing an image type of main content and setting an insert point on the main content includes: capturing the main content (S1101); setting an insert point (S1102); shooting/recording additional content (S1103); or associating the main content with the additional content (S1104); may include at least one of

The step of photographing the main content ( S1101 ) may include, when there is a user input for photographing the main content, a command to photograph the main content is executed to perform the photographing of the main content.

A user input for capturing the main content may be distinguished from a user input for setting an insert point, which will be described later. For example, when both the user input for setting the insert point and the user input for capturing the main content are touch inputs to the live area of the content capturing screen for capturing the main content, the touch input for setting the insert point and the touch for capturing the main content The input may be different in at least one of a touch position, a touch pattern, a touch intensity (touch pressure), a touch time, or the number of touches. For example, the touch input for setting the insert point may be a long touch input input at the same location for a preset time or longer, and the touch input for the main content shooting command is input for less than a preset time at the same location It may be a short touch input. Conversely, the touch input for setting the insert point may be the short touch input, and the touch input for capturing the main content may be the long touch input.

An insert point setting command, which will be described later, may be executed by a user input for capturing the main content. That is, even if there is no user input for setting a separate insert point, both the main content capturing command and the inserting point setting command may be executed by one user input for capturing the main content. For example, when there is a touch input in the live area of the content capturing screen for main content capturing, a main content capturing command and an inserting point setting command may be executed. As another example, if there is a touch input in the execution region of the shooting command while the focused portion of the camera is output on the live region, the main content shooting command and the insert point setting command may be executed.

The step of setting the insert point ( S1102 ) may include, when there is a user input for setting the insert point, a command to set the insert point is executed and the insert point is set based on the user input.

The step of shooting/recording the additional content ( S1103 ) may include executing an additional content shooting command or at least one additional content recording related command when there is a user input for shooting/recording the additional content.

The step of associating the main content with the additional content ( S1104 ) may include associating the captured main content with the subsequent captured or recorded additional content based on a set insert point on the main content.

In response to a user input for capturing the main content, the controller 160 may execute a command for capturing the main content to perform main content capturing. In response to the user input for setting the insert point, the controller 160 may execute an insert point setting command to set the insert point based on the user input. In response to a user input for additional content shooting/recording, the controller 160 may execute an additional content shooting command or at least one additional content recording related command to perform additional content shooting/recording. When the additional content is photographed or recorded, the controller 160 may link the additional content based on an insert point set in the main content.

12 is a diagram illustrating an example of a user input for capturing main content.

Before capturing the main content is performed, a content capturing screen for capturing the main content may be output to the display. In response to a user input for capturing the main content, the controller 160 may execute a main content capturing command to perform main content capturing.

Referring to FIG. 12 , the user input for capturing the main content includes a touch input to the execution area of the capturing command of the content capturing screen for capturing the main content ( FIG. 12 ( a )) or a touch input to the live area ( 12(b)) may be included.

When the user input for shooting the main content is a touch input 1201 in the execution area of the shooting command of the content shooting screen for shooting the main content (FIG. 12(a)), the user input 1202 for setting the insert point This may be required separately.

When the user input for main content shooting is a touch input to the live area of the content shooting screen for main content shooting (FIG. 12(b)), insert point setting command by the user input 1203 for main content shooting can be executed, so there may be no need for user input for setting a separate insert point.

When there is a touch input in the live area for capturing the main content, the controller 160 may focus the camera on a portion corresponding to the corresponding position.

When the main content is captured, the screen output to the display may output a main content recording screen, an additional content capturing/recording screen, or a separate main content or additional content screen. The separate main content or additional content screen may include a case in which the main content or the additional content is output to the entire screen of the display, is output to a partial area, or is output to a pop-up window.

When the main content is an image type, the setting of the insert point of the main content may be performed by specifying the position of the corresponding insert point. When there are a plurality of insert points of the main content, setting of each insert point may be performed by specifying a position of each insert point. Here, the position of the insert point of the main content may be specified by one coordinate.

Referring to FIG. 12 ( b ) , the user input for setting the insert point may be a touch input to the live area of the content capturing screen for capturing the main content. In this case, the insert point may be set based on a touch input of the live area. For example, the insert point may be set to be the same as the touch input coordinates. As another example, the insert point may be set to all coordinates within a range having a predetermined shape based on the coordinates input by the touch. Here, the size of the predetermined shape may be pre-set or may be adaptively determined in consideration of a display screen ratio, an output ratio of content, and the like.

A user input for setting an insert point may be distinguished from a user input for capturing the main content. For example, when both the user input for setting the insert point and the user input for shooting the main content are performed as a touch input to the live area of the content shooting screen for shooting the main content, the touch input for setting the insert point and the main content shooting are performed. For the touch input, at least one of a touch position, a touch pattern, a touch intensity (touch pressure), a touch time, or the number of touches may be different. As described above, this will be omitted.

In response to a user input for setting an insert point, a command for capturing a main content may be executed. That is, even if there is no separate user input for capturing the main content, both the insert point setting command and the main content capturing command may be executed by one user input for setting the insert point. For example, when there is a touch input in the live area of the content capturing screen for main content capturing, a main content capturing command is executed to perform main content capturing, and an insert point setting command is executed to live of the captured main content. The insert point may be set to be the same as the coordinates that are touch-inputted into the region.

In response to a user input for setting an insert point, an additional content shooting command or at least one additional content recording related command may be executed. That is, even if there is no user input for additional content shooting/recording, by one user input for setting the insert point, an insert point setting command and additional content shooting or at least one additional content recording related command (eg, start recording) command and recording end command) can all be executed.

In addition, an additional content shooting command or at least one additional content recording related command may be executed along with the main content shooting command by a user input for setting the insert point. For example, if there is a touch input in the live area of the content capturing screen for main content capturing, the main content capturing command is executed to perform the main content capturing, and the insert point setting command is executed to display the captured main content live. The insert point is set to be the same as the coordinates inputted by the touch in the region, and an additional content shooting command or at least one additional content recording related command is executed to perform additional content shooting/recording for the coordinates where the touch input is located. . Here, the additional content shooting/recording includes capturing/recording by enlarging a portion to which a touch input is applied, and the magnification ratio may be a preset value or a value adaptively determined by the size of an object.

As described above, when the main content shooting and the additional content shooting/recording are performed in parallel, the main content shooting and the additional content shooting/recording may be sequentially performed by one camera unit. Alternatively, main content shooting and additional content shooting/recording may be performed by a plurality of camera units. In this case, the first camera unit among the plurality of camera units may photograph the main content, and the second camera unit may photograph/record the additional content. Here, the first camera unit may be either a camera unit for wide-angle photographing/recording or a camera unit for enlarged photographing/recording, and the second camera unit may be the other one.

When the user input for setting the insert point is a touch input for dragging in one direction on the live area, the controller 160 sets the insert point based on the first touched position, and selects additional content based on the dragged direction. You can set the type. Specifically, if the drag direction of the touch input is the first direction, the first additional content may be set as a still picture type, and if the drag direction of the touch input is the second direction, the first additional content may be set as a moving picture type.

When there is a touch input in the live area for setting the insert point, the controller 160 may focus the camera on a portion corresponding to the corresponding position.

13 is a diagram illustrating an example of setting any one of at least one candidate as an insert point.

Referring to FIG. 13B , the user input for setting the insert point may be a touch input 1314 of any one of at least one candidate. For example, at least one candidate may be output to the live area, and if there is a touch input to any one of the output at least one candidate, the touch input candidate may be set as an insert point.

Referring to FIG. 13 ( a ), at least one candidate is set based on an insert point set in main content (hereinafter, second main content) different from main content (hereinafter, first main content) in which an insert point is set. can be

As an example, coordinates corresponding to the coordinates of the insert point of the second main content may be output to the live area as a candidate for the insert point of the first main content. Specifically, referring to FIG. 13 , the first insert point candidate 1311 and the second insert point 1302 are at the coordinates of the first main content corresponding to the coordinates of the first insert point 1301 of the second main content. The second insert point candidate 1312 is outputted to the coordinates of the first main content corresponding to the coordinates, and the third insert point candidate 1313 is output to the coordinates of the first main content corresponding to the coordinates of the third insert point 1303. can be

Here, when the size and ratio of the first main content and the second main content are the same, the corresponding coordinates may be coordinates of the same position as the coordinates of the insertion point of the second main content. On the other hand, when at least one of the sizes or ratios of the first main content and the second main content is different, the corresponding coordinates may be coordinates in which the coordinates of the insert point of the second main content are changed according to at least one of the sizes or ratios. have.

As another example, when the same or similar thing as the thing located at the insert point of the second main content is included in the first main content, the coordinates of the same or similar thing in the first main content are the first main content's insert point. Candidates may be output to the live area.

Here, similar objects may include objects having similar at least one of color, size, type, shape, or angle. For example, if only the viewing angle is changed, the same object, an object having a different color, or an object having a different size may be included.

At least one candidate may be set based on another insert point of the main content in which the insert point is set. For example, coordinates of an object that is the same as or similar to an object located at another insert point of the main content may be output to the live area as a candidate for the insert point of the main content. Here, descriptions of similar objects are omitted as they have been described above.

A plurality of insert points may be set in the main content. Here, each of the plurality of insert points may be associated with additional content. The additional contents associated with the plurality of insert points may be different from or the same as each other. In the latter case, it may be associated with a plurality of insert points and one additional content. In addition, a plurality of additional content may be associated with one insert point.

Hereinafter, an embodiment in which a plurality of insert points are set will be described.

14 illustrates an embodiment in which a plurality of insert points are set by an input of simultaneously touching a plurality of points.

In a first embodiment, when the user input for setting the insert point is an input ( 1401 , 1402 ) for simultaneously touching a plurality of points on the live area of the content capturing screen for capturing the main content, the plurality of inserts point can be set. In this case, the plurality of insert points may be set based on the plurality of points touched on the live area. For example, the first insert point may be set to be the same as the coordinates of the first point among the plurality of points, and the second insert point may be set to be the same as the coordinates of the second point.

In this embodiment, when the main content shooting command is executed by the user input for setting the insert point, the main content shooting command and the inserting point setting command are executed by the user input, so that the main content shooting and the captured main A plurality of insert points may be set in the content.

In the present embodiment, when an additional content capturing command is executed by a user input for setting an insert point, a main content capturing command and a plurality of inserting point setting commands may be executed by the user input. In this case, the first additional content capturing may be performed by the input 1401 touching the first point among the plurality of points, and the second additional content capturing may be performed by the input 1402 touching the second point.

In the present embodiment, the user input for setting the insert point may include an input of simultaneously touching a plurality of candidates. In this case, a candidate selected by an input of touching a first point among the plurality of points may be set as the first insert point, and a candidate selected by an input of touching a second point may be set as the second insert point.

In this embodiment, the insert points may have an order. The order may be set manually or automatically. An example of manually setting may include arbitrarily setting an order by a user. An example of the automatic setting may include automatically setting in the order of being closest in distance based on at least one of the top, the bottom, the left, and the right.

15 illustrates an embodiment in which a plurality of insert points are set by an input of sequentially touching a plurality of points.

In a second embodiment, when the user input for setting the insert point is an input ( 1501 , 1502 ) for continuously touching a plurality of points on the live area of the content capturing screen for capturing the main content, the plurality of You can set the insert point of In this case, the plurality of insert points may be set based on the plurality of points touched on the live area. For example, the first insert point may be set to be the same as the coordinates of the first point among the plurality of points, and the second insert point may be set to be the same as the coordinates of the second point.

Specifically, in FIG. 15 , setting of the first insert point and capturing the main content may be performed at the same location as the coordinates of the first point by the touch input 1501 of the first point for setting the insert point. Thereafter, the second insert point at the same position as the coordinates of the second point may be performed by the touch input 1502 of the second point for setting the insert point.

In this embodiment, when the main content shooting command is executed by the user input for setting the insert point, the main content shooting command and the inserting point setting command are executed by the user input, so that the main content shooting and the captured main A plurality of insert points may be set in the content.

In the present embodiment, when an additional content capturing command is executed by a user input for setting an insert point, a main content capturing command and a plurality of inserting point setting commands may be executed by the user input. In this case, first additional content capturing may be performed by an input 1501 that touches a first point among a plurality of points, and second additional content capturing may be performed by an input 1502 that touches a second point.

In the present embodiment, the user input for setting the insert point may include an input of continuously touching a plurality of candidates. In this case, a candidate selected by an input of touching a first point among the plurality of points may be set as the first insert point, and a candidate selected by an input of touching a second point may be set as the second insert point.

In this embodiment, the insert points may have an order. The order may be set manually or automatically. An example of manually setting may include arbitrarily setting an order by a user. An example of the automatic setting may include automatically setting in the order of being closest in distance based on at least one of the top, the bottom, the left, and the right. As another example, the order may include automatically setting a plurality of consecutive touch inputs in the order in which they are input.

In the present embodiment, a last touch input among inputs for continuously touching a plurality of points for setting an insert point may be distinguished from other touch inputs. For example, the last touch input may be different from other touch inputs in at least one of a touch position, a touch pattern, a touch intensity (touch pressure), a touch time, or the number of touches. For example, the last touch input may be a long touch input input for more than a pre-set time. As another example, when the number of insert points to be set is determined, the touch input for setting the last number of insert points may be the last touch input. When there is a last touch input, insert point setting may be terminated. In this case, a content capturing screen for capturing additional content may be output to the display.

When a plurality of insert points have an order, in the output form of the main content, a number indicating the insert point may indicate the order. For example, the first set number of insert points may be indicated as '1', and the second set number of insert points may be indicated as '2'. That is, the number of insert points set to the k-th may be expressed as 'k'. Here, k may represent a natural number of 1 or more.

When the insert point setting is performed, the screen output to the display may output a main content recording screen, an additional content shooting/recording screen, or a separate main content or additional content screen. The separate main content or additional content screen may include a case in which the main content or the additional content is output to the entire screen of the display, is output to a partial area, or is output to a pop-up window.

As another example, only one insert point may be set by the inputs 1501 and 1502 that sequentially touch a plurality of points. In this case, after the touch input 1501 of the first point for setting the insert point, the setting of the first point as the first insert point is canceled by the touch input 1502 of the second point for setting the insert point, and , the second point may be set as the first insert point.

16 shows an example of a user input for capturing additional content of an image type.

In response to a user input for capturing additional content, the controller 160 may execute an additional content capturing command to perform additional content capturing.

The user input for capturing additional content includes an input for touching a live area of the content capturing screen for capturing additional content (FIG. 16(a)) or an input for touching an execution area of a shooting command (FIG. 16(b)). can do. In addition, the user input for capturing additional content may include an input for touching a live area in a pop-up window of a content capturing screen for capturing additional content (FIG. 16(c)). Here, the additional content may be an enlarged photograph of a focused portion on the live area.

The command for capturing additional content may be executed by a user input for setting an insert point or a user input for capturing the main content. When an additional content capturing command is executed by a user input for setting an insert point, an additional content capturing command of a portion corresponding to the corresponding insert point may be executed. In this case, since the insert point setting input is performed on the content capturing screen for capturing the main content, a separate content capturing screen for additional content may not be output on the display.

When additional content capturing is performed after a plurality of insert points are set in the main content, additional content capturing associated with the plurality of insert points may be performed according to the order of the plurality of insert points. For example, after shooting of additional content to be linked to a first insert point corresponding to a first order is performed, shooting of additional content to be linked to a second insert point corresponding to a second order may be performed.

It is preferable that the shooting of the additional content is performed after the setting of the insert point is performed, but the setting of the insert point may be performed after the shooting of the additional content is performed first.

An insert point setting command for setting an insert point in the first additional content may be executed by a user input for capturing the additional content (the first additional content). Here, the insertion point of the first additional content may be linking the first additional content and the second additional content. In this case, the first additional content may serve as the main content in relation to the second additional content.

17 illustrates an example of a user input for recording additional content of a video type.

In response to a user input for additional content recording, the controller 160 may execute at least one additional content recording related command (eg, a recording start command and a recording end command) to capture additional content. Here, the recording related command may include an additional content recording start command, a recording pause command, a recording resume command, and a recording end command.

The user input for additional content recording includes an input for touching the live area of the content recording screen for additional content recording (FIG. 17(a)) or an input for touching the execution area of a recording-related command (FIG. 17(b)). may include In addition, the user input for additional content recording may include an input for touching a live area in a pop-up window of a content recording screen for additional content recording (FIG. 17(c)). Here, the additional content may be an enlarged recording of a focused portion on the live area.

The command related to recording of the additional content may be executed by a user input for setting an insert point or a user input for recording the main content. When an additional content recording start command is executed by a user input for setting an insert point, an additional content recording start command of a portion corresponding to the corresponding insert point may be executed. In this case, since the insert point setting input is performed on the content capturing screen for capturing the main content, a separate content capturing screen for additional content may not be output on the display.

When additional content recording is performed after a plurality of insert points are set in the main content, additional content recording associated with the plurality of insert points may be performed according to the order of the plurality of insert points. For example, after recording of the additional content to be linked to the first insert point corresponding to the first order is performed, the recording of the additional content to be linked to the second insert point corresponding to the second order may be performed.

The recording of the additional content is preferably performed after the setting of the insert point is performed, but the setting of the insert point may be performed after the recording of the additional content is performed first.

An insert point setting command for setting an insert point in the first additional content may be executed by a user input for recording the additional content (the first additional content). Here, the insertion point of the first additional content may be linking the first additional content and the second additional content. In this case, the first additional content may serve as the main content in relation to the second additional content.

Associating the additional content based on the set insert point may include storing the additional content or link information of the additional content in the main content. Alternatively, it may include storing link information of the additional content separately from the main content. In this case, link information of the additional content may be obtained from the database based on key data of the main content.

Since the association of the main content and the additional content may be performed for each set insert point, when there are a plurality of insert points, the main content may be associated with at least one additional content.

In this case, any one of the plurality of insert points may be associated with the object corresponding to the one of the at least one additional content and the additional content having the highest matching rate. Here, the plurality of insert points may include those set to be the same as the coordinates of each position selected by simultaneous or sequential user input. Here, the matching rate may include a similarity rate between the additional content and the thing of any one of the plurality of insert points. The similarity rate may be determined in consideration of at least one of a color, an angle, a shape, a shape, a type, and a size.

When the main content and the additional content are linked, the output form of the main content may include outputting the main content and an insertion point of the main content to the display. In this case, when there is an input for the insert point of the main content, additional content associated with the insert point with the input may be output. Specific details thereof have been described above, and thus will be omitted.

The controller 160 may set a second insert point for the main content and the first additional content linked by the first insert point. Here, the second insert point may be a link between the first additional content and the second additional content. In this case, in the relationship between the first additional content and the second additional content, the first additional content may be main content, and the second additional content may be additional content associated with the main content. Accordingly, the above-described content regarding the main content and the additional content may be directly applied to the first additional content (role of the main content) and the second additional content (the role of the additional content).

For example, the user input for setting the second insertion point of the first additional content may include an input of touching a live area of a content capturing screen for capturing the first additional content or an input of touching an execution area of a shooting command. can Also, a user input for setting the second insert point may be distinguished from a user input for capturing the first additional content. Also, a shooting command of the first additional content may be executed by a user input for setting the second insert point. In addition, a second additional content shooting command or at least one second additional content recording related command may be executed by a user input for setting the second insert point. In addition, a second additional content shooting command or at least one second additional content recording related command may be executed together with the first additional content shooting command by a user input for setting the second insert point. Also, the user input for setting the second insert point may include an input of touching any one of at least one candidate. In addition, the first additional content may include a plurality of insert points, and the plurality of insert points may be set by simultaneously or sequentially touching a plurality of points in the live area.

< If the main content is a video type >

18 is a diagram illustrating a method of concurrently performing video-type main content recording and inserting point setting on the main content.

Referring to FIG. 18 , a method of concurrently performing recording of a video type main content and setting an insert point on the main content includes: recording the main content (S1801); setting an insert point (S1802); shooting/recording additional content (S1803); or associating the main content with the additional content (S1804); may include at least one of

In the step of recording the main content (S1801), at least one recording-related command (recording start command, recording pause command, recording resume command, or recording end command, etc.) by at least one user input for recording the main content. This may include performing recording of the main content by being executed.

The recording of the main content may be performed by a recording start command and a recording end command. Specifically, a recording start command is executed to start recording of the main content, and a recording end command is executed while recording is in progress to end the recording of the main content, so that the recording of the main content can be performed.

Between the recording start command and the recording end command, a recording pause command and a recording resume command may be further included. Here, the recording pause command and the recording resume command may not be essential commands for main content recording, unlike the recording start command and the recording end command.

A user input for recording the main content may be distinguished from a user input for setting an insert point, which will be described later. For example, when both the user input for setting the insert point and the user input for recording the main content are touch inputs to the live area of the content recording screen for recording the main content, the touch input for setting the insert point and the touch for recording the main content The input may be different in at least one of a touch position, a touch pattern, a touch intensity (touch pressure), a touch time, or the number of touches. For example, the touch input for setting the insert point may be a long touch input input for more than a preset time at the same location, and the touch input for recording the main content is a short input for less than a preset time at the same location. (short) may be a touch input. Conversely, the touch input for setting the insert point may be the short touch input, and the touch input for recording the main content may be the long touch input.

An insert point setting command, which will be described later, may be executed by a user input for recording the main content. That is, even if there is no user input for setting a separate insert point, at least one recording-related command and an insert point setting command may all be executed by the user input for recording the main content. For example, when a touch input is applied to a live area of a content recording screen for main content recording, at least one recording related command and an insert point setting command may be executed. As another example, if there is a touch input in the execution area of the recording-related command while the focused portion of the camera is output on the live area, the main content recording-related command and the insert point setting command may be executed.

The step of setting the insert point ( S1802 ) may include setting the insert point based on the user input by executing a command to set the insert point when there is a user input for setting the insert point.

The step of shooting/recording the additional content ( S1803 ) may include executing an additional content shooting command or at least one additional content recording related command when there is a user input for shooting/recording the additional content.

The step of associating the main content with the additional content ( S1804 ) may include associating the recorded main content with the subsequent shooting or recorded additional content based on a set insert point on the main content.

In response to at least one user input for main content recording, the controller 160 may execute at least one recording related command to perform main content recording. In response to the user input for setting the insert point, the controller 160 may execute an insert point setting command to set the insert point based on the user input. In response to a user input for additional content shooting/recording, the controller 160 may execute an additional content shooting command or at least one additional content recording related command to perform additional content shooting/recording. When the additional content is photographed or recorded, the controller 160 may link the additional content based on an insert point set in the main content.

19 is a diagram illustrating an example of a user input for recording main content.

Before recording of the main content is performed, a content recording screen for recording the main content may be output on the display. In response to at least one user input for recording the main content, the controller 160 executes at least one main content recording related command (eg, a recording start command and a recording end command) to perform the main content recording. have.

Referring to FIG. 19 , the user input for main content recording includes a touch input to an execution area of a recording related command of a content recording screen for main content recording (FIG. 19(a)) or a touch input to a live area (FIG. 19(b)) may be included.

When the user input for recording the main content is a touch input 1901 to the execution area of the recording related command of the content recording screen for recording the main content (FIG. 19(a)), the user input 1902 for setting the insert point ) may be required separately.

When the user input for main content recording is a touch input to the live area of the content shooting screen for main content recording (FIG. 19(b)), insert point setting command by the user input 1903 for main content recording can be executed, so there may be no need for user input for setting a separate insert point.

When there is a touch input in the live area for recording the main content, the controller 160 may focus the camera on a portion corresponding to the corresponding position.

The recording of the main content may be performed by a plurality of user inputs for recording the main content.

Specifically, the recording of the main content may be performed by a first user input for executing a recording start command and a second user input for executing a recording end command. That is, the recording of the main content may be started by the first user, and then the recording of the main content may be ended by the second user input, so that the recording of the main content may be performed.

The recording of the main content may be performed by one user input for recording the main content.

Specifically, the recording of the main content may be performed by executing a recording start command and a recording end command by one user input. That is, by one user input, recording of the main content is started, and then the recording of the main content is ended, so that the recording of the main content can be performed.

As a first embodiment, one user input for main content recording may be a long touch input. Specifically, a recording start command may be executed from the touch point to start recording of the main content, and a recording end command may be executed when the touch is released to end the recording of the main content.

In a second embodiment, either one of the recording start command or the recording end command is performed by a user input, and the other is automatically executed according to a pre-set condition, so that the main content recording can be performed. For example, when a recording start command is executed by one user input for recording the main content, the recording of the main content is started, and when a pre-set predetermined time elapses, the recording end command may be automatically executed and ended. Upon completion, recording of the main content may be performed.

When the recording of the main content is finished (or paused), the screen output to the display may output a main content recording screen, an additional content shooting/recording screen, or a separate main content or additional content screen. can The separate main content or additional content screen may include a case in which the main content or the additional content is output to the entire screen of the display, is output to a partial area, or is output to a pop-up window.

When the main content is a video type, the setting of the insert point of the main content may be performed by specifying the effective time and location of the corresponding insert point. When there are a plurality of insert points of the main content, setting of each insert point may be performed by specifying an effective time and location of each insert point. Here, the position of the insert point of the main content may be specified by one coordinate. Here, the effective time may be specified in units of at least one of hours, minutes, and seconds.

In the video-type main content, the effective time of the insert point may be specified as a start time (or a frame corresponding to the start time) of the effective time and an end time (or a frame corresponding to the end time) of the effective time. have. For example, if the start time of the effective time is '6 seconds' and the end time is '16 seconds', the effective time of the insert point is specified as '00:06 (6 seconds)~00:16 (16 seconds)'. can be

In addition, the effective time of the insert point may be specified by a start time (or a frame corresponding to the start time) of the effective time and a duration (or the number of frames corresponding to the duration) of the effective time. For example, if the starting point of the effective time is '6 seconds' and the duration is '10 seconds', the effective time of the insert point is specified as '00:06 (6 seconds)~00:16 (16 seconds)'. can be

When the effective time of the insert point is discontinuous, the discontinuous effective time includes a plurality of consecutive effective times. Therefore, if each effective time is specified, the effective time of the discontinuous insert point can be specified. For example, when the effective time of a discontinuous insert point includes three effective times, if the first, second, and third effective times are specified as a start time and an end time (or a start time and a duration), respectively, the discontinuous It is possible to specify the effective time of a specific insert point. Alternatively, since the effective time of the discontinuous insert point includes a plurality of consecutive invalid times, it can be specified by specifying each invalid time.

In the video-type main content, the position of the insert point during the effective time of the insert point may be specified by dividing the effective time into at least one section and specifying the position of the insert point for each section.

The position of the insert point within each section may be fixed. In this case, the position of the insert point may be specified by one coordinate. The position of the insert point within each section may be changed. In this case, the position of the insert point may be specified in the following embodiment.

As a first embodiment, the position of the insert point in each section may be specified by the coordinates of the insert point at the start time (or the frame corresponding to the start time) of the section and the insert coordinates at the changed time point. When there are a plurality of changing times, the position of the insert point can be specified by the coordinates of the insert point at the start time (or the frame corresponding to the start time) of the section and the coordinates of the insert point at each variable time point. have.

As a second embodiment, the position of the insert point in each section may be specified by a motion vector indicating the coordinates and movement of the insert point at the start time (or frame corresponding to the start time) of the section. Referring to FIG. X, the position of the insert point within the section has (x,y) as the starting position and has a velocity of (motion vector size)/(duration of the section) for the duration of the section. It can be characterized as a constant movement in a direction.

In a third embodiment, the position of the insert point within each section is the coordinates of the insert point at the start time (or the frame corresponding to the start time) of the section and the end point (or the frame corresponding to the end time) of the section at the end of the section. It can be specified by the coordinates of the insert point. Referring to FIG. X, the position of the insert point within the corresponding section may be specified as moving at a constant speed with (x1, y1) as a starting position and (x2, y2) as an ending position. Here, the speed may be determined by (a straight line distance between the coordinates of the start time and the coordinates of the end time)/(duration of the section).

Referring to FIG. 19(b) , a user input for setting an insert point may be a touch input on a live area of a content recording screen for main content recording. In this case, the insert point may be set based on a touch input of the live area. For example, the insert point may be set to be the same as the touch input coordinates. As another example, the insert point may be set to all coordinates within a range having a predetermined shape based on the coordinates input by the touch. Here, the size of the predetermined shape may be pre-set or may be adaptively determined in consideration of a display screen ratio, an output ratio of content, and the like.

A user input for setting an insert point may be distinguished from a user input for recording main content. For example, when both the user input for setting the insert point and the user input for recording the main content are performed as a touch input to the live area of the content shooting screen for shooting the main content, the touch input for setting the insert point and the main content shooting are performed. For the touch input, at least one of a touch position, a touch pattern, a touch intensity (touch pressure), a touch time, or the number of touches may be different. As described above, this will be omitted.

At least one recording related command may be executed by a user input for setting an insert point. That is, even if there is no separate user input for recording the main content, both the insert point setting command and at least one recording related command may be executed by one user input for setting the insert point.

As a first embodiment, the user input for setting the insert point may be a fixed short touch input. Here, the fixed short touch input may include input of the touch input at a fixed position for less than a preset time.

In this embodiment, by specifying the position and effective time of the insert point by the fixed short touch input, the insert point setting may be performed. Specifically, the effective time of the insert point may be specified to be the same as the time for a pre-set time from the time of the touch. Contrary to this, the effective time of the insert point may be specified from the time of the touch until the object at the position of the touch input disappears from the screen (frame out). Specifically, the position of the insert point may be specified by the same coordinates as the coordinates at which the touch input is applied. Alternatively, the position of the insert point may be specified by tracking the position of the object at the position of the touch input. The tracking may be performed during the validity time of the insert point.

In the present embodiment, a recording start command and a recording end command are executed by the fixed short touch input, so that the recording of the main content may be performed. Specifically, the recording start command is executed at the point of the touch, so that the recording of the main content is executed, and when a predetermined time has elapsed, the recording end command is automatically executed and terminated.

As a second embodiment, the user input for setting the insert point may be a fixed long touch input. Here, the fixed long touch input may include input of the touch input at a fixed position for a predetermined time or longer.

In this embodiment, by the fixed long touch input, the position of the insert point and the effective time are specified, and the insert point setting can be performed. Specifically, the position of the insert point may be specified by the same coordinates as the coordinates of the touch input at the point of time of the touch. Alternatively, the position of the insert point may be specified by tracking the position of the object at the position of the touch input. Specifically, the effective time of the insert point may be specified to be the same as the time from the point in time of the touch to the point in time when the touch is released. Alternatively, the effective time of the insert point may be specified to be the same as the time for a pre-set time from the point of the touch. Contrary to this, the effective time of the insert point may be specified from the time of the touch until the object at the position of the touch input disappears from the screen (frame out).

In the present embodiment, a recording start command and a recording end command are executed by the fixed long touch input, so that the main content can be recorded. Specifically, a recording start command may be executed at a point in time of the touch to start recording of the main content, and a recording end command may be executed at a point in time where the touch is released to end recording of the main content. Contrary to this, the recording start command is executed at the point of the touch, and the recording of the main content is executed, and when a predetermined time has elapsed, the recording end command is automatically executed and terminated.

As a third embodiment, the user input for setting the insert point may be a long drag touch input. Here, the long drag touch input may include inputting the touch input at a position where the touch input is not fixed for more than a preset time.

In this embodiment, by specifying the position and effective time of the insert point by the long drag touch input, the insert point setting may be performed. Specifically, the position of the insert point may be specified by the same coordinates as the coordinates of the touch input at the point of time of the touch. Contrary to this, as for the position of the insert point, the coordinates of the touch input at the time of touch are the starting positions of the insert point, and the coordinates of the touch input at the time of releasing the touch are the end positions of the insert point. It can be specified by a start position and an end position. On the other hand, as for the position of the insert point, the coordinates of the touch input at the time of touch are the start positions of the insert point, and the direction and speed of the touch input dragged from the start position is the direction and speed of the motion vector of the insert point. Thus, it can be specified by the start position of the insert point and the motion vector. Alternatively, the position of the insert point may be specified by tracking the position of the object at the position of the touch input. Specifically, the effective time of the insert point may be specified to be the same as the time from the point in time of the touch to the point in time when the touch is released. Alternatively, the effective time of the insert point may be specified to be the same as the time for a pre-set time from the point of the touch. Contrary to this, the effective time of the insert point may be specified from the time of the touch until the object at the position of the touch input disappears from the screen (frame out).

In the present embodiment, a recording start command and a recording end command are executed by the fixed long touch input, so that the main content can be recorded. Specifically, a recording start command may be executed at a point in time of the touch to start recording of the main content, and a recording end command may be executed at a point in time where the touch is released to end recording of the main content. Contrary to this, the recording start command is executed at the point of the touch, and the recording of the main content is executed, and when a predetermined time has elapsed, the recording end command is automatically executed and terminated.

In response to a user input for setting an insert point, an additional content shooting command or at least one additional content recording related command may be executed. That is, even if there is no user input for additional content shooting/recording, by one user input for setting the insert point, an insert point setting command and additional content shooting or at least one additional content recording related command (eg, start recording) command and recording end command) can all be executed.

In addition, an additional content recording command or at least one additional content recording related command may be executed along with at least one main content recording related command by a user input for setting an insert point. For example, when there is a touch input in the live area of the content recording screen for main content recording, at least one main content recording related command is executed to perform main content recording, and an insert point setting command is executed to execute the captured The insert point is set to be the same as the coordinates inputted by the touch in the live area of the main content, and an additional content shooting command or at least one additional content recording related command is executed, so that additional content shooting/recording for the coordinates with the touch input is performed. can be performed. Here, the additional content shooting/recording includes capturing/recording by enlarging a portion where a touch input is applied, and the magnification ratio may be a preset value or a value adaptively determined by the size of an object.

As described above, when the main content recording and the additional content shooting/recording are performed in parallel, the main content recording and the additional content shooting/recording may be sequentially performed by one camera unit. Alternatively, main content recording and additional content shooting/recording may be performed by a plurality of camera units. In this case, the first camera unit among the plurality of camera units may record main content, and the second camera unit may record/record additional content. Here, the first camera unit may be either a camera unit for wide-angle photographing/recording or a camera unit for enlarged photographing/recording, and the second camera unit may be the other one.

When the user input for setting the insert point is a touch input for dragging in one direction on the live area, the controller 160 sets the insert point based on the first touched position, and selects additional content based on the dragged direction. You can set the type. Specifically, if the drag direction of the touch input is the first direction, the first additional content may be set as a still picture type, and if the drag direction of the touch input is the second direction, the first additional content may be set as a moving picture type.

When there is a touch input in the live area for setting the insert point, the controller 160 may focus the camera on a portion corresponding to the corresponding position.

20 is a diagram illustrating an example of setting any one of at least one candidate as an insert point.

Referring to FIG. 20B , the user input for setting the insert point may be a touch input 2014 of any one of at least one candidate. For example, at least one candidate may be output to the live area, and if there is a touch input to any one of the output at least one candidate, the touch input candidate may be set as an insert point. That is, if there is the touch input, the coordinates and the effective time of the touch-input candidate may be the coordinates and the effective time of the insert point.

Referring to FIG. 20( a ), at least one candidate is set based on an insert point set in main content (hereinafter, second main content) different from main content (hereinafter, first main content) in which an insert point is set. can be

For example, a candidate for an insert point of the first main content having coordinates corresponding to the coordinates of the insert point of the second main content and having an effective time equal to the effective time of the insert point of the second main content is output to the live area. can Specifically, referring to FIG. 20 , the first insert point candidate 2011 and the second insert point 2002 are in the coordinates of the first main content corresponding to the coordinates of the first insert point 2001 of the second main content. The second insert point candidate 2012 is outputted to the coordinates of the first main content corresponding to the coordinates, and the third insert point candidate 2013 is output to the coordinates of the first main content corresponding to the coordinates of the third insert point 2003. can be

Here, when the size and ratio of the first main content and the second main content are the same, the corresponding coordinates may be coordinates of the same position as the coordinates of the insertion point of the second main content. On the other hand, when at least one of the sizes or ratios of the first main content and the second main content is different, the corresponding coordinates may be coordinates in which the coordinates of the insert point of the second main content are changed according to at least one of the sizes or ratios. have.

As another example, when the same or similar thing as the thing located at the insert point of the second main content is included in the first main content, the coordinates of the same or similar thing in the first main content are the first main content's insert point. Candidates may be output to the live area. Here, the effective time of the candidate of the insertion point of the first main content may be the same as the time at which the same or similar thing located at the coordinates of the candidate is output to the live area. For example, it may be specified from a point in time when there is a touch input for selecting a candidate to when an object at a position of the touch input disappears from the screen (frame out). Here, similar objects may include objects having similar at least one of color, size, type, shape, or angle. For example, if only the viewing angle is changed, the same object, an object having a different color, or an object having a different size may be included.

At least one candidate may be set based on another insert point of the main content in which the insert point is set. For example, coordinates of an object that is the same as or similar to an object located at another insert point of the main content may be output to the live area as a candidate for the insert point of the main content. Here, the other insert points may include an insert point that overlaps with a candidate for an insert point of the main content but has different coordinates and an insert point whose effective time does not overlap with a candidate of an insert point of the main content. Here, the effective time of the candidate of the insert point of the main content may be the same as the time when the same or similar object located at the coordinates of the candidate is output to the live area. Here, descriptions of similar objects are omitted as they have been described above.

A plurality of insert points may be set in the main content. Here, each of the plurality of insert points may be associated with additional content. The additional contents associated with the plurality of insert points may be different from or the same as each other. In the latter case, it may be associated with a plurality of insert points and one additional content. In addition, a plurality of additional content may be associated with one insert point.

The plurality of insert points may include insert points of different coordinates with overlapping effective times. Also, the plurality of insert points may include insert points having different effective times. In this case, since the effective times are different, the coordinates of the plurality of insert points may be the same.

Hereinafter, an embodiment in which a plurality of insert points are set will be described.

21 shows an embodiment in which a plurality of insert points are set by an input of simultaneously touching a plurality of points.

In a first embodiment, when the user input for setting the insert point is an input ( 2101 , 2102 ) for simultaneously touching a plurality of points on the live area of the content recording screen for recording the main content, the plurality of inserts point can be set. In this case, the plurality of insert points may be set based on the plurality of points touched on the live area. For example, the first insert point may be set to be the same as the coordinates of the first point among the plurality of points, and the second insert point may be set to be the same as the coordinates of the second point.

In the present embodiment, when at least one main content recording related command is executed by a user input for setting an insert point, at least one main content recording related command is executed to perform main content recording, and the insert point setting command is executed It may be executed to set a plurality of insert points in the recorded main content.

In the present embodiment, when an additional content shooting command or at least one additional content recording related command is executed by a user input for setting an insert point, along with a plurality of insert point setting commands, an additional content shooting command or at least one addition A content recording related command may be executed. At this time, the first additional content shooting/recording is performed by the input 2101 which touches the first point among the plurality of points, and the second additional content shooting/recording is performed by the input 2102 which touches the second point. can be

In the present embodiment, the user input for setting the insert point may include an input of simultaneously touching a plurality of candidates. In this case, a candidate selected by an input of touching a first point among the plurality of points may be set as the first insert point, and a candidate selected by an input of touching a second point may be set as the second insert point.

In this embodiment, the insert points may have an order. The order may be set manually or automatically. An example of manually setting may include arbitrarily setting an order by a user. An example of the automatic setting may include automatically setting in the order of being closest in distance based on at least one of the top, the bottom, the left, and the right.

22 illustrates an embodiment in which a plurality of insert points are set by an input of sequentially touching a plurality of points.

In a second embodiment, when the user input for setting the insert point is an input for continuously touching a plurality of points on the live area of the content recording screen for recording the main content, the controller 160 may set the plurality of insert points. can In this case, the plurality of insert points may be set based on the plurality of points touched on the live area. For example, the first insert point may be set to be the same as the coordinates of the first point among the plurality of points, and the second insert point may be set to be the same as the coordinates of the second point.

Specifically, in FIG. 22 , the setting of the first insert point and the recording start may be performed at the same position as the coordinates of the first point by the touch input 2201 of the first point for setting the insert point. Thereafter, by the touch input 2202 of the second point for setting the insert point, setting and recording pause (or stop recording) of the second insert point at the same position as the coordinates of the second point may be performed.

In the present embodiment, at least one of at least one main content recording related command or additional content capturing command may be executed by a user input for setting an insert point. Also, at least one of a main content recording command and an additional content recording related command may be executed by a user input for setting an insert point. Also, the input for setting the insert point may include an input for continuously touching a plurality of candidates.

In this embodiment, the insert points may have an order. The order may be set manually or automatically. An example of manually setting may include arbitrarily setting an order by a user. An example of the automatic setting may include automatically setting in the order of being closest in distance based on at least one of the top, the bottom, the left, and the right. As another example, the order may include automatically setting a plurality of consecutive touch inputs in the order in which they are input.

In the present embodiment, a last touch input among inputs for continuously touching a plurality of points for setting an insert point may be distinguished from other touch inputs. For example, the last touch input may be different from other touch inputs in at least one of a touch position, a touch pattern, a touch intensity (touch pressure), a touch time, or the number of touches. For example, the last touch input may be a long touch input input for more than a pre-set time. As another example, when the number of insert points to be set is determined, the touch input for setting the last number of insert points may be the last touch input. When there is a last touch input, insert point setting may be terminated. In this case, a content capturing screen for capturing additional content may be output to the display.

When a plurality of insert points have an order, in the output form of the main content, a number indicating the insert point may indicate the order. For example, the first set number of insert points may be indicated as '1', and the second set number of insert points may be indicated as '2'. That is, the number of insert points set to the k-th may be expressed as 'k'. Here, k may represent a natural number of 1 or more.

When the insert point setting is performed, the screen output to the display may output a main content recording screen, an additional content shooting/recording screen, or a separate main content or additional content screen. The separate main content or additional content screen may include a case in which the main content or the additional content is output to the entire screen of the display, is output to a partial area, or is output to a pop-up window.

As another example, only one insert point may be set by the inputs 2201 and 2202 that sequentially touch a plurality of points. In this case, after the touch input 2201 of the first point for setting the insert point, the setting of the first point as the first insert point is canceled by the touch input 2202 of the second point for setting the insert point, and , the second point may be set as the first insert point.

16 shows an example of a user input for capturing additional content of an image type.

In response to a user input for capturing additional content, the controller 160 may execute an additional content capturing command to perform additional content capturing.

The user input for capturing additional content includes an input for touching a live area of the content output screen for capturing additional content (FIG. 16(a)) or an input for touching an execution area of a shooting command (FIG. 16(b)). can do. In addition, the user input for capturing additional content may include an input for touching a live area in a pop-up window of a content output screen for capturing additional content ( FIG. 16( c ) ). Here, the additional content may be an enlarged photograph of a focused portion on the live area.

The command for capturing additional content may be executed by a user input for setting an insert point or a user input for capturing the main content. When an additional content capturing command is executed by a user input for setting an insert point, an additional content capturing command of a portion corresponding to the corresponding insert point may be executed. In this case, since the insert point setting input is performed on the content capturing screen for capturing the main content, a separate content capturing screen for additional content may not be output on the display.

When additional content capturing is performed after a plurality of insert points are set in the main content, additional content capturing associated with the plurality of insert points may be performed according to the order of the plurality of insert points. For example, after shooting of additional content to be linked to a first insert point corresponding to a first order is performed, shooting of additional content to be linked to a second insert point corresponding to a second order may be performed.

It is preferable that the shooting of the additional content is performed after the setting of the insert point is performed, but the setting of the insert point may be performed after the shooting of the additional content is performed first.

An insert point setting command for setting an insert point in the first additional content may be executed by a user input for capturing the additional content (the first additional content). Here, the insertion point of the first additional content may be linking the first additional content and the second additional content. In this case, the first additional content may serve as the main content in relation to the second additional content.

17 illustrates an example of a user input for recording additional content of a video type.

In response to a user input for additional content recording, the controller 160 may execute at least one additional content recording related command (eg, a recording start command and a recording end command) to capture additional content. Here, the recording related command may include an additional content recording start command, a recording pause command, a recording resume command, and a recording end command.

The user input for additional content recording includes an input for touching the live area of the content recording screen for additional content recording (eh 17(a)) or an input for touching the execution area of a recording-related command ( FIG. 17(b)). may include In addition, the user input for additional content recording may include an input for touching a live area in a pop-up window of a content output screen for additional content recording (FIG. 17(c)). Here, the additional content may be an enlarged recording of a focused portion on the live area.

The command related to recording of the additional content may be executed by a user input for setting an insert point or a user input for recording the main content. When an additional content recording start command is executed by a user input for setting an insert point, an additional content recording start command of a portion corresponding to the corresponding insert point may be executed. In this case, since the insert point setting input is performed on the content capturing screen for capturing the main content, a separate content capturing screen for additional content may not be output on the display.

When additional content recording is performed after a plurality of insert points are set in the main content, additional content recording associated with the plurality of insert points may be performed according to the order of the plurality of insert points. For example, after recording of the additional content to be linked to the first insert point corresponding to the first order is performed, the recording of the additional content to be linked to the second insert point corresponding to the second order may be performed.

The recording of the additional content is preferably performed after the setting of the insert point is performed, but the setting of the insert point may be performed after the recording of the additional content is performed first.

An insert point setting command for setting an insert point in the first additional content may be executed by a user input for recording the additional content (the first additional content). Here, the insertion point of the first additional content may be linking the first additional content and the second additional content. In this case, the first additional content may serve as the main content in relation to the second additional content.

Associating the additional content based on the set insert point may include storing the additional content or link information of the additional content in the main content. Alternatively, it may include storing link information of the additional content separately from the main content. In this case, link information of the additional content may be obtained from the database based on key data of the main content.

Since the association of the main content and the additional content may be performed for each set insert point, when there are a plurality of insert points, the main content may be associated with at least one additional content.

In this case, any one of the plurality of insert points may be associated with the object corresponding to the one of the at least one additional content and the additional content having the highest matching rate. Here, the plurality of insert points may include those set to be the same as the coordinates of each position selected by simultaneous or sequential user input. Here, the matching rate may include a similarity rate between the additional content and the thing of any one of the plurality of insert points. The similarity rate may be determined in consideration of at least one of a color, an angle, a shape, a shape, a type, and a size.

When the main content and the additional content are linked, the output form of the main content may include outputting the main content and an insertion point of the main content to the display. In this case, when there is an input for the insert point of the main content, additional content associated with the insert point with the input may be output. Specific details thereof have been described above, and thus will be omitted.

The controller 160 may set a second insert point for the main content and the first additional content linked by the first insert point. Here, the second insert point may be a link between the first additional content and the second additional content. In this case, in the relationship between the first additional content and the second additional content, the first additional content may be main content, and the second additional content may be additional content associated with the main content. Accordingly, the above-described content regarding the main content and the additional content may be directly applied to the first additional content (role of the main content) and the second additional content (the role of the additional content).

For example, the user input for setting the second insertion point of the first additional content includes an input of touching a live area of a content recording screen for recording the first additional content or an input of touching an execution area of a recording related command. can do. Also, a user input for setting the second insert point may be distinguished from a user input for recording the first additional content. Also, a command related to recording of at least one first additional content may be executed in response to a user input for setting the second insert point. In addition, a second additional content shooting command or at least one second additional content recording related command may be executed by a user input for setting the second insert point. In addition, a second additional content recording command or at least one second additional content recording related command may be executed along with at least one first additional content recording related command by a user input for setting the second insert point. Also, the user input for setting the second insert point may include an input of touching any one of at least one candidate. In addition, the first additional content may include a plurality of insert points, and the plurality of insert points may be set by simultaneously or sequentially touching a plurality of points in the live area.

The method for controlling a terminal in connection with capturing content according to an embodiment of the present disclosure may be implemented as a computer-readable recording medium including program instructions for performing various computer-implemented operations. The computer-readable recording medium may include program instructions, local data files, local data structures, and the like alone or in combination. The recording medium may be specially designed and configured for the embodiment of the present disclosure, or may be known and used by a person skilled in the art of computer software. Examples of the computer-readable recording medium include hard disks, magnetic media such as floppy disks and magnetic tapes, optical recording media such as CD-ROMs and DVDs, magneto-optical media such as floppy disks, and ROMs, RAMs, flash memories, and the like. Hardware devices specially configured to store and execute the same program instructions are included. The recording medium may be a transmission medium such as an optical or metal wire or a waveguide including a carrier wave for transmitting a signal designating a program command, a local data structure, or the like. Examples of program instructions may include not only machine language codes such as those generated by a compiler, but also high-level language codes that can be executed by a computer using an interpreter or the like.

The above description is merely illustrative of the technical spirit of the present disclosure, and various modifications and variations may be made by those of ordinary skill in the art to which the present disclosure belongs without departing from the essential characteristics of the present disclosure. In addition, the embodiments disclosed in the present disclosure are for explanation rather than limiting the technical spirit of the present disclosure, and the scope of the technical spirit of the present disclosure is not limited by these embodiments. Accordingly, the protection scope of the present disclosure should be construed by the following claims, and all technical ideas within the scope equivalent thereto should be construed as being included in the scope of the present disclosure.

110: communication unit 120: camera
130: microphone 140: user input unit
150: display unit 160: memory
170: control unit
201: Preview area 202: Live area
203: area for execution of shooting commands 204: area for shooting settings
211: Preview area 212: Live area in the form of a pop-up window
213: area for execution of shooting command 214: area for shooting settings
301: Preview area 302: Live area
303: Execution area of command related to recording
304: Area for recording settings
311: Preview area 312: Live area in the form of a pop-up window
313: Execution area of command related to recording
314: Area for recording settings
401: pre-stored main content 402: touch input for setting insert point
403: pre-stored additional content
404: Touch input to select pre-stored additional content
501: point marking the insert point
502, 503: numbers indicating insert points
601: touch input for the number of insert points
602: Touch input for number of insert point
603: Additional content corresponding to number '2' of insert point
801: point marking the insert point
802, 803: numbers indicating insert points
901: Touch input for the number of insert points
902: Touch input for number of insert point
903: Additional content corresponding to number '2' of insert point
S1101: main content shooting step S1102: insert point setting step
S1103: Additional content shooting/recording step
S1104: Main content and additional content association step
1201: Touch input to execution area of shooting command
1202: Touch input for insert point setting
1203: Touch input for shooting main content
1301, 1302, 1303: insert point of the second main content
1311, 1312, 1313: Candidates for insert points in the first main contest
1314: Touch input to select insert point candidates
1401, 1402: Input for simultaneously touching multiple points on the live area
1501, 1502: Input for consecutively touching multiple points on the live area
S1801: Main content recording step S1802: Insert point setting step
S1803: Additional content shooting/recording stage
S1804: Main content and additional content association step
1901: Touch input to execution area of recording related command
1902: Touch input for insert point setting
1903: Touch input for main content recording
2001, 2002, 2003: Insert point in the second main content
2011, 2012, 2013: Candidates for insert points in the 1st main contest
2014: Touch input to select insert point candidates
2101, 2102: Input for simultaneously touching multiple points on the live area
2201, 2202: Inputs for consecutively touching multiple points on the live area

Claims (18)

camera;
a display for outputting a live area generated by processing data input from the camera in real time;
In response to a first user input selecting a first location of the live area,
Through the camera, the main content of the image type corresponding to the live area being output to the display in real time is captured, and at the same time, additionally captured or recorded first additional content is subsequently recorded at the insert point on the main content. Including a control unit for controlling to be linked,
The control unit controls the output of the first additional content in response to a second user input for selecting an insert point on the main content in a state in which the main content is output,
The position of the insert point on the main content is characterized in that set to be the same as the selected first position, the terminal. According to claim 1,
The control unit, after the main content is photographed, while the display outputs the live area for photographing or recording the first additional content,
In response to a third user input for selecting the second location of the live area, the first additional content is photographed or recorded through the camera, and the second additionally photographed or recorded subsequent additional content is displayed as the second additional content. 1 Control to be linked to the insert point on the additional content,
The control unit controls to output the second additional content in response to a third user input for selecting an insert point on the first additional content while the first additional content is output;
The position of the insert point on the first additional content is characterized in that set to be the same as the selected second position, the terminal. According to claim 1,
The camera includes a first camera unit for wide-angle shooting or recording and a second camera unit for enlarged shooting or recording,
In response to the first user input, capturing the main content and capturing or recording the first additional content,
The photographing of the main content is performed through any one of the first camera unit and the second camera unit,
The first additional content shooting or recording, characterized in that performed through the other one, the terminal. According to claim 1,
The first user input is to touch one of the at least one candidate,
The at least one candidate is characterized in that it is set based on an insert point set in the second main content different from the main content, the terminal. According to claim 1,
The first additional content is characterized in that the enlarged photographing or recording of a focused portion on the live area, the terminal. The method of claim 1,
In response to a second user input for selecting a plurality of locations in the live area,
A control unit for performing photographing of the main content through the camera, and controlling the subsequent additionally captured or recorded first additional content to be linked to an insert point on the main content,
In a state in which the main content is output, the control unit controls the output of the first additional content in response to a third user input for selecting an insert point associated with the first additional content on the main content,
The position of the insert point associated with the first additional content on the main content is characterized in that set to be the same as any one of the plurality of positions, the terminal. 7. The method of claim 6,
Any one of the plurality of locations, the terminal, characterized in that the highest matching rate with the first additional content among the objects corresponding to each of the plurality of locations. According to claim 1,
When the first user input is a touch input for dragging in one direction on the live area, a location first touched by the touch input is selected as the first location,
When the drag direction of the touch input is the first direction, the first additional content is set to a still picture type,
In the second direction, the first additional content is set as a video type. camera;
a display for outputting a live area generated by processing data input from the camera in real time;
In response to a first user input selecting a first location of the live area,
While recording of the main content of the video type corresponding to the live area that is output on the display in real time through the camera is performed, the first additional content additionally captured subsequently is controlled to be linked to an insert point on the main content including a control unit that
The control unit controls the output of the first additional content in response to a second user input for selecting an insert point on the main content in a state in which the main content is output,
The insert point on the main content is characterized in that set to be the same as the selected first position, the terminal. 10. The method of claim 9,
The control unit, after the main content is recorded, while the display outputs the live area for shooting or recording the first additional content,
In response to a third user input for selecting the second location of the live area, the first additional content is photographed or recorded through the camera, and the second additionally photographed or recorded subsequent additional content is displayed as the second additional content. 1 Control to be linked to the insert point on the additional content,
The control unit controls to output the second additional content in response to a third user input for selecting an insert point on the first additional content while the first additional content is output;
The position of the insert point on the first additional content is characterized in that set to be the same as the selected second position, the terminal. 10. The method of claim 9,
The camera includes a first camera unit for wide-angle shooting or recording and a second camera unit for enlarged shooting or recording,
In response to the first user input, recording of the main content and shooting or recording of the first additional content is performed,
The recording of the main content is performed through any one of the first camera unit and the second camera unit,
The first additional content shooting or recording, characterized in that performed through the other one, the terminal. 10. The method of claim 9,
The first user input is to touch one of the at least one candidate,
The at least one candidate is characterized in that it is set based on an insert point set in the second main content different from the main content, the terminal. 10. The method of claim 9,
The first additional content is characterized in that the enlarged photographing or recording of a focused portion on the live area, the terminal. 10. The method of claim 9,
In response to a second user input for selecting a plurality of locations in the live area,
Comprising a control unit for performing recording of the main content through the camera, and controlling the subsequent additionally captured or recorded first additional content to be linked to an insert point on the main content,
In a state in which the main content is output, the control unit controls the output of the first additional content in response to a third user input for selecting an insert point associated with the first additional content on the main content,
The position of the insert point associated with the first additional content on the main content is characterized in that set to be the same as any one of the plurality of positions, the terminal. 15. The method of claim 14,
Any one of the plurality of locations, the terminal, characterized in that the highest matching rate with the first additional content among the objects corresponding to each of the plurality of locations. 10. The method of claim 9,
When the first user input is a touch input for dragging in one direction on the live area, a location first touched by the touch input is selected as the first location,
When the drag direction of the touch input is the first direction, the first additional content is set to a still picture type,
In the second direction, the first additional content is set as a video type. a main content capturing step of capturing the main content in response to a first user input for selecting a first location of the live area of the display;
an insert point setting step of setting an insert point at the same location as the selected first location on the captured main content; and
A linking step of associating the subsequently additionally photographed or recorded first additional content with the insert point,
The live area is an area generated by processing data input from a camera in real time, and
The insert point on the main content is characterized in that the first additional content is output in response to a second user input for selecting the insert point on the main content in a state in which the main content is output. . a main content capturing step of capturing the main content in response to a first user input for selecting a first location of the live area of the display;
an insert point setting step of setting an insert point at the same location as the selected first location on the captured main content; and
A linking step of associating the subsequently additionally photographed or recorded first additional content with the insert point,
The live area is an area generated by processing data input from a camera in real time, and
The insert point on the main content is characterized in that the first additional content is output in response to a second user input for selecting the insert point on the main content in a state in which the main content is output. recorded media.

Images