WO2020085526A1 - Terminal and control method thereof - Google Patents

Abstract

The present invention relates to a terminal capable of configuring a trigger area and outputting an additional content according to a response of an input of touching the configured trigger area, and a control method thereof. A terminal according to the present invention may comprise: a touch screen for displaying information and receiving a touch input; and a control unit for outputting a video to the touch screen, configuring a first trigger area, which is to be associated with a first additional content to be inserted into the video, when the first additional content is selected, and performing control, when a touch input touching the first trigger area of the video is received at a first time point at which the first trigger area is inserted into the video, to output the first additional content in response to the touch input.

Description

Terminal and control method

The present invention relates to a terminal capable of setting a trigger area and outputting additional content according to a response of an input touching the set trigger area, and a control method thereof.

With the development of technology, various electronic devices have increased beyond the PC. For example, not only mobile terminals such as mobile phones and tablet PCs, but also touch-based PCs using touch input as a main input source have appeared.

These new terminals also support document viewing and editing functions for user convenience. However, in these terminals, the word processor used in the existing PC is simply ported and used.

Accordingly, it is required to develop a user interface capable of efficiently reading and editing documents not only in the existing PC, but also in the newly emerged terminal.

The present disclosure is to provide a terminal and a control method capable of outputting additional content in response to touching the main content.

Furthermore, the present disclosure is to provide a terminal and a control method that allows a user to freely adjust an output area of an additional content or an output area of an additional content.

In addition, the present disclosure is to provide a terminal and a control method capable of adaptively determining content to be output to main content based on a priority between a plurality of trigger regions or a priority between a plurality of additional contents.

In addition, the present disclosure is to provide a terminal and a control method that can use additional content for the purpose of controlling the output of other additional content.

In addition, the present disclosure is to provide a terminal and a control method capable of interlocking with a trigger area or an additional content valid time point and a video playback time point.

The technical problems to be achieved in the present disclosure are not limited to the technical problems mentioned above, and other technical problems that are not mentioned will be clearly understood by those skilled in the art from the following description. Will be able to.

The terminal according to the present disclosure displays information, outputs a video to the touch screen for receiving a touch input, and outputs a video to the touch screen, and when the first additional content to be inserted into the video is selected, the first additional content When a touch input for touching the first trigger region is received at a first time point in the video in which the first trigger region is to be set, and the first trigger region is inserted, the response is generated in response to the touch input. It may include a control unit for controlling to output the first additional content.

The control method of the terminal according to the present disclosure includes determining a first additional content to be inserted into a video, setting a first trigger area to be associated with the first additional content, and inserting the first trigger area And when a touch input touching the first trigger region is received at a first time point of the video, outputting the first additional content in response to the touch input.

In a terminal and a method for controlling a terminal according to the present disclosure, the first time point may be that the first trigger area is included between a second time point at which an effective period is calculated and an effective time period of the first trigger area.

In the terminal and the terminal control method according to the present disclosure, the second viewpoint may be a playback time of the video when the first trigger region is set.

In the terminal and the control method of the terminal according to the present disclosure, when the playback time of the video reaches the second time as the video is played, the first trigger area may be visually identified and displayed.

In the control method of a terminal and a terminal according to the present disclosure, at least one of the location or size of the first trigger region is set around a subject appearing in the video, and at least one of the location or size of the first trigger region May change according to the movement of the subject appearing in the video.

In the terminal and the terminal control method according to the present disclosure, when the subject is framed out, the valid period of the first trigger area may expire.

In the control method of a terminal and a terminal according to the present disclosure, when the validity period of the first additional content expires, the control unit controls the output of the first additional content to end, and the validity of the first additional content The period may be calculated from the time when the output of the first additional content starts.

In a terminal and a method of controlling a terminal according to the present disclosure, in response to the touch input, the first additional content is output through an output panel that is output as the size of the playback window of the video is reduced and the size of the playback window is reduced. Can be output.

In the control method of a terminal and a terminal according to the present disclosure, a second trigger region associated with second additional content is further inserted into the video, and at least a portion of the first trigger region and the second trigger region overlap In case, the controller responds to a touch input touching the region where the first trigger region and the second trigger region overlap, and is associated with a trigger region having a higher priority among the first trigger region and the second trigger region. Additional content may be output.

In the control method of a terminal and a terminal according to the present disclosure, when output of additional content associated with a trigger region having a higher priority among the first trigger region and the second trigger region is terminated, the additional content with the output terminated The priority of the associated trigger area may be changed to the lowest priority.

In the control method of a terminal and a terminal according to the present disclosure, when the first additional content is additionally linked to a second trigger region, the second trigger region is changed to valid when the valid period of the first trigger region expires Can be.

In a terminal and a method for controlling a terminal according to the present disclosure, when the second additional content is additionally associated with the first trigger area, in response to a touch input touching the first trigger area, the first additional content and Any one of the second additional content having a higher priority may be output.

In the control method of a terminal and a terminal according to the present disclosure, when the second additional content is associated with the first additional content, the second additional content is output in response to a touch input touching the first additional content Can be.

In the control method of a terminal and a terminal according to the present disclosure, when the validity period of the first additional content expires while the first additional content and the second additional content are being simultaneously output, the first additional content and The output of the second additional content may all be stopped.

The features briefly summarized above with respect to the present disclosure are merely illustrative aspects of the detailed description of the present disclosure described below, and do not limit the scope of the present disclosure.

The present disclosure has an effect of providing a terminal and a control method capable of outputting additional content in response to touching the main content.

Furthermore, the present disclosure has an effect of providing a terminal and a control method in which a user can freely adjust an output area of an additional content or an output area of an additional content.

In addition, the present disclosure can provide a terminal and a control method that can adaptively determine content to be output to main content based on a priority between a plurality of trigger regions or a priority between a plurality of additional contents.

In addition, the present disclosure may provide a terminal and a control method that can use additional content for the purpose of controlling the output of other additional content.

In addition, the present disclosure may provide a terminal and a control method capable of interworking with a trigger area or an effective time point of additional content and a playback time point of a video.

The effects obtainable in the present disclosure are not limited to the above-mentioned effects, and other effects not mentioned may be clearly understood by those skilled in the art from the following description. will be.

1 is a block diagram of a terminal according to the present invention.

2 is a flowchart showing the operation of the terminal under the edit mode.

3 is a diagram for explaining an example of selecting additional content.

4 is a diagram illustrating an example of setting a trigger area based on a graphic object.

5 is a diagram illustrating an example in which a trigger area is set around a subject in a video.

6 is a diagram showing an example of setting an effective period of a trigger area.

7 is a view showing an example of setting the position / size of the trigger area after the change.

8 is a view showing an example in which the position / size of the trigger area is changed according to the movement of the subject.

9 and 10 are views showing an example of setting a trigger area and an output area of additional content.

11 is a view showing an example of setting a trigger area and an output area of additional content.

12 is a diagram illustrating an example in which a plurality of additional contents are linked to one trigger region.

13 is a view showing an example of setting a plurality of trigger regions for one additional content.

14 is a diagram illustrating an operation of a terminal when a plurality of trigger regions are overlapped.

15 shows an example of linking new additional content to additional content already inserted in a video.

16 is a flowchart showing the operation of the terminal under the viewer mode.

17 is a diagram illustrating an example in which the trigger region is visually identified and displayed.

18 is a view showing an example in which the trigger area is visually identified and displayed.

19 is a diagram illustrating an example in which additional content is output in response to a user input touching a trigger area.

20 is a diagram illustrating an example in which additional content is rotated and output.

21 is a diagram showing an example in which the output of additional content is ended.

22 is a diagram illustrating an operation of a terminal when a user input for touching an area where a plurality of trigger areas overlap is received.

23 is a diagram illustrating an operation of a terminal when a user input touching a trigger region associated with a plurality of additional contents is received.

24 illustrates an example in which other additional content is output in response to a user input touching the additional content.

Hereinafter, exemplary embodiments of the present disclosure will be described in detail with reference to the accompanying drawings so that those skilled in the art to which the present disclosure pertains can easily carry out the embodiments. However, the present disclosure may be implemented in various different forms and is not limited to the embodiments described herein.

In describing the embodiments of the present disclosure, when it is determined that a detailed description of known configurations or functions may obscure the subject matter of the present disclosure, detailed description thereof will be omitted. In the drawings, parts irrelevant to the description of the present disclosure are omitted, and similar reference numerals are used for similar parts.

In the present disclosure, when a component is said to be "connected", "coupled" or "connected" with another component, this is not only a direct connection relationship, but also an indirect connection relationship in which another component exists in the middle. It may also include. Also, when a component is said to "include" or "have" another component, this means that other components may be further included instead of excluding other components unless specifically stated to the contrary. .

In the present disclosure, terms such as first and second are used only for the purpose of distinguishing one component from other components, and do not limit the order or importance of components, etc., unless otherwise specified. Accordingly, within the scope of the present disclosure, the first component in one embodiment may be referred to as a second component in another embodiment, and likewise the second component in one embodiment may be the first component in another embodiment It can also be called.

In the present disclosure, the components that are distinguished from each other are for clarifying each feature, and the components are not necessarily separated. That is, a plurality of components may be integrated to be composed of one hardware or software unit, or one component may be distributed to be composed of a plurality of hardware or software units. Accordingly, such integrated or distributed embodiments are included in the scope of the present disclosure, unless otherwise stated.

In the present disclosure, components described in various embodiments are not necessarily essential components, and some may be optional components. Accordingly, an embodiment consisting of a subset of components described in one embodiment is also included in the scope of the present disclosure. In addition, embodiments including other components in addition to the components described in various embodiments are also included in the scope of the present disclosure.

The present disclosure relates to an application including a content editing tool and a terminal capable of driving the application. The content editing tool described in the present disclosure provides a function of setting a trigger area in the main content and linking the trigger area with additional content. When a user input for selecting a trigger area is received after editing of the main content is completed, additional content associated with the trigger area may be output. Hereinafter, a content editing tool according to the present invention and a terminal capable of driving an application supporting the same will be described in detail.

1 is a block diagram of a terminal according to the present invention. The terminal described in the present invention may be a mobile terminal such as a smart phone, a tablet PC (Personal Computer), a laptop (Laptop) or PDA (Personal Digital Assistants), or a fixed terminal such as a PC (Personal Computer) or a smart TV. have. However, for convenience of description, in the drawings and embodiments described below, it is assumed that the terminal is a mobile terminal.

Referring to FIG. 1, a terminal according to the present invention includes a communication unit 110, a camera 120, a microphone 130, a user input unit 140, a display unit 150, an audio output unit 160, and a memory 170 And a controller 180.

The communication unit 110 allows the terminal to communicate with other terminals. The communication unit 110 may perform communication in a wireless manner or may perform communication in a wired manner. For example, in order to perform communication in a wireless manner, the communication unit 110 may include at least one of a mobile communication module or a wireless Internet module. The mobile communication module is for performing communication through a mobile communication base station such as LTE, HSDPA or CDMA, and the wireless Internet module is for performing communication through a wireless LAN (Wi-Fi). The wired method may include LAN, USB, HDMI, RGB or DVI.

The camera 120 receives the zero signal and performs signal processing on the input video signal. The microphone 130 receives an audio signal and performs signal processing on the input audio signal.

The user input unit 140 receives a user input. The user input unit 140 may include at least one of a button-type input unit exposed on the outside of the terminal and a touch input unit capable of receiving a touch input touching the display unit 150. The touch input unit may include at least one touch sensor. At this time, when the display unit 150 and the touch input unit form a mutual layer structure, such a structure may be referred to as a 'touch screen'. In such a touch screen structure, it is possible to receive various types of touch input, such as selecting or dragging an object displayed on the touch screen using a pointer.

The user input unit 140 may include at least one motion sensor for receiving gesture input. At this time, the motion sensor may include a gyro sensor or an acceleration sensor that can detect the movement of the terminal. As another example, the controller 180 may analyze a user's movement through an image input through the camera 120 and determine whether a gesture input is received based on the analysis result.

In the embodiments described below, an example in which a terminal operates based on various user inputs through a touch screen will be described. However, in the embodiments described below, it is also included in the embodiment of the present invention to implement a function executed by a touch input by an input or gesture input by touching (or pushing) a button exposed outside the terminal.

The display unit 150 outputs information processed by the terminal. For example, the display unit 150 serves to output an execution screen of an application driven by the terminal, a user interface on the execution screen, or a graphical user interface.

The sound output unit 160 serves to output audio data received from the communication unit 110 or stored in the memory 170.

The memory 170 stores data for application execution and data processed by the terminal. The memory 170 is a hard disk, a solid state disk (SSD), a flash memory 170 (Flash Memory), a card type storage device (for example, SD or XD memory 170, etc.), RAM (Random Access Memory) ) Or ROM (Read Only Memory). Web storage that can be accessed remotely through the communication unit 110 may also be included in the category of the memory 170.

The controller 180 controls the overall operation of the terminal. The controller 180 may process signals, data, or information input or output through components constituting the terminal. In addition, the controller 180 can execute an application stored in the memory 170. The controller 180 may include an operation / control device such as a central processing unit (CPU), a graphic processing unit (GPU), a micro controller unit (MCU), or a micro processing unit (MPU).

The terminal does not have to include all the components illustrated in FIG. 1, and depending on the implementation form, some of the components illustrated in FIG. 1 may not be included. Based on the above description, the present invention will be described in detail.

The main content described in the present invention includes not only text-based content, but also multimedia content such as images or videos. For example, the main content includes presentation documents (eg, files with an extension of ppt (x)), spreadsheet documents (eg, files with an extension of xsl (x)), and word processing documents (eg For example, doc (x), hwp, txt or pdf file extension), website (for example, html file extension) or e-book (for example, epub file extension) Text (eg, files with extensions such as jpg, gif, tif or bmp) or videos (eg files with extensions such as mpeg, avi, mp4, wmv or mov), as well as text-based content such as And multimedia content.

Hereinafter, for convenience of description, it will be assumed that the main content is a video in the embodiments and drawings described below. In addition, a state in which a trigger area can be set in the main content is called an edit mode, and a state in which additional content associated with a trigger area in response to a trigger area touch can be output is called a viewer mode. That is, the edit mode may indicate a state in which settings related to the trigger area and additional content can be changed, and the viewer mode may indicate a state in which settings related to the trigger area and additional content cannot be changed.

2 is a flowchart showing the operation of the terminal under the edit mode.

First, the controller 180 may select a video to be edited based on a user's selection or a predefined condition (S210). Specifically, the controller 180 may select a video selected by the user or a video satisfying a predefined condition as an editing target. Here, the video satisfying the predefined conditions may include a video added to the most recent terminal, a video most recently played, a video captured through the most recent camera, or a video played through the most recent web browser. .

When a video to be edited is selected, the controller 180 may output a video to be edited and output a playback control menu for controlling playback of the video. The playback control menu may provide functions such as video playback, pause, pause, move forward, move backward, and adjust volume.

Next, the controller 180 may select additional content to be inserted into the video based on the user input (S220). Additional content that may be inserted into a video may include multimedia content such as images, videos, and music, as well as text-based content.

3 is a diagram for explaining an example of selecting additional content.

While a video is being output, when a predetermined user input is received, the controller 180 can output a menu 310 for selecting additional content. When a predetermined user input is received while the video is playing, the controller 180 may stop playing the video and output the menu 310. Alternatively, the controller 180 may output a menu 310 for selecting additional content in response to a predetermined user input, only when playback of a video is stopped. The predetermined user input is a touch input that touches an arbitrary location of the video, a touch input that touches a subject such as a person or object appearing in the video, a touch input of a predefined form, or a menu that calls a function for selecting additional content. It may be a touch input. The predefined shape may be that at least one of the number of pointers, the touch intensity (touch pressure), the touch interval or the number of touches is greater than or equal to a reference value.

For example, when a user input for touching an arbitrary location in a video is received, the controller 180 outputs a menu 310 for selecting additional content at the user's touch input point, as in the example illustrated in FIG. 3. can do. Selection of additional content may be performed in the order of i) selection of a content type, and ii) output of a list of contents of the selected type or creation of content of the selected type.

For example, each item included in the menu 310 shown in FIG. 3 may be for selecting a content type. Specifically, each item of the menu 310 shown in FIG. 3 sequentially includes an image 311, a video 312, music 313, a document 314, a web page 315, and a specific page 316 in the document ).

When a user input for selecting a content type is received, the controller 180 can output a list of contents corresponding to the selected type or execute an application for generating content corresponding to the selected type. At this time, whether to output a content list or to run an application for generating content may be determined by user input, or any one of them may be executed by default.

For example, when an image item 311 or a video item 312 is selected through the menu 310, the controller 180 outputs a list of image or video files stored in the memory 170 or the cloud, or an image or video You can run the camera application to create a file. When any one of the file list is selected or when the image or video is captured through the camera 120, the selected / generated image or video may be determined as additional content to be inserted into the video.

Alternatively, when a music item 313 is selected through the menu 310, the controller 180 can output a list of music files stored in the memory 170 or the cloud, or run a recording application to create a music file. . When any one of the file list is selected or the recording is completed through the microphone 130, the selected / generated music may be determined as additional content to be inserted into the video.

Alternatively, when a document item 314 is selected through the menu 310, the controller 180 can output a list of document files stored in the memory 170 or the cloud, or execute a document creation application to generate a document file have. When any one of the file list is selected or a document is generated through a document creation application, the selected / generated document may be determined as additional content to be inserted into a video. When a specific page item 316 in the document is selected through the menu 310, a process of selecting / generating the document or entering a page number identifying a specific page may be added to the process of selecting / generating the document. have.

Alternatively, when the web page item 315 is selected through the menu 310, the controller 180 outputs a list of web pages stored in the memory 170 or the cloud, a list of favorites, or a list of frequently visited web pages, or the web. You can run a web browser application to select pages. Alternatively, the output of the input window for inputting the IP address or URL (Uniform Resource Locator) address of the web page may be selected. The IP address or URL address of the web page can be entered through the input window. According to the above process, when a website document or an Internet Protocal (IP) address or a Uniform Resource Locator (URL) address of a website is determined, the corresponding web page may be determined as additional content to be inserted into a video.

In the above-described example, after selecting a content type, it is illustrated that an application for generating a content list of a selected type or content of a selected type is executed, but this is only an embodiment for selecting additional content, and the present invention is limited. It is not done. For example, without a content type selection process, a content list may be output, an application for content creation may be executed, or when the content type is selected, content corresponding to a predefined condition may be determined as additional content. Here, the content corresponding to the predefined condition includes the most recently viewed content, the most recently modified content, the most recently stored content on the terminal, the content with the highest number of times the user has viewed for a period of time, or content previously designated by the user. And the like.

In addition, in FIG. 3, it is illustrated that the content type is determined based on a user input touching any one of the items included in the menu 310, but it is also possible to select the content type in a different way from the illustrated one. will be. For example, the content type may be determined according to a user's touch input type. For example, when the first type of touch input is received, it is determined that the first type of content is selected, while when the second type of touch input is received, it can be determined that the second type of content is selected. Here, the first type and the second type of touch input may be different in at least one of the number of pointers, the touch intensity (touch pressure), the touch time, or the number of touches.

When the additional content to be inserted into the video is selected, a trigger area to be associated with the additional content in the video may be set (S230). The setting of the trigger area may include at least one of the location, size, validity period, or fixed position / size of the trigger area.

In order to set the position and size of the trigger area, the controller 180 can output a graphic object for setting the trigger area in the video. In addition, the controller 180 may adjust the position and size of the trigger area according to the position and size of the graphic object.

4 is a diagram illustrating an example of setting a trigger area based on a graphic object.

The left drawing of FIG. 4 shows an example of setting the trigger area under the edit mode, and the right drawing of FIG. 4 shows an example of identifying and displaying the trigger area in the viewer mode. In addition, the outline of the dotted line in the left drawing of FIG. 4 represents the position or size of the previous graphic object, and the outline of the dotted line in the right drawing of FIG. 4 represents the trigger area.

When the additional content is determined, the controller 180 can control the graphic object 410 for setting the trigger area 420 to be output, as in the example shown in FIG. 4A. The graphic object 410 may be an image representing additional content (eg, a thumbnail or preview image). For example, if an image is selected as additional content, a thumbnail of the image selected for trigger region setting may be output as the graphic object 410.

In addition to the described example, the graphic object 410 may be an image (eg, icon) or polygonal image corresponding to the type of additional content. For example, when additional content is determined, an icon for identifying the type of the additional content may be output as the graphic object 410 according to the type of the additional content.

The controller 180 may set the position and / or size of the trigger area 420 according to the position and / or size of the graphic object 410. That is, the position and size of the graphic object 410 may correspond to the position and size of the trigger area 420.

For example, as in the example illustrated in FIG. 4B, when the position of the graphic object 410 is changed, the position of the trigger area 420 may also be changed according to the changed position of the graphic object 410. have. For example, in (b) of FIG. 4, if the upper left coordinate of the graphic object 410 is changed from (x1, y1) to (x2, y2), the coordinates of the trigger area 420 from (x1, y1) (x2, y2).

In addition, as in the example illustrated in FIG. 4C, when the size of the graphic object 410 is changed, the size of the trigger area 420 may also be changed according to the changed size of the graphic object 410. . For example, in (c) of FIG. 4, if the width and height of the graphic object 410 are increased by Δw and Δh, respectively, the size of the trigger region 420 may also be increased by Δw and Δh.

As another example, the controller 180 may set a trigger area around a subject selected by a user in a video. Specifically, if additional content to be inserted into a video is selected by a user's touch input selecting an arbitrary subject in the video, the controller 180 can set a trigger area to include the subject selected by the user's touch input. .

Here, the subject represents an object appearing in a video, such as a person or object. The entire subject may be set as the trigger area, but the trigger area may be set centering on a part of the subject (for example, a person's face, arms, legs, etc.).

5 is a diagram illustrating an example in which a trigger area is set around a subject in a video.

As in the example shown in (a) of FIG. 5, when a touch input for touching an arbitrary subject 510 in a video is received, the controller 180 outputs a menu for selecting additional content to be inserted into the video. When selection of additional content is completed through the menu, the controller 180 may set a trigger area including a subject selected by a user's touch input.

Specifically, as in the example shown in (b) of FIG. 5, the controller 180 may set an area of a predetermined shape (for example, a rectangle) including a subject as the trigger area 520.

Alternatively, the controller 180 may set the trigger area along the outline of the subject, as in the example shown in FIG. 5C.

In order to identify and display the set trigger area, the controller 180 may control the graphic object 520 on the trigger area to be overlayed as shown in the example shown in FIG. 5 (b), and (c) of FIG. 5 As in the example shown in, it is also possible to control the outline 525 of the trigger area to appear.

The position and size of the trigger area set around the subject may also be set to be adjustable by the user.

The valid period of the trigger area may be determined according to a predefined time, a time set by the user, or a video playback condition.

6 is a diagram showing an example of setting an effective period of a trigger area.

As in the example illustrated in FIG. 6, the controller 180 may output a setting window 610 for setting an effective period of the trigger area. The user may input a valid period of the trigger region through the setting window 610, and the controller 180 may set the input valid period as the valid period of the trigger region.

The valid period of the trigger region may be calculated from the time of insertion of the trigger region. For example, when a trigger region is set at a playback time t1 of a video and the valid period of the trigger region is set to Δt, the trigger region may be set to be valid from a playback time t1 to a playback time t1 + Δt.

It is also possible to set the starting point of the valid period to a time point earlier or later than a trigger area setting point. For example, even if the trigger region is set at the playback time t1 of the video, the valid period of the trigger region may start from t0 that is earlier than t1 or t2 that is later than t1. That is, the trigger region may remain effective for t0 + Δt or t2 + Δt.

As another example, when the trigger area is set around the subject, the controller 180 may set the trigger area to be invalid when the subject is framed out. That is, the valid period of the trigger area may be set from a time point when the trigger area is set to a time point before the subject is framed out. Alternatively, when a part of the subject leaves the screen, the trigger area may be set as invalid.

When the framed-out subject re-appears (ie, frame-in) to the video, the trigger area set around the re-appeared subject may be set to be valid again. When the frame-out subject reappears, whether or not to treat the trigger area set around the subject as valid again may be determined according to the user's setting.

As another example, the controller 180 may set a predefined time as an effective period of the trigger area. The predefined time may be a preset value in the terminal, such as 1 second, 3 seconds, or 5 seconds. Alternatively, a predetermined value may be determined in proportion to the running time of the video. For example, a predefined value may be set to △ t for a video having a running time of t seconds, whereas a predefined value may be set to 2 △ t for a video having a running time of 2t seconds.

Whether to fix the position / size of the trigger area may be determined according to a user setting. When the position / size of the trigger area is set to be fixed, even if a video is played, the position / size of the trigger area can be maintained without changing. On the other hand, if the position / size of the trigger area is set to not be fixed, the position / size of the trigger area may change as the video is played. When the position / size of the trigger area is set to be not fixed, the controller 180 may output a user interface for setting the position / size of the trigger area after the change.

7 is a view showing an example of setting the position / size of the trigger area after the change.

7 (a) shows the location / size of the trigger area set at time t0.

On the setting screen of the trigger area, when the video playback time is moved from t0 to t1, and the position / size of the trigger area 710 is changed at the time t1, the controller 180 triggers set at the time t0 from t0 to t1 The location / size of the region may be applied, and from the time t1, the location / size of the trigger region 710 set at the time t1 may be applied.

That is, in the example shown in FIG. 7, the position / size of the trigger area 710 from time t0 to t1 follows the setting shown in FIG. 7 (a), while the position / position of the trigger area 710 from time t1 The size may follow the setting shown in FIG. 7 (b).

As another example, the position / size of the trigger area may be set to gradually change. For example, if the position / size of the trigger area 710 is set as in the example shown in (a) and (b) of FIG. 7, in the playback section between the time t0 and time t1, the trigger area 710 It can be seen that the position / size gradually changes from the position / size set at the time t0 to the position / size set at the time t1.

When the trigger area is set around the subject, the position / size of the trigger area may change according to the movement of the subject.

8 is a view showing an example in which the position / size of the trigger area is changed according to the movement of the subject.

8 (a) shows an example in which the position / size of the trigger area is set around the subject at the time t0.

The controller 180 can adjust the position / size of the trigger area 810 according to the movement of the subject. For example, when the position / size of the subject is changed differently from the time t0 at the time t1, the position / size of the trigger area 810 at the time t1 may be set around the changed subject. That is, the position / size of the trigger area is set centering on the subject at time t0 at the time t0, while the position / size of the trigger area is centered on the subject at time t1 at the time t1.

Although the position / size of the trigger area is adjusted according to the movement of the subject, the controller 180 may limit the size of the trigger area to be larger than a predefined limit value or smaller than a predefined limit value. For example, if the subject in the video becomes very small due to zoom-out, and the trigger area set around the subject is also very small according to the subject, a problem that the user cannot select the trigger area may occur. Accordingly, even if the subject in the video becomes very small, the size of the trigger area set around the subject may be set so as not to be smaller than a predefined limit value. Here, the predefined limit value may be a value determined based on the width, height, or width of the trigger area.

As another example, when the size of the trigger area becomes smaller than a predefined limit value, the controller 180 may set the trigger area to be invalid. That is, when the subject in the video becomes very small and the size of the trigger region set around the subject becomes smaller than a predefined threshold, the trigger region may be set to be no longer valid.

Under the edit mode, you can change the settings for additional content as well as the trigger area. The setting for the additional content may include at least one of an output mode of the additional content, a location / size of the output area, an expiration date, whether to continue playing the video, or whether to slow down the video.

The output mode of the additional content may indicate whether to output the additional content in full screen or the additional content in a partial screen when a user input touching the trigger area under the viewer mode is received. Depending on the output mode of the additional content, the step of setting the output area of the additional content may be selectively performed (S240, S250).

When the additional content is set to be output as a partial screen, it may be further set whether or not to output the additional content over the video. When the additional content is set to output overlay, the additional content on the video is overlayed in response to a user input touching the trigger area under the viewer mode, while the additional content is set to output on a separate screen, the trigger area under the viewer mode Additional content may be output in a display margin that is not overlaid with a video in response to a user input touching.

When the additional content is set to be output as a partial screen, a graphic object for setting the trigger area and a graphic object for setting the output area of the additional content may be simultaneously output.

The output mode of the additional content may be determined by user input, or either a full screen or a partial screen may be applied as a default. For example, when additional content is selected, the controller 180 may output a menu for determining the output mode of the additional content, and select an output mode of the additional content based on a user input to the menu. The menu may further include an item for setting whether to output the additional content as an overlay or an individual screen when the additional content is set to be output as a partial screen.

Alternatively, the controller 180 may set the output of the additional content as a full screen or a partial screen as a default.

Alternatively, the control unit 180 may set whether to output the selected additional content in full screen or to output in partial screen depending on whether the previous additional content is set to be output in full screen or to be displayed in partial screen. Can decide.

The controller 180 may change the output mode of the additional content based on the user input.

Specifically, when a predetermined user input is received while the additional content is set to be output on the full screen, the controller 180 may change the additional content to be displayed on the partial screen. For example, when a certain type of touch input is received with respect to a graphic object for setting a trigger area, the controller may change the output mode of the additional content from a full screen to a partial screen. Here, the predetermined type of touch input may be simply touching a graphic object, or at least one of the number of touches, touch intensity (touch pressure), or touch time on the graphic object may be greater than or equal to a reference value. Alternatively, the output mode of the additional content may be changed based on a touch input that touches a menu for changing the output mode of the additional content from a full screen to a partial screen. When the output mode of the additional content is changed from the entire screen to the partial screen, the first graphic object for setting the trigger area and the second graphic object for setting the output area for the additional content may be simultaneously output.

It is also possible to change the output mode of the additional content whose output mode is a partial screen to the full screen. For example, output of additional content when a touch input in a predetermined form for deleting either the first graphic object or the second graphic object is received or a user input for merging the first graphic object and the second graphic object is received You can change the mode from partial screen to full screen. Here, the touch input of a predetermined form for deleting either the first graphic object or the second graphic object is simply touching a button for deleting the first graphic object or the second graphic object, or the first graphic object or The second graphic object may include at least one of the number of touches, the touch intensity (touch pressure), or the touch time, which is greater than or equal to a reference value. Alternatively, the output mode of the additional content may be changed based on a touch input that touches a menu for changing the output mode of the additional content from a partial screen to a full screen.

9 and 10 are views showing an example of setting a trigger area and an output area of additional content. 9 shows an example in which the additional content is set to be outputted over the video, and FIG. 10 shows an example in which the additional content is set to be output in a separate screen.

The left drawing of FIGS. 9 and 10 shows an example of setting the trigger area and the output area of additional content under the edit mode, and the right drawing of FIGS. 9 and 10 identifies the trigger area and the output area of additional content in the viewer mode The example shown is shown.

For convenience of description, it is assumed that the initial additional content is set to be output in full screen.

When the additional content is set to be output in full screen, the controller 180 is a graphic for setting the trigger regions 930 and 1030, as in the example shown in FIGS. 9A and 10A. Objects 910 and 1010 may be output.

Thereafter, when the output mode of the additional content is changed from a full screen to a partial screen, the controller 180 maintains the output of the graphic objects 910 and 1010, as in the example shown in FIG. 9B. The new graphic objects 920 and 1020 may be controlled to be output. The new graphic objects 920 and 1020 may be overlayed on the existing graphic objects 910 and 1010, or may be output at a different location from the existing graphic objects 910 and 1010.

The existing graphic objects 910 and 1010 are used to set either the trigger area 930 or 1030 or the output area 940 or 1040 of additional content, and the new graphic objects 920 and 1020 set the other. Can be used.

For example, when the output mode of the additional content is full screen, the graphic objects 910 and 1010 are used to set the trigger areas 930 and 1030, whereas when the output mode of the additional content is changed to the partial screen, the graphic object 910 and 1010 may be used to set the output areas 940 and 1040 of additional content. As the output mode of the additional content is changed to the partial screen, the newly output graphic objects 920 and 1020 may be used to set the trigger regions 930 and 1030.

Alternatively, on the contrary, the existing graphic objects 910 and 1010 may be used to set the trigger regions 930 and 1030 even after the output mode of the additional content is changed to the partial screen. In this case, the newly output graphic objects 920 and 1020 may be used to set the output areas 940 and 1040 of additional content.

In this embodiment, it is assumed that the existing graphic object 910 is used to set the content area, and the newly output graphic objects 920 and 1020 are used to set the trigger areas 930 and 1030. In addition, the graphic objects 920 and 1020 used to set the trigger regions 930 and 1030 are referred to as first graphic objects, and the graphic objects 910 used to set the output regions 940 and 1040 of additional content. 1010) will be referred to as a second graphic object.

The first graphic objects 920 and 1020 and the second graphic objects 910 and 1010 may be images representing additional content, images corresponding to types of the additional content, or polygonal images. In this case, it is preferable that the first graphic objects 920 and 1020 and the second graphic objects 910 and 1010 are different images.

When the additional content is set to be output on the video, the second graphic object 910 on the video may be output, as in the example illustrated in FIG. 9B. On the other hand, when the additional content is set to be output as a separate screen, as in the example shown in FIG. ) May output a second graphic object.

Whether the additional content is to be outputted over the video or to be displayed on a separate screen can be controlled by the user's setting. For example, when a user input for moving a second graphic object overlaid on a video to a video boundary is received, the controller 180 may change the output mode of the additional content from overlay output to individual screen output. At this time, the position of the output panel may be determined according to the moving direction of the second graphic object. For example, when a user input for moving the second graphic object to the right boundary of the video is received, as in the example illustrated in FIG. 10B, an output panel 1050 may be generated on the right side of the display. . On the other hand, when a user input for moving the second graphic object to the left boundary of the video is received, an output panel may be generated on the left side of the display. In addition to this, it is also possible to create an output panel at the top or bottom of the display.

On the other hand, when a user input for moving the second graphic object located on the output panel onto the video playback window is received, the controller 180 may change the output mode of the additional content from individual screen output to overlay output. When the output mode of the additional content is changed from the individual screen output to the overlay output, the output panel disappears, and the size of the video playback window may increase as much as the disappeared output panel.

In the above example, it has been described that the thrust panel is output to the display margin generated as the size of the video playback window decreases. Unlike the example described, it is also possible to overlay the output panel on the video while maintaining the size of the video playback window. The output panel is a rectangular area and may be positioned adjacent to one side of the video playback window. Alternatively, it is also possible to adjust the position / size of the output panel according to the user setting.

The controller 180 sets the position and / or size of the trigger regions 930 and 1030 based on the position and / or size of the first graphic objects 920 and 1020, and the second graphic objects 910 and 1010 The location and / or size of the output areas 940 and 1040 of the additional content may be set based on the location and size. For example, as the position and / or size of the first graphic objects 920 and 1020 are changed, the position and / or size of the trigger regions 930 and 1030 may be changed, and the second graphic objects 910 and 1010 may be changed. ), The location and / or size of the output areas 940 and 1040 of the additional content may be changed as the location and / or size of the content is changed. FIG. 9C shows an example in which the location of the output area 940 of the additional content is changed as the location of the second graphic object 910 is changed. In FIG. 10C, the second graphic object 1010 is illustrated. In the example shown in), an example in which the size of the output area 1040 of the additional content is changed as the size of the second graphic object 1020 is changed is illustrated.

The controller 180 may determine the aspect ratio of the output area of the additional content according to the aspect ratio of the additional content. That is, in order to suppress distortion caused by the output of the additional content in accordance with the output area of the additional content, the controller 180 may control the aspect ratio of the output area of the additional content to remain the same as the aspect ratio of the additional content. Accordingly, when the width of the second graphic object is changed, the controller 180 may control the height of the second graphic object to be changed according to the aspect ratio of the additional content. Similarly, when the height of the second graphic object is changed, the controller 180 may control the width of the second graphic object to be changed according to the aspect ratio of the additional content. When a user input for simultaneously adjusting the width and height of the second graphic object is received, the controller 180 can adjust the width and height of the second graphic object according to the aspect ratio of the additional content. At this time, among the width change value or the height change value calculated by the user input, the one used as a criterion for changing the width and height of the second graphic object may be any one set by default, and among the width change value and the height change value It may be a large change.

Whether to set the aspect ratio of the output area of the additional content to be the same as the additional content may be adjusted by the user's setting.

If the size of the trigger area is small, in the viewer mode, it is difficult for a user to find the trigger area, and if the size of the output area of the additional content is small, it may be difficult to accurately check the content of the additional content. Accordingly, the controller 180 can prevent the size of the trigger area and / or the output area of the additional content from being smaller than a predefined size. For example, even if a user input for reducing the size of the first graphic object for setting the trigger area is smaller than a predefined size, the controller 180 controls the size of the first graphic object to be smaller than a predefined size. can do. Likewise, even if a user input for reducing the size of the second graphic object for setting the output area of the additional content is smaller than the predefined size, the controller 180 does not allow the size of the second graphic object to be smaller than the predefined size. Control.

The setting of the trigger area and the setting of the output area of the additional content may be independent of each other. That is, changing the position and / or size of the first graphic object used to set the trigger area may be independent of changing the position and / or size of the second graphic object used to set the output area of the additional content. have. Accordingly, even if the position and / or size of the first graphic object is changed, the position and / or size of the second graphic object may not be changed.

As another example, the setting of the trigger area and the setting of the output area of the additional content may be mutually dependent. That is, the position and / or size of the output area of the additional content may be determined depending on the position and / or size change of the trigger area, and the position and / or size of the trigger area may be dependent on the position and / or size change of the content area. It can be determined by. Accordingly, when changing the position and / or size of the first graphic object used to set the trigger area, the position and / or size of the second graphic object used to set the output area of the additional content may also be changed. .

11 is a view showing an example of setting a trigger area and an output area of additional content.

In FIG. 11, it is assumed that the first graphic object 1120 is used to set the trigger area, and the second graphic object 1110 is used to set the output area of the additional content.

When the content output area and the trigger area are set to be mutually dependent, changing the position and / or size of either the first graphic object or the second graphic object may affect the other.

For example, as in the example shown in (a) of FIG. 11, when the position of the first graphic object 1120 is changed by (Δx, Δy), the position diagram of the second graphic object 1110 ( △ x, △ y). As the position of the first graphic object 1120 is changed by (Δx, △ y), the position of the trigger area is also changed by (△ x, △ y), and the position of the second graphic object 1110 is (△ x , △ y), the position of the output area of the additional content may also be changed by (△ x, △ y).

As an example, as in the example shown in (b) of FIG. 11, when the size of the first graphic object 1120 is changed by (Δw, Δh), the size of the second graphic object 1110 is also ( Δw, Δh). As the size of the first graphic object 1120 is changed by (Δw, Δh), the size of the trigger area is also changed by (Δw, Δh), and the size of the second graphic object 1110 is (△ w , △ h), the size of the output area of the additional content may also be changed by (△ w, Δh).

In consideration of the size ratio of the trigger area (or the first graphic object) and the output area of the additional content (or the second graphic object), by changing the position and / or size of the trigger area (or the first graphic object) The amount of change in the position and / or size of the output area (or the second graphic object) of the additional content caused may be adjusted. For example, when the size ratio between the trigger area and the output area of the additional content is 1: N, in response to the size of the trigger area being changed by (Δw, Δh), the size of the output area of the additional content is (N Δw, NΔh).

Whether to set the trigger area and the additional content output area independently or independently of each other may be determined by user settings. For example, while the trigger area and the additional content output area are set independently of each other, although the position and / or size of the first graphic object is changed, the position and / or size of the second graphic object may not be changed. On the other hand, if the setting is changed so that the trigger area and the additional content output area are mutually dependent, the position and / or size of the second graphic object may be changed in response to a change in the position and / or size of the first graphic object. have.

The validity period of the additional content may be dependent on the trigger area. As an example, the expiration time of the trigger area may be set as the expiry time of the additional content. In other words, when the additional content is output in the viewer mode, if the trigger region expires as the video playback continues, the validity period of the additional content also expires and output of the additional content may end.

Alternatively, an offset may be added or subtracted to the expiry time of the trigger area as an expiry time of the additional content.

As another example, the valid period of the additional content may be set independently of the trigger area. For example, the valid period of the additional content may be set through the setting window 610 as in the example shown in FIG. 6. Under the viewer mode, the valid period of the additional content can be calculated from the time when the output of the additional content starts. For example, if the validity period of the additional content is Δt, and the playback time of the video is t1 when the additional content is output under the viewer mode, the validity period of the additional content may expire at t1 + Δt time.

Alternatively, the start point of the valid period of the additional content may be set to be the same as the start point of the valid period of the trigger area.

Whether to continue playing the video among the settings for the additional content indicates whether to continue playing the video when the additional content is output as a touch input touching the trigger area in the viewer mode is received. The setting of whether or not to continue playing the video may be adjusted by user input.

Whether the video is decelerated among the settings for the additional content indicates whether the video is decelerated and played when the additional content is output as a touch input touching the trigger area in the viewer mode is received. The setting for whether to slow down the video can be adjusted by user input. When it is set to decelerate the video when the additional content is output, the playback speed of the video may be additionally set.

A plurality of additional contents may be linked to one trigger region. For example, when selecting an additional content and setting a trigger area for the selected additional content, when selecting a trigger area already associated with other additional content, a plurality of additional content may be linked to one trigger area.

12 is a diagram illustrating an example in which a plurality of additional contents are linked to one trigger region.

For convenience of description, as in the example shown in (a) of FIG. 12, a first trigger area 1210 associated with the first additional content 1215 and the first additional content 1215 is already inserted into the video. It is assumed that it is in an established state.

When the second additional content 1225 to be inserted into the video is selected, the controller 180 sets a second trigger area to be associated with the second additional content 1225, as in the example shown in FIG. 12B. The graphic object 1220 for setting may be output. At this time, as in the example shown in (c) of FIG. 12, when a user input for changing the position of the graphic object 1220 is received inside the first trigger area 1210, the controller 180 may be As shown in the example shown in (d), a menu 1230 for determining whether to merge the second trigger area for the second additional content 1225 with the first trigger area 1210 is output. can do.

When a user input for determining to merge the second trigger region with the first trigger region 1210 is received, as in the example illustrated in FIG. 12E, the controller 180 displays the graphic object 1220. The output may be stopped, and the second additional content 1225 may be additionally associated with the first trigger area 1210. That is, when it is set to merge the first trigger region and the second trigger region, setting the second trigger region for the second additional content may end.

On the other hand, when a user input that determines not to merge the second trigger region with the first trigger region is received, the controller 180 can generate a second content for the second additional content based on the location and / or size of the graphic object 1220. The second trigger area can be set.

FIG. 12 illustrates that a menu for selecting whether to merge the first trigger region and the second trigger region is output when a user input for dragging and moving a graphic object is received inside the first trigger region. , The present invention is not limited to this. For example, if it is decided to insert the second additional content in the video, before outputting a graphic object for setting the second trigger region, for selecting whether to merge the first trigger region and the second trigger region You can print the menu.

Alternatively, the controller 180 may determine whether merging of the first trigger region and the second trigger region is possible according to whether the first additional content and the second additional content are of the same type. For example, only when the first additional content and the second additional content are of the same type, the first trigger area and the second trigger area may be set to be mergeable. On the other hand, if the first additional content and the second additional content are heterogeneous types, the first trigger region and the second trigger region may not be merged even if the graphic object for setting the second trigger region is dragged over the first trigger region. You can.

Alternatively, the controller 180 may determine whether merging of the first trigger region and the second trigger region is possible based on the size of the trigger region and / or the output mode of the additional content or the output region of the additional content. For example, when a size difference or a size ratio between the first trigger region and the second trigger region exceeds a predefined threshold, even if a graphic object for setting the second trigger region is dragged over the first trigger region, the The first trigger region and the second trigger region may not be merged. Alternatively, when the output modes of the first additional content and the second additional content are different (eg, the output mode of the first content is a partial screen and the output mode of the second additional content is full screen), the second is over the first trigger area. Even if the graphic object for setting the trigger area is dragged and moved, the first trigger area and the second trigger area may not be merged.

In addition to the example illustrated in FIG. 12, when a plurality of additional contents are simultaneously selected, an integrated trigger area for additionally selected additional contents may be set. That is, when a plurality of additional contents are simultaneously inserted into a video, one graphic object for setting an integrated trigger area for the plurality of additional contents is output, and the plurality of additional contents are based on the position and / or size of the graphic object. The integrated trigger area for can be determined.

Alternatively, when a predetermined type of touch input is input to the pre-inserted trigger area, a menu for selecting additional content to be additionally linked to the trigger area may be displayed. Here, the predetermined type of touch input may mean that a predetermined area in the trigger area is touched, or that at least one of the number of pointers, touch intensity, or touch time touching the trigger area is greater than or equal to a reference value. When additional content is selected through the menu, the selected additional content may be further associated with the trigger area. Accordingly, a plurality of additional contents may be linked to one trigger region.

The method of associating a plurality of additional contents with one trigger region is not limited to the example shown in FIG. 12. For example, in FIG. 12, a plurality of additional contents are linked to one trigger area based on user input through the menu 1230, but a predefined user input (eg, a graphic object is already present) without outputting the menu. If a drag movement is performed over the trigger region), merging between trigger regions may be performed.

When a plurality of additional contents are associated with one trigger region, the controller 180 may set a priority between the plurality of additional contents. Priority may be used to determine the output order of additional content in viewer mode.

The priority may be determined by a user setting, or may be determined based on at least one of an order inserted into a video, a type of additional contents, an output mode, or a size. For example, the controller 180 may determine the priority of additional content in the order in which it is inserted into the video. That is, the additional content inserted into the video first may have a higher priority than the additional content inserted into the video later. Alternatively, considering the type of additional contents, the first type of additional content may be set to have a higher priority than the second type of additional content. Alternatively, among the additional contents, the additional content in which the output mode is full screen is set to have higher priority than the additional content in which the output mode is partial screen, or the additional content having a large output area is larger than the additional content having a small output area size. It can be set to have a high priority. The determined priority may be changed by user setting. Multiple additional contents may be set to have the same rank.

Settings for the first additional content and the second additional content may be mutually independent. For example, a valid period of the first additional content and a valid period of the second additional content may be set differently.

Alternatively, the settings of the first additional content and the second additional content may be mutually dependent. For example, the valid periods of the first additional content and the second additional content may be set to be the same.

Alternatively, the validity period of the second additional content may be set to expire when the first additional content expires. That is, when the output of the first additional content ends, the second additional content may also be set to end output at the same time.

Alternatively, the valid periods of the first additional content and the second additional content may be individually set, but the second additional content may be output when the first additional content expires.

One additional content may be linked to a plurality of trigger regions. For example, when a user input for adding a trigger area for additional content is received, a plurality of graphic objects for setting a plurality of trigger areas may be output.

13 is a view showing an example of setting a plurality of trigger regions for one additional content.

When additional content to be inserted into a video is selected, the controller 180, as in the example shown in (a) of FIG. 13, is a graphic object (hereinafter referred to as a first graphic object) for setting a trigger area for additional content. , 1310).

In this state, when a user input for adding a trigger area is received, the controller 180, as in the example shown in (b) of FIG. 13, is a graphic object for setting an additional trigger area (hereinafter, a second graphic) Object, 1320) may be further output.

The first graphic object 1310 may be used to set the first trigger area 1315 for additional content, and the second graphic object 1320 may be used to set the second trigger area 1315 for additional content. That is, the controller 180 sets the first trigger area 1315 based on the position and / or size of the first graphic object 1310, and based on the position and / or size of the second graphic object 1320. The second trigger area 1325 may be set.

Settings for the first trigger region and the second trigger region may be independent of each other. For example, the valid period of the first trigger region and the valid period of the second trigger region may be set differently.

Alternatively, the settings of the first trigger region and the second trigger region may be mutually dependent. For example, the valid periods of the first trigger region and the second trigger region may be set identically.

Alternatively, the second trigger region may be set to be valid after a predetermined time has elapsed since the first trigger region is valid.

Alternatively, when the validity period of the first trigger region expires, the second trigger region may be set to be activated. For example, when the first trigger area is set around the subject and the second trigger area is set at the position set by the user, the second trigger area is no longer valid because the subject is framed out and the second trigger area is no longer valid. The trigger area can be activated.

The controller 180 may set the functions of the first trigger region and the second trigger region to be the same, or may set the functions of both to be different. For example, the controller 180 may set both the first trigger region and the second trigger region to have a purpose of outputting additional content and stopping output of the additional content in the viewer mode.

Alternatively, the controller 180 may set the first trigger area to have the purpose of outputting additional content in the viewer mode, while the second trigger area may be set to have the purpose of stopping the output of the additional content in the viewer mode.

Alternatively, at least one of the first trigger region and the second trigger region may be set to have the purpose of outputting and stopping the output of the additional content, while the other may be set to have control purposes such as enlargement, playback, pause of the additional content.

When a plurality of additional contents are inserted into a video, a plurality of trigger regions may exist. At this time, the controller 180 may determine whether to allow overlapping arrangement of trigger regions based on the user setting. If overlapping arrangement between trigger regions is not allowed, the newly added trigger region may be as small as the overlapping portion with the existing trigger region, or the position may be automatically changed so as not to overlap with the existing trigger region.

14 is a diagram illustrating an operation of a terminal when a plurality of trigger regions are overlapped.

When overlapping arrangements of trigger regions are allowed, as in the example shown in FIG. 14A, the first graphic object 1410 and the second trigger region 1425 for setting the first trigger region 1415 A second graphic object 1420 for setting a may be overlapped. In this case, an area where the first graphic object 1410 overlaps with the second graphic object 1420 may correspond to the first trigger area 1415 or the second trigger area 1425. When the trigger regions are overlapped, a priority between trigger regions for the overlapping arrangement region may be determined. Priority may be used to determine the output order of additional content in viewer mode.

The priority may be determined by a user setting, or may be determined based on at least one of a sequence of setting a trigger area, a size of a trigger area, a type of additional content associated with each trigger area, an output mode, or a size. For example, the controller 180 may determine the priority of the trigger region in the order in which it is inserted into the video. That is, the trigger area added to the video first may have a higher priority than the trigger area inserted into the video later. Alternatively, considering the type of additional contents associated with each trigger region, the trigger region associated with the first type of additional content may be set to have a higher priority than the trigger region associated with the second type of additional content. Alternatively, among the additional contents, a trigger region associated with additional content whose output mode is full screen is set to have a higher priority than a trigger region associated with additional content whose output mode is partial screen, or additional content having a large output region size The trigger region associated with and may have a higher priority than the trigger region associated with additional content having a small size of the output region. The determined priority may be changed by user setting. Multiple trigger regions may be set to have the same rank.

Alternatively, the trigger regions may be set to have the same rank with respect to the overlapping arrangement region.

On the other hand, if overlapping arrangement of the trigger regions is not allowed, the first graphic object 1410 for setting the first trigger region 1415 and the second graphic object 1420 for setting the second trigger region 1425 May not be allowed to overlap. For example, as shown in the example shown in (a) of FIG. 14, when the second graphic object 1420 is superimposed on the first graphic object 1410, the control unit 180 may display 14 (b) As in the example shown in, the position of the second graphic object 1420 may be automatically changed to an area not overlapping with the first graphic object 1410.

Alternatively, instead of pushing the second graphic object 1420 to an area that does not overlap with the first graphic object 1410, the controller 180 may select one of the first trigger area 1415 and the second trigger area 1425. The first graphic object 1410 and the second graphic object 1420 may be controlled to be reduced by the overlapping amount. For example, when the second graphic object 1420 is moved over the first graphic object 1410, the control unit 180 may operate in the second graphic object 1420, as in the example illustrated in (c) of FIG. 14. The overlapping portion between the first graphic object 1410 and the second graphic object 1420 may be set as the second trigger area 1425.

New additional content may be linked to additional content already inserted in a video. For example, a second additional content different from the first additional content may be associated with the first additional content. When the second additional content is associated with the first additional content, the output area of the first additional content may function as a trigger area for the second additional content. That is, in the viewer mode, the trigger area associated with the first additional content is used to start or end the output of the first additional content, and the first additional content can be used to start or end the output of the second additional content. have.

15 shows an example of linking new additional content to additional content already inserted in a video.

For convenience of description, the additional content already inserted in the video will be referred to as first additional content, and additional content newly linked to the first additional content will be referred to as second additional content.

As in the example shown in (a) of FIG. 15, setting the first graphic object 1510 or the output area 1540 of the first additional content to set the trigger area 1530 for the first additional content When a predetermined user input is received in the second graphic object 1520 for, the controller 180 may output a menu for outputting the second additional content to be linked to the first additional content. Here, the predetermined input is to touch at least one of the first graphic object 1510 or the second graphic object 1520, or at least one of the first graphic object 1520 or the second graphic object 1520. It may mean that at least one of the number of touched pointers, the touch intensity, the number of touches, or the touch time is greater than or equal to a reference value. The menu may be for selecting the type of the second additional content, as in the example shown in FIG. 3, or may be a content list for selecting additional content. When content is selected through the menu, the controller 180 may determine the selected content as the second additional content. Alternatively, without outputting a menu for selecting a type of additional content, a list of additional content of the same type as the first additional content may be output in order to select the second additional content.

Alternatively, content satisfying a predefined condition may be determined as a second additional content to be automatically associated with the first additional content. Here, the content that satisfies the predefined conditions may include content related to the first additional content, content added to the most recent terminal, content most recently executed, or content executed in the viewer mode. The content that is highly related to the first additional content may mean content including content similar to the first additional content. For example, when the first additional content is an image or a video, an image or video of a person included in the first additional content, an image or video taken on the same date or the same place as the first additional content, is first added. It can be determined as content that is highly related to the content.

Alternatively, the controller 180 may control a content list including content related to the first additional content to be output. When content is selected through the content list, the selected content may be determined as the second additional content.

When the second additional content is selected, the controller 180 can selectively output the third graphic object 1550 for setting the output area 1560 of the second additional content according to the output mode of the second additional content. have. For example, when the output mode of the second additional content is full screen, the third graphic object 1550 is not output, while when the output mode of the second additional content is a partial screen, the output area of the second additional content ( 1560), the third graphic object 1550 for setting may be output. The controller 180 may determine the output area 1560 of the second additional content based on the position and size of the third graphic object 1550.

At this time, the position and / or size of the output area 1560 of the second additional content may be determined depending on the position and / or size of the output area 1540 of the first additional content. For example, the size of the output area 1560 of the second additional content may be set so as not to exceed the size of the output area 1540 of the first additional content. Alternatively, the position and / or size of the output area 1560 of the second additional content may be changed as much as the position and / or size of the output area 1540 of the first additional content is changed.

As another example, the output area 1560 of the second additional content may be set to be the same as the output area 1540 of the first additional content. When the output area 1560 of the second additional content is set equal to the output area 1540 of the first additional content, the output of the third graphic object 1550 for setting the output area 1560 of the second additional content This can be omitted.

Whether to allow the association of the second additional content to the first additional content may be determined according to the output mode of the first additional content. For example, the controller 180 may allow linking the second additional content to the first additional content only when the output mode of the first additional content is a partial screen. On the other hand, when the output mode of the first additional content is full screen, it may not be possible to link the second additional content to the first additional content.

The type of the second additional content that may be linked to the first additional content may be limited by the type of the first additional content. For example, the second additional content that may be linked to the first additional content may be limited to the same type as the first additional content. Accordingly, when the first additional content is an image, the second additional content that may be linked to the first additional content may be limited to an image.

A part of the first additional content may be set as a trigger area for the second additional content. That is, only some of the output areas of the first additional content may function as a trigger area for the second additional content.

A plurality of additional content may be linked to the first additional content. When a plurality of additional contents are associated with one additional content, the controller 180 may set a priority order among the multiple additional contents. Priority may be used to determine the output order of additional content in viewer mode. The priority may be determined by a user setting, or may be determined based on at least one of an order inserted into a video, a type of additional contents, an output mode, or a size. For example, the controller 180 may determine the priority of additional content in the order in which it is inserted into the video. That is, the additional content inserted into the video first may have a higher priority than the additional content inserted into the video later. Alternatively, considering the type of additional contents, the first type of additional content may be set to have a higher priority than the second type of additional content. Alternatively, among the additional contents, the additional content in which the output mode is full screen is set to have higher priority than the additional content in which the output mode is partial screen, or the additional content having a large output area is larger than the additional content having a small output area size. It can be set to have a high priority. The determined priority may be changed by user setting. Multiple additional contents may be set to have the same rank.

Alternatively, after linking a plurality of additional content to the first additional content, the first additional content may be divided into a plurality of regions, and each partitioned region may be set to function as a trigger region for different additional contents. For example, when the second additional content and the third additional content are linked to the first additional content, one-half of the output areas of the first additional content function as a trigger area for the second additional content, and the remaining 1 The / 2 area may function as a trigger area for the third additional content. The location and / or size of the trigger area for each of the plurality of additional content on the first additional content may be adjusted by a user's setting, based on the priority, output mode, location or type of the output area, etc. of each of the plurality of additional content It may be determined by.

In the above-described example, the trigger region and the output region of the additional content are illustrated as being square, but the present invention is not limited thereto. The trigger area and / or the output area of additional content may be set as polygons or circles other than rectangles.

In addition, in the above-described example, the trigger region and the output region of the additional content are illustrated through a graphic object, but the present invention is not limited thereto. For example, a trigger area and / or an output area of additional content may be set without a medium such as a graphic object. For example, when a touch input for dragging and moving a point in a predetermined direction is received, a rectangular area that uses the pointer's movement trajectory as a diagonal, width, or height may be set as a trigger area and / or an output area of additional content. . Alternatively, when a touch input in which two pointers touch the touch screen is received, a rectangular area having two pointers as two vertices may be set as a trigger area and / or an output area of additional content.

In the example illustrated in FIG. 2, it is described that the trigger region and the output region of the additional content are set in a sequence, but the present invention is not limited to the illustrated example. For example, in FIG. 2, although it is illustrated that a trigger region can be set after additional content to be inserted into the main content is selected, an embodiment implemented in the reverse order may be included in the scope of the present invention. For example, when the setting of the trigger area is completed, the present invention may be implemented such that a menu for selecting additional content to be inserted into the main content is displayed. As another example, the present invention may be implemented to set the trigger area after setting the output area of the additional content first.

Next, the operation of the terminal will be described under the viewer mode.

16 is a flowchart showing the operation of the terminal under the viewer mode.

When the editing mode ends, the controller 180 can switch the terminal to the viewer mode. The viewer mode indicates a state in which the settings related to the trigger area and additional content inserted in the video can no longer be changed. To change the settings related to the trigger area and additional content, the viewer mode must be exited and the edit mode must be entered again.

When the terminal is switched to the viewer mode, the controller 180 may set the trigger area set in the initial edit mode and the output area of additional content to be invisible. That is, when the terminal is switched from the edit mode to the viewer mode, in the edit mode, the trigger area and the output area of the additional content visually identified by the graphic object may no longer be identified and displayed. Accordingly, when the editing mode ends and the viewer mode is switched, only the first video may be output to the display unit 160.

However, in order to prevent a user from erroneously identifying the location of the trigger region, the controller 180 may control the location of the trigger region to be identified and displayed when a predetermined user input is received.

17 is a diagram illustrating an example in which the trigger region is visually identified and displayed.

In the example shown in Fig. 17, the outline of the dotted line represents the effective trigger area at time t0. The outline of the dotted line may be a virtual line invisible to the user.

When a video is playing at the time t0, when a user input for visually identifying and displaying the trigger area 1710 is received, the controller 180 controls the trigger area 1710 valid at the time t0 to be visually identified and displayed. You can. Here, the user input may be a touch of a button requesting to visually identify and display the trigger area 1710, a specific location of a video, or a predefined type of touch input. The predefined touch input may mean that at least one of the number of pointers touching a video, touch intensity, or touch time is greater than or equal to a reference value.

For example, when a user input requesting identification display of the trigger area 1710 is received at a time t0, the controller 180 may be located anywhere in the trigger area 1710, as in the example shown in (a) of FIG. 17. The element 1720 for identifying the trigger area 1710 may be controlled to be output. Alternatively, when a user input requesting identification display of the trigger area 1710 is received at a time t0, the controller 180 shows an outline of the trigger area 1710 as in the example shown in FIG. 17B. The element 1730 may be controlled to be outputted over the video.

At this time, in order to prevent the elements 1720 and 1730 from covering the video, the controller 180 may set the elements 1720 and 1730 to be translucent.

The control unit 180 may control the elements 1720 and 1730 to be output for a predetermined period of time, or may control the elements 1720 and 1730 to be output while blinking. Alternatively, the elements 1720 and 1730 may be output while the user input is maintained.

As another example, the controller 180 may control the trigger region to be visually identified for a predetermined time from the time when the valid period of the trigger region starts during video playback.

18 is a view showing an example in which the trigger area is visually identified and displayed.

It is assumed that a valid trigger region does not exist at the time t0, and the trigger region 1810 corresponding to the outline of the dotted line from the time t1 is valid.

As the video is played, when moving from the time t0 to the time t1, the controller 180 can control the trigger area 1810 corresponding to the outline of the dotted line to be visually identified for a predetermined time from the time t1. In FIG. 18, an element 1820 for identifying a trigger region in the trigger region 1810 is output. Here, the predetermined time may be a time predefined by the terminal, or may be determined by a running time of a video, an effective period of a trigger area, or a user setting. For example, the trigger area may be visually identified for a predetermined time Δt.

Alternatively, the trigger area may be visually identified and displayed continuously during the valid period of the trigger area.

When a touch input for touching the video is received while the video is being output (S1610), and the position of the received touch input corresponds to the inside of the effective trigger area at the time (S1620), the controller 180 is associated with the trigger area The added content can be controlled to be output. At this time, according to the output mode of the additional content, the controller 180 may output the additional content on the entire screen or on the partial screen (S1630, S1640, S1650). Here, the position and size of the partial screen may correspond to the output area of the additional content set in the edit mode. When the additional content is output as a partial screen, the additional content may be overlaid on a part of the main content.

19 is a diagram illustrating an example in which additional content is output in response to a user input touching a trigger area.

For convenience of description, it is assumed that two trigger regions are valid at the time t0, and the position and size of each trigger region are assumed to follow the example shown in FIG. 19A. In addition, it is assumed that the additional content associated with the first trigger region 1910 is the first image 1915 and the additional content associated with the second trigger region 1920 is the second image 1925.

When a user input for touching a video is received at a time t0, and the location of the received touch input corresponds to the inside of the trigger area, the controller 180 controls to output additional content associated with the trigger area selected by the touch input. can do. For example, when the location of the touch input is inside the first trigger region 1910, the controller 180 may control to output the first image 1915 associated with the first trigger region 1910. At this time, when the output mode of the additional content associated with the first trigger area 1910 is a full screen, the control unit 180, as in the example shown in (b) of FIG. 19, first trigger area 1910 The first image 1915 can be controlled to be output in full screen in response to a user input touching.

On the other hand, when the location of the touch input is inside the second trigger region 1920, the controller 180 may control the second image 1925 associated with the second trigger region 1920 to be output. At this time, when the output mode of the additional content associated with the second trigger region 1920 is a partial screen, the controller 180 may display the second trigger region 1920 as in the example illustrated in FIG. 19C. The second image 1925 may be controlled to be output as a partial screen in response to a user input touching. Specifically, the controller 180 may control the second image 1925 to be output through the output area of the additional content set in the edit mode.

The controller 180 may output additional content while adjusting the size of the video playback window. For example, after reducing the size of the video playback window, the controller 180 may output additional content through the output panel generated as the size of the video playback window is reduced. Specifically, when the second image 1925 is set to be output through the output panel 1930, the controller 180 touches the second trigger region 1920, as in the example shown in FIG. 19 (c). After reducing the size of the video playback window in response to the user input, the second image 1925 can be controlled to be output through the output panel 1930 that appears as the size of the playback window is reduced.

Alternatively, the output panel 1930 on the video may be overlaid while maintaining the size of the video playback window. The second image 1925 may be output on the output panel 1930 overlayed on the video.

When the additional content associated with the trigger area is a multimedia file output by playing a video or music, the controller 180 is configured to play additional content such as a video or music in response to a user input touching the trigger area. The multimedia player can be controlled to be output in full screen or partial screen. The user can control playback of additional content such as a video or music through a multimedia player.

When the additional content on the video is set to be overlayed output, in order to prevent the additional content from covering the video content, the controller 180 outputs the additional content in a translucent state, or when a predetermined time has elapsed since the additional content was output, It is possible to control the additional content to be translucent. Alternatively, the controller 180 may adjust the transparency of the additional content according to the playback state of the video. For example, while the video is being played, it is possible to control the additional content to be output in a translucent state, while the video is paused, the additional content can be controlled to be output in a non-transparent state (ie, an opaque state).

When the output mode of the additional content is a partial screen, the controller 180 can adjust the size of the additional content according to the size of the output area of the additional content. At this time, while the width of the additional content is greater than the height, if the output area of the additional content is set to be smaller than the height, distortion of the additional content output through the output area of the additional content may occur significantly. To solve the above problem, the controller 180 may rotate and output the additional content in consideration of the width and height ratio of the additional content and the width and height ratio of the output area of the additional content. For example, if the width of the additional content is less than the height, the width of the output area of the additional content is greater than the height, and / or the width of the additional content is greater than the height, and the width of the output area of the additional content is less than the height. In, the controller 180 may rotate and output additional content.

20 is a diagram illustrating an example in which additional content is rotated and output.

As shown in the example shown in (a) of FIG. 20, when the additional content 2030 associated with the trigger area 2010 is an image whose width is greater than the height, and the output area of the additional content is less than the height, the control unit In response to a user input touching the trigger area 2010, 180 may output additional content 2030 rotated 90 degrees through the output area 2020 of the additional content. At this time, the rotation direction (eg, clockwise or counterclockwise) of the additional content may be determined by the user's setting under the edit mode.

As another example, the controller 180 outputs additional content according to the aspect ratio of the trigger area set in the edit mode, but when a touch input for touching the trigger area or the additional content is received while the additional content is output, the additional content is It can also be controlled to rotate.

After the additional content is output, before the trigger region or the valid period for the additional content has elapsed, if the touch input is received and the location of the touch input is inside the trigger region or the output region of the additional content, the controller 180 adds The output of content may be stopped (S1660, S1670, S1680, S1690). That is, after the additional content is output, when a user input for touching the trigger area or the additional content is received, the output of the additional content may be terminated.

21 is a diagram showing an example in which the output of additional content is ended.

FIG. 21A is a view showing a trigger area 2110 and an output area 2120 of additional content.

When a touch input is received while the additional content 2130 is being output, and the touch location is inside the trigger area 2110, the controller 180 can add additional content (as in the example shown in (b) of FIG. 21). 2130) may be terminated. Although not shown, the output of the additional content 2130 may be terminated even when a touch input for touching the additional content 2130 is received.

The valid period for the trigger area may be set in association with the playback time of the video. That is, in the edit mode, when the valid period of the trigger region inserted at the time t0 of the video is set to Δt, the trigger region may effectively exist from the time t0 to the time t0 + Δt. However, if the validity period of the trigger area has expired while the additional content is being output, there may be a problem that the output of the additional content can no longer be terminated through the trigger area. To solve this problem, while the output of the additional content is continued, even if the validity period of the trigger region expires, the trigger region can be set to remain effective. Alternatively, while output of the additional content is continued, when the expiration time of the validity period of the trigger region is reached, it may be set to stop the video playback so that the trigger region remains effective. Alternatively, the expiration time of the additional content may also be set to expire at the expiration time of the trigger area, so that the output of the additional content is terminated at the expiration time of the trigger area.

As the video is played, the position / size of the trigger area may change. For example, when the trigger area is set around a subject appearing in a video, the position / size of the trigger area may change according to the movement of the subject in the video. The controller 180 may output additional content associated with the trigger region based on the location / size of the trigger region at the time when the user's touch input is received and whether the trigger region is valid.

Since the additional content is output, when the expiration time of the additional content is reached (S1660), the controller 180 may control the output of the additional content to end (S1690). At this time, the valid period of the additional content may be calculated from the time when the additional content is output. Alternatively, the start point of the valid period of the additional content may be set equal to the start point of the valid period of the trigger area.

When a plurality of valid trigger regions exist in the video, the controller 180 may output additional content associated with each trigger region in response to a touch input touching each trigger region. When a plurality of trigger regions are sequentially touched, the controller 180 can control the trigger regions associated with each of the plurality of trigger regions to be simultaneously output.

As another example, when a plurality of trigger regions are sequentially touched, the controller 180 may control to output only additional content associated with any one of the plurality of trigger regions. For example, when the first additional content associated with the first trigger area is being output, the controller 180 may receive the first additional content when a user input for selecting the second trigger area associated with the second additional content is received. It is also possible to stop the output of and control to output the second additional content.

Alternatively, according to whether the output area of the first additional content overlaps with the output area of the second additional content, the controller 180 determines whether to output the first additional content when the second additional content is output. You can also decide. For example, when the first additional content associated with the first trigger area is being output, when a user input for outputting the second additional content overlapping at least a portion of the output area of the first additional content is received, the control unit ( 180) may stop outputting the first additional content and output the second additional content. On the other hand, when the output area of the first additional content and the output area of the second additional content do not overlap, the controller 180 may output the second additional content while maintaining the output of the first additional content.

Alternatively, when the outputs of the first additional content and the second additional content overlap, the controller 180 may control at least one of the first additional content and the second additional content to be switched to a translucent state.

In the above-described example, in response to a user input touching the trigger area or the output area of the additional content, it has been described that the output of the additional content ends, but the response to the user input touching the output area of the trigger area or the additional content In addition, it is also possible to change the settings related to output of additional content. Here, the output-related setting may include at least one of adjusting the size of the additional content (eg, zooming), controlling the transparency of the additional content, or controlling playback of the additional content (eg, play, pause, pause).

For example, when a first type of touch input touching the trigger area or the output area of the additional content is received, the output of the additional content is set to end while the second form of touching the output area of the trigger area or the additional content is set. When a touch input of is received, output-related settings of additional content may be adjusted. For example, when a second type of touch input touching the trigger area or the output area of the additional content is received, the additional content displayed on the video is enlarged or reduced, or the transparency of the additional content displayed on the video can be adjusted. have. Here, the first type and the second type of touch input may be different in at least one of the number of pointers, the touch intensity (touch pressure), the touch time, or the number of touches.

Alternatively, the output of the additional content may be terminated in response to the user input touching the trigger area, while the output related setting of the additional content may be changed in response to the user input touching the output area of the additional content. For example, when a user input touching the output area of the additional content is received, the additional content displayed on the video may be enlarged or reduced, or the transparency of the additional content displayed on the video may be adjusted.

When a plurality of trigger regions are associated with one additional content, each of the plurality of trigger regions may be used to control the output and termination of the additional content. For example, when two trigger regions are associated with one additional content, output of the additional content may be started or ended by a user input touching the first trigger region, or a user input touching the second trigger region The output of the additional content may be started or stopped. When the valid periods of the first trigger region and the second trigger region are different, output of additional content may be controlled based on the valid periods of the first trigger region and the second trigger region. For example, when the valid period of the first trigger region is from t0 to t1, while the valid period of the second trigger region is from t2 to t3, based on the first trigger region from t0 to t1 The output of the additional content may be controlled, and the output of the additional content may be controlled from the time t2 to the time t3 based on the second trigger area.

Alternatively, when a plurality of trigger regions are linked to one additional content, different functions may be assigned to each of the plurality of trigger regions. For example, when two trigger regions are associated with one additional content, output start of the additional content is performed in response to receiving a user input touching the first trigger region, while output termination of the additional content is This may be performed in response to receiving a user input touching the second trigger area.

Alternatively, at least one of the plurality of trigger regions may be used to start or end output of additional content, while the other may be used to change settings related to output of additional content. For example, when two trigger regions are associated with one additional content, in order to start or end the output of the additional content, a user input touching the first trigger region must be received while setting the output related to the additional content. In order to change, a user input touching the second trigger area may need to be received.

When an overlapping area exists between the plurality of trigger areas, and when a user input for touching the area where the plurality of trigger areas overlap is received, the controller 180 may control the plurality of trigger areas based on the priority or touch type between the trigger areas. You can choose either.

22 is a diagram illustrating an operation of a terminal when a user input for touching an area where a plurality of trigger areas overlap is received.

As shown in the example shown in (a) of FIG. 22, a part of the first trigger region 2210 and the second trigger region 2220 are overlapped, and the first trigger region 2210 and the second trigger region ( In 2220), it is assumed that the first additional content 2215 and the second additional content 2225 are linked, respectively.

When a touch input for touching the region 2230 in which the first trigger region 2210 and the second trigger region 2220 overlap is received, the controller 180 may include the first trigger region 2210 and the second trigger region ( 2220), a trigger region having the highest priority may be selected. For example, when the priority of the first trigger region 2210 is higher than the priority of the second trigger region 2220, the controller 180 overlaps the first trigger region 2210 and the second trigger region 2220. It may be determined that the first trigger region 2210 is selected by a user input touching the region 2230. Accordingly, as in the example illustrated in FIG. 22B, the first additional content 2215 associated with the first trigger region 2210 may be output. In a state in which the first additional content 2215 is being output, when a user input for touching the region 2230 in which the first trigger region 2210 and the second trigger region 2220 overlap is received, the controller 180 It may be determined that the first trigger region 2210 having a higher priority than the second trigger region 2220 is selected. Accordingly, as in the example illustrated in FIG. 22C, output of the first additional content 2215 may be terminated.

Priority between trigger regions may be determined by user setting in the edit mode. Alternatively, it may be determined based on at least one of an order in which a trigger region is set in an edit mode, a type of additional contents associated with each trigger region, an output mode or a size.

When the output of the additional content associated with any one of the plurality of trigger regions starts and / or ends, the priority of the trigger region associated with the additional content may be changed to the lowest priority. For example, in the example illustrated in FIG. 22, when the output of the first additional content 2215 associated with the first trigger region 2210 ends, the control unit has a priority of the first trigger region 2210 second. It may be set to be lower than the priority of the trigger area 2220. Accordingly, after the output of the first additional content 2215 is finished, when a user input touching the region 2230 in which the first trigger region 2210 and the second trigger region 220 overlap is received, the control unit 180 determines that the second trigger region 2220 is selected and outputs the second additional content 2225 associated with the second trigger region 2220, as in the example shown in FIG. 22D. It can be controlled to start.

As another example, when a user input touching the region 2230 in which the first trigger region 2210 and the second trigger region 2220 overlap is received while the first additional content 2215 is being output, the control unit ( 180) may control the output of the second additional content 2225 to be started at the same time as the output of the first additional content 2215 is finished.

In the example illustrated in FIG. 22, when a user input that touches a portion where a plurality of trigger regions overlap is received, it is illustrated that any one of the plurality of trigger regions is selected according to a priority between trigger regions. Accordingly, it may be set to select any one of a plurality of trigger regions. For example, when a first type of touch input is received in a portion where the first trigger area and the second trigger area overlap, the first trigger area is determined to be selected, whereas the second type of touch input is received when the first type of touch input is received. It may be determined that the trigger region is selected. Here, the first type and the second type of touch input may be different in at least one of the number of pointers, the touch intensity (touch pressure), the touch time, or the number of touches.

As another example, when a user input that touches a portion where multiple trigger regions overlap is received, it may be determined that the multiple trigger regions are simultaneously selected. For example, when a user input touching a portion where the first trigger region and the second trigger region overlap is received, the controller 180 may select both the first trigger region and the second trigger region. Accordingly, output of the first additional content associated with the first trigger region may start or end, and output of the second additional content associated with the first trigger region may start or end.

When a plurality of additional contents are linked to one trigger region, the controller 180 may start or end the output of additional content having high priority in response to a user input touching the trigger region.

23 is a diagram illustrating an operation of a terminal when a user input touching a trigger region associated with a plurality of additional contents is received.

23A, it is assumed that the first additional content 2315 and the second additional content 2325 are associated with the trigger area 2310.

When a touch input touching the trigger area 2310 is received, the controller 180 outputs additional content having the highest priority among the first additional content 2315 and the second additional content 2325 associated with the tree area. It can be controlled as much as possible. For example, when the priority of the first additional content 2315 is higher than the priority of the second additional content 2325, the controller 180 may generate a trigger area (eg, as in the example shown in FIG. 23B). 2310), the first additional content 2315 may be output in response to a user input touching the screen. When a touch input for touching the trigger area 2310 is received while the first additional content 2315 is being output, the controller 180 adds the first, as in the example shown in (c) of FIG. 23. The output of the content 2315 can be ended.

Priority between additional content may be determined by user setting in the edit mode. Alternatively, it may be determined based on at least one of an order in which additional content is inserted into a video, a type of additional content, an output mode, or a size in the edit mode.

When the output of the previously added content is ended, the priority of the additional content may be changed to the lowest priority. For example, in the example illustrated in FIG. 23, when the output of the first additional content 2315 is ended, the priority of the first additional content 2315 is set to be lower than the priority of the second additional content 2315. You can. Accordingly, when a user input touching the trigger area 2310 is received, the controller 180 controls to start outputting the second additional content 2325 as in the example illustrated in FIG. 23D. can do.

As another example, when a user input for touching the trigger area 2310 is received while the first additional content 2315 is being output, the controller 180 terminates the output of the first additional content 2315 at the same time. 2 The output of the additional content 2325 may be controlled to start.

The priority of the plurality of additional contents may be the same. For example, when the first additional content and the second additional content are in the same rank, the controller 180 responds to a user input touching the trigger area, starts or ends output of the first additional content, and simultaneously adds the second. You can start or end the output of content.

Alternatively, the controller 180 may output at least one of the first additional content or the second additional content according to the form of a touch input to the trigger area. For example, when a first type of touch input touching the trigger area is received, first additional content is output, and when a second type of touch input touching the trigger area is received, second additional content is output. You can.

Alternatively, when the first type of touch input is received, as in the example illustrated in FIG. 23, the first additional content and the second additional content are sequentially output as the touch input is received, while the second type of touch is received. When input is received, the first additional content and the second additional content may be controlled to be simultaneously output.

When other additional content is linked to the additional content, the controller 180 may control to output additional content linked to the additional content in response to a user input touching the additional content.

24 illustrates an example in which other additional content is output in response to a user input touching the additional content. For convenience of description, as in the example illustrated in FIG. 24A, the first additional content 2415 is associated with the trigger area 2410 and the second addition is added to the first additional content 2415. It is assumed that the content 2425 is linked.

The output of the first additional content 2415 may be started or terminated by the trigger area 2410, while the output of the second additional content 2425 may be started or terminated by the first additional content 2415. Specifically, when a user input for touching the trigger area 2410 is received, the controller 180, as in the example illustrated in (b) of FIG. 24, first additional content linked to the trigger area 2410 ( 2415) can be controlled to be output.

In a state in which the first additional content 2415 is being output, when a user input for touching the first additional content 2415 is received, the controller 180 may display the second additional content (associated with the first additional content 2415). 2425) can be controlled to be output. At this time, the second additional content 2425 may be output as a full screen or a partial screen according to the output mode of the second additional content 2425 set in the edit mode. When the second additional content 2425 is set to be output as a partial screen, the output position and / or size of the second additional content 2425 is the position and / or the output area of the second additional content 2425 set in the edit mode It can be determined by size.

As another example, when the output areas of the first additional content 2415 and the second additional content 2425 are set to be the same, the second additional content 2425 may be overlaid on the first additional content 2415.

As in the example illustrated in FIG. 24, the output area of the first additional content 2415 may function as a trigger area for the second additional content 2425. However, the output area of the first additional content 2415 may function as a trigger area for the second additional content 2425 only when the first additional content 2415 is output through the corresponding area. That is, only when the first additional content 2415 output on the main content is touched, the second additional content 2425 may be output on the main content.

The controller 180 may determine whether to output the second additional content 2425 according to the form of the touch input to the first additional content 2415. For example, when a first type of touch input is input to the first additional content 2415, the second additional content 2425 is output in response to the touch input, and the first additional content 2415 is displayed. When a second type of touch input is input, the output of the first additional content 2415 may be ended in response to the touch input, or an output-related setting for the first additional content 2415 may be changed. Here, the first type and the second type of touch input may be different in at least one of the number of pointers, the touch intensity (touch pressure), the touch time, or the number of touches.

The controller 180 may stop output of the second additional content 2425 in response to a user input touching the output area of the first additional content or the output area of the second additional content. Alternatively, the controller 180 stops the output of the first additional content 2415 in response to a touch input touching the output area of the first additional content, and the touch input for the touch input touching the output area of the second additional content. In response, the output of the second additional content 2425 may be stopped.

Meanwhile, the controller 180 may stop the output of the first additional content 2415 and the second additional content 2425 in response to a user input touching the trigger area 2410. Alternatively, in response to the first touch input touching the trigger area 2410, outputting either the first additional content 2415 or the second additional content 2425 ends, and the trigger area 2410 is touched. The output of the additional content remaining in response to the second touch input may be terminated.

As another example, the output area of the first additional content 2415 is set to function as a trigger area for the second additional content 2425, but the second additional content ( When 2425) is output, the output of the first additional content 2415 may be set to be stopped. When the output of the first additional content 2415 is stopped as the second additional content 2425 is output, the trigger area 2410 that controls the output of the first additional content 2415 is the second additional content 2425 ) Can be used to stop the output.

When a plurality of additional contents are linked to the first additional content, the controller 180 may determine additional content to be output according to a location of a touch input touching the first additional content or a form of a touch input. For example, when a touch input touching the first area of the first additional content is received, the second additional content is output, while the touch input touching the second area of the first additional content is received. It can be controlled to output additional content. Alternatively, when the first type of touch input is received for the first additional content, the second additional content is set to be output, while when the second type of touch input is received for the first additional content, the third addition is added. Content can be set to be output.

Alternatively, the controller 180 may select additional content to be output based on the priority order among the plurality of additional content associated with the first additional content. For example, when a touch input for touching the first additional content is received, the controller 180 may control to output the additional content having the highest priority among a plurality of additional content associated with the first additional content. For example, when the priority of the second additional content is higher than the priority of the third additional content, the second additional content may be output in response to a touch input touching the first additional content.

When the output of the additional content associated with the first additional content ends, the priority of the additional content may be changed to the lowest priority. For example, when the output of the second additional content ends, the priority of the second additional content may be changed to a lower priority than the priority of the third additional content. Accordingly, when the touch input for touching the first additional content is received again, the third additional content instead of the second additional content may be output.

The valid period of the second additional content linked to the first additional content may be set independently of the first additional content. For example, the valid period of the first additional content may be set to Δt, and the valid period of the second additional content may be set to Δt '. While the second additional content is being output, if the validity period of the first additional content has expired, the output of the first additional content may be ended. When the output of the second additional content is ended, a trigger area triggering the output of the first content may be used to control the output of the second additional content.

Alternatively, when the validity period of the first additional content expires, the validity period of the second additional content may be set to expire. In this case, as the validity period of the first additional content expires, output of the second additional content as well as the first additional content may be ended.

Exemplary methods of the present disclosure are expressed as a series of operations for clarity of description, but are not intended to limit the order in which the steps are performed, and each step may be performed simultaneously or in a different order if necessary. In order to implement the method according to the present disclosure, the steps illustrated may include other steps in addition, other steps may be included in addition to the remaining steps, or other additional steps may be included in addition to some steps.

Various embodiments of the present disclosure are not intended to list all possible combinations, but are intended to describe representative aspects of the present disclosure, and the items described in various embodiments may be applied independently or in combination of two or more.

In addition, various embodiments of the present disclosure may be implemented by hardware, firmware, software, or a combination thereof. For implementation by hardware, one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), Universal It can be implemented by a processor (general processor), a controller, a microcontroller, a microprocessor.

The scope of the present disclosure includes software or machine-executable instructions (eg, operating systems, applications, firmware, programs, etc.) that cause an operation according to the method of various embodiments to be executed on a device or computer, and such software or Instructions include a non-transitory computer-readable medium that is stored and executable on a device or computer.

The present invention can be applied to electronic devices capable of handling content such as documents, images, and videos.

Claims (15)

1. A touch screen for displaying information and receiving a touch input; And

   When a video is output to the touch screen, and the first additional content to be inserted into the video is selected, a first trigger area to be associated with the first additional content is set, and the video in which the first trigger area is inserted And a control unit controlling to output the first additional content in response to the touch input when a touch input touching the first trigger region is received at a first time point.
2. According to claim 1,

   The first time point is characterized in that the first trigger area is included between a valid time period of the first trigger area and a second time point at which the validity period is calculated.
3. According to claim 2,

   The second viewpoint is a terminal characterized in that the playback time of the video when the first trigger region is set.
4. According to claim 2,

   The control unit controls the first trigger area to be visually identified and displayed when the playback time of the video reaches the second time as the video is played.
5. According to claim 1,

   At least one of the position or size of the first trigger area is set centering on the subject appearing in the video, and at least one of the position or size of the first trigger area changes according to the movement of the subject appearing in the video. Characterized in that, the terminal.
6. The method of claim 5,

   When the subject is framed out, the terminal is characterized in that the valid period of the first trigger area expires.
7. According to claim 1,

   The control unit controls the output of the first additional content to end when the validity period of the first additional content expires,

   The validity period of the first additional content is calculated from the time when the output of the first additional content starts, the terminal.
8. According to claim 1,

   The controller, in response to the touch input, controls to reduce the size of the playback window of the video,

   The terminal, characterized in that the first additional content is output through the output panel that is output as the size of the playback window is reduced.
9. According to claim 1,

   When a second trigger region associated with second additional content is further inserted into the video, and at least a portion of the first trigger region and the second trigger region overlap,

   The control unit responds to a touch input touching an area where the first trigger area and the second trigger area overlap, and additional content associated with a trigger area having a higher priority among the first trigger area and the second trigger area. Characterized in that to control the output, the terminal.
10. The method of claim 9,

    When the output of the additional content associated with the trigger region having the higher priority among the first trigger region and the second trigger region is terminated, the priority of the trigger region associated with the additional content where the output is terminated is changed to the lowest priority. Characterized in that, the terminal.
11. According to claim 1,

    When the first additional content is additionally linked to the second trigger area,

    The second trigger area is switched to a valid one when the validity period of the first trigger area expires, the terminal.
12. According to claim 1,

    When a second additional content is additionally linked to the first trigger area,

    In response to a touch input touching the first trigger region, the control unit controls one of the first additional content and the second additional content having a higher priority to be output.
13. According to claim 1,

    When the second additional content is linked to the first additional content,

    The control unit controls the second additional content to be output in response to a touch input for touching the first additional content, the terminal.
14. The method of claim 13,

    The control unit outputs both the first additional content and the second additional content when the validity period of the first additional content expires while the first additional content and the second additional content are being simultaneously output. Characterized in that the control to be stopped, the terminal.
15. Determining first additional content to be inserted into the video;

    Setting a first trigger region to associate with the first additional content; And

    And outputting the first additional content in response to the touch input when a touch input touching the first trigger region is received at a first time point of the video in which the first trigger region is inserted. Control method.

Images