KR20210046633A - Terminal, method for contrlling thereof and recording medium on which a program for implemeting the method - Google Patents

Abstract

The present invention relates to a terminal capable of setting a trigger area and outputting additional content according to a response of an input touching a set trigger area, and a control method thereof. The terminal according to the present invention may comprise: a touch screen displaying information and receiving a touch input; and a control unit outputting main content to the touch screen, setting a trigger area associated with a plurality of pieces of additional content on the main content, outputting a list of the plurality of pieces of the additional content associated with the trigger area in response to the touch input touching the trigger area when an editing mode in which the setting of the trigger area is allowed ends and a viewer mode is executed, and controlling first additional content corresponding to a selected item when any one of the list is selected.

Description

A terminal, a control method thereof, and a recording medium in which a program for implementing the method is recorded.

The present invention relates to a terminal capable of setting a trigger area and outputting additional content according to a response of an input touching the set trigger area, and a control method thereof.

With the advancement of technology, various electronic devices have increased beyond the PC. For example, not only mobile terminals such as mobile phones and tablet PCs, but also touch-based PCs using touch input as the main input source have appeared.

These newly appeared terminals also support document viewing and editing functions for user convenience. However, in these terminals, the word processor used in the existing PC is simply ported and used.

Accordingly, there is a need to develop a user interface capable of efficiently reading and editing documents not only in the existing PC but also in the newly appeared terminal.

The present disclosure is to provide a terminal and a control method capable of outputting additional content in response to touching the main content.

Further, the present disclosure is to provide a terminal and a control method in which a user can freely adjust an area capable of triggering output of additional content or an output area of additional content.

In addition, the present disclosure is to provide a terminal and a control method capable of adaptively determining a content to be output to a main content based on a priority between a plurality of trigger regions or a priority between a plurality of additional content.

In addition, the present disclosure is to provide a terminal and a control method that can use additional content to control the output of other additional content.

The technical problems to be achieved in the present disclosure are not limited to the technical problems mentioned above, and other technical problems that are not mentioned will be clearly understood by those of ordinary skill in the technical field to which the present invention belongs from the following description. I will be able to.

The terminal according to the present disclosure, a touch screen for displaying information and receiving a touch input, and outputting a main content to the touch screen, and setting a trigger area associated with a plurality of additional content on the main content, When the editing mode allowing setting of the trigger area is terminated and the viewer mode is executed, in response to a touch input touching the trigger area, a list of the plurality of additional contents associated with the trigger area is output, and the When any one of the list is selected, it may include a control unit that controls to output the first additional content corresponding to the selected item.

The control method of a terminal according to the present disclosure comprises the steps of setting a trigger region associated with a plurality of additional content on a main content, and when the editing mode allowing the setting of the trigger region and the additional content is terminated and the viewer mode is executed. , In response to a touch input touching the trigger area, outputting a list of the plurality of additional content associated with the trigger area, and when any one of the list is selected, first additional content corresponding to the selected item It may include the step of outputting.

In the terminal and the terminal control method according to the present disclosure, when an item corresponding to the first additional content in the additional content list is selected while the first additional content is being output, the first additional content is output. Can be terminated.

In the terminal and the terminal control method according to the present disclosure, when an item corresponding to a second additional content different from the first additional content in the additional content list is selected while the first additional content is being output, the As the output of the first additional content is terminated, the output of the second additional content may be started.

In the terminal and the terminal control method according to the present disclosure, the first additional content may be output through an output area of the first additional content set in the editing mode.

In the terminal and the terminal control method according to the present disclosure, when a user input for touching and dragging the first additional content is received, at least one of the location or size of the first additional content is changed in response to the user input. Can be.

In the terminal and the terminal control method according to the present disclosure, even if the location or size of the first additional content is changed, the location or size of the output area may not be changed.

In the terminal and the control method of the terminal according to the present disclosure, the controller may generate log data that records the usage records of each of the plurality of additional content.

In the terminal and the terminal control method according to the present disclosure, the usage record may include at least one of the number of times the additional content is cited, a file name in which the additional content is cited, or a page number in which the additional content is cited.

Features briefly summarized above with respect to the present disclosure are only exemplary aspects of the detailed description of the present disclosure described below, and do not limit the scope of the present disclosure.

The present disclosure has an effect of providing a terminal and a control method capable of outputting additional content in response to touching the main content.

Furthermore, the present disclosure has an effect of providing a terminal and a control method in which a user can freely adjust an area capable of triggering output of additional content or an output area of additional content.

In addition, the present disclosure may provide a terminal and a control method capable of adaptively determining a content to be output to a main content based on a priority between a plurality of trigger regions or a priority between a plurality of additional content.

In addition, the present disclosure may provide a terminal and a control method that can use additional content for controlling the output of other additional content.

The effects obtainable in the present disclosure are not limited to the above-mentioned effects, and other effects not mentioned may be clearly understood by those of ordinary skill in the art from the following description. will be.

1 is a block diagram of a terminal according to the present invention.
2 is a flowchart showing an operation of a terminal in an edit mode.
3 is a diagram for describing an example of selecting additional content.
4 is a diagram illustrating an example of setting a trigger area based on a graphic object.
5 is a diagram illustrating an example of setting a trigger area and an output area of additional content.
6 is a diagram illustrating an example of setting a trigger area and an output area of additional content.
7 is a diagram illustrating an example in which a plurality of additional contents are linked to one trigger area.
8 is a diagram illustrating an example in which a plurality of additional contents are linked to a trigger object using a sub-menu.
9 is a diagram illustrating an example of setting a plurality of trigger regions for one additional content.
10 is a diagram illustrating an operation of a terminal when a plurality of trigger regions are overlapped and arranged.
11 shows an example in which additional content previously inserted in the main content is set as a trigger area for new additional content.
12 is a flowchart showing an operation of a terminal in a viewer mode.
13 is a diagram illustrating an example in which a trigger area is visually identified and displayed.
14 is a diagram illustrating an example in which additional content is output in response to a user input touching a trigger area.
15 is a diagram illustrating an example in which additional content is rotated and output.
16 is a diagram illustrating an example in which output of additional content is terminated.
17 is a diagram illustrating an operation of a terminal when a user input for touching an area in which a plurality of trigger areas are overlapped is received.
18 and 19 are diagrams illustrating an example in which an additional content list is output in response to a user input touching a trigger area.
20 is a diagram illustrating an operation of a terminal when a user input for touching a trigger area associated with a plurality of additional content is received.
21 shows an example in which other additional content is output in response to a user input touching the additional content.
22 is a diagram illustrating an example in which the output position and size of additional content are changed.
23 is a diagram illustrating an example of outputting usage details for each content.

Hereinafter, exemplary embodiments of the present disclosure will be described in detail with reference to the accompanying drawings so that those of ordinary skill in the art may easily implement the exemplary embodiments. However, the present disclosure may be implemented in various different forms and is not limited to the embodiments described herein.

In describing an embodiment of the present disclosure, when it is determined that a detailed description of a known configuration or function may obscure the subject matter of the present disclosure, a detailed description thereof will be omitted. In addition, parts not related to the description of the present disclosure in the drawings are omitted, and similar reference numerals are attached to similar parts.

In the present disclosure, when a component is said to be "connected", "coupled" or "connected" with another component, it is not only a direct connection relationship, but also an indirect connection relationship in which another component exists in the middle. It can also include. In addition, when a certain component "includes" or "have" another component, it means that other components may be further included rather than excluding other components unless otherwise stated. .

In the present disclosure, terms such as first and second are used only for the purpose of distinguishing one component from other components, and do not limit the order or importance of the components unless otherwise noted. Accordingly, within the scope of the present disclosure, a first component in one embodiment may be referred to as a second component in another embodiment, and similarly, a second component in one embodiment is a first component in another embodiment. It can also be called.

In the present disclosure, components that are distinguished from each other are intended to clearly describe each feature, and do not necessarily mean that the components are separated. That is, a plurality of components may be integrated into one hardware or software unit, or one component may be distributed to form a plurality of hardware or software units. Therefore, even if not stated otherwise, such integrated or distributed embodiments are also included in the scope of the present disclosure.

In the present disclosure, components described in various embodiments do not necessarily mean essential components, and some may be optional components. Accordingly, an embodiment comprising a subset of components described in the embodiment is also included in the scope of the present disclosure. In addition, embodiments including other components in addition to the components described in the various embodiments are included in the scope of the present disclosure.

The present disclosure relates to an application including a content editing tool and a terminal capable of driving the application. The content editing tool described in the present disclosure provides a function of setting a trigger region in the main content and linking the trigger region with the additional content. When a user input for selecting a trigger region is received after editing of the main content is completed, additional content linked to the trigger region may be output. Hereinafter, a content editing tool according to the present invention and a terminal capable of driving an application supporting the same will be described in detail.

1 is a block diagram of a terminal according to the present invention. The terminal described in the present invention may be a mobile terminal such as a smartphone, a tablet PC (Personal Computer), a laptop (Laptop), or a PDA (Personal Digital Assistants), or a fixed terminal such as a personal computer (PC) or a smart TV. have. However, for convenience of description, it is assumed that the terminal is a mobile terminal in the drawings and embodiments to be described later.

Referring to FIG. 1, a terminal according to the present invention includes a communication unit 110, a camera 120, a microphone 130, a user input unit 140, a display unit 150, an audio output unit 160, and a memory 170. And a controller 180.

The communication unit 110 enables a terminal to communicate with other terminals. The communication unit 110 may perform communication through a wireless method or a wired method. For example, in order to perform communication in a wireless manner, the communication unit 110 may include at least one of a mobile communication module or a wireless Internet module. The mobile communication module is for performing communication through a mobile communication base station such as LTE, HSDPA, or CDMA, and the wireless Internet module is for performing communication through a wireless LAN (Wi-Fi) or the like. The wired method may include LAN, USB, HDMI, RGB or DVI.

The camera 120 receives a Youngsan signal and performs signal processing on the input image signal. The microphone 130 receives an audio signal and performs signal processing on the input audio signal.

The user input unit 140 receives a user input. The user input unit 140 may include at least one of an input unit in the form of a button exposed to the outside of the terminal and a touch input unit capable of receiving a touch input touching the display unit 150. The touch input unit may include at least one touch sensor. In this case, when the display unit 150 and the touch input unit form a mutual layer structure, such a structure may be referred to as a “touch screen”. In such a touch screen structure, it is possible to receive various types of touch inputs such as selecting or dragging an object displayed on the touch screen using a pointer.

The user input unit 140 may also include at least one motion sensor for receiving a gesture input. In this case, the motion sensor may include a gyro sensor or an acceleration sensor capable of detecting the movement of the terminal. As another example, the controller 180 may analyze a user's movement through an image input through the camera 120 and determine whether a gesture input has been received based on the analysis result.

In embodiments to be described later, an example in which a terminal operates based on various user inputs through a touch screen will be described. However, in embodiments to be described later, implementing a function executed by a touch input by an input of touching (or pushing) a button exposed outside the terminal or a gesture input is also included in the embodiment of the present invention.

The display unit 150 outputs information processed by the terminal. For example, the display unit 150 plays a role of outputting an execution screen of an application driven by a terminal, a user interface or a graphic user interface on the execution screen.

The sound output unit 160 serves to output audio data received from the communication unit 110 or stored in the memory 170.

The memory 170 stores data for application execution and data processed by the terminal. The memory 170 includes a hard disk, a solid state disk (SSD), a flash memory 170, a card-type storage device (for example, an SD or XD memory 170), a random access memory (RAM). ) Or ROM (Read Only Memory). Web storage that can be accessed remotely through the communication unit 110 may also be included in the category of the memory 170.

The controller 180 controls the overall operation of the terminal. The controller 180 may process signals, data, or information input or output through components constituting the terminal. In addition, the controller 180 may execute an application stored in the memory 170. The controller 180 may include an operation/control device such as a central processing unit (CPU), a graphic processing unit (GPU), a micro controller unit (MCU), or a micro processing unit (MPU).

The terminal does not have to include all of the components shown in FIG. 1, and some of the components shown in FIG. 1 may not be included depending on the implementation form. The present invention will be described in detail based on the above description.

The main content described in the present invention may be text-based content or multimedia content such as an image or a video. For example, the main content is a presentation document (e.g., a file with an extension of ppt(x)), a spreadsheet document (e.g., a file with an extension of xls(x)), a word processing document (e.g. For example, a file with an extension of doc(x), hwp, txt or pdf), a web page (e.g., a file with an extension of html), or an e-book (e.g., a file with an extension such as epub) Based on text-based content, or an image (e.g., a file with an extension such as jpg, gif, tif or bmp) or a video (e.g., a file with an extension such as mpeg, avi, mp4, wmv or mov) It may be multimedia content based.

Hereinafter, a state in which a trigger region can be set in the main content is defined as an edit mode, and a state in which additional content linked to the trigger region is output in response to a trigger region touch is defined as a viewer mode. That is, the edit mode may indicate a state in which settings related to the trigger region and additional content can be changed, and the viewer mode may indicate a state in which settings related to the trigger region and additional content cannot be changed.

2 is a flowchart showing an operation of a terminal in an edit mode.

When the main content is selected, the controller 180 may output the selected main content on the display unit 150 (S210). The controller 180 may output the main content in full screen while maintaining the aspect ratio of the main content. Accordingly, when the aspect ratio of the main content is different from the aspect ratio of the display unit 150, a blank space may be generated in the display unit 150. The controller 180 may fill the blank space with a single predefined color or a color selected by user selection. Alternatively, the controller 180 may determine a pixel value of a pixel included in the margin based on a value of a pixel at the boundary of the main content. For example, a pixel value of a pixel included in the margin may be set to be the same as a sample value of a sample located at a boundary of the main content having the same x-coordinate or y-coordinate as the corresponding pixel.

When the main content includes a plurality of pages, the controller 180 may control at least one page to be output through the display unit 150.

Next, the controller 180 may select additional content to be inserted into the main content based on a user input (S220). Additional content that can be inserted into the main content may be content such as text-based content, images, moving pictures, or music. That is, the main content and the additional content may have the same type or different types.

3 is a diagram for describing an example of selecting additional content.

When a predetermined user input is received while the main content is being output, the controller 180 may output a menu 310 for selecting additional content. Here, the predetermined touch input may be a touch input of touching an arbitrary location of the main content, a touch input of a predefined type, or a touch input of touching a menu calling a content selection function. The predefined form may be that at least one of the number of pointers, touch strength (touch pressure), touch time, and number of touches is greater than or equal to a reference value.

As an example, when a user input for touching an arbitrary location of the main content is received, the controller 180 displays a menu 310 for selecting additional content at the user's touch input point, as in the example shown in FIG. 3. Can be printed. The selection of additional content may proceed in the following order: i) selection of a content type, and ii) output of a list of content of a selected type or generation of a selected type of content.

For example, each item included in the menu 310 shown in FIG. 3 may be for selecting a content type. Specifically, each item of the menu 310 illustrated in FIG. 3 is sequentially an image 311, a video 312, a web 313, a mark 314, music 315, text 316, and a slide file. It may be for selecting my specific page 317.

When a user input for selecting a content type is received, the controller 180 may output a list of contents corresponding to the selected type or execute an application/input window for generating content corresponding to the selected type. In this case, whether to output a content list or to execute an application for generating content may be determined by a user input. Or you can run either of these by default.

For example, when the image item 311 or the video item 312 is selected through the menu 310, the controller 180 outputs a list of image or video files stored in the memory 170 or the cloud, or You can run a camera application to create a file. When any one of the file list is selected or the image or video recording is completed through the camera 120, the selected/generated image or video may be determined as additional content to be inserted into the main content.

Alternatively, when the web item 313 is selected through the menu 310, the controller 180 outputs a list of web pages, a list of favorites, or a list of web pages stored in the memory 170 or in the cloud, or a web page You can run a web browser application to select. Alternatively, an input window for inputting an IP address or a URL (Uniform Resource Locator) address of a web page may be displayed. The IP address or URL address of the web page may be input through the input window. According to the above process, when a web site document or an Internet protocol (IP) address or a uniform resource locator (URL) address of the web site is determined, the web site may be determined as additional content to be inserted into the main content.

Alternatively, when the mark item 314 is selected through the menu 310, the controller 180 may output a list of pre-stored images that can be inserted into the main content. The pre-stored image may include at least one of an icon, an emoji, or a figure.

Alternatively, when the audio item 315 is selected through the menu 310, the controller 180 may output a list of music files stored in the memory 170 or the cloud, or execute a recording application to generate an audio file. . When any one of the file list is selected or recording is completed through the microphone 130, the selected/generated data may be determined as additional content to be inserted into the main content.

Alternatively, when the text item 316 is selected through the menu 310, the controller 180 may output an input window for inputting text. The controller 180 may determine the text input through the input window as additional content to be inserted into the main content.

Alternatively, when the slide item 317 is selected through the menu 310, the controller 180 may output an input window for inputting a page list or page number in the slide file. When any one of the page list is selected or a page number is input through the input window, the corresponding page may be determined as additional content.

Although not shown, a document different from the document being edited may be set as the additional content. For example, when a document item is selected, the controller 180 may output a list of document files stored in the memory 170 or a cloud, or may execute a document creation application to generate a document file. When any one of the file list is selected or a document is generated through a document creation application, the selected/generated document may be determined as additional content to be inserted into the main content.

In the above example, after selecting a content type, it is shown that an application for generating a content list of the selected type or a content of the selected type is executed, but this is only an embodiment for selecting additional content, and the present invention is limited. It is not. For example, without selecting a content type, a content list may be output, an application for content generation may be executed, or when a content type is selected, content corresponding to a predefined condition may be determined as additional content. Here, the content corresponding to the predefined condition is the most recently viewed content, the most recently modified content, the most recently stored content in the terminal, the content with the highest number of views by the user for a predetermined period, or the content previously specified by the user. And the like.

In addition, although FIG. 3 illustrates that the content type is determined based on a user input touching any one of the items included in the menu 310, it is also possible to select the content type in a method different from that shown. will be. For example, the content type may be determined according to the user's touch input type. For example, when a first type of touch input is received, it is determined that the first type of content is selected, whereas when a second type of touch input is received, it may be determined that the second type of content is selected. Here, the first type and the second type of touch input may be different in at least one of the number of pointers, touch strength (touch pressure), touch time, and number of touches.

When the additional content is selected, a trigger area associated with the additional content in the main content may be set (S230). Specifically, when additional content is selected, the controller 180 may output a graphic object for setting a trigger area in the main content, and adjust the location and size of the trigger area according to the location and size of the graphic object. For convenience of explanation, a graphic object for setting a trigger area will be defined as a trigger object.

4 is a diagram showing an example of setting a trigger area based on a trigger object.

The left drawing of FIG. 4 shows an example of setting a trigger area in the main content under the edit mode, and the right drawing of FIG. 4 shows an example of identifying and displaying the trigger area in the viewer mode. In addition, the outline of the dotted line in the left drawing of FIG. 4 indicates the location or size of the previous graphic object, and the outline of the dotted line in the right drawing of FIG. 4 indicates the trigger area.

When the additional content is determined, the controller 180 may control the trigger object 410 for setting the trigger area 420 to be output, as in the example shown in FIG. 4A. The trigger object 410 may be an image representing additional content. Here, the image representing the additional content may include at least one of a thumbnail or a preview image. For example, if an image is selected as the additional content, a thumbnail of the image selected for setting a trigger area may be output as the trigger object 410.

In addition to the example described above, the trigger object 410 may be an image corresponding to the type of additional content. For example, when additional content is determined, an image corresponding to the determined type of additional content may be output as a trigger object 410.

Alternatively, a predefined/pre-stored image or polygonal image may be output as the trigger object 410.

The controller 180 may set the location and/or size of the trigger area 420 according to the location and/or size of the trigger object 410. That is, the location and size of the trigger object 410 may correspond to the location and size of the trigger area 420.

For example, as in the example shown in (b) of FIG. 4, when the location of the trigger object 410 is changed, the location of the trigger area 420 may also be changed according to the changed location of the trigger object 410. have. For example, in (b) of FIG. 4, if the upper left coordinate of the trigger object 410 is changed from (x1, y1) to (x2, y2), the coordinate of the trigger area 420 is also from (x1, y1). It can be changed to (x2, y2).

In addition, as in the example shown in FIG. 4C, when the size of the trigger object 410 is changed, the size of the trigger area 420 may also be changed according to the changed size of the trigger object 410. . For example, in FIG. 4C, if the width and height of the trigger object 410 are increased by Δw and Δh, respectively, the size of the trigger area 420 may also increase by Δw and Δh.

According to the output mode of the additional content, the step of setting the output area of the additional content may be selectively performed (S240, S250). Here, the output mode may indicate whether to output the additional content as a full screen or to output the additional content as a partial screen when a user input touching the trigger area is received under the viewer mode.

When the additional content is set to be output as a partial screen, a trigger object for setting a trigger area and a graphic object for setting an output area of the additional content may be simultaneously output. For convenience of description, a graphic object for setting an output area of additional content will be defined as a content object.

The output mode of the additional content may be determined by a user input, or either the full screen or the partial screen may be applied as a default. For example, when additional content is selected, the controller 180 may output a menu for determining an output mode of the additional content, and may select an output mode of the additional content based on a user input to the menu.

Alternatively, outputting the additional content in full screen or partial screen may be set as a default.

Alternatively, the controller 180 determines whether to set to output the selected additional content in full screen or to output in a partial screen, depending on whether the previous additional content is set to be output in full screen or partial screen. Can be determined.

The controller 180 may change the output mode of the additional content based on a user input. Specifically, when a predetermined user input is received while the additional content is set to be output on the full screen, the controller 180 may change the additional content to be output on the partial screen. For example, when a predetermined type of touch input is received for the trigger object, the controller 180 may change the output mode of the additional content from the full screen to the partial screen. Here, the predetermined type of touch input may be a simple touch of a graphic object, or at least one of the number of touches, a touch intensity (touch pressure), and a touch time for the graphic object may be equal to or greater than a reference value. Alternatively, the output mode of the additional content may be changed based on a touch input of touching a menu for changing the output mode of the additional content from the full screen to the partial screen.

When the output mode of the additional content is set to a partial screen, a trigger object for setting the trigger area and a content object for setting the output area of the additional content may be simultaneously output.

It is also possible to change the output mode of the additional content whose output mode is a partial screen to full screen. For example, when a predetermined type of touch input for deleting either a trigger object or a content object is received, or a user input for merging the trigger object and the content object is received, the output mode of the additional content is changed from partial screen to full screen. You can change it. Here, the predetermined type of touch input for deleting either the trigger object or the content object is to touch a button for deleting the trigger object or the content object, or the number of touches to the trigger object or the content object, and the touch intensity (touch Pressure) or at least one of the touch time is equal to or greater than a reference value, and the like. Alternatively, the output mode of the additional content may be changed based on a touch input of touching a menu for changing the output mode of the additional content from a partial screen to a full screen.

Alternatively, the output mode of the additional content may be determined based on the size of the content object. For example, when the size of the content object exceeds a predefined threshold, the output mode of the additional content may be changed from a partial screen to a full screen. Conversely, when the size of the content object is changed to less than a predefined threshold, the output mode of the additional content may be changed from the full screen to the partial screen. Here, the size of the content object represents at least one of the width or height of the content object.

5 is a diagram illustrating an example of setting a trigger area and an output area of additional content.

The left drawing of FIG. 5 shows an example of setting a trigger area and an output area of additional content in a document in the edit mode, and the right drawing of FIG. 5 shows an example of identifying and displaying the trigger area and the output area of additional content in the viewer mode. Is shown.

For convenience of explanation, it is assumed that the initial additional content is set to be displayed in full screen.

When the additional content is set to be output on the full screen, the controller 180 may output a graphic object 510 for setting the trigger area 530 as in the example shown in FIG. 5A. .

Thereafter, when the output mode of the additional content is changed from the full screen to the partial screen, the controller 180 may control the output of the new graphic object 520 while maintaining the output of the graphic object 510. The existing graphic object 510 may be used to set either the trigger area 530 or the output area 540 of the additional content, and the new graphic object 520 may be used to set the other.

For example, when the output mode of the additional content is a full screen, the graphic object 510 is used to set the trigger area 530, whereas when the output mode of the additional content is changed to a partial screen, the graphic object 510 is It may be used to set the output area 540 of the additional content. As the output mode of the additional content is changed to a partial screen, the graphic object 520 that is newly output may be used to set the trigger area 530.

Alternatively, on the contrary, even after the output mode of the additional content is changed to a partial screen, the existing graphic object 510 may be used to set the trigger area 530. In this case, the newly output graphic object 520 may be used to set the output area 540 of the additional content.

In the present embodiment, it is assumed that the existing graphic object 510 is used to set the content area, and the newly output graphic object 520 is used to set the trigger area 530. In addition, the graphic object 520 used to set the trigger area 530 will be referred to as a trigger object, and the graphic object 510 used to set the content output area 540 will be referred to as a content object.

The trigger object 520 and the content object 510 may be an image representing additional content, an image corresponding to a type of additional content, or a polygonal image. In this case, it is preferable that the first graphic object 520 and the second graphic object 510 are different images.

The controller 180 sets the location and/or size of the trigger area 530 based on the location and/or size of the trigger object 520, and outputs additional content based on the location and size of the content object 510 The location and/or size of the region 540 may be set. For example, as the location and/or size of the trigger object 520 is changed, the location and/or size of the trigger area 530 may be changed, and the location and/or size of the content object 510 is changed. Accordingly, the location and/or size of the output area 540 of the additional content may be changed. In the examples shown in (b) and (c) of FIG. 5, the location and size of the trigger area 530 is determined according to the location and size of the trigger object 520, and the location and size of the content object 510 are determined. It is shown that the position and size of the output area 540 of the additional content are determined.

The controller 180 may determine the aspect ratio of the output area of the additional content according to the aspect ratio of the additional content. That is, in order to suppress distortion that occurs when the additional content is output in accordance with the output area of the additional content, the controller 180 may control the aspect ratio of the output area of the additional content to be maintained equal to the aspect ratio of the additional content. Accordingly, when the width of the content object is changed, the controller 180 may control the height of the content object to be also changed according to the aspect ratio of the additional content. Likewise, when the height of the content object is changed, the controller 180 may control the width of the content object to be also changed according to the aspect ratio of the additional content. When a user input for simultaneously adjusting the width and height of the content object is received, the controller 180 may adjust the width and height of the content object according to the aspect ratio of the additional content. In this case, the width and height of the content object may be adjusted based on any one of a width change value or a height change value obtained by a user input as a default value, or a change width of the width change value and height change value may be large.

Whether or not to set the aspect ratio of the output area of the additional content equal to that of the additional content may be adjusted according to the user's setting.

If the size of the trigger area is small, it becomes difficult for the user to find the trigger area in the viewer mode, and if the size of the output area of the additional content is small, it may be difficult to accurately check the content of the additional content. Accordingly, the controller 180 may prevent the size of the trigger area and/or the output area of the additional content from becoming less than or equal to a predefined size. As an example, even if a user input for reducing the size of the trigger object for setting the trigger area to be smaller than the predefined size is received, the controller 180 may control the size of the trigger object not to be smaller than the predefined size. Likewise, even if a user input for reducing the size of the content object for setting the output area of the additional content to be smaller than the predefined size is received, the controller 180 can control the size of the content object not to be smaller than the predefined size. have.

The setting of the trigger area and the setting of the output area of the additional content may be mutually independent. That is, changing the location and/or size of the trigger object used to set the trigger area may be independent from changing the location and/or size of the content object used to set the output area of the additional content. Accordingly, even if the location and/or size of the trigger object is changed, the location and/or size of the content object may not be changed.

As another example, the setting of the trigger area and the setting of the output area of the additional content may be interdependently set. That is, the location and/or size of the output area of the additional content may be determined dependently on the location and/or size change of the trigger area, and the location and/or size of the trigger area is dependent on the location and/or size change of the content area. Can be determined. Accordingly, when the location and/or size of the trigger object used to set the trigger area is changed, the location and/or size of the content object used to set the output area of the additional content may also be changed.

6 is a diagram illustrating an example of setting a trigger area and an output area of additional content.

In FIG. 6, it is assumed that the graphic object 620 functions as a trigger object, and the graphic object 610 functions as a content object.

When the content output area and the trigger area are mutually dependently set, changing the position and/or size of either the trigger object or the content object may affect the other.

For example, as in the examples shown in FIGS. 6A and 6B, when the location of the trigger object 620 is changed by (Δx, Δy), the location of the content object 610 is also ( It can be changed as much as △x, △y). As the position of the trigger object 620 is changed by (Δx, Δy), the position of the trigger area 630 is also changed by (Δx, Δy), and the position of the content object 610 is changed by (Δx, Δy). As it is changed by Δy), the position of the output area 640 of the additional content may also be changed by (Δx, Δy).

For example, as in the example shown in (c) of FIG. 6, when the size of the trigger object 620 is changed by (△w, △h), the size of the content object 610 is also (△w, △ h) can be changed. As the size of the trigger object 620 is changed by (△w, △h), the size of the trigger area 630 is also changed by (△w, △h), and the size of the content object 610 is changed by (△w, △h). As it is changed by Δh), the size of the output area 640 of the additional content may also be changed by (Δw, Δh).

Output of additional content caused by changing the location and/or size of the trigger area (or trigger object) in consideration of the size ratio of the trigger area (or trigger object) and the output area (or content object) of the additional content It is possible to adjust the amount of change in the location and/or size of the region (or content object). For example, when the size ratio between the trigger area and the output area of the additional content is 1:N, in response to the size of the trigger area being changed by (△w, △h), the size of the output area of the additional content is (N It can be changed by Δw, NΔh).

Whether to set the trigger area and the additional content output area independently or dependently from each other may be determined by user setting. For example, while the trigger area and the additional content output area are set independently of each other, even if the location and/or size of the trigger object is changed, the location and/or size of the content object may not be changed. On the other hand, when the setting is changed so that the trigger area and the additional content output area are mutually dependent, the location and/or size of the content object may be changed in response to a change in the location and/or size of the trigger object.

A plurality of additional content may be linked to one trigger area. For example, when setting a trigger region for the selected additional content after selecting the additional content, when a trigger region already associated with another additional content is selected, a plurality of additional content may be associated with one trigger region.

7 is a diagram illustrating an example in which a plurality of additional contents are linked to one trigger area.

For convenience of explanation, as in the example shown in FIG. 7A, the primary content already includes a first additional content 715 and a first trigger object 710 linked to the first additional content 715 It is assumed to exist.

When the second additional content 725 to be inserted into the main content is selected, as in the example shown in FIG. 7(b), the controller 180 is a second trigger area to be linked with the second additional content 725 A second trigger object 720 for setting may be output. In this case, as in the example shown in (c) of FIG. 7, when a user input for changing the position of the second trigger object 720 inside the first trigger object 710 is received, the controller 180 As in the example shown in (d) of FIG. 7, a menu for determining whether to merge the second trigger region for the second additional content 725 with the first trigger region may be output.

When a user input for determining to merge the second trigger area with the first trigger area is received, the controller 180 outputs the second trigger object 720, as in the example shown in FIG. 7(e). After stopping, the second additional content 725 may be additionally linked to the first trigger region. That is, when it is set to merge the first trigger region and the second trigger region, setting of the second trigger region for the second additional content may be terminated. The first additional content and the second additional content may be associated with a first trigger area set by the first trigger object 710.

On the other hand, when a user input for determining not to merge the second trigger region with the first trigger region is received, the controller 180 determines the second additional content based on the position and/or size of the second trigger object 720. A second trigger area for can be set.

In FIG. 7, when a user input for dragging a graphic object toward the inside of the first trigger object is received, a menu for selecting whether to merge the first trigger area and the second trigger area is output. , The present invention is not limited thereto. For example, when it is determined to insert the second additional content into the main content, before outputting the second trigger object, a menu for selecting whether to merge the first trigger region and the second trigger region may be output. have.

Alternatively, the controller 180 may determine whether the first trigger region and the second trigger region can be merged according to whether the first additional content and the second additional content are of the same type. For example, only when the first additional content and the second additional content are of the same type, the first trigger region and the second trigger region may be set to be mergeable. On the other hand, when the first additional content and the second additional content are of different types, even if the second trigger object is dragged over the first trigger object, the first trigger area and the second trigger area may not be merged.

Alternatively, the controller 180 may determine whether the first trigger region and the second trigger region can be merged based on the size of the trigger region and/or the output mode of the additional content or the size of the output region of the additional content. For example, if the size difference or the size ratio between the first trigger area and the second trigger area exceeds a predefined threshold, even if you drag and move the second trigger object for setting the second trigger area over the first trigger area , The first trigger region and the second trigger region may not be merged. Alternatively, when the output modes of the first additional content and the second additional content are different (eg, when the output mode of the first content is a partial screen and the output mode of the second additional content is a full screen), above the first trigger object Even if the second trigger object is dragged, the first trigger area and the second trigger area may not be merged.

In addition to the example shown in FIG. 7, when a plurality of additional content is simultaneously selected, an integrated trigger area for the simultaneously selected additional content may be set. That is, when a plurality of additional contents are simultaneously inserted in the main content, one trigger object for setting an integrated trigger area for the plurality of additional contents is output, and a plurality of them are added based on the location and/or size of the trigger object. An integrated trigger area for content can be determined.

Alternatively, when a predetermined type of touch input is input to the previously inserted trigger object, a submenu for selecting additional content to be additionally linked to a corresponding trigger area may be output. Here, the predetermined type of touch input may mean that a trigger object is touched, or that at least one of the number of pointers touching the trigger object, a touch intensity, or a touch time is equal to or greater than a reference value.

8 is a diagram illustrating an example in which a plurality of additional contents are linked to a trigger object using a sub-menu.

When a touch input touching the trigger object 810 is received, the controller 180 controls the sub-menu 820 related to the trigger object 810 to be output, as in the example shown in FIG. 8A. I can.

In the sub-menu 820 shown in FIG. 8A, the additional item 821 is for executing a command for additionally linking the additional content to the trigger object 810. The delete item 822 is for executing a command to delete the trigger object 810 on the main content.

When an additional item is selected, the controller 180 outputs a menu for selecting additional content to be additionally linked to the trigger object 810, or an application/input for generating a content list or additional content for selecting additional content. You can launch windows. The selection of additional content may follow the embodiment described based on FIG. 3.

When a plurality of additional content is associated with one trigger object 810, the controller 180 may identify and display that a plurality of additional content is associated with the trigger object 810. As an example, the controller 180 may output at least one of information indicating that a plurality of additional content is associated with the trigger object 810 or information 815 indicating the number of additional content associated with the trigger object 810. I can. (See Fig. 8(b)).

Also, an additional content list for identifying a plurality of additional content may be output around the trigger object. The additional content list may include an object corresponding to each additional content. Accordingly, the number of objects may be the same as the number of additional content linked to the trigger object. Here, the object may be an image representing each additional content or an image representing the type of each additional content.

The plurality of objects may be arranged in a line along a vertical or horizontal direction. Alternatively, a plurality of objects may be distributed and disposed near the boundary of the trigger area of the plurality of objects. For example, the first object may be disposed adjacent to the first border of the trigger area, and the second object may be disposed adjacent to the second border of the trigger area.

The position and/or size of each object may be adjusted by user input.

When a plurality of additional contents are linked to one trigger region, the controller 180 may set a priority among the plurality of additional contents. The priority may be used to determine an output order of additional content in the viewer mode.

The priority may be determined by user setting, or may be determined based on at least one of an order of insertion into the main content, a type of additional content, an output mode, or a size. For example, the controller 180 may determine the priority of the additional content in the order of insertion into the main content. That is, the additional content first inserted into the main content may have a higher priority than the additional content later inserted into the main content. Alternatively, in consideration of the types of additional contents, the first type of additional content may be set to have a higher priority than the second type of additional content. Alternatively, among the additional contents, the additional content whose output mode is full screen is set to have a higher priority than the additional content whose output mode is partial screen. It can be set to have a higher priority. The determined priority may be changed by user setting. A plurality of additional contents may be set to have the same rank.

One additional content may be linked to a plurality of trigger regions. For example, when a user input for adding a trigger region for additional content is received, a plurality of graphic objects for setting a plurality of trigger regions may be output.

9 is a diagram illustrating an example of setting a plurality of trigger regions for one additional content.

When the additional content to be inserted into the main content is selected, as in the example shown in FIG. 9A, the controller 180 sets a trigger object for setting a trigger area for the additional content (hereinafter, referred to as a first trigger object). Ham, 810) can be output.

In this state, when a user input for adding a trigger area is received, the controller 180 performs a graphic object for setting an additional trigger area (hereinafter, referred to as a second trigger area), as in the example shown in FIG. 9B. An object 820 may be further output.

The first trigger object 910 may be used to set the first trigger area 915 for the additional content, and the second trigger object 920 may be used to set the second trigger area 915 for the additional content. That is, the controller 180 sets the first trigger area based on the position and/or size of the first trigger object 910, and the second trigger is based on the position and/or size of the second trigger object 920 You can set the area.

The setting of the first trigger area and the setting of the second trigger area may be mutually dependently set. That is, when the location and/or size of the first trigger area changes, the location and/or size of the second trigger area may also be set to change. Accordingly, when the location and/or size of the first trigger object used to set the first trigger area is changed, the location and/or size of the second trigger object used to set the second trigger area may also be changed. have.

The controller 180 may set the functions of the first trigger area and the second trigger area to be the same, or differently set the functions of the first trigger area and the second trigger area. For example, the controller 180 may set both the first trigger region and the second trigger region to have a purpose of outputting additional content and stopping the output of the additional content in a viewer mode. Alternatively, the controller 180 may set the first trigger region to have a purpose of outputting additional content from all viewers, while the second trigger region may set the second trigger region to have a purpose of stopping the output of additional content in the viewer mode.

Alternatively, at least one of the first trigger region and the second trigger region may be set to have a purpose of outputting and stopping the output of additional content, while the other may be set to have a control purpose such as enlargement, playback, or pause of the additional content.

When a plurality of additional content is inserted into the main content, a plurality of trigger regions may exist. In this case, the controller 180 may determine whether to allow the overlapping arrangement of trigger regions based on a user setting. When the overlapping arrangement between trigger regions is not allowed, the newly added trigger region may be as small as a portion overlapped with the existing trigger region, or the position may be automatically changed so as not to overlap with the existing trigger region.

10 is a diagram illustrating an operation of a terminal when a plurality of trigger regions are overlapped and arranged.

When the overlapping arrangement of trigger areas is allowed, as in the example shown in FIG. 10A, the first trigger object 1010 and the second trigger area 1025 for setting the first trigger area 1015 The second trigger object 1020 for setting may be overlapped. In this case, an area where the first trigger object 1010 and the second trigger object 1020 overlap may correspond to the first trigger area 1015 or the second trigger area 1025. For the overlapping area, priority between trigger areas may be determined. The priority may be used to determine an output order of additional content in the viewer mode.

The priority may be determined by user setting, and may be determined based on at least one of a setting order of a trigger region, a size of a trigger region, a type of additional contents linked to each trigger region, and an output mode or size of the additional content. For example, the controller 180 may determine the priority of the trigger region in the order in which the main content is inserted. That is, a trigger region added to the main content first may have a higher priority than a trigger region inserted into the main content later. Alternatively, in consideration of the types of additional contents associated with each trigger region, the trigger region to which the first type of additional content is associated may be set to have a higher priority than the trigger region to which the second type of additional content is associated. Alternatively, among the additional contents, the trigger area associated with the additional content whose output mode is full screen is set to have a higher priority than the trigger area associated with the additional content whose output mode is partial screen, or the additional content with a larger size of the output area The trigger area associated with the output area may be set to have a higher priority than the trigger area associated with the additional content having a small size of the output area. The determined priority may be changed by user setting. A plurality of trigger areas may be set to have the same priority.

On the other hand, when overlapping arrangement of trigger areas is not allowed, a first trigger object 1010 for setting the first trigger area 1015 and a second trigger object 1020 for setting the second trigger area 1025 May not allow overlapping. For example, as in the example shown in FIG. 10B, when the second trigger object 1020 is moved over the first trigger object 1010, the controller 180 automatically generates the first trigger object 1010. ) And the location of the second trigger object 1020 may be changed.

Alternatively, if the overlapping arrangement of trigger regions is not allowed, the controller 180 allows the overlapping arrangement of the first trigger object 1010 and the second trigger object 1020, but the first trigger region 1015 and the second Any one of the trigger regions 1025 may be controlled to decrease by an overlap amount of the first trigger object 1010 and the second trigger object 1020. That is, the overlapping area of the first trigger object 1010 and the second trigger object 1020 may be used only as the first trigger area 1015 or only the second trigger area 1025. As an example, when the second trigger object 1020 is moved over the first trigger object 1010, the controller 180 moves from the second trigger object 1020 as in the example shown in FIG. 10C. An overlapping portion of the first trigger object 1010 and the second trigger object 1020 may be removed as the second trigger area 1025.

At least a part of the additional content already inserted in the main content may be set as a trigger area for the new additional content. For example, at least a partial area of the first additional content may be set as a trigger area for outputting second additional content different from the first additional content. That is, in the viewer mode, the trigger area to which the first additional content is linked is used to start or end the output of the first additional content, and at least some areas of the first additional content start or end the output of the second additional content. Can be used for things.

11 shows an example in which additional content previously inserted in the main content is set as a trigger area for new additional content.

For convenience of description, the additional content previously inserted in the main content will be referred to as first additional content, and the additional content newly linked to the first additional content will be referred to as second additional content.

A predetermined user input is input to the first trigger object 1110 for setting the trigger area 1130 for the first additional content or the first content object 1120 for setting the output area 1140 for the first additional content. When received, the controller 180 may output a menu for outputting second additional content to be linked to the first additional content. Here, the predetermined input is to touch at least one of the first trigger object 1110 or the first content object 1120, or at least one of the first trigger object 1120 or the first content object 1120 It may mean that at least one of the number of touched pointers, the touch strength, the number of touches, and the touch time is equal to or greater than a reference value. As in the example illustrated in FIG. 3, the menu may be for selecting a type of second additional content or a content list for selecting additional content.

Alternatively, content that satisfies a predefined condition may be automatically determined as the second additional content. Here, the content that satisfies the predefined condition may include content that is highly related to the first additional content, content that is most recently added to a terminal, content that is most recently executed, or content that has been executed in a viewer mode. Content having high relevance to the first additional content may mean content including content similar to the first additional content. For example, when the first additional content is an image or a video, an image or video of a person included in the first additional content, an image or video taken on the same date or at the same place as the first additional content is added first It may be determined as content that is highly relevant to the content.

Alternatively, the controller 180 may control the output of a content list including content having high relevance to the first additional content. When a content is selected through the content list, the selected content may be determined as the second additional content.

When the second additional content is selected through the menu, a second trigger object 1150 for setting a second trigger area for the second additional content may be output. A second trigger area 1160 for second additional content may be set through the second trigger object 1150.

The controller 180 may output the second trigger object 1150 on the first content object 1120. In this case, the location and/or size of the second trigger object 1150 may be determined dependently on the location and/or size of the first content object 1120. For example, the size of the second trigger object 1150 may be set so as not to exceed the size of the first content object 1120. Alternatively, the second trigger object 1150 may be set so as not to depart from the first content object 1120. For example, when the first direction boundary of the second trigger object 1150 contacts the first direction boundary of the first content object 1120, even if the pointer touching the second trigger object 1150 moves in the first direction , The second trigger object 1150 may be set to no longer move in the first direction.

As the second trigger object 1150 is output on the first content object 1120, at least a partial area of the first additional content output area 1140 overlapping the second trigger object 1150 displays the second additional content. It may be set as the second trigger area 1160 for. That is, the first trigger area 1130 is set as an output control area of the first additional content, and the second trigger area 1160 in which the first content object 1120 and the second trigger object 1150 overlap is the second It may be set as an area for controlling the output of additional content.

Alternatively, the entire area of the first additional content output area 1140 may be set as the second trigger area 1160 for the second additional object. When the entire area of the first additional content output area 1140 is set as the second trigger area 1160, the output of the second trigger object 1150 for setting the second trigger area may be omitted. In this case, the location and/or size of the second trigger area 1160 may be determined according to the location and/or size of the first content object 1120.

The controller 180 may output the second content object 1170 for setting the output area 1180 of the second additional content according to the output mode of the second additional content.

Alternatively, whether to output the second content object 1170 may be selectively determined based on the output mode of the second additional content. For example, when the output mode of the second additional content is a full screen, the second content object 1170 is not output, while when the output mode of the second additional content is a partial screen, the output area of the second additional content ( A second content object 1170 for setting 1180 may be output. The controller 180 may determine the output area 1180 of the second additional content based on the location and size of the second content object 1170.

In this case, the location and/or size of the output area 1180 of the second additional content may be determined dependently on the location and/or size of the output area 1140 of the first additional content. For example, the size of the output area 1180 of the second additional content may be set so as not to exceed the size of the output area 1140 of the first additional content. Alternatively, the location and/or size of the output area 1180 of the second additional content may be changed as the location and/or the size of the output area 1140 of the first additional content is changed.

As another example, the output area 1180 of the second additional content may be set to be the same as the output area 1140 of the first additional content. When the output area 1180 of the second additional content is set to be the same as the output area 1140 of the first additional content, the output of the second content object 1170 for setting the output area 1180 of the second additional content Can be omitted.

Whether to allow at least a part of the output area of the first additional content to be used as a trigger area for the second additional content may be determined according to the output mode of the first additional content. As an example, the controller 180 may allow setting at least a part of the output area of the first additional content as a trigger area for the second additional content only when the output mode of the first additional content is a partial screen. . On the other hand, when the output mode of the first additional content is full screen, it may not be allowed to set at least a part of the output area of the first additional content as a trigger area for the second additional content.

The type of the second additional content may be determined dependently on the type of the first additional content. For example, the second additional content may be limited to the same type as the first additional content. Accordingly, when the first additional content is an image, the second additional content that can be linked to the first additional content may be limited to an image.

It is also possible to set a plurality of trigger areas on the first content output area. For example, on the first content object, a second trigger object for setting a trigger area of the second additional content and a third trigger object for setting a trigger area of the third additional content may be output. It may not be allowed to overlap a plurality of trigger objects on the first content object.

Alternatively, the controller 180 may divide the first content object by the number of trigger objects above the first content object. Each trigger object may be set to be movable only within a designated area. For example, the second trigger object may be set to be freely movable within the first area of the first content object, and the third trigger object may be set to be freely moved within the second area of the first content object. Accordingly, a second trigger region may exist in the first region among the output regions of the first additional content, and a third trigger region may exist within the second region among the output regions of the second additional content. The location and/or size of the first area and the second area may be adjusted according to a user's setting. Alternatively, the positions and/or sizes of the first region and the second region may be determined based on the priority of each of the additional contents, the output mode, and the location or type of the output region.

A plurality of additional contents may be linked to a trigger object that is output on the content object. When a plurality of additional contents are associated with one trigger object, the controller 180 may set a priority among the plurality of additional contents. The priority may be used to determine an output order of additional content in the viewer mode. The priority may be determined by user setting, or may be determined based on at least one of an order of insertion into the main content, a type of additional content, an output mode, or a size. For example, the controller 180 may determine the priority of the additional content in the order of insertion into the main content. That is, the additional content first inserted into the main content may have a higher priority than the additional content later inserted into the main content. Alternatively, in consideration of the types of additional contents, the first type of additional content may be set to have a higher priority than the second type of additional content. Alternatively, among the additional contents, the additional content whose output mode is full screen is set to have a higher priority than the additional content whose output mode is partial screen. It can be set to have a higher priority. The determined priority may be changed by user setting. A plurality of additional contents may be set to have the same rank.

In the above-described example, it has been exemplified that the trigger area and the output area of the additional content are rectangular, but the present invention is not limited thereto. A trigger area and/or an output area of additional content may be set with a polygon or circle other than a rectangle.

In addition, in the above-described example, the trigger area and the output area of the additional content are set through a graphic object, but the present invention is not limited thereto. For example, a trigger area and/or an output area of additional content may be set without a medium such as a graphic object. For example, when a touch input for dragging a point in a predetermined direction is received, a rectangular area having a movement trajectory of a pointer diagonally may be set as a trigger area and/or an output area of additional content. Alternatively, when a touch input in which two pointers touch the touch screen is received, a rectangular area having two pointers as two vertices may be set as a trigger area and/or an output area of additional content.

In the example illustrated in FIG. 2, it is described that the trigger region and the output region of the additional content are set in a series of order, but the present invention is not limited to the illustrated example. For example, in FIG. 2, it is shown that a trigger region can be set after additional content to be inserted into the main content is selected, but an embodiment implemented in the reverse order may also be included in the scope of the present invention. For example, when the setting of the trigger area is completed, the present invention may be implemented so that a menu for selecting additional content to be inserted into the main content is displayed. As another example, the present invention may be implemented to first set the output area of the additional content and then set the trigger area.

Alternatively, the setting of the trigger area and the setting of the output area of the additional content may be processed in parallel. For example, a trigger object for setting a trigger area and a content object for setting an output area of additional content may be simultaneously output through the display unit 150.

In the edit mode, layout settings for the trigger area and the output area of the additional content may be stored, and the stored layout may be applied to another page or other main content as it is. For example, even if the main content is changed from a PPT format file to a PDF format file, a layout set on the PPT format main content may be applied to the PDF format main content as it is. When the sizes of the main contents are different, the sizes of the trigger area and the additional content output area may be automatically adjusted according to the size ratio between the main contents.

Next, the operation of the terminal in the viewer mode will be described.

12 is a flowchart showing an operation of a terminal in a viewer mode.

When the editing mode ends, the controller 180 may switch the terminal to the viewer mode. In the viewer mode, the settings for the trigger area and the output area of the additional content cannot be changed any more. In order to change the settings of the trigger area and the output area of the additional content, the viewer mode must be terminated and the edit mode must be entered again.

When the terminal is switched to the viewer mode, the controller 180 may set the trigger area set in the initial editing mode and the output area of the additional content not to be visible. That is, when the terminal is switched from the edit mode to the viewer mode, in the edit mode, the trigger area that was visually identified by the graphic object and the output area of the additional content may no longer be identified and displayed. Accordingly, when the editing mode ends and the viewer mode is switched, only the first main content may be displayed on the display unit 160.

However, in order to prevent the user from misrecognizing the location of the trigger area, the controller 180 may control the location of the trigger area to be identified and displayed when a predetermined user input is received.

13 is a diagram illustrating an example in which a trigger area is visually identified and displayed.

In the example shown in Fig. 13, a dotted outline represents a trigger area. The dotted outline may be a virtual line that is not visible to the user.

When a user input for visually identifying and displaying the trigger area 1310 is received, the controller 180 may control the trigger area 1310 to be visually identified and displayed. Here, the user input may be a touch of a button requesting to visually identify and display the trigger area 1310, or may be a touch input in a predefined form. The predefined touch input may mean that at least one of the number of pointers touching the main content, the touch strength, the touch time, or the number of touches is equal to or greater than a reference value.

As an example, when a user input for double-touching the main content is received, the controller 180 displays the trigger area 1310 at the location of the trigger area 1310, as in the examples shown in FIGS. 13A and 13B. ) Can be controlled to be displayed. For example, the controller 180 may control an object 1320 for identifying the trigger area 1310 to be output on the trigger area 1310. The object 1320 may include at least one of a trigger object used to set the trigger area 1310, a pre-stored icon, or an image representing an outline of the trigger area.

In this case, in order to prevent the object 1320 identifying the trigger region from covering the main content, the controller 180 may set the object 1320 to a semi-transparent state.

The controller 180 may control the object 1320 to be output for a predetermined time, or control the object 1320 to blink and be output. Alternatively, it is possible to control the object 1320 to be output while the user input is maintained. For example, while the pointer touches the touch screen, the object 1320 may be output, and when the touch input of the pointer is released, the output of the object 1320 may be stopped. Alternatively, when a user input requesting to stop outputting the object 1220 is received, the controller 180 may stop outputting the object 1220.

When a touch input touching the main content is received (S1210) and the location of the received touch input corresponds to the inside of the trigger area (S1220), the controller 180 controls to output additional content associated with the trigger area. I can. In this case, according to the output mode of the additional content, the controller 180 may output the additional content as a full screen or a partial screen (S1230, S1240, and S1250). Here, the partial screen may correspond to the output area of the additional content set in the edit mode. When the additional content is output on a partial screen, the additional content may be overlaid on a part of the main content.

14 is a diagram illustrating an example in which additional content is output in response to a user input touching a trigger area.

For convenience of explanation, it is assumed that two trigger regions are inserted on the main content, and it is assumed that the location and size of each trigger region follow the example shown in FIG. 14A. In addition, it is assumed that the additional content linked to the first trigger area 1410 is a first image 1415 and the additional content linked to the second trigger area 1420 is a second image 1425.

When a user input touching the main content is received, and the location of the received touch input corresponds to the inside of the trigger area, the controller 180 can control to output additional content related to the trigger area selected by the touch input. have. For example, when the location of the touch input is inside the first trigger area 1410, the controller 180 may control the first image 1415 linked to the first trigger area 1410 to be output. In this case, when the output mode of the additional content linked to the first trigger area 1410 is the full screen, the controller 180 displays the first image 1415 in response to a user input touching the first trigger area 1410. Can be controlled to be displayed in full screen.

On the other hand, when the location of the touch input is inside the second trigger area 1420, the controller 180 may control the second image 1425 linked to the second trigger area 1420 to be output. In this case, when the output mode of the additional content linked to the second trigger area 1420 is a partial screen, the controller 180 displays the second image 1425 in response to a user input touching the second trigger area 1420. ) Can be controlled to be displayed as a partial screen. Specifically, the controller 180 may control the second image 1425 to be output through the output area of the additional content set in the edit mode.

When the additional content linked to the trigger area is a multimedia file that is output by playback such as video or music, the controller 180 is configured to play additional content such as video or music in response to a user input touching the trigger area. You can control the multimedia player to be displayed in full screen or partial screen. The user can control the playback of additional content such as video or music through the multimedia player.

However, when the additional content is output, since the content of the main content is hidden, the controller 180 outputs the additional content in a semi-transparent state, or when a predetermined time elapses since the additional content is output, the additional content is converted into a semi-transparent state. You can also control it to switch.

When the output mode of the additional content is a partial screen, the controller 180 may set the size of the additional content according to the size of the output area of the additional content. In this case, while the width of the additional content is greater than the height, if the width of the output area of the additional content is set to be smaller than the height, distortion of the additional content output through the output area of the additional content may occur. In order to solve the above problem, the controller 180 may rotate and output the additional content in consideration of the width and height ratio of the additional content and the width and height ratio of the output area of the additional content. For example, when the width of the additional content is smaller than the height, the width of the output area of the additional content is greater than the height and/or the width of the additional content is larger than the height, but the width of the output area of the additional content is smaller than the height. In this regard, the controller 180 may rotate and output the additional content.

15 is a diagram illustrating an example in which additional content is rotated and output.

As in the example shown in (a) of FIG. 15, when the additional content 1530 linked to the trigger area 1510 is an image whose width is greater than the height, and the output area of the additional content is less than the height, the control unit In response to a user input touching the trigger area 1510, 180 may output the additional content 1530 rotated by 90 degrees through the output area 1520 of the additional content. In this case, the rotation direction (eg, clockwise or counterclockwise) of the additional content may be determined by the user's setting in the edit mode.

In a state in which additional content is being output, when a touch input is received and the location of the touch input is inside the trigger area or the output area of the additional content, the controller 180 may stop outputting the additional content (S1260, S1270). , S1280). That is, after the additional content is output, when a user input touching the trigger area or the additional content is received, the output of the additional content that has been overlaid on the main content may be terminated.

16 is a diagram illustrating an example in which output of additional content is terminated.

16A is a diagram illustrating a trigger area 1610 and an output area 1620 of additional content.

* When a touch input is received while the additional content is being output, and the touch position is inside the trigger area 1610, the controller 180 performs output of the additional content, as in the example shown in FIG. 16B. You can quit. Although not shown, when a touch input for touching the additional content that is overlaid on the main content is received, the output of the additional content may be terminated.

When a predetermined condition is satisfied, the controller 180 may terminate the output of the additional content.

For example, when a preset time has elapsed since the additional content was output, the controller 180 may terminate the output of the additional content. Here, the preset time may be adjusted by a user setting in the edit mode.

For example, when the first additional content linked to the first trigger area is being output, the controller 180 receives a user input for selecting a second trigger area linked to the second additional content, and the first additional content It is also possible to stop the output of and control to output the second additional content.

Alternatively, when a user input of flicking a pointer touching the additional content is received, the controller 180 may terminate the output of the additional content.

In the above example, it has been described that the output of the additional content is terminated in response to a user input touching the trigger area or the output area of the additional content, but a response to the user input touching the trigger area or the output area of the additional content As a result, it is possible to change the output related setting of the additional content. Here, the output-related setting may include at least one of adjusting the size of the additional content (eg, expanding/reducing), adjusting the transparency of the additional content, or controlling the playback of the additional content (eg, playing, pausing, and stopping).

For example, when a first type of touch input that touches the trigger area or the output area of the additional content is received, the output of the additional content is set to end, while the second type of touching the trigger area or the output area of the additional content When a touch input of is received, a setting related to output of additional content may be adjusted. For example, when a second type of touch input that touches the trigger area or the output area of the additional content is received, the additional content displayed over the main content is enlarged or reduced, or the transparency of the additional content displayed over the main content is displayed. Can be adjusted. Here, the first type and the second type of touch input may be different in at least one of the number of pointers, touch strength (touch pressure), touch time, and number of touches.

Alternatively, the output of the additional content may be terminated in response to a user input touching the trigger area, and a setting related to output of the additional content may be changed in response to a user input touching the output area of the additional content. For example, when a user input touching the output area of the additional content is received, the additional content displayed over the main content may be enlarged or reduced, or the transparency of the additional content displayed over the main content may be adjusted.

When a plurality of trigger regions are associated with one additional content, each of the plurality of trigger regions may all be used to control output and end of output of the additional content. For example, when two trigger regions are linked to one additional content, output of the additional content may be started or terminated by a user input touching the first trigger region, or a user input touching the second trigger region. Output of the additional content may be started or ended accordingly.

Alternatively, when one additional content is linked to a plurality of trigger regions, different functions may be set to be assigned to each of the plurality of trigger regions. For example, when two trigger regions are linked to one additional content, the output of the additional content is performed in response to receiving a user input touching the first trigger area, while the output of the additional content is terminated. This may be performed in response to receiving a user input touching the second trigger area.

Alternatively, at least one of the plurality of trigger regions may be used to start or end output of the additional content, while the other may be used to change a setting related to output of the additional content. For example, when two trigger regions are linked to one additional content, a user input touching the first trigger region must be received in order to start or end the output of the additional content, while setting related to the output of the additional content In order to change, a user input touching the second trigger area may need to be received.

When there is an overlapped region between a plurality of trigger regions and a user input for touching an overlapped region of the plurality of trigger regions is received, the controller 180 performs a plurality of trigger regions based on the priority or touch type between the trigger regions. You can choose any one of them.

17 is a diagram illustrating an operation of a terminal when a user input for touching an area in which a plurality of trigger areas are overlapped is received.

As in the example shown in FIG. 17A, the first trigger area 1710 and the second trigger area 1720 are partially overlapped, and the first trigger area 1710 and the second trigger area ( In 1720, it is assumed that the first additional content 1715 and the second additional content 1725 are linked, respectively.

When a touch input that touches a portion where the first trigger area 1710 and the second trigger area 1720 overlap is received, the controller 180 performs The trigger area with the highest priority can be selected. For example, when the priority of the first trigger area 1710 is higher than the priority of the second trigger area 1720, the controller 180 overlaps the first trigger area 1710 and the second trigger area 1720. It may be determined that the first trigger area 1710 is selected according to a user input that touches the portion that is being used. Accordingly, as in the example shown in FIG. 17B, the first additional content 1715 linked to the first trigger area 1710 may be output. In a state in which the first additional content 1715 is being output, when a user input for touching a portion where the first trigger region 1710 and the second trigger region 1720 overlap is received, the controller 180 It may be determined that the first trigger area 1710 having a higher priority than the trigger area 1720 is selected. Accordingly, as in the example shown in FIG. 17C, the output of the first additional content 1715 may be terminated.

The priority between trigger areas may be determined by user setting in the edit mode. Alternatively, it may be determined based on at least one of the order in which the trigger regions are set in the edit mode, the type of additional content associated with each trigger region, an output mode, or a size.

When the output of the additional content linked to any one of the plurality of trigger areas starts and/or ends, the priority of the trigger area to which the additional content is linked may be changed to the lowest priority. As an example, in the example shown in FIG. 17, when the output of the first additional content 1715 linked to the first trigger area 1710 is terminated, the control unit sets the priority of the first trigger area 1710 to the second. It may be set to be lower than the priority of the trigger area 1720. Accordingly, when a user input for touching a portion where the first trigger area 1710 and the second trigger area 1720 overlap is received, the controller 180 determines that the second trigger area 1720 is selected, and As in the example shown in (d) of FIG. 17, the output of the second additional content 1725 linked to the second trigger area 1720 may be controlled to start.

As another example, when a user input of touching a portion where the first trigger area 1710 and the second trigger area 1720 overlap while the first additional content 1715 is being output is received, the controller 180 It is possible to control the output of the second additional content 1725 to start while the output of the first additional content 1715 is terminated.

In the example shown in FIG. 17, when a user input touching a portion where a plurality of trigger areas overlap is received, it is exemplified that one of the plurality of trigger areas is selected according to the priority between the trigger areas. Accordingly, it may be set to select any one of a plurality of trigger areas. For example, when a first type of touch input is received in a portion where the first trigger area and the second trigger area overlap, the first trigger area is determined to be selected, whereas when a second type of touch input is received, the second type It may be determined that the trigger area is selected. Here, the first type and the second type of touch input may be different in at least one of the number of pointers, touch strength (touch pressure), touch time, and number of touches.

As another example, when a user input for touching a portion where a plurality of trigger areas overlap is received, it may be determined that the plurality of trigger areas are simultaneously selected. For example, when a user input for touching a portion where the first trigger region and the second trigger region overlap is received, the controller 180 may select both the first trigger region and the second trigger region. Accordingly, the output of the first additional content linked to the first trigger area may start or end, and the output of the second additional content linked to the first trigger area may start or end.

When a plurality of additional content is linked to one trigger area, the controller 180 may output a list of additional content linked to the trigger area in response to a user input touching the trigger area. When any one of the additional content list is selected, the controller 180 may control the selected additional content to be output.

18 and 19 are diagrams illustrating an example in which an additional content list is output in response to a user input touching a trigger area.

As in the example shown in FIG. 18A, it is assumed that the first additional content 1815 and the second additional content 1825 are linked to the trigger area 1810.

When a touch input touching the trigger area 1810 is received, the controller 180 may output a list 1830 of additional contents associated with the tree area. The list 1830 may include a representative image of each additional content. Here, the representative image may include at least one of a thumbnail or a preview image.

When any one item is selected from the additional content list 1830, the controller 180 may output additional content corresponding to the selected item. For example, when the first additional content item 1832 is selected from the additional content list 1830, the first additional content 1815 may be output. (See Fig. 18(c))

When a user input touching the trigger area 1810 is received while at least one additional content is being output, the controller 180 may output the additional content list 1830 again.

When an additional content item that is already in an output state is selected from the re-output additional content list 1830, the controller 180 may terminate the output of the additional content. For example, when the first additional content item 1832 is selected from the additional content list 1830, output of the first additional content 1815 may be stopped. (See Fig. 19(b))

When an additional content item different from the additional content that is already in the output state is selected from the re-output additional content list 1830, the controller 180 may additionally output the selected additional content. For example, when the second additional content item 1834 is selected from the additional content list 1830, the second additional content 1825 may be additionally output. (See Fig. 19(c))

As another example, when an additional content item different from the additional content that is already in the output state is selected in the re-output additional content list 1830, the controller 180 stops outputting the additional content that is already in the output state and outputs the selected additional content can do. For example, when the second additional content item 1834 is selected from the additional content list 1830 while the first additional content is being output, the second additional content 1825 is displayed while terminating the output of the first additional content 1815. Can be printed.

As another example, the list of additional content that is re-output may be set to not include an additional content item that is already being output. For example, when a touch input for touching a trigger area is received while the first additional content is being output, an additional content list excluding the first additional content item may be output.

As another example, when a plurality of additional content is associated with one trigger area, the controller 180 may start or end output of the additional content having a high priority in response to a user input touching the trigger area.

20 is a diagram illustrating an operation of a terminal when a user input for touching a trigger area associated with a plurality of additional content is received.

As in the example shown in FIG. 20A, it is assumed that the first additional content 2015 and the second additional content 2025 are linked to the trigger area 2010.

When a touch input touching the trigger area 2010 is received, the controller 180 outputs the additional content with the highest priority among the first additional content 2015 and the second additional content 2025 linked to the tree area. It can be controlled as much as possible. As an example, when the priority of the first additional content 2015 is higher than the priority of the second additional content 2025, the controller 180 may perform a trigger area ( 2010) may output the first additional content 2015 in response to a user input. When a touch input touching the trigger area 2010 is received while the first additional content 2015 is being output, the controller 180 performs a first addition, as in the example shown in FIG. 20C. The output of the content 2015 may be terminated.

Priority between additional content may be determined by user setting in the edit mode. Alternatively, in the edit mode, it may be determined based on at least one of an order in which the additional content is inserted into the main content, a type of the additional content, an output mode, or a size.

When the output of the previously displayed additional content is terminated, the priority of the additional content may be changed to the lowest priority. For example, in the example shown in FIG. 20, when the output of the first additional content 2015 is terminated, the priority of the first additional content 2015 is set to be lower than the priority of the second additional content 2025. I can. Accordingly, when a user input touching the trigger area 2010 is received, the controller 180 controls the output of the second additional content 2025 to start as in the example shown in FIG. 20(d). can do.

As another example, when a user input touching the trigger area 2010 is received while the first additional content 2015 is being output, the controller 180 ends the output of the first additional content 2015 and simultaneously provides the 2 It is possible to control the output of the additional content 2025 to be started.

As another example, when a user input touching the trigger area 2010 is received while the first additional content 2015 is being output, the controller 180 maintains the output of the first additional content 2015 and 2 It is possible to control the output of the additional content 2025 to be started. When a user input touching the trigger area 2010 is received while all additional content linked to the trigger area 2010 is being output, the controller 180 outputs all additional content linked to the trigger area 2010 Can be terminated.

The priority of a plurality of additional content may be the same. For example, when the first additional content and the second additional content have the same rank, the controller 180 starts or ends the output of the first additional content and adds a second in response to a user input touching the trigger area. Content output can be started or stopped.

As in the illustrated example, the additional content list may include an object corresponding to each additional content. The number of output objects may be the same as the number of additional content associated with the trigger object. The object may be an image representing each additional content or an image representing the type of each additional content.

The plurality of objects may be arranged in a line along a vertical or horizontal direction. Alternatively, a plurality of objects may be distributed and disposed near the boundary of the trigger area of the plurality of objects. For example, the first object may be disposed adjacent to the first border of the trigger area, and the second object may be disposed adjacent to the second border of the trigger area.

Depending on the number of times the trigger area is touched, additional content to be output in response to a touch input touching the trigger area may be selected. For example, when a touch input for touching the additional content once is received, the first additional content may be output, and when a touch input for touching the additional content twice is received, the second additional content may be output. . That is, a touch input for touching the trigger area N times may function as calling the N-th additional content. In this case, the order of the additional contents may be determined based on the priority of the additional contents. When at least some areas of the additional content are set as a trigger area, the trigger area may be activated only in a state in which the additional content is being output on the main content. In a state in which additional content is being output, when a touch input for touching a trigger area corresponding to at least a partial area of the additional content is received, the controller 180 outputs additional content linked to the trigger area in response to a user input. can do.

21 shows an example in which other additional content is output in response to a user input touching the additional content. For convenience of explanation, the additional content whose output starts or ends by the first trigger area 1810 is referred to as first additional content, and is output by a second trigger area corresponding to at least a partial area of the first additional content. The additional content that starts or ends is referred to as second additional content.

When a user input touching the first trigger area 2110 is received, the controller 180 performs first additional content linked to the first trigger area 1810, as in the example shown in FIG. 21(a). (2120) can be controlled to be output.

When the first additional content 2120 is output, the second trigger area 2130 set on the first additional content 2120 may be switched to an active state. When a touch input for touching the second trigger area 2130 (ie, at least a partial area of the first additional content) is received while the second trigger area 2130 is activated, the controller 180 performs a second trigger The second additional content 2140 linked to the region 2130 may be controlled to be output. (See (b) of FIG. 21) In this case, the second additional content 2140 may be output as a full screen or a partial screen according to an output mode of the second additional content 2140 set in the edit mode. When the second additional content 2140 is set to be output on a partial screen, the output position and/or size of the second additional content 2140 is the position and/or the output area of the second additional content 2140 set in the edit mode. Can be determined by size.

As another example, when the output area of the second additional content 2140 is set to be the same as the output area of the first additional content 2120, the second additional content 2140 is overlaid on the first additional content 2120. May be.

The controller 180 may determine whether to output the second additional content 2140 according to the type of the touch input for the first additional content 2120. For example, when a first type of touch input is input to the second trigger area 2130 on the first additional content 2120, the second additional content 2140 may be output in response to the touch input. On the other hand, when a second type of touch input is input to the second trigger area 2130 on the first additional content 2120, the output of the first additional content 2120 is terminated in response to the touch input, or An output-related setting for the first additional content 2120 may be changed. Here, the first type and the second type of touch input may be different in at least one of the number of pointers, touch strength (touch pressure), touch time, and number of touches.

The controller 180 may stop outputting the second additional content 2140 in response to a user input touching the second trigger area 2130 or the second additional content 2140.

Alternatively, the controller 180 may stop outputting both the first additional content 2120 and the second additional content 2140 in response to a user input for stopping the output of the first additional content 2120. The user input for stopping the output of the first additional content 1820 may include at least one of touching a remaining area other than the first trigger area 2110 or the second trigger area 2130 on the first additional content 2120. Can include.

A plurality of trigger regions may be set on the first additional content. In this case, the location of each trigger area may be different. Alternatively, the entire area of the first additional content may be set as the trigger area.

When a trigger region for a plurality of additional content is set on the first additional content, the controller 180 may determine the additional content to be output according to a location of a touch input touching the first additional content or a shape of the touch input. For example, when a touch input for touching a first area of the first additional content is received, a second additional content is output, while when a touch input for touching a second area of the first additional content is received, a third It is possible to control the output of additional content. Alternatively, when a first type of touch input is received for the first additional content, the second additional content is set to be output, while when a second type of touch input is received for the first additional content, a third additional content Content can be set to be displayed.

Alternatively, the controller 180 may select additional content to be output based on a priority among a plurality of additional content. For example, when a touch input for touching the first additional content is received, the controller 180 may control an additional content having the highest priority among a plurality of additional content associated with the first additional content to be output. For example, when the priority of the second additional content is higher than the priority of the third additional content, the second additional content may be output in response to a touch input touching the first additional content.

When the output of the additional content associated with the first additional content is terminated, the priority of the additional content may be changed to the lowest priority. For example, when the output of the second additional content is terminated, the priority of the second additional content may be changed to a priority lower than that of the third additional content. Accordingly, when a touch input for touching the first additional content is re-received, the third additional content, not the second additional content, may be output.

In a state in which the additional content is being output, when a user input for the additional content is received, the controller 180 may change the output position and/or size of the additional content in response to the user input. That is, even under the viewer mode, the location and/or size of the additional content being output can be freely changed.

22 is a diagram illustrating an example in which the output position and size of additional content are changed.

As in the example shown in (a) of FIG. 22, when a user input of dragging a pointer touching the edge of the additional content 2210 in a predetermined direction is received, the controller 180 responds to the user input. , It is possible to change the size of the additional content 2210 being output.

Alternatively, as in the example shown in (b) of FIG. 19, when a user input of dragging the pointer touching the additional content 2210 in a predetermined direction is received, the controller 180 responds to the user input. The location of the additional content 2210 being output may be changed.

When a predetermined user input is received while the location and/or size of the additional content is changed, the controller 180 may adjust the location and/or size of the additional content according to the location and/or size of the original additional content output area. I can. Here, the predetermined user input may be to touch an output area or a trigger area of the additional content, or may be a touch input in a predefined form. The predefined form may be that at least one of the number of pointers, touch strength (touch pressure), touch time, and number of touches is greater than or equal to a reference value.

Even if the location and/or size of the additional content is changed, the location and/or size of the additional content output area may be maintained the same as that set in the edit mode. Accordingly, when a user input of touching the trigger area is received while the location and/or size of the additional content is changed, the output of the additional content whose location and/or size is changed is terminated, and then, the trigger area is retouched. When a user input is received, the additional content may be output in accordance with the original additional content output area.

Alternatively, the position and/or size of the additional content output area may be changed according to the changed position and/or the changed size of the additional content. However, the change can be maintained in effect until the event occurs. The event may include at least one of ending a viewer mode, changing a slide page, or ending a file. The position and/or size of the additional content output area may be determined according to the setting in the edit mode.

Contents that have been edited in the edit mode may be saved as a single file. That is, the trigger area, the additional content output area, and/or the main content to which the additional content is added may be stored in a predefined file format.

The controller 180 may generate log data that records the usage history of the main content and/or the additional content. Log data is used as main content, number of times used as main content, file information used as main content, whether used as additional content, number of times used as additional content, file information used as additional content, or additional content. It may include at least one of the inserted slice information. The controller 180 may refer to log data and output usage details for each content.

23 is a diagram illustrating an example of outputting usage details for each content.

The controller 180 may output a content list that can be used as main content and/or additional content. The controller 180 may refer to log data to output a usage history of each content included in the content list. Alternatively, when any one is selected from the content list, the controller 180 may output a usage history for the selected content. The usage history may include at least one of the number of times the selected content is used as main content and/or additional content, a file name in which the selected content is used, or a slide number (or page number) in which the selected content is used.

When a user input of touching a file name or a slide number is received, the controller 180 may output a corresponding file or a page corresponding to the selected slide number of the corresponding file.

* When outputting the content usage details, the controller 180 may display whether the selected content has been used multiple times in one file or one slice. For example, when the selected content is used multiple times for one file or one slice, the corresponding file or the corresponding slice number may be displayed in the first format. On the other hand, a file or slice number that does not correspond to the above condition may be displayed in the second format. The first format and the second format may be different in at least one of font, thickness, color, italicity, or size. By identifying and displaying files and/or slices in which the same content is cited multiple times, it is possible to minimize a user's editing error.

When outputting a content list for selecting additional content to be added to the main content, the controller 180 may sort the contents in ascending or descending order in consideration of usage details of each content. For example, the controller 180 may sort and output the contents in ascending order based on the number of times that each content is used as main content and/or additional content. Alternatively, the output is sorted in descending order based on the number of uses, but contents added to the main content currently being edited may be output in a lower order. By arranging and displaying the contents based on the usage history, it is possible to block editing errors in which additional content previously inserted in the main content is reinserted.

Although the exemplary methods of the present disclosure are expressed as a series of operations for clarity of description, this is not intended to limit the order in which steps are performed, and each step may be performed simultaneously or in a different order if necessary. In order to implement the method according to the present disclosure, the exemplary steps may include additional steps, other steps may be included excluding some steps, or may include additional other steps excluding some steps.

Various embodiments of the present disclosure are not listed in all possible combinations, but are intended to describe representative aspects of the present disclosure, and matters described in the various embodiments may be applied independently or may be applied in combination of two or more.

In addition, various embodiments of the present disclosure may be implemented by hardware, firmware, software, or a combination thereof. For implementation by hardware, one or more ASICs (Application Specific Integrated Circuits), DSPs (Digital Signal Processors), DSPDs (Digital Signal Processing Devices), PLDs (Programmable Logic Devices), FPGAs (Field Programmable Gate Arrays), general purpose It may be implemented by a processor (general processor), a controller, a microcontroller, a microprocessor, or the like.

The scope of the present disclosure is software or machine-executable instructions (e.g., operating systems, applications, firmware, programs, etc.) that allow an operation according to a method of various embodiments to be executed on a device or a computer, and such software or It includes a non-transitory computer-readable medium (non-transitory computer-readable medium) which stores instructions and the like and is executable on a device or a computer.

110: communication department
120: camera
130: microphone
140: user input unit
150: display unit
160: sound output unit
170: memory
180: control unit

Claims (15)

A touch screen for displaying information and receiving a touch input; And
Including a control unit for cross-executing the editing mode and the viewer mode for the main content,
The control unit, under the editing mode, controls setting of a first trigger area associated with a first additional content on the main content and a first output area for the first additional content,
In the viewer mode, when a touch input for touching the first trigger area on the main content is received, controlling to output the first additional content linked to the first trigger area to the first output area,
And controlling at least one of a location or size of the outputted first additional content to change in response to a user input of touching and dragging the outputted first additional content under the viewer mode. The method of claim 1,
The control unit, under the editing mode, controls an additional setting of a second trigger area associated with a second additional content on the main content and a second output area for the second additional content,
In the viewer mode, when a touch input for touching an overlapping region between the first trigger region and the second trigger region is received, controlling to output a higher priority among the first additional content and the second additional content is performed. Characterized in, the terminal. The method of claim 2,
The terminal, characterized in that when outputting of the additional content having a higher priority among the first additional content and the second additional content is terminated, the priority of the additional content whose output is terminated is changed to the lowest priority. The method of claim 1,
The control unit, under the editing mode, in a state in which the first additional content is associated with the first trigger area, when a command for linking the second additional content to the first trigger area is input,
And controlling the second additional content to be additionally linked to the first trigger area while the association between the first trigger area and the first additional content is maintained. The method of claim 1,
Under the editing mode, at least one of the first trigger area and the first output area is not smaller in size than a pre-defined size. The method of claim 1,
Under the viewer mode, even if the location or size of the first additional content is changed, the location or size of the first output area does not change. The method of claim 1,
Under the editing mode, the aspect ratio of the first output area is maintained equal to the aspect ratio of the first additional content. Setting a first trigger area associated with the first additional content and a first output area for the first additional content on the main content under the edit mode; And
In a viewer mode, when a touch input for touching the first trigger area on the main content is received, outputting the first additional content linked to the first trigger area to the first output area,
In the viewer mode, in response to a user input of touching and dragging the outputted first additional content, at least one of a location or size of the outputted first additional content is changed. The method of claim 8,
Additionally setting a second trigger area associated with a second additional content and a second output area for the second additional content on the main content under the editing mode; And
In the viewer mode, when a touch input for touching an overlapping region between the first trigger region and the second trigger region is received, a higher priority among the first additional content and the second additional content is output. To, the control method of the terminal. The method of claim 9,
When the output of the additional content having a higher priority among the first additional content and the second additional content is terminated, the priority of the additional content whose output is terminated is changed to the lowest priority. . The method of claim 8,
In the editing mode, when a command for linking the second additional content to the first trigger area is input while the first additional content is linked to the first trigger area,
And the second additional content is further linked to the first trigger area while the association between the first trigger area and the first additional content is maintained. The method of claim 8,
In the editing mode, at least one of the first trigger area and the first output area is not smaller in size than a pre-defined size. The method of claim 8,
In the viewer mode, even if the location or size of the first additional content is changed, the location or size of the first output area does not change. The method of claim 8,
In the editing mode, the aspect ratio of the first output area is maintained equal to the aspect ratio of the first additional content, the terminal control method. Setting a first trigger area associated with the first additional content and a first output area for the first additional content on the main content under the edit mode; And
In a viewer mode, when a touch input for touching the first trigger area on the main content is received, outputting the first additional content linked to the first trigger area to the first output area,
In the viewer mode, in response to a user input of touching and dragging the outputted first additional content, at least one of a location or size of the outputted first additional content is changed. Recorded media.

Images