KR20230135845A - Terminal, method for contrlling therefor - Google Patents

Abstract

The present invention relates to a terminal capable of setting a trigger area and outputting additional content in response to an input of touching the set trigger area, and a method for controlling the same. The terminal comprises: a display which displays information; a user input unit which receives a user input; and a control unit which performs control to output main content on a touchscreen, set a trigger area associated with additional content on the main content and, when an editing mode for setting the trigger area is terminated and a viewer mode is activated, output the additional content associated with the trigger area in response to a touch input on the trigger area, wherein the additional content may be created by cropping a portion of the main content.

Description

Terminal, its control method {TERMINAL, METHOD FOR CONTRLLING THEREFOR}

The present invention relates to a terminal capable of setting a trigger area and outputting additional content in response to an input that touches the set trigger area, and a control method thereof.

Due to technological advancements, various electronic devices have increased beyond PCs. For example, in addition to mobile terminals such as mobile phones and tablet PCs, touch-based PCs that use touch input as the main input source have also appeared.

These newly introduced terminals also support document viewing and editing functions for user convenience. However, in these terminals, the word processor used in existing PCs is simply ported and used.

Accordingly, there is a need for the development of a user interface that allows efficient viewing and editing of documents not only on existing PCs but also on newly introduced terminals.

The present disclosure is intended to provide a terminal and control method capable of outputting additional content in response to touching main content.

Furthermore, the present disclosure is intended to provide a terminal and control method that allow a user to freely adjust an area that can trigger output of additional content or an output area of additional content.

Additionally, the present disclosure is intended to provide a terminal and control method that can adaptively determine content to be output to the main content based on priorities between a plurality of trigger areas or priorities between a plurality of additional contents.

Additionally, the present disclosure is intended to provide a terminal and control method that can use additional content to control the output of other additional content.

Additionally, the present disclosure is intended to provide a terminal and control method that can set some data of main content as additional content.

The technical problems to be achieved in the present disclosure are not limited to the technical problems mentioned above, and other technical problems not mentioned will be clearly understood by those skilled in the art from the description below. You will be able to.

A terminal according to the present disclosure includes a display for displaying information, a user input unit for receiving user input, and outputting main content to the touch screen, setting a trigger area associated with additional content on the main content, and triggering the trigger. and a control unit that controls the additional content associated with the trigger area to be output in response to a touch input touching the trigger area when the edit mode allowing setting of the area ends and the viewer mode is executed. At this time, the additional content may be created by cutting out part of the main content.

The control method of a terminal according to the present disclosure includes the steps of setting a trigger area on the main content, and when the edit mode in which settings for the trigger area and additional content are allowed is ended and the viewer mode is executed, the control method on the main content In response to a touch input touching the trigger area, outputting additional content associated with the trigger area. At this time, the additional content may be created by cutting out part of the main content.

In the terminal and its control method according to the present disclosure, replacement data that replaces the original data may be output in the cut out area on the main content.

In the terminal and its control method according to the present disclosure, the replacement data may be set differently depending on the type of the additional content.

In the terminal and its control method according to the present disclosure, when the additional content is image data generated by capturing a part of the main content, the replacement data is a default image, and the additional content contains a partial string in the main content. In the case of truncated character data, the replacement data may be a default character or character string.

In the terminal and its control method according to the present disclosure, when the additional content is created by cutting out a part of the main content, the trigger area may be set to the cut out area of the main content.

In the terminal and its control method according to the present disclosure, when the additional content is created by cutting out a part of the main content, in response to the touch input touching the trigger area, the cut out area of the main content Additional content may be output.

In the terminal and its control method according to the present disclosure, when the additional content is created by cutting out a part of the main content, in response to the touch input touching the trigger area, a position different from the cut out area of the main content While the additional content is being output, when the output of the additional content at the different location is terminated, the additional content may be output in the cut out area.

The features briefly summarized above with respect to the present disclosure are merely exemplary aspects of the detailed description of the present disclosure described below, and do not limit the scope of the present disclosure.

The present disclosure has the effect of providing a terminal and control method capable of outputting additional content in response to touching main content.

Furthermore, the present disclosure has the effect of providing a terminal and control method that allows a user to freely adjust an area that can trigger output of additional content or an output area of additional content.

Additionally, the present disclosure can provide a terminal and control method that can adaptively determine content to be output to the main content based on priorities between a plurality of trigger areas or priorities between a plurality of additional contents.

Additionally, the present disclosure can provide a terminal and control method that can use additional content to control the output of other additional content.

Additionally, the present disclosure can provide a terminal and control method that can set part of the main content as additional content.

The effects that can be obtained from the present disclosure are not limited to the effects mentioned above, and other effects not mentioned can be clearly understood by those skilled in the art from the description below. will be.

1 is a block diagram of a terminal according to the present invention.
Figure 2 is a flowchart showing the operation of the terminal in edit mode.
Figure 3 is a diagram for explaining an example of selecting additional content.
Figure 4 is a diagram showing an example of setting a trigger area based on a graphic object.
Figure 5 is a diagram showing an example of setting a trigger area and an output area of additional content.
Figure 6 is a diagram showing an example of setting a trigger area and an output area of additional content.
Figure 7 is a diagram showing an example in which a plurality of additional contents are linked to one trigger area.
Figure 8 is a diagram illustrating an example in which a plurality of additional contents are linked to a trigger object using a submenu.
Figure 9 is a diagram showing an example of setting multiple trigger areas for one additional content.
Figure 10 is a diagram showing the operation of the terminal when a plurality of trigger areas are arranged to overlap.
Figure 11 shows an example of setting additional content already inserted into the main content as a trigger area for new additional content.
Figure 12 is a diagram showing an example of setting cut content as additional content.
Figure 13 is a diagram illustrating the visual effect reflected in the part corresponding to the cut out area.
Figure 14 shows an example in which replacement content is set differently depending on the type of content that is cut out.
Figure 15 is a flowchart showing the operation of the terminal in viewer mode.
Figure 16 is a diagram showing an example in which a trigger area is visually identified and displayed.
Figure 17 is a diagram illustrating an example in which additional content is output in response to a user input touching a trigger area.
Figure 18 is a diagram showing an example in which additional content is rotated and output.
Figure 19 shows an example in which the cut content is set as additional content.
Figure 20 shows an example in which output areas for a plurality of additional contents are set.
Figure 21 is a diagram illustrating an example in which output of additional content ends.
Figure 22 is a diagram showing the operation of the terminal when a user input touching an area where multiple trigger areas overlap is received.
Figures 23 and 24 are diagrams illustrating an example in which an additional content list is output in response to a user input that touches the trigger area.
Figure 25 is a diagram showing the operation of the terminal when a user input that touches a trigger area linked to a plurality of additional contents is received.
Figure 26 shows an example in which other additional content is output in response to a user input that touches additional content.
Figure 27 is a diagram showing an example in which the output location and size of additional content are changed.

Hereinafter, with reference to the attached drawings, embodiments of the present disclosure will be described in detail so that those skilled in the art can easily practice them. However, the present disclosure may be implemented in many different forms and is not limited to the embodiments described herein.

In describing embodiments of the present disclosure, if it is determined that detailed descriptions of known configurations or functions may obscure the gist of the present disclosure, detailed descriptions thereof will be omitted. In addition, in the drawings, parts that are not related to the description of the present disclosure are omitted, and similar parts are given similar reference numerals.

In the present disclosure, when a component is said to be “connected,” “coupled,” or “connected” to another component, this is not only a direct connection relationship, but also an indirect connection relationship in which another component exists in between. It may also be included. In addition, when a component is said to "include" or "have" another component, this does not mean excluding the other component, but may further include another component, unless specifically stated to the contrary. .

In the present disclosure, terms such as first, second, etc. are used only for the purpose of distinguishing one component from other components, and do not limit the order or importance of components unless specifically mentioned. Therefore, within the scope of the present disclosure, a first component in one embodiment may be referred to as a second component in another embodiment, and similarly, the second component in one embodiment may be referred to as a first component in another embodiment. It may also be called.

In the present disclosure, distinct components are intended to clearly explain each feature, and do not necessarily mean that the components are separated. That is, a plurality of components may be integrated to form one hardware or software unit, or one component may be distributed to form a plurality of hardware or software units. Accordingly, even if not specifically mentioned, such integrated or distributed embodiments are also included in the scope of the present disclosure.

In the present disclosure, components described in various embodiments do not necessarily mean essential components, and some may be optional components. Accordingly, embodiments consisting of a subset of the elements described in one embodiment are also included in the scope of the present disclosure. Additionally, embodiments that include other components in addition to the components described in the various embodiments are also included in the scope of the present disclosure.

This disclosure relates to an application including a content editing tool and a terminal capable of running the application. The content editing tool described in this disclosure provides the function of setting a trigger area within the main content and linking the trigger area and additional content. If a user input for selecting a trigger area is received after editing the main content is completed, additional content associated with the trigger area may be output. Hereinafter, we will look at the content editing tool according to the present invention and a terminal capable of running an application that supports it in detail.

1 is a block diagram of a terminal according to the present invention. The terminal described in the present invention may be a mobile terminal such as a smartphone, personal computer (tablet PC), laptop, or personal digital assistant (PDA), or a fixed terminal such as a personal computer (PC) or smart TV. there is. However, for convenience of explanation, the drawings and embodiments described later assume that the terminal is a mobile terminal.

Referring to Figure 1, the terminal according to the present invention includes a communication unit 110, a camera 120, a microphone 130, a user input unit 140, a display unit 150, an audio output unit 160, and a memory 170. and a control unit 180.

The communication unit 110 allows the terminal to communicate with other terminals. The communication unit 110 may perform communication in a wireless manner or in a wired manner. For example, in order to communicate wirelessly, the communication unit 110 may include at least one of a mobile communication module or a wireless Internet module. The mobile communication module is for communication through a mobile communication base station such as LTE, HSDPA, or CDMA, and the wireless Internet module is for communication through Wireless LAN (Wi-Fi), etc. Wired methods may include LAN, USB, HDMI, RGB, or DVI.

The camera 120 receives a video signal and performs signal processing on the input video signal. The microphone 130 receives an audio signal and performs signal processing on the input audio signal.

The user input unit 140 receives user input. The user input unit 140 may include at least one of a button-shaped input unit exposed on the outside of the terminal and a touch input unit capable of receiving a touch input for touching the display unit 150. The touch input unit may include at least one touch sensor. At this time, when the display unit 150 and the touch input unit form a mutual layer structure, such a structure may be called a 'touch screen'. In such a touch screen structure, it is possible to receive various types of touch input, such as selecting or dragging an object displayed on the touch screen using a pointer.

The user input unit 140 may include at least one motion sensor for receiving gesture input. At this time, the motion sensor may include a gyro sensor or an acceleration sensor that can detect movement of the terminal. As another example, the control unit 180 may analyze the user's movement through an image input through the camera 120 and determine whether a gesture input has been received based on the analysis result.

Embodiments described later will describe examples of how a terminal operates based on various user inputs through a touch screen. However, in embodiments described later, a function executed by a touch input is received through an input that touches (or pushes) a button exposed on the outside of the terminal, a gesture input, or an external input device (e.g., a mouse or keyboard, etc.). Implementation by input, etc. may also be included in embodiments of the present invention.

The display unit 150 outputs information processed in the terminal. For example, the display unit 150 serves to output an execution screen of an application running in the terminal, a user interface (User Interface), or a graphic user interface (Graphic User Interface) on the execution screen.

The audio output unit 160 serves to output audio data received from the communication unit 110 or stored in the memory 170.

The memory 170 stores data for executing applications and data processed in the terminal. The memory 170 includes a hard disk, SSD (Solid State Disk), flash memory 170, a card-type storage device (e.g., SD or XD memory 170, etc.), and RAM (Random Access Memory). ) or ROM (Read Only Memory). Web storage that can be accessed remotely through the communication unit 110 may also be included in the category of memory 170.

The control unit 180 controls the overall operation of the terminal. The control unit 180 can process signals, data, or information that are input or output through the components that make up the terminal. In addition, the control unit 180 can execute an application stored in the memory 170. The control unit 180 may include an operation/control device such as a Central Processing Unit (CPU), Graphic Processing Unit (GPU), Micro Controller Unit (MCU), or Micro Processing Unit (MPU).

The terminal does not have to include all the components shown in FIG. 1, and depending on the implementation type, some of the components shown in FIG. 1 may not be included. Based on the above description, the present invention will be described in detail.

The main content described in the present invention may be text-based content or multimedia content such as images or videos. As an example, the main content may be a presentation document (e.g., a file with an extension of ppt(x)), a spreadsheet document (e.g., a file with an extension of xls(x)), a word processing document (e.g., For example, files with the extension doc(x), hwp, txt or pdf), web pages (for example, files with the extension html), or e-books (for example, files with the extension epub, etc.) is text-based content, or is an image (e.g., a file with an extension such as jpg, gif, tif, or bmp) or a video (e.g., a file with an extension such as mpeg, avi, mp4, wmv, or mov) It may be a multimedia content based.

Hereinafter, the state in which a trigger area can be set in the main content will be defined as the edit mode, and the state in which additional content linked to the trigger area can be output in response to touching the trigger area will be defined as the viewer mode. That is, the edit mode may refer to a state in which settings related to the trigger area and additional content can be changed, and the viewer mode may refer to a state in which settings related to the trigger area and additional content cannot be changed.

Figure 2 is a flowchart showing the operation of the terminal in edit mode.

When the main content is selected, the control unit 180 may output the selected main content on the display unit 150 (S210). The control unit 180 can output the main content in full screen while maintaining the aspect ratio of the main content. Accordingly, when the aspect ratio of the main content is different from the aspect ratio of the display unit 150, a blank space may occur in the display unit 150. The control unit 180 can fill the blank space with a predefined single color or a color selected by the user. Alternatively, the control unit 180 may determine the pixel value of the pixel included in the margin based on the value of the pixel at the border of the main content. For example, the pixel value of a pixel included in the margin may be set to be the same as the sample value of a sample located at the border of the main content that has the same x-coordinate or y-coordinate as the corresponding pixel.

When the main content includes a plurality of pages, the control unit 180 can control at least one page to be output through the display unit 150.

Next, the control unit 180 may select additional content to be inserted into the main content based on the user input (S220). Additional content that can be inserted into the main content may be text-based content, images, videos, or music. That is, the main content and the additional content may be of the same type or may be of different types.

Figure 3 is a diagram for explaining an example of selecting additional content.

If a predetermined user input is received while the main content is being output, the control unit 180 may output a menu 310 for selecting additional content. Here, the predetermined touch input may be a touch input that touches an arbitrary location of the main content, a touch input of a predefined type, or a touch input that touches a menu that calls a content selection function. The predefined form may be one in which at least one of the number of pointers, touch intensity (touch pressure), touch time, or number of touches is greater than or equal to a reference value.

For example, when a user input that touches an arbitrary position of the main content is received, the control unit 180 creates a menu 310 for selecting additional content at the user's touch input point, as in the example shown in FIG. 3. Can be printed. Selection of additional content may proceed in the following order: i) selection of a content type, and ii) outputting a list of content of the selected type or generating content of the selected type.

As an example, each item included in the menu 310 shown in FIG. 3 may be for selecting a content type. Specifically, each item of the menu 310 shown in FIG. 3 is sequentially image 311, video 312, web 313, mark 314, music 315, text 316, and slide file. This may be for selecting a specific page (317) or cut content (318).

When a user input for selecting a content type is received, the control unit 180 outputs a list of contents corresponding to the selected type, or executes an application for creating content corresponding to the selected type and/or an input window for selecting content. You can. At this time, whether to output a content list or run an application for creating content may be determined by user input. Alternatively, you can run any one of these by default.

For example, when an image item 311 or a video item 312 is selected through the menu 310, the control unit 180 outputs a list of image or video files stored in the memory 170 or the cloud, or outputs a list of image or video files stored in the memory 170 or the cloud. You can run the camera application to create files. When one of the file lists is selected or the image or video capture is completed through the camera 120, the selected/created image or video can be determined as additional content to be inserted into the main content.

Alternatively, when a web item 313 is selected through the menu 310, the control unit 180 outputs a list of web pages, a favorites list, or a list of frequently visited web pages stored in the memory 170 or the cloud. You can run a web browser application to select . Alternatively, an input window for entering the IP address or URL (Uniform Resource Locator) address of the web page may be displayed. The IP address or URL address of the web page can be entered through the input window. According to the above process, if the website document, the IP (Internet Protocol) address, or the URL (Uniform Resource Locator) address of the website is determined, the website can be determined as additional content to be inserted into the main content.

Alternatively, when the mark item 314 is selected through the menu 310, the control unit 180 can output a list of pre-stored images that can be inserted into the main content. The pre-stored image may include at least one of an icon, emoji, or shape.

Alternatively, when the audio item 315 is selected through the menu 310, the control unit 180 can output a list of music files stored in the memory 170 or the cloud, or run a recording application to create an audio file. . When one of the file lists is selected or recording is completed through the microphone 130, the selected/generated data can be determined as additional content to be inserted into the main content.

Alternatively, when a text item 316 is selected through the menu 310, the control unit 180 may output an input window for inputting text. The control unit 180 may determine text input through the input window as additional content to be inserted into the main content.

Alternatively, when the slide item 317 is selected through the menu 310, the control unit 180 can output an input window for entering a page list or page number in the slide file. When one of the page lists is selected or a page number is entered through the input window, the corresponding page may be determined as additional content.

Alternatively, when the cut content item 318 is selected through the menu 310, the control unit 180 may execute a tool for cropping at least a portion of the main content. Here, the tool is an element for selecting part of the main content and may include at least one of a pointer or a menu.

The cut content may be partial data created by capturing, copying, or cutting at least part of the data included in the main content. As an example, the cut content may include at least one of a captured image capturing at least a portion of the main content, an image with at least a portion of the main content cut out, or text data obtained by copying or cutting at least a portion of a string included in the main content. there is.

Although not shown, a document different from the document being edited can be set as additional content. For example, when a document item is selected, the control unit 180 may output a list of document files stored in the memory 170 or the cloud, or execute a document creation application to create a document file. When one of the file lists is selected or a document is created through a document creation application, the selected/created document can be determined as additional content to be inserted into the main content.

In the above example, after selecting a content type, a content list of the selected type or an application for creating content of the selected type is shown to be executed. However, this is only an example for selecting additional content and does not limit the present invention. It's not like that. For example, a content list may be output or an application for content creation may be executed without selecting a content type, or, when a content type is selected, content corresponding to a predefined condition may be determined as additional content. Here, the content corresponding to the predefined conditions is the most recently viewed content, the most recently modified content, the content most recently stored in the terminal, the content with the highest number of views by the user over a certain period of time, and the content pre-designated by the user. Alternatively, it may include at least one of content cut out of a portion corresponding to the area where the pointer is located.

In addition, in FIG. 3, the content type is illustrated as being determined based on a user input by touching one of the items included in the menu 310, but it is also possible to select the content type in a different way than shown. will be. As an example, the content type may be determined according to the user's touch input type. For example, when a first type of touch input is received, it may be determined that the first type of content is selected, while when a second type of touch input is received, it may be determined that the second type of content is selected. Here, the first type and the second type of touch input may be different in at least one of the number of pointers, touch intensity (touch pressure), touch time, or number of touches.

Alternatively, the user input for selecting the content type may be preset only for a specific content type among a plurality of content types. As an example, a user input for selecting a type of cut content 318 from among content selectable through the menu 310 of FIG. 3 may be pre-defined. In this case, when a pre-defined user input is received, a tool for determining the cut content 318 can be immediately executed without outputting a separate menu 310.

When additional content is selected, a trigger area linked to the additional content within the main content can be set (S230). Specifically, when additional content is selected, the control unit 180 outputs a graphic object for setting a trigger area within the main content and can adjust the position and size of the trigger area according to the position and size of the graphic object. For convenience of explanation, a graphic object for setting a trigger area will be defined as a trigger object.

Figure 4 is a diagram showing an example of setting a trigger area based on a trigger object.

The left drawing of FIG. 4 shows an example of setting a trigger area in the main content in edit mode, and the right drawing of FIG. 4 shows an example of identifying and displaying a trigger area in viewer mode. In addition, the dotted outline in the left drawing of FIG. 4 indicates the location or size of the previous graphic object, and the dotted outline in the right drawing of FIG. 4 indicates the trigger area.

When additional content is determined, the control unit 180 may control the output of the trigger object 410 for setting the trigger area 420, as in the example shown in (a) of FIG. 4. The trigger object 410 may be an image representing additional content. Here, the image representing the additional content may include at least one of a thumbnail or a preview image. For example, if an image is selected as additional content, a thumbnail of the image selected for setting the trigger area may be output as the trigger object 410.

In addition to the examples described, the trigger object 410 may be an image corresponding to the type of additional content. For example, when additional content is determined, an image corresponding to the type of the determined additional content may be output as the trigger object 410.

Alternatively, a predefined/prestored image or polygon image may be output as the trigger object 410.

The control unit 180 may set the position and/or size of the trigger area 420 according to the position and/or size of the trigger object 410. That is, the location and size of the trigger object 410 may correspond to the location and size of the trigger area 420.

For example, as in the example shown in (b) of FIG. 4, when the position of the trigger object 410 changes, the position of the trigger area 420 may also change along the changed position of the trigger object 410. there is. For example, in (b) of FIG. 4, if the upper left coordinates of the trigger object 410 are changed from (x1, y1) to (x2, y2), the coordinates of the trigger area 420 are also changed from (x1, y1). It can be changed to (x2, y2).

In addition, as in the example shown in (c) of FIG. 4, when the size of the trigger object 410 is changed, the size of the trigger area 420 may also be changed to match the changed size of the trigger object 410. . For example, in (c) of FIG. 4, if the width and height of the trigger object 410 increase by △w and △h, respectively, the size of the trigger area 420 may also increase by △w and △h.

Depending on the output mode of the additional content, the step of setting the output area of the additional content may be selectively performed (S240, S250). Here, the output mode may indicate whether to output the additional content as a full screen or a partial screen when a user input that touches the trigger area is received under the viewer mode.

When the additional content is set to be output in a partial screen, a trigger object for setting the trigger area and a graphic object for setting the output area of the additional content may be output at the same time. For convenience of explanation, a graphic object for setting the output area of additional content will be defined as a content object.

The output mode of the additional content may be determined by user input, or either full screen or partial screen may be applied as default. For example, when additional content is selected, the control unit 180 may output a menu for determining an output mode of the additional content and select the output mode of the additional content based on a user input to the menu.

Alternatively, outputting the additional content in full screen or partial screen may be set as default.

Alternatively, the control unit 180 determines whether to set the selected additional content to be output in full screen or partial screen, depending on whether the previous additional content was set to be output in full screen or partial screen. can be decided.

The control unit 180 may change the output mode of additional content based on user input. Specifically, when the additional content is set to be output on the full screen and a predetermined user input is received, the control unit 180 can change the additional content to be displayed on the partial screen. For example, when a certain type of touch input is received for a trigger object, the control unit 180 may change the output mode of the additional content from full screen to partial screen. Here, a certain type of touch input may be a simple touch to a graphic object, or may be one in which at least one of the number of touches, touch intensity (touch pressure), or touch time on the graphic object is greater than or equal to a reference value. Alternatively, the output mode of the additional content may be changed based on a touch input that touches a menu that changes the output mode of the additional content from full screen to partial screen.

When the output mode of the additional content is set to partial screen, a trigger object for setting the trigger area and a content object for setting the output area of the additional content may be output at the same time.

It is also possible to change the output mode of additional content whose output mode is partial screen to full screen. For example, when a certain form of touch input is received to delete either the trigger object or the content object, or when a user input to merge the trigger object and the content object is received, the output mode of the additional content is changed from partial screen to full screen. You can change it. Here, a predetermined form of touch input for deleting either the trigger object or the content object is touching a button for deleting the trigger object or the content object, or the number of touches on the trigger object or content object, the touch intensity (touch intensity) This may include at least one of pressure) or touch time being greater than or equal to a reference value. Alternatively, the output mode of the additional content may be changed based on a touch input that touches a menu that changes the output mode of the additional content from partial screen to full screen.

Alternatively, the output mode of the additional content may be determined based on the size of the content object. For example, when the size of the content object exceeds a predefined threshold, the output mode of the additional content may be changed from partial screen to full screen. Conversely, when the size of the content object changes below a predefined threshold, the output mode of the additional content may be changed from full screen to partial screen. Here, the size of the content object represents at least one of the width or height of the content object.

Alternatively, the output mode of the additional content may be determined depending on the type of the additional content. For example, if the additional content is a video type, the output mode of the additional content may be set to full screen. On the other hand, if the additional content is a photo type, the output mode of the additional content may be set to partial screen.

Figure 5 is a diagram showing an example of setting a trigger area and an output area of additional content.

The left drawing of FIG. 5 shows an example of setting a trigger area and an output area of additional content in a document under edit mode, and the right drawing of FIG. 5 shows an example of identifying and displaying a trigger area and an output area of additional content in viewer mode. It is shown.

For convenience of explanation, it is assumed that the initially added content is set to be displayed in full screen.

When additional content is set to be output in full screen, the control unit 180 may output a graphic object 510 for setting the trigger area 530, as in the example shown in (a) of FIG. 5. .

Thereafter, when the output mode of the additional content is changed from full screen to partial screen, the control unit 180 can control the output of the new graphic object 520 while maintaining the output of the graphic object 510. The existing graphic object 510 can be used to set one of the trigger area 530 or the output area 540 of additional content, and the new graphic object 520 can be used to set the other one.

For example, when the output mode of the additional content is full screen, the graphic object 510 is used to set the trigger area 530, while when the output mode of the additional content is changed to partial screen, the graphic object 510 is used to set the trigger area 530. It can be used to set the output area 540 of additional content. As the output mode of the additional content is changed to partial screen, the newly output graphic object 520 can be used to set the trigger area 530.

Or, conversely, the existing graphic object 510 may be used to set the trigger area 530 even after the output mode of the additional content is changed to partial screen. In this case, the newly output graphic object 520 may be used to set the output area 540 of additional content.

In this embodiment, it is assumed that the existing graphic object 510 is used to set the content area, and the newly output graphic object 520 is used to set the trigger area 530. In addition, the graphic object 520 used to set the trigger area 530 will be called a trigger object, and the graphic object 510 used to set the content output area 540 will be called a content object.

The trigger object 520 and the content object 510 may be an image representing additional content, an image corresponding to the type of additional content, or a polygonal image. At this time, it is preferable that the first graphic object 520 and the second graphic object 510 are different images.

The control unit 180 sets the position and/or size of the trigger area 530 based on the position and/or size of the trigger object 520, and outputs additional content based on the position and size of the content object 510. The location and/or size of area 540 can be set. For example, as the position and/or size of the trigger object 520 changes, the position and/or size of the trigger area 530 may change, and as the position and/or size of the content object 510 changes. Accordingly, the location and/or size of the output area 540 of the additional content may be changed. In the example shown in (b) and (c) of FIGS. 5, the position and size of the trigger area 530 are determined according to the position and size of the trigger object 520, and are determined according to the position and size of the content object 510. The output area 540 of the additional content is shown to have its location and size determined.

The control unit 180 may determine the aspect ratio of the output area of the additional content according to the aspect ratio of the additional content. That is, in order to suppress distortion that occurs as the additional content is output in accordance with the output area of the additional content, the control unit 180 may control the aspect ratio of the output area of the additional content to remain the same as the aspect ratio of the additional content. Accordingly, when the width of the content object changes, the control unit 180 can control the height of the content object to also change according to the aspect ratio of the additional content. Likewise, when the height of the content object changes, the control unit 180 can control the width of the content object to also change according to the aspect ratio of the additional content. When a user input that simultaneously adjusts the width and height of the content object is received, the control unit 180 can adjust the width and height of the content object according to the aspect ratio of the additional content. At this time, the width and height of the content object may be adjusted based on either the width change value or the height change value set as default, or the width change value or the height change value may have a larger change value.

Whether to set the aspect ratio of the output area of the additional content to be the same as that of the additional content may be adjusted by the user's settings.

If the size of the trigger area is small, it may be difficult for the user to find the trigger area in viewer mode, and if the size of the output area of the additional content is small, it may be difficult to accurately check the contents of the additional content. Accordingly, the control unit 180 can prevent the size of the trigger area and/or the output area of the additional content from becoming less than a predefined size. For example, even if a user input is received to make the size of the trigger object for setting the trigger area smaller than the predefined size, the control unit 180 may control the size of the trigger object so that it does not become smaller than the predefined size. Likewise, even if a user input is received that makes the size of the content object smaller than the predefined size for setting the output area of the additional content, the control unit 180 can control the size of the content object so that it does not become smaller than the predefined size. there is.

The setting of the trigger area and the setting of the output area of the additional content may be independent of each other. That is, changing the position and/or size of the trigger object used to set the trigger area may be independent of changing the position and/or size of the content object used to set the output area of the additional content. Accordingly, even if the position and/or size of the trigger object is changed, the position and/or size of the content object may not change.

As another example, the trigger area settings and the output area settings of additional content may be set to be mutually dependent. That is, the position and/or size of the output area of the additional content may be determined dependent on a change in the position and/or size of the trigger area, and the position and/or size of the trigger area may be dependent on a change in the position and/or size of the content area. can be decided. Accordingly, when the position and/or size of the trigger object used to set the trigger area is changed, the position and/or size of the content object used to set the output area of the additional content may also be changed.

Figure 6 is a diagram showing an example of setting a trigger area and an output area of additional content.

In FIG. 6, it is assumed that the graphic object 620 functions as a trigger object, and the graphic object 610 functions as a content object.

If the content output area and the trigger area are set to be interdependent, changing the position and/or size of either the trigger object or the content object may affect the other one.

For example, as in the examples shown in (a) and (b) of Figures 6, when the position of the trigger object 620 is changed by (△x, △y), the position of the content object 610 is also ( It can be changed by △x, △y). As the position of the trigger object 620 changes by (△x, △y), the position of the trigger area 630 also changes by (△x, △y), and the position of the content object 610 changes by (△x, As △y) is changed, the position of the output area 640 of the additional content may also be changed by (△x, △y).

For example, as in the example shown in (c) of FIG. 6, when the size of the trigger object 620 is changed by (△w, △h), the size of the content object 610 is also changed by (△w, △). h) may be changed. As the size of the trigger object 620 changes by (△w, △h), the size of the trigger area 630 also changes by (△w, △h), and the size of the content object 610 changes by (△w, As △h) is changed, the size of the output area 640 of the additional content may also be changed by (△w, △h).

Output of additional content caused by a change in the position and/or size of the trigger area (or trigger object), considering the size ratio of the trigger area (or trigger object) and the output area (or content object) of the additional content. The amount of change in position and/or size of the area (or content object) can be adjusted. For example, if the size ratio between the trigger area and the output area of the additional content is 1:N, in response to the size of the trigger area being changed by (△w, △h), the size of the output area of the additional content is (N It can be changed by △w, N△h).

Whether to set the trigger area and the additional content output area independently or dependently can be determined by user settings. For example, while the trigger area and the additional content output area are set independently of each other, even if the position and/or size of the trigger object changes, the position and/or size of the content object may not change. On the other hand, if the settings are changed so that the trigger area and the additional content output area are interdependent, the position and/or size of the content object may be changed in response to the change in position and/or size of the trigger object.

In Figure 2, it is shown that after setting the trigger area (S220), the step of setting the output area of the additional content (S250) is performed. However, as in the above-described example, setting of the trigger area and setting of the additional content output area can be performed independently. Accordingly, setting of the trigger area and setting of the additional content output area do not necessarily have to be performed sequentially, as in the example shown in FIG. 2. That is, depending on the user's intention, setting of the trigger area and setting of additional content may be performed in the opposite order, or the above two settings may be performed alternately and repeatedly.

Multiple additional contents can also be linked to one trigger area. For example, when setting a trigger area for the selected additional content after selecting additional content, if a trigger area already linked to other additional content is selected, a plurality of additional content may be linked to one trigger area.

Figure 7 is a diagram showing an example in which a plurality of additional contents are linked to one trigger area.

For convenience of explanation, as in the example shown in (a) of FIG. 7, the main content already includes a first additional content 715 and a first trigger object 710 associated with the first additional content 715. Assume it exists.

When the second additional content 725 to be inserted into the main content is selected, the control unit 180 creates a second trigger area to be linked with the second additional content 725, as in the example shown in (b) of FIG. 7. A second trigger object 720 for setting may be output. At this time, as in the example shown in (c) of FIG. 7, when a user input that changes the position of the second trigger object 720 inside the first trigger object 710 is received, the control unit 180 As in the example shown in (d) of FIG. 7, a menu for determining whether to merge the second trigger area for the second additional content 725 with the first trigger area can be controlled to be output.

When a user input determining to merge the second trigger area with the first trigger area is received, as in the example shown in (e) of FIG. 7, the control unit 180 outputs the second trigger object 720 may be stopped, and the second additional content 725 may be additionally linked to the first trigger area. That is, when the first trigger area and the second trigger area are set to merge, setting the second trigger area for the second additional content can be completed. The first additional content and the second additional content may be associated with the first trigger area set by the first trigger object 710.

On the other hand, when a user input determining not to merge the second trigger area with the first trigger area is received, the control unit 180 generates second additional content based on the position and/or size of the second trigger object 720. You can set a second trigger area for.

In FIG. 7, when a user input for dragging a graphic object to the inside of the first trigger object is received, a menu for selecting whether to merge the first trigger area and the second trigger area is displayed. , the present invention is not limited thereto. For example, if it is decided to insert second additional content into the main content, a menu for selecting whether to merge the first trigger area and the second trigger area can be output before outputting the second trigger object. there is.

Alternatively, the control unit 180 may determine whether the first trigger area and the second trigger area can be merged, depending on whether the first additional content and the second additional content are of the same type. As an example, the first trigger area and the second trigger area may be set to be mergeable only when the first additional content and the second additional content are of the same type. On the other hand, if the first additional content and the second additional content are of different types, the first trigger area and the second trigger area may not be merged even if the second trigger object is dragged over the first trigger object.

Alternatively, the control unit 180 may determine whether the first trigger area and the second trigger area can be merged based on the size of the trigger area and/or the output mode of the additional content or the size of the output area of the additional content. For example, if the size difference or size ratio between the first trigger area and the second trigger area exceeds a predefined threshold, even if the second trigger object for setting the second trigger area is dragged over the first trigger area. , the first trigger area and the second trigger area may not be merged. Or, when the output modes of the first additional content and the second additional content are different (e.g., when the output mode of the first content is a partial screen and the output mode of the second additional content is a full screen), over the first trigger object Even if the second trigger object is dragged, the first trigger area and the second trigger area may not be merged.

In addition to the example shown in FIG. 7, when a plurality of additional contents are selected at the same time, an integrated trigger area for the simultaneously selected additional contents may be set. That is, when a plurality of additional contents are simultaneously inserted into the main content, one trigger object for setting an integrated trigger area for the plurality of additional contents is output, and a plurality of trigger objects are added based on the position and/or size of the trigger object. An integrated trigger area for content can be determined.

Alternatively, when a certain type of touch input is input to a previously inserted trigger object, a submenu for selecting additional content to be linked to the corresponding trigger area may be output. Here, a certain type of touch input may mean touching a trigger object, or may mean that at least one of the number of pointers touching the trigger object, touch intensity, or touch time is greater than or equal to a reference value.

Figure 8 is a diagram illustrating an example in which a plurality of additional contents are linked to a trigger object using a submenu.

When a touch input for touching the trigger object 810 is received, the control unit 180 controls the submenu 820 related to the trigger object 810 to be output, as in the example shown in (a) of FIG. 8. You can.

In the submenu 820 shown in (a) of FIG. 8, the additional item 821 is for executing a command for additionally linking additional content to the trigger object 810. The delete item 822 is for executing a command to delete the trigger object 810 on the main content.

When an additional item is selected, the control unit 180 outputs a menu for selecting additional content to be linked to the trigger object 810, a content list for selecting additional content, or an application/input for creating additional content. You can run windows. Selection of additional content may follow the embodiment described based on FIG. 3.

When a plurality of additional contents are linked to one trigger object 810, the control unit 180 may identify and display that a plurality of additional contents are linked to the trigger object 810. As an example, the control unit 180 may output at least one of information indicating that a plurality of additional contents are linked to the trigger object 810 or information 815 indicating the number of additional contents linked to the trigger object 810. You can. (See (b) in Figure 8).

Additionally, a list of additional content can be output to identify a plurality of additional content around the trigger object. The additional content list may include objects corresponding to each additional content. Accordingly, the number of objects may be equal to the number of additional content linked to the trigger object. Here, the object may be an image representing each additional content or an image representing the type of each additional content.

Multiple objects may be arranged in a row along a vertical or horizontal direction. Alternatively, a plurality of objects may be distributed and disposed near the border of the trigger area. As an example, the first object may be placed adjacent to the first border of the trigger area, and the second object may be placed adjacent to the second border of the trigger area.

The position and/or size of each object can be adjusted by user input.

When a plurality of additional contents are linked to one trigger area, the control unit 180 can set priorities among the plurality of additional contents. Priority can be used to determine the output order of additional content in viewer mode.

The priority may be determined by user settings, or may be determined based on at least one of the order of insertion into the main content, the type, output mode, or size of additional content. As an example, the control unit 180 may determine the priority of additional content in the order in which it is inserted into the main content. That is, additional content inserted first into the main content may have a higher priority than additional content inserted into the main content later. Alternatively, considering the types of additional content, the first type of additional content may be set to have higher priority than the second type of additional content. Alternatively, among the additional contents, additional content with a full screen output mode may be set to have higher priority than additional content with a partial screen output mode, or additional content with a large output area may be set to have a higher priority than additional content with a small output area size. It can be set to have high priority. The determined priority may be changed by user settings. Multiple additional contents may be set to have the same ranking.

One additional content can also be linked to multiple trigger areas. For example, when a user input for adding a trigger area for additional content is received, a plurality of graphic objects for setting a plurality of trigger areas may be output.

Figure 9 is a diagram showing an example of setting multiple trigger areas for one additional content.

When additional content to be inserted into the main content is selected, the control unit 180 creates a trigger object (hereinafter referred to as the first trigger object) to set a trigger area for the additional content, as in the example shown in (a) of FIG. 9. , 810) can be output.

In this state, when a user input for adding a trigger area is received, the control unit 180 creates a graphic object (hereinafter referred to as a second trigger) for setting an additional trigger area, as in the example shown in (b) of FIG. 9 Referred to as an object, 820) can be further output.

The first trigger object 910 may be used to set a first trigger area 915 for additional content, and the second trigger object 920 may be used to set a second trigger area 915 for additional content. That is, the control unit 180 sets the first trigger area based on the position and/or size of the first trigger object 910, and sets the second trigger area based on the position and/or size of the second trigger object 920. Areas can be set.

The settings of the first trigger area and the settings of the second trigger area may be set to be mutually dependent. That is, when the position and/or size of the first trigger area changes, the position and/or size of the second trigger area can also be set to change. Accordingly, when the position and/or size of the first trigger object used to set the first trigger area changes, the position and/or size of the second trigger object used to set the second trigger area may also change. there is.

The control unit 180 may set the functions of the first trigger area and the second trigger area to be the same, or may set the functions of both to be different. As an example, the control unit 180 may set both the first trigger area and the second trigger area to have the purpose of outputting additional content and stopping the output of additional content in the viewer mode. Alternatively, the control unit 180 may set the first trigger area to have the purpose of outputting additional content in all viewers, while setting the second trigger area to have the purpose of stopping the output of additional content in the viewer mode.

Alternatively, at least one of the first trigger area and the second trigger area may be set to have the purpose of outputting or stopping the output of additional content, while the other may be set to have the purpose of controlling, such as enlarging, playing, or pausing the additional content.

When a plurality of additional contents are inserted into the main content, a plurality of trigger areas may exist. At this time, the control unit 180 may determine whether to allow overlapping arrangement of trigger areas based on user settings. If overlapping arrangement between trigger areas is not allowed, the newly added trigger area may be as small as the overlap with the existing trigger area, or its position may be automatically changed so that it does not overlap with the existing trigger area.

Figure 10 is a diagram showing the operation of the terminal when a plurality of trigger areas are arranged to overlap.

When overlapping arrangement of trigger areas is allowed, as in the example shown in (a) of FIG. 10, a first trigger object 1010 and a second trigger area 1025 to set the first trigger area 1015 The second trigger object 1020 for setting may be arranged to overlap. In this case, the area where the first trigger object 1010 and the second trigger object 1020 overlap may correspond to the first trigger area 1015 or the second trigger area 1025. For overlapping areas, priorities between trigger areas may be determined. Priority can be used to determine the output order of additional content in viewer mode.

The priority may be determined by user settings, or may be determined based on at least one of the setting order of the trigger area, the size of the trigger area, the type of additional content associated with each trigger area, and the output mode or size of the additional content. As an example, the control unit 180 may determine the priority of the trigger area in the order in which it is inserted into the main content. That is, a trigger area added to the main content first may have a higher priority than a trigger area inserted into the main content later. Alternatively, considering the types of additional content associated with each trigger region, the trigger region associated with the first type of additional content may be set to have higher priority than the trigger region associated with the second type of additional content. Alternatively, among additional contents, the trigger area associated with additional content whose output mode is full screen may be set to have higher priority than the trigger area associated with additional content whose output mode is partial screen, or additional content whose output area is large in size. The trigger area associated with can be set to have higher priority than the trigger area associated with additional content with a smaller output area. The determined priority may be changed by user settings. Multiple trigger areas may be set to have the same priority.

On the other hand, when overlapping arrangement of trigger areas is not allowed, a first trigger object 1010 for setting the first trigger area 1015 and a second trigger object 1020 for setting the second trigger area 1025 Overlapping may not be allowed. For example, as in the example shown in (b) of FIG. 10, when the second trigger object 1020 is moved over the first trigger object 1010, the control unit 180 automatically moves the first trigger object 1010. ) The position of the second trigger object 1020 can be changed to an area that does not overlap.

Alternatively, when overlapping arrangement of trigger areas is not allowed, the control unit 180 allows overlapping arrangement of the first trigger object 1010 and the second trigger object 1020, but the first trigger area 1015 and the second trigger object 1020 Any one of the trigger areas 1025 can be controlled to decrease by the amount of overlap between the first trigger object 1010 and the second trigger object 1020. That is, the overlapping area of the first trigger object 1010 and the second trigger object 1020 may be used only as the first trigger area 1015 or only as the second trigger area 1025. As an example, when the second trigger object 1020 is moved over the first trigger object 1010, the control unit 180 moves from the second trigger object 1020, as in the example shown in (c) of FIG. 10. The overlap between the first trigger object 1010 and the second trigger object 1020 can be removed and set as the second trigger area 1025.

At least part of the additional content already inserted into the main content can be set as a trigger area for new additional content. As an example, at least a partial area of the first additional content may be set as a trigger area for outputting second additional content that is different from the first additional content. That is, in the viewer mode, the trigger area associated with the first additional content is used to start or end the output of the first additional content, and at least a partial area of the first additional content is used to start or end the output of the second additional content. It can be used for things.

Figure 11 shows an example of setting additional content already inserted into the main content as a trigger area for new additional content.

For convenience of explanation, additional content already inserted into the main content will be referred to as first additional content, and additional content newly linked to the first additional content will be referred to as second additional content.

A predetermined user input is applied to the first trigger object 1110 for setting the trigger area 1130 for the first additional content or the first content object 1120 for setting the output area 1140 for the first additional content. When received, the control unit 180 may output a menu for outputting second additional content to be linked to the first additional content. Here, the predetermined input is touching at least one of the first trigger object 1110 or the first content object 1120, or touching at least one of the first trigger object 1120 or the first content object 1120. This may mean that at least one of the number of pointers being touched, touch intensity, number of touches, or touch time is greater than the reference value. As in the example shown in FIG. 3, the menu may be for selecting a type of second additional content, or may be a content list for selecting additional content.

Alternatively, content that satisfies predefined conditions may be automatically determined as the second additional content. Here, content that satisfies the predefined conditions may include content highly related to the first additional content, content most recently added to the terminal, content most recently executed, or content executed in viewer mode. Content that is highly related to the first additional content may mean content that includes similar content to the first additional content. For example, when the first additional content is an image or video, an image or video of a person included in the first additional content, an image or video taken on the same date or at the same location as the first additional content, etc. are included in the first additional content. The content may be determined to be highly related to the content.

Alternatively, the control unit 180 may control the output of a content list including content highly related to the first additional content. When content is selected through the content list, the selected content may be determined as second additional content.

When second additional content is selected through the menu, a second trigger object 1150 for setting a second trigger area for the second additional content may be output. A second trigger area 1160 for second additional content can be set through the second trigger object 1150.

The control unit 180 may output the second trigger object 1150 on the first content object 1120. At this time, the location and/or size of the second trigger object 1150 may be determined dependent on the location and/or size of the first content object 1120. For example, the size of the second trigger object 1150 may be set not to exceed the size of the first content object 1120. Alternatively, the second trigger object 1150 may be set not to deviate from the first content object 1120. For example, when the first direction boundary of the second trigger object 1150 is in contact with the first direction boundary of the first content object 1120, even if the pointer touching the second trigger object 1150 moves in the first direction , the second trigger object 1150 can be set to no longer move in the first direction.

As the second trigger object 1150 is output on the first content object 1120, at least a portion of the first additional content output area 1140 overlapping with the second trigger object 1150 displays the second additional content. It can be set as the second trigger area 1160 for. That is, the first trigger area 1130 is set as the output control area of the first additional content, and the second trigger area 1160, where the first content object 1120 and the second trigger object 1150 overlap, is the second trigger area 1160. It can be set as an area for output control of additional content.

Alternatively, the entire area of the first additional content output area 1140 can be set as the second trigger area 1160 for the second additional object. When the entire area of the first additional content output area 1140 is set as the second trigger area 1160, output of the second trigger object 1150 for setting the second trigger area can be omitted. In this case, the location and/or size of the second trigger area 1160 may be determined according to the location and/or size of the first content object 1120.

The control unit 180 may output a second content object 1170 for setting the output area 1180 of the second additional content according to the output mode of the second additional content.

Alternatively, it may be selectively determined whether to output the second content object 1170 based on the output mode of the second additional content. For example, when the output mode of the second additional content is full screen, the second content object 1170 is not output, while when the output mode of the second additional content is partial screen, the output area of the second additional content ( A second content object 1170 for setting 1180 may be output. The control unit 180 may determine the output area 1180 of the second additional content based on the location and size of the second content object 1170.

At this time, the position and/or size of the output area 1180 of the second additional content may be determined depending on the position and/or size of the output area 1140 of the first additional content. For example, the size of the output area 1180 of the second additional content may be set not to exceed the size of the output area 1140 of the first additional content. Alternatively, the position and/or size of the output area 1180 of the second additional content may be changed as the position and/or size of the output area 1140 of the first additional content are changed.

As another example, the output area 1180 of the second additional content may be set to be the same as the output area 1140 of the first additional content. When the output area 1180 of the second additional content is set to be the same as the output area 1140 of the first additional content, output of the second content object 1170 to set the output area 1180 of the second additional content can be omitted.

Whether it is permissible to use at least a portion of the output area of the first additional content as a trigger area for the second additional content may be determined according to the output mode of the first additional content. As an example, the control unit 180 may allow setting at least a portion of the output area of the first additional content as a trigger area for the second additional content only when the output mode of the first additional content is partial screen. . On the other hand, when the output mode of the first additional content is full screen, setting at least a portion of the output area of the first additional content as a trigger area for the second additional content may not be permitted.

The type of the second additional content may be determined dependent on the type of the first additional content. For example, the second additional content may be limited to the same type as the first additional content. Accordingly, when the first additional content is an image, the second additional content that can be linked to the first additional content may be limited to images.

It is also possible to set a plurality of trigger areas on the first content output area. As an example, a second trigger object for setting a trigger area of the second additional content and a third trigger object for setting a trigger area of the third additional content may be output on the first content object. A plurality of trigger objects may not be allowed to overlap on the first content object.

Alternatively, the control unit 180 may divide the first content object by the number of trigger objects on the first content object. Each trigger object can be set to be movable only within a designated area. As an example, the second trigger object may be set to be freely movable within the first area of the first content object, and the third trigger object may be set to be freely movable within the second area of the first content object. Accordingly, a second trigger area may exist within the first area of the output area of the first additional content, and a third trigger area may exist within the second area of the output area of the second additional content. The position and/or size of the first area and the second area may be adjusted by user settings. Alternatively, the location and/or size of the first area and the second area may be determined based on the priority of each additional content, output mode, location or type of the output area, etc.

A plurality of additional contents can also be linked to the trigger object displayed on the content object. When a plurality of additional contents are linked to one trigger object, the control unit 180 can set priorities among the plurality of additional contents. Priority can be used to determine the output order of additional content in viewer mode. The priority may be determined by user settings, or may be determined based on at least one of the order of insertion into the main content, the type, output mode, or size of additional content. As an example, the control unit 180 may determine the priority of additional content in the order in which it is inserted into the main content. That is, additional content inserted first into the main content may have a higher priority than additional content inserted into the main content later. Alternatively, considering the types of additional content, the first type of additional content may be set to have higher priority than the second type of additional content. Alternatively, among the additional contents, additional content with a full screen output mode may be set to have higher priority than additional content with a partial screen output mode, or additional content with a large output area may be set to have a higher priority than additional content with a small output area size. It can be set to have high priority. The determined priority may be changed by user settings. Multiple additional contents may be set to have the same ranking.

The settings of the trigger area and the settings of the additional content output area can be integrated into one. For example, a trigger area and an additional content output area may be set simultaneously based on a graphic object in which the functions of a trigger object or a content object are integrated into one. In this case, one set area can function as a trigger area and an output area for additional content.

Alternatively, depending on the content type, the process of setting the trigger area or additional content output area may be omitted. For example, when cut content is selected, setting of a trigger area or setting of an additional content output area may be omitted.

Figure 12 is a diagram showing an example of setting cut content as additional content.

When the cut content type is selected as additional content, the control unit 180 may enter a cut mode to cut out a portion of the main content.

In a state where the cut mode is entered, when a user input for selecting a part of the main content is received, the control unit 180 can cut the corresponding area and set the cut content as additional content.

Specifically, as in the example shown in (a) of FIG. 12, when a user input (e.g., drag input) for selecting a partial area of the main content is received, the control unit 180 cuts the corresponding area and then cuts the cut content. can be set as additional content (1240).

When additional content is set, at least one of the trigger area 1225 for the additional content or the output area 1235 of the additional content may be set by user input. To this end, the control unit 180 may output at least one of a trigger object 1220 for setting a trigger area or a content object 1230 for setting an output area of additional content to the display.

As another example, when setting the cut content as additional content 1240, at least one of the process of setting the trigger area 1225 or the process of setting the output area 1235 of the additional content may be omitted.

For example, if the face part 1210 of the person in the main content is cut out as in the example shown in (a) of FIG. 12, the control unit 180 cuts the , the cropped area (i.e., the face part of the person, 1210) can be set as the trigger area 1225. In this case, the output of the trigger object 1220 for setting the trigger area 1225 may be omitted.

Alternatively, initially, the cut area 1210 is set as the trigger area 1250, and when a user input requesting a change in the trigger area 1225 (e.g., an input that touches the cut area 1210) is received, the trigger By outputting the object 1230, the trigger area can be set to be freely adjustable by the user.

Alternatively, when setting the cut out area 1210 as additional content 1240, the cut out area 1210 may be set as the first trigger area, and a second trigger area may be additionally set based on the trigger object. In this case, both the first trigger area and the second trigger area may be associated with additional content 1240 set based on the cut area.

As another example, when setting the cut content as additional content 1240, the cut out area 1220 within the main content can be controlled to be set as the additional content output area 1235.

For example, if the face part 1210 of the person in the main content is cut out as in the example shown in (a) of FIG. 12, the control unit 180 cuts the , the cropped area (i.e., the face part of the person, 1210) can be set as the output area 1235 of additional content. In this case, output of the content object 1230 for setting the output area 1235 of additional content may be omitted.

Alternatively, initially, the cut out area 1210 is set as the output area 1235 of the additional content, and then a user input requesting a change in the output area 1235 of the additional content (e.g., an input that touches the cut out area 1210) When this is received, the content object 1230 can be output and the output area 1235 of the additional content can be set to be freely adjustable by the user.

Alternatively, the cut out area 1210 may be set as the output area of the second additional content, while the output area of the first additional content may be additionally set based on the content object 1230. In this case, in the viewer mode, in response to a user input for selecting the trigger area 1225, the additional content 1240 is output to at least one of the output area of the first additional content and/or the output area of the second content, or Additional content 1240 may be sequentially output to the output area of the first additional content and the output area of the second content.

As another example, when the cut out content is set as additional content 1240, the cut out area 1210 may be set to function as both the trigger area 1225 and the output area 1235 of the additional content.

When the cut out content is set as additional content 1240, the cut out area 1210 may be displayed in a blank state. Alternatively, at least one of a default/user-selected image, a default/user-selected character, a default/user-selected color, or an image visually processed in the cropped area may be output through the cropped area.

Figure 13 is a diagram illustrating the visual effect reflected in the part corresponding to the cut out area.

When part of the main content is cut out, the control unit 180 can set the cut out area 1310 as a blank area, as in the example shown in (a) of FIG. 13.

In another example, the control unit 180 may insert a default image into the cut out area 1320, as in the example shown in (a) of FIG. 13. For example, in (b) of FIG. 13, the image showing the outline of the face is illustrated as the default image.

As another example, the control unit 180 may insert a default character/string into the cut out area 1330, as shown in (c) of FIG. 13. As an example, in Figure 13(c), a question mark is illustrated as the default character.

Although not shown, the controller 180 may control the display of a single color or color pattern (eg, gradient, etc.) in the cut out area. At this time, the color to be displayed in the cut out area may be determined based on the background color surrounding the cut out area. For example, a gradient pattern created using the same color as the background color around the cut out area or background colors around the cut out area may be displayed in the cut out area.

Alternatively, you can apply a visual effect to the cropped area and display the generated image in the cropped area. Here, visual effects may include blur processing, mosaic processing, etc.

Depending on the type of the cut content, replacement content to be displayed in the cut out area can be adaptively set.

Figure 14 shows an example in which replacement content is set differently depending on the type of content that is cut out.

As in the example shown in (a) of FIG. 14, when a part of the image is cut out and additional content is set, a replacement image (e.g., a person's outline 1410) may be output in the cut out area.

On the other hand, as in the example shown in (b) of FIG. 14, when part of the character string is cut off and additional content is set, a replacement character (e.g., question mark, 1420) may be output in the cut area.

In the above example, the trigger area and the output area of the additional content are illustrated as being rectangular, but the present invention is not limited to this. You can set the trigger area and/or output area of additional content to a polygon or circle other than a square.

In addition, in the above-described example, it is exemplified that the trigger area and the output area of additional content are set through a graphic object, but the present invention is not limited to this. For example, the trigger area and/or the output area of additional content may be set without a medium such as a graphic object. For example, when a touch input for dragging a point in a predetermined direction is received, a rectangular area diagonal to the pointer's movement trajectory may be set as a trigger area and/or an output area for additional content. Alternatively, when a touch input in which two pointers touch the touch screen is received, a rectangular area with the two pointers as two vertices may be set as a trigger area and/or an output area for additional content.

Next, let's look at the operation of the terminal in viewer mode.

Figure 15 is a flowchart showing the operation of the terminal in viewer mode.

When the edit mode ends, the control unit 180 can switch the terminal to the viewer mode. In viewer mode, settings regarding the trigger area and output area of additional content can no longer be changed. To change the settings for the trigger area and output area of additional content, you must exit the viewer mode and re-enter the edit mode.

When the terminal switches to the viewer mode, the control unit 180 can set the trigger area and the output area of the additional content set in the initial editing mode to be invisible. That is, when the terminal switches from the edit mode to the viewer mode, the trigger area and the output area of the additional content, which were visually identified by the graphic object in the edit mode, may no longer be identified and displayed. Accordingly, when the edit mode is terminated and converted to the viewer mode, only the initial main content can be displayed on the display unit 160.

However, in order to prevent the user from misrecognizing the location of the trigger area, the control unit 180 may control the location of the trigger area to be identified and displayed when a predetermined user input is received.

Figure 16 is a diagram showing an example in which a trigger area is visually identified and displayed.

In the example shown in Figure 16, the dotted outline indicates the trigger area. The dotted outline may be a virtual line that is invisible to the user.

When a user input for visually identifying and displaying the trigger area 1610 is received, the control unit 180 may control the trigger area 1610 to be visually identified and displayed. Here, the user input may be touching a button requesting to visually identify and display the trigger area 1610, or may be a predefined type of touch input. A predefined touch input may mean that at least one of the number of pointers touching the main content, touch intensity, touch time, or number of touches is greater than or equal to a reference value.

For example, when a user input of double touching the main content is received, the control unit 180 creates the trigger area 1610 at the location of the trigger area 1610, as shown in (a) and (b) of FIG. 16. ) can be controlled to be identified and displayed. As an example, the control unit 180 may control the object 1620 for identifying the trigger area 1610 to be output on the trigger area 1610. The object 1620 may include at least one of a trigger object used to set the trigger area 1610, a pre-stored icon, or an image representing the outline of the trigger area.

At this time, in order to prevent the object 1620 identifying the trigger area from covering the main content, the control unit 180 may set the object 1620 to a semi-transparent state.

The control unit 180 may control the object 1620 to be output for a predetermined time, or may control the object 1620 to be output while blinking. Alternatively, the object 1620 can be controlled to be output while the user input is maintained. For example, while the pointer is touching the touch screen, the object 1620 may be output, and when the pointer's touch input is released, the output of the object 1620 may be stopped. Alternatively, when a user input requesting to stop output of the object 1620 is received, the control unit 180 may stop output of the object 1620.

Alternatively, depending on user settings in the edit mode, at least one of the trigger area or the additional content output area may be identified and displayed by default.

Alternatively, depending on the content type, it may be determined whether to identify and display the trigger area or the output area of the additional content.

For example, when additional content is created by cutting out part of the main content, a replacement image or replacement text is displayed in the cut out area. If the cut out area is selected at least one of the trigger area or the output area of the additional content, the location of the trigger area or the output area of the additional content can be identified through a replacement image or replacement text even if the identification object is not output. Accordingly, when the cut content is set as additional content, the output of an identification object for identifying the trigger area or the output area of the additional content can be omitted.

When a touch input touching the main content is received (S1510) and the location of the received touch input corresponds to the inside of the trigger area (S1520), the control unit 180 controls the output of additional content associated with the trigger area. You can. At this time, depending on the output mode of the additional content, the control unit 180 can output the additional content in full screen or partial screen (S1530, S1540, S1550). Here, the partial screen may correspond to the output area of additional content set in edit mode. When the additional content is displayed as a partial screen, the additional content may be displayed as an overlay on part of the main content.

Figure 17 is a diagram illustrating an example in which additional content is output in response to a user input touching a trigger area.

For convenience of explanation, it is assumed that two trigger areas are inserted into the main content, and the location and size of each trigger area are assumed to follow the example shown in (a) of FIG. 17. In addition, it is assumed that the additional content linked to the first trigger area 1710 is the first image 1715, and the additional content linked to the second trigger area 1720 is the second image 1725.

When a user input that touches the main content is received, and the location of the received touch input corresponds to the inside of the trigger area, the control unit 180 can control the output of additional content linked to the trigger area selected by the touch input. there is. For example, when the location of the touch input is inside the first trigger area 1710, the control unit 180 may control the first image 1715 associated with the first trigger area 1710 to be output. At this time, when the output mode of the additional content linked to the first trigger area 1710 is full screen, the control unit 180 displays the first image 1715 in response to a user input touching the first trigger area 1710. You can control it to be displayed in full screen.

On the other hand, when the location of the touch input is inside the second trigger area 1720, the control unit 180 can control the second image 1725 linked to the second trigger area 1720 to be output. At this time, when the output mode of the additional content linked to the second trigger area 1720 is a partial screen, the control unit 180 displays the second image 1725 in response to a user input touching the second trigger area 1720. ) can be controlled to be displayed on a partial screen. Specifically, the control unit 180 may control the second image 1725 to be output through the output area of the additional content set in the edit mode.

If the additional content linked to the trigger area is a multimedia file output through playback, such as a video or music, the control unit 180 provides a device for playing additional content, such as a video or music, in response to a user input that touches the trigger area. You can control the multimedia player to display in full screen or partial screen. Users can control the playback of additional content such as videos or music through the multimedia player.

However, when the additional content is output, the content of the main content is obscured, so the control unit 180 outputs the additional content in a semi-transparent state or, when a predetermined time has elapsed since the additional content was output, the additional content in a semi-transparent state. You can also control it to switch.

When the output mode of the additional content is partial screen, the control unit 180 can set the size of the additional content according to the size of the output area of the additional content. At this time, if the width of the additional content is greater than the height, but the output area of the additional content is set to have a width smaller than the height, the additional content output through the output area of the additional content may be significantly distorted. To solve the above problem, the control unit 180 may rotate and output the additional content by considering the width and height ratio of the additional content and the width and height ratio of the output area of the additional content. For example, if the width of the additional content is less than the height, but the width of the output area of the additional content is greater than the height, and/or if the width of the additional content is greater than the height, but the width of the output area of the additional content is smaller than the height. In , the control unit 180 may rotate and output additional content.

Figure 18 is a diagram showing an example in which additional content is rotated and output.

As in the example shown in (a) of FIG. 18, when the additional content 1830 associated with the trigger area 1810 is an image whose width is larger than the height, and the output area of the additional content has a width smaller than the height, the control unit 180 may output additional content 1830 rotated by 90 degrees through the additional content output area 1820 in response to a user input touching the trigger area 1810. At this time, the rotation direction (eg, clockwise or counterclockwise) of the additional content may be determined by the user's settings under the edit mode.

Even when additional content is created by cutting out at least a portion of the main content, the additional content may be output in response to a user input that touches the trigger area.

Figure 19 shows an example in which the cut content is set as additional content.

For convenience of explanation, it is assumed that both the trigger area and the additional content output area are the same as the cut area 1910.

As in the example shown in (a) and (b) of FIGS. 19, when a user input that touches the cut area (i.e., trigger area, 1910) is received, the control unit 180 operates through the cut area (1910). It is possible to omit the output of the alternative content and control the output of the additional content 1920 and 1930.

Figure 19 (a) is an example of creating additional content 1920 by cutting out a portion of the image, and Figure 19 (b) is an example of creating additional content 1930 by cutting out part of a string. This is an example.

When a plurality of additional content output areas are set, additional content can be output simultaneously to the plurality of additional content output areas, or additional content can be output sequentially to the plurality of additional content output areas.

Figure 20 shows an example in which output areas for a plurality of additional contents are set.

For convenience of explanation, it is assumed that output areas for two additional contents are set on the main content. Among these, the output area 2020 of the first additional content is assumed to be set in a different position from the cut out area 2010, and the output area 2025 of the second additional content is assumed to be the same as the cut out area 2010. Additionally, it is assumed that the cut out area 2010 also functions as a trigger area 2015.

When the user's touch input is inside the trigger area 2015, the control unit 180 displays the output area 2020 of the first additional content and the second additional content, as in the example shown in (a) of FIG. 20. Additional content 2040 can be controlled to be output in the output area of content 2025.

As another example, when the user's input is inside the trigger area 2015, the control unit 180 displays the output area 2020 of the first additional content, as in the example shown in (b) of FIG. 20. First, additional content 2030 can be controlled to be output.

Thereafter, when a predetermined condition is satisfied, the output of the additional content 2030 that was output through the first additional content output area 2020 is terminated, and the additional content 2030 is displayed through the second additional content output area 2025. You can control it to be output. That is, the additional content 2030 can be controlled to be sequentially output to each of the first additional content output area 2020 and the second additional content output area 2025.

Here, the predetermined condition is when a predetermined time has elapsed or when additional content is being output through the first content output area 2020, a user input (e.g., additional It may include at least one of the cases where a user input touching the content 2030 is received. The predetermined time may be adjusted according to the user's settings in edit mode.

While additional content is being output, if a touch input is received and the location of the touch input is inside the trigger area or the output area of the additional content, the control unit 180 may stop output of the additional content (S1560, S1570) , S1580). That is, after the additional content is output, if a user input that touches the trigger area or the additional content is received, the output of the additional content that was overlaid on the main content may be terminated.

Figure 21 is a diagram illustrating an example in which output of additional content ends.

Figure 21 (a) is a diagram showing a trigger area 2110 and an output area 2120 of additional content.

If a touch input is received while the additional content is being output, and the touch location is inside the trigger area 2110, the control unit 180 ends the output of the additional content, as in the example shown in (b) of FIG. 21. can do. Although not shown, when a touch input that touches additional content overlaid on the main content is received, output of the additional content may be terminated.

If a predetermined condition is satisfied, the control unit 180 may end output of the additional content.

As an example, the control unit 180 may end output of the additional content when a preset time has elapsed since the additional content was output. Here, the preset time can be adjusted by user settings in edit mode.

As an example, when the first additional content associated with the first trigger area is being output and a user input for selecting the second trigger region associated with the second additional content is received, the control unit 180 selects the first additional content It is also possible to control the output of the content to be stopped and the second additional content to be output.

Alternatively, when a user input of flicking a pointer touching the additional content is received, the control unit 180 may end output of the additional content.

In the above example, it was explained that the output of the additional content is terminated in response to a user input that touches the trigger area or the output area of the additional content, but in response to the user input that touches the trigger area or the output area of the additional content You can also change settings related to output of additional content. Here, the output-related settings may include at least one of size adjustment (e.g., zoom in/out) of the additional content, transparency adjustment of the additional content, or playback control (e.g., play, pause, stop) of the additional content.

For example, when a first type of touch input that touches the trigger area or the output area of the additional content is received, output of the additional content is set to end, while a second type of touch input touches the trigger area or the output area of the additional content. When touch input is received, settings related to output of additional content can be adjusted. For example, when a second type of touch input that touches the trigger area or the output area of the additional content is received, the additional content that is overlaid and output on the main content is displayed enlarged or reduced, or the transparency of the additional content that is overlaid and output on the main content is changed. It can be adjusted. Here, the first type and the second type of touch input may be different in at least one of the number of pointers, touch intensity (touch pressure), touch time, or number of touches.

Alternatively, output of the additional content may be terminated in response to a user input that touches the trigger area, while settings related to output of the additional content may be changed in response to a user input that touches the output area of the additional content. For example, when a user input that touches the output area of the additional content is received, the additional content displayed as an overlay on the main content may be enlarged or reduced, or the transparency of the additional content displayed as an overlay on the main content may be adjusted.

When a plurality of trigger areas are associated with one additional content, each of the plurality of trigger areas can be used to control the output and termination of the additional content. For example, when two trigger areas are linked to one additional content, output of the additional content may be started or stopped by a user input that touches the first trigger area, or a user input that touches the second trigger area. Output of additional content may be started or stopped by .

Alternatively, when a plurality of trigger areas are linked to one additional content, different functions may be assigned to each of the plurality of trigger areas. For example, when two trigger areas are linked to one additional content, the start of output of the additional content is performed in response to receiving a user input that touches the first trigger area, while the end of output of the additional content is performed. This may be performed in response to receiving a user input that touches the second trigger area.

Alternatively, at least one of the plurality of trigger areas can be used to start or end output of additional content, while the remaining trigger areas can be used to change settings related to output of additional content. For example, when two trigger areas are linked to one additional content, a user input that touches the first trigger area must be received to start or end output of the additional content, while setting related to output of the additional content must be received. In order to change, a user input touching the second trigger area may need to be received.

When an overlapped area exists between a plurality of trigger areas and a user input of touching the overlapping area of the plurality of trigger areas is received, the control unit 180 selects the plurality of trigger areas based on the priority or touch type between the trigger areas. You can choose any one of them.

Figure 22 is a diagram showing the operation of the terminal when a user input touching an area where multiple trigger areas overlap is received.

As in the example shown in (a) of FIG. 22, part of the first trigger area 2210 and the second trigger area 2220 overlap, and the first trigger area 2210 and the second trigger area ( It is assumed that the first additional content 2215 and the second additional content 2225 are linked to 2220, respectively.

When a touch input that touches the overlapping portion of the first trigger area 2210 and the second trigger area 2220 is received, the control unit 180 selects one of the first trigger area 2210 and the second trigger area 2220. You can select the trigger area with the highest priority. For example, when the priority of the first trigger area 2210 is higher than that of the second trigger area 2220, the control unit 180 controls the first trigger area 2210 and the second trigger area 2220 to overlap. It may be determined that the first trigger area 2210 is selected by a user input that touches the part that is selected. Accordingly, as in the example shown in (b) of FIG. 22, the first additional content 2215 associated with the first trigger area 2210 may be output. While the first additional content 2215 is being output, when a user input that touches the overlapping portion of the first trigger area 2210 and the second trigger area 2220 is received, the control unit 180 It may be determined that the first trigger area 2210, which has a higher priority than the trigger area 2220, is selected. Accordingly, as in the example shown in (c) of FIG. 22, output of the first additional content 2215 may be terminated.

Priority between trigger areas can be determined by user settings in edit mode. Alternatively, it may be determined based on at least one of the order in which trigger areas are set in the edit mode, the type, output mode, or size of additional content associated with each trigger area.

When output of additional content linked to one of a plurality of trigger areas starts and/or ends, the priority of the trigger area linked to the additional content may be changed to the lowest priority. For example, in the example shown in FIG. 22, when the output of the first additional content 2215 associated with the first trigger area 2210 is terminated, the control unit changes the priority of the first trigger area 2210 to second. It can be set to be lower than the priority of the trigger area 2220. Accordingly, when a user input that touches the overlapping portion of the first trigger area 2210 and the second trigger area 2220 is received, the control unit 180 determines that the second trigger area 2220 is selected, As in the example shown in (d) of FIG. 22, output of the second additional content 2225 associated with the second trigger area 2220 can be controlled to start.

As another example, when a user input that touches the overlapping portion of the first trigger area 2210 and the second trigger area 2220 is received while the first additional content 2215 is being output, the control unit 180 It is possible to control the output of the second additional content 2225 to start at the same time that the output of the first additional content 2215 ends.

In the example shown in FIG. 22, when a user input that touches a part where multiple trigger areas overlap is received, one of the multiple trigger areas is selected according to the priority between trigger areas. However, depending on the type of touch input, one of the multiple trigger areas is selected. Accordingly, it can be set to select any one of multiple trigger areas. As an example, when a first type of touch input is received in a portion where the first trigger area and a second trigger area overlap, the first trigger area is determined to be selected, whereas when a second type of touch input is received, the second trigger area is determined to be selected. It may be determined that the trigger area is selected. Here, the first type and the second type of touch input may be different in at least one of the number of pointers, touch intensity (touch pressure), touch time, or number of touches.

As another example, when a user input that touches a portion where multiple trigger areas overlap is received, it may be determined that the multiple trigger areas are selected simultaneously. For example, when a user input that touches a portion where the first trigger area and the second trigger area overlap is received, the control unit 180 may select both the first trigger area and the second trigger area. Accordingly, output of the second additional content linked to the first trigger area may start or end at the same time that the output of the first additional content linked to the first trigger area starts or ends.

When a plurality of additional contents are associated with one trigger area, the control unit 180 may output a list of additional contents associated with the trigger area in response to a user input that touches the trigger area. When one of the additional content lists is selected, the control unit 180 can control the selected additional content to be output.

Figures 23 and 24 are diagrams illustrating an example in which an additional content list is output in response to a user input that touches the trigger area.

As in the example shown in (a) of FIG. 23, it is assumed that the first additional content 2315 and the second additional content 2325 are linked to the trigger area 2310.

When a touch input touching the trigger area 2310 is received, the control unit 180 may output a list 2330 of additional contents linked to the tree area. The list 2330 may be configured to include representative images of each additional content. Here, the representative image may include at least one of a thumbnail or a preview image.

When an item is selected from the additional content list 2330, the control unit 180 may output additional content corresponding to the selected item. For example, when the first additional content item 2332 is selected from the additional content list 2330, the first additional content 2315 may be output. (See (c) in Figure 23)

If a user input of touching the trigger area 2310 is received while at least one additional content is being displayed, the control unit 180 may output the additional content list 2330 again.

If an additional content item that is already in an output state is selected from the re-output additional content list 2330, the control unit 180 may end output of the additional content. For example, when the first additional content item 2332 is selected from the additional content list 2330, output of the first additional content 2315 may be stopped. (See (b) in Figure 23)

When an additional content item that is different from additional content that is already in an output state is selected from the re-output additional content list 2330, the control unit 180 may additionally output the selected additional content. For example, when the second additional content item 2334 is selected from the additional content list 2330, the second additional content 2325 may be additionally output. (See (c) in Figure 24)

As another example, when an additional content item different from the additional content already in output is selected from the re-output additional content list 2330, the control unit 180 stops outputting the additional content already in output and outputs the selected additional content. can do. For example, when the second additional content item 2334 is selected from the additional content list 2330 while the first additional content is being output, the second additional content 2325 is displayed while ending the output of the first additional content 2315. Can be printed.

As another example, the list of additional content to be re-displayed can be set to not include additional content items that are already being displayed. For example, when a touch input that touches the trigger area is received while the first additional content is being displayed, an additional content list excluding the first additional content item may be output.

As another example, when a plurality of additional content is linked to one trigger area, the control unit 180 may start or end output of the high-priority additional content in response to a user input that touches the trigger area.

Figure 25 is a diagram showing the operation of the terminal when a user input that touches a trigger area linked to a plurality of additional contents is received.

As in the example shown in (a) of FIG. 25, it is assumed that the first additional content 2515 and the second additional content 2525 are linked to the trigger area 2510.

When a touch input touching the trigger area 2510 is received, the control unit 180 outputs the additional content with the highest priority among the first additional content 2515 and the second additional content 2525 linked to the tree area. It can be controlled as much as possible. For example, when the priority of the first additional content 2515 is higher than the priority of the second additional content 2525, the control unit 180 creates a trigger area (as shown in (b) of FIG. 25). First additional content 2515 may be output in response to a user input touching 2510). When a touch input that touches the trigger area 2510 is received while the first additional content 2515 is being output, the control unit 180 generates the first additional content, as in the example shown in (c) of FIG. 25. Output of content 2515 may be terminated.

Priority between additional content may be determined by user settings in edit mode. Alternatively, in the edit mode, the additional content may be determined based on at least one of the order in which the additional content is inserted into the main content, the type, output mode, or size of the additional content.

When the output of the additional content that was already being output ends, the priority of the additional content may be changed to the lowest priority. For example, in the example shown in FIG. 25, when the output of the first additional content 2515 ends, the priority of the first additional content 2515 is set to be lower than the priority of the second additional content 2525. You can. Accordingly, when a user input that touches the trigger area 2510 is received, the control unit 180 controls the output of the second additional content 2525 to start, as in the example shown in (d) of FIG. 25. can do.

As another example, when a user input that touches the trigger area 2510 is received while the first additional content 2515 is being output, the control unit 180 terminates the output of the first additional content 2515 and simultaneously 2 The output of additional content 2525 can be controlled to start.

As another example, when a user input that touches the trigger area 2510 is received while the first additional content 2515 is being output, the control unit 180 maintains the output of the first additional content 2515 and 2 The output of additional content 2525 can be controlled to start. When a user input that touches the trigger area 2510 is received while all additional content associated with the trigger area 2510 is being output, the control unit 180 outputs all additional content associated with the trigger area 2510. can be terminated.

The priorities of the plurality of additional contents may be the same. For example, when the first additional content and the second additional content have the same priority, the control unit 180 starts or stops output of the first additional content and simultaneously outputs the second additional content in response to a user input that touches the trigger area. You can start or stop outputting content.

As in the example shown, the additional content list may include an object corresponding to each additional content. The number of output objects may be equal to the number of additional content linked to the trigger object. The object may be an image representing each additional content or an image representing the type of each additional content.

Multiple objects may be arranged in a row along a vertical or horizontal direction. Alternatively, a plurality of objects may be distributed and disposed near the border of the trigger area. As an example, the first object may be placed adjacent to the first border of the trigger area, and the second object may be placed adjacent to the second border of the trigger area.

Depending on the number of times the trigger area is touched, additional content to be output in response to a touch input touching the trigger area can be selected. For example, when a touch input for touching the additional content once is received, the first additional content can be output, and when a touch input for touching the additional content twice is received, the second additional content can be output. . That is, a touch input that touches the trigger area N times can function as calling the Nth additional content. At this time, the order of additional content may be determined based on the priority of the additional content. When at least a partial area of the additional content is set as a trigger area, the trigger area can be activated only when the additional content is being displayed on the main content. While additional content is being output, when a touch input that touches a trigger area corresponding to at least a portion of the additional content is received, the control unit 180 outputs additional content linked to the trigger area in response to the user input. can do.

Figure 26 shows an example in which other additional content is output in response to a user input that touches additional content. For convenience of explanation, the additional content whose output starts or ends by the first trigger area 1810 is called the first additional content, and is output by the second trigger area corresponding to at least a partial area of the first additional content. This additional content that starts or ends will be referred to as second additional content.

When a user input that touches the first trigger area 2610 is received, the control unit 180 generates the first additional content linked to the first trigger area 1810, as in the example shown in (a) of FIG. 26. (2620) can be controlled to be output.

When the first additional content 2620 is output, the second trigger area 2630 set on the first additional content 2620 may be switched to an activated state. In a state in which the second trigger area 2630 is activated, when a touch input touching the second trigger area 2630 (i.e., at least a partial area of the first additional content) is received, the control unit 180 generates the second trigger The second additional content 2640 associated with the area 2630 can be controlled to be output. (See (b) of FIG. 26) At this time, the second additional content 2640 may be output as a full screen or a partial screen depending on the output mode of the second additional content 2640 set in the edit mode. When the second additional content 2640 is set to be output as a partial screen, the output location and/or size of the second additional content 2640 is the location and/or the output area of the second additional content 2640 set in the edit mode. It can be determined by size.

As another example, when the output area of the second additional content 2640 is set to be the same as the output area of the first additional content 2620, the second additional content 2640 may be overlaid and output on the first additional content 2620. It may be possible.

The control unit 180 may determine whether to output the second additional content 2640 according to the type of touch input for the first additional content 2620. For example, when a first type of touch input is input to the second trigger area 2630 on the first additional content 2620, the second additional content 2640 may be output in response to the touch input. On the other hand, when a second type of touch input is input to the second trigger area 2630 on the first additional content 2620, output of the first additional content 2620 is terminated in response to the touch input, or Output-related settings for the first additional content 2620 can be changed. Here, the first type and the second type of touch input may be different in at least one of the number of pointers, touch intensity (touch pressure), touch time, or number of touches.

The control unit 180 may stop outputting the second additional content 2640 in response to a user input that touches the second trigger area 2630 or the second additional content 2640.

Alternatively, the control unit 180 may stop outputting both the first additional content 2620 and the second additional content 2640 in response to a user input that stops output of the first additional content 2620. The user input that stops output of the first additional content 1820 is at least one of touching the first trigger area 2610 or the remaining area excluding the second trigger area 2630 on the first additional content 2620. It can be included.

A plurality of trigger areas may be set on the first additional content. At this time, the location of each trigger area may be different. Alternatively, the entire area of the first additional content can be set as the trigger area.

When a trigger area for a plurality of additional contents is set on the first additional content, the control unit 180 may determine the additional content to be output according to the location of the touch input or the type of the touch input that touches the first additional content. For example, when a touch input touching the first area of the first additional content is received, the second additional content is output, while when a touch input touching the second area of the first additional content is received, the third additional content is output. You can control the output of additional content. Alternatively, when a first type of touch input is received for the first additional content, the second additional content is set to be output, while when a second type of touch input is received for the first additional content, the third additional content is set to be output. You can set the content to be output.

Alternatively, the control unit 180 may select additional content to be output based on the priority among a plurality of additional content. For example, when a touch input for touching the first additional content is received, the controller 180 may control the output of the additional content with the highest priority among a plurality of additional content associated with the first additional content. For example, when the priority of the second additional content is higher than that of the third additional content, the second additional content may be output in response to a touch input that touches the first additional content.

When the output of the additional content associated with the first additional content ends, the priority of the additional content may be changed to the lowest priority. For example, when the output of the second additional content ends, the priority of the second additional content may be changed to a lower priority than the priority of the third additional content. Accordingly, when a touch input for touching the first additional content is received again, the third additional content, not the second additional content, may be output.

While additional content is being output, if a user input for the additional content is received, the control unit 180 may change the output position and/or size of the additional content in response to the user input. That is, even under the viewer mode, the position and/or size of the additional content being output can be freely changed.

Figure 27 is a diagram showing an example in which the output location and size of additional content are changed.

As in the example shown in (a) of FIG. 27, when a user input that the pointer touching the edge of the additional content 2710 is dragged in a predetermined direction is received, the control unit 180 responds to the user input. , the size of the additional content 2710 being output can be changed.

Alternatively, as in the example shown in (b) of FIG. 27, when a user input that causes the pointer touching the additional content 2710 to be dragged in a predetermined direction is received, the control unit 180 responds to the user input. The location of the additional content 2710 being output can be changed.

When a predetermined user input is received while the position and/or size of the additional content is changed, the control unit 180 adjusts the position and/or size of the additional content to match the position and/or size of the original additional content output area. You can. Here, the predetermined user input may be touching an output area or trigger area of additional content, or may be a predefined type of touch input. The predefined form may be one in which at least one of the number of pointers, touch intensity (touch pressure), touch time, or number of touches is greater than or equal to a reference value.

Even if the location and/or size of the additional content changes, the location and/or size of the additional content output area may remain the same as that set in the edit mode. Accordingly, when a user input that touches the trigger area is received while the location and/or size of the additional content has changed, the output of the additional content whose location and/or size has changed is terminated, and then the trigger area is touched again. When a user input is received, the additional content may be output according to the original additional content output area.

Alternatively, the position and/or size of the additional content output area may be changed according to the changed position and/or changed size of the additional content. However, the above changes may remain effective until the event occurs. The event may include at least one of ending the viewer mode, changing the slide page, or ending the file. The location and/or size of the additional content output area may be determined depending on the settings in the edit mode.

Contents that have been edited under edit mode can be saved as a single file. That is, the main content to which the trigger area, additional content output area, and/or additional content has been added can be saved in a predefined file format.

Depending on the type of additional content, it may be determined whether the position and size of the additional content can be adjusted in the viewer mode.

For example, if content created by cutting out part of the main content is set as additional content, the position and/or size of the additional content may not be adjusted in the viewer mode.

Alternatively, in viewer mode, if the additional content is output through an area other than the cropped area, the position and/or size of the additional content is set to be adjustable, while if the additional content is output through the cropped area, the additional content is set to be adjustable. The position and/or size of the content may be set to no longer be adjustable. Exemplary methods of the present disclosure are expressed as a series of operations for clarity of description, but this is not intended to limit the order in which steps are performed. If necessary, each step may be performed simultaneously or in a different order. In order to implement the method according to the present disclosure, other steps may be included in addition to the exemplified steps, some steps may be excluded and the remaining steps may be included, or some steps may be excluded and additional other steps may be included.

The various embodiments of the present disclosure do not list all possible combinations but are intended to explain representative aspects of the present disclosure, and matters described in the various embodiments may be applied independently or in combination of two or more.

Additionally, various embodiments of the present disclosure may be implemented by hardware, firmware, software, or a combination thereof. For hardware implementation, one or more ASICs (Application Specific Integrated Circuits), DSPs (Digital Signal Processors), DSPDs (Digital Signal Processing Devices), PLDs (Programmable Logic Devices), FPGAs (Field Programmable Gate Arrays), general purpose It can be implemented by a processor (general processor), controller, microcontroller, microprocessor, etc.

The scope of the present disclosure is software or machine-executable instructions (e.g., operating system, application, firmware, program, etc.) that cause operations according to the methods of various embodiments to be executed on a device or computer, and such software or It includes non-transitory computer-readable medium in which instructions, etc. are stored and can be executed on a device or computer.

110: Department of Communications
120: camera
130: microphone
140: user input unit
150: display unit
160: sound output unit
170: memory
180: control unit

Claims (14)

a display that displays information;
a user input unit that receives user input; and
Outputting main content on the touch screen, setting a trigger area associated with additional content on the main content,
When the editing mode that allows setting of the trigger area is terminated and the viewer mode is executed, a control unit that controls the additional content associated with the trigger area to be output in response to a touch input touching the trigger area, ,
The terminal, characterized in that the additional content is created by cutting out part of the main content. According to claim 1,
A terminal, characterized in that replacement data replacing the original data is output in the cut out area on the main content. According to clause 2,
The terminal, characterized in that the replacement data is set differently depending on the type of the additional content. According to clause 3,
If the additional content is image data created by capturing part of the main content, the replacement data is a default image,
When the additional content is character data obtained by cutting off some character strings in the main content, the replacement data is a default character or character string. According to claim 1,
When the additional content is created by cutting out a part of the main content, the trigger area is set to the cut out area of the main content. According to claim 1,
When the additional content is created by cutting out a part of the main content, the additional content is output to the cut out area of the main content in response to the touch input touching the trigger area. According to claim 1,
When the additional content is created by cutting out a part of the main content, in response to the touch input touching the trigger area, the additional content is output at a location different from the cut area of the main content, and then at the different location. When output of the additional content is completed, the additional content is output in the cut out area. Setting a trigger area on the main content; and
When the editing mode that allows settings for the trigger area and additional content is terminated and the viewer mode is executed, in response to a touch input touching the trigger area on the main content, outputting additional content associated with the trigger area Includes steps,
A method of controlling a terminal, characterized in that the additional content is created by cutting out part of the main content. According to clause 8,
A method of controlling a terminal, characterized in that replacement data replacing the original data is output in the cut out area on the main content. According to clause 9,
The replacement data is set differently depending on the type of the additional content. According to claim 10,
If the additional content is image data created by capturing part of the main content, the replacement data is a default image,
When the additional content is character data obtained by cutting off some character strings in the main content, the replacement data is a default character or character string. According to clause 8,
When the additional content is created by cutting out a part of the main content, the trigger area is set to the cut out area of the main content. According to clause 8,
When the additional content is created by cutting out a part of the main content, the additional content is output to the cut out area of the main content in response to the touch input touching the trigger area. Control method. According to clause 8,
When the additional content is created by cutting out a part of the main content, in response to the touch input touching the trigger area, the additional content is output at a location different from the cut area of the main content, and then at the different location. A control method of a terminal, characterized in that when output of the additional content is completed, the additional content is output in the cut out area.

Images