KR20140047941A

KR20140047941A - Apparatus and method for processing note information in portable device

Info

Publication number: KR20140047941A
Application number: KR1020120114323A
Authority: KR
Inventors: 김경민; 이채경; 한경훈; 신영선
Original assignee: 삼성전자주식회사
Priority date: 2012-10-15
Filing date: 2012-10-15
Publication date: 2014-04-23

Abstract

A method of processing a content viewer application of a mobile terminal includes displaying a content viewer application and a note application item, calling a note application when selecting a note application item, overlaying and displaying a portion of the content viewer application screen on the content viewer application, and a content viewer. And the information selected by the application and / or the information created by the note application are processed as note information of the corresponding content viewer.

Description

APPARATUS AND METHOD FOR PROCESSING NOTE INFORMATION IN PORTABLE DEVICE}

The present invention relates to an information processing apparatus and method of a mobile terminal, and more particularly, to an apparatus and method for processing note information of an application for displaying content.

When the mobile terminal executes one application, the portable terminal may use a sub-application of an additional function for executing the corresponding application. In this case, conventionally, the main application is a method of performing an additional function by calling an application of the additional function. That is, if there is an additional function required in addition to the main application, the method is included in the main application. However, this method cannot be handled by interworking with the application of the additional function. For example, when a specific word of content is selected and a dictionary of an additional function is selected while executing a content viewer application, the mobile terminal may show a result of pre-searching the selected word in the content. However, as described above, however, the word information of the searched dictionary cannot be stored in association with the content. Therefore, if a user wants to search for the word in the corresponding content in the future, the user must run the dictionary application to search for the word.

In the following description, it is assumed that the main content is an eBook. In this case, in the conventional technology, a user collects an object such as Image / Gallery / 3D / Video included in the corresponding content while viewing a content viewer application (for example, an eBook), and manages information by using an analog method or an actual notebook in an analog manner. Or there was no function that acts like a driving range, and thus, there was no way to collect information only for the user when the purpose of viewing the content was education or securing the content, or it was extremely limited. That is, the user could not copy the specific information (text and / or the inserted image) of the content while viewing the content, and could not store it in his or her own information collection space. In addition, conventionally, if you want to copy specific information of the content and store it in a specific space, you have to try multi tasking, which must run and paste the application of the add-on again, and try to paste the multi tasking. Even if the contents viewer application and the sub-application of the additional function could not be interlocked, it could not be remembered that the contents were noted in the page of a specific eBook, and there was no interaction between them.

The present invention proposes an apparatus and method for interworking an application of an additional function to a main application running in a mobile terminal. In particular, the present invention proposes an apparatus and method for integrating a note function to a content or page information selected by a user by interworking a note application to a content viewer application in a mobile terminal.

Here, when the content viewer application is an eBook application, in the present invention, a user can open a specific eBook and put the contents of the eBook in a user's own note through a Note application belonging to the eBook, or take notes in association with the eBook by text / pen drawing. Provide the function. In addition, one note that matches each eBook file is provided, so you can easily call the note through the toolkit while viewing the eBook, and the worked note can be linked with the S-Note App to save edits / added reflections in both directions at the same time. . And when a user views a note created through an ebook in S-Note, when the user taps the tagged ebook page in the ebook, the ebook automatically opens and can be checked immediately.

The method of processing a content viewer application of a mobile terminal according to an embodiment of the present invention may include displaying a content viewer application and a note application item, and calling the note application when selecting the note application item to display a partial region of the content viewer application screen. And overlaying on the display and processing information selected by the content viewer application and / or information created by the note application as note information of the corresponding content viewer.

In addition, the application processing apparatus of the mobile terminal according to an embodiment of the present invention, the content viewer application and the sub-application set corresponding to the content viewer application, the sub-application set is a memory including a note application, and the content viewer application And a display unit for displaying items of a corresponding sub-application set, an input unit for selecting the note application item and note information, and controlling the display unit when selecting the note application item in the content viewer application. The note application is overlaid and displayed on a portion of the area, and the information selected by the content viewer application and / or the information created by the note application is displayed. It characterized by consisting of a borohydride to the process control.

The mobile terminal according to an embodiment of the present invention may process and manage note information of a content according to a user's selection together with the content by interworking a note application of an additional function while executing a content viewer application. It is assumed here that the content viewer application is an eBook.

In this case, when the user first moves the contents of the book while viewing the eBook or directly inputs specific contents, the mobile terminal can easily generate the note information by calling a note application which is a toolkit in the eBook. In addition, the mobile terminal can add content inserted as an object into an ebook directly to the note, and the inserted content into the toolkit note can form a note related to the book by memorizing the pages of the ebook that were opened at the time of the note. In addition, the contents of the Toolkit Note can be expanded in various ways by Note Page and Chapter in the My Page menu screen of the eBook. Note that the note in the eBook is automatically added to the S-Note App. You can connect and run it without running additional apps. In addition, note contents entered through the Calculator, Map, Web, Dictionary Toolkit provided in addition to the Note Toolkit are directly applied to the S-Note App. When the eBook Note is opened in S-Note, the Calculator, Map, Web, Dictionary App is not executed. You can see the information you collected without having to worry about it.

1 is a view showing the configuration of a portable terminal according to an embodiment of the present invention;
2 is a diagram illustrating a configuration example of a sub-application set (tool kit set) in a mobile terminal according to an embodiment of the present invention.
3A and 3C are diagrams for describing an interlocking operation between a main application and a sub application in a mobile terminal according to an embodiment of the present invention.
4 is a diagram illustrating a linking procedure between a content viewer application and a note application in a mobile terminal according to an embodiment of the present invention.
5A and 5D are diagrams for explaining an interworking procedure between an ebook application and a note application while performing the same procedure as in FIG.
6 is a flowchart illustrating an interlocking operation between an ebook application and a note application in FIG. 4.
FIG. 7 is a flowchart illustrating a procedure of calling and activating a note application in an ebook application of FIG. 6. FIG.
8 is a flowchart illustrating a procedure of performing an input mode in a note application of FIG. 6.
9A to 9E are diagrams illustrating screen examples of the display unit 130 displayed when the procedure of FIGS. 6 to 8 is performed.
10 is a flowchart illustrating a procedure of confirming note information in a mobile terminal according to an embodiment of the present invention.
11A and 11B illustrate an example of confirming note information by the same procedure as in FIG. 10.
12 is a flowchart illustrating a procedure of confirming note information of an ebook application according to an embodiment of the present invention.
FIG. 13 is a diagram showing an example of displaying note information confirmed by the same procedure as in FIG. 12; FIG.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. It should be noted that the same configurations of the drawings denote the same reference numerals as possible whenever possible.

The present invention provides a tool kit frame of sub-applications of an additional function performed in a main application, displays sub-applications available when the main application is executed as an item, and a sub-application of a corresponding additional function when a user selects an item. To display the overlay on the main application screen. That is, when the user executes the main application to perform the main task, the portable terminal according to the embodiment of the present invention displays the main application in the entire screen area and the sub-application of the additional function that can be used in the main application. Display items at a specific location in the screen area. In this case, the user of the mobile terminal can call or drag a sub application item (which can be configured as a tab-shaped button) displayed at a specific position on the screen to call a sub application (sub task). This sub-application (hereinafter referred to as Toolkit) is displayed in the form of an overlay on the main application.

The main application may be a content viewer application. In this case, in the embodiment of the present invention, the portable terminal may process the content viewer application which is the main application and the sub application of the additional function. The content viewer application may be an eBook, a docoument (word, image, etc.), an image (video and / or still image), the Internet, or the like. The eBook may include readers hub, learning hub, and smart school applications. In the following description, it is assumed that the content viewer application is an eBook application.

The present invention displays a sub-application called in a partial area of the screen of the main application when the sub-application of the additional function is called in the main application, and the main application and the called sub-application are linked to process additional information on the selected content of the main application. can do. Here, the processing may store information generated in association with the content of the main application in the My Information area (hereinafter referred to as my page) together with the information of the Main Application and / or store the note information area (hereinafter referred to as S-note). have. The additional information may be text, image, drawing, and / or meter information, and the additional information may be information added to the content of the main application or the content of the main application. The application of the additional function may be a note application, a map application, a dictionary application, a web browser application, a calculator application, or the like. In the embodiment of the present invention, it is assumed that the application of the additional function is a note application. In addition, in the embodiment of the present invention will be used as the terms of the application, sub-application and toolkit of additional functions.

For example, an embodiment of the present invention displays a note toolkit in a portion of an eBook screen by calling a Note Toolkit from an eBook application supported by a mobile terminal. In addition, when contents (or objects) included in the eBook are selected (for example, drag and drop), or various interactions such as text input, eBook Pen Drawing, or Note Pen Drawing are generated through the Note Toolkit, the present invention is implemented. According to an exemplary embodiment, a mobile terminal smartly links eBook and Note Toolkit information to automatically link eBook specific pages and note information.

In an embodiment of the present invention, when a user opens an ebook and calls a Note Toolkit belonging to the eBook, the mobile terminal stores the contents of the eBook in a user's own space area (for example, my page), or through text / pen through a note toolkit. Provides the function to save the information created by drawing in connection with eBook. In addition, the mobile terminal according to an embodiment of the present invention provides a single note that matches each eBook file, the user can easily call the note through the toolkit while viewing the eBook, the work is linked with the S-Note App Modifications / additional reflections are saved in both directions at the same time. Therefore, when a user selects additional information while viewing a note created through an ebook in S-Note (for example, by tapping a tagged ebook page in the ebook), the mobile terminal can automatically open and display the ebook. .

1 is a diagram illustrating a configuration of a mobile terminal according to an embodiment of the present invention. Here, the portable terminal may be various digital devices such as a mobile phone including a smart phone, an MP3 terminal, a tablet, and a computer.

Referring to FIG. 1, the communication unit 120 performs a wireless communication function with a base station or another device. The communication unit 120 may include a transmitter for up-converting and frequency-amplifying a frequency of a transmission signal, and a receiver for performing low-noise amplification and frequency down-conversion on a reception signal. The communication unit 120 may include a modulation unit and a demodulation unit. The modulator modulates the transmission signal and transmits the modulated signal to the transmission unit, and the demodulation unit demodulates the signal received through the reception unit. In this case, the modulation and demodulation unit may be LTE, WCDMA, GSM, WIFI, WIBRO, NFC, Bluetooth, or the like. In the embodiment of the present invention, it is assumed that the communication unit 120 includes LTE, WIFI, and bluetooh communication units.

The controller 100 controls the overall operation of the mobile terminal, and displays the items of the corresponding sub-applications when the main application is executed according to an embodiment of the present invention, and overlays the sub-applications corresponding to the selected item on the main application screen to the main application. Control the interlocking operation between the and sub-applications.

The memory 110 may include a program memory for storing an operation program of a terminal and a program according to an embodiment of the present invention, tables for operation of the terminal, and a data memory for storing data generated during program execution. The memory 110 also stores a main application and a set of sub-applications corresponding to the main application. The sub-application set may be commonly used for a plurality of main applications. In an embodiment of the present invention, the sub-application set may be composed of a note application, a map application, a web application, a calculator application, a dictionary application, or may be composed of some of these applications.

The display unit 130 displays information of an application being executed under the control of the controller 100. [ The display unit 130 may be an LCD or an OLED. The first input unit 140 may be implemented by a correction capacitance method or a resistance film method, and outputs the position information of the user's touch (hereinafter, referred to as a finger touch) to the controller 100. The second input unit 150 may include an EMR sensor pad. The second input unit 150 senses a pen touch input and outputs the pen touch input to the controller 100. Here, the display unit 130, the touch panel 140, and the ERM panel 150 may be integrally formed.

As described above, the screen of the mobile terminal according to an embodiment of the present invention is displayed by overlaying a main application screen and a sub application screen. In this case, the configuration of the sub application may include a plurality of tool kits. 2 is a diagram illustrating a configuration example of a sub-application set (tool kit set) in a mobile terminal according to an embodiment of the present invention.

Referring to FIG. 2, a sub application (Toolkit) according to an embodiment of the present invention is implemented based on a toolkit framework as shown by reference numeral 200, and the toolkit framework 200 It provides common functions for screen composition and data exchange between sub-application and main application. In this case, the sub-applications are provided with the toolkit framework 200 based on the toolkit framework 200 as a reference numeral 210, and the toolkit set (sub-application set) can be commonly used for various main applications. In addition, each main application can provide different types of toolkits included in the toolkit set according to characteristics, and users can customize the toolkit type configuration.

Wherein the sub application (tool kit) is a note application (calculator application), a map application (map application), a web application (web browser application), a dictionary application (dictionary application) as described above ) May be included. Reference numeral 220 illustrates a screen configuration of the display unit 130 in which the eBook application and the sub-application are overlaid and displayed on one screen when the main application is an eBook application. The eBook application may be a reader hub, a running hub, a smart school application, and the like, and each of these applications may use all sub-applications of the toolkit set 210 in common.

3A and 3C are diagrams for describing an interlocking operation between a main application and a sub application in a mobile terminal according to an embodiment of the present invention.

3A to 3C, the basic configuration of the present invention allows a user to directly reprocess information such as a main application 300 for directly reading content, an object belonging to the main application 300, a text, a memo, handwriting, etc. It may be configured as a sub-application 320 of additional functions. The main application 300 and the sub-application 320 of the additional function are closely related to each other. In the embodiment of the present invention, the control unit 100 displays the sub-application item 310 of the additional function that can be used as 310 on the screen of the main application 300 as shown in FIG. 3A when the main application is executed. Here, the sub application item 310 may be composed of one or more. 3A includes five sub-application items 310, where "N" is a note application item, "C" is a calculator application item, and "M" is a map application item. It is assumed that "W" is a web browser application item and "D" is a dictionary application item.

In this case, when a specific sub application item is selected as shown in FIG. 3B, the controller 100 overlays and displays the corresponding sub application on the main application as shown in 320 of FIG. 3C. In this case, the sub-application 320 is overlaid and displayed on the screen of the main application 300, and the transparency of the sub-application screen can be adjusted. In this case, it is assumed that the transparency is 0. In this case, the main application of the area overlaid on the sub-application 320 is not displayed. When the sub-application is overlaid and displayed on the main application as described above, the display 130 should be able to display the main application of the area covered by the sub-application. To this end, in the embodiment of the present invention, when the sub-application 320 is overlaid and displayed on the main application 300 as shown in FIG. 3C, when a drag (or scroll) occurs in the display area of the main application 300, the screen of the main application 300 is dragged. Move it to display it. In this case, the dragging operation may be performed on a touch or gesture (for example, hovering, etc.) of the hand detected by the first input unit 140 or the pen detected by the second input unit 150. Accordingly, when the drag operation is detected through the first input unit 140 or the second input unit 150 as shown by reference numeral 330 in the state where the main and sub applications are overlaid as shown in FIG. The screen of the main application is moved in the direction in which the dragging operation occurs in the screen (horizontal direction from right to left in FIG. 3C). If the main application exceeds the set size (eg, 50% of the main application screen page) by the drag operation, the main application page may be changed and displayed.

Here, the main application 300 may be a content viewer application. In the following description, it is assumed that the content viewer application is an ebook application and the sub application 320 is a note application. In this case, when the item ("N") of the note application is selected, the controller 100 calls the note application and displays the overlay on the screen of the ebook application. When the user scrolls (or drags) the main application, the controller 100 The page of the ebook application is moved in the drag direction. Therefore, even when the note application of the additional function is displayed on the screen of the ebook application, the user may search the contents of the ebook covered by the note application by performing a drag operation. When the note application is in the close state, the control unit 100 does not support the scroll (or drag) function of the ebook application by recognizing the close state of the sub application. In this case, the controller 100 may support a flick function of the main application.

As described above, when the main application area of the ebook application is covered by the note application display, the controller 100 temporarily allows left and right scrolling of the ebook application display area, thereby closing the displayed note application. Instead, you can explore the area of the ebook application that is covered by the note application. When the scrolling (or dragging) is performed in a display area of the ebook application for a predetermined range or more, the controller 100 moves a page of the displayed ebook application to another page without closing the note application. In addition, when the note application is opened and the page is continuously moved to reach the last page of the contents of the ebook application, the last page may be notified by a lighting effect.

In addition, when the user closes the display of the note application by the first input unit 140 or the second input unit 150 while viewing the content page of the ebook application covered by the display of the note application as shown in FIG. 3C, FIG. 3A. The ebook application is displayed, and the page of the displayed ebook application returns to the page occupying 50% or more of the area.

4 is a diagram illustrating a linking procedure between a content viewer application and a note application in a mobile terminal according to an embodiment of the present invention.

Referring to FIG. 4, the controller 100 is in a state of executing a main application in step 411, and the main application is displayed on the display unit 130. Here, the main application may be a content viewer application, and it is assumed here as an ebook application. In this case, as shown in FIG. 3A, the control unit 100 displays the items of the sub-applications as additional functions along with the main application on the display unit 130 in step 411. The items of the sub-application may include notes, maps, webs, calculators, and dictionary application items. When the user selects the sub application item (here, the note application item) as shown in FIG. 3B in the displayed state as shown in FIG. 3A, the control unit 100 detects it in step 413 and displays it on the display unit 130 as shown in FIG. 3C in step 415. The screen of the selected note application is displayed by overlaying the screen of the ebook application. Thereafter, the controller 100 processes information by interworking the ebook application selected by a user and a note application. That is, the controller 100 can display the content selected in the ebook application on the note application screen, and can also display information input through the first input unit 140 or the second input unit 150.

In addition, when the display of the note application is selected, the controller 100 detects this in step 421 and displays the note information generated by linking the ebook application and the note application in step 423. At this time, the display of the note information can be displayed by activating my page that collects and stores my information while executing the ebook application, and can also display the note information through an independent application. In this case, the independent application may be an S-note. If the termination mode is selected from among displaying the note application or note information, the operation is terminated. In this case, the terminating operation may also terminate the main application, and when terminating only the note application, the process may return to step 411 to continue to perform the main application service. In FIG. 4, it is assumed that the main application and the sub application are terminated at the same time.

5A through 5D are diagrams for describing a linking procedure between an ebook application and a note application while performing the same procedure as in FIG. 4. 5A is a diagram illustrating an example of displaying an eBook and Note Toolkit screen as a basic screen configuration, and FIG. 5B is a diagram illustrating an example of performing text input on a Note Toolkit screen as an application screen configuration, and FIG. 5C is another configuration example of an application screen. FIG. 5D illustrates a screen in which an ebook note is added to S-Note as another configuration example of an application screen. 5A through 5C may be an operation in step 425 of FIG. 4, and FIG. 5D may be an operation in step 423 of FIG. 4.

5A through 5D, the basic screen configuration of the present invention is the same as that of FIG. 5A. That is, the user can open the eBook application 300, and can open a note application such as 320 through the Note Toolkit, and display the contents of the ebook on the note screen as shown in 513 by dragging and dropping objects in the eBook as shown in 511. You can also use the pop-up menu for notes, highlights, and more. In addition, in the state in which the note application 320 is opened, text may be directly input as shown in FIG. 5B, and desired drawing contents may be stored in a note by drawing with a pen operation as shown in FIG. 5C. In this case, as shown in FIGS. 5A to 5C, when the ebook application and the note application are generated in the open state, the controller 100 may link the eBook page open at the time to the note information and tag the mapping information as mapping information. This information is stored together as note information. And note information as described above may be stored in my page.

In addition, a note created in this way can be automatically added as a note to S-Note at the same time that it is stored in the my page. In this case, when the user executes the S-Note as shown in FIG. 5D, the controller 100 can display the eBook Note created through the S-Note without executing the eBook application. In this case, the tagged page is displayed in the displayed note information. Pages in eBooks can also be opened immediately without launching the app.

In an embodiment of the present invention, by recognizing what is currently open eBook content and which page is open, information on the eBook content and page can be automatically displayed when a note is created.

6 is a flowchart illustrating an interlocking operation between an ebook application and a note application in FIG. 4.

Referring to FIG. 6, when the note application item is selected, the controller 100 overlays and displays a note application screen on a portion of an ebook application screen in step 611. If a touch interaction occurs in the above state, the controller 100 processes the information of the ebook selected by the touch interaction as note information in step 615. The touch interaction may be drag and drop. That is, the controller 100 processes the information selected in the ebook as note information by dragging and dropping. In this case, the note information may include meter information including page information of the ebook in addition to the selected ebook information.

The note application may also select text and pen input. When the input mode is selected as described above, the controller 100 detects the input mode in step 631, and processes text and / or drawing inputs input from the first input unit 140 or / and the second input unit 150 as note information in step 633.

In addition, when tag information is selected when displaying note information in the note application, the control unit 100 detects this in step 641 and displays information on an ebook corresponding to the selected meter information in step 643. That is, when the controller 100 selects page information of the meter information, the controller 100 moves to the corresponding page of the ebook and displays the main application screen.

In addition, as described above, the operation of the ebook application may be controlled in addition to the operation of processing the note information by linking the ebook application and the note application. That is, when the user performs a scroll operation in the ebook application screen area, the controller 100 detects this in step 641 and moves the ebook screen in the scroll direction in step 651. This may occur when checking the contents of the ebook covered by the note application screen as described above, or when page turning of the ebook is necessary.

When the note application ends, the controller 100 detects this in step 653 and terminates the note application in step 655. In this case, the termination process may terminate the operation of the note application and operate the ebook application, and may terminate both the note application and the ebook application.

7 is a flowchart illustrating a procedure of calling and activating a note application in an ebook application in FIG. 6, and FIG. 8 is a flowchart illustrating a procedure of performing an input mode in a note application in FIG. 6. 9A and 9E are diagrams illustrating screen examples of the display unit 130 displayed when the procedure of FIGS. 6 to 8 is performed.

6 to 9E, when a user wants to call a note application while performing an ebook application, the user selects a note application item among the sub-application items of FIG. 2 or makes a note through a contextual menu. You can select an application. Therefore, when the note application item is selected, the controller 100 detects it in step 711 and displays the note application screen on the ebook application screen in step 713 as shown in 930 of FIG. 9B. However, if a specific position of the ebook is selected (for example, highlighted) as shown in 910 of FIG. 9A and then a contextual menu is selected, the control unit 100 detects this in step 721 and the menu as shown in 913 in step 723. Show the toolbar. If a memo is selected in the menu toolbar, the controller 100 detects this in step 725 and displays a note application screen such as 320 in a partial area of the ebook application screen 300 in step 727. In operation 729, the controller 100 displays the highlighted ebook information on the note application screen as shown in 920 of 920 of FIG. 9A. When the text mode is selected on the screen of the note application, the controller 100 may input text as shown in 915. Display the window (Soft Input Panel: SIP). Here, the SIP may be a keypad or a keyboard having a 3 * 4 key or querty arrangement.

In the above state, the user can transfer the contents of the ebook to the note information and store it. That is, if a touch interaction (drag and drop, touch and hold) is detected in step 613 of FIG. 6, the controller 100 stores information selected from the ebook as note information in step 615 as shown in 940 of FIG. 9B. Here, the note information may be composed of the content and the meter information of the ebook selected by the user, the meter information may be a page (page link), book info., Label / caption of the ebook.

In addition, after invoking the note application, a user may write desired note information using a finger and / or a pen. In this case, the user may select a text mode as shown in 950 of FIG. 9C or a drawing mode as shown in 970 of FIG. 9D from the menu toolbar of the note application. In this case, when the text mode is selected, the controller 100 detects this in step 811 of FIG. 8 and displays SIP in step 813. In this case, the SIP may be a keypad or a keyboard having a 3 * 4 or qwerty key arrangement as described above. In step 815, the controller 100 processes the key data input through the SIP as text and stores the information as note information. In addition, when the drawing mode is selected as shown in 970 of FIG. 9D, the controller 100 detects this in step 821, and processes the pen drawing input detected by the second input unit 150 in step 823 as in 980 of FIG. 9D. Save as information. In addition, in the input mode, the controller 100 processes the corresponding input in step 825 when the text and pen input mode is not in the input mode. In the case of storing the note information generated by the text and pen input while performing the procedure, FIG. 8 kx may also store the meter information as described above. Therefore, when the note information is stored in the text and / or drawing, the meter information (page link, book info., Label / caption, etc.) of the ebook in which the note information is generated is also stored, thereby confirming the note information. You can display note information with the corresponding page in.

In addition, when linking the ebook application and the note application, the note information includes the meter information of the corresponding ebook, and if the meter information is selected, the corresponding page for generating the note information in the ebook is displayed. That is, if the meter information is selected as shown in step 641 of FIG. 6 while the ebook and note information is displayed as shown in 990 of FIG. 9E, the controller 100 corresponds to the meter information as shown in 995 of FIG. 9E in step 643. Navigate to the page of the ebook and display it.

When scrolling is performed on the display screen of the ebook in the above state, the controller 100 may move the contents of the ebook in the scrolling direction, and when the scrolling size exceeds the set size (for example, 50% or more pages). May scroll through the page).

As described above, in the embodiment of the present invention, the user may generate and store note information about the ebook while viewing the eBook. The note information may be stored in My Page and / or S-Note associated with the eBook and note Toolkit.

First, the eBook application and the Note Toolkit work together. When pasting a specific content in a note in the eBook, the corresponding content of the ebook and metadata such as page link, book info, label / caption where the content was located are stored as note information. In this case, the call of the note application may be selected through a note application item or a menu displayed when the ebook application is displayed as described above. As shown at 910 of FIG. 9A, when Memo is selected through the contextual menu, the controller 100 overlays the note screen on the ebook screen, and the highlighted content is automatically added to the Note Toolkit such as 920 and the SIP is displayed. Is called to enter text. In addition, when a note item is selected while the ebook screen is displayed, the controller 100 activates a state in which the note information is generated by overlaying the note screen on the ebook screen.

In a state where the note screen is overlaid on the ebook screen as described above, the controller 100 generates and stores note information according to touch interaction, text, or drawing input information. That is, as illustrated in FIG. 9B, an object inserted into an ebook, such as an image, 3D, or video, may be pasted into a note through a Drag & Drop or Touch & Long operation. In addition, when the eBook is displayed and the Note Toolkit is called and text input or pen drawing is performed as shown in FIG. 9C, the controller 100 may input desired content in Note in association with the corresponding page of the etbook. At this time, the note information includes the meter information of the ebook associated with the note information.

In addition, when the note information is displayed, tapping the page icon attached to each tagged object as shown in FIG. 9E to display the corresponding page of the textbook. That is, when eBook and note Toolkit are linked to generate note information, the note information stores each page information and stores how many pages the note is made from. You can unfold it. You can also tap the note icon and underline to go to the Note Toolkit page with the note.

Such note information is stored in my page and / or S-note. The my page may be an area for collectively storing memo information, and the S-note may be an area for storing a message generated through a note application. The user may select the my page or S-note to check the note information.

10 is a flowchart illustrating a procedure of confirming note information in a mobile terminal according to an embodiment of the present invention, and FIGS. 11A and 11B are diagrams illustrating an example of confirming note information by the same procedure as in FIG. 10.

10 to 11B, the controller 100 displays an ebook application as a main application in step 1011. In this case, when the ebook application presses a note information confirmation button (here, may be my page button) 1113 as shown in 1110 of FIG. 11A, the controller 100 stores a note stored in my page as shown in 1120 of FIG. 11A in step 1015. Display a list of information. In this case, the list of note information may be displayed for each note page as shown in 1130 of FIG. 11A, and may be displayed for each chapter of the ebook as shown in 1140 of FIG. 11A. In this case, when a specific note information list is selected from the displayed list of note information, the controller 100 displays note information of an ebook corresponding to the selected note information list in step 1017. In this case, the note information is displayed together with the meter information as described above, and when the user selects the tagged information as shown in 1150 of FIG. 11B, the control unit 100 detects this in step 1013, and in step 1021, 1160 in FIG. 11B. As shown above, the page and note information of the corresponding ebook is overlaid. In addition, the controller 100 may edit the note information. If an editing command is generated, the control unit 100 detects this in step 1023 and edits note information according to the information input in step 1025. After performing step 1021 or step 1025, the controller 100 processes note information in step 1027. Here, the note information processing operation may store the changed note information, move to another application at the user's command, or terminate the ebook application.

Referring to FIG. 11A, when the my page button 113 is selected in a state of displaying an ebook application as shown in 1110, the controller 100 displays a my page screen such as 1120. At this time, the page configuration of the my page includes a notebook button 1121 for selecting note information worked in the note toolkit, a drowing button 1123 for selecting drawing information worked in the note toolkit, and a bookmark button 1125 of the ebook. The note information list 1127 is displayed in the created order, and the selected note information 1129 is displayed on the main screen. In this case, the note information may be displayed for each page or chapter. That is, when the notebook page1126 is tapped, the list of note information may be displayed for each page as shown by 1130 of FIG. 11A, and the note information may be displayed. However, when the textbook chapter button 1133 of 1130 is selected, the controller 100 may display the note information by displaying the list of note information for each chapter of the ebook as shown in 1140 of FIG. 11A.

When the page tagging icon is tapped in My Page as shown in 1150 of FIG. 11B, the controller 100 moves to the Viewer as shown in 1150 and displays corresponding page and note information of the ebook.

As illustrated in FIGS. 11 and 11A through 11B, the contents added to the eBook Note Toolkit can be viewed in the same manner in My Page. In My Page, you can delete by object and note contents by Notebook Page or Chapter. FIG. 11A illustrates a method of accessing Mypage from a Viewer screen, and FIG. 11B may directly open a page to which a corresponding object belongs through a page index icon. This has the advantage of accessing the page related to the memo object in various ways through Page Tagging, which is automatically pasted at the same time with the same Page Index icon in Note Toolkit.

As described above, in the open state of the ebook application, the user can check the note information created in the ebook by opening my page. However, note information created in the ebook application may be stored together with my page and S-note as described above. Therefore, the note information can also be confirmed through S-note. That is, the my page may store note information corresponding to the ebook, and thus may be opened in the ebook application. However, S-note is an independent application. When the S-note application is executed, the list of note information is displayed, and the user can check the information of the desired list among the displayed lists.

12 is a flowchart illustrating a procedure of confirming note information of an ebook application according to an embodiment of the present invention, and FIG. 13 is a diagram illustrating an example of displaying note information confirmed by the same procedure as in FIG. 12.

12 and 13, when the user selects an S-note, the controller 100 detects this in step 1211 and displays an information list of the S-note as shown in 1310 of FIG. 13. When the user selects a specific list in the same state as described above, the control unit 100 detects this in step 1215 and displays the note information of the corresponding list as shown in 1320 of FIG. 13 in step 1217, and the note information is associated with the associated ebook. It also displays meter information. In this case, when the user selects the tagged meter information, the control unit 100 detects this in step 1219, and displays the corresponding page of the ebook and the note information as in step 1330. In addition, when an editing command is generated, the control unit 100 detects this in step 1223, and edits note information according to an editing command of the user in step 1225. After performing step 1221 or 1225, the controller 100 processes note information in step 1227. Here, the note information processing operation may store the changed note information, or may move to another application or terminate the ebook application at the user's command.

As described above, in an embodiment of the present invention, an eBook and a Note Toolkit can be opened in S-Note. As described above, the note information created in the eBook is added as note information in association with the S-Note. And you can edit the note information in S-Note and the updated contents are reflected in the eBook Note Toolkit. You can open the note information created in the eBook from the S-Note Library, and tap the eBook Page Tagging icon to open the corresponding Textbook page of the eBook Viewer and display the Note Page including the object that the Note Toolkit also tapped. .

As described above, the mobile terminal according to an embodiment of the present invention may call and write a note application in a content viewer application to create and store note information, and display the stored note information together with the corresponding ebook. In other words, if the user wants to move the contents of the book or input specific contents while viewing the ebook, the toolkit module in the eBook can easily call Note to easily create the contents. You can add it right away. When the note application is executed, the note information stores the page of the eBook that was opened at the time of the note, and includes meter information related to the book. The note information created as described above is stored in My Page and S-note of the corresponding ebook.

The stored note information created as described above can be displayed in various ways by chapter and by chapter on the My Page menu screen in the eBook.Notes in the eBook are automatically added to the S-Note App. Allows users to link and run the pages in the eBook without launching additional apps. In addition, when executing a content viewer application, a calculator, a map, a web, a dictionary toolkit provided in addition to the note toolkit may be selected, and note information generated through the selected toolkit is directly applied to an S-Note app, and the S-Note When you open an eBook Note, you can view the information you collected without running the Calculator, Map, Web, or Dictionary App.

The embodiments of the present invention disclosed in the present specification and drawings are merely illustrative of specific embodiments of the present invention and are not intended to limit the scope of the present invention in order to facilitate understanding of the present invention. It will be apparent to those skilled in the art that other modifications based on the technical idea of the present invention are possible in addition to the embodiments disclosed herein.

Claims

In the content viewer application processing method of a mobile terminal,
Displaying a content viewer application and a note application item;
Calling the note application when the note application item is selected and overlaying and displaying the note application on a portion of the screen of the content viewer application;
And processing information selected by the content viewer application and / or information created by a note application as note information of a corresponding content viewer.

The method of claim 1, further comprising: calling the note application when the memo menu is selected while displaying the content viewer application and overlaying it on a portion of the screen of the content viewer application.

The process of claim 2, wherein the process of processing the note information of the content viewer comprises:
And pasting the information selected from the content viewer into a note application by touch interaction and storing the information as note information.

4. The method of claim 3, wherein the touch interaction is drag and drop.

The process of claim 3, wherein the processing of the note information of the content viewer comprises:
And processing information input from a note application as note information of the content viewer.

The method of claim 5, wherein the information input from the note application is text and / or drawing input.

The method of claim 6, wherein the note information further comprises meter information including page information of a content viewer.

8. The method of claim 7, wherein the content viewer is an ebook.

The method of claim 8, further comprising moving a content of the ebook in a scroll direction when a drag or scroll input is detected in the ebook screen area in the process of overlaying and displaying the note application on the ebook application. Way.

The method of claim 9, further comprising moving the page screen of the ebook when the screen movement of the ebook application exceeds a set size.

The process of claim 6, wherein the process of processing the note information of the content viewer comprises:
And storing the note information in the My Page of the corresponding content viewer.

12. The method of claim 11,
Displaying a list of note information stored in a content viewer when selecting a My Page in the process of displaying the content viewer application;
And displaying the note information selected from the note information list.

The method of claim 12,
The note information list is categorized and displayed by page or chapter of a content viewer.

The method of claim 12,
The displayed note information displays page information of a linked content viewer.
And overlaying the corresponding page and memo information of the corresponding content viewer application when selecting the page information.

In the application processing apparatus of a mobile terminal,
A content viewer application and a sub-application set corresponding to the content viewer application, wherein the sub-application set includes a memory including a note application;
A display unit displaying items of a content viewer application and a corresponding sub-application set;
An input unit for selecting the note application item and generating note information;
When the note application item is selected by the content viewer application, the display unit is controlled to overlay the note application on a portion of the screen of the content viewer application, and the information selected by the content viewer application and / or information created by the note application is displayed. And a control unit for processing the note information of the corresponding content viewer.

16. The method of claim 15,
The controller may call the note application when the memo menu is selected while displaying the content viewer application, and display the content viewer application by overlaying it on a portion of the screen of the content viewer application.

17. The method of claim 16,
The controller pastes the information selected from the content viewer into a note application by touch interaction and stores the information as note information, and processes information input from the note application as note information of the content viewer.

18. The apparatus of claim 17, wherein the note information further comprises meter information including page information of a content viewer.

19. The method of claim 18,
The controller stores the note information in the My Page of the corresponding content viewer.
And displaying the note information stored in the content viewer when selecting the My Page, and displaying the note information selected from the note information list.

20. The apparatus of claim 19, wherein the content viewer is an ebook.