JP2012088805A - Information processor and information processor control method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an information processor in which an end-part GUI set outside a display area can be called by both a finger and a pen.SOLUTION: An electronic notebook 100 includes an end-part GUI processing unit 145. Both a finger 152 and a pen 151 are assigned as an input operation for displaying, inside a display area of a display unit 121, one end-part GUI (such as a caption tab and a toolbox) set outside the display area of the display unit 121 and adjacently to an end portion of the display area in a normal display state.

Description

  The present invention relates to an information processing apparatus that displays electronic information so that a user can view and edit it using a finger and a pen, and a control method for the information processing apparatus.

  Conventionally, with the spread of computers, various user interfaces have been developed so that the user can operate the computer more intuitively. In particular, in recent years, a number of user interfaces have been proposed in the technical field of providing information by digitizing information that has been provided on paper.

  For example, Patent Literature 1 describes an input method and an input device that improve the operability of an input operation by operating a touch panel. Specifically, a menu is displayed when the user's finger touches the sensor unit at the right end of the screen, and the menu item is selected by moving the sensor unit with the finger, and then the item is selected when the finger is released.

  Patent Document 2 describes an electronic device and a display control method capable of performing processing based on a contact area between a screen and an object when an object touches the screen of a touch panel. Specifically, the size of the input instruction is determined, and if it is a finger input, the screen is scrolled. If it is a pen input, the screen input is processed.

Japanese Patent Laying-Open No. 2005-4690 (released on January 6, 2005) JP 2010-182185 A (released on August 19, 2010)

  However, with the conventional technology as described above, it has not been possible to give an operational feeling to handle books and notebooks made of actual paper.

  That is, a person uses a finger and a pen differently when handling a book or notebook made of actual paper. Therefore, in order to realize books and notebooks with an information processing device, it is possible to give a feeling of operation to handle books and notebooks made of actual paper by using different fingers and pens for operating the screen. A user interface is required.

  In addition, the size of the display screen is a limitation of the information processing apparatus. Therefore, it is necessary to change the contents to be displayed according to the situation. For example, a GUI that is used less frequently is not displayed in a normal display state, and a user interface that is called when used is generally adopted.

  When the GUI that is used for such use is adopted in an apparatus that uses both a finger and a pen as an input device, if the input operation for calling the GUI is not systematized in cooperation with the finger and the pen, it is rather inconvenient. There is a problem that it becomes a user interface.

  The present invention has been made in view of the above-described problems, and an object of the present invention is to provide an information processing that provides a user interface that can call an end GUI set outside a display area from both a finger and a pen. It is to implement a control method for an apparatus and an information processing apparatus.

  In order to solve the above problems, an information processing apparatus according to the present invention is a normal information processing apparatus that displays electronic information on the display unit in response to an input operation on a touch panel configured integrally with the display unit. In the display state, an input operation with a finger is used as an input operation for displaying one end GUI set adjacent to the end of the display area outside the display area of the display section in the display area of the display section. And end GUI processing means to which an input operation with a pen is assigned.

  The information processing apparatus control method according to the present invention is an information processing apparatus control method for displaying electronic information on the display unit in response to an input operation on a touch panel integrated with the display unit. In a state, one end GUI set adjacent to the end of the display area outside the display area of the display section is input when a predetermined input operation with a finger is input or a predetermined input with a pen is performed. The method includes a step of displaying in the display area of the display unit when an operation is input.

  According to the above configuration, in the normal display state, one end GUI set adjacent to the end of the display area is displayed outside the display area of the display section in the display area of the display section. As an input operation to be performed, an input operation with a finger is assigned and an input operation with a pen is assigned. That is, one end GUI is displayed in the display area of the display unit when a predetermined input operation with a finger is input or when a predetermined input operation with a pen is input.

  Therefore, one end GUI set outside the display area can be called from both the finger and the pen. Therefore, there is no need to hold and place the pen for calling the end GUI, and it is possible to provide a user-friendly and natural user interface.

  Here, the input operation set to the finger and the pen is preferably an operation that draws the GUI outside the screen, that is, an operation that simulates a movement in the direction from the outside of the screen to the inside of the screen. For example, a flicking operation from the outside of the screen to the inside of the screen or a hovering operation at the end of the display area where the end GUI is set adjacently. When a predetermined input operation is detected, the screen is preferably slid or scrolled from the outside to the inside so that the end GUI is drawn into the screen.

  Furthermore, in the information processing apparatus according to the present invention, the end GUI processing means may display a part of the end GUI at the end of the display area where the end GUI is set adjacently. preferable.

  According to said structure, there exists an effect that a user can be further notified that there exists edge part GUI adjacent to the outer side of a display area.

  Further, in the information processing apparatus according to the present invention, the input operation with the finger is an input operation in which the finger is slid inward from an end portion of the display area in which the end GUI is set adjacently, and the pen is used. The input operation is preferably an input operation in which the end is touched with a pen.

  According to the above configuration, both of the operation of sliding the finger in the direction opposite to the direction approaching the end GUI and the operation of touching the pen near the end where the end GUI exists exist. The end GUI can be displayed in the display area. Therefore, there is an effect that it is possible to provide a user interface that can call the end GUI by an intuitive operation.

  The information processing apparatus may be realized by a computer, and in this case, a control program for the information processing apparatus that causes the information processing apparatus to be realized by the computer by operating the computer as the means, and A recorded computer-readable recording medium also falls within the scope of the present invention.

  The information processing apparatus according to the present invention includes, in a normal display state, one end GUI set adjacent to the end of the display area outside the display area of the display section within the display area of the display section. As an input operation to be displayed, an input operation with a finger is assigned, and an end GUI processing unit to which an input operation with a pen is assigned is provided.

  Also, the control method of the information processing apparatus according to the present invention provides a predetermined finger GUI for setting one end GUI set adjacent to the end of the display area outside the display area in the normal display state. When the input operation is input, or when a predetermined input operation with a pen is input, the method includes a step of displaying in the display area of the display unit.

  Therefore, there is no need to hold and place the pen for calling the end GUI, and it is possible to provide a user-friendly and natural user interface.

It is a block diagram which shows the structural example of the electronic notebook apparatus which concerns on one Embodiment of this invention. It is the data structure figure illustrated about the data structure of electronic note information. It is a figure illustrated about the case where the page information of the 1st page of an electronic notebook is displayed. It is a figure illustrated about the case where the page information of the 2nd page of an electronic notebook is displayed. It is a figure which shows about the toolbox which integrated the edit function with respect to an electronic note. It is a figure which shows the example of a screen structure containing the edge part GUI of an electronic notebook apparatus. In an electronic notebook device, it is explanatory drawing which shows the transition from the normal display state to the state which displayed the toolbox and edge tab GUI which are edge part GUIs. It is explanatory drawing which shows the display operation | movement of the said heading tab. It is explanatory drawing which shows the specific example of the relationship between the said heading tab and an application. It is explanatory drawing which shows the display operation of the said toolbox. It is a flowchart which shows the operation | movement when the edge part GUI process part of an electronic notebook apparatus displays edge part GUI.

  An embodiment of the present invention will be described below with reference to FIGS.

  First, the functional outline of the electronic notebook device (information processing device) 100 according to the present embodiment will be described with reference to FIG. FIG. 1 is a block diagram illustrating a configuration example of the electronic notebook device 100.

  The electronic notebook device 100 receives a handwritten input from a user and provides a function for allowing the user to edit a note realized on software and other information processing functions. In the following, a note realized on software is referred to as an electronic note.

  As illustrated in FIG. 1, the electronic notebook device 100 includes a touch panel unit 120, a storage unit 130, and a main control unit 140.

  The touch panel unit 120 provides a user interface such as an input operation and screen display in the electronic notebook device 100, and includes a display unit 121 and a position input unit (touch panel) 122.

  The position input unit 122 detects a touch position where the touch operation on the operation surface of the touch panel unit 120 is performed, and generates input position information corresponding to the detected position.

  Here, the touch operation is an operation in which an instruction member such as the touch pen 151 or the user's finger 152 is brought into contact with the operation surface. The touch position is a position detected by the position input unit 122 when the touch pen 151 or the user's finger 152 is brought into contact with the operation surface.

  Further, the position input unit 122 can be realized by a touch panel, for example. Here, as a method for the position input unit 122 to detect the touch position, a capacitance method is illustratively employed. However, the present invention is not limited to this, and there are various types such as a matrix switch, a resistive film method, a surface acoustic wave method, an infrared method, an electromagnetic induction method, a capacitance method, and a method for detecting an object image (photosensor method). These methods can be appropriately employed singly or in combination. For example, a capacitive method for detecting the finger 152 and an electromagnetic induction method for detecting the pen 151 may be used in combination.

  And the position input part 122 is comprised so that a several touch position can be detected simultaneously, for example. However, the present invention is not limited to this, and the position input unit 122 may be configured to detect only a single touch position.

  The position input unit 122 discriminates and detects a touch operation with the touch pen 151 and a touch operation with the user's finger 152. This can be realized, for example, by configuring the position input unit 122 as follows.

  That is, the area where the position input unit 122 detects the touch of the touch pen 151 or the finger 152 is detected, and the size of the detected area is calculated. Then, the position input unit 122 determines that the calculated area is wider than the predetermined area, that is, the touch operation with the finger 152, and if smaller than the predetermined area, the position input unit 122 determines that the touch operation is performed with the touch pen 151. .

  The position input unit 122 may include a type indicating whether the touch operation is performed with the touch pen 151 or the user's finger 152 in the input position information.

  Further, the position input unit 122 can detect a so-called hover state in which the pen tip of the touch pen 151 is held at a close position separated by a minute distance without touching the operation surface of the touch panel unit 120. .

  The position input unit 122 may generate two-dimensional coordinate data indicating the touch position on the operation surface as input position information. Further, the position input unit 122 may detect the pressure of the touch operation and include information on the detected pressure in the input position information.

  The display unit 121 has a display screen for displaying image data, receives image data from the main control unit 140, and displays an image on the display screen based on the received image data. The display unit 121 can be realized by, for example, an LCD (Liquid Crystal Display), a PDP (Plasma Display Panel), an EL (Electroluminescence) display, electronic paper, or the like.

  The position input unit 122 is illustratively formed as an integrated structure superimposed on the display screen of the display unit 121 so that the coordinates of the display screen correspond to the coordinates of the operation surface. . Information for associating the coordinates of both may be stored in the storage unit 130.

  Moreover, the position input part 122 is comprised by the member which permeate | transmits the part corresponding to a display screen so that the display in the display screen of the display part 121 may not be prevented.

  With such a configuration, the user can perform an input operation on the operation surface while confirming the screen displayed on the display unit 121. As a specific example of the screen displayed on the display unit 121, the display unit 121 displays a GUI (Graphical User Interface) screen such as an icon on the display screen. Then, when the operation surface of the position input unit 122 is touched by a user's finger (or touch pen), coordinate information corresponding to the touched icon or image is generated by the position input unit 122.

  The configuration of the touch panel unit 120 has been exemplified above, but the configuration is not limited thereto, and any structure can be used as long as the display screen and the operation surface are shared.

  The storage unit 130 stores various data and programs. The storage unit 130 can be configured by, for example, a hard disk, a flash memory, a ROM (Read Only Memory), a RAM (Random Access Memory), or the like. Details of the storage unit 130 will be described later.

  The main control unit 140 comprehensively controls various configurations in the electronic notebook device 100. The function of the main control unit 140 is realized by a CPU (Central Processing Unit) executing a program stored in a storage element such as a RAM or a flash memory.

(Specific configuration of storage unit and main control unit)
Next, a more specific configuration of the storage unit 130 and the main control unit 140 will be described as follows.

  First, the configuration of the storage unit 130 will be described. As illustrated in FIG. 1, the storage unit 130 includes an electronic notebook information storage unit 131.

  Electronic note information storage unit 131 stores electronic note information. The data structure of the electronic notebook information will be described with reference to FIG. FIG. 3 is a data structure diagram illustrating the data structure of electronic note information.

  As shown in FIG. 2, the electronic note information N1 includes page information P1 that is electronic information about each page of the electronic notebook. The page information P1 includes “page number”, “edit information”, and “refill type” data.

  “Page number” indicates a page number assigned to the page. The “edit information” is a data area that the user can freely edit by handwriting via the touch panel unit 120. As the data format of “editing information”, those based on the digital ink system or the bitmap system can be adopted.

  In the “refill type”, the type of refill set for each page is set. Here, the type of refill is a pattern of a sheet, and displays, for example, a ruled line or the like attached to a paper medium notebook. This display is implemented, for example, by displaying a background image representing ruled lines or the like on the background of the sheet.

  There are a plurality of types of refill types, examples of which include 7 mm horizontal ruled lines, horizontal ruled lines such as 6 mm horizontal ruled lines with dots, 5 mm squares, plain, and minutes of meetings.

  The storage unit 130 may be provided with a deleted page holding unit (not shown) for temporarily saving deleted page information.

  Next, referring to FIG. 1 again, the main controller 140 will be described as follows. The main control unit 140 has an application unit 141 for realizing each information processing function included in the electronic notebook device 100.

  The application unit 141 includes an electronic notebook function unit 142, a schedule management function unit 143, an Internet function unit 144, and an end GUI (Graphical User Interface) processing unit (end GUI processing means) 145.

  The electronic notebook function unit 142 provides an electronic notebook function for editing and browsing a notebook by hand. The schedule management function unit 143 provides a schedule management function for editing and managing a schedule by hand. The Internet function unit 144 is for providing an Internet function for communication connection to the Internet via a communication unit (not shown) for communicating with an external network. The contents can be cut out as an image from the homepage connected by the Internet function unit 144 and recorded in the electronic notebook by the electronic note function unit 142. The end GUI processing unit 145 is for providing a GUI outside the display area of the display unit 121 of the touch panel unit 120. Specifically, in the normal display state, the end GUI set outside the display area is called and functioned when a predetermined input operation with a finger or a predetermined input operation with a pen is performed. is there. The function of the end GUI processing unit 145 will be described in detail later.

  As described above, the application unit 141 of the electronic notebook device 100 provides not only an electronic notebook function but also various functions such as a schedule management function and an Internet function. Various functions provided by the application unit 141 can be added or deleted by installing or uninstalling an arbitrary application.

  When the touch panel unit 120 receives an application switching operation from the user, the application unit 141 receives an electronic note function by the electronic note function unit 142, a schedule management function by the schedule management function unit 143, according to the received switching operation, And the internet function by the internet function part 144 can be switched mutually.

  Further, when the electronic notebook device 100 is activated, the electronic notebook function in the electronic notebook function unit 142 may be operated.

  In addition, the application unit 141 has a function of recognizing a touch operation or a gesture performed by the user on the touch panel unit 120 based on input position information transmitted from the position input unit 122 of the touch panel unit 120. Here, the gesture is a touch operation performed according to a predetermined pattern, and details thereof are as follows.

  The gesture recognized by the application unit 141 includes, for example, single touch, double touch, drag, and flick.

  Single touch is a gesture for performing a touch operation in which a finger 152 or the like is brought into contact with a position on the touch panel unit 120 and released immediately.

  The double touch is a gesture in which the touch panel unit 120 performs the single touch twice within a predetermined short time.

  Further, the drag is a gesture in which the finger 152 or the like is slid as it is while the finger 152 or the like is in contact with the touch panel unit 120.

  A flick is a gesture in which a finger 152 or the like is brought into contact with the touch panel unit 120, the finger 152 or the like is slid as it is, and a finger 152 or the like that is in contact within a predetermined short time is released from the touch panel unit 120. is there. That is, flicking is an operation that flicks the touch panel unit 120 lightly.

  When the application unit 141 recognizes the gesture, the application unit 141 generates gesture information indicating the recognized gesture.

  The gesture information is information indicating a change in coordinates of the touch position when the user touches the screen. As a specific example of the gesture information, there is information indicating the change amount of the coordinate of the touch position changed by the user dragging from the top to the bottom in the vertical direction of the screen. The gesture information may be information indicating what kind of gesture the user has performed in which direction.

  The application unit 141 notifies the generated gesture information to the electronic notebook function unit 142, the schedule management function unit 143, and the Internet function unit 144.

(About the electronic notebook function overview)
The outline of the electronic notebook function implemented in the electronic notebook function unit 142 of the application unit 141 of the electronic notebook device 100 will be described with reference to FIGS.

  First, the external appearance of the electronic notebook displayed on the display unit 121 of the touch panel unit 120 will be described with reference to FIG. FIG. 3 illustrates a case where the page information P1 of the first page of the electronic notebook is displayed.

  For example, it is assumed that “page number” of the page information P1 is “1”, and “horizontal rule” is set in “refill type”. Further, it is assumed that “P1.memo ABCDEFGHIJKLMN” is input by handwriting in the “editing information” of the page information P1.

  As shown in FIG. 3, the display area of the electronic notebook includes a page number area 201 for displaying the “page number” of the page information P1, and an editing area 202 for displaying the “edit information”. In the page number area 201 shown in FIG. 3, “1” which is the “page number” of the page information P1 is displayed. In the same figure, “P1.memo ABCDEFGHIJKLMN” of “edit information” is displayed in the page number area 201.

  Further, in the display of the page information P1 shown in FIG. 3, the left side corresponds to a node portion in a paper medium note. That is, the left side of FIG. 3 corresponds to a spread center portion of a paper medium notebook, that is, a notebook binding side. On the other hand, in the display of the page information P1 shown in FIG. 3, the right side corresponds to the outside of the notebook of the paper medium, that is, the fore edge (front edge).

  In addition, this structure is only what was shown as an example and can also be comprised like the notebook opened up and down.

  The user can edit “edit information” in the edit area 202 via the touch panel unit 120. The “page number” is automatically assigned and managed by the electronic notebook function unit 142.

  Further, referring to FIG. 4 in addition to FIG. 3, page turning of the electronic note realized by the electronic note function unit 142 will be described as follows. FIG. 4 illustrates a case where page information P2 of the second page of the electronic notebook is displayed.

  The electronic notebook function unit 142 accepts page turning gesture information in the state shown in FIGS. 3 and 4. The page turning gesture information indicates, for example, a flick in the horizontal direction of the screen and the right and left direction. Then, in response to the page turning gesture information, the electronic notebook function unit 142 reads out the page information of the page next to the currently displayed page from the electronic notebook information storage unit 131 and causes the display unit 121 to display the page information. The page information of the page before the currently displayed page is read and displayed on the display unit 121.

  Specifically, when the flick (left flick) is performed in the direction of the arrow F1 shown in FIG. 3, the page information P2 of the second page is read by the electronic notebook function unit 142 after the display effect of turning the first page. Then, the page information P2 of the second page is displayed on the display unit 121 as shown in FIG. Here, as shown in FIG. 4, “P.2 mem abcdefg”, which is the editing information of the page information P2, is displayed.

  On the contrary, as shown in FIG. 4, when the page information P2 of the second page is displayed, if the flick (right flick) is performed in the direction of the arrow F2, the page of the first page is displayed by the electronic notebook function unit 142. The information P1 is read, and the page information P1 for the first page shown in FIG.

  As described above, the electronic notebook function unit 142 displays the next page when the left flick is detected, and displays the previous page when the right flick is detected.

  The electronic note function unit 142 is configured not to perform any operation even when a right flick is detected when the first page is displayed, that is, when the first page is displayed. Also good. In addition, when the electronic notebook function unit 142 displays the last page and detects a left flick, the electronic notebook function unit 142 may create a new page and send a page to the new page.

  When displaying the page information, the electronic notebook function unit 142 divides the display screen into two areas, displays the page information of a certain page in one display area, and displays another information in the other display area. Page information may be displayed.

  Next, an editing function performed on the electronic notebook will be described with reference to FIG. In editing an electronic notebook, a user can use a tool box 210 that integrates various editing functions as shown in FIG. The tool box 210 is called in response to a user operation on the touch panel unit 120, that is, gesture information notified from the application unit 141.

  The tool box 210 stores a tool (electronic stationery) used by the application being used. In the tool box 210 shown in FIG. 5, a ruler 211, a refill 212, an art knife 213, and a pen case 214 are stored as an example.

  The ruler 211 is a tool for drawing graphics such as straight lines and circles in the editing area 202.

  The refill 212 is a tool for adding and deleting pages. When adding a page by the refill 212, the user is made to select a refill type of the page to be added.

  The art knife 213 is for realizing a function for cutting out manually entered editing information in the editing area 202, and for realizing a so-called cut and paste function. When cutting and pasting with the art knife 213, the target region is first cut out by surrounding the target region to be cut out. Then, the cut area is dragged to another location on the same page or moved to a different page, and pasted to a desired location.

  The pen case 214 is a main tool for editing an electronic notebook and a tool for manual input. The user can select and input a desired pen type, for example, pen thickness / color, from the pen case 214.

  Note that the electronic note function unit 142 may be configured so that the pen tool of the pen case 214 is initially selected when the electronic note function is activated by the function switching operation. In addition, the pen case 214 has an eraser tool for erasing editing information once input by handwriting.

(End GUI function)
Hereinafter, the end GUI function provided by the end GUI processing unit 145 will be described in detail with reference to FIGS.

  The end GUI function is such that a GUI (hereinafter referred to as an end GUI) that is hidden outside the screen when not in use is slid into the screen when a predetermined user operation (gesture) is detected so that the user can use it. To do.

  FIG. 6 shows an example of a screen configuration including the end GUI. The arrangement in FIG. 6 is an example image, and whether or not such image data is prepared in a memory in advance can be selected as appropriate.

  As shown in FIG. 6, the end GUI is arranged outside the normal display area including the editing area 202. In the example of FIG. 6, the GUI of the tool box 210 is arranged adjacent to the upper end of the normal display area, and the GUI of the heading tab 300 is arranged adjacent to the right end. Further, the GUI of the ring 240 is disposed adjacent to the left end.

  FIG. 7 is an explanatory diagram showing a transition from a normal display state (screen D10) to a state where the GUI of the toolbox 210 is displayed (screen D11) and a state where the GUI of the heading tab 300 is displayed (screen D12). It is.

  As shown on the screen D10, in the normal display state, the end 210a of the tool box 210 and the end 300a of the heading tab 300 are displayed at the end of the normal display area. In this way, by displaying the end portion 210a of the tool box 210 and the end portion 300a of the heading tab 300, the presence of the tool box 210 and the heading tab 300 can be understood even in normal display.

[1] Heading Tab The heading tab 300 will be described in more detail with reference to FIGS.

  FIG. 8 is an explanatory diagram showing the display operation of the heading tab 300. A bold frame indicates an area where the display unit 121 is displayed.

  As shown in FIG. 8, the heading tab 300 is not displayed (default) in the normal display state (screen D21), and only the end portion 300a (screen D10 in FIG. 7) is displayed. In this display state, (a) “left drag” with the finger 152 (drag the screen to the left with the finger 152) or (b) the pen 151 close to the right edge of the screen in the hover state (screen) D22), the screen slides to the left, and the entire heading tab 300 is displayed at the right end of the screen (screen D23).

  The operation for displaying the heading tab 300 with the finger 152 may be, for example, “left flick with a plurality of fingers”. The heading tab 300 that is hidden on the right side of the screen is displayed by opening the hand, touching the screen with multiple fingers, and moving the screen to the left, while turning the page with a flick of one finger. Then, it becomes easier to imagine the movement.

  When the heading tab 300 is touched with the finger 152 or the pen 151 on the screen D23, the application is switched to the application corresponding to the selected heading tab. Then, the screen is slid rightward so that the heading tab 300 is hidden.

  Here, when a tab of a different application is selected, a page used last in the application after switching may be displayed. When a tab of an application currently in use is selected, the user may jump to the first page of the application.

  In addition, when a predetermined cancel operation is performed while the heading tab 300 is displayed, the screen display (for example, a note) slides to the right, so that the heading tab 300 is not displayed. Examples of this canceling operation include “right drag”, “flick right with multiple fingers”, “release the pen from the right edge of the screen”, “touch an area other than the heading tab with your finger or pen”, “new operation” "When the state of not being continued for a certain period of time".

  FIG. 9 is an explanatory diagram illustrating a specific example of a relationship between a heading tab and an application.

  As described above, the electronic notebook device 100 according to the present embodiment has three functions of an electronic notebook, a schedule management, and the Internet as applications. Therefore, the heading tab 300 is provided with heading tabs 301, 302, and 303 of "electronic notebook", "schedule management", and "Internet" for each application.

[2] Tool Box The tool box 210 will be described in more detail with reference to FIG. FIG. 10 is an explanatory diagram showing the display operation of the toolbox 210. The processing of the tool box 210 may be performed by the electronic notebook function unit 142 instead of the end GUI processing unit 145.

  As shown in FIG. 10, the tool box 210 is not displayed (default) in a normal display state, and only the end 210a (screen D10 in FIG. 7) is displayed. In this display state, (a) “down drag” with the finger 152 (drag the screen downward with the finger 152) or (b) the pen 151 close to the upper end of the screen in the hover state (screen) D41), the screen slides downward, and the entire tool box 210 is displayed at the upper end of the screen (screen D42).

  The operation for displaying the toolbox 210 with the finger 152 may be, for example, “down flick with a plurality of fingers”. In contrast to a single-finger flick operation, open the hand, touch the screen with multiple fingers, and move the screen downward to display the toolbox 210 hidden on the upper side of the screen. This makes it easier to imagine the movement.

  Subsequently, when the user selects a tool in the tool box 210 by touching with the pen 151 or the finger 152, the tool box 210 is closed with the selected tool remaining in the screen (screen D43). As a result, the tool can be used (screen D44). When the user flicks the tool in the direction outside the screen, the tool is thrown in the flicked direction, and the selected state of the tool is released.

  In addition, when a predetermined cancel operation is performed while the tool box 210 is displayed, the tool box 210 is hidden by sliding the screen display (for example, a note) upward. Examples of this canceling operation include “up drag”, “flick up with multiple fingers”, “release the pen from the top of the screen”, “touch an area other than the toolbox with a finger or pen”, “new operation "When the state of not being continued for a certain period of time".

  The ring 240 (FIG. 6) is displayed when a page is added / deleted. Similarly to the tool box 210 and the heading tab 300, the ring 240 is also displayed by sliding the screen with a predetermined operation performed when the function is used as a trigger.

  In the present embodiment, in the normal display state, the end GUI that is set outside the display area is displayed when a predetermined input operation of a pen or a finger is performed. Although the display area is slid, the present invention is not limited to this. That is, the display area may be displayed by superimposing the end GUI on the screen display in the normal display state without sliding the display area. Specifically, in order to display the heading tab 300 and the tool box 210, the heading tab 300 and the tool box 210 may be superimposed on the upper end and the right end of the screen without erasing the left end and the lower end of the screen.

(Action / Effect)
As described above, the electronic notebook device 100 according to the present embodiment includes the end GUI processing unit 145 and is adjacent to the end of the display area outside the display area of the display unit 121 in a normal display state. As an input operation for displaying one end GUI (heading tab 300 or tool box 210) set in the display area of the display unit 121, an input operation with the finger 152 is assigned and an input with the pen 151 is performed. An operation is assigned.

  Here, FIG. 11 is a flowchart showing an operation when the end GUI processing unit 145 displays the end GUI.

  The end GUI processing unit 145 performs a predetermined input operation with the finger 152 on one end GUI that is set adjacent to the end of the display area outside the display area of the display unit 121 in a normal display state. When input (S1), it is displayed in the display area of the display unit 121 (S3). Alternatively, when a predetermined input operation with the pen 151 is input (S2), the end GUI is displayed in the display area of the display unit 121 (S3). That is, the end GUI processing unit 145 receives one end GUI when a predetermined input operation with the finger 152 is input (S1) or when a predetermined input operation with the pen 151 is input (S2). ) And displayed in the display area of the display unit 121 (S3).

  With the above configuration, the electronic notebook device 100 can provide a user interface that can call the same end GUI from both the finger 152 and the pen 151.

  As an example, the electronic notebook device 100 displays a heading tab 300 on the right side of the screen and a tool box 210 on the upper side of the screen that are not displayed during normal operation, and (a) one finger 152 (one or two). (It may be more than one), and when moving the paper left or down, or (b) touching or hovering the left and top edges of the screen with the pen 151, the headline The tab 300 or the tool box 210 is displayed.

  That is, when calling an end GUI (heading tab 300 or tool box 210) provided outside the display area on the normal screen, (a) the screen is touched with a finger 152 and the direction in which the end GUI is present is reversed. When the screen is slid in the direction, the end GUI outside the screen is displayed, or (b) when the end of the screen is touched or hovered with the pen 151, the end GUI outside the screen is displayed. Is done.

  Further, the electronic notebook device 100 displays a part of the end GUI so that the end GUI is outside the screen.

  In the electronic notebook device 100, the input operation by the finger 152 is an input operation in which the finger 152 is slid from the end of the display area where the end GUI is adjacently set to the inside (that is, in the direction away from the end). It is preferable that the input operation with the pen 151 is an input operation in which the end portion is touched with the pen 151. As a result, both the operation of sliding the finger in the direction opposite to the direction approaching the end GUI and the operation of touching the pen near the end where the end GUI exists exist in the display area of the display unit. A GUI can be displayed. Therefore, it is possible to provide a user interface that can call the end GUI by an intuitive operation.

  In addition, when the electronic notebook device 100 selects the heading tab 300, the electronic notebook device 100 displays a screen of an application corresponding to the tab. Also on the screen, a part of the heading tab 300 is displayed on the right side of the screen and a part of the tool box 210 is displayed on the upper side of the screen, the heading tab 300 is on the right outer side of the screen, and It can be seen that there is a tool box 210.

(Conclusion)
The present invention is not limited to the above-described embodiment, and various modifications are possible within the scope shown in the claims, and the present invention is also applied to an embodiment obtained by appropriately combining technical means disclosed in the embodiment. It is included in the technical scope of the invention.

  In the above, an example has been described in which each block of the electronic notebook device 100, in particular, the electronic notebook function unit 142 and the end GUI processing unit 145 is realized by software using a CPU.

  That is, the electronic notebook device 100 includes a CPU (central processing unit) that executes instructions of a control program that realizes each function, a ROM (read only memory) that stores the program, and a RAM (random access memory) that expands the program. And a storage device (recording medium) such as a memory for storing the program and various data. An object of the present invention is a recording medium on which a program code (execution format program, intermediate code program, source program) of a control program of the electronic notebook device 100, which is software that realizes the functions described above, is recorded so as to be readable by a computer. This can also be achieved by supplying the electronic notebook device 100 and reading and executing the program code recorded on the recording medium by the computer (or CPU or MPU).

  Examples of the recording medium include a tape system such as a magnetic tape and a cassette tape, a magnetic disk such as a floppy (registered trademark) disk / hard disk, and an optical disk such as a CD-ROM / MO / MD / DVD / CD-R. Card system such as IC card, IC card (including memory card) / optical card, or semiconductor memory system such as mask ROM / EPROM / EEPROM / flash ROM.

  The electronic notebook device 100 may be configured to be connectable to a communication network, and the program code may be supplied via the communication network. The communication network is not particularly limited. For example, the Internet, intranet, extranet, LAN, ISDN, VAN, CATV communication network, virtual private network, telephone line network, mobile communication network, satellite communication. A net or the like is available. Further, the transmission medium constituting the communication network is not particularly limited. For example, even in the case of wired such as IEEE 1394, USB, power line carrier, cable TV line, telephone line, ADSL line, etc., infrared rays such as IrDA and remote control, Bluetooth ( (Registered trademark), 802.11 wireless, HDR, mobile phone network, satellite line, terrestrial digital network, and the like can also be used. Each block of the electronic notebook device 100 may be configured by hardware logic.

  The present invention provides an intuitive user interface in an electronic notebook device that displays electronic information so that a user can view and edit the information using a finger and a pen. The present invention can be used widely and suitably in tablet PCs, portable terminals, and the like that have a touch panel interface and have an electronic notebook function.

100 Electronic notebook device (information processing device)
120 Touch Panel Unit 121 Display Unit 122 Position Input Unit (Touch Panel)
140 Main Control Unit 141 Application Unit 142 Electronic Notebook Function Unit 145 End GUI Processing Unit (End GUI Processing Unit)
151 Touch pen 152 Finger 210 Tool box (edge GUI)
300 Heading tab (edge GUI)

Claims (4)

In an information processing apparatus that displays electronic information on the display unit in response to an input operation on a touch panel configured integrally with the display unit,
In a normal display state, as an input operation for displaying one end GUI set adjacent to the end of the display area outside the display area of the display section in the display area of the display section by a finger. An information processing apparatus comprising an end GUI processing unit to which an input operation is assigned and an input operation with a pen is assigned.   2. The information processing according to claim 1, wherein the end GUI processing means displays a part of the end GUI at an end of the display area in which the end GUI is set adjacently. 3. apparatus.   The input operation with the finger is an input operation in which the finger is slid inward from the end of the display area where the end GUI is set adjacently, and the input operation with the pen touches the end with the pen. The information processing apparatus according to claim 1, wherein the information processing apparatus is an input operation. In a control method of an information processing apparatus that displays electronic information on the display unit in response to an input operation on a touch panel configured integrally with the display unit,
In a normal display state, one end GUI set adjacent to the end of the display area outside the display area of the display section is input when a predetermined input operation with a finger is input, or with a pen A control method for an information processing apparatus, comprising: a step of displaying in a display area of the display unit when a predetermined input operation is input.

Images