JP3385965B2 - Input device and input method - Google Patents

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an input device and an input method, and more particularly, to an input device and an input method used in a portable information processing device that processes various data using a pen.

[0002]

2. Description of the Related Art [1] First conventional example In Japanese Patent Application Laid-Open No. 8-179872, an electrostatic coupling type tablet is superposed with an ultrasonic type touch panel, and a pen input by a dedicated pen type pointing device is electrostatically charged. One input device for fine input such as handwritten characters by pen input and selection input such as menu input by touch input by identifying touch input with a finger on an ultrasonic touch panel with stylus limitation. It is disclosed that it can be done in.

[2] Second Conventional Example In addition, a mouse has been conventionally used as an input device for a computer. The mouse is a multi-directional detection device (= normally,
Ball) and buttons for selecting items and commands on the display screen of the computer.

[0004]

In the input device described in the above-mentioned first conventional example, the structure of the panel is complicated because the ultrasonic touch panel is stacked on the electrostatic coupling type tablet. There was a problem.
The mouse of the second conventional example is a relative pointing device, and the position on the moving surface of the mouse itself does not directly correspond to each position on the screen. There was a problem that was bad. Further, in the handheld type information terminal device, there is a problem that an operation surface for operating the mouse cannot be secured. Therefore, an object of the present invention is to provide an input device and an input method capable of improving the operability by simplifying the operation method and the device configuration when various inputs are made to a portable information processing device using a pen. It is in.

[0005]

In order to solve the above problems, the present invention provides a pen type input means for specifying an operation position and data for inputting data by bringing the pen type input means into contact with each other. While having an input surface, a touch screen means for displaying various data and a contact state of the pen type input means with the data input surface are detected to determine whether or not the pen type input means is in a hold state. and a hold condition detecting means for detecting the hold state detection
If the output means detects that the
In the vicinity of the hold position of the pen-type input means,
Touch screen to display the processing menu corresponding to the position
And a pen-type input means for displaying on the input means.
Corresponds to the processing when it is detected that is tapped.
To the default selection position of the processing menu
And a hold state processing means for displaying .

In the present invention , the hold state detecting means includes contact time detecting means for detecting whether or not the pen type input means continuously contacts the data input surface for a predetermined reference time or longer. A contact position detecting means for detecting whether or not a contact position on the data input surface of the pen-type input means is within a predetermined reference range; and a detection of the contact time detecting means and the contact position detecting means. Based on the result, the pen-type input means has been in contact with the data input surface for the predetermined reference time or longer, and the contact position is within the predetermined reference range within the continuous contact time. In this case, a hold state determination means for determining that the pen type input means is in the hold state,
May be provided .

[0007]

[0008]

[0009]

Further , the present invention has a pen for specifying an operation position, a data input surface for inputting data by bringing the pen into contact, and a touch screen for displaying various data, The contact state of the pen with the data input surface is detected to detect whether or not the pen is in the hold state, and when the pen is in the hold state, the touch position is near the hold position of the pen.
Touch screen to display the processing menu corresponding to the field position.
It is a unit to be displayed on the screen and the pen is tapped
Processing item corresponding to the processing when it is detected that there is a state
Display the eyes in the default selection position of the processing menu.
And a hold state processing unit.

Further, according to the present invention, in the input method of the input device for inputting data by bringing the pen into contact with the data input surface of the touch screen, the contact state of the pen with respect to the data input surface of the touch screen is detected. A hold state detecting step of detecting whether or not the pen is in a hold state, and a hold state near the hold position of the pen when the pen is in the hold state.
The processing menu corresponding to the position is displayed on the touch screen.
In the step of displaying, the pen is in a tapped state
The processing item corresponding to the processing when it is detected
It is characterized by having a hold state processing step of displaying the default selection position of management menu, the.

[0012]

DESCRIPTION OF THE PREFERRED EMBODIMENTS Next, preferred embodiments of the present invention will be described with reference to the drawings. [1] System Configuration of Information Terminal Device FIG. 1 is an external perspective view for explaining the system configuration of the information terminal device of the embodiment. The information terminal device 1 displays various information on the liquid crystal display 10, and
1, a transparent touch panel 12 for inputting various data and a touch screen 13 provided on the liquid crystal display 10, and another information terminal device 1 '.
An infrared communication port 14 for performing infrared communication with a mobile phone 15, a PHS (Personal Handyphone System) 16, a PHS unit 17 that realizes a PHS function in cooperation with the information terminal device 1, a personal computer (P) not shown.
A communication connector 2 to which a PC connection cable 18 for connecting to C), a modem connection cable 19 for connecting to a modem (Modem) not shown, and the like are connected
0, a charger connection connector 22 to which a charger 21 for charging a built-in battery (not shown) is connected, and a memory card (Compact Flash etc.) 23 for storing various data to be inserted for connection. A memory card slot 24 and a GPS connector (not shown) provided on the back surface of the information terminal device 1 for connecting a GPS (Global Positioning System) unit 25 for measuring the current position, altitude, etc. of the information terminal device 1. , And a microphone 26 for performing voice input.

[2] Schematic configuration of the information terminal device in actual use FIG. 2 shows an example of a schematic configuration block diagram of the information terminal device in actual use. The information terminal device 1 includes a mask ROM 30 that stores an operating system (OS) and various applications, and a CPU that controls the information terminal device 1.
31, a RAM 32 for executing an application, a data communication device 33 for performing various data communications, an internal RAM 34 for storing internal data, and a touch screen 13, and a liquid crystal display 10 for displaying various data.
A transparent touch panel 12 that constitutes the touch screen 13 and inputs various data; a GPS unit 25 for measuring the current position and altitude of the information terminal device 1;
A microphone 26 for voice input and an image of a subject are captured,
And a digital camera 35 that stores the still image as digital data.

[3] Outline Operation of Information Terminal Device Next, the operation of the information terminal device will be described with reference to the processing flowchart of FIG. When the information terminal device 1 is powered on (step S1) and the user starts the application (step S2) and operates the pen 11 (step S3), the CPU 31 once makes the pen 11 contact the transparent touch panel 12. Without leaving
It is determined whether or not the transparent touch panel 12 remains in contact for a predetermined time or longer (step S4).

If it is determined in step S4 that the pen 11 has separated from the transparent touch panel 12 within a predetermined time after contacting the transparent touch panel 12, the CPU 31
Determines that it is a tap operation (step S
5) It is determined whether or not the tapped position corresponds to the display position of the text character string (step S6).
If it is determined in step S6 that the tapped position is the position corresponding to the display position of the text character string (step S6; Yes), the cursor is moved to the position (step S7) to determine whether the operation is finished. It is determined (step S15). If it is determined in step S15 that the operation has ended (step S15; Yes), the process ends.

If it is determined in step S15 that the operation has not ended (step S15; No), the process proceeds to step S3 again. In the determination in step S6, if the tapped position is not the position corresponding to the display position of the text character string (step S6; No), the operation corresponding to the tap position is executed (step S8), and after the operation is executed, It is determined whether or not the operation is completed (step S1)
5).

If it is determined in step S15 that the operation has ended (step S15; Yes), the process ends. If it is determined in step S15 that the operation has not ended (step S15; No), the process proceeds to step S3 again.

When it is determined in step S4 that the pen 11 has been in contact with the transparent touch panel 12 for a predetermined time or more (step S4; Yes), the pen 11 is moved while being in contact with the transparent touch panel 12. Whether or not the pen 11 is the transparent touch panel 1
It is determined whether or not the variation of the contact position is within the predetermined reference range (= within the movement error permissible range) while keeping the contact with # 2 (step S9).

When it is determined in step S9 that the pen 11 is not moving while being in contact with the transparent touch panel 12 (step S9; No), the CPU 31 determines that it is a hold operation (step S10), and the hold operation is performed. A shortcut menu is displayed at the display position of the display device corresponding to the position (step S11), and it is determined whether or not the operation is completed (step S15).

If it is determined in step S15 that the operation has ended (step S15; Yes), the process ends. If it is determined in step S15 that the operation has not ended (step S15; No), the process proceeds to step S3 again. In the determination of step S9,
When the pen 11 is moving while the pen 11 is in contact with the transparent touch panel 12 (step S9; Ye
s), the CPU 31 determines that it is a drag operation (step S12), and determines whether the dragged position is a position corresponding to the display position of the text character string or the display position of the map data (step S13).

If it is determined in step S13 that the dragged position corresponds to the display position of the text character string or the display position of the map data (step S13; Yes), range selection for selecting the drag range is performed. The operation is performed (step S14), and it is determined whether or not the operation is completed (step S15). If it is determined in step S15 that the operation is completed (step S15;
Yes), and the process ends. If it is determined in step S15 that the operation is not completed (step S15; N
o), the process moves to step S3 again.

[4] Specific Operation of Information Terminal Device [4.1] When Operation Target is Text Object First, a specific operation when the operation target is a text object will be described. In this case, a case where an editor program having an editor function capable of handling various objects (images, sounds, etc.) is operated as the application program will be described.

When the power of the information terminal device is turned on and the user taps the position corresponding to the editor program from the start menu (not shown) using the pen 11, the CPU 31 reads the editor program from the mask ROM 30, To start. Thus, as shown in FIG. 4, the character string input cursor CS is displayed at the character input position of the editor program.

Next, among the off-screen icons OSI1 to OSI9 (see FIG. 4) for the user to provide a common function regardless of the type of application,
Off-screen icon O corresponding to soft keyboard
By tapping the display position of SI5, the soft keyboard SKEY is activated as shown in FIG. Soft keyboard SKEY on the editing screen of the editor program
To "1" → "2" → ... → "8" → "9" in order, tapping the keyboard on the screen with the pen 11, and input the character string "123456789".

By tapping the enter key ENT with the pen 11, the character string "123456789" is transferred and displayed on the editing screen of the editor program. In this state, the character string input cursor CS is positioned behind "9" as shown in FIG. 6, so that the pen 11 is tapped in front of the character "1". As a result, the character string input cursor CS moves to the position before the character "1".

Next, the position of the character string input cursor CS is designated again with the pen 11, and the pen 11 is moved to the transparent touch panel 12
Without moving from, move in the direction of the character "9". As a result, the CPU 31 determines that the pen operation is a drag operation and, assuming that the range of the character string “123456789” is selected, displays the character string in reverse video as shown in FIG. 7. Then, the operation state is changed depending on which of the following three operations is performed.

If the position before the character “1” is tapped again, the selection range is canceled and the state before the range selection operation is restored. If dragging is continued without releasing the pen 11 as it is, the drag range including the character string “123456789” is selected and highlighted. The range of the character string "123456789" is selected,
When the pen 11 is not released from the transparent touch panel 12 at the position of the character "9" in the highlighted state, the holding operation is determined, and as shown in FIG. 8, the vicinity of the selected character string is selected. A shortcut menu SCM for performing a plurality of processes (cut, copy, data delete, color, size, typeface in FIG. 8) that can be performed on the character string is displayed.

When the pen 11 is released from the transparent touch panel 12 when the shortcut menu SCM is displayed, the shortcut menu SCM remains displayed. , The character string “123456789” is cut out and stored in a buffer memory (not shown).

[4.2] When the Operation Target is an Object Other than Text Next, a specific operation when the operation target is an object other than text will be described by taking as an example the case where the object is an image taken by a digital camera. When the power of the information terminal device 1 is turned on and the user taps the position corresponding to the editor program from the start menu (not shown) using the pen 11, the CPU 31
Reads the editor program from the mask ROM 30 and activates it. As a result, a character string input cursor is displayed at the character input position (see FIG. 4).

Next, the user selects the off-screen icon O
SI1-OSI9 (see FIG. 4) digital camera 34
The digital camera application is activated by tapping the display position of the off-screen icon OSI8 corresponding to. Then, the user uses the digital camera 34
When the subject is photographed by and the screen is returned to the editor edit screen, the image corresponding to the photograph photographed by the digital camera application is automatically saved by using the clipboard (temporary save function).

Next, the pen 1 is set to the image insertion position corresponding to the photographed picture on the editing screen of the editor program by the user.
If you specify 1 and hold the pen 11 at that position,
A shortcut menu for image editing is displayed near the hold position. The user drags the pen 11 to a position where the display of "paste" in the shortcut menu is highlighted, and when the display of "paste" is highlighted, releases the pen 11. In addition, this operation is
This can also be done by releasing the pen 11 once and tapping the "paste" menu display position when the image editing shortcut menu is displayed. As a result, the image taken by the digital camera 34 is inserted at the position designated by the pen 11.

[4.3] When operating the image object itself When the image is displayed on the edit screen of the editor program, tapping the image with the pen 11 causes the image to be displayed on the full screen. Then tap again to display the original size again.

With the display in the original size,
When the display area of the image is held with the pen 11, the shortcut menu S near the image is displayed as shown in FIG.
CM is displayed. In this case, the menu at the default selection position of the shortcut menu (the menu that is highlighted first. Hereinafter, referred to as the default selection menu) DFM is "full screen display",
The menu corresponds to the same operation as when tapped.

Then, the pen 1 is moved to the position where the display of "full screen display" in the shortcut menu SCM is highlighted.
When 1 is dragged and the pen 11 is released, the image is displayed on the full screen. Then tap again to display the original size again. As described above, the default selection position of the shortcut menu when operating an object other than text (usually the beginning of the shortcut menu) is the default selection for performing the same operation as when the object is tapped. The menu DFM is displayed.

With this, by holding the pen 11 before tapping, it becomes possible to easily confirm the operation performed when tapping. For example, in the case of objects other than image objects, the following actions are displayed as default actions at the default selection position.・ Voice (sound) object → play / stop ・ Position object → Map display application (map viewer) startup ・ PIM (Personal Information Management) object → PIM (Personal Information Manager) application startup [scheduler, address book, etc.]

[5] Effects of the Embodiments As described above, according to the present embodiment, there are three types of pen operations: (single) tap, hold, and drag, and the pen touches the display screen. Since it works in the pressed state, it can be operated stably. When you operate an object other than text, hold the pen and display the shortcut menu. The default selection position (usually the beginning of the shortcut menu) is the same as when you tap the pen at the same position. Since the same menu is displayed, even if you forget the action when you tap the pen, you can know the default action of the object by performing the hold action, and you can continue the operation as it is. .

[0037]

According to the present invention, since the holding operation of the pen-type input means is detected and various operations are performed, the device configuration can be simplified and the device can be downsized. Also, compared to the case of double-clicking (or double-tapping) like a mouse, it is possible to operate with the pen-type input means in contact, so there is no need to consider misalignment, especially hand-held type. It is possible to improve the certainty of operation and the operability of the portable information processing device.

[Brief description of drawings]

FIG. 1 is an external perspective view of an information terminal device according to an embodiment.

FIG. 2 is a schematic configuration block diagram of an information terminal device.

FIG. 3 is a schematic operation process flowchart.

FIG. 4 is an operation explanatory diagram (1) in the case where the operation target is a text object.

FIG. 5 is an operation explanatory diagram (2) in the case where the operation target is a text object.

FIG. 6 is an operation explanatory diagram (3) when the operation target is a text object.

FIG. 7 is an operation explanatory diagram (No. 4) when the operation target is a text object.

FIG. 8 is an operation explanatory diagram (No. 5) when the operation target is a text object.

FIG. 9 is an explanatory diagram of the operation when the operation target is the image object itself.

[Explanation of symbols]

1 ... Information terminal device 10 ... Liquid crystal display 11 ... pen 12 ... Transparent touch panel 13 ... Touch screen 14 ... Infrared communication port 15 ... Mobile phone 16 ... PHS 17 ... PHS unit 18 ... PC connection cable 19 ... Modem connection cable 20 ... Communication connector 21 ... Charger 22 ... Connector for charger 23 ... Memory card 24 ... Memory card slot 25 ... GPS unit 26 ... Mike 30 ... Mask ROM 31 ... CPU 32 ... RAM 33 ... Data communication device 34 ... Internal RAM 35 ... Digital camera CS: Character string input cursor DFM ... Default selection menu OSI1 to OSI9 ... Off-screen icons SCM ... Shortcut menu SKEY ... Soft keyboard

─────────────────────────────────────────────────── ─── Continuation of front page (58) Fields surveyed (Int.Cl. ⁷ , DB name) G06F 3/03 G06F 3/00 G06F 3/14

Claims (4)

(57) [Claims] 1. A touch screen means for displaying various data while having a pen type input means for specifying an operation position and a data input surface for inputting data by bringing the pen type input means into contact with each other. A hold state detecting means for detecting whether or not the pen type input means is in a hold state by detecting a contact state of the pen type input means with the data input surface; and a hold state by the hold state detecting means. Is in a state
Hold of the pen type input means when it is detected
A processing menu corresponding to the hold position near the position
Means for displaying on the touch screen means,
Detected that the pen type input means is in a tapped state
If the processing item corresponding to the
Hold status processing means to be displayed at the fault selection position
Input apparatus characterized by comprising a, the. 2. The input device according to claim 1, wherein the hold state detection unit is the pen type input unit,
A contact time detecting means for detecting whether or not the data input surface is continuously in contact with the data input surface for a predetermined reference time or more; and a contact position on the data input surface of the pen-type input means for a predetermined reference Based on the contact position detection means for detecting whether or not it is within the range, and the detection results of the contact time detection means and the contact position detection means, the pen-type input means on the data input surface for the predetermined reference time or longer. Hold state determination means for determining that the pen type input means is in the hold state when the contact position is within the predetermined reference range within the contact time and the continuous contact time. An input device comprising: 3. A touch screen having a pen for specifying an operation position, a data input surface for inputting data by contacting the pen, and a touch screen for displaying various data, and the data for the pen. Detects the state of contact with the input surface,
Detecting whether the pen is on hold, the pen hold when the pen is in the hold state
A processing menu corresponding to the hold position near the position
A unit to be displayed on the touch screen,
Processing when it is detected that the pen is in a tapped state
Select the processing item corresponding to the default selection in the processing menu above.
An input device, comprising: a hold state processing unit that is displayed at a selected position . 4. An input method of an input device for inputting data by bringing a pen into contact with a data input surface of a touch screen, detecting a contact state of the pen with respect to the data input surface of the touch screen. , a hold state detection step of the pen to detect whether the hold state, the pen ho when the pen is in the hold state
The processing menu corresponding to the hold position near the field position.
Is displayed on the touch screen.
When it detects that the pen is in the tapped state,
The processing items corresponding to the processing are displayed in the default of the processing menu.
Input method characterized by having a hold state process to be displayed on bets selected position.