JPH1063408A - Portable information terminal equipment - Google Patents

Abstract

PROBLEM TO BE SOLVED: To improve operability by directly inputting a gesture in an editing document by a handwritten character input with a pen, editing and making the execution possible by only a handwritten input. SOLUTION: This device can directly input a gesture that carries out a specific function in editing document and is provided with a means which executed editing features which erases and converts document or characters in input frames 11 or an intermediate frame 12, etc., based on the function of a gesture when the gesture is recognized. It also is provided with a means which can register a gesture in an optional shape as a function in which a user edits a character.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

[0001] The present invention relates to a portable information terminal device.

[0002]

2. Description of the Related Art Conventionally, when inputting handwritten characters with a pen, the characters are input by handwriting in an input frame portion, and the recognized characters are displayed in an intermediate frame. At this time, if you make a mistake or if the entered character is misrecognized, touch the back or delete the function key with a pen to erase the mis-input characters or mis-recognized characters in the middle frame once and re-enter the input frame. Input handwritten characters from. If you want to delete or modify the character string established on the application display, move the cursor to the character to be deleted on the display, touch the back of the function key or delete with the pen to erase the character string once, Input the handwritten character again from the input frame. Alternatively, as another method of correcting the character in the intermediate frame, when a character that is erroneously recognized in the intermediate frame is touched with a pen, a character recognition candidate for the character input by handwriting is displayed. If there is a target character in the displayed character recognition candidates, the character is displayed in the intermediate frame by touching the character with a pen. If the target character is not included in the character recognition candidates, re-input is performed.

[0003]

Conventionally, for example, in the case of Hitachi's portable information terminal "PMC-1000", in the case of handwritten character input using a pen, if an erroneously input character or an erroneously recognized character is corrected, the character is deleted and input again. I do. To perform such editing, it was necessary to edit the characters using both handwriting input and function keys.

An object of the present invention is to improve operability by directly inputting a gesture into an edited document by handwriting input with a pen, editing the document, and enabling execution only by handwriting input.

[0005]

[MEANS FOR SOLVING THE PROBLEMS] To achieve the object,
According to the present invention, a gesture for executing a specific function can be directly input to an edited document, and when a gesture is recognized, a document or characters in an input frame or an intermediate frame can be deleted according to the gesture function. A means for executing an editing function such as conversion. In addition, there is provided means for allowing a user to register a gesture as a function of editing a character in an arbitrary form.

[0006]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS An embodiment of the present invention will be described below with reference to the drawings.

FIG. 16 shows a handwriting input pad of the portable information terminal device of the present invention. The input pad is displayed according to input means required for each application of the portable information terminal device. You can enter a character string in the application or edit the character string of the application. Also, handwriting recognition and kana-kanji conversion are possible. Applications that can be input using the handwriting input pad include a calendar, an address book, a memo pad, and a report. Also, the user can freely change the pad by using the "input switching" 36 or the direct switching key 33 such as "handwriting" or "symbol". With the handwriting input pad, characters can be input by handwriting using a pen. There are four input frames 11, and even if input from any frame, it is recognized in the writing order and the intermediate frame 1
2 is displayed. Recognition target of handwriting input is "Hiragana"
They are "Katakana", "Kanji", "Alphanumeric" and "Symbol". A character string input from the input frame 11 by handwriting is temporarily stored in an area called an intermediate frame 12 as an editing area. Some functions can be executed as functions on the character strings in the input frame 11 or the intermediate frame 12. For example, on the intermediate frame 12, editing by the function keys 34 is possible until the user fixes the character string to the application. A cursor 37 is displayed in the intermediate frame 12, and when the input character is recognized, it is displayed to the right of the cursor 37, and the cursor 37 moves to the right of the displayed character. The scroll button 35 is a key for moving the cursor 37 of the intermediate frame 12. The character recognized by the handwriting input is set as the recognized reading state in the intermediate frame 12.
Will be displayed. In the recognition reading state, a dotted underline is displayed in the character string. By touching the “conversion” key in the function keys 34, the kana-kanji conversion is performed, and the display is in an unestablished state. In the unestablished state,
Displays underline in the string. The character string in an unestablished state is displayed as an established state on the application by touching the “execute” key or the “line feed” key in the function keys 34. The "reverse" key deletes the character to the left of the cursor position 37. "Delete" deletes the character to the right of the cursor position 37. In “Recognition”, the input box 11
Are recognized and displayed in the intermediate frame 12. "space"
Puts a space before the cursor 37. The functions of these functions can be executed by the function keys 34 on the right of the input frame 11.

In the present invention, the functions of these functions are realized by manually inputting a specific gesture in the input frame 11. As an example, FIG. 1 shows an example in which the “retreat” function is first performed by a gesture. When "now", "date" and "wa" 16 are entered in the input frame 11, the intermediate frame 12
Is displayed, and "wa" 18 is in a state of waiting for recognition. Here, when the erroneous input “wa” is re-input to “ha” before “wa” is recognized, the input frame 11 of “wa” is input.
By inputting the gesture 13, the character is deleted and the "today" 19 is displayed. If you enter "ha" anew,
"Today" 1a is displayed in the intermediate frame 12. Alternatively, as shown in FIG. 2, “wa” 18 is recognized, and “now today” 21 is displayed in the intermediate frame 12, and then the gesture 14 is input into the input frame 11 to delete “wa” in the intermediate frame 12. When "ha" is newly input, "today is" 22
Is displayed. Alternatively, as shown in FIG. 3, the gesture 3a is directly input on the character
It is also possible to delete the character of "wa". Intermediate frame 12
FIG. 4 shows another example of deleting an arbitrary character in the character string displayed in FIG. When “Kawa wa today” 42 is displayed in the intermediate frame 12, the pen 41 is touched between “wa” and “ha”, and the cursor 37 is moved between “wa” and “wa”.
Here, when the gesture 14 is input from the input frame 11, “Wa” on the left side of the cursor 37 is deleted, and “Today is” 46 is displayed in the intermediate frame 12. Similarly, the “delete” function can be executed by a gesture. For example, when the gesture 51 corresponding to “delete” is input in the input frame in the scene of FIG. 5, the character on the right side of the cursor 27 is deleted. . "Today's day" 52 is displayed.

FIG. 18 shows an example in which a character is deleted by a gesture on a display 181 on an application.
When a part of the displayed document is to be deleted, when the gesture 182 is input, the character at the part where the gesture 182 is applied is deleted at a time.

Next, as an example, FIG. 6 shows an example in which the function of "space" is executed by a gesture. Figure 6 in the input box
When the gesture 61 is input as shown in FIG.
Cursor 37 moves to the right with a blank space for one character. The display is "Today" 63. To execute the “execute” and “line feed” functions with gestures, enter characters in the intermediate frame 12 and enter a gesture 71 as shown in FIG.
Will be displayed. It is also possible to execute the function of “conversion” by gesture. When a gesture 81 as shown in FIG. 8 is input to convert a character string input from the input frame 11 into kana-kanji characters, the character “Kyoha” 8 in the intermediate frame 12 is input.
2 is converted to Kana-Kanji, and “Today is” 83 is displayed in the intermediate frame 12.

As other examples, switching of character types, switching of full-width and half-width modes, switching of uppercase and lowercase modes for hiragana and alphabetic characters, copying (copying), cutting (cutting), pasting (pasting), depending on gestures registered by the user. , Recovery (undo) and the like. Switching the character type refers to a function of converting a handwritten input character into a corresponding one of hiragana, katakana, alphanumeric characters, Roman time, and a symbol. Switching between the full-width and half-width modes refers to a function of switching between displaying the size in full-width as in the input character “A” or displaying the size in half-width with half the width. Switching between uppercase and lowercase mode refers to a function of performing conversion such as "a" and "@" in hiragana, and "A" and "a" in English. When the copying gesture is performed, the selected character string is temporarily stored in the memory while being displayed. When the pasting gesture is executed at an arbitrary position on the display, the character string temporarily stored in the memory is displayed from the position where the gesture is input. When cut is performed, the display of the selected character string is deleted, temporarily stored in memory, and when paste is performed at any position on the display, the stored character string is displayed from the position where the gesture was input Is done. The recovery refers to a function of performing a recovery gesture to return a function executed immediately before to a state before execution.

According to the present invention, it is conceivable to execute a gesture function other than editing the display characters on the edited display of the document. For example, the user registers a gesture for adjusting the volume of the touch sound of the pen or the alarm sound of the clock function, and executes the gesture as needed on the edited display.
FIG. 17 shows an example of a gesture for adjusting the volume. Use gestures to increase, decrease, or eliminate sound. It is assumed that the user is registered as a gesture 172 for increasing the volume of the touch sound of the pen and a gesture 173 for decreasing the volume. When a gesture 172 is input on the display 171 on which editing is being performed, the sound becomes louder than the current pen touch sound. When the gesture 172 is input again, the rank is further increased by one rank. Thus, the setting can be made until the sound volume reaches the maximum state.
Conversely, by inputting the gesture 173, the volume can be set stepwise until there is no minimum sound. In FIG. 17, a method in which the user registers as a gesture for adjusting the brightness of the display may be considered. If the gesture 172 has a function of brightening the display and the gesture 173 has a function of darkening the display, the gesture can brighten or darken the display. Display on editing 17
When the gesture 172 is input at 1, the display becomes brighter than the current display. When the gesture 172 is input again, it becomes one rank brighter. Thus, it can be set until the display brightness reaches the maximum state. Conversely, by inputting the gesture 173, the display can be set to be gradually darkened.

According to the present invention, the following functions can be considered as functions by other gestures. A function of transmitting / receiving document data to / from another portable information terminal device or an information processing device such as a personal computer or a Japanese word processor is conceivable. FIG. 19 shows an example of transmitting the displayed edited document. Display of document edit 19
In step 1, when a gesture 192 for transmitting data is input, a condition setting screen 193 is displayed. The port to be used 194 and the communication speed 195 are set, and transmitted when the execution key is touched with a pen or an execution gesture is input. A method of using a modular line, RS-232C, as a transmission / reception port is also conceivable.

According to the present invention, the user can arbitrarily register a gesture for executing the function of the function of the handwriting input pad. The registration procedure is shown below. As shown in FIG. 9, “environment setting” 92 in “extended function” 91 is touched with a pen. Then, an environment setting selection screen as shown in FIG. 10 is displayed. "Gesture registration" 10 in it
Touch 1 with a pen, highlight it, and then “execute” 102
Touch with a pen. Then, the already registered gesture function list is displayed. FIG. 11 shows the display of the gesture function list. A handwriting gesture 111 is displayed on the left side, and a function 112 of a function to be executed is displayed on the right side. Here, “new” 113 or “correct” 114
Touching with a pen brings up the registration screen. "New" 11
Touching 3 with a pen displays a gesture registration screen as shown in FIG. A frame 121 for inputting a handwritten gesture is displayed on the left side, and a function frame 122 is displayed on the right side.
A list 123 of function functions is displayed below.
When a gesture is input with a pen in a frame 121 for inputting a handwritten gesture, and a function to be selected in a function list 123 below is touched with a pen, the selected function is displayed in a function frame 122. Then, when "Registration" 124 is touched with a pen, it is registered. "Modify" 1 in the gesture function list in FIG.
When 14 is touched with a pen, the screen shown in FIG. 12 is displayed in a state where the gesture indicated by arrow 115 has already been registered. A frame 121 for inputting a handwritten gesture is left blank on the left side,
The registered functions are displayed in the function frame 122 on the right side. To change the function, the function frame 122 on the right
Is touched with a pen, and the function selected from the function list 123 below is touched with the pen, and the selected function is displayed in the function frame 122. Frame 1 for inputting handwritten gesture on the left
Enter a gesture with a new pen at 21 and click “Registration” 1
Touching 24 with a pen registers a new gesture. A gesture priority column 125 and a character priority column 126 on the right side of the function list 123 are used to recognize a character or a gesture input from the input box 11 when a gesture that is recognized by both the character and the gesture is registered. Set whether to give priority to text or gestures. Recognition is performed with priority given to the check mark “X” in the gesture priority column 125 or the character priority column 126 check column.

FIG. 13 is a flowchart of a handwriting input process of the portable information terminal device of the present invention. A flowchart from a state 131 in which handwriting input is started in the input frame 11 with a handwritten input pad displayed on the screen is shown.
When a handwriting input is made in the input frame 11, recognition 132 is first performed as a gesture input. When the gesture is recognized, the editing 135 is performed by the function indicated by the gesture, and the editing result is displayed in the intermediate frame 12. If it is not recognized as a gesture, character recognition 134 is performed. As a result of the recognition, the corresponding character is displayed in the intermediate frame. When the execution or the line feed is executed, the display 136 of the intermediate frame 12 is displayed on the application. If no execution or line feed is performed, the process proceeds to the next input processing. Exit the handwriting input pad,
Or if you quit the running application,
The handwriting input process ends.

FIG. 14 is a block diagram of the control section 3 of the portable information terminal device of the present invention. The main control unit 142 controls the input device 1 by pen input. The storage device includes a main memory 1401, a data memory 1402, a program memory 1403, and a user data memory 1404. A display control unit 147 for controlling the display device 2 and the display memory 146; a power control unit 14 for controlling the power supply 148
9. In the user data memory 1404, a gesture of an arbitrary function of the user is registered. When handwritten characters are input on the handwriting input pad with a pen, the main control unit 142 converts analog data input from the input device 1 into digital data. The handwritten character data input from the input frame 11 is temporarily stored in the main memory 1401, where the main control unit 142 performs a gesture recognition process to determine whether the input handwritten character is a gesture registered as a function. If it is a gesture, the corresponding function is executed. If it is not a gesture, recognition as a character is performed. The input handwritten character data is stored in the display memory 146 at the same time as being stored in the main memory 1401, and is displayed on the display device 2. When the data stored as the handwritten character in the display memory 145 is determined to be a gesture, the data is deleted from the display memory 146.

FIG. 15 is a perspective view of a portable information terminal device according to the present invention. It comprises an input device 1 for inputting with a pen, a display device 2 for displaying an editing result, and a control unit 3 in the main body.

[0018]

According to the present invention, a portable information terminal device capable of inputting handwritten characters with a pen is provided with a means for inputting a gesture for executing a specific function in an edited document, so that it can be performed only by handwriting input. As a result, the usability of handwritten character input has improved. In addition, the operability of inputting handwritten characters is further improved by providing the user with a means for registering a gesture for executing a specific function from the input frame.

[Brief description of the drawings]

FIG. 1 is an explanatory diagram showing an operation example of executing a function by a gesture of the portable information terminal device of the present invention.

FIG. 2 is an explanatory diagram showing an operation example of executing a function by a gesture of the portable information terminal device of the present invention.

FIG. 3 is an explanatory diagram showing an operation example of executing a function by a gesture of the portable information terminal device of the present invention.

FIG. 4 is an explanatory diagram showing an operation example of executing a function by a gesture of the portable information terminal device of the present invention.

FIG. 5 is an explanatory diagram showing an operation example of executing a function by a gesture of the portable information terminal device of the present invention.

FIG. 6 is an explanatory diagram showing an operation example of executing a function by a gesture of the portable information terminal device of the present invention.

FIG. 7 is an explanatory diagram showing an operation example of executing a function by a gesture of the portable information terminal device of the present invention.

FIG. 8 is an explanatory diagram showing an operation example of executing a function by a gesture of the portable information terminal device of the present invention.

FIG. 9 is an explanatory diagram showing an operation screen for environment setting of the portable information terminal device of the present invention.

FIG. 10 is an explanatory diagram showing a gesture registration selection screen of the portable information terminal device of the present invention.

FIG. 11 is an explanatory diagram showing a gesture registration operation screen of the portable information terminal device of the present invention.

FIG. 12 is an explanatory diagram showing a gesture registration operation screen of the portable information terminal device of the present invention.

FIG. 13 is a flowchart of a handwriting input process of the portable information terminal device of the present invention.

FIG. 14 is a block diagram of a control device of the portable information terminal device of the present invention.

FIG. 15 is a perspective view of a main body of the portable information terminal device of the present invention.

FIG. 16 is an explanatory view showing a handwriting input pad of the portable information terminal device of the present invention.

FIG. 17 is an explanatory view showing an example of a gesture for adjusting the volume of the portable information terminal device of the present invention.

FIG. 18 is an explanatory view showing an operation example of executing a function by a gesture of the portable information terminal device of the present invention.

FIG. 19 is an explanatory diagram showing an operation example of executing a function by a gesture of the portable information terminal device of the present invention.

[Explanation of symbols]

DESCRIPTION OF SYMBOLS 1 ... Input device, 2 ... Display device, 3 ... Control device, 11 ... Input frame, 12 ... Intermediate frame.

Claims (6)

[Claims] An input device for inputting at least a desired character or symbol or an instruction of an editing function with a pen, a display device for displaying the input character or symbol, or an editing result, and the input device and the display device In a portable information terminal device comprising a control device for controlling and having means for recognizing that a trajectory of handwriting input is an instruction of an editing function, an area having a plurality of input areas and inputting an instruction of a handwriting editing function A portable information terminal device comprising means for executing an editing function corresponding to the document. 2. An input device for inputting at least a desired character or symbol or an instruction of an editing function with a pen, a display device for displaying the input character or symbol, or an editing result, and the input device and the display device. In a portable information terminal device comprising a control device for controlling and having means for recognizing that a trajectory of handwriting input is an instruction of an editing function, a user registers an instruction of a handwriting editing function for an arbitrary function. A portable information terminal device comprising means. 3. An input device for inputting at least a desired character or symbol or an instruction of an editing function with a pen, a display device for displaying the input character or symbol, or an editing result, and the input device and the display device. In a portable information terminal device comprising a control device for controlling and having means for recognizing that the trajectory of handwriting input is an instruction of an editing function and means for determining a rectangular area indicated by the trajectory of handwriting input, A portable information terminal device comprising means for editing a document in an arbitrary rectangular area according to a function instruction. 4. An input device for inputting at least a desired character, symbol, or function instruction with a pen, a display device for displaying the input character, symbol, or editing result, and controlling the input device and the display device. The handwriting function for adjusting the volume of a pen input sound or a clock function alarm sound in a portable information terminal device comprising a control device for recognizing that a trajectory of handwriting input is a function instruction. A portable information terminal device comprising means for adjusting a volume by inputting an instruction of (1). 5. An input device for inputting at least a desired character or symbol or an instruction of a function with a pen, a display device for displaying the input character or symbol, or an editing result, and controlling the input device and the display device. A portable information terminal device configured to recognize that the trajectory of the handwriting input is a function instruction, and to input the instruction of the handwriting function for adjusting the brightness of the display of the display device. Then, a portable information terminal device comprising means for adjusting display brightness. 6. An input device for inputting at least a desired character or symbol or an instruction of a function with a pen, a display device for displaying the input character or symbol, or an editing result, and controlling the input device and the display device. A portable information terminal device having means for recognizing that the trajectory of handwriting input is an instruction of a function between the portable information terminal device and an information processing device capable of transmitting and receiving data. A portable information terminal device comprising means for transmitting edited document data or receiving data of the portable information terminal device or the information processing device in accordance with an instruction of the handwritten function.