JP2000099223A - Data processor with handwritten character input interface and storage medium - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a data processor having the handwritten character input interface which facilitates the operation and has good operation efficiency when a handwritten character is misrecognized. SOLUTION: When a handwritten character input frame 21 wherein one of character candidates is displayed is specified with a pen 1, a pen input GUI (graphical user interface) 2 displays character candidates for the handwritten character in the handwritten character input frame 2 and executable editing commands such as the deletion of the input frame and the rewriting of the handwritten character together; when one of the character candidates is selected, the display of the character candidate in the character input frame 21 is changed to the display of the selected character candidate and when one of the editing commands is selected, the selected editing command is executed for the specified handwritten character input frame 21.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

TECHNICAL FIELD The present invention relates to an electronic pen (hereinafter, referred to as an electronic pen).
A portable information terminal device having a handwritten character input interface for recognizing a handwritten character written by a coordinate input device such as a pen and providing a character code obtained as a result of the recognition to another application program; The present invention relates to a data processing device such as a computer and a recording medium on which a computer program for inputting handwritten characters is recorded.

[0002]

2. Description of the Related Art For example, Microsoft Pen Servic
In e-Windows 95, pen-operated computers such as Fujitsu's FM Pen-Note and portable information terminals such as Sharp's Zaurus have a liquid crystal display with a thin grid on the surface for position detection. Provides a pen input interface that allows a user to input characters by handwriting with a pen.

[0003] The pen input interface displays handwriting of handwritten characters entered with a pen in an input frame, cuts out characters based on the input frame, and converts character pattern data consisting of coordinate time series data of the input characters. The character candidate is passed to the character recognition engine, and among the plurality of character candidates obtained as a result of the recognition by the character recognition engine, for example, a character candidate having the highest score is displayed. The user confirms the displayed character candidate, and selects another character candidate if necessary, or corrects the character by re-input,
Edits such as insertion and deletion of characters. When the user who has obtained the desired character string taps the transfer button, the transmission button, and the like with the dedicated pen, the character code of the character candidate is transferred to another application program.

The above-described pen input interface is roughly classified into the following two systems. One is a system typified by a Zaurus manufactured by Sharp Corporation, as shown in FIG. 1, in which an input frame for entering characters, an area for displaying a recognition result, and an area for performing an editing operation including correction are provided. It is a separate separation method. In the separation method, when a character is written in the lower input box with a pen (a), the recognition result is displayed in another upper area, and the handwriting of the handwritten character in the input box is erased (b).

At this time, for example, if the handwritten character "hand" is erroneously recognized as "cow", when the user touches "cow" of the recognition result with a pen, the character candidate is displayed in reverse video, and a plurality of recognized characters are displayed. The candidates are displayed, for example, superimposed on the input frame (c). When the desired character candidate “hand” is included in the displayed character candidates, when the user touches and selects the “hand” with the pen, the “cow” of the recognition result is changed to “hand”. .

On the other hand, if the desired character candidate is not included in the plurality of character candidates, the user presses the "delete" or "delete" button to temporarily delete the display of the character candidates and to display the upper area. Confirm that the cursor is before or after "cow" and rewrite the "hand" character in the input box (d)
. As a result of the rewriting, if the correct recognition result is displayed in the upper area, press the "Delete" button to delete the erroneously recognized character "cow" (you may delete it before rewriting) .

[0007] The other is a method represented by "draft book" implemented in Microsoft Pen Service for Windows 95 as shown in FIG. The area for displaying the result and performing the editing operation including the correction is the same integrated system. In the integrated method, when a character is entered in the input frame with a pen (a), the handwriting of the handwritten character in the input frame is erased, and the recognition result is displayed at the position of the input frame (b).

At this time, for example, if the handwritten character "hand" is erroneously recognized as "cow", when the user taps the "cow" input box with a pen, a plurality of recognition candidates are displayed in a pop-up window, for example. (C). When a desired character candidate “hand” is included in the displayed character candidates, when the user touches and selects the “hand” with a pen, the pop-up window is closed and the “cow” in the input box is closed. Changed to "Hand".

On the other hand, if the desired character candidate is not included in the plurality of character candidates, the user closes the pop-up window, temporarily erases the display of the character candidate, and inputs the erroneously recognized "cow". Overwrite the word "hand" on the frame
(d). If "hand" is displayed in the character frame as a result of recognition of the rewritten character, the correction is completed.

[0010] In the case of Microsoft "draft book", editing operations such as insertion and deletion can be performed by a preset insertion,
It can also be performed by an editing gesture by handwriting an editing symbol such as deletion (e). In this case, the handwritten character and the editing gesture are separately identified by recognizing the shape of the gesture. Note that tapping the input frame for displaying a plurality of character candidates is also one of the editing gestures. In such an integrated system, a new input frame appears by scrolling the screen.

[0011]

As described above, in the handwritten character input interface, when a desired character is included in another character candidate when a handwritten character is erroneously recognized, the character is not displayed. It is only necessary to select from among, but whether or not the desired character is included in other character candidates is
Once these character candidates are displayed, they cannot be known.

Further, if the desired character is not included in the plurality of character candidates, an operation of deleting the display of the character candidate is performed, and then, in the separation method, the cursor is moved, and the character candidate which is erroneously recognized is removed. Deletion, rewriting of handwritten characters, etc.
Further, in the integrated system, editing operations such as selection of an input frame and rewriting of handwritten characters have to be performed. Therefore, when a handwritten character is erroneously recognized, the operation is complicated and work efficiency is poor.

The present invention has been made in order to solve such a problem, and a plurality of character candidates and an edit command which can be executed by simply designating a character candidate which is erroneously recognized as a handwritten character. By displaying them collectively on the same pop-up menu and letting the user select
It is an object of the present invention to provide a data processing device having a handwritten character input interface which is easy to operate when handwritten characters are erroneously recognized and has good work efficiency, and a recording medium on which a computer program for handwritten character input is recorded.

[0014]

According to a first aspect of the present invention, there is provided a data processing apparatus for recognizing a handwritten character from coordinate time series data of the handwritten character entered in an input frame, and obtaining one or more characters obtained as a result of the recognition. Any one of the candidates is displayed in the input box, another character candidate other than the displayed character candidate or all the character candidates are displayed, and the input box in which the handwritten characters are entered can be edited. In a data processing apparatus having a character input interface, means for designating an input frame, and when the input frame is designated by the means, one or a plurality of character candidates of handwritten characters written in the input frame can be executed. Means for collectively displaying edit commands, means for selecting one or more of the character candidates and edit commands displayed by the means, and one or more character candidates If one of them is selected, the display of the character candidates in the specified input box is changed to the display of the selected character candidates, and if any of the editing commands is selected, the display of the specified input box is changed. And means for executing the selected editing command.

In the first invention, for example, when the input frame is designated by tapping the input frame with a pen in the above-described integrated system, or by moving the cursor before or after a character candidate in the separation system, One or more character candidates for the handwritten character entered in the input frame and an editing command capable of executing deletion of the input frame, insertion of the input frame before and after the input frame, rewriting of the handwritten character, and the like, for example, are the same. When the user selects one or more of the displayed character candidates, the display of the character candidates in the designated input box is selected. Is changed to the display of the selected character candidate, and when any of the editing commands is selected by the user, the selected editing command is executed in the designated input frame. Therefore, operation when handwritten characters are erroneously recognized is simple, and work efficiency is good.

The data processing apparatus of the second invention recognizes the handwritten character from the coordinate time-series data of the handwritten character entered in the input frame, and displays one of a plurality of character candidates obtained as a result of the recognition. In a data processing device having a character input interface, means for designating whether a handwritten character is recognized as a full-width character or a half-width character, and, when the handwritten character is designated to be recognized as a half-width character, Means for making the width of an unfilled input box narrower than when it is designated to be recognized as full-width characters.

In the second invention, when the handwritten character is designated to be recognized as a half-width character, the handwritten character is designated so as to recognize the width of an unfilled input frame as a full-width character. , For example, halving it. Therefore, it is possible to easily identify whether a handwritten character is recognized as a full-width character or a half-width character. For example, a character such as an alphabetic character or a number to be input as a half-width character is recognized as a full-width character. Problems such as rejection when character codes are transferred to the program do not occur. Also, even when the number of input frames that can be displayed on one screen is limited due to restrictions on the screen area, for example, twice as many input frames can be displayed on one screen as in a full-width case, so A character string that has many digits, such as a number and an e-mail address, and can be input at a stretch without scrolling the screen can be input on one screen.

A recording medium according to a third aspect of the present invention causes a computer to recognize the handwritten character from the coordinate time-series data of the handwritten character entered in the input box, and obtains one of a plurality of character candidates obtained as a result of the recognition. One in the input box, and the computer displays the other or all the character candidates other than the displayed character candidate, and causes the computer to edit the input box in which the handwritten character is entered. In a readable recording medium, program code means for causing the computer to accept designation of an input frame, and when the input frame is designated, the computer provides one or more of handwritten characters written in the input frame to the computer. Program code means for collectively displaying character candidates and executable edit commands; Program code means for accepting a selection from a number of character candidates and an edit command; and displaying one or more character candidates in a specified input frame on the computer when any one or a plurality of character candidates are selected. To display the selected character candidate, and, when any of the editing commands is selected, a program code means for causing the computer to execute the selected editing command for a specified input frame. And characterized in that:

In the third invention, the computer reads the computer program on the recording medium, and for example, by tapping the input box with a pen in the above-described integrated system, or by moving the cursor before or after the character candidate in the separated system. When the input frame is designated, one or more character candidates for the handwritten character entered in the input frame, execution of deletion of the input frame, insertion of the input frame before and after the input frame, rewriting of the handwritten character, etc. Are displayed collectively, for example, by displaying them in the same pop-up menu, and when one of the displayed one or more character candidates is selected by the user, the specified input is performed. Change the display of the character candidates of the frame to the display of the selected character candidate,
When one of the editing commands is selected by the user, the selected editing command is executed in the designated input frame. Therefore, a computer program for providing a handwritten character input interface can be provided via a portable recording medium such as a CD-ROM or an MO, or via a line.

[0020]

FIG. 3 is a block diagram of a data processing apparatus having a handwritten input character interface according to the present invention (hereinafter, referred to as the present invention apparatus). Pen input GUI (Grap
hical User Interface) 2 draws a handwritten character with a pen 1 in a handwritten character input box (hereinafter referred to as an input box) 21 drawn on a display screen.
I2 displays a handwriting of a handwritten character if no character candidate as a recognition result is displayed in the input frame 21 and, when a predetermined time elapses (Time Out) without any input to the input frame 21, Coordinate time-series data obtained by cutting out the handwritten characters in the input frame as one character is used as a character recognition engine 3
Pass to.

The character recognition engine 3 passes the character codes of a plurality of character candidates obtained as a result of recognition to the pen input GUI 2 together with their scores, and the pen input GUI 2
The handwriting of the first handwritten character is cleared, and the first character candidate is displayed in the input frame 21 in the case of the above-described integrated system, or in an area provided separately from the input frame 21 in the case of the separated system. .

When the input frame 21 displaying the character candidates is selected by tapping the pen 1 in the case of the above-described integrated system, and when the character candidate of the recognition result is selected by moving the cursor in the separation system, The pen input GUI 2 includes a plurality of character candidates passed from the character recognition engine 3 and the input box 21.
And editing commands that can be executed, such as deleting an input frame, inserting an input frame before and after an input frame, and rewriting handwritten characters, are displayed collectively by displaying them in the same pop-up menu, for example.

Further, the pen input GUI 2 includes an application (.) Such as a back space (BS), a delete (Del), a tab (Tab), an enter (Enter), and a cursor key.
Program) 6, various kinds of soft keyboards 22 that allow direct input, kana-kanji conversion button 23 that accepts the specification of kana-kanji conversion, full-width / half-width switching, specification of recognition character type, clear (Clear), copy (Copy), Button icons for paste, registration, transfer, etc. are provided as a user interface.

When a handwritten character is input to the input box 21 in a state in which the kana-kanji conversion is designated, the pen input GUI 2 passes the character candidate of the recognition result obtained from the character recognition engine 3 to the kana-kanji conversion means 5, and inputs the kana-kanji. The conversion result obtained from the conversion means 5 is input to the input frame 21 in the case of the above-described integrated system.
In the case of the separation method, it is displayed in an area provided separately from the input frame 21.

In addition, the pen input GUI 2 stores coordinate time-series data of the handwritten characters entered in the input box 21 in accordance with the application 6 to which the recognition result of the handwritten characters is to be transferred.
Words that may appear in the application 6 are provided in a list format to the context processing means 4 having a function of resolving ambiguity in handwritten character recognition and correcting erroneous recognition. When the user who confirms the displayed character candidates instructs the transfer, the character code string of the recognition result is transferred to the application 6.

[0026]

Next, the operation procedure of the apparatus according to the present invention will be described with reference to specific examples of screen layouts shown in FIGS. In this embodiment, the above-described integrated system will be described as an example. FIG. 4 is a diagram showing a basic procedure. As shown in FIG. 4 (a), full-width / half-width switching (toggle), recognition character type (alphabetic / numeric / kanji / hirakana / kana / symbol) designation (ON / OFF), character frame Left and right scroll,
Clear, Copy, Paste
), Registration, transfer, etc. button icons are provided. At the bottom, soft keys, such as Back Space, Delete, and cursor keys, that enable direct input to the application are arranged to improve the operability of the entire system. It also has a function of displaying the number of non-display characters existing at the front and rear of the currently displayed input frame.

When the user writes "handwriting" in the input box, the handwriting of the handwritten character is displayed (FIG. 4B), and after a predetermined time has elapsed since the input of the character is stopped, the recognition result is displayed ( FIG. 4 (c)). Also, if the character candidate obtained as a result of recognition is erroneously recognized as “good” as shown in FIG. 4D, when the user taps the “good” input box with a pen,
The input frame is highlighted and a plurality of character candidates for the handwritten character entered in the input frame and a group of edit commands that can be executed (“handwriting”, “rewrite”, “delete”)
"Insert" and "Transform") appear in the same pop-up menu.

By simply tapping the input box with a pen, the user can select a character candidate if there is a desired character among other character candidates, and edit the character candidate if there is no desired character. You can select a command. When "Sho" is selected from the character candidates, the pop-up menu is deleted, and the character candidate "Good" for the tapped input box
Is changed to the display of the selected character candidate "sho". When any one of the editing commands is selected, the editing command is executed as described below.

FIG. 5 is a diagram showing a rewriting procedure. In the pop-up menu of FIG. 4D, when the user selects "Rewrite" with the pen (FIG. 5A), the inverted display of the input frame returns to the original display, and the pop-up menu is deleted (FIG. 4D). 5 (b)), it is possible to overwrite the input frame. When the user hand-writes "call" in this input frame (FIG. 5 (c)), the handwriting of the handwritten character is displayed, and the handwritten character is re-recognized. The handwriting is erased and the top character candidate is displayed in this input box.

FIG. 6 is a diagram showing a procedure of handwriting reproduction. When the user selects "handwriting" with a pen (FIG. 6 (a)), the handwriting of the handwritten character entered in the input frame is reproduced, and the editing commands for the reproduced handwritten character ("recognition", "learning", " A menu of "return" and "rewrite" is displayed (FIG. 6B).

FIG. 7 is a diagram showing a procedure for deleting / inserting one character. When the user selects "Delete" with the pen (Fig. 7 (a)
), And the input frame is deleted (FIG. 7 (b)). When the user selects "insert" with a pen (FIG. 7 (c)), one input frame is inserted before the input frame (FIG. 7 (d)).

FIG. 8 is a diagram showing a procedure for proofreading a plurality of characters. When the user selects a plurality of input frames in which character candidates are displayed with a pen (FIG. 8A), the plurality of input frames are displayed in reverse video, and a group of edit commands that can be executed (“handwriting”)
A pop-up menu of "rewrite", "delete", "conversion", and "cancel" is displayed (FIG. 8 (b)).

When the user selects "conversion" with a pen, if the character string in the input box is a mixture of kanji and kana characters, the character string is converted to kana characters (FIG. 8C), and a pop-up menu of conversion candidates is displayed (FIG. 8C). FIG. 8 (d)). When one of these conversion candidates is selected, the editing command group and the pop-up menu of the conversion candidates are erased, and the reverse display of the input frame returns to the original display, and the character candidates of these input frames are displayed. Is changed to the display of the selected conversion candidate.

FIG. 9 is a diagram showing a procedure for half-width input. When the user selects the half-width mode, the width of the input frame is reduced to half of that in the full-width mode, and in the present embodiment, 12 input frames are displayed on one screen in the full screen mode (FIG. 9 (a)). As a result, the user can input a character string having a large number of digits, such as a telephone number and an e-mail address, and wanting to input at once without scrolling the screen (FIG. 9B). Further, as shown in FIG. 9C, it is possible to easily identify whether the handwritten character is recognized as a full-width character or a half-width character.

FIG. 10 is a diagram showing an input procedure in which all half-width characters are mixed. For example, if you paste the file name "Handwritten.EXE", the characters you have pasted will be displayed in the full-width input box because "Handwritten" is full-width characters. It is displayed in a half-width input box. In this state, if the user selects the half-width mode or the full-width mode, the size of the input frame that has been input is not affected, but the width of the input frame that has not been input is larger than the width of the half-width when the half-width mode is selected. In addition, when the full-width mode is selected (FIG. 10A), the size becomes full-size (FIG. 10B).

FIG. 11 is a diagram showing a scrolling procedure. When the user selects one character scroll in the right direction (FIG. 11 (a)), the screen is scrolled to the right by one input frame (FIG. 11 (b)). If the user selects rightward block scrolling to scroll rightward by one screen (FIG. 11C), the screen is scrolled rightward by five input frames, and the last screen before scrolling is displayed. (Right end) is displayed at the top (left end) (see FIG. 11).
(d)). In this example, five scrolls are performed to the right. However, basically, the block scroll is performed such that the last character displayed in the input frame before scrolling remains in the input frame after scrolling.

The computer as the device of the present invention is capable of transmitting a computer program for a handwritten character input interface to a portable recording medium such as a magnetic disk or a CD-ROM, or a program capable of communicating with the computer wirelessly or by wire. Line destination memory provided in the center,
Alternatively, the data is loaded from a recording medium such as a processing device side memory such as a RAM and a hard disk provided in the computer.

[0038]

As described above, the data processing apparatus and the recording medium having the handwritten character input interface according to the present invention can execute a plurality of character candidates simply by designating a character candidate that is erroneously recognized as a handwritten character. Editing commands and
For example, since the same pop-up menu is displayed collectively on the pop-up menu and made to be selected by the user, there is an excellent effect that the operation when the handwritten character is erroneously recognized is simple and the work efficiency is good.

[Brief description of the drawings]

FIG. 1 is a diagram showing a conventional procedure for inputting and editing handwritten characters by a separation method.

FIG. 2 is a diagram showing a procedure for inputting and editing a conventional handwritten character in an integrated system.

FIG. 3 is a block diagram of the device of the present invention.

FIG. 4 is a diagram showing a basic procedure.

FIG. 5 is a diagram showing a rewriting procedure.

FIG. 6 is a diagram showing a procedure of handwriting reproduction.

FIG. 7 is a diagram showing a procedure for deleting / inserting one character.

FIG. 8 is a diagram showing a procedure for proofreading a plurality of characters.

FIG. 9 is a diagram showing a procedure for half-width input.

FIG. 10 is a diagram showing an input procedure in which all single-byte characters are mixed.

FIG. 11 is a diagram showing a scroll procedure.

[Explanation of symbols]

 1 pen 2 pen input GUI 21 handwriting character input frame 22 soft keyboard 23 kana-kanji conversion button 3 character recognition engine 4 context processing means 5 kana-kanji conversion means 6 application

Claims (3)

[Claims] 1. A method for recognizing handwritten characters from coordinate time-series data of handwritten characters entered in an input box, displaying one or a plurality of character candidates obtained as a result of the recognition in the input box. In a data processing device having a handwritten character input interface capable of displaying character candidates other than the displayed character candidates or all character candidates, and editing an input frame in which handwritten characters are entered, Means for specifying, and, when an input box is specified by the means, means for collectively displaying one or more character candidates of handwritten characters written in the input box and edit commands that can be executed; Means for selecting one or more of the one or more character candidates and the editing command displayed by (1). If one of the one or more character candidates is selected,
Changes the display of the character candidates in the specified input box to the display of the selected character candidates, and if any of the editing commands is selected, the selected editing command is displayed for the specified input box. A data processing device having a handwritten character input interface. 2. A data processing system having a handwritten character input interface for recognizing a handwritten character from coordinate time-series data of the handwritten character entered in an input frame and displaying any of a plurality of character candidates obtained as a result of the recognition. Means for designating whether the handwritten character is to be recognized as a full-width or half-width character; and, if the handwritten character is specified to be recognized as a half-width character, the width of the input box where the handwritten character is not filled. And a means for narrowing the width of the character when the character is designated to be recognized as a full-width character. 3. A computer recognizes the handwritten character from the coordinate time-series data of the handwritten character entered in the input box, and displays one or a plurality of character candidates obtained as a result of the recognition in the input box. While displaying other character candidates other than the displayed character candidate or all character candidates,
And a computer-readable recording medium that causes a computer to edit an input box in which a handwritten character has been written, wherein: a program code unit that causes the computer to accept the specification of the input frame; and the input frame is specified. A program code means for causing the computer to collectively display one or more character candidates of the handwritten character entered in the input box and an edit command that can be executed; Program code means for accepting the selection from among the character candidates and the edit commands of the above, and when one or more of the character candidates is selected,
The computer causes the display of the character candidates of the designated input box to be changed to the display of the selected character candidate, and when any of the editing commands is selected, the computer causes the computer to change the display to the designated input box. And a program code means for executing the selected editing command.