JP3029824B1 - Handwritten character processing device, handwritten character processing method, and computer-readable recording medium storing a program for causing a computer to execute the method - Google Patents

Abstract

An object of the present invention is to input a handwritten character quickly and efficiently by enabling a more natural input similar to the case of writing on paper. A display unit (202) displaying an input frame (220) input by a cursor (201) for inputting a character according to a movement locus, and a result frame (230) for displaying a recognition result.
A cursor state detection unit 203 that detects an input on / off state of the cursor 201, a cursor position detection unit 204 that detects that the cursor 201 has moved out of the input frame area due to input off, and a boundary of the input frame A passing position detecting unit 205 for detecting whether the position has passed, an input frame displaying position determining unit 206 for determining a display position of a new input frame based on the detected position, and an input frame displaying position determining unit 2
A display control unit 210 that displays a new input frame based on the position determined in step 06 is provided.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a handwritten character processing device for inputting handwritten characters, recognizing and converting the input handwritten characters, a handwritten character processing method, and a computer-readable program storing a program for causing a computer to execute the method. It relates to a possible recording medium.

[0002]

2. Description of the Related Art A handwritten character processing apparatus for inputting handwritten characters and recognizing the input characters includes: (1) how to display an input frame for handwritten characters;
What triggers the post-processing of the word-by-word recognition process to start, how to determine clauses and word breaks,
(3) There is a problem on how to select the correct character from the recognized character candidates.

[0003] In the conventional handwritten character processing apparatus, (1) of these problems is divided into those having only one input frame for inputting handwritten characters, those having a plurality of input frames, and those having an input frame. There are those that are not set, for example, those that are entered along the line instead of the frame, and those that have no frame or line and can be written at any position in the input area.

As for (2), one phrase or one phrase
As an opportunity to start the post-processing of the recognition processing in units of words, an explicit operation, for example, pressing a specific button or inputting a specific symbol (for example, Japanese Patent Laid-Open No. 6-208)
655 publication).

As for (3), in the conventional handwritten character processing apparatus, a frame for displaying a list of recognition candidates (hereinafter, referred to as a candidate list frame) is provided, and the correct answer is included in the next candidate and below. In some cases, the operator can correct incorrect recognition by selecting a correct answer candidate. In a conventional handwritten character processing apparatus, usually, a recognition candidate list of characters immediately after recognition is displayed in a candidate list frame. When a plurality of recognition results are displayed in the result frame, a list of recognition candidates for arbitrary characters can be displayed by moving the cursor in the result frame.

As other conventional techniques, the above (1) is disclosed in JP-A-1-195527, and the (2) is disclosed in JP-A-9-102012, and the above (3) With respect to
No. 84, for example.

[0007]

However, in the conventional handwritten character processing apparatus, (1)
When there is only one input frame, there is an advantage that a large space is not required and the frame to be input is clear, but when writing handwritten characters, it is usual to use the right or downward direction. Writing with moving the hand little by little (it is reasonable to do this even from the stroke order of Japanese characters), so if you continue to enter characters in the same position, the operator may feel uncomfortable or There was a problem of giving unnaturalness.

When there are a plurality of input frames, there is a problem that although a sense of strangeness or unnaturalness of the input is not felt, a certain large space is required and a frame to be input is not clear.

Furthermore, in the case where the input frame is not set, it is difficult to cut out one character (determination of where one character is from), so that the recognition process becomes complicated.
In addition, there is a problem that recognition accuracy is reduced.

[0010] Further, in the case of the above (2), there is a problem that an explicit operation must be performed each time, which makes the operation complicated and lowers the work efficiency.

Regarding the above (3), in the case of continuously inputting handwritten characters, in many conventional techniques,
The recognition result of the previous character is output while the next character is being input. Therefore, if the first candidate is wrong and there is a correct answer below the next candidate, it is necessary to interrupt the current character input and replace the first candidate of the immediately preceding character with the correct candidate. Therefore, if the recognition is set to start after a certain period of time has elapsed since the pen was lifted, the recognition of the character being input during the above-mentioned operation is started against the operator's will. was there.

For this reason, it is necessary to perform an operation of returning to the erroneously recognized character after replacing the current character input recognition, replacing the candidates, and returning to the input of the new character again. Note that candidates can be replaced before the end of recognition.However, recognition may end immediately before this operation and the list of candidates may change. It is considered more appropriate after recognition of is completed.

As described above, if the cursor movement operation is performed each time, there is a problem that the work (input) efficiency is reduced. If the time from when the pen is raised to the start of recognition is increased so that the recognition candidates can be replaced, there is a problem that the operability at the time of character input in units of one character is reduced.

The present invention solves the above-mentioned problems of the prior art by enabling more natural input, as in writing on paper, and for instructing the start of post-processing. , And a special operation for designating a break of one phrase or one word is unnecessary, and even if a character is being input, the recognition candidate can be replaced at any time with respect to the character immediately before it. A handwritten character processing device, a handwritten character processing method, and a handwritten character processing method capable of quickly and efficiently inputting handwritten characters by enabling easy selection of correct answer candidates even when character recognition is erroneous. It is an object of the present invention to provide a computer-readable recording medium that records a program to be executed by a computer.

[0015]

Means for Solving the Problems The above-mentioned problems are solved,
In order to achieve the object, a handwritten character processing apparatus according to the present invention comprises a cursor for inputting a character according to a locus of movement, an input frame indicating an input enabled area of the character input by the cursor, and the input frame. And a display unit for displaying a result frame for displaying a first candidate character from among the character recognition candidates input to the handwritten character processing device.
A cursor state detecting means for detecting whether the cursor is in an input on or input off state, and wherein the state detected by the cursor state detecting means is in an input off state, and the cursor is moved out of the area of the input frame. When the cursor moves out of the input frame area when the cursor position detecting means detects that the cursor has moved out of the input frame area, Passing position detecting means for detecting which position of the boundary of the input frame has passed and moving, and displaying a new input frame based on the position at which the cursor has been detected by the passing position detecting means An input frame display position determining means for determining a position, and controlling the display means to determine the new position based on the position determined by the input frame display position determining means. And displays the input frame, the
In the area of the input frame, one of the recognition candidates of the character entered immediately before
Display control means for displaying a list .

According to a second aspect of the present invention, in the handwritten character processing apparatus according to the first aspect of the present invention, the input frame display position deciding means is configured such that the cursor passes through the input frame boundary by the passing position detecting means. When the detected position is detected as the right end of the input frame, the display position of the new input frame is set to a position on the right side of the currently displayed input frame.

According to a third aspect of the present invention, in the handwritten character processing device according to the second aspect of the present invention, the input frame display position determining means displays the display position of the new input frame at the presently displayed position. It is characterized in that it is located at a position overlapping the input frame.

Further, in the handwritten character processing apparatus according to a fourth aspect of the present invention, in the first aspect of the present invention, the input frame display position determining means may be configured such that the cursor passes through a boundary of the input frame by the passing position detecting means. When the detected position is detected as the left end of the input frame, the display position of the new input frame is set to a position on the left side of the currently displayed input frame.

According to a fifth aspect of the present invention, in the handwritten character processing apparatus according to the fourth aspect, the input frame display position determining means displays one or more display positions of the new input frame. It is characterized in that the result frame is set in the vicinity of a desired result frame.

According to a sixth aspect of the present invention, in the handwritten character processing apparatus according to the fourth aspect, the input frame display position determining means displays one or more display positions of the new input frame. The result frame is set near the result frame displayed on the leftmost side.

According to a seventh aspect of the present invention, in the handwritten character processing apparatus according to the fourth aspect, the input frame display position determining means displays one or more display positions of the new input frame. It is characterized in that the result frame is located near the result frame displayed on the rightmost side.

Further, in the handwritten character processing device according to the invention of claim 8, in the invention of claim 4, the input frame display position determining means sets the display position of the new input frame near the cursor. It is characterized by.

According to a ninth aspect of the present invention, in the handwritten character processing apparatus according to the first aspect of the present invention, the input frame display position deciding unit is configured such that the cursor passes through a boundary of the input frame by the passing position detecting unit. When the detected position is detected as the upper or lower end of the input frame, the display position of the new input frame is set to the same position as the currently displayed input frame.

According to a tenth aspect of the present invention, there is provided a handwritten character processing apparatus comprising: a cursor for inputting a character according to a movement locus; an input box indicating an input enabled area of the character input by the cursor; And a display unit for displaying a result frame for displaying a first candidate character from among the input character recognition candidates.
A cursor state detecting means for detecting whether the cursor is in an input on or input off state, and wherein the state detected by the cursor state detecting means is in an input off state, and the cursor is moved out of the area of the input frame. When the cursor moves out of the input frame area when the cursor position detecting means detects that the cursor has moved out of the input frame area, A pass position detecting means for detecting which position of the input frame has passed and moved, and a position where the cursor has passed the input frame boundary by the pass position detecting means is a left end of the input frame. And a post-processing executing means for performing post-processing of recognition processing in units of phrases or words when detected.

In the handwritten character processing apparatus according to an eleventh aspect of the present invention, in the tenth aspect of the present invention, the post-processing executing means includes a position at which the cursor has passed a boundary of the input frame by the passing position detecting means. Is detected as the left end of the input frame, and the post-processing of the recognition process is performed, assuming that the characters which have been input so far and which have not been transmitted to the system side are regarded as one phrase or one word. And

According to a twelfth aspect of the present invention, there is provided the handwritten character processing apparatus according to the tenth or eleventh aspect, wherein the post-processing execution means corrects a notation error of a target character. .

According to a thirteenth aspect of the present invention, in the handwritten character processing apparatus according to the tenth or eleventh aspect, the post-processing executing means adds specific data.

According to a fourteenth aspect of the present invention, there is provided the handwritten character processing apparatus according to the tenth to thirteenth aspects, further comprising the step of inputting a character into a new input box after the post-processing is completed by the post-processing executing means. The transmission means for transmitting the character after completion of the post-processing to the system side when the processing is started.

Further, the handwritten character processing apparatus according to the invention of claim 15, in the invention of claim 1 0-14, wherein the display control means controls said display means, said input frame in the area, It is characterized by displaying a list of recognition candidates for the character input immediately before.

[0030] Also, in the handwritten character processing apparatus according to the sixteenth aspect of the present invention, in the invention of the fifth to seventh aspects, the display control means controls the display means so that the display control means can display the new input frame area. And displaying a list of first candidates and / or recognition candidates other than the first candidates in the result frame displayed nearest to the new input frame.

The handwritten character processing method according to the seventeenth aspect of the present invention is a method for processing a handwritten character, comprising:
In a handwritten character processing method in which a result frame displaying a first candidate character from among the character recognition candidates input to the input frame is displayed, a cursor for detecting whether the cursor is in an input on or input off state A state detection step, a cursor position detection step of detecting that the cursor has moved out of the area of the input frame, with the state detected by the cursor state detection step being an input off state, and the cursor position detection step. When it is detected that the cursor has moved out of the area of the input frame, when the cursor moves out of the area of the input frame, the cursor has moved through any of the boundaries of the input frame. Determining a display position of a new input frame based on a passing position detecting step of detecting whether the cursor has passed, and a position at which the cursor detected by the passing position detecting step has passed. An input frame display position determining step, and displays the new input frame, based on the position determined by the input frame display position determining step, Ryo of the input frame
Display the list of recognition candidates for the character entered immediately before
Display control means that, characterized in that it includes a display control step.

[0032] In the handwritten character processing method according to the eighteenth aspect of the present invention, in the invention according to the seventeenth aspect, the input frame display position determining step includes the step of detecting the passing position so that the cursor passes through a boundary of the input frame. When the detected position is detected as the right end of the input frame, the display position of the new input frame is set to a position on the right side of the currently displayed input frame.

According to a nineteenth aspect of the present invention, in the method for processing a handwritten character according to the eighteenth aspect, in the input frame display position determining step, the display position of the new input frame is displayed at the present time. It is characterized in that it is located at a position overlapping the input frame.

In the handwritten character processing method according to a twentieth aspect of the present invention, in the invention according to the seventeenth aspect, the input frame display position determining step includes the step of detecting the passing position so that the cursor passes through the boundary of the input frame. When the detected position is detected as the left end of the input frame, the display position of the new input frame is set to a position on the left side of the currently displayed input frame.

In the handwritten character processing method according to the twenty-first aspect, in the twentieth aspect, the input frame display position determining step sets the display position of the new input frame to one.
Alternatively, a desired result frame is set in the vicinity of a desired result frame among the plurality of displayed result frames.

In the handwritten character processing method according to a twenty-second aspect, in the twentieth aspect, the input frame display position determining step sets the display position of the new input frame to one.
Alternatively, the result frame is set near the result frame displayed on the leftmost side among the plurality of displayed result frames.

Also, in the handwritten character processing method according to the invention of claim 23, in the invention of claim 20, the input frame display position determining step sets the display position of the new input frame to one.
Alternatively, the result frame is set near the result frame displayed on the rightmost side of the plurality of displayed result frames.

According to a twenty-fourth aspect of the present invention, in the handwritten character processing method according to the twentieth aspect, the input frame display position determining step sets the display position of the new input frame near the cursor. It is characterized by.

According to a twenty-fifth aspect of the present invention, in the method for processing a handwritten character according to the seventeenth aspect, in the input frame display position determining step, the cursor passes through the input frame boundary by the passing position detecting step. When the detected position is detected as the upper or lower end of the input frame, the display position of the new input frame is set to the same position as the currently displayed input frame.

Also, in the handwritten character processing method according to the twenty-sixth aspect of the present invention, there is provided a handwriting character processing method comprising the steps of:
In a handwritten character processing method in which a result frame displaying a first candidate character from among the character recognition candidates input to the input frame is displayed, a cursor for detecting whether the cursor is in an input on or input off state A state detection step, a cursor position detection step of detecting that the cursor has moved out of the area of the input frame, with the state detected by the cursor state detection step being an input off state, and the cursor position detection step. When it is detected that the cursor has moved out of the area of the input frame, when the cursor moves out of the area of the input frame, the cursor has moved through any of the boundaries of the input frame. A pass position detecting step of detecting whether the cursor has passed a boundary of the input frame is detected as a left end of the input frame by the pass position detecting step Characterized by including a post-processing execution step of performing post-processing of the recognition processing of clause units or word units, a.

A handwritten character processing method according to a twenty-seventh aspect of the present invention is the method according to the twenty-sixth aspect, wherein the post-processing execution step includes the step of: Is detected as the left end of the input frame, and the post-processing of the recognition process is performed, assuming that the characters which have been input so far and which have not been transmitted to the system side are regarded as one phrase or one word. And

A handwritten character processing method according to a twenty-eighth aspect of the present invention is characterized in that, in the twenty-sixth or twenty-seventh aspect, the post-processing execution step corrects an error in notation of a target character. .

According to a twenty-ninth aspect of the present invention, in the handwritten character processing method according to the twenty-sixth or twenty-seventh aspect, the post-processing execution step adds specific data.

According to a thirty-fourth aspect of the present invention, there is provided a handwritten character processing method according to the twenty-sixth to twenty-ninth aspects, wherein after the post-processing is completed in the post-processing execution step, the input of characters into a new input box is started. The transmitting step includes transmitting the character after the post-processing to the system side.

According to a thirty-first aspect of the present invention, there is provided the handwriting character processing method according to the twenty-sixth to thirty- sixth aspects, wherein the display control step includes the step of: It is characterized by displaying a list.

According to a thirty-second aspect of the present invention, in the handwriting character processing method according to the twenty-first to twenty-third aspects, the display control step includes the step of: A list of first candidates and / or recognition candidates other than the first candidates in the result frame displayed nearby is displayed.

Further, the storage medium according to the invention of claim 33 records a program for causing a computer to execute the method according to claims 17 to 32, so that the program becomes machine-readable. The operations of Items 17 to 32 can be realized by a computer.

[0048]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS With reference to the accompanying drawings, preferred embodiments of a handwritten character processing apparatus, a handwritten character processing method and a computer readable recording medium storing a program for causing a computer to execute the method will be described below. Embodiments will be described in detail.

First, the hardware configuration of the information processing apparatus including the handwritten character processing apparatus according to the embodiment of the present invention will be described. FIG. 1 is a block diagram illustrating a hardware configuration of the information processing apparatus according to the present embodiment.

In FIG. 1, 101 is a CPU for controlling the entire system, 102 is a ROM storing a boot program and the like, 103 is a RAM used as a work area for the CPU 101, and 104 is an HD ( A hard disk drive (HDD) 105 controls reading / writing of data from / to a hard disk (105), an HD 105 stores data written under the control of the HDD 104, and a data 106 to an FD (floppy disk) 107 under the control of the CPU 101. And a detachable FD 107 for storing data written under the control of the FDD 106.
Reference numeral 108 denotes a display for displaying a window relating to data such as a document, an image, and function information, including a cursor, an icon, or a tool box.

Reference numeral 109 is connected to the network NET via the communication line 110, and the network NET is connected to the network NET.
And the interface that controls the internal interface (I
/ F), 111 is a keyboard having keys for inputting characters, numerical values, various instructions, etc. 112 is a mouse for moving a cursor, selecting a range, moving a window, and changing a size, 113 Is a scanner for optically reading an image, 114 is a printer for printing contents displayed in a window, 115 is a tablet for inputting handwritten characters, 116 is a tablet 11
5 is a pen included with the camera. Reference numeral 117 denotes a bus for connecting the above-described units.

FIG. 2 is a block diagram functionally showing the configuration of the handwritten character processing apparatus according to the present embodiment.
In FIG. 2, the handwritten character processing device includes a cursor 201.
Display unit 202, cursor state detection unit 203, cursor position detection unit 204, passage position detection unit 205,
An input frame display position determination unit 206, a display control unit 210,
Is provided. Reference numeral 200 denotes a system which controls handwritten character recognition and other information processing.

The cursor 201 is for inputting characters according to the movement locus. The pen 116 attached to the tablet 115 moves according to the locus on the tablet 115.

The cursor 201 has a pen shape, as shown in FIG. 4 to be described later, to indicate that a character is to be drawn. However, the shape and the like of the cursor 201 are not limited to this. The cursor moves according to the movement of the pen 116, and the locus of the movement is displayed in the handwritten character input area.

The display unit 202 includes an input box 220 for indicating a region where characters input by the cursor 201 can be input,
The first of the character recognition candidates input to the input box 220 is selected.
A result frame 230 or the like for displaying candidate characters is displayed. A display example of the display unit 202 will be described later.

The cursor state detection unit 203 outputs the cursor 2
It is detected whether 01 is an input on or input off state. Specifically, the determination is made based on whether or not the pen tip switch of the pen 116 is pressed.

The input state of the cursor 201 is a state in which characters can be drawn by the cursor, that is, when the pen tip of the pen or the like comes into contact with the surface of the tablet 115 with a predetermined force or more, the switch of the pen tip is depressed. It is in the state that has been. Also, when the cursor is in the input off state,
The character cannot be drawn by the cursor 201, that is, the pen 116 is not in contact with the surface of the tablet 115 and the tip switch is not pressed, or the pen 116 is in contact with the surface of the tablet 115. However, no force greater than a predetermined value is applied, and the switch of the pen tip is not depressed.

The cursor position detecting section 204 detects that the cursor 201 has moved out of the area of the input frame 220 while the state detected by the cursor state detecting section 203 is in the input off state. Specifically, for example, in the case of a tablet adopting the electromagnetic induction method, it is possible to detect that the pen tip of the pen 116 moves out of the area of the input frame 220 while being slightly away from the tablet. In addition, as long as it can be detected that the cursor 201 in the input-off state moves out of the area of the input frame 220, the invention is not limited to the example of the tablet adopting the electromagnetic induction method.

When the cursor position detecting unit 204 detects that the cursor 201 has moved out of the area of the input frame 220, the passing position detecting unit 205
It is detected which position of the boundary of the input frame 220 has passed and moved.

More specifically, the determination is made by detecting the position coordinates where the input frame 220 is displayed and the position coordinates through which the cursor 201 has moved. Usually, since the input frame 220 is rectangular, which of the four sides has passed is calculated from the position coordinates of each side, and it is possible to determine which of the upper, lower, left and right ends has passed.

For example, if the input frame 220 is (X0, Y
0), (X1, Y0) , (X 0, Y 1), (X1, Y
In the case of a rectangle having the four coordinates of 1) as vertices (1>
0), when the coordinates in the horizontal direction (X direction) of the coordinates where the cursor 201 is located are larger than X1, it is determined that the cursor 201 has passed the right end of the input frame boundary line. Horizontal direction (X direction) of the coordinates where
Is smaller than X0, the input frame 220
It is determined that the vehicle has passed the left side of the boundary line.

On the other hand, if the coordinates in the horizontal direction (X direction) do not exceed the range between X0 and X1, and the coordinates in the vertical direction (Y direction) are smaller than Y0 or larger than Y1, the input frames are respectively set. It is determined that the vehicle has passed the upper or lower end of the boundary line 220.

The input frame display position determining unit 206 determines the display position of a new input frame 230 based on the passing position of the cursor 201 detected by the passing position detecting unit 205.

More specifically, the input frame display position determining unit 206
Is the position at which the cursor 201 has passed the boundary of the input frame 220 by the passing position detection unit 205, for example, the input frame 22
When it is detected that the input frame is at the right end of 0, the display position of the new input frame is set to a position on the right side of the currently displayed input frame.

The input frame display position determining section 206 can also set the display position of the new input frame to a position overlapping the currently displayed input frame. This allows more natural input in accordance with the amount of movement of the hand performing writing to the right. In addition, the input area on the screen can be saved, and the number of characters that can be continuously input can be increased.

The input frame display position determining unit 206 determines that the cursor 201 is
When it is detected that the position that has passed through the boundary of 0 is the left end of the input frame 220, the display position of the new input frame may be set to a position on the left side of the currently displayed input frame. Thus, the input frame can be displayed at an optimum position according to the hand movement at the time of writing.

Further, the input frame display position determining section 206 can set the display position of the new input frame in the vicinity of a desired result frame among the one or more displayed result frames 230. This makes it possible to easily correct the recognition result of the character desired by the operator.

Further, the input frame display position determining unit 206 can set the display position of the new input frame near the result frame displayed on the leftmost side among the one or more displayed result frames 230. .

Further, the input frame display position determining section 206 can set the display position of the new input frame in the vicinity of the rightmost result frame among the one or more displayed result frames 230. .

Further, the input frame display position determining section 206 can set the display position of the new input frame near the cursor 201. Thus, the input frame can be displayed at a position following the movement of the pen.

The input frame display position determination unit 206 determines that the cursor 201 is
When it is detected that the position passing through the zero boundary is the upper end or the lower end of the input frame 220, the display position of the new input frame can be set to the same position as the currently displayed input frame. As a result, it is desired to continue inputting characters, but the area for moving to the right is reduced, or the result frame 230 and the input frame are too far apart, making it difficult to compare the two. For reasons, if it is not desired to move the input box further to the right, no new input box is displayed on the right.

The display control section 210 controls the display section 202 to display a new input frame based on the position determined by the input frame display position determining section 206. That is, a new input frame is displayed at a position to the right of the currently displayed input frame, or at a position to the right of the currently displayed input frame and overlapping the input frame. . The display control unit 210 can also set the new input frame to a position on the left side of the currently displayed input frame.

Further, a new input frame is displayed in the vicinity of a desired result frame, the vicinity of a result frame displayed on the leftmost side, and the result displayed on the rightmost side of one or more result frames 230 displayed. Each can be displayed near the frame. Further, a new input frame can be displayed near the cursor 201. Further, a new input frame can be displayed at the same position as the currently displayed input frame.

Further, the display control section 210
Is displayed in the area of the input box 220 to display a list of recognition candidates for the character input immediately before. As a result, the recognition result of the immediately preceding character can be corrected without moving the pen out of the input frame in which the character is currently being input.

Further, the display control unit 210
Is controlled so that the first candidate and / or the first candidate in the result box displayed nearest to the new input box are set in the area of the new input box.
Alternatively, a list of recognition candidates other than the first candidate is displayed.
Thereby, the first candidate displayed in the desired result frame can be easily corrected.

FIG. 3 is a block diagram functionally showing another configuration of the handwritten character processing apparatus according to the present embodiment. In FIG. 3, the handwritten character processing device includes a cursor 201.
Display unit 202, cursor state detection unit 203, cursor position detection unit 204, passage position detection unit 205,
A display control unit 210, and a post-processing execution unit 301;
The transmission unit 302 is provided. Note that FIG.
2, the same components as those in FIG. 2 are denoted by the same reference numerals, and description thereof is omitted.

The post-processing execution unit 301 includes the passing position detection unit 2
When the position where the cursor 201 has passed through the boundary of the input frame 220 is detected as the left end of the input frame 220 according to 05, post-processing of recognition processing in units of phrases or words is performed.
This eliminates the need for a special operation such as pressing a specific button, which is an explicit operation for instructing the start of post-processing, and can simplify the operation.

A problem similar to this is the problem of instructing the start of the recognition process in units of one character. Various methods have been considered heretofore. Among them, when the cursor is out of the area of the current input frame in a normal state with the input off and a certain time has elapsed, it is determined that one character has been written. It is widely used to start a recognition process for the character (for example, see Japanese Unexamined Patent Application Publication No.
No. 54086).

By using the present invention together with this prior art, the recognition process of one character unit and the post-processing of the recognition process of one phrase or one character can be performed by the same type of operation by the operator. Therefore, operability with a sense of unity that can be easily understood by the operator can be realized.

The post-processing is performed, for example, by performing post-processing of recognition processing on characters that have been input up to that point and that have not yet been sent to the system side as one phrase or one word. This eliminates the need for a special operation such as designating a break, and simplifies the operation.

As another content of the post-processing, it is conceivable to correct a notation error of a target character. Specifically, this is a correction of the character type. For example, even though the user wants to input “Muscat”, the third katakana character “Ka” is erroneously recognized as the kanji “power”, and “ If it becomes "mass power", replace the "power (kanji)" with "ka (Katakana)"
When the lowercase letter “v” of the third letter of the English word “have” is mistakenly recognized as an uppercase letter “V” and becomes “haVe”, the “V (uppercase letter)” is changed to “v ( Lowercase) ".

Other corrections for errors in character notation include typographical correction and spell checking. further,
When adding specific data, for example, in the case of an English sentence, an efficient English sentence can be input by adding a space (blank character) to the end of a word.

The sending section 302 is provided with the post-processing execution section 301
After the post-processing is completed, the input of characters into a new input box is started, and the characters whose post-processing has been completed are sent to the system side 200.

The cursor state detecting unit 203, the cursor position detecting unit 204, the passing position detecting unit 205, the input frame display position determining unit 206, the display control unit 210, the post-processing executing unit 301, and the sending unit 302 are each composed of the ROM 102. , R
The function of each unit is realized by the CPU 101 or the like executing the instruction processing in accordance with the instruction described in the program recorded on the recording medium such as the AM 103, the hard disk 105, and the floppy disk 107.

Next, the display contents of the display unit 202 will be described. FIG. 4 is an explanatory diagram showing display contents of the display unit 202. In FIG. 4, the handwritten character input screen displayed by the opened window includes a cursor 201, an input frame 400, and a conversion button 401.
00 indicates a handwritten character input area 450 and a delete (DE
An L) button 402, a back space (BS) button 403, a cancel button 404, a send button 405, and a setting button 406 shown by pictures.

As described above, the cursor 201 is
It has a pen shape and moves according to the movement of the pen 116, and the locus of the movement is displayed in the handwritten character input area.

In a device for inputting handwritten characters by directly touching the screen with a pen or a finger or the like, the position where the pen or finger or the like touches is the position of the cursor. In this case, the cursor is displayed on the screen. It is not necessary. Also, by changing the shape, size, direction, color, etc. of the input state detected by the cursor state detection unit 203, it is possible to easily determine whether the current state is the input on state or the input off state. I do.

The DEL button 402 provided in the input frame 400 has the same function as the DEL key (delete key) provided on a normal keyboard. Specifically, this is used when deleting a character in which a result frame cursor 708 described later exists.

BS button 4 provided in input frame 400
03 also has the same function as a BS key (backspace key) provided on a normal keyboard, similar to the DEL button 402. Specifically, it is used to delete a character before a character where a result frame cursor 708 described later exists.

Similarly, the cancel button 404 is used to cancel the immediately preceding operation. The send button 405 is
This is used when sending the characters displayed in the result box to be described later to the system side. Normally, sending characters to the system side is
As will be described later, this is performed by a predetermined operation of the cursor 201. By using the send button 405, characters can be forcibly sent to the system side regardless of the predetermined operation of the cursor 201.

The setting button 406 is a button for making various settings relating to input of handwritten characters. Specifically, pressing the setting button 406 opens a dialog (not shown) for performing various settings, and performs various settings related to handwritten character input according to the dialog.

The result frame 230 is displayed when a handwritten character is inputted and recognized. Therefore, as shown in FIG. 4, when the handwritten character has not been input yet, the result frame 230 is displayed.
Is not displayed.

Next, the transition of the display content of the display unit 202 in response to the input of the handwritten character will be described. 5 to 13 are explanatory diagrams showing display contents of the display unit 202 of the handwritten character processing device according to the present embodiment. In FIG. 5, reference numeral 501 denotes a right end boundary line of the input frame 500. FIG. 5 shows a state in which a character (Katakana “ma”) is drawn in the handwritten character input area 550 by the cursor 201.

As long as the cursor 201 is within the handwritten character input area 550 of the input frame 500, the recognition of the input character is not started, and no new input frame is displayed. After entering the characters, the cursor 201
With the input off, pass through the rightmost boundary 501,
When moved to the right, a new input frame 600 is displayed as shown in FIG. The input frame 500 is deleted in accordance with the display of the new input frame 600.

In FIG. 6, it can be seen that the input frame 600 is displayed at a position shifted to the right as compared with the input frame 500 in FIG. When the input frame 500 and the input frame 600 are compared, it can be seen that they are displayed at positions overlapping each other by the distance X (X is approximately 1/4 of the width of the input frame) shown in FIG. This is to match the natural movement of the hand when writing a character. In particular,
By making the position existing when the cursor 201 passes through the rightmost boundary line 501 of the input frame 500 coincide with the position at which to start writing a character in the handwritten character input area 650 of the new input frame 600, the cursor 201 The amount of movement of the object is minimized.

Further, by displaying input frames at overlapping positions, the display area can be saved, and the number of input frames that can be continuously displayed in the rightward direction in a character input window of a predetermined size is increased. Can be.

Next, the recognition candidate display fields 701 to 706 will be described. In FIG. 7, the first candidate “MA” is displayed in the top recognition candidate display column 701, and other recognition candidates are displayed in the recognition candidate display columns 702, 703, 704, 705, and 706. Are displayed in one vertical column in descending order of

A result frame cursor 708 is displayed on the right of the result frame 707. The result frame cursor 708 is operated by, for example, a direction key of the keyboard 111, the mouse 112, or the like, and is used to indicate a result frame.

By repeating the same operation, characters are displayed in the result box. In FIG. 8, “M” is displayed in the result frame 707, “S” is displayed in the result frame 807, “F” is displayed in the result frame 808, and “T” is displayed in the result frame 809 by the same operation.
In the handwritten character input area 850 of the new input frame 800,
This shows a state in which katakana “g” is drawn.

In the recognition candidate display fields 801 to 805 in the new input frame 800, the character “tsu” entered immediately before is displayed.
Is displayed. Reference numeral 806 denotes a down arrow button. By displaying the down arrow button 806, it is possible to indicate that other recognition candidates exist other than those displayed in the recognition candidate display columns 801 to 805. By pressing the down arrow button 806, the other recognition candidate can be displayed instead of the currently displayed recognition candidate.

After the character “G” is input (drawn) in the handwritten character input area 850 in FIG.
When 01 is turned off and passes through the boundary 810 at the left end of the input frame 800, a new result frame 906 is displayed as shown in FIG. 9, in which the first candidate input and recognized in FIG. Is displayed. Further, a new input frame 900 is displayed near the new result frame 906, and the previous input frame 800 is deleted.

[0102] In the recognition candidate display fields 901 to 905 of the new input frame 900, recognition candidates for the characters input in the previous input frame 800, including the first candidate displayed in the result frame 906, are displayed. Is done. In this state, by selecting any one of the recognition candidate display fields 902 to 905, the character displayed in the result frame 906 can be changed. The down arrow button 806 is as described above.

Next, in FIG. 9, when the result frame cursor 708 displayed near the right side of the result frame 906 is moved and moved between the result frames 807 and 808, as shown in FIG. , A new input box 1000 is displayed near the result box cursor 708, and the previous input box 900 is deleted.

Further, recognition candidate display fields 1001 to 100
5 displays a list of recognition candidates including the first candidate “f” displayed in the result box 808. even here,
Similarly, by selecting any of the recognition candidate display fields 1002 to 1005, the character displayed in the result frame 808 can be changed. By inputting a handwritten character using the cursor 201 in the handwritten character input area 1050, a new result frame can be inserted between the result frames 807 and 808.

The result frame cursor 708 is moved to each result frame 707,
By moving between 807, 808, and 809, a new input frame can be displayed near the result frame to which the result frame cursor 708 has moved, and the first candidate can be replaced, characters can be input again, and the like.

After the above processing is completed, the result frame cursor 7
08 is moved to the right side of the result frame 906, as shown in FIG.
6 can be displayed. At this time, no recognition candidate display column is displayed in the new input frame 1100.
In this state, by inputting into the handwritten character input area 1150 with the cursor 201, the result frame 906 is displayed.
A new character can be added after the character "g".

Also, move the cursor 201 to the left,
As shown in FIG. 12, a new input frame 1200 is displayed near the leftmost result frame 707 (basic position of the input frame) by passing through the boundary 1101 at the left end of the input frame 1100. Can be. At this time, the characters that have been input so far and are still in the system 200
Post-processing (specifically, checking whether there is a spelling error, etc.) is performed as a phrase or a word that has not been sent to.

In input frame 1200 redisplayed at the basic position after the completion of the post-processing, new characters begin to be input to handwritten character input area 1250, and at the same time, result frame 7
07, 807, 808, 809, and 906 are deleted, and the characters “Muscat” displayed there are sent to the system side 200. FIG. 13 shows the state.

Next, another transition of the display content of the display unit 202 in response to the input of the handwritten character will be described. FIG.
4 and 15 are explanatory diagrams showing display contents of the display unit 202. FIG. In FIG. 14, after inputting each character of “Muscat Jew” and further inputting a character of katakana “S” in the handwritten character input area 1450 of the input box 1400, the input box is turned off with the cursor 201 turned off. 14
00 upper border 1401 or lower border 140
When passing through the second input frame 1500, the new input frame 1500 is displayed at the same position as the previous input frame 1400, as shown in FIG.

Thus, the input frame can be displayed without protruding from the handwritten character input screen or without being too far from the result frame.

Next, the processing contents of the handwritten character processing apparatus according to the present embodiment will be described. 16 to 19
5 is a flowchart showing a procedure of a series of processes of the handwritten character processing device according to the present embodiment. In the flowchart of FIG. 16, first, the first input frame is displayed (step S1601).

Next, it is determined whether a handwritten character has been input in the handwritten character input area of the input frame displayed in step S1601 (step S1602). Here, after waiting for the input of the handwritten character, if the input is made (Yes at step S1602), then the cursor 2
It is determined whether or not 01 is in the input off state (step S1603).

If the input has not been turned off in step S1603, that is, if the input remains in the on state (No in step S1603), the flow shifts to step S1602. On the other hand, if the input is off (Yes at step S1603), it is next determined whether the cursor 201 has passed the boundary of the input frame (step S16).
04).

In step S1604, if the vehicle does not pass through the boundary line (No in step S1604), the process advances to step S1602. On the other hand, if it has passed through the boundary line (Yes at step S1604), it is determined whether the passed boundary line is the right end boundary line of the input frame (step S1605). Here, if it is not the right end boundary line (No at Step S1605), at Step S180 in FIG.
Move to 1.

In step S1605, when the passed boundary is the rightmost boundary of the input frame (step S1).
Affirmative (605) indicates that a new input frame is displayed at a predetermined position on the right side of the currently displayed input frame (step S160).
6) The input frame currently displayed (the previous input frame) is deleted (step S1607). Here, the step of displaying a new input box (step S1606) and the step of deleting the previous input box (step S1607) may be reversed.

A result frame for displaying the first candidate of the result of recognition of the character input in the previous input frame is displayed at a predetermined position (step S1608). Further, a recognition candidate list of characters input in the previous input frame is displayed in the newly displayed input frame recognition candidate display field (step S160).
9). After that, the flow shifts to step S1701 in FIG.

Next, in FIG. 17, it is determined whether or not one candidate below the next candidate has been selected from the list of recognition candidates in the recognition candidate display column (step S1701). Here, when a candidate is selected (Yes at Step S1701), the first candidate in the result frame is replaced with the selected candidate (Step S1702), and thereafter, the process proceeds to Step S1703. On the other hand, if no candidate is selected in step S1701 (No in step S1701), the process proceeds to step S1703 without doing anything.

In step S1703, it is determined whether a character has been input (drawn) (step S1703).
1703). If no character has been input (No at Step S1703), the process proceeds to Step S1701. On the other hand, when a character is input (step S170
(3 Yes), it is determined whether the cursor 201 has been turned off (step S1704).

If the input is not turned off in step S1704 (No in step S1704)
Shifts to step S1701. On the other hand, when the input is in the off state (Yes at step S1704),
Next, it is determined whether the cursor 201 has passed the boundary of the input frame (step S1705). Here, when the vehicle does not pass through the boundary (No at Step S1705).
Shifts to step S1701. On the other hand, if the vehicle has passed the boundary line, the flow shifts to step S1605 in FIG.

Next, the case where the boundary line through which the cursor 201 has passed in step S1605 in FIG. 16 is not the rightmost boundary line (No in step S1605) will be described. In FIG. 16, if step S1605 is negative, it is next determined whether or not the boundary line through which the cursor 201 has passed is the leftmost boundary line (step S1801 in FIG. 18).

If it is determined in step S1801 that the image does not pass through the left end boundary line (No in step S1801).
Is the upper boundary line or the lower boundary line. In this case, a new input frame is displayed at the same position as the currently displayed input frame (previous input frame) (step S180).
2) The process proceeds to step S1607 in FIG. Here, a step of displaying a new input frame (step S180)
2) and the step of deleting the previous input frame (step S160)
7) may be reversed.

On the other hand, if it is determined in step S1801 that the left edge has passed (step S1801)
Affirmatively indicates that a new input frame is displayed near the result frame displayed on the rightmost side (step S180).
3). At the same time, the currently displayed input frame (previous input frame) is deleted (step S1804). further,
A recognition candidate list of the characters input to the previous input box is displayed in the new input box (step S1805). Here, the step of displaying a new input box (step S1803) and the step of deleting the previous input box (step S1804) may be reversed.

Next, it is determined whether or not one candidate below the next candidate has been selected from the recognition candidate list display (step S).
1806). Here, when a candidate is selected (Yes at Step S1806), the first candidate in the result frame is replaced with the selected candidate (Step S1807), and thereafter, the process proceeds to Step S1808. On the other hand, if no candidate is selected in step S1806 (step S18
(No in step 06), the process proceeds to step S1808 without doing anything.

Thereafter, it is determined whether or not the result frame cursor 708 has moved between the result frames (step S1808).
If the user has not moved (No in step S1808), the process advances to step S1806 to determine whether another candidate has been selected. On the other hand, the result frame cursor 708
If has moved (Yes at Step S1808), it is determined whether the destination is the result frame displayed on the rightmost side (Step S1809).

In step S1809, if the destination is not the result frame displayed on the rightmost side (step S18)
09 negative), a new input frame is displayed in the vicinity of the result frame to which the result frame cursor 708 has moved (step S1).
810), the process moves to step S1804. Thereafter, each of the steps S1804 to S1810 is repeatedly performed.

On the other hand, if the destination is the result frame displayed on the rightmost side in step S1809 (Yes in step S1809), the flow shifts to step S1901 in FIG.

In step S1901 of FIG. 19, a new input box is set at the position where the result box cursor 708 has been moved.
That is, it is displayed near the result frame displayed on the rightmost side. At the same time, the previous input frame is deleted (step S
1902). Here, the step of displaying a new input box (step S1901) and the step of deleting the previous input box (step S1902) may be reversed.

Thereafter, it is determined whether or not the conversion button 401 has been pressed (step S1903). If the conversion button 401 is pressed (Yes at step S1903), the character string displayed in the result frame is converted (step S1904). Specifically, a character string of Hiragana is converted into a character string containing kanji and kana. After that, the conversion result is displayed in the result frame (step S1905), and step S19 is performed.
Shift to 03. Each time the conversion button 401 is pressed, steps S1904 and S1905 are repeated.

When the conversion button has not been pressed in step S1903 (No in step S1903)
Next, it is determined whether the cursor 201 has been moved to the basic position (step S1906). If the user has not been moved (No at Step S1906), the process proceeds to Step S1903.

On the other hand, when the cursor 201 has been moved to the basic position in step S1906 (step S1).
906 affirmatively) sets the new input box to the base position, ie,
It is displayed at the position where the input frame was displayed first (the leftmost position). Next, it is determined whether a character has been input in the handwritten character input area of the new input frame (step S190).
8).

In step S1908, the process waits for a character to be input, and if a character is input (step S190).
If “8” is affirmative, the character (string) displayed in the result frame is transmitted to the system side 200 (step S1909). afterwards,
The flow shifts to step S1603 in FIG. 16, and thereafter, the same processing is repeated.

As described above, according to the present embodiment, a natural input can be performed in the same manner as when writing on paper. Specifically, it is possible to perform more natural input in accordance with the amount of movement of the hand performing writing to the right side, to save the input area on the screen, and to increase the number of characters that can be continuously input.

Further, the input frame can be displayed at an optimum position in accordance with the movement of the cursor following the movement of the hand during writing, and the operator can easily correct the desired character recognition result. Can be.

If the user wants to continue inputting characters but does not want to move the input frame further rightward,
Since a new input frame is not displayed on the right side, the input frame can be displayed based on the operator's will.

Further, the trouble of instructing the start of the post-processing and the trouble of designating where each phrase is one phrase or one word can be omitted. In addition, it is possible to easily input specific data that is difficult to input when performing handwritten character input.In addition, data transmission operations in units of phrases or words, which conventionally required special operations such as button presses, etc. , Can be triggered by a natural operation of the operator.

In addition, even if a character is being input, the immediately preceding character or a desired character can be replaced with a recognition candidate at any time, so that a correct candidate can be easily selected even when character recognition is erroneous. .

Note that the handwritten character processing method described in the present embodiment is realized by executing a prepared program on a computer such as a personal computer or a workstation. This program is for hard disk, floppy disk, CD-RO
The program is recorded on a computer-readable recording medium such as M, MO, and DVD, and is executed by being read from the recording medium by the computer. This program can be distributed via the recording medium via a network.

[0138]

As described above, according to the first aspect of the present invention, there is provided a cursor for inputting a character according to a movement locus,
Display means for displaying an input box indicating an inputtable area of a character input by the cursor, and a result box for displaying a first candidate character among recognition candidates of the character input to the input box; A cursor state detecting means for detecting whether the cursor is in an input on or input off state, and a state detected by the cursor state detecting means in an input off state, and the cursor is out of the area of the input frame. A cursor position detecting means for detecting that the cursor has moved; and, when the cursor position detecting means detects that the cursor has moved out of the area of the input frame, the cursor moves out of the area of the input frame. At this time, the passing position detecting means for detecting which position of the boundary of the input frame has passed and the cursor has been detected by the passing position detecting means. Input frame display position determining means for determining a display position of a new input frame on the basis of the determined position, and controlling the display means so that the new input frame is determined based on the position determined by the input frame display position determining means. In addition to displaying the input frame, the last input is performed in the area of the input frame.
To provide a display control means for displaying a recognition candidate list of characters, a, similar to the case of writing on paper, enables natural input, also even during character input the immediately preceding sentence
For characters, the recognition candidate can be replaced at any time.
You can easily select the correct answer candidate even if the recognition is wrong
Therefore, an advantage is obtained in that a handwritten character processing device capable of quickly and efficiently inputting handwritten characters is obtained.

Further, according to the invention of claim 2, according to claim 1,
In the invention, the input frame display position determining means displays a new input frame when the position at which the cursor has passed the boundary of the input frame is detected as the right end of the input frame by the passing position detecting means. Since the position is set to a position on the right side of the currently displayed input frame, more natural input is possible, and the effect that a handwritten character processing device capable of quickly and efficiently inputting handwritten characters is obtained. Play.

Further, according to the invention of claim 3, according to claim 2,
In the invention, the input frame display position determining means sets the display position of the new input frame to a position overlapping the currently displayed input frame, so that the amount of movement of the hand performing writing moves to the right. Handwritten character processing that enables quick and efficient input of handwritten characters because it can also provide more natural input, save input area on the screen, and increase the number of characters that can be input continuously. The effect that a device is obtained is produced.

According to the invention of claim 4, according to claim 1,
In the invention, the input frame display position determining means displays a new input frame when the position at which the cursor has passed the boundary of the input frame is detected as the left end of the input frame by the passing position detecting means. Since the position is set to the left side of the currently displayed input frame, the input frame can be displayed at the optimum position according to the hand movement when writing, so handwritten characters can be input quickly and efficiently There is an effect that a handwritten character processing device capable of performing the operation can be obtained.

Further, according to the invention of claim 5, according to claim 4,
In the invention, the input frame display position determining means sets the display position of the new input frame to a vicinity of a desired result frame among the one or more displayed result frames, so that a character desired by the operator is displayed. Since it is possible to easily correct the recognition result of the handwritten character, it is possible to obtain a handwritten character processing device capable of quickly and efficiently inputting handwritten characters.

According to the invention of claim 6, according to claim 4,
In the invention, the input frame display position determining means sets the display position of the new input frame to be in the vicinity of the leftmost result frame among the one or more displayed result frames. The input frame can be displayed at the optimal position according to the movement of the hand when performing, and the number of characters that can be continuously input can be increased to the maximum, so that handwritten characters can be input quickly and efficiently This provides an effect that a simple handwritten character processing device can be obtained.

Further, according to the invention of claim 7, according to claim 4,
In the invention, the input frame display position determining means sets the display position of the new input frame to be near the result frame displayed on the rightmost side of the one or more displayed result frames. The input frame can be displayed at the optimal position according to the movement of the hand when performing, and when the result frame and the input frame are too far apart, the space between them can be easily closed to make the result frame and the input frame easy to see. Therefore, there is an effect that a handwritten character processing device capable of quickly and efficiently inputting handwritten characters can be obtained.

According to the eighth aspect of the present invention, the fourth aspect is provided.
In the invention, since the input frame display position determining means sets the display position of the new input frame near the cursor, the input frame is displayed at an optimum position following the movement of the hand when writing. Therefore, there is an effect that a handwritten character processing device capable of inputting handwritten characters quickly and efficiently can be obtained.

According to the ninth aspect of the present invention, the first aspect of the present invention is provided.
In the invention, the input frame display position determining means detects a new input frame when the position at which the cursor has passed the boundary of the input frame is detected as the upper or lower end of the input frame by the passing position detecting means. Is set to the same position as the currently displayed input frame, so that it is desired to continue inputting characters, but if it is not desired to move the input frame further to the right, a new input frame is set to the right. Since the input frame can be displayed based on the operator's will without being displayed, a handwritten character processing device capable of quickly and efficiently inputting handwritten characters is obtained. .

Further, according to the tenth aspect of the present invention, a cursor for inputting a character according to a movement trajectory, an input box indicating an inputtable area of a character input by the cursor, and a character input to the input box Display means for displaying a result frame for displaying a first candidate character from among the recognition candidates, and a cursor state detection means for detecting whether the cursor is in an input on or input off state; A cursor position detecting means for detecting that the cursor has moved out of the area of the input frame when the state detected by the state detecting means is in the input off state; and When it is detected that the cursor has moved out of the area, when the cursor moves out of the area of the input frame, the cursor moves through any position of the boundary of the input frame. A passing position detecting means for detecting whether,
When a position at which the cursor has passed through the boundary of the input box is detected as the left end of the input box by the passing position detecting unit, a post-processing executing unit that performs post-processing of recognition processing in units of phrases or words, Since there is no need for a special operation to instruct the start of post-processing,
There is an effect that a handwritten character processing device capable of quickly and efficiently inputting handwritten characters is obtained.

According to an eleventh aspect of the present invention, in the tenth aspect of the present invention, the post-processing execution means determines that the position at which the cursor has passed the boundary of the input frame by the passing position detecting means is the input frame. Is detected as the left edge of
Characters that have been input up to that point and that have not yet been sent to the system will be subjected to post-processing of recognition processing as one clause or one word. This eliminates the need for this operation, so that a handwritten character processing device capable of quickly and efficiently inputting handwritten characters is obtained.

According to the twelfth aspect of the present invention, in the tenth or eleventh aspect of the present invention, the post-processing execution means corrects an error in the notation of a target character, thereby facilitating the error in the notation of the character. This makes it possible to obtain a handwritten character processing device capable of quickly and efficiently inputting handwritten characters.

According to a thirteenth aspect of the present invention, in the tenth or eleventh aspect, the post-processing execution means adds specific data, so that it is difficult to input specific data when performing handwritten character input. Can be easily input, so that a handwritten character processing device capable of quickly and efficiently inputting handwritten characters is obtained.

According to a fourteenth aspect of the present invention, in the invention of the tenth to thirteenth aspects, after the post-processing is completed by the post-processing execution means, the input of characters into a new input box is started. By providing a transmission means for transmitting the character after the post-processing to the system side,
Data can be sent out in units of phrases or words that required special operations such as pressing a button, and can be performed with the natural operation of the operator as a trigger, enabling quick and efficient input of handwritten characters This provides an effect that a simple handwritten character processing device can be obtained.

[0152] According to the invention of claim 15, in the invention of claim 1 0-14, wherein the display control means controls said display means, said input frame in the area, input immediately before A list of recognized characters is displayed, so even if you are in the middle of entering a character, you can change the recognized candidate at any time, and you can easily select the correct candidate even if the character recognition is incorrect. Thus, an advantage is obtained in that a handwritten character processing device capable of quickly and efficiently inputting handwritten characters is obtained.

According to the invention of claim 16, in the invention of claims 5 to 7, the display control means controls the display means to display the new input frame in the area of the new input frame. The first in the result box displayed closest to the input box
Since a list of candidates and / or recognition candidates other than the first candidate is displayed, even if a character is being input, the recognition candidate can be replaced at any time with respect to the immediately preceding character. Since it is possible to easily select the correct answer candidate, it is possible to obtain a handwritten character processing device capable of quickly and efficiently inputting handwritten characters.

Further, according to the seventeenth aspect of the present invention, an input box indicating an inputtable area of a character input by a cursor for inputting a character according to a locus of movement, and a recognition candidate of a character input to the input box. A result frame for displaying a first candidate character from among them is displayed, and a cursor state detecting step of detecting whether the cursor is in an input on or input off state, and an input off state of the cursor state detecting step is detected. In the state, the cursor position detecting step of detecting that the cursor has moved out of the area of the input frame, and the cursor position detecting step detects that the cursor has moved out of the area of the input frame. When the cursor moves out of the area of the input frame, a passing position detecting step of detecting which position of the boundary of the input frame has passed and moved, An input frame display position determining step of determining a display position of a new input frame based on the position at which the cursor has passed through the passing position detection step, and a position determined by the input frame display position determining step. Displaying the new input frame based on the input frame
A list of recognition candidates for the previously entered character is displayed in the area
Because it includes a Shimesuru display control step, the, similar to the case of writing on paper, enables natural input, The character input
Even if it is in the middle, the character immediately before it is a recognition candidate at any time
Can be swapped and character recognition is incorrect.
Since the correct answer candidate can be easily selected, there is an effect that a handwritten character processing method capable of quickly and efficiently inputting a handwritten character is obtained.

[0155] According to the eighteenth aspect of the present invention, in the seventeenth aspect, the input frame display position determining step includes:
When the position at which the cursor has passed through the boundary of the input box is detected as the right end of the input box by the passing position detection step, the display position of the new input box is set to the right of the currently displayed input box. Since the position is set, more natural input becomes possible, and an effect is obtained that a handwritten character processing method capable of quickly and efficiently inputting handwritten characters is obtained.

Further, according to the nineteenth aspect, in the eighteenth aspect, the input frame display position determining step includes:
Since the display position of the new input frame is set to a position overlapping the currently displayed input frame, more natural input can be performed in accordance with the amount of movement of the hand performing writing to the right, and the input area can be changed. Since it is possible to save and increase the number of characters that can be continuously input, it is possible to obtain a handwritten character processing method capable of quickly and efficiently inputting handwritten characters.

According to a twentieth aspect of the present invention, in the seventeenth aspect, the input frame display position determining step includes:
When the position at which the cursor has passed through the boundary of the input box is detected as the left end of the input box in the passing position detection step, the display position of the new input box is set to the left of the currently displayed input box. It is possible to display the input frame at an optimal position according to the hand movement at the time of writing, so that a handwritten character processing method capable of quickly and efficiently inputting handwritten characters is obtained. It works.

According to a twenty-first aspect of the present invention, in the twentieth aspect, the input frame display position determining step includes the step of:
Since the display position of the new input frame is in the vicinity of a desired result frame among the one or more displayed result frames, it is possible to easily correct the recognition result of the character desired by the operator. Thus, there is an effect that a handwritten character processing method capable of quickly and efficiently inputting handwritten characters can be obtained.

According to a twenty-second aspect of the present invention, in the twentieth aspect, the input frame display position determining step includes the step of:
Since the display position of the new input frame is set near the result frame displayed on the leftmost side of the one or more displayed result frames, the new input frame is input at an optimum position according to the hand movement when writing. Since a frame can be displayed and the number of characters that can be continuously input can be increased to the maximum, there is an effect that a handwritten character processing method that can quickly and efficiently input handwritten characters is obtained.

According to a twenty-third aspect of the present invention, in the twentieth aspect, the input frame display position determining step includes the following steps:
Since the display position of the new input frame is set near the result frame displayed on the rightmost side of the one or more displayed result frames, the input position is set to an optimum position according to the hand movement when writing. Frames can be displayed, and when the result frame and the input frame are too far apart, the space between them can be easily closed to make it easier to see the result frame and the input frame, so that handwritten characters can be input quickly and efficiently. There is an effect that a handwritten character processing method that can perform the method is obtained.

According to a twenty-fourth aspect of the present invention, in the twentieth aspect, the input frame display position determining step includes the step of:
Since the display position of the new input frame is in the vicinity of the cursor, the input frame can be displayed at an optimal position following the movement of the hand when writing, so that handwritten characters can be quickly and efficiently displayed. There is an effect that a handwritten character processing method capable of inputting is obtained.

According to a twenty-fifth aspect of the present invention, in the seventeenth aspect, the input frame display position determining step includes:
When the position where the cursor has passed through the boundary of the input frame is detected as the upper end or the lower end of the input frame by the passing position detection step, the display position of the new input frame is set to the currently displayed input frame. Since the same position is set, further input of characters is desired, but if it is not desired to move the input frame to the further right side, a new input frame is not displayed on the right side and based on the will of the operator. Thus, an input frame can be displayed by using this method, so that a handwritten character processing method capable of quickly and efficiently inputting handwritten characters is obtained.

According to the twenty-sixth aspect of the present invention, an input box indicating an inputtable area of a character input by a cursor for inputting a character according to a locus of movement, and a recognition candidate for a character input to the input box. A result frame for displaying a first candidate character from among them is displayed, and a cursor state detecting step of detecting whether the cursor is in an input on or input off state, and an input off state of the cursor state detecting step is detected. In the state, the cursor position detecting step of detecting that the cursor has moved out of the area of the input frame, and the cursor position detecting step detects that the cursor has moved out of the area of the input frame. When the cursor moves out of the area of the input frame, a passing position detecting step of detecting which position of the boundary of the input frame has passed and moved, A post-processing execution step of performing post-processing of recognition processing on a phrase or word basis when the position at which the cursor has passed the boundary of the input frame is detected as the left end of the input frame by the passing position detection step; Since no special operation is required for instructing the start of post-processing, a handwritten character processing method capable of quickly and efficiently inputting handwritten characters is obtained.

According to a twenty-seventh aspect of the present invention, in the twenty-sixth aspect of the present invention, in the post-processing execution step, the position at which the cursor has passed the boundary of the input frame in the passing position detecting step is the input frame. Is detected as the left edge of
Characters that have been input up to that point and that have not yet been sent to the system will be subjected to post-processing of recognition processing as one clause or one word. This eliminates the need for the above operation, so that a handwritten character processing method that can quickly and efficiently input handwritten characters is obtained.

According to the twenty-eighth aspect of the present invention, in the twenty-sixth aspect or the twenty-seventh aspect, the post-processing execution step corrects a spelling error of a target character, thereby facilitating the spelling error of the character. Therefore, a handwritten character processing method capable of quickly and efficiently inputting handwritten characters is obtained.

According to the twenty-ninth aspect of the present invention, in the twenty-sixth or twenty-seventh aspect, the post-processing execution step adds specific data, so that it is difficult to input specific data when performing handwritten character input. Can be easily input, so that a handwritten character processing method capable of quickly and efficiently inputting handwritten characters is obtained.

According to the invention of claim 30, in the invention of claims 26 to 29, after the post-processing is completed in the post-processing execution step, the input of characters into a new input box is started. Since the method includes a sending step of sending the post-processed character to the system side, the sending operation of data in units of phrases or words, which conventionally required a special operation such as pressing a button, can be performed naturally by the operator. Since a simple operation can be performed, a handwritten character processing device capable of quickly and efficiently inputting handwritten characters is obtained.

According to the thirty-first aspect of the present invention,
In the inventions of claims 26 to 30, since the display control step displays a list of recognition candidates for the character that has been input immediately before in the area of the input frame, even if the character is in the middle of being input, the character immediately before it is not displayed. You can replace recognition candidates at any time,
Since the correct answer candidate can be easily selected even when the character recognition is erroneous, a handwritten character processing method capable of quickly and efficiently inputting a handwritten character is obtained.

According to the invention of claim 32, in the invention of claims 21 to 23, the display control step is displayed in the area of the new input box in the vicinity of the new input box. A list of the first candidates and / or a list of recognition candidates other than the first candidates in the result frame is displayed. Therefore, even if a character is being input, the recognition candidate can be replaced at any time for the immediately preceding character. Since the correct candidate can be easily selected even when the recognition is wrong, an effect is obtained that a handwritten character processing method capable of quickly and efficiently inputting a handwritten character is obtained.

Further, the storage medium according to the invention of claim 33 records a program for causing a computer to execute the method according to claims 17 to 32, so that the program becomes machine-readable. There is an effect that a recording medium capable of realizing the operations of the items 5 to 8 by a computer is obtained.

[Brief description of the drawings]

FIG. 1 is a block diagram showing a hardware configuration of an information processing apparatus including a handwritten character processing apparatus according to an embodiment of the present invention.

FIG. 2 is a block diagram functionally showing a configuration of a handwritten character processing device according to the present embodiment.

FIG. 3 is a block diagram functionally showing another configuration of the handwritten character processing device according to the present embodiment.

FIG. 4 is an explanatory diagram showing display contents of a display unit of the handwritten character processing device according to the present embodiment.

FIG. 5 is an explanatory diagram showing another display content of the display unit of the handwritten character processing device according to the present embodiment.

FIG. 6 is an explanatory diagram showing another display content of the display unit of the handwritten character processing device according to the present embodiment.

FIG. 7 is an explanatory diagram showing another display content of the display unit of the handwritten character processing device according to the present embodiment.

FIG. 8 is an explanatory diagram showing another display content of the display unit of the handwritten character processing device according to the present embodiment.

FIG. 9 is an explanatory diagram showing another display content of the display unit of the handwritten character processing device according to the present embodiment.

FIG. 10 is an explanatory diagram showing another display content of the display unit of the handwritten character processing device according to the present embodiment.

FIG. 11 is an explanatory diagram showing another display content of the display unit of the handwritten character processing device according to the present embodiment.

FIG. 12 is an explanatory diagram showing another display content of the display unit of the handwritten character processing device according to the present embodiment.

FIG. 13 is an explanatory diagram showing another display content of the display unit of the handwritten character processing device according to the present embodiment.

FIG. 14 is an explanatory diagram showing another display content of the display unit of the handwritten character processing device according to the present embodiment.

FIG. 15 is an explanatory diagram showing another display content of the display unit of the handwritten character processing device according to the present embodiment.

FIG. 16 is a flowchart (part 1) illustrating a sequence of a series of processes of the handwritten character processing device according to the present embodiment;

FIG. 17 is a flowchart (part 2) illustrating a sequence of a series of processes of the handwritten character processing device according to the present embodiment.

FIG. 18 is a flowchart (part 3) illustrating a series of processing procedures of the handwritten character processing apparatus according to the present embodiment.

FIG. 19 is a flowchart (part 4) illustrating a series of processing procedures of the handwritten character processing apparatus according to the present embodiment.

[Explanation of symbols]

101 CPU 102 ROM 103 RAM 104 HDD 105 HD 106 FDD 107 FD 108 Display 109 I / F 110 Communication line 111 Keyboard 112 Mouse 113 Scanner 114 Printer 115 Tablet 116 Pen 117 Bus 200 System side 201 Cursor 202 Display section 203 Cursor state detecting section 204 Cursor position detection unit 205 Passage position detection unit 206 Input frame display position determination unit 210 Display control unit 220, 400, 500, 600, 800, 900, 1
000, 1100, 1200, 1400, 1500 Input frame 230, 707, 807-809, 906 Result frame 301 Post-processing execution unit 302 Sending unit 401 Conversion button 402 DEL button 403 BS button 404 Cancel button 405 Send button 406 Setting button 450, 550, 650, 850, 950, 1050,
1150, 1250, 1450, 1550 Handwritten character input area 501 Boundary line (right end) 701-706, 801-805, 901-905, 1
001 to 1005 recognition candidate display field 708 Result frame cursor 806 Down arrow button 810, 910, 1101 Border (left end) 1401 Border (top) 1402 Border (bottom)

────────────────────────────────────────────────── ─── Continuation of the front page (51) Int.Cl. ⁷ Identification symbol FI G06K 9/03 G06K 9/72 Z 9/72 G06F 15/20 506A (56) References JP-A-1-210222 (JP, A JP-A-1-261720 (JP, A) JP-A-63-132387 (JP, A) JP-A-9-6919 (JP, A) JP-A-64-14684 (JP, A) 7034 (JP, A) JP-A-4-347721 (JP, A) JP-A-4-344918 (JP, A) (58) Fields investigated (Int. Cl. ⁷ , DB name) G06K 9/62 G06K 9 / 03 G06K 9/72 G06F 3/03 G06F 3/033 G06F 17/22

Claims (33)

(57) [Claims] 1. A cursor for inputting a character according to a movement trajectory, an input box indicating an inputtable area of a character input by the cursor, and a first candidate from among recognition candidates for a character input in the input box. And a display unit for displaying a result frame for displaying a character of the character. A cursor state detecting unit for detecting whether the cursor is in an input-on state or an input-off state, and a state detected by the cursor state detecting unit. A cursor position detecting unit that detects that the cursor has moved out of the area of the input box in a state where the input is off, and the cursor has moved out of the area of the input box by the cursor position detecting unit. Is detected, when the cursor moves out of the area of the input frame, the cursor moves through any position of the boundary of the input frame. Passing position detecting means for detecting whether the cursor has passed the position detected by the passing position detecting means, input frame display position determining means for determining a display position of a new input frame, the display means To display the new input frame based on the position determined by the input frame display position determining means , and to input the last input frame in the area of the input frame.
And a display control means for displaying a list of recognition candidates for the extracted characters. 2. The input frame display position determining means, when the position at which the cursor has passed the boundary of the input frame is detected as the right end of the input frame by the passing position detecting means, a new input frame is determined. 2. The handwritten character processing device according to claim 1, wherein the display position is set to a position on the right side of the currently displayed input frame. 3. The handwritten character according to claim 2, wherein the input frame display position determining means sets a display position of the new input frame to a position overlapping with the currently displayed input frame. Processing equipment. 4. The input frame display position determining means, when a position at which the cursor has passed the boundary of the input frame is detected as the left end of the input frame by the passing position detecting means, a new input frame is determined. 2. The handwritten character processing device according to claim 1, wherein the display position is set to a position on the left side of the currently displayed input frame. 5. The input frame display position determining means sets a display position of the new input frame near a desired result frame among the one or more displayed result frames. 5. The handwritten character processing device according to 4. 6. The input frame display position determining means sets the display position of the new input frame to be close to a leftmost result frame among the one or more displayed result frames. The handwritten character processing device according to claim 4, characterized in that: 7. The input frame display position determining means sets the display position of the new input frame to be in the vicinity of a rightmost result frame among the one or more displayed result frames. The handwritten character processing device according to claim 4, characterized in that: 8. The handwritten character processing device according to claim 4, wherein said input frame display position determining means sets a display position of said new input frame near said cursor. 9. The input frame display position determining means, when the position at which the cursor has passed the boundary of the input frame is detected as the upper end or the lower end of the input frame by the passing position detecting means, a new input frame display position is determined. 2. The handwritten character processing device according to claim 1, wherein the display position of the frame is set to the same position as the currently displayed input frame. 10. A cursor for inputting a character according to a movement locus, an input box indicating an inputtable area of a character input by the cursor, and a first candidate from among recognition candidates for the character input in the input box. And a display unit for displaying a result frame for displaying a character of the character. A cursor state detecting unit for detecting whether the cursor is in an input-on state or an input-off state, and a state detected by the cursor state detecting unit. A cursor position detecting unit that detects that the cursor has moved out of the area of the input box in a state where the input is off, and the cursor has moved out of the area of the input box by the cursor position detecting unit. Is detected, when the cursor moves out of the area of the input frame, the cursor moves through any of the boundaries of the input frame. Passing position detecting means for detecting whether the cursor has passed through the boundary of the input frame is detected as the left end of the input frame by the passing position detecting means, the recognition processing of the phrase unit or word unit And a post-processing executing means for performing post-processing. 11. The post-processing execution means, when the position at which the cursor has passed the boundary of the input frame is detected as the left end of the input frame by the passing position detection means, the character input so far. 11. The handwritten character processing device according to claim 10, wherein a post-recognition process is performed for a sentence that has not yet been sent to the system side as one phrase or one word. 12. The post-processing execution unit corrects a notation error of a target character.
Or the handwritten character processing device according to 11. 13. The handwritten character processing device according to claim 10, wherein the post-processing execution unit adds specific data. 14. A sending means for sending a character after completion of the post-processing to the system side by starting to input a character in a new input frame after the post-processing by the post-processing executing means. The handwritten character processing device according to any one of claims 10 to 13, further comprising: 15. The display control unit according to claim 1, wherein the display control unit controls the display unit to display a list of recognition candidates for a character input immediately before in the area of the input frame.
The handwritten character processing device according to any one of 0 to 14. 16. The display control means controls the display means to display a first candidate in a result frame displayed nearest to the new input frame in a region of the new input frame. The handwritten character processing device according to any one of claims 5 to 7, wherein a list of recognition candidates other than the first candidate is displayed. 17. An input box indicating an inputtable area of a character input by a cursor for inputting a character according to a movement locus, and a first candidate character is displayed from recognition candidates of the character input in the input box. A cursor state detecting step of detecting whether the cursor is in an input on or input off state, and a state detected by the cursor state detecting step is in an input off state. A cursor position detecting step of detecting that the cursor has moved out of the area of the input box; and a step of detecting that the cursor has moved out of the area of the input box by the cursor position detecting step. When the cursor moves out of the area of the input frame, a passing position detecting step of detecting which position of the input frame has passed and moved, An input frame display position determining step of determining a display position of a new input frame based on the position at which the cursor has been detected by the passing position detecting step; and a position determined by the input frame display position determining step. Displaying the new input frame based on the input
In the area of the frame, the recognition candidate list of the character entered immediately before is displayed.
A display control step of displaying, and a method for processing a handwritten character, comprising: 18. The input frame display position determining step, when a position at which the cursor has passed the boundary of the input frame is detected as the right end of the input frame by the passing position detecting step, a new input frame is determined. The display position is set to a position on the right side of a currently displayed input frame.
The method for processing handwritten characters described in. 19. The handwritten character according to claim 18, wherein in the input frame display position determining step, the display position of the new input frame is set to a position overlapping the currently displayed input frame. Processing method. 20. The input frame display position determining step, wherein when the position at which the cursor has passed the boundary of the input frame is detected as the left end of the input frame by the passing position detecting step, a new input frame is determined. The display position is set to a position on the left side of the currently displayed input frame.
The method for processing handwritten characters described in. 21. The input frame display position determining step, wherein the display position of the new input frame is set near a desired result frame among the one or more displayed result frames. 20. The method for processing handwritten characters according to 20. 22. The input frame display position determining step, wherein the display position of the new input frame is set in the vicinity of the leftmost result frame among the one or more displayed result frames. 21. The handwritten character processing method according to claim 20, wherein: 23. The input frame display position determining step includes setting a display position of the new input frame near a result frame displayed on the rightmost side of the one or more displayed result frames. 21. The handwritten character processing method according to claim 20, wherein: 24. The handwritten character processing method according to claim 20, wherein in the input frame display position determining step, the display position of the new input frame is set near the cursor. 25. The input frame display position determining step, wherein when the position at which the cursor has passed the boundary of the input frame is detected as the upper or lower end of the input frame in the passing position detecting step, a new input is performed. 18. The handwritten character processing method according to claim 17, wherein the display position of the frame is set to the same position as the currently displayed input frame. 26. An input box indicating a region where characters can be input by a cursor for inputting characters according to a movement trajectory, and a first candidate character is displayed from recognition candidates of the character input in the input frame. A cursor state detecting step of detecting whether the cursor is in an input on or input off state, and a state detected by the cursor state detecting step is in an input off state. A cursor position detecting step of detecting that the cursor has moved out of the area of the input box; and a step of detecting that the cursor has moved out of the area of the input box by the cursor position detecting step. When the cursor moves out of the area of the input frame, a passing position detecting step of detecting which position of the input frame has passed and moved, A post-processing execution step of performing post-processing of recognition processing in units of phrases or words, when the position at which the cursor has passed the boundary of the input box is detected as the left end of the input box by the passing position detection step; A handwritten character processing method comprising: 27. The post-processing execution step, wherein when the position at which the cursor has passed through the boundary of the input box is detected as the left end of the input box by the passing position detecting step, the characters input up to that time are detected. 27. The handwritten character processing method according to claim 26, wherein a post-recognition process is performed for a sentence that has not yet been sent to the system side as one phrase or one word. 28. The post-processing execution step corrects a notation error of a target character.
Or the handwritten character processing method according to 27. 29. The handwritten character processing method according to claim 26, wherein the post-processing execution step adds specific data. 30. After the post-processing is completed by the post-processing execution step, a character input operation is started in a new input box, so that the character of the post-processing is transmitted to the system side. Claims 26 to 2 characterized by the above-mentioned.
9. The method for processing handwritten characters according to any one of 9 above. 31. The display control method according to claim 26 , wherein the display control step displays a list of recognition candidates for the character input immediately before in the area of the input frame. Handwritten character processing method. 32. The display control step, wherein, within the area of the new input frame, a first candidate in a result frame displayed nearest to the new input frame and / or a candidate other than the first candidate is displayed. The handwritten character processing method according to any one of claims 21 to 23, wherein a list of recognition candidates is displayed. 33. A computer-readable recording medium on which a program for causing a computer to execute the method according to claim 17 is recorded.