JPH06324797A - Handwritten input device - Google Patents

Abstract

PURPOSE:To easily perform the correction operation of data at a high speed by replacing image data for newly inputted image data when a distance between the written position of a recognized correction graphic and the written position of the image data newly inputted after writing the correction graphic is within a prescribed value. CONSTITUTION:When handwritten input is performed to an input display device by a pen following the handwritten input of the correction graphic, characters or the like inputted by the pen are displayed on the input display device. Then, the image data are stored in an image memory I26 and a CPU 21 instructs an image processing part 31 to calculate a difference between the sizes of the correction graphic and the image data for correction when it is judged that the handwritten image data displayed on a display part 13a are written near the correction graphic. Then, after erasing the image data of a position corresponding to the written position of the correction graphic inside the image memory II27, the adjacent image data in the rear are shifted only by a difference portion received from the image processing part 31.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a handwriting input device for inputting data by handwriting, and more particularly to a handwriting input device capable of correcting image data on a screen by handwriting input.

[0002]

2. Description of the Related Art Recently, the importance of user interfaces in computers has been recognized. Along with this, GUI (Graphical User Interfac
e; Graphical user interface) is becoming the mainstream of user interface.

In this interface, by selecting an icon (pictorial symbol) by operating a mouse or the like,
All operations other than character input such as command selection, file operation, and program startup can be executed from the menu.

By the way, the conventional GUI has a problem in terms of operability because it is based on mouse operation. That is, the movement of the mouse cursor for selecting an icon by operating the mouse is not so smooth, and it takes a long time even if the user gets used to it. Also, a space for operating the mouse was required. Recently, pen input has been attracting attention as a means for overcoming the drawbacks of the mouse as a pointing device.

The pen input allows the user to directly input characters, figures and the like on the display surface in the same manner as when writing in a notebook or notebook that the user is accustomed to. Moreover, since the selection of an icon can be pointed out directly with a pen, it is very easy and fast, and it is suitable as a pointing device for GUI.

[0006]

[Problems to be Solved by the Invention] However, in the past,
To correct data by handwriting with a pen, delete the image data to be corrected by inputting a deletion figure (gesture to specify deletion) and then input an insertion figure (gesture to specify the insertion position). It was necessary to input two types of figures (gestures) such as to specify the input position of the correction data. For this reason, data correction work is complicated and troublesome.

Further, when making correction, it is easier to correct the data while confirming the data before correction. However, if the data before correction is erased by deletion, such confirmation work cannot be performed, and therefore the correction work is required. It may not go smoothly. Moreover, not only that, but also erasing the data causes an inconvenience that it is impossible to immediately know what the deleted data was in the case of an error in the correction operation. For this reason, correction work must be done carefully,
As a result, there is a problem that the work does not proceed easily.

According to the present invention, in a handwriting input device using a pen input as a basic operation, correction work such as rewriting of already input image data by handwriting input with a pen is performed with a feeling similar to that of a pen operation on paper. It aims to be easier and faster than that.

[0009]

The invention according to claim 1 (first invention) includes the following respective means. The display means is a device that displays image data in a bitmap format,
For example, it is composed of a liquid crystal display device or the like.

The coordinate detection means detects the coordinates of the operation position of the pen on the display screen of the display means. This means is composed of, for example, a pressure sensitive type, a capacitance type, an electromagnetic induction type tablet (digitizer).

The image recognition means recognizes the input of the corrected figure based on the coordinate data of the operation position of the pen detected by the coordinate detection means. The detection means detects the distance between the entry position of the corrected graphic recognized by the image recognition means and the entry position of the image data newly handwritten after the correction graphic is written.

When the distance detected by the detecting means is within a predetermined value, the replacing means replaces the image data overwritten with the corrected figure with the newly input image data.

The image recognition means, the detection means, and the replacement means are composed of, for example, a CPU (central processing unit), an image registration memory, a subsystem dedicated to image data processing, and the like.

The invention according to claim 2 (second invention) includes the following means. In addition to the display means, the coordinate input means, the image recognition means, the detection means, and the replacement means of the first invention, the following means are provided.

The difference detecting means detects the difference between the size of the corrected graphic and the size of the image data newly input after the correction graphic is entered. The shift means moves the image data displayed subsequently to the rear of the corrected figure according to the difference detected by the difference detection means.

Then, the replacing means moves the newly input image data between the start position of the image data overwritten with the corrected figure and immediately before the image data moved by the replacing means. Let

The difference detecting means and the shift means are composed of, for example, a CPU (central processing unit), an image registration memory, a subsystem dedicated to image data processing, and the like.

[0018]

In the first aspect of the present invention, when the user inputs a corrected figure by handwriting on the screen displayed on the display means by the pen operation, the coordinate input means detects the coordinates of the entry position on the screen. The image recognition means receives the coordinate data of the detected handwriting input from the coordinate input means,
Based on this coordinate data, it is recognized that the corrected figure is input by handwriting.

Next, when the user manually inputs the correction image data in the vicinity of, for example, immediately above or immediately below the correction figure by operating the pen, the detecting means detects the entry position of the newly input image data. The distance from the entry position of the corrected figure is detected. When the distance detected by the detecting means is within a predetermined value, the replacing means replaces the image data overwritten with the corrected figure with the newly input image data.

As a result, the image data designated for correction by handwriting input is corrected to image data newly input by handwriting in the vicinity thereof. In the second invention, in addition to the operation of the first invention, the difference detecting means includes:
The shift means detects the difference between the size of the corrected figure and the size of the newly input image data, and the shift means, in accordance with the detected difference, displays the non-corrected image adjacent to the rear of the corrected figure. The data is moved in a direction away from the position where the corrected graphic is written or into the position where the corrected graphic is written. Then, the replacing means moves the newly input image data between the beginning position of the image data overwritten with the corrected figure and immediately before the moved image data.

As a result, even if the size of the image data to be corrected is different from the size of the newly input image data for correction, the non-correction image data following the image data to be corrected is the image data for correction. Since the data can be moved according to the size of so that there is no unnatural spacing between the data, the corrected result will also be a clean finish.

[0022]

Embodiments of the present invention will be described below with reference to the drawings. FIG. 1 is an external view of an embodiment of the present invention.

The apparatus shown in the figure has a basic operation of handwriting input with the pen 11 and has a handwritten character recognition function. The entire device has a pad type outer shape, and a pen storage groove 12 for storing a pen 11 is provided above the device. Further, an input / display device 13 for pen input is incorporated in almost the entire upper surface except the pen housing groove 12.

The input / display device 13 is composed of a display unit 13a composed of a bitmap display such as a liquid crystal display, and a coordinate input unit 13b composed of a tablet arranged so as to overlap with the display unit 13a.

Next, the system configuration of the embodiment having the above appearance is shown in FIG. In the figure, a CPU 21 is a central processing unit such as a microprocessor, and executes a program stored in a program memory 22 to control each component in the system.

The coordinate input section 13b is composed of, for example, a pressure-sensitive tablet or an electromagnetic induction tablet, and when a pen input is detected, the coordinate position of this pen input (coordinate data of the handwriting input writing locus) is passed through an interface not shown. CP
Output to U21. The CPU 21 generates handwritten image data by pen input from this coordinate data and writes it in the image memory I26.

The image recognition unit 23 receives the instruction from the CPU 21, recognizes the handwritten input data as a character or a graphic, and returns the recognition result to the CPU 21. In response to an instruction from the CPU 21, the command recognition unit 24 collates the graphic data obtained by the graphic recognition of the image recognition unit 23 with the graphic data group stored in the reserved command memory 25, and inputs the corrected graphic by handwriting. Recognize. And
This recognition result is returned to the CPU 21.

The reserved command memory 25 stores all edit commands usable in this apparatus. CPU21
In response to the recognition result of the command recognition unit 24, if the corrected figure is input, the handwritten input coordinate data of this corrected figure is used to calculate the image data to be corrected displayed at the input position of this corrected figure. The storage position in the image memory II 27 is detected.

The image memory I26 is a memory for storing the latest handwritten input image data pen-input on the screen of the input / display device 13 in a bitmap format.
The image memory II 27 is a memory for storing the already input image data currently displayed on the screen in the bitmap format.

The display memory 28 is a frame memory for storing the image data of the screen displayed on the display unit 13a in the bitmap format. The display control unit 29 reads the image data from the display memory 28, converts the image data into a serial video signal, outputs the serial video signal to the display unit 13a, and supplies a horizontal / vertical synchronization signal to the display unit 13a. The image of the image data stored in the display memory 28 is displayed on.

In response to an instruction from the CPU 21, the image processing unit 31 receives the instruction based on the handwriting input coordinate data of the image data newly input by handwriting, and the image data is input position of the corrected figure detected by the CPU 21. The handwriting input of the correction image data is recognized by checking whether or not the input is made in an area within a predetermined constant distance from. If the correction image data has been input, the correction image data is sequentially written in the image development memory 32. Then, when the writing is completed, the arithmetic unit 33 is caused to calculate the difference between the size of the correction image data and the size of the corrected figure stored in the image memory I26, and the calculation result is notified to the CPU 21.

The CPU 21 shifts the uncorrected image data input adjacently behind the input position of the corrected figure in the image memory II 27 according to the notified difference, and then the image processing unit. The correction image data stored in the image expansion memory 32 is transferred to the address 31 and subsequent addresses in the image memory II 27 corresponding to the input start position of the corrected figure.

The image development memory 32 is a bit map format memory for temporarily storing the correction image data generated by the image processing unit 31 as described above.

The calculation unit 33 calculates the difference between the size of the correction image data stored in the image expansion memory 32 and the size of the corrected figure stored in the image memory I26.

The page file 34 stores a plurality of pages of one page (corresponding to one screen of the display unit 13) created by pen input. The CPU 21 writes the one-page document in the page file 34 every time a one-page document is created on the display screen of the input / display device 13.

Next, a method of correcting already input data in the embodiment having the above-mentioned structure will be described with reference to the schematic diagram shown in FIG. In the figure, the rectangular frame indicates the input / display device 1.
3 shows a display screen of No. 3.

As shown in FIG. 3A, the input / display device 1
On the display screen of No. 3, 5 above "ABCde"
After the handwriting input of the image data of each of the English letters 41 and the letters, numbers, or symbols represented by the spiral mark 42 below the pen 11, the letters “AB” in the English letters 41 above are input.
It is assumed that it is necessary to correct the three letters "C" into lowercase letters "abc". In this case, first, as shown in FIG.
A horizontal line 43 is drawn on the three letters "ABC".

When the apparatus recognizes that the written horizontal line 43 is a corrected figure overwritten on the already input image data, the corrected figure 43 corrects the overwritten image data. Recognize that the data is correct.

Next, the user manually inputs "abc" 44 as correction image data just above "ABC" overwritten with the correction graphic 43, as shown on the left side of FIG. As a result, as shown on the right side of FIG. 7B, the image data “AB
The correction image data “abc” newly input by handwriting is displayed in place of “C” and the corrected “AB” is displayed.
Since the display width of “abc” input for correction is shorter than the display width of “C”, the already displayed “de” following this is moved to the left (corrected image data “AB
It is displayed by invading the area where "C" was displayed.

Further, when the user needs to confirm the deleted data later, new image data is not handwritten in the vicinity of the entry position of the corrected figure 43. That is, as shown in FIG. 7C, when the image data “ABC” is not simply corrected to another image data but simply deleted, the image data newly input after the corrected figure 43 is input. “Abc” is input by handwriting at a position (lower right in the example in the drawing) that is a predetermined distance or more away from the correction position (the position where the corrected graphic 43 is written).

The apparatus side recognizes that the newly written image data "abc" is not the correction image data but the normal handwritten input image data, and the data is changed as shown in FIG. Without replacing
Corrected figure 43 and "AB
Display "C" as it is.

It is often convenient to review the handwriting data to be deleted in a book entry such as a notebook or the like, rather than deleting it with an eraser, for later review. For example, it may be useful as a clue to immediately remember things before and after filling in, or you may notice an error in deletion.

In this embodiment, in the case of simple deletion, the image data to be inputted subsequently to the corrected figure 43 is
By inputting at a predetermined distance or more from the corrected graphic 43, the corrected graphic 43 and the image data designated to be deleted by the corrected graphic 43 are not erased but left as they are, so that the above case can be dealt with. I have to.

Next, the operation of this embodiment for rewriting or deleting already input image data by handwriting input of the corrected figure 43 will be described with reference to the flowchart of FIG. .

The user inputs the pen 11 on the input / display device 13.
When the handwriting operation (handwriting input) is performed by
3b is a handwritten input coordinate position (a coordinate position in the normalized coordinate system detected on the coordinate input unit 13b of the position operated by the pen. In the present embodiment, the normal position detected by the display unit 13a and the coordinate input unit 13b). The coordinated coordinate system is the same), and this coordinate data is notified to the CPU 21 by interruption (S1).

The CPU 21 creates image data in which the input handwritten input coordinate data is the same as the locus drawn in chronological order and writes it in the image memory I26 (S2).

When the handwriting input by the user is completed and the interruption from the coordinate input unit 13b is interrupted for a predetermined time or longer, the CPU 21 determines that the handwriting input is completed,
The image data newly written in the image memory I26 by handwriting this time and the already input / displayed handwritten input image data stored in the image memory II27 are OR-synthesized and written in the display memory 28.
The display control unit 29 reads out the OR-combined image data from the display memory 28 and causes the display unit 13a to display an image corresponding to the image data (S3).

With the above operation, when the user performs handwriting input on the input / display device 13 with the pen 11, the characters and figures input by the pen are immediately displayed on the input / display device 13 (see FIG. )).

Next, the CPU 21 checks whether or not the handwritten image data written in the image memory I26 by the above-mentioned pen input is the corrected figure 43 instructing the rewriting or erasing of the already input data (S4). In this process,
The CPU 21 first detects the handwritten input image data stored in the image memory I26 by the image recognition unit 23.
Then, it is instructed to recognize whether it is a character or a graphic. The image recognition unit 23 receives the above instruction, recognizes the above, and notifies the CPU 1 of the result. CPU2
When the 1 knows from this notification that a graphic has been input by the pen, it transfers the graphic image data to the command recognition section 24 and instructs the command recognition unit 24 to recognize whether or not the graphic image data is a corrected graphic. The command recognition unit 24 collates this graphic image data with the graphic data group of the edit command stored in the reserved command memory 25 to check whether or not it is a corrected graphic, and notifies the CPU 21 of the recognition result. When the CPU 21 knows from this notification that the corrected figure has been input by the pen (S4, Yes), the next step S
In steps 5 to S7, the same processing as that in steps S1 to S3 described above is performed on the handwritten input image data following the input of the corrected figure.

By the above operation, when the user performs handwriting input on the input / display device 13 with the pen 11 after handwriting input of the corrected figure 43, the characters etc. input by the pen are input to the input / display device 13. It is displayed immediately (see the left side of Figure 3 (b) or the same figure (c)).

After the pen input is detected in step S5, the image data is stored in the image memory I26 in step S6, and the display unit 13a is stored in step S7.
The handwritten image data displayed on the
It is checked whether or not the handwritten input in 1 is entered in the vicinity of the corrected figure 43 (S8). This is because the corrected figure 43 previously input by handwriting received from the coordinate input unit 13b is collated with both coordinate data of the image data input by handwriting after that, and the input coordinate position of the handwritten input image data is This is a process of checking whether or not it is within a predetermined distance from the input coordinate position of the corrected figure 43.

When the CPU 21 knows that the image data input by handwriting after the correction graphic 43 is written in the vicinity of the correction graphic 43, that is, the correction image data is input by the pen (S8, Yes), The correction image data input by handwriting and the image memory I2
The image processing unit 31 is instructed to calculate the size difference from the corrected figure 43 written in No. 6. The image processing unit 31 causes the calculation unit 33 to calculate the difference between the sizes of the two figures based on this instruction, and the calculation result is calculated by the CPU 21.
(S9).

The CPU 21 erases the image data stored in the position corresponding to the entry position of the corrected figure 43 in the image memory II 27, and then the image data adjacent to the rear of the erased image data is subjected to the image processing. It shifts forward or backward by the difference received from the unit 31 (S10).

Subsequently, the CPU 21 causes the image memory I
The image data of the corrected figure 43 in 26 is deleted. Then, the correction image data written in the vicinity thereof is moved according to the head position of the correction graphic 43 (S11).

Next, the CPU 21 causes the image memory I2
The image data in 6 and the image data in the image memory II 27 are OR-combined at corresponding bit positions. Then, after the result obtained by this logical operation is stored in the image memory II 27, all the image data in the image memory II 27 is written in the display memory 28.
After that, the display control unit 29 reads out the image data from the display memory 28 and displays the execution result of the correction process instructed by the input of the correction graphic 43 on the screen of the input / display device 13 (S12).

Then, the CPU 21 causes the image memory I
26 is cleared (S13), the process returns to step S1 to wait for the next handwriting input. On the other hand, when the input image data is not written in the vicinity of the corrected figure 43 in step 8, it is determined that the image data is not the correction image data but the normal handwritten writing image data (S8). , No), in this case, the process immediately proceeds to step S12.

As a result, the image data written at a position more than a predetermined distance from the corrected graphic 43, such as "abc" shown in FIG. 3 (c), is corrected. Not regarded as image data,
It is regarded as newly input image data and displayed at the entry position. Then, the image data for deletion in which the corrected graphic 43 is overwritten is displayed and stored as it is together with the corrected graphic 43.

Further, in step S4, the corrected figure 43
When image data other than the above is input (S4, N
o), the process immediately proceeds to step S12. As a result, the normal handwritten input image data for which the corrected figure 43 has not been input previously is input to the entry position.

By the above operation, when the user himself / herself inputs the corrected figure 43 onto the already input data, the image data overwritten with the corrected figure 43 is automatically recognized as the correction target. Then, when image data (correction image data) is newly pen-input in the vicinity of the corrected figure 43, the image data overwritten with the corrected figure 43 is replaced with the correction image data.

Therefore, when rewriting the already input data, the user only needs to handwrite the corrected graphic 43 on the already input data and then write the correction image data in the vicinity of the corrected graphic 43 following this input. good. That is, the correction designation and the correction target can be designated by only one pen operation. In addition, the user should pay attention to the size in order to move the image data following this data forward or backward according to the size of the image data to be corrected so as not to cause an unnatural interval between the data. The correction of the image data can be performed easily and at a high speed only by writing the correction image data in the vicinity of the correction portion without performing the correction.

In the above embodiment, one horizontal line is entered as the corrected figure, but the present invention is not limited to such an input method.
It is also possible to input a figure having another shape such as a waveform, a sawtooth shape, an X mark, a double line, or the like that can specify the range of already input image data to be corrected.

Further, in the above embodiment, the image data input by handwriting is corrected.
The present invention is not limited to this, and may be image data such as text data converted into a character code by handwritten character recognition or text data input from the outside by downloading or the like.

In the above embodiment, the uncorrected image data input after the image data corrected by the correction graphic 43 is moved according to the size of the newly input correction image data. However, without moving the uncorrected image data like this,
The size of the correction image data may be automatically changed according to the size of the corrected figure and the corrected image data may be inserted in the entry position of the corrected figure.

Further, when the image data newly input by handwriting after the correction figure is entered is not entered in the vicinity of the corrected figure, the corrected figure and the image data corrected by this corrected figure are left as they are. However, the image data corrected and designated by the correction graphic may be immediately erased together with the correction graphic without leaving the correction graphic.

[0065]

According to the present invention, the correction figure is overwritten by simply handwriting the correction figure onto the image data to be corrected and handwriting the correction image data in the vicinity of the correction figure. The image data is rewritten with the correction image data.

For this reason, the pen on paper is not required to perform the complicated operation of inputting the correction image data after inputting a figure (gesture) for instructing two types of deletion and insertion as in the conventional case. Correction work can be performed with a feeling similar to operation. Moreover, it is convenient and easy and fast.

Further, since the image data to be corrected can be confirmed until the rewriting of the correction is completed, if an error is noticed during the correction, it is possible to immediately know what the original data was. Therefore, it is convenient that the correction work can be carried out with confidence.

Further, when the size of the image data to be corrected and the size of the image data for correction are different, the image data behind the image data for correction is automatically moved and tidyed. The result after that is a beautiful finish. Therefore, the display is easy to see, and the printed output is convenient and convenient.

In the case of simply deleting, the image data to be inputted subsequently to the corrected figure may be inputted at a predetermined distance or more from the corrected figure. When such an input is made, the image data to be deleted remains unerased in the state in which the corrected figure is overwritten. Therefore, when reviewing later, for example, a clue to immediately remember the matter before and after the entry. If the correction is an error, the error can be easily found.

[Brief description of drawings]

FIG. 1 is an external view of an embodiment of the present invention.

FIG. 2 is a block diagram showing a system configuration of the above embodiment.

FIG. 3 is a diagram illustrating a method of correcting already input data.

FIG. 4 is a flowchart illustrating the operation of the above embodiment.

[Explanation of symbols]

 13 input / display device 13a display unit 13b coordinate input unit 21 CPU 22 program memory 23 image recognition unit 24 command recognition unit 25 reserved command memory 26 image memory I 27 image memory II 28 display memory 29 display control unit 31 image processing unit 32 image Expansion memory 33 Operation section 34 Page file

Claims (2)

[Claims] 1. A display means for displaying image data, a coordinate detection means for detecting coordinates of a pen operation position on a display screen of the display means, and a pen operation position detected by the coordinate detection means. An image recognition means for recognizing the input of the corrected figure based on the coordinate data, an entry position of the corrected figure recognized by the image recognition means, and an entry of the image data newly input by handwriting after the entry of the corrected figure Detecting means for detecting the distance to the position, and replacing means for replacing the image data overwritten with the corrected figure with the newly input image data when the distance detected by the detecting means is within a predetermined value. And a handwriting input device. 2. A difference detecting means for detecting a difference between a size of the corrected figure and a size of image data newly input after the correction figure is written, and a difference detecting means according to the difference detected by the difference detecting means. Further comprising a shift means for moving the image data displayed after the corrected figure, and the replacement means is an image in which the newly input image data is overwritten with the corrected figure. The handwriting input device according to claim 1, wherein the handwriting input device is moved from a head position of the data to a position immediately before the image data moved by the shift means.