JPH06301472A - Handwriting input device - Google Patents

Abstract

PURPOSE:To attain the input of an editing command that can be simply supplied and also can perform a desired editing job at a high speed. CONSTITUTION:A deletion command is written on the data to be deleted on the screen of an input/display device 13 (b). Then a rectangular area 101 which is circumscribed to deletion command is automatically set as a command executing area, and the outer frame of this area is show by a broken line (c). When an optional position touched by a pen in the outer frame, the deletion command is carried out. Thus all data are deleted out of the area 101.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a handwriting input device for inputting data by handwriting, and more particularly to a method for inputting edit commands by handwriting input.

[0002]

2. Description of the Related Art Recently, the importance of user interfaces in computers has been recognized. Along with this, GUI (Graphical User Interfac
e; Graphical user interface) is becoming the mainstream of user interface.

In this interface, by selecting an icon (pictorial symbol) by operating a mouse or a keyboard, it is possible to perform all operations other than character input such as command selection, file operation, and program start-up from a menu. It has become.

[0004]

However, since the conventional GUI is based on mouse operation, there is a problem in terms of operability. That is, the movement of the mouse cursor for selecting an icon by operating the mouse is not so smooth, and it takes a long time even if the user gets used to it. Also, a space for operating the mouse was required. Recently, pen input has been attracting attention as a means for overcoming the drawbacks of the mouse as a pointing device.

Pen input is an operation that the user is familiar with on a daily basis, and characters and figures can be input with the same feeling as when writing in a notebook or notebook. Moreover, since the selection of an icon can be pointed out directly with a pen, it is very easy and fast, and it is suitable as a pointing device for GUI.

Therefore, if it becomes possible to edit a document or the like on the screen which has been conventionally performed by key operation or mouse operation by handwriting input by pen operation, it is considered that the editing work will be facilitated and the efficiency will be improved. To be In addition, it is considered that the work can be performed with a natural feeling without a sense of discomfort unlike in the past.

It is an object of the present invention to make it possible to easily and quickly edit image data that has already been input by handwriting input with a pen in a handwriting input device whose basic operation is pen input.

[0008]

The present invention comprises the following means. The display means is a device for displaying the image data in the bitmap format, and is composed of, for example, a liquid crystal display device.

The coordinate input means detects the coordinates of the operation position of the pen on the display screen of the display means. This means is composed of, for example, a pressure sensitive type, a capacitance type, an electromagnetic induction type tablet (digitizer).

The command recognition means recognizes the input of the edit command of the image data whose format is predetermined based on the coordinate data of the operation position of the pen detected by the coordinate input means when the user performs handwriting input with the pen. To do.

The edit target area setting means extracts the block of the image data including the coordinate position based on the coordinate data of the entry position of the edit command recognized by the command recognizing means, which is detected by the coordinate inputting means, The block is set as the target area of the edit command.

The editing means performs an edit process corresponding to the edit command recognized by the command recognition means on the image data in the area set by the edit target area setting means.

The command recognition means, the edit target area setting means, and the edit means are composed of, for example, a CPU (central processing unit), a memory, a subsystem dedicated to image data processing, and the like.

[0014]

In the present invention, when the user hand-writes an arbitrary editing command among various predetermined commands by pen operation on the screen displayed on the display means, the coordinates of the entry position on the screen are displayed. Is detected by the coordinate input means.

The command recognition means receives the detected coordinate data of the handwriting input from the coordinate input means, and recognizes that the edit command is handwritten based on the coordinate data.

Next, the edit target area setting means extracts a block of image data including the write position of the edit command based on the coordinate data of the write position of the recognized edit command detected by the coordinate input means. Then, the block is set as the edit target area.

The editing means performs the editing process corresponding to the recognized editing command on the image data in the editing target area. Therefore, the desired editing can be performed easily and quickly only by writing the editing command in a predetermined size in accordance with the display position of the image data desired to be edited.

[0018]

Embodiments of the present invention will be described below with reference to the drawings. FIG. 1 is an external view of an embodiment of the present invention.

The apparatus shown in the figure has a handwriting input by the pen 11 as a basic operation and has a handwritten character recognition function. The entire device has a pad type outer shape, and a pen storage groove 12 for storing a pen 11 is provided above the device. Further, an input / display device 13 for pen input is incorporated in almost the entire upper surface except the pen housing groove 12.

The input / display device 13 includes a display portion 13a composed of a bit map display such as a liquid crystal display and a tablet 13b arranged on the display portion 13a.
And consists of.

Next, FIG. 2 shows a system configuration of an embodiment having the above appearance. In the figure, a CPU 21 is a central processing unit such as a microprocessor, and executes a program stored in a program memory 22 to control each component in the system.

The coordinate input unit 13a is composed of, for example, a pressure sensitive tablet, an electromagnetic induction type tablet, or the like. When the input of the pen is detected, the input coordinate position of the pen (coordinate data of handwriting input) is sent to the CPU 21 through an interface (not shown). Output to. The CPU 21 generates handwritten image data by pen input from this coordinate data and generates the image memory I2.
Write to 6.

The command recognition unit 23 receives the instruction from the CPU 21 and recognizes the handwritten input data as characters. Then, the character string obtained by this character recognition is collated with the character string of the edit command stored in the reserved command memory 24 to recognize the handwriting input of the edit command. And
This recognition result is returned to the CPU 21.

Upon receipt of the recognition result, if the edit command has been input, the CPU 21 uses the handwriting input coordinate data of the edit command to execute the edit command in the image memory II 27 (edit target area). )
To set.

The reservation command memory 24 stores, as text data (character code string), all editing commands usable in this apparatus in a format as shown in FIG. 3, for example. The image memory I26 is a memory for storing the latest handwritten input image data pen-input on the screen of the input / display device 13 in a bitmap format.

The image memory II 27 is a memory for storing the image data of the screen currently displayed on the input / display device 13 (display unit 13a) in the bitmap format.

The display memory 28 is a frame memory for storing the image data of the screen displayed on the display unit 13a in the bitmap format. The display control unit 29 reads the image data from the display memory 28, converts the image data into a serial video signal, outputs the serial video signal to the display unit 13a, and supplies a horizontal / vertical synchronization signal to the display unit 13a. The image of the image data stored in the display memory 28 is displayed on.

Upon receiving the instruction from the CPU 21, the image processing section 31 executes the edit command recognized by the command recognition section 23 on the image data of the edit target area in the image memory II 27. In this editing processing, the arithmetic unit 33 is caused to execute processing such as enlargement / reduction.
Then, new image data obtained by this editing process is sequentially written in the image development memory 32. Then, when the editing process is completed, the execution result of the editing command (edited image data) stored in the image development memory 32 is transferred to the relevant area of the image memory II.

The image development memory 32 is of a bitmap format for temporarily storing the image data of the edit target area in the image memory II 27 which has undergone the edit processing such as enlargement / reduction by the image processing section 31 as described above. It is a memory.

Under the control of the image processing unit 31, the arithmetic unit 33 performs edit processing such as enlargement / reduction on the image data of the edit target area in the image memory II.
The page file 34 is created by pen input 1
A document such as a page (corresponding to one screen of the display unit 13) is stored in a format in which text data and image data are mixed. The CPU 21 writes this in the page file 34 each time a one-page document is created on the input / display device 13.

The work memory 36 is a memory used by the CPU 21 as a work area in various processes, and is used for temporarily storing, for example, handwritten input coordinate data received from the coordinate input unit 13b.

Next, a method of handwriting inputting an edit command in the embodiment having the above-mentioned structure will be described with reference to FIGS. 4 and 5. FIG. 4 is a schematic diagram illustrating a method of inputting a “delete” command when deleting part of handwritten input data that has already been input. In the figure, a rectangular frame shows the display screen of the input / display device 13. This also applies to FIGS. 5 and 7 described later. In addition, in FIG. 3, circles indicate image data of text information such as already input characters, numbers, or symbols.

As shown in FIG. 4 (a), when text data is input by handwriting with the pen 11 up to the middle of the third line,
It is assumed that it is necessary to delete the fourth digit to the sixth digit of each line from the first line to the third line.

In this case, a command consisting of two characters "delete" is overwritten in the area to be deleted, as shown in FIG. At this time, the rectangle circumscribing these two characters covers the entire deletion area.

When the device recognizes the entered command "delete" as a reserved command, it automatically sets the rectangular area 101 circumscribing the two characters "delete" as the area to be edited, and the outer frame is the same. It is indicated by a broken line as shown in Fig. (C).

If the rectangular area 101 framed by the broken line matches the desired deletion area, the user touches an arbitrary position in the area 101 with a pen. As a result, the "delete" command is displayed in the rectangular area 10
The text data in 1 is deleted and the text data in the rectangular area 101 is deleted as shown in FIG.

By the way, when the rectangular area 101 framed and displayed as shown in FIG. 3C does not match the desired deletion area, the user himself / herself encloses the desired deletion area (not necessarily a rectangular shape). It does not need to be). As a result, the area designated by this handwriting input is deleted.

FIG. 5 shows an input example of the "bold character" command for converting the handwritten input image data into a bold character.
In the example of this figure, the three handwritten input image data 102 shown in FIG. 9A are converted into bold letters as shown in FIG. The command input method in this case is also the same as the input of the "delete" command described above (see FIG. 7B).

"Move" other than these commands,
Similar handwriting input can be realized for various commands such as "copy", "color change", "enlarge", or "reduce". Also, instead of showing the editing target area with a framed display,
The text data to be edited itself may be displayed in a different color from the other text data, or may be displayed in reverse video.

Next, the operation for realizing the handwriting input of such an edit command will be described with reference to the flowchart of FIG. The user inputs the pen 11 on the input / display device 13.
When the handwriting operation (handwriting input) is performed by
3b is a handwritten input coordinate position (a coordinate position in the normalized coordinate system set on the coordinate input detection unit 13b at the position where the pen is operated. In the present embodiment, the display unit 13a and the coordinate input unit 13b.
(The normalized coordinate system set to 1) is detected, and the coordinate data is notified to the CPU 21 by interruption (S11).

The CPU 21 creates image data in which the input handwritten input coordinate data is the same as the locus drawn in chronological order and writes it in the image memory I26 (S12).

When the handwriting input by the user is completed and the interruption from the coordinate input unit 13b is interrupted for a predetermined time or longer, the CPU 21 determines that the handwriting input is completed,
The image data newly written in the image memory I26 by handwriting this time and the already input / displayed handwritten input image data stored in the image memory II27 are OR-synthesized and written in the display memory 28.
The display control unit 29 reads the OR-combined image data from the display memory 28 and causes the display unit 13a to display an image corresponding to this image data (S13).

By the above operation, when the user performs handwriting input on the input / display device 13 with the pen 11, the characters and figures input by the pen are immediately displayed on the input / display device 13 (FIG. 4 (b). ), See FIG. 5 (b)).

Next, the CPU 21 controls the image memory II2.
It is checked whether the image data is already stored in the area corresponding to the input position of the handwritten data input by the pen in 7 (S14).

If it is stored (S14, YE
S), The handwritten input image data stored in the image memory I26 is transferred to the command recognition unit 23, and it is instructed to determine whether or not this image data is an edit command. The command recognition unit 23 recognizes the character data of the handwritten input image data, and if the input character data is character information, the character code string of the character information is stored in the reserved command memory 24. Match with the character code string. Then, it is checked whether the image data input by handwriting matches any edit command, that is, whether the image data input by handwriting is an edit command, and the CPU 21 is notified of the recognition result (S15).

By the above operation, only the edit command overwritten on the handwritten data already input by the pen is regarded as valid. When the CPU 21 learns from this notification that the edit command has been input by the pen (S15, YES),
The entry area of this edit command on the screen of the input / display device 13 is checked based on the above handwritten input coordinate data or the image data of the handwritten input in the image memory I26 (S16), and a rectangular area circumscribing this edit command ( The edit target area) is determined (S17).

Next, the CPU 21 writes in the display memory 28 the image data in which the frame of this rectangular area is shown by the broken line. As a result, the display control unit 29 displays this framing on the display unit 13a (S18).

By the above operation, for example, as shown in FIG. 4 (c) or FIG. 5 (c), the rectangular frame showing the edit target area of the edit command input by handwriting on the screen of the input / display device 13 is displayed by a broken line. To be done.

Next, the CPU 21 inputs a handwriting input coordinate corresponding to a pen operation (OK operation) for allowing the edit target area from the coordinate input unit 13b, that is, an operation of touching an arbitrary position in the edit target area with the pen 11. It waits until a predetermined time until data is sent (S19).

When the CPU 21 receives the handwritten input coordinate data indicating the coordinate position in the edit target area from the coordinate input unit 13b within the predetermined time, the CPU 21 receives the instruction given by the edit command to the image processing unit 31. The position data indicating the area in the image memory II 27 of the area to be edited set as described above is sent to the image processing section 31. When the image processing unit 31 receives these pieces of information, the image processing unit 31 uses the operation unit 33 to perform image memory
The edit command is executed for the image data in the edit target area in 27. Then, the results obtained by this execution are sequentially written in the image development memory 32. When this execution is completed, the image processing unit 31 transfers the image data obtained by executing the edit command written in the image development memory 32 to the relevant area of the image memory II 27 (S22).

On the other hand, the CPU 21 makes the above-mentioned step S19.
If the handwritten input coordinate position data is not sent even after the predetermined time has passed, that is, if the user does not perform the OK operation, the edit target area of the edit command is designated to the user. The area designation message requested by the user is displayed at a predetermined position on the display unit 13b via the display control unit 29 (S20).
When the surrounding figure indicating the edit target area of the edit command is input by the pen, the coordinate input unit 13b sends the handwritten input coordinate data indicating the pen-input position to the CPU 21 (S21).

The CPU 21 recognizes the edit target area in the image memory II 27 from this coordinate data, and executes the edit command on the image data in this edit target area as described above (S22).

Next, the CPU 21 uses the image memory I26.
Of the image data in the image memory II27 and the image data in the image memory II27 are OR-combined at corresponding bit positions, and the result obtained by this logical operation is used as the image memory II27.
(S23).

Subsequently, the CPU 21 uses the image memory II2.
All the image data in 7 are written in the display memory 28. The display control unit 29 reads this image data from the display memory 28 and displays the execution result of the edit command on the screen of the input / display device 13 (S24).

By the above operation, the area in which the edit command is executed is automatically set by the entry area of the edit command entered by the user himself (see FIGS. 4 (c) and 5 (c)). That is, the rectangular area circumscribing the entered edit command is set as the execution target area of this edit command. Therefore, when the user inputs the edit command by handwriting, he / she only needs to overwrite the edit command in the edit target area with a size corresponding to the size of the edit target area. That is, the editing command can be executed by only one pen operation. If the size or entry position of the edit command is erroneously set to be different from the desired region and the edit target region is automatically set, the edit target region may be designated by direct pen input.

Subsequently, the CPU 21 causes the image memory I2
6 is cleared (S25), and the above processing is repeated from step S11. On the other hand, the CPU 21 executes the step S
When it is determined in step 14 that handwriting input has been performed in the uninput area, or when it is determined in step S15 that an image other than the edit command has been input by handwriting in the already input area, immediately in steps S23 to S25. Perform processing.

By this operation, the handwritten image written in the blank area on the screen of the input / display device 13,
Alternatively, the handwritten image other than the edit command overwritten on the already input image data is directly input as data.

Next, a second embodiment of the present invention will be described. First, a method of inputting an edit command in this embodiment will be described with reference to FIG.

As shown in FIG. 9A, the input / display device 13
It is assumed that after the image data 201 is input by handwriting on the screen, the line width needs to be made thicker. In this case, the "bold" command is overwritten on at least a part of the handwritten input image data 201 as shown in FIG. As a result, the entire handwritten input image data 201 and the area 202 including this command are automatically cut out as the target area of the edit command. Then, as shown in FIG. 7C, this area 202 is displayed in a shaded manner, and a confirmation message 203 to the user, "Change to bold type OK!", Is displayed near this area 202.

If the area 202 is suitable as the execution area for the "bold" command, the user can confirm the confirmation message 20.
Perform the operation of drawing "○" on 3. As a result, the "bold" command is executed for the handwritten input image data 201, and the line width of the handwritten input image data 201 becomes thicker as shown in FIG.

If the area 202 is unfavorable as the execution area (editing area) of the "bold" command, the desired editing area is designated by handwriting as in the first embodiment. Also in the second embodiment, the edit target area 202 may be displayed in a color different from that of the handwritten input data, or may be displayed in reverse, instead of being shaded. Further, the editing command is not limited to the "bold" command as in the first embodiment, and the "move",
Other commands such as “copy”, “delete”, “color change”, “enlarge”, “reduce” can also be applied.

In some cases, it may be desired to input the same name as the edit command as data. In such a case, this name may be input by handwriting in the non-input area. By such input, this name is directly input as handwritten image data. An example of this is shown in FIG. In this example, "bold" is entered as is.

The hardware structure of the second embodiment is realized by the structure shown in FIG. 2 similarly to the first embodiment. Then, referring to the flowchart of FIG.
The operation of the embodiment will be described.

The user uses the pen 11 on the input / display device 13.
When the handwriting input is performed by the steps S101 to S15 similar to the steps S11 to S15 in the flowchart of FIG.
The process of S105 is performed, and it is recognized whether the edit command or the image data is input.

When the CPU 21 recognizes that this is an edit command (S105, YES), this edit command and this is overwritten based on the corresponding position in the image memory II27 of the entry position of the edit command input by handwriting. A block (image block) including the handwritten input image data is cut out from the image memory II 27 (S106).

Then, the CPU 21 causes the image block to be displayed in a shaded manner on the screen of the input / display device 13 via the display control unit 29 (S107). Further subsequently, the CPU 21 sends a confirmation message (to the user) corresponding to the edit command near the image block, that is, the edit target area (the area shaded) of the input edit command via the display control unit 29. A message for confirming the execution of the edit command is displayed (S108).

As a result of the above operation, when the user overwrites the edit command on at least a part of the already input image data (see FIG. 7B), the block containing this command and the image data overwritten by this command is to be edited. The area is automatically set and shaded. Also,
A message confirming the user's execution of this command is displayed near this area (see (c) in the figure).

Then, the CPU 21 waits for an input from the coordinate input section 13b. After that, when the handwriting input coordinate position data is sent from the coordinate input unit 13b, the CPU 21 performs an OK operation (an operation of pen-inputting "○") on this confirmation message from this data and the display position of the confirmation message. It is determined whether it has been performed (S109).

When the CPU 21 recognizes the OK operation (S109, YES), the image processing unit 31 receives an instruction corresponding to the edit command and the image memory II2.
The storage position of the area to be edited in 7 is sent. In response to this, the image processing unit 31 reads out the image data of the editing target area from the image memory II 27, performs the processing instructed by the editing command on the image data using the calculation unit 33, and outputs the processing result. Write to the image development memory 32. After the processing is completed, the execution result of the edit command is read from the image development memory 32 and transferred to the area in the image memory II 27 (S112).

On the other hand, the CPU 21 executes the above step S109.
If it is determined that the user has not performed the OK operation (S0
19, NO), and steps S110 to S111 similar to steps S20 to S21 in the flowchart of FIG. 6 described above.
The process of step S112 is performed on the area specified by the user himself / herself with the pen operation.

By the above operation, when the user performs a predetermined OK operation on the confirmation message of the edit command, the area is automatically set by the system (a block including the image data overwritten with the edit command). This edit command is executed. On the other hand, when the user is unhappy with the automatic setting area and does not perform the OK operation and directly specifies the edit target area by handwriting input, the edit command is executed for this area.

When the CPU 21 completes the processing in step S112, steps S113 to S115 similar to steps S23 to S25 in the flowchart of FIG. 6 described above.
Processing is executed and the execution result of the edit command is displayed on the screen of the input / display device 13 (see FIG. 7 (d)).

On the other hand, the CPU 21 executes the above step S104.
When it is determined that the handwriting input is performed on the uninput area in step S104, NO, or the above step S
When it is determined in 105 that the image data other than the edit command has been handwritten input over the already input image data (S105, NO), steps S113 to S are immediately performed.
The processing of 115 is executed.

By this operation, the image data handwritten in the uninput area is input as it is even if it is the same as the edit command (see FIG. 7E). Further, even if the image data other than the edit command is overwritten on the already input image data, this image data is directly input.

As described above, in the second embodiment, since the edit command may be overwritten on at least a part of the image data desired to be edited, the size of the edit command to be written is large even for large image data. It can be small. Therefore, high speed input becomes possible.

In each of the above embodiments, the edit command is written over the image data to be edited, but the present invention is not limited to such an input method. As shown in 9 (a) and 9 (b), the edit command may be written in the vicinity of the image data to be edited so as to include it.
In the example of the figure, a rectangular area circumscribing the edit command (area indicated by a broken line) is set as the edit target area.

In the above embodiment, the editing is performed only on the image data input by handwriting input, but the present invention is not limited to this.
For example, image data such as text data converted into a character code by handwritten character recognition or text data input from the outside may be used.

The method of automatically setting the edit target area is not limited to the above method, and any method may be used as long as it is set based on the entry position of the edit command.

[0079]

According to the present invention, the edit process corresponding to the edit command is executed on the image by simply handwriting the edit command in accordance with the display position of the image to be edited. Editing can be done easily and quickly.

[Brief description of drawings]

FIG. 1 is an external view of an embodiment of the present invention.

FIG. 2 is a block diagram showing a system configuration of the above embodiment.

FIG. 3 is a diagram showing a configuration example of a reservation command memory.

FIG. 4 is a diagram illustrating an editing command input method according to the first embodiment (part 1);

FIG. 5 is a diagram for explaining a method of inputting an edit command according to the first embodiment (No. 2).

FIG. 6 is a flowchart illustrating the operation of the first embodiment.

FIG. 7 is a diagram illustrating an input method of an edit command according to the second embodiment.

FIG. 8 is a flowchart illustrating the operation of the second embodiment.

FIG. 9 is a diagram showing another method of inputting an edit command.

[Explanation of symbols]

 13 input / display device 13a display unit 13b coordinate input unit 21 CPU 22 program memory 23 command recognition unit 24 reserved command memory 26 image memory I 27 image memory II 28 display memory 29 display control unit 31 image processing unit 32 image expansion memory 33 operation Department

Claims (1)

[Claims] 1. Image data display means, coordinate input means for detecting coordinates of an operation position of a pen on a display screen of the display means, and coordinate data of an operation position of the pen detected by the coordinate input means. Command recognition means for recognizing the input of the edit command of the image data based on the An edit target area setting means for extracting a block of image data including a position and setting the block as a target area of the edit command, and the image data in the area set by the edit target area setting means, And an editing unit that performs an editing process corresponding to the editing command recognized by the command recognizing unit. That handwriting input device.