JP2627407B2 - Handwritten input information processing method and apparatus - Google Patents

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a handwriting input information processing method and apparatus, and more particularly, to handwriting with improved workability by making online editing operations similar to conventional manual operations using paper, an eraser, a pencil, or the like. The present invention relates to an input information processing method and apparatus.

More specifically, according to the present invention, an on-line handwritten input graphic is used to specify a graphic segment to be edited and a type of editing, and the graphic processing is performed by a procedure similar to the conventional graphic editing on paper with a pencil and eraser. The present invention relates to a handwriting input information processing method and apparatus capable of performing editing.

[0003]

2. Description of the Related Art Conventionally, when a graphic is edited by a computer, a menu system in which a menu is displayed on a display and a desired graphic is selected from the menu by using a cursor is often used. In particular, recently, a menu system has been proposed in which pictorial figures such as a file, a cabinet, and a document receiving tray are displayed on a display, and the pictorial figures are selected by a coordinate input device.

[0004]

However, in these menu methods, since the cursor is frequently moved up, down, left, and right to execute the editing, the fixation point is moved, and the thinking of the operator tends to be disturbed. However, there is a drawback that is reduced. In other words, the operation was far more complicated than the conventional method of writing and erasing characters and figures on paper using a pencil and eraser, so training and skill were required to perform editing work. In addition to this, there is a disadvantage that it is difficult to achieve efficient editing.

The present invention has been made in view of these drawbacks, and has as its object the advantage of being able to edit a figure by a method as similar as possible to a conventional figure editing method using paper and pencil. -In other words, it is an object of the present invention to provide a good handwritten input information processing method and apparatus having a so-called man-machine interface.

[0006]

In order to achieve the above object, the present invention provides a method for selecting a graphic segment to be edited from various graphics displayed on a screen. A closed figure that intersects a part is handwritten with a stylus pen, and an edit command figure for designating the type of editing process is similarly handwritten with a stylus pen. Key operations to be executed one by one
It is characterized in that it is configured to determine the type of handwritten input graphic and the key operation and to perform the editing of the specified type on the specified graphic segment.

According to the above-described configuration, editing can be performed by an operation similar to a conventional editing operation on paper using a pencil and an eraser, so that so-called man-machine characteristics are improved and a designated type An instruction to execute the editing process in unit amounts can be given by key operation, so that operability is also improved. Therefore, the operator's thinking is less disturbed, and non-experts can easily perform editing without requiring skill.

[0008]

DESCRIPTION OF THE PREFERRED EMBODIMENTS One embodiment of the present invention will be described below with reference to FIG.
This will be described in detail with reference to FIGS. FIG. 1 is a schematic block diagram of an embodiment of the present invention. The pen up / down information generated by the coordinate input device (tablet) 1 and the stylus pen 12 and the position coordinate information a are:
It is input to the figure recognition processing unit 310 of the figure editing processing device 3. The figure recognition processing unit 310 generates a figure selection window (pick window) for selecting a figure segment to be edited, based on the information a, and determines an editing operation command from the handwritten input figure coordinates. Output information b. By inputting this information b and the information f of the editing function key 4,
In step 20, editing such as erasure, movement, enlargement, and reduction of a figure is performed while writing data in the figure display frame memory 330 and the image display frame memory 340.

The graphic display frame memory 330 is configured to write a graphic represented by a vector, while the image display frame memory 340 is configured to write handwritten input data, thereby simplifying the graphic editing process. . The contents of the graphic display frame memory and the image display frame memory are, for example,
The images are synthesized by the OR circuit 350 and displayed on the display device 2. In the illustrated embodiment, a coordinate input device, that is, a so-called input display integrated device in which the tablet 1 and the display means 2 are integrated is used, and a handwritten figure is input in the same manner as a conventional paper and pencil, and What you want to edit,
Its operability (so-called man-machine interface) has been improved.

Next, FIG. 14 shows a graphic editing function realized in one embodiment of the present invention. As shown in the drawing, editing includes processes such as erasing, moving, enlarging / reducing, rotating, and shading. Here, in order to select a figure segment to be edited (in this case, a quadrilateral), a method of enclosing a part of the quadrilateral with a handwritten circle and writing a handwriting edit command in the circle is described. taking it. An editing command is recognized from this online handwritten information, and an edited figure as shown in FIG. 14 is obtained.

For example, as illustrated in FIG. 14, as a handwriting edit command for designating the type of editing process, "Erase" is a plurality of jagged images of an image rubbed with an eraser, and "Move" is an "Arrow". ",""Enlargement / reduction" is "<", "Rotation" is "curved arrow", and "shadow" is "jagged bracket" considering the direction of the shadow. Enter the figure that will image each edit.

Next, the detailed structure and operation of each part in FIG. 1 will be described below. FIG. 2 is a detailed block diagram showing a specific configuration of the graphic recognition processing unit 310 of FIG.

[0013] The handwritten input figure by the stylus pen 12 is roughly classified into a closed figure a1 for selecting a figure displayed in advance on the screen and an open figure a2 for an editing operation command. That is, these input figures are first separated into a closed figure and an open figure by the closed / open figure recognition processing unit 312. This identification can be easily performed depending on whether or not the end point Q of the stroke of the stylus pen 12 is within a circle having a predetermined radius r of the start point P of the stroke, as shown in FIG. That is, if it is within the range of the radius r, it is determined that the figure is a closed figure, and if not, it is determined that it is an open figure.

The start point P of the stroke is determined by the down signal of the stylus pen 12, and the end point Q is determined by the up signal. Therefore, the closed figure of the handwriting input needs to be input in one stroke-that is, one stroke. Further, based on the position coordinates of the stylus pen 12 read from the tablet 1, the moving direction (vector) of the stylus pen 12 is, for example, as shown in FIG.
Are stored in a memory together with coordinate information, and become information for recognition.

When the closed / open figure discriminating unit 312 recognizes that the handwritten input figure is a closed figure, the maximum and minimum values y of the coordinates of the closed figure a1 in the x and y directions are determined.
From (max), y (min), x (max), x (min),
A figure picking window (hereinafter simply referred to as a window) WID as shown in FIG. 5 is generated by the figure picking window generating unit 314, and sent to the figure editing unit 320 together with the graphic to be edited. On the other hand, the open figure is input to the edit operation command identification unit 316 and outputs the edit command COM.

The determination of the editing operation command COM can be realized by the procedure shown in the flowchart of FIG. That is, after performing preprocessing first, in step 316-1, the ith coordinate point input is fetched. In step 316-2, it is determined whether or not the input coordinates are the starting point based on whether or not the pen down signal is detected. If it is the start point, the process jumps to step 316-5, and it is determined whether or not the processing of all input points has been completed--that is, whether or not the pen-up signal has been detected.

If it is determined in step 316-2 that the input point is not the start point, a direction vector (based on FIG. 3) is obtained from the coordinates of the previous input point and the current input point (step 316-3). ). Next step 316-4
Then, it is detected whether or not the same direction vector appears continuously for a predetermined number of times. If the same direction vector has been continued a plurality of times, the process proceeds to step 316-4A, where the vector is recognized as a direction pattern, and data is created. If it is not determined in the previous step 316-4 that the vector in the same direction has been detected continuously for the predetermined number of times, the process jumps to step 316-5.

If it is determined in step 316-5 that the pen-up signal has not been detected and all input points have not been processed, i is incremented by 1 in step 316-6 to (i + 1). It returns to 316-1. Then, the (i + 1) -th coordinate point of the stylus pen 12 is read, and the above-described processing is repeated. That is, step 31
By the loop of 6-1 to 316-5 to 316-6 to 316-1, as shown in FIG. 15, a directional pattern for the input figure is created.

In the example of FIG. 15, for example, the direction pattern for the command of “erase” is “1, 6, 1, 6,
1, 6, 1, 6, 1, E ". In this case, E indicates the end point of the directional pattern.
For the commands "Reduce,""Rotate," and "Shade,"
A directional pattern is required for each.

Returning to the flowchart of FIG. 6, once the direction pattern is obtained as described above,
The direction pattern defined in the dictionary is checked, and a matching pattern is obtained from the pattern.
(Step 316-7).

As described above, the graphic recognition processing unit 310
, The figure picking window WID and the editing operation command COM are obtained. These data are input together with the input coordinates Pi of the stylus pen 1 together with the graphic editing unit 320 of FIG.
Is transmitted to

FIG. 7 is a detailed block diagram of the graphic editing unit 320.
Shown in The figure picking window WID is input to the figure display processing unit 326. Based on this, the graphic display processing unit 326 detects a segment of the graphic to be edited cut out by the graphic picking window WID.

Then, of the graphics to be edited, a graphic defined to be integrated with the segment is output as an edited graphic segment G. The edited graphic segment G is transmitted to the graphic processing unit 324.

On the other hand, the input coordinates Pi of the stylus pen 12
Is displayed from the graphic display processing unit 326 in order to display the locus of the image display frame memory 340.
Is written as data d. Figure edit processing unit 324
In the figure, graphic editing is executed by a known method described later using the editing operation command COM, the function key information f, and the selected edited graphic segment G as input data.

The concrete processing procedure of the figure editing is shown in FIGS.
This is shown in the flowchart of FIG. FIG. 8 is a flowchart illustrating the processing procedure of the “erase” command.

First, the image display frame memory 340 is cleared to erase the locus display (handwriting editing command) of the stylus pen 12 (step S81), and then the graphic selected by the graphic display processing unit 326 in FIG. The corresponding data in the graphic display frame memory 330 is deleted based on the data of the segment G (step S8).
2). As a result, the corresponding one of the graphic displays on the display device is deleted (see No. 1 in FIG. 14). Subsequently, when the editing end key 41 is operated, the erasing process ends.

FIG. 9 is a flowchart showing the processing procedure of the "move" command. As in the case of FIG. 8, first, the image display memory 340 is cleared, and the trace display of the stylus pen 12 is erased from the display screen (step S91). Next, when the coordinates of the stylus pen 12 are moved on the tablet 1, the selected segment is moved following the movement (step S92). Since the specific procedure of such figure movement is well known to those skilled in the art, the description thereof will be omitted.

When the selected graphic segment is moved to a desired position and positioned, when the editing end key 41 of the function key 4 is depressed, the movement of the graphic is completed (step S93). This specific processing example is shown in FIG.
3 (a). In the figure, reference numeral 100 denotes a selected edited graphic segment before processing, and reference numeral 102 denotes a movement locus of the stylus pen 12.

FIG. 10 is a flowchart showing the processing procedure of the "enlarge / reduce" command. As in the case of FIG.
The image display memory 340 is cleared and the locus display of the stylus pen 12 is erased from the display screen (step S10).
After 1), it is determined whether the function key 42 or 43 (FIG. 1) is depressed (step S102). If the function key 42 has been depressed, the process proceeds to step S103, and FIG.
As indicated by reference numeral 103 in (b), the selected graphic segment is enlarged by a predetermined unit (magnification).

Then, the flow advances to step S105 to check whether or not the edit end key 41 has been operated. If the operation has been performed, this process ends. If the operation has not been performed, the steps S102 and S103 are repeated again, and the selected graphic segment is enlarged again. That is, the operator can execute the enlargement of the graphic only by holding down the function key 42 until the selected graphic segment is enlarged to the required size. If it is determined in step S102 that the function key 43 has been pressed, the process proceeds to step S104. Step S10
In 4, the selected graphic segment is reduced at a predetermined interval (reduction ratio) as indicated by reference numeral 104 in FIG.

Then, as before, the flow advances to step S105 to determine whether or not the edit end key 41 has been operated. If it has been operated, this process is terminated, but if it has not been operated, step S102, again
The procedure of S104 is repeated, and the selected graphic segment is reduced again. In this way, the target graphic segments are reduced one after another while the function key 43 is being depressed, so that the operator can easily fine-adjust the magnification. If the selected graphic segment is excessively enlarged or reduced, the function key 43 or 42 can be pressed to reduce or enlarge the graphic segment in predetermined increments.

When the graphic segment has been edited to the desired size, the user presses the edit end key 41 to end the processing. The procedure of the above-described enlargement / reduction processing is well known to those skilled in the art. Further, once the enlargement or reduction function keys 42 and 43 are operated, the enlargement or reduction operation may be repeatedly executed at a predetermined time interval until the edit end key 41 is operated. This eliminates the need to keep pressing the function key 42 or 43.

FIG. 11 is a flowchart showing the processing procedure of the "rotate" command. As in the case of the above-described movement or reduction / enlargement, first, the image display memory 340 is cleared and the trace display of the stylus pen 12 is erased from the screen (step S111). Thereafter, similarly to the enlargement / reduction processing of FIG. 10, in step S112, it is determined whether or not the function key 42 or 43 is depressed. Then, the right rotation (step S113) or the left rotation (step S114) processing is performed at predetermined intervals depending on which function key is pressed, as shown in (c) of FIG. Finally, the editing end key 41 is pressed to end the processing (step S115). Such a figure rotation method is also well known to those skilled in the art. The fact that the processing procedure can be changed is the same as in the case of enlargement / reduction.

FIG. 12 shows a "shadow" for emphasizing a figure.
It is a flowchart which shows the processing procedure of a command. As in the above-described cases, the image display memory 340 is cleared and the trace display of the stylus pen 12 is deleted from the display screen (step S121). Then, step S122
In, the desired shadow location is determined based on the direction of the stroke of the input graphic. There are four corners as shading points, and FIGS. 13 and 15 show an example in which a shading is provided at the upper right corner.

Next, in step S123, it is determined whether the function key 42 or 43 has been pressed. Then, depending on which function key is depressed, it is determined whether the shade is to be increased or decreased, and in step S124 or S125, as shown in FIG. The processing for increasing / decreasing the shadows in is performed. Then, when the editing end key 41 is depressed, the shading process ends (step S126). Such a shading processing method for a figure is also well known to those skilled in the art. The fact that the processing procedure can be changed is the same as in the case of enlargement / reduction.

The present invention can be implemented with the following modifications. (1) In the above-described embodiment, the input of the edit command is performed by writing in the handwritten closed figure.
It is not always necessary to write in the handwritten closed figure. That is, the effect of the present invention does not change even if a handwriting edit command is input in the vicinity of the graphic to be edited. (2) In the above embodiment, the handwriting edit operation command is set to 1
Although the stroke is input by one stroke, this may be performed by a plurality of strokes. For example, the effect of the present invention is the same even if "move" is input in two strokes like a mark instead of a one-stroke stroke as shown in FIG. (3) In the above embodiment, the integrated input and display device is used, but the input and the display device may be separated. For example, instead of a flat display, a CRT device that has been widely used may be applied as a display device. However, in this case, since the input and the display device are separated, improvement in operability or man-machine performance cannot be expected much. (4) In the above-described embodiment, a dedicated function key is used. However, the function key may be provided on a stylus pen. In this case, all the figures can be edited with one hand.

[0037]

As described above, according to the present invention, the following effects are achieved. (1) A figure to be edited is specified by surrounding (cutting) a part of the drawing displayed on the screen with a handwritten closed figure, and further editing is performed in the closed figure or in the vicinity of the figure to be edited. The editing process type can be specified by hand-writing the command figure, so it is not only close to the conventional editing work on paper with a pencil and eraser, etc., but also humanly editing work on paper with thought. Is performed, the operability is improved and so-called man-machine characteristics are improved as compared with the conventional menu-based figure editing.

Further, since adjustments regarding magnification, rotation angle, and increase / decrease of shadows, which are difficult with handwriting input, can be performed by key operation, operability is also improved. Therefore, the operator's thinking is less disturbed, and even a non-expert can easily perform editing without requiring skill. (2) When the integrated input display device is provided, the stylus pen locus can be displayed as it is and can be considered as an extension of the conventional paper and pencil, so that the man-machine property is further improved. (3) Since the editing process such as enlargement / reduction and rotation of the figure can be confirmed visually, the operation is extremely easy. (4) A graphic display frame memory for displaying a graphic represented by a vector and an image display frame memory for displaying a locus of a stylus pen are separately provided, and these are combined and displayed. Therefore, it becomes extremely easy to erase the figure of the edit command from the final figure.

[Brief description of the drawings]

FIG. 1 is a schematic block diagram showing the overall configuration of an embodiment of the present invention.

FIG. 2 is a detailed block diagram of a graphic recognition processing unit.

FIG. 3 is a diagram showing a reference of a direction vector.

FIG. 4 is a diagram for explaining a closed figure determination criterion.

FIG. 5 is a diagram showing a procedure for creating a figure picking window.

FIG. 6 is a flowchart showing a graphic editing procedure according to the present invention.

FIG. 7 is a detailed block diagram of a graphic editing unit.

FIG. 8 is a flowchart showing a graphic editing procedure according to the present invention.

FIG. 9 is a flowchart showing a graphic editing procedure according to the present invention.

FIG. 10 is a flowchart showing a graphic editing procedure according to the present invention.

FIG. 11 is a flowchart showing a graphic editing procedure according to the present invention.

FIG. 12 is a flowchart showing a graphic editing procedure according to the present invention.

FIG. 13 is a schematic diagram showing a graphic editing procedure according to the present invention.

FIG. 14 is a conceptual diagram of graphic editing according to the present invention.

FIG. 15 is a diagram showing a specific example of a handwriting edit command and its directional pattern.

[Explanation of symbols]

1. Coordinate input device (tablet), 2. Display device, 3.
Figure editing processing unit, 4 ... function keys for editing, 1
2 stylus pen, 41, 42, 43 ... function keys, 310 ... figure recognition processing section, 312 ... closed / open figure recognition processing section, 314 ... figure pick window generation section,
316: edit operation command identification unit, 320: graphic edit unit, 324: graphic edit processing unit, 326: graphic display processing unit, 330: graphic display frame memory, 340: image display frame memory, 350: synthesizer

 ──────────────────────────────────────────────────続 き Continuation of front page (56) References JP-A-58-159192 (JP, A) Information processing VOL. 15 NO. 6 (issued June 15, 1974) PP. 419-427 IEICE Transactions Vol. J65-D NO. 3 (published March 1982) PP. 402-409 Figures and Images 81 / Autumn Issue, Graphic Processing Information Center (published August 1981) PP. 34 −37

Claims (9)

(57) [Claims] In a handwriting input information processing apparatus for performing handwriting input and output display thereof, information for specifying a region to be edited and information for specifying a type of editing process to be performed on the region to be edited Pen input means that are individually handwritten and input; means for recognizing the input edit processing type designation information as edit symbols; and selectively inputting the edit target area designation information and the edit process type designation information. A key unit for receiving a key operation for executing an editing process of a type designated by the pen input unit; and an editing process corresponding to the recognized editing symbol in response to the pressing operation of the key. And a unit for executing the above-mentioned processing on the specified edit target area by a unit amount. 2. The method according to claim 1, wherein the editing process is simply performed on an editing target area.
The means to execute each position is as follows:
The feature is to continuously execute the editing process for each unit amount
The handwriting input information processing device according to claim 1. Wherein the editing processing type is a scaling process, the handwriting input apparatus according to claim 1 or 2, characterized in that the magnification is changed by the key operation. Wherein a said editing processing type is the rotation process, the handwriting input apparatus according to claim 1 or 2, characterized in that the rotation angle is changed by the key operation. Wherein said editing processing type is shading processing, the handwritten input information processing apparatus according to claim 1 or 2, characterized in that the amount of shading is increased or decreased by the key operation. 6. A handwriting input editing method in a handwriting input information processing apparatus for performing handwriting input and output display thereof, wherein a step of displaying an image including an editing target area on a screen, and information and editing processing for designating the editing target area Enter the information for specifying the type separately by handwriting.
Pen inputting step; combining the handwritten input information with the displayed image; and displaying the image; and, based on the information input to specify the editing target area, an editing target area from the image. A step of cutting out information, a step of recognizing information input to specify the editing processing type as an editing symbol, and selectively selecting information for specifying the editing target area and information for specifying an editing processing type. A step of performing a key operation for executing an editing process of a type designated by the handwriting input; and, in response to the pressing operation of the key , a predetermined corresponding to the recognized editing symbol. A step of performing the editing process on the cut-out target figure by a unit amount, and a step of displaying a result of the editing process. Force information processing method. 7. The handwriting input information processing method according to claim 6 , wherein the editing processing type is an enlargement / reduction processing, and a magnification is changed by the key operation. 8. The handwriting input information processing method according to claim 6 , wherein the editing process type is a rotation process, and the rotation angle changes according to the key operation. 9. The handwriting input information processing method according to claim 6 , wherein the editing processing type is shading processing, and the amount of shading is increased or decreased by the key operation.