JP3427050B2 - Document information processing apparatus and document information processing method - Google Patents

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a pen information processing apparatus such as a Japanese word processor, a European word processor, a DTP (disk top publishing), a personal computer, etc.

[0002]

2. Description of the Related Art Conventionally, as a document information processing apparatus, there is a Japanese word processor that uses a pen for input. This document information processing apparatus is capable of inputting handwritten characters and gestures (handwriting editing such as deletion and line feed by inputting handwritten symbols) on a text input screen, in addition to inputting graphics online. That is, as shown in FIG. 19, when a handwritten character is desired to be input, the handwritten character input button is pressed, and when a gesture is desired to be performed, the gesture button is pressed to change the gesture shape.
If you want to move the cursor by inputting (handwritten edit symbol representing deletion, line feed, etc.) with the pen, press the cursor move button and pen down to the position you want to move on the input screen. Therefore, it is possible to easily input and edit.

As another document information processing apparatus, in order to select a handwriting character input mode by pattern input and a cursor movement mode, a mode changeover switch is provided on the tablet and a handwriting character input mode is provided. There is a method in which a mode button indicating whether the cursor movement mode or the cursor movement mode is displayed on the text display screen so that the user can recognize the mode switching so that the handwriting character input mode and the cursor movement mode can be selected. Sho 5
JP-A-7-113135 and JP-A-61-40633.
(See the official gazette).

[0004]

As described above, in the former document information processing apparatus, when a pen is used to perform an editing operation and a handwriting character input operation in the text input screen, that is, in the pen operation mode. When selecting a certain cursor movement / gesture / handwritten character input mode, each cursor movement button / gesture button / handwritten character input button is provided, and when any one of those buttons is pressed, it corresponds to that button. Enable only the pen operation mode. In the latter document information processing apparatus, while recognizing the mode button displayed on the display screen, the user determines whether or not to switch the mode by the next pen operation, and makes a pen operation different from the displayed mode button. To do so, operate the mode selector switch on the tablet.

However, both document information processing devices
When a user uses a pen to perform a desired operation, it is necessary to switch the mode frequently while always being aware of the mode of pen operation in order for the user to perform a desired operation.

SUMMARY OF THE INVENTION Therefore, an object of the present invention is to provide a document information processing apparatus which can improve the operability and shorten the editing and input time without the user having to be aware of the pen operation mode switching.

[0007]

In order to achieve the above object, a document information processing apparatus of the present invention inputs a stroke information to a display means for displaying document information such as characters and stroke information to the display means. Input means, a gesture recognition means for recognizing a gesture that means an editing process of the input document information based on the stroke information input by the input means, and a character based on the stroke information input by the input means. Character recognition means for recognizing the document information, and the document information displayed on the display means is changed to the gesture.
-Editing according to the recognition result of the recognition means,
The character recognized by the character recognition means is displayed on the display means.
In the document information processing device displayed on the screen, the character area input determination means for determining whether or not the starting point position of the stroke information input from the input means is designated by an arbitrary character of the character displayed document information. When the character area input determination means determines that it is instructed, it is determined to be the gesture mode, and when it is determined that it is not instructed, it is determined to be the handwritten character input mode. In the case of the gesture mode, the gesture recognizing means recognizes a stroke continuous to the start point position, performs editing processing of the character displayed at the start point position, and in the case of the handwriting character input mode, Even if the entered stroke information overlaps the characters displayed on the character, the start point position Successive stroke information by recognizing by said character recognition means is characterized by performing input processing of the document information.

In order to achieve the above object, the document processing method of the document information processing apparatus according to the present invention includes a display means for displaying document information such as characters and the display means.
Input means for inputting stroke information, gesture recognition means for recognizing a gesture that means editing processing of input document information based on the stroke information input by the input means, and stroke input by the input means based on the information, and a character recognition means for recognizing a character, the GETS the document information displayed on the display means
Edit processing according to the recognition result of the sticker recognition means
In principle, the characters recognized by the character recognition means are listed in the table.
In the document information processing method of the document information processing device for displaying on the indicating means, it is determined whether or not the starting point position of the stroke information input from the input means is designated by an arbitrary character of the character displayed document information. A character area input determination step, and a mode determination that determines a gesture mode if it is determined in the character area input determination step and determines a handwritten character input mode if it is determined not In the case of the step and the gesture mode, an edit processing step of recognizing a stroke continuous to the start point position by the gesture recognition means and performing an edit process of a character displayed at the start point position, and a handwriting character input mode In this case, the stroke information that was input is the text that is displayed by the character. It is characterized by be overlapped on and an input processing step of performing input processing of the document information by recognizing the stroke information successive to the start position in the character recognition means.

[0009]

BEST MODE FOR CARRYING OUT THE INVENTION The document information processing apparatus of the present invention will be described in detail below with reference to embodiments.

(First Embodiment) FIG. 1 is a block diagram of a document information processing apparatus according to a first embodiment of the present invention, in which 1 is a CPU (central processing unit) for controlling the entire apparatus, and 2 is the above-mentioned. An address and data bus connected to the CPU 1,
CGROM (Character Generator Read Only Memory) 3 is connected to the CPU 1 via the bus 2 and stores a bitmap of displayable / printable characters, symbols, etc., and outline font data, and 4 is the CPU 1 VRAM (video random number) which is connected to the display device 6 via a bus 2 and has an address configuration which corresponds to the coordinates on the screen of the display device 6 described later in a one-to-one manner and which stores the screen displayed on the display device 6 in a bitmap. Access memory), 5 is a display controller connected to the CPU 1 via the bus 2 and outputs a display signal representing display data for one screen stored in the VRAM 4 in real time, 6 is the display controller 5 In response to the display signal from the LCD, the display data for one screen stored in the VRAM 4 is displayed on the LCD (liquid crystal display). A display device for displaying by a) a CRT (cathode ray tube). Also,
Reference numeral 7 is an FD (floppy (registered trademark) disk) controller connected to the CPU 1 via the bus 2, and 8 is controlled by the FD controller 7 to record and reproduce document data on a floppy disk (not shown). A floppy disk drive 9 is connected to the CPU 1 via the bus 2 and is connected to a RAM (random access
A printer controller 10 for outputting a print signal representing image data stored in a memory 12 is a printer for receiving the print signal from the printer controller 9 and printing the image data, and 11 is the CPU 1
A ROM (Read Only Memory) which is connected to the CPU 1 via the bus 2 and stores a control program for the CPU 1.
12 is connected to the CPU 1 via the bus 2 and stores data.
It is a RAM having a coordinate storage buffer 13 (including coordinate data and the like) and a variable buffer 14 for holding data and the like used by the CPU 1 when performing control and editing. Also, 15
Is a keyboard controller which is connected to the CPU 1 via the bus 2 and outputs a signal representing a key input to the keyboard 16 to the CPU 1. 17 is connected to the CPU 1 via the bus 2 and is a pen input device (hereinafter referred to as a pen input device). Say)
A pen controller that outputs to the CPU 1 signals representing the state of the pen tip (whether or not the pen is touching the screen) and the coordinates on the screen when the pen tip is touching the screen, and 19 is the CPU 1 Is a buzzer controller that is connected via the bus 2 and controls the on / off of the buzzer 20.

FIG. 2 shows a block diagram of the main part of the document information processing apparatus. This document information processing apparatus comprises a pen controller 17 and a pen input means 31 composed of a pen 18.
A display unit 32 including the display controller 5 and the display device 6, a mode determination unit 33 configured by a program stored in the ROM 11, a pen movement amount determination unit 34,
Pen input time determination means 35, mode determination output means 36, character area input determination means 37, cursor display switching means 38, pen input trajectory determination means 39 and recognition button display means 40.
It has and. The pen movement amount determination means 34,
Pen input time determination means 35, character area input determination means 37,
The cursor display switching means 38 and the pen input trajectory determining means 39 are pen input means 31 via the mode determining means 33.
Information of the pen input signal from.

In the document information processing apparatus having the above structure, as shown in Table 1, modes of cursor movement / range designation / gesture / handwritten character input are selected.

[0013]

[Table 1] That is, the pen movement amount determination means 34 determines whether or not the movement amount of the drag of the pen 18 is less than or equal to a predetermined amount based on the pen input signal indicating the information of the pen up, pen down and drag from the pen input means 31. At the same time, based on the pen input signal, the pen input time determination means 35
It is determined whether the time from the first pen-up of the pen 18 to the next pen-down is a predetermined time or more.

Then, the mode determination means 33 determines the pen movement amount determination means 34 after the first pen down of the pen 18.
Determines that the movement amount of the drag of the pen 18 is less than or equal to a predetermined amount (the pen movement amount is small), and the pen input time determination means 35.
Determines that the time from the first pen-down to the next pen-up is less than a fixed second and the time from the pen-up to the pen-down of the next second stroke is a fixed second or more, the cursor movement Determined as mode. That is, when the pen is quickly moved up at approximately the same position after the first pen down, the cursor movement mode is set.

In the mode determination means 33, after the first pen down, the pen movement amount determination means 34 determines that the movement amount of the drag of the pen 18 is less than a predetermined amount (the pen movement amount is small), and the pen input is performed. If the time determination means 35 determines that the time from the first pen-down to the next pen-up is a fixed second or more, it is determined to be the range designation mode. That is, after pen-down for the first time, if the pen-down is performed at the same position for a while, the range designation mode is set.

In the mode determination means 33, after the first pen down, the pen movement amount determination means 34 determines that the movement amount of the drag of the pen 18 exceeds a predetermined amount (the pen movement amount is large), and When the input time determination means 35 determines that the time from the pen-up after the first pen-down to the pen-down of the next second stroke is a certain second or more,
Determined as a gesture mode. However, the handwriting character input determination means 37 determines that the pen input has not started from the area of the character displayed on the display means 32, or the pen input trajectory determination means 39 determines that the size of the pen input trajectory is a predetermined value. If it is determined to be larger, the mode is determined again as the handwritten character input mode.

Further, the mode determination means 33 determines that the movement amount of the drag of the pen 18 exceeds a predetermined amount (the pen movement amount is large) after the first pen down, and the pen input time determination means 35 first determines. If it is determined that the time from pen-up after pen-down to pen-down of the next second stroke is a certain second or more, it is determined to be a mode for inputting handwritten characters. At this time, the recognition button display means 40 displays the recognition button on the display means 31.

In this way, the mode determination means 33 is provided.
Selects the mode of cursor movement / range designation / gesture / handwritten character input, and the cursor display switching means 38 moves the cursor displayed on the display means 31 according to the mode determined by the mode determination means. Switch to a form that supports movement / range designation / gesture / handwritten character input. Then, the mode determination output means 36 outputs a signal representing the mode determined by the mode determination means 33, and performs input and edit processing based on the signal.

The process of selecting the pen operation mode will be described below with reference to the flowcharts of FIGS.

First, in step S1, when an event occurs while waiting for the event of the pen 18,
In step S2, it is determined whether the pen event is pen down / drag / pen up.

When it is determined that the pen event is pen down in step S2, the process proceeds to step S3, and the pen down coordinates are set in the work, that is, the coordinate storage buffer 13 of the RAM 12. Next, in step S4, the timer is started. Next, in step S5, it is determined whether or not the recognition button is pressed. If it is determined that the recognition button is pressed, the process returns to step S1. On the other hand, if it is determined in step S4 that the recognition button has not been pressed, the process proceeds to step S42 shown in FIG.

If it is determined in step S2 that the pen event is a drag, the flow advances to step S6 to set the coordinates of the drag in the work, that is, the coordinate storage buffer 13 of the RAM 12. Next, in step S7, it is determined whether or not the drag is the first stroke, and if it is determined that it is the first stroke, the process proceeds to step S8, whereas if it is determined that it is not the first stroke, the process proceeds to step S14.
Then, in step S8, it is determined whether the amount of movement from the pen down is small, that is, whether the amount of movement from the pen down is less than or equal to a predetermined value, and when it is determined that the amount of movement from the pen down is less than or equal to the predetermined value, On the other hand, when it is determined that the amount of movement from the pen down is larger than the predetermined value while proceeding to step S9, the process proceeds to step S14. Next, in step S9, it is determined whether or not the timer started in step S4 has timed out, and if it is determined that the timer has timed up, the process proceeds to step S10, while it is determined that the timer has not timed up. If determined, step S
Return to 1.

Next, in step S10, the range designation mode is set, and in step S11, the cursor display is changed. That is, the shape of the cursor is changed to the designated range so that the range can be identified by the cursor. Next, the range designation code is output in step S12, the editing process is performed in step S13, and the process in the range designation mode is ended.

On the other hand, if it is determined in step S2 that the pen event is pen-up, step S21 shown in FIG.
Go to and start the timer. Next, step S2
When it is determined that the pen-up is the first stroke and the first stroke is determined in step 2, step S2
On the other hand, if it is determined that the stroke is not the first stroke, the process proceeds to step S31. Then, in step S23, it is determined whether or not the drag movement amount is small, that is, whether or not the drag movement amount is less than or equal to a predetermined value, and when it is determined that the drag movement amount is less than or equal to the predetermined value, the process proceeds to step S24. On the other hand, if it is determined that the movement amount of the drag is larger than the predetermined value, the process proceeds to step S41 shown in FIG.

Next, in step S24, a pen event is awaited, and it is determined whether or not the timer started in step S21 is up before the next pen down.
When it is determined in step S24 that the timer is up, the process proceeds to step S25, the cursor movement mode is set, and the edit process is performed in step S26.
The processing of the cursor movement mode ends. On the other hand, if it is determined in step S24 that the timer has not timed up until the next pen down, the process proceeds to step S27, the trajectory of the drag is displayed, the flag of the second stroke is set in step S28, and the process returns to step S1. . In addition,
The flag for the second stroke is reset at the start of this pen operation mode selection process.

If it is determined in step S22 that the stroke is not the first stroke, the process advances to step S31, a pen event is waited for, and step S21 is executed until the next pen down.
It is determined whether or not the timer started in step 1 will time out. If it is determined in step S31 that the timer has timed out, the process proceeds to step S32, whereas if it is determined that the timer has not timed out, the process returns to step S1.

Next, in step S32, coordinate data is set in the coordinate storage buffer 13 for character recognition, and in step S32
In step 33, character recognition is performed based on the coordinate data stored in the coordinate storage buffer 13. And step S
In step 34, the recognition code of the character recognized in step S33 is output, the editing process is performed, and the process of the handwritten character input mode is ended.

Next, the pen event is waited in step S41 shown in FIG. 5, and the step S2 is executed until the next pen down.
It is determined whether or not the timer started at 1 is up. When it is determined in step S41 that the timer has timed out, the process proceeds to step S42,
If it is determined that the time has not expired, the process returns to step S1. Next, in step S42, it is determined whether or not the size of the pen input trajectory is within a predetermined value (for example, three lines in the vertical direction), and it is determined that the pen input trajectory size is within the predetermined value. , Step S43 is skipped, and step S4
Go to 4. On the other hand, if it is determined in step S42 that the size of the trajectory of the pen input is larger than the predetermined value, step S43
Then, it is determined whether or not the pen is down on the input character displayed on the display device 6 of the display means 32, that is, the character area. Then, if it is determined in step S43 that the pen is down on the input character, the process proceeds to step S44, while if it is determined that the input character is not input, the process shown in FIG.
Go to step S32 shown in.

Next, in step S44, the coordinate data is set in the coordinate storage buffer 13 for gesture, the gesture recognition is performed in step S45, and step S46.
Then, it is determined whether or not the gesture recognition is successful. When it is determined in step S46 that the gesture recognition is successful, the process proceeds to step S47, the gesture code is output, the edit process is performed in step S48, and the process of the gesture mode is finished. On the other hand, if it is determined in step S46 that the gesture recognition has not succeeded, the process proceeds to step S32 shown in FIG. 4 and the operation mode for handwritten character input is entered.

As described above, the document information processing apparatus selects the mode of cursor movement / range designation / gesture / handwritten character input. Hereinafter, selection of a pen operation mode will be described with reference to the conceptual diagrams shown in FIGS.

First, in FIG. 6, when the cursor is moved with the pen 18, the pen is moved down to the point (the position of the character "Ke" in FIG. 6) at which the cursor should be moved, and the pen is quickly moved up at the same position. That is, when the amount of movement after pen-down is small and the time until pen-up is less than a fixed time, and there is a certain time or more from pen-up to the next pen-down, it is recognized as a cursor movement mode. .

Next, in FIG. 7, when the range is specified, the pen is moved down to the start position of the range specification (the position of the character "?" In FIG. 7) and then stopped at the same position for a while to enter the range specification mode. That is, when the amount of movement after pen down is small and the pen down state continues for a certain period of time or more, it is recognized as the range designation mode. Then, the pen is dragged to determine the range (character "Kakikuke" in FIG. 7).

Next, referring to FIG. 8, in the case of handwritten character input, if the first stroke is dragged to some extent and the second stroke is input quickly, the handwritten character input mode is set. That is, first pen down (first time)
If the amount of drag movement that exceeds the specified value occurs within a predetermined time after and after the pen-up occurs and the time until the pen-down (second time) of the next stroke is less than the predetermined time, the handwritten character Recognize as input. At this time, a recognition button for character recognition is displayed on the display device 6 of the display means 32 at the time when the handwriting character input mode is found.

Next, referring to FIG. 9, when a gesture is performed, a certain amount of drag is performed with only one stroke.
In other words, if the amount of movement of the drag exceeds the specified value after pen down (first time), and if a certain amount of time elapses before the next pen down (second time) after pen up occurs, the gesture mode is set, and In other cases, it is treated as a mode for inputting handwritten characters. Further, even one stroke having a size larger than a predetermined value is treated as character recognition. After the gesture mode is determined and the gesture is recognized, if the gesture fails, the handwriting character input mode is used. In addition,
Gestures that can be heard anywhere except on characters (such as line breaks) are excluded.

In this way, it is possible to automatically determine which mode of cursor movement / range designation / gesture / handwritten character input. Therefore, it is not necessary for the user to select the pen operation mode without being aware of the pen operation mode, so that the operability is improved and the editing and input time can be shortened.

Further, since the stroke of the one-stroke pen which is not written in the character area displayed on the display means 31 is determined again in the handwriting character input mode, the one-stroke character can be input. .

Further, the user can judge the current pen operation mode by the shape of the cursor displayed on the display means 31 and corresponding to cursor movement / range designation / gesture / handwritten character input, and smoother operation is possible. Therefore, the operability is further improved.

By determining the size of the pen input trajectory by the pen input trajectory determining means 39, the gesture / handwritten character input mode can be accurately selected.

Further, in the handwriting character input mode, the recognition button is displayed on the display means 31, and the recognition button is immediately pressed by the pen 18 after the handwriting character input is completed. Since it can be eliminated, smoother handwritten character input can be performed.

Further, when the mode determination means 33 fails to recognize the gesture after determining the gesture mode, the mode determination means 33 changes the determination from the gesture mode to the handwritten character input mode so that the handwritten character is intended to be input. Even if the gesture mode is accidentally changed, the gesture mode is immediately switched to the handwritten character input mode, which saves the trouble of operation.

(Second Embodiment) FIG. 10 is a block diagram showing the essential parts of a document information processing apparatus according to the second embodiment of the present invention. This document information processing apparatus has the same configuration as the block diagram shown in FIG. 1 except for the program stored in the ROM 11, and the illustration and description thereof will be omitted.

The above-mentioned document information processing apparatus has a pen input means 41 composed of a pen controller 17 and a pen 18, and a display means 4 composed of a display controller 5 and a display device 6.
2, a mode determination unit 43, a pen movement amount determination unit 44, a time management unit 45, a mode determination output unit 46, and a cursor display switching unit 47 which are configured by a program stored in the ROM 11. The pen movement amount determination means 44, the time management means 45, and the cursor display switching means 47 are assumed to receive the information of the pen input signal from the pen input means 31 via the mode determination means 33.

In the document information processing apparatus having the above structure, the time management means 45 receives the information of the signal indicating the pen down from the pen input means 41 via the mode determination means 43 and manages the time after pen down. In order to output the time management signal. Then, the cursor display switching means 47, as shown in FIG. 11, based on the time management signal from the time management means 45, the display means 42 at predetermined time intervals.
The shape of the cursor displayed in is sequentially switched to the shape corresponding to the mode of cursor movement / range designation / gesture / handwritten character input (the cursor shown in FIG. 11 is cursor movement / range designation / gesture / handwritten character input in order from the left). Mode). Then, the pen input means 4
Based on the pen input signal from 1, the pen movement amount determination means 44 determines the movement amount of the drag of the pen 18. Based on the pen operation mode represented by the cursor switched by the cursor display switching unit 47 and the pen input signal from the pen input unit 41, the mode determination unit 43 determines that the pen operation mode is cursor movement / range designation / gesture. / It is determined that the mode is one of the handwritten character input modes.

The mode selection processing of the document information processing apparatus will be described below with reference to the flowcharts shown in FIGS.

First, when the pen 18 is pen-down on the display screen of the display means 42, a timer is started in step S51. Next, in step S52, the cursor indicating the mode of cursor movement is displayed at the point on the pen-down screen. Next, in step S53, it is determined whether or not the counter started in step S51 has timed out. If it is determined that the counter has timed up, the process proceeds to step S56 while the counter has timed up in step S53. If it is determined that there is not, the process proceeds to step S54. Next, in step S54, it is determined whether or not a pen-up event has occurred, that is, pen-up has occurred, and if it is determined that pen-up has occurred, step S5
Proceed to step 5 to perform cursor movement processing. On the other hand, if it is determined in step S54 that the pen-up event has not occurred, the process returns to step S53.

Next, the timer is started in step S56, and the process proceeds to step S57 to display the cursor indicating the range designation mode. Next, in step S58, it is determined whether or not the timer started in step S56 has timed out. If it is determined in step S58 that the timer has timed out, the process proceeds to step S61 shown in FIG. 13, while if it is determined that the timer has not timed out, the process proceeds to step S59. Next, in step S59, it is determined whether or not a certain amount of drag has occurred. That is, it is determined whether or not the movement amount of the drag of the pen 18 is a predetermined amount or more. Then, if it is determined in step S59 that a certain amount of drag or more has occurred, the process proceeds to step S60, while if it is determined that no certain amount of drag has occurred, step S60.
Return to 58. Then, in step S60, range designation processing is performed, and this mode selection processing ends.

Next, the timer is started in step S61, and the process proceeds to step S62 to display the cursor indicating the gesture mode. Next, in step S63, it is determined whether or not the timer started in step S61 has timed out. Then, in step S61
If it is determined that the timer has timed out, the process proceeds to step S66, while if it is determined that the timer has not timed out, the process proceeds to step S64. Next, in step S64, it is determined whether or not a certain amount of drag has occurred. That is, it is determined whether or not the movement amount of the drag of the pen 18 is a predetermined amount or more. Then, step S6
If it is determined in step 4 that a certain amount of drag or more has occurred, the process proceeds to step S65, while if it is determined that no amount of drag has occurred, the process returns to step S63. next,,
In step S65, the process of recognizing the gesture is performed,
This mode selection process ends.

Further, the timer is started in step S66, and the process proceeds to step S67 to display the cursor indicating the handwritten character input mode. Next, step S68.
Then, it is determined whether or not the timer started in step S66 has timed out, and when it is determined that the timer has timed out, the process returns to step S51. On the other hand, if it is determined in step S68 that the timer has not expired, the process proceeds to step S69 and it is determined whether or not dragging has occurred. If it is determined in step S69 that the timer has timed out, the process proceeds to step S70, while if it is determined that the timer has not timed out, the process returns to step S68. Then, in step S70, a character recognition process, that is, a process of inputting handwritten characters is performed, and the mode selection process is ended.

In this way, after the first pen down, the display state of the cursor displayed on the display means 31 is switched every predetermined time, and when the cursor movement / range designation / gesture / handwritten character input is displayed, pen input is performed. Switch each mode accordingly. That is, the cursor display becomes a cursor movement display at the first pen-down, and the cursor movement processing is performed when the pen-up at this time. Also, after the first pen down, the pen down state continued, the cursor display changes from the cursor movement to the range designation display,
If you drag at this time, range specification processing is performed.
Furthermore, after the first pen down, the pen down state continues, and the cursor display changes from cursor movement / range designation to gesture display. At this time, if a certain amount of drag is made, the gesture processing is performed. Furthermore, after the first pen down, the pen down state continues, and the cursor display changes from cursor movement / range designation / gesture to handwritten character input. If dragging occurs at this time, handwritten character input processing is performed. Then, if the pen down state continues without performing any mode processing, a cursor having a shape corresponding to the modes of cursor movement / range designation / gesture / handwritten character input is repeatedly displayed.

As described above, it is possible to automatically select each mode of cursor movement / range designation / gesture / handwritten character input. Therefore, it is necessary for the user to select the pen operation mode without being aware of the pen operation mode, so that the operability is improved and the editing and input time can be shortened.

In the first embodiment, the character area input judging means 37, the cursor display switching means 38, the pen input locus judging means 39 and the recognition button display means 40 are used, but the character area input judging means and the cursor display switching means are used. Therefore, the pen input trajectory determining means and the recognition button displaying means may be omitted. That is, as shown in FIG. 14, the pen input means 3
1, mode determination means 33, display means 32, pen movement amount determination means 34, pen input time determination means 35 The document information processing apparatus of the present invention may be configured. Then, the mode determined by the mode determination means 33 is output to an arbitrary place by the mode determination output means 36.

In the first embodiment, the character area input judging means 37, the cursor display switching means 38, the pen input locus judging means 39 and the recognition button displaying means 40 are used. It may be provided with at least one of a switching means, a pen input trajectory determination means, and a recognition button display means.

For example, as shown in FIG. 15, in the structure of the character information processing apparatus shown in FIG. 14, character area input judging means for judging whether or not pen input has started from the area of the character displayed on the display means 32. It may be provided with 51. In this case, the stroke of the pen of one stroke not written in the area of the character displayed on the display means can be input as the mode for inputting the handwritten character, and the character of one stroke can also be input.

Further, as shown in FIG. 16, in the configuration of the character information processing apparatus shown in FIG. 14, the cursor display switching means for switching the shape of the cursor displayed on the display means 32 based on the determination result of the mode determination means 33. It may be provided with 52. In this case, since the shape of the cursor displayed on the display means is switched according to the pen operation mode, the current pen operation mode can be determined by the shape of the cursor, and smoother operation becomes possible and operability is improved. Especially improved.

As shown in FIG. 17, based on the pen input signal from the pen input means 31 in the structure of the character information processing apparatus shown in FIG. It may be provided with a pen input trajectory determining means 53 for determining. In this case, the gesture and handwritten character input modes can be accurately selected according to the size of the pen input trajectory.

Further, as shown in FIG. 18, when the mode determining means 33 determines in the configuration of the character information processing apparatus shown in FIG. Recognition button displaying means 32
It may be provided with a recognition button display means 54 for displaying. In this case, by pressing the recognition button immediately after the handwritten character input is completed, the waiting time until the handwritten character input can be eliminated.

In the first embodiment, when the mode determination means 33 determines that the pen operation mode is the gesture mode and then fails to recognize the gesture, the mode of the handwritten character is changed from the gesture mode. However, the mode determination unit may leave the gesture mode even if recognition of the gesture fails after determining the gesture mode.

Further, in the second embodiment, the cursor display switching means 47 switches the cursor shape every predetermined time, but the switching time may change the cursor shape at the same time or different. Of course, the shape of the cursor may be switched every time.

[0059]

As is apparent from the above, according to the document information processing apparatus and the document information processing method of the present invention, which mode of the handwriting editing and the handwriting character input is automatically selected as the pen operation mode. Can be determined,
Since it is not necessary to select the mode, the operability is improved and the editing and input time can be shortened.

In addition, it is possible to automatically determine which of the gesture editing mode and the handwritten character input mode the pen operation mode is, and it is not necessary to perform the mode selection operation. Can be improved, and editing and input time can be shortened.

Further, since the pen operation written in the area where no character is displayed is determined to be the mode of handwritten character input, it is possible to input a single stroke of character which is easily misrecognized as a gesture symbol.

[Brief description of drawings]

FIG. 1 is a block diagram of a document information processing apparatus according to a first embodiment of the present invention.

FIG. 2 is a configuration diagram of a main part of the document information processing apparatus.

FIG. 3 is a flowchart showing an operation of selecting a pen operation mode of the document information processing apparatus.

FIG. 4 is a flowchart showing a selection operation of a pen operation mode of the document information processing apparatus.

FIG. 5 is a flowchart showing an operation of selecting a pen operation mode of the document information processing apparatus.

FIG. 6 is a conceptual diagram of cursor movement.

FIG. 7 is a conceptual diagram of range designation.

FIG. 8 is a conceptual diagram of handwritten character input.

FIG. 9 is a conceptual diagram of a gesture.

FIG. 10 is a configuration diagram of a main part of a document information processing apparatus according to a second embodiment of the present invention.

FIG. 11 is a diagram showing cursor display switching of the document information processing apparatus.

FIG. 12 is a flowchart showing an operation of selecting a pen operation mode of the document information processing apparatus.

FIG. 13 is a flowchart showing an operation of selecting a pen operation mode of the document information processing apparatus.

FIG. 14 is a configuration diagram of a main part of another embodiment of the present invention.

FIG. 15 is a configuration diagram of a main part of another embodiment of the present invention.

FIG. 16 is a configuration diagram of a main part of another embodiment of the present invention.

FIG. 17 is a configuration diagram of a main part of another embodiment of the present invention.

FIG. 18 is a configuration diagram of a main part of another embodiment of the present invention.

FIG. 19 is a configuration diagram of a main part of a conventional document information processing apparatus.

[Explanation of symbols]

1 ... CPU, 2 ... Bus, 3 ... CGROM, 4 ... VRA
M, 5 ... Display controller, 6 ... Display device, 7 ... FD controller, 8 ... Floppy disk drive, 9 ... Printer controller, 10 ... Printer, 11 ... ROM,
12 ... RAM, 13 ... Coordinate storage buffer, 14 ... Variable buffer, 15 ... Keyboard controller, 16 ... Keyboard, 17 ... Pen controller, 18 ... Pen, 19 ... Buzzer controller, 20 ... Buzzer.

─────────────────────────────────────────────────── ─── Continuation of front page (58) Fields surveyed (Int.Cl. ⁷ , DB name) G06F 3/03 G06F 17/22 G06K 9/62 G06T 11/60

Claims (2)

(57) [Claims] 1. Display means for displaying document information such as characters, input means for inputting stroke information to said display means, and document information input based on stroke information input by said input means. Of the document displayed on the display unit, which has a gesture recognition unit that recognizes a gesture that means the editing process of the above, and a character recognition unit that recognizes a character based on the stroke information input by the input unit. The information is the recognition result of the gesture recognition means.
Editing processing is performed according to
In the document information processing apparatus for displaying the recognized character on the display means, whether or not the starting point position of the stroke information input from the input means is designated by an arbitrary character of the character displayed document information. And a character area input determining unit that determines whether the character area input determining unit determines that the gesture mode is instructed by the character area input determining unit, and determines a handwriting character input mode when not determining. In the case of a gesture mode, the stroke recognition device further recognizes a stroke continuous to the start point position,
In addition to performing editing processing of the character displayed at the starting point position, in the case of the handwritten character input mode, stroke information that continues at the starting point position even if the input stroke information overlaps the character displayed character A document information processing apparatus, wherein the document information input processing is performed by recognizing the character by the character recognition means. 2. Display means for displaying document information such as characters, input means for inputting stroke information to said display means, and document information input based on stroke information input by said input means. Of the document displayed on the display unit, which has a gesture recognition unit that recognizes a gesture that means the editing process of the above, and a character recognition unit that recognizes a character based on the stroke information input by the input unit. The information is the recognition result of the gesture recognition means.
Editing processing is performed according to
In the document information processing method of the document information processing apparatus for displaying the recognized character on the display means, the start point position of the stroke information input from the input means is designated from any character of the character displayed document information. A character area input determining step for determining whether or not the handwriting character is determined to be a gesture mode when it is determined to be instructed in the character area input determining step, and a handwritten character when it is determined not to be instructed. A mode determination step of determining the input mode, and an edit processing step of recognizing a stroke continuous to the start point position by the gesture recognition means in the case of the gesture mode and performing an edit process of a character displayed at the start point position And in the handwriting input mode,
An input processing step of performing the input processing of the document information by recognizing the stroke information continuing at the start point position by the character recognition means even if the input stroke information overlaps the character to be displayed. A document information processing method characterized by the above.