JP2989084B2 - Information processing device - Google Patents

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an information processing apparatus capable of editing by handwriting with a pen or the like on a screen.

[0002]

2. Description of the Related Art Conventionally, in an information processing apparatus such as a word processor or a computer, input is generally performed by a keyboard. In such an information processing apparatus, when editing a document or the like, a cursor is moved by a cursor operation key operation to specify an edit location or an edit range, and a desired edit process is executed by an edit key operation. I was

[0003] In recent years, there has been an apparatus capable of inputting information by directly pointing the screen with a pen for inputting coordinates. In a device provided with so-called gesture editing for editing a document or the like by handwriting with such an apparatus, a command is processed in accordance with the shape of the line drawing by drawing the line drawing on the screen with a pen. ing.

As shown in FIG. 13, such an information processing apparatus includes an input processing unit 21 for inputting by handwriting, a recognition processing unit 22 for recognizing input handwriting (input pattern), and a recognition processing unit. 22 recognition result (recognition pattern)
And a storage unit memory 24 that stores a matching pattern used for recognition of an input pattern and command data associated with the matching pattern, based on the determination processing unit 23 that determines command data corresponding to the recognition pattern. And an output processing unit 25 that executes command execution processing based on the command data determined by the determination processing unit 23.

[0005] Further, the above-mentioned storage unit memory 24 is provided in FIG.
As shown in (a), a gesture command table including a 2-byte code is provided. In the gesture command table, as shown in FIG. 14B, the first byte indicates the code of the matching pattern for the handwriting, and the second byte indicates the processing code of the command data associated with this pattern code.

[0006] The gesture editing process by the information processing device is firstly performed by a handwriting input process in an input processing unit 21 (S31) as shown in a flowchart of FIG. The coordinate data (input pattern) is temporarily stored in a buffer memory (not shown) (S32). Next, a matching pattern is called from the gesture command table (S33), and the recognition processing unit 22 checks the matching pattern against the input pattern (S34).
It is determined whether there is a corresponding pattern (recognition pattern) for the input pattern (S35).

In S35, if there is no recognition pattern,
On the other hand, if there is a recognition pattern, the process proceeds to S3.
Then, the process proceeds to step S6, where command data corresponding to the above recognition pattern is determined from the gesture command table.
Then, the command data determined by the determination processing unit 23 and the position information are output as processing codes by the output processing unit 25.
(S37), the output processing unit 25 executes command processing based on the above processing code (S3).
8) The processing process in the gesture editing as described above ends.

[0008]

However, in the conventional information processing apparatus which enables gesture editing, the correspondence between the matching pattern and the command data in the gesture command table is fixed. I have. For this reason, it is necessary for the user to pay attention to the correspondence of the command processing to be performed corresponding to the predetermined handwriting pattern in operation, and there is a problem that the gesture editing operation cannot be performed according to the user's purpose. ing.

[0009]

In order to solve the above-mentioned problems, an information processing apparatus according to the present invention includes a display input unit for inputting a handwriting on a display screen as an input pattern, and an input pattern from the display input unit. An information processing apparatus comprising a management table for storing a matching pattern for recognition and command data for editing associated with the matching pattern, and executing a command execution process based on the input pattern, includes the following means. I'm taking it.

That is, the map stored in the management table is
Either the ring pattern or the command data item
Item selection means for selecting
If you select data, it is stored in the above management table.
Command data as command data candidates
Output, while the item selection means is a matching pattern
If you select, the
Matching patterns that do not exist as matching pattern candidates
Output means for outputting the data from the candidate output means.
Command data candidate or matching pattern
Candidate selecting means for selecting an arbitrary one from the complements,
Command data or map selected by the selection means
Storage for storing the switching pattern in the management table.
With new means .

[0011]

According to the above arrangement, the input pattern input from the display input means is recognized as a recognition pattern by comparing the input pattern with the matching pattern in the management table. Thereafter, based on the above recognition pattern, the corresponding command data is determined, and the command processing of the determined data is executed. The setting change means arbitrarily changes the corresponding setting of the matching pattern and the command data stored in the management table as described above.

[0012]

1 to 12A show an embodiment of the present invention.
This will be described below based on (b). In this embodiment,
An example in which the information processing apparatus is applied to a Japanese word processor will be described.

As shown in FIG. 1, the Japanese word processor according to the present embodiment includes an input processing unit (display input means) 1 for inputting handwriting on a display screen as an input pattern.
A recognition processing unit for recognizing an input pattern input from the input processing unit, and a gesture editing command data corresponding to the recognition pattern is determined based on a recognition result (recognition pattern) in the recognition processing unit. Judgment processing unit 3
And a storage unit memory 4 for storing a matching pattern used for recognition of an input pattern and command data associated with the matching pattern, and executing a command based on the command data determined by the determination processing unit 3. An output processing unit 5 that performs processing, and a gesture setting change processing unit (setting change unit) 6 that arbitrarily changes the correspondence between the matching pattern and the command data in the storage unit memory 4 according to the user's application. ing.

As shown in FIG. 2, the input processing unit 1 includes a display tablet 11 in which a display 11a and a transparent tablet 11b are integrally formed, and coordinates for inputting coordinates on a display screen of the display tablet 11 by a user operation. An input pen 12 and a locus coordinate extracting unit 13 for sequentially extracting coordinates of a locus operated by the coordinate input pen 12 are provided.

The recognition processing section 2 and the determination processing section 3 are each composed of a handwritten character recognition section 14a and a gesture command determination section 14b. Handwritten character recognition unit 14a
Collates the coordinate data extracted by the locus coordinate extraction unit 13 with a matching pattern in a handwritten character table 15a to be described later, and confirms a corresponding character code. The gesture command determination unit 14b checks the coordinate data extracted by the trajectory coordinate extraction unit 13 with a matching pattern in a gesture command table 15b described later to check a matching pattern code of the corresponding basic stroke, Of the command data corresponding to.

The handwritten character recognition section 14a outputs the corresponding character code to the output processing section 5 as a result of the confirmation, while the gesture command determination section 14b outputs the determined command data as the determination result. , And outputs the position information to the output processing unit 5 as a processing code.

The storage unit memory 4 has a management table 1 of a handwritten character table 15a for storing a matching pattern for handwritten characters and a gesture command table 15b for storing a matching pattern for gesture commands.
5 is comprised. As shown in FIG. 3, the matching pattern stored in the gesture command table 15b is composed of a plurality of basic stroke data, and these basic stroke data are provided with corresponding command data.

The output processing unit 5 comprises a text editing unit 17 for editing a character or a character string in the text memory 16. When a character code is inputted from the handwritten character recognition unit 14a, the text memory 16 is used. When character data is added to the cursor position in the, while the command and the processing code of the position are input from the gesture command determination unit 14b, the character or character string in the text memory 16 corresponding to the position information is corresponded to the data. Execute a command. The gesture setting change processing unit 6 includes a keyboard 18 for inputting characters such as character data and command data for gesture editing, and enables setting change of a gesture editing matching pattern by a key operation described later.

As shown in FIG. 2, the word processor connects the trajectory coordinates extracted by the trajectory coordinate extraction unit 13 to generate a trajectory image, and the trajectory drawing unit 19 generates the trajectory image. By providing the bitmap memory 20 for storing the track image combined with the image currently displayed on the display tablet 11, the character or the gesture handwriting operated by the user with the coordinate input pen 12 is displayed on the display tablet 11. Enables real-time display.

In the above configuration, the operation methods of gesture editing, pointing, and handwritten character input in the present word processor will be described below with reference to FIGS. 4 (a) (b) to 6 (a) (b). explain.

First, in the gesture editing operation, for example, as shown in FIG. 4A, of the text displayed on the display tablet 11, the character "e" is displayed.
When one character is to be deleted, the coordinate input pen 12
Is gestured like “V”, and the coordinate input pen 12 is released from above the display tablet 11.

As a result, the trajectory coordinates are extracted by the trajectory coordinate extraction unit 13, and the trajectory coordinates are output to the trajectory drawing unit 19 and the gesture command determination unit 14b. The trajectory coordinates output to the trajectory drawing unit 19 are generated as a trajectory image. After that, the trajectory image is output to the bitmap memory 20 so that “e” displayed on the display tablet 11 is displayed on the “e”. "V" is superimposed and displayed.

On the other hand, the gesture command determining unit 14b
Are collated with the basic stroke data in the gesture command table 15b, and the obtained one-letter erasure command data and its position information are output to the text editing unit 17. Then, the text editing unit 17 moves the cursor C from the current position to the position of “E” operated by the coordinate input pen 12 based on the position information, and thereafter, based on the command data of one character deletion. Then, "e" in the text memory 16 is deleted. For this reason, on the display tablet 11,
As shown in FIG. 4B, "e" is deleted,
The cursor C is shifted to “O” displayed after “E”.

Next, a pointing operation for specifying a plurality of characters on the display tablet 11 will be described. The pointing operation has conventionally been performed by sequentially moving the cursor. However, in the present word processor, the cursor position can be directly designated by the instruction of the coordinate input pen 12.

For example, as shown in FIG. 5A, when a point "U" on a text is designated by the coordinate input pen 12,
The gesture command determining unit 14b determines that the coordinate input pen 1
It is determined that the trajectory coordinates by 2 are one-point coordinates, the processing operation is switched from gesture editing to pointing, and the cursor C is shifted to "U" to indicate the starting point position of the pointing area. At this time, the gesture command determination unit 14b does not collate the trajectory coordinates with the basic stroke data in the gesture command table 15b, and only outputs the position information thereof to the text editing unit 17b.
Output.

Then, as shown in FIG. 5 (b), when the character "F" on the text is pointed by the coordinate input pen 12, and the end point position of the pointing area is designated, the character "U" is displayed. Characters located between "" and "" are separated by broken lines, and an area is designated.

Next, an operation for inputting handwritten characters will be described. This handwritten character input function is performed by the keyboard 18.
In addition to the startup by the key input command from the user, the startup from the gesture editing command by gesturing “ジ ェ” on the display tablet 11 is enabled.

When the handwritten character input function is activated as described above, a predetermined position on the display screen is displayed as shown in FIG.
, A handwriting input window W is displayed. Then, in the coordinate input pen 12 to the first input area W ₁ in this window W, for example, handwritten characters "su", placing the coordinate input pen 12 to the second input area W ₂ for the next character input.

As a result, the trajectory coordinates are extracted by the trajectory coordinate extraction unit 13, and the trajectory coordinates are output to the trajectory drawing unit 19 and the handwritten character recognition unit 14a. The trajectory coordinates output to the trajectory drawing unit 19 are generated as a trajectory image,
After that, the locus image is output to the bitmap memory 20, so that “S” appears in the first input area W ₁ of the window W displayed on the display tablet 11.
Is displayed.

On the other hand, the trajectory coordinates output to the handwritten character recognition unit 14a are subjected to character recognition by collating with a matching pattern in the handwritten character table 15a, and the code of the obtained recognized character is edited by text editing. Output to the unit 17. At the position of the cursor C on the display tablet 11, as shown in FIG. 6B, the recognition result character "su" is displayed, and at the position next to the displayed recognition character "su". The cursor C is moved.

Next, a processing process of the word processor in the above-described gesture editing will be described with reference to a flowchart of FIG.

First, the gesture command table 15
It is determined whether or not to change the gesture setting content of b (S1). When the gesture setting content is changed in S1, the process proceeds to S2, where the setting content is changed using the keyboard 18, and then the process returns to S1 again. On the other hand, when the gesture setting content is not changed, the process proceeds to S3,
The input processing unit 1 performs a handwriting input process, and then temporarily stores and holds the coordinate data (input pattern) obtained in the input process in a buffer memory (not shown) (S
4).

Next, the gesture command table 15
b, a matching pattern (basic stroke data) is called (S5), and the gesture command determination unit 14b compares the matching pattern with the input pattern (S6), and a corresponding pattern (recognition pattern) for the input pattern is obtained. Is determined (S7). S
In S7, if there is no recognition pattern, the process proceeds to S1, while if there is a recognition pattern, the process proceeds to S8 to determine the command data corresponding to the recognition pattern from the gesture command table 15b.

Then, the gesture command determining unit 14
By outputting the command data determined in b and the position information to the text editing unit 17 as a processing code (S9), the text editing unit 17 executes the command processing based on the above processing code. (S10) The processing process in the gesture editing as described above ends.

Next, the process of changing the setting by the keyboard 18 in S2 will be described below with reference to the flowchart of FIG. 8 and the explanatory diagrams of FIGS. 9 (a) to 9 (c).

First, when the gesture setting change key on the keyboard 18 is pressed, the contents of the gesture command table 15b are read out (S11), and the current display as shown in FIG. Is displayed (S12).
The setting contents include a setting number, a basic stroke, and a command.

Next, when the user selects a setting number (for example, "1") to be changed (S13), the setting number "1" is displayed on the display screen as shown in FIG. 9B.
The basic stroke and command are displayed. When the user selects a basic stroke or a command change item from the display screen using the cursor movement keys (← / →) (S14), it is then determined whether or not the change item is a change in the basic stroke. Is performed (S15).

If it is determined in S15 that the change item is not a change of the basic stroke, that is, if the change item is a change of the command, the process proceeds to S1.
Then, the process proceeds to step 6, where command setting candidates are displayed on the display screen. On the other hand, when the change item is the change of the basic stroke, the process proceeds to S17, and the setting candidates of the basic stroke excluding the set pattern are displayed on the display screen. This makes it possible to make overlapping setting of basic strokes, while enabling overlapping setting of commands.

Thereafter, when the setting type is selected by the conversion / next candidate key (S18), it is then determined whether or not the selection of the setting type is finalized (S19). S19
If the selection of the setting type is not determined, the process returns to S18. On the other hand, if the selection of the setting type is determined, the process proceeds to S20. The selection of the setting type is confirmed by the user pressing the execution key.

At S20, the setting data of the setting type determined as described above is held, and based on this, the contents of the gesture command table 15b are changed (S21). Then, the changed setting is displayed on the display screen as shown in FIG. 9C (S22), and the above setting change process is ended.

Next, a description will be given of a setting candidate table for controlling whether or not the above-described basic stroke or command can be set repeatedly.

This setting candidate table is provided in the gesture command table 15 for the basic stroke and for the command. The setting candidate table for the basic stroke is, as shown in FIG.
This is a data storage format composed of "e", and the first byte represents check data indicating whether or not the setting has been completed, and the second byte represents a pattern candidate number. On the other hand, the command setting candidate table has a data storage format composed of 1 byte, as shown in FIG. 11, and this 1 byte represents a processing candidate number such as “retreat”, “line feed”, “erase”, and the like.

As shown in FIG. 12A, the pattern candidate number of the basic stroke setting candidate table and the processing candidate number of the command setting candidate table are each 1 byte of the gesture command table 15b.
It is stored as each code of the e-th and second bytes.
And this gesture command table 15b is
With the above-described setting change operation, for example, FIG.
As shown in (b), the data storage is changed.

As described above, the present Japanese word processor includes an input processing unit 1 for inputting a gesture handwriting on a display screen as an input pattern, a matching pattern for recognizing an input pattern from the input processing unit 1, and a matching pattern. Gesture command table 15b for storing command data for editing associated with a matching pattern
And a keyboard 18 for arbitrarily changing the setting of the correspondence between the matching pattern and the command data in the gesture command table 15b.

As a result, a gesture editing setting corresponding to the user's purpose can be performed by operating the keys on the keyboard 18, so that the correspondence relationship of command processing to be performed corresponding to the gesture handwriting can be changed at the user's convenience. As a result, operability in gesture editing can be improved.

The above embodiment does not limit the present invention, and various modifications can be made within the scope of the present invention.
For example, in the above-described embodiment, the gesture setting change processing unit 6 is the keyboard 18. However, the present invention is not limited to this, and a configuration based on handwriting input on the display tablet 11 is also possible.

[0047]

According to the information processing apparatus of the present invention, as described above, the matching pattern stored in the management table is used.
Or an item to select any item of command data
Selection means and the above item selection means select command data
In this case, the frame stored in the management table
Command data as command data candidates,
When the above item selection means selects a matching pattern
The matching that is not stored in the above management table
Candidates to output patterns as matching pattern candidates
Output means and a command output from the candidate output means
Any of the data candidates or matching pattern candidates
Candidate selection means for selecting
Command data or matching pattern selected
Is stored in the management table .

[0048] Thus, the handwritten pattern was fixed in the conventional, the correspondence between the command processing corresponding thereto, it is possible to change depending on the user application, to improve the operability of the gesture editing Can be
As a result, it is possible to provide a convenient information processing device having excellent operability in gesture editing. To change the matching pattern,
Stored in the above management table without being associated with command data
Is output as candidates after the change.
Commands can be duplicated, while match
The overlapping pattern suppresses the overlapping setting. Therefore,
Input the same command associated with multiple gestures
And combine them into one matching pattern.
Preventing a number of commands from causing corresponding defects
it can. Therefore, it is necessary to further improve operability.
It has the effect of being able to.

[Brief description of the drawings]

FIG. 1 is a block diagram showing a basic configuration of a Japanese word processor according to an embodiment of the present invention.

FIG. 2 is a block diagram showing components constituting the above basic configuration.

FIG. 3 is an explanatory diagram showing basic strokes and commands of a gesture command table that constitutes the above-described components.

FIGS. 4A and 4B are explanatory diagrams each showing a gesture editing operation method; FIGS.

FIGS. 5A and 5B are explanatory diagrams each showing a pointing operation method. FIG.

FIGS. 6A and 6B are explanatory diagrams each showing a method of operating handwritten character input.

FIG. 7 is a flowchart showing a gesture editing process of the word processor.

FIG. 8 is a flowchart showing a gesture setting changing process using the keyboard of the word processor.

FIGS. 9A to 9C are explanatory views showing display of setting contents in a gesture setting changing process.

FIG. 10 is an explanatory diagram showing a setting candidate table for a basic stroke provided in the gesture command table.

FIG. 11 is an explanatory diagram showing a command setting candidate table provided in the gesture command table.

FIGS. 12A and 12B are explanatory diagrams each showing a change in setting of a gesture command table.

FIG. 13 is a block diagram showing a basic configuration of a Japanese word processor in a conventional example.

FIG. 14A is an explanatory diagram showing a gesture command table of the word processor.
FIG. 6B is an explanatory diagram of each code constituting the gesture command table.

FIG. 15 is a flowchart showing a gesture editing process of the word processor.

[Explanation of symbols]

 Reference Signs List 1 input processing unit (display input unit) 11 display tablet 12 coordinate input pen 13 trajectory coordinate extraction unit 14b gesture command determination unit 15 management table 15b gesture command table 18 keyboard (setting change unit)

──────────────────────────────────────────────────続 き Continued on front page (58) Field surveyed (Int.Cl. ⁶ , DB name) G06F 3/03

Claims (1)

(57) [Claims] 1. A display input means for inputting handwriting on a display screen as an input pattern, a matching pattern for recognizing an input pattern from the display input means, and editing command data associated with the matching pattern. And a management table that stores a matching pattern stored in the management table.
Is an item selection to select any item of command data
Means, and when the item selecting means selects the command data,
Is the command data stored in the management table
Is output as a command data candidate.
If the selection means selects a matching pattern,
Matching patterns not stored in the management table
Candidate output means for outputting as a matching pattern candidate
And the command data candidates output from the candidate output means.
Or select any of the matching pattern candidates
The candidate selection means and the command data selected by the candidate selection means
Or the matching pattern is stored in the management table.
The information processing apparatus characterized by and a that stores update means.