JPH08329192A - Information processing device and method therefor - Google Patents

Abstract

PURPOSE: To improve the efficiency of work for executing processing by the input of a locus by executing plural kinds of processing recognized by a recogni tion means in accordance with priority previously set up in the processing. CONSTITUTION: A locus is inputted to a digitizer 121 by an electronic pen 122 and the coordinates of the inputted locus are read out. The inputted locus is recognized by a locus recognition program 31. An instruction corresponding to each recognition result is executed by an execution program 34 and the executed instruction is successively stored in a storage area 35. The priority of each recognition result recognized by a recognition part is judged in accordance with a priority judging program 32. In addition, a correspondence table between instructions corresponding to respective recognition results and their priority is previously prepared and the priority of each recognition result is judged based upon the table.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an information processing apparatus and method for processing based on trajectory information.

[0002]

2. Description of the Related Art The following techniques exist in conventional information processing apparatuses for inputting with an input pen or the like. (1) In the trajectory recognition for recognizing a trajectory drawn by an input pen or the like, there has been a delay recognition technique in which the recognition processing is collectively performed after inputting a plurality of trajectories.

(2) There has been a technique of sequentially registering recognition results of a trajectory drawn by an input pen or the like, and sequentially executing a process intended by the result as a process different from the recognition of the trajectory. The delay recognition process (1) will be described with reference to the flowchart of FIG. FIG. 1 is a flow chart showing the delay recognition processing flow of (1). In step 11, the locus is input with an input pen or the like. In step 12, it is determined whether to recognize the locus. If the recognition is not determined to be started (NO in step S12), the locus is stored in step 13. Then, the process returns to the trajectory input in step 11.

If it is determined in step 12 that the recognition is started (YES in step S12), it is determined in step 14 whether the locus is stored. When the locus is not stored (NO in step S14), the process returns to the locus input in step 11. If the locus is stored (step S
14), the trajectory is recognized in step 15.
In step 16, the intended instruction by trajectory is executed.
Then, the process returns to step 14 again, and is repeated until there are no stored loci.

A case where the above processing is realized by a multitask processing system will be described with reference to FIG. Figure 2 is (2)
5 is a flowchart showing a processing flow when the processing of FIG. In step 21, the locus is input with an input pen or the like. In step 22, the trajectory storage is repeatedly executed, and the trajectory is continuously stored as one process. On the other hand, in step 23, it is constantly monitored whether or not there is a stored trajectory, and if there is a stored trajectory (YES in step S23), the trajectory is recognized in step 24. Then, in step 25, the intended command based on the locus is executed.

In both of the processing systems shown in FIGS. 1 and 2, the instruction intended by the locus is executed in the order of locus input.

[0007]

However, the above-mentioned conventional information processing apparatus has the following problems. (1) Since the desired processing cannot be realized before the recognition result is output, the input locus cannot be corrected. (2) When performing the operations by the loci collectively, the processing can be performed only in the order in which they are input. Therefore, the operation intended by the user should be performed on the target whose coordinates and shape change, or the instruction to be preferentially executed. Cannot be entered later. There was a problem.

The present invention has been made in view of the above problems, and it is an object of the present invention to provide an information processing apparatus and method for improving the efficiency of work in the work of inputting a locus and executing processing. Has an aim.

[0009]

In order to achieve the above object, an information processing apparatus according to the present invention has the following configuration.
That is, the information processing apparatus performs processing based on the trajectory information, and recognizes the processing indicated by each of the plurality of types of trajectory information, and the plurality of types of processing recognized by the recognition means in advance in each processing. And executing means for executing the priority according to the set priority.

Preferably, the execution means changes the storage order of the processing recognized by the recognition means and the storage means for storing the priority thereof and the storage order of the processing stored in the storage means according to the priority. The changing means is provided to execute the processing in accordance with the storage order. This is because the processing can be executed according to the priority without depending on the input order.

Further, preferably, the processing is control of a window displayed on the display screen. Further, preferably, the processing is editing of a character string displayed on the display screen. Further, preferably, the control includes moving the window, deiconifying the iconified window, and deleting the window.

[0012] Preferably, the editing includes changing lowercase letters to uppercase letters, inserting characters, and replacing characters. An information processing apparatus according to the present invention for achieving the above-mentioned other object has the following configuration. That is, an information processing apparatus that performs processing based on trajectory information, and recognizes a character by a combination of determination means that determines whether the input trajectory is a stroke or a cancellation instruction, and strokes that are sequentially input. Recognizing means for detecting the stroke at the input position of the trajectory when the input trajectory is a cancel instruction, and control for disabling the stroke detected by the detecting means by the recognizing means. And a control means for performing.

Further, preferably, the control means gives a priority for executing processing next to the detected stroke,
When the cancel instruction is executed in the process of processing, the recognizing means recognizes the stroke immediately before it and erases the stroke. This is because it is possible to cancel only the stroke indicating the desired character without canceling the entire locus indicating the character.

An information processing method according to the present invention for achieving the above object has the following configuration. That is, an information processing method for performing processing based on trajectory information, the recognition step of recognizing processing indicated by each of a plurality of types of trajectory information,
And an execution step of executing the plurality of types of processing recognized in the recognition step according to the priority set in advance for each processing.

An information processing method according to the present invention for achieving the above-mentioned other object has the following configuration. That is, it is an information processing method that performs processing based on trajectory information, and recognizes a character by a combination of a determination step of determining whether an input trajectory is a stroke or a cancellation instruction and a stroke that is sequentially input. And a detection step of detecting a stroke at the input position of the trajectory, and a control of disabling the stroke detected in the detection step in the recognition step. And a control step to be performed.

[0016]

With the above configuration, the processing indicated by each of the plurality of types of trajectory information is recognized, and the recognized plurality of types of processing are executed in accordance with the priority set in advance for each processing. Further, it is determined whether the input locus is a stroke or a cancellation instruction.

On the other hand, when a character is recognized by a combination of strokes that are sequentially input and the input locus is a cancellation instruction, the stroke at the input position of the locus is detected. Then, control is performed so that the detected stroke is not used.

[0018]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Preferred embodiments of the present invention will be described below in detail with reference to the drawings. <First Embodiment> FIG. 3 is a block diagram showing the arrangement of an information processing apparatus according to the first embodiment. Reference numeral 121 denotes a digitizer integrated with a liquid crystal display, which inputs and controls information based on trajectory information of a trajectory drawn by the electronic pen 122. In addition, display of characters input from the keyboard 124 and C
A window by a window system (not shown) controlled by the PU 123 is displayed. An electronic pen 122 is used to input a trajectory. 123 is a CPU,
Recognition of characters drawn by the electronic pen 122 and various controls are performed. Reference numeral 124 denotes a RAM, which is a trajectory recognition program 3
1, priority determination program 32, instruction classification program 3
3, an execution program 34, an instruction storage area 35, and a window system (not shown) are stored. A keyboard 124 is used to input characters and execute processing.

FIG. 13 is a functional block diagram showing the functions of the information processing apparatus of the first embodiment. A recognition unit 1 recognizes an input trajectory according to a trajectory recognition program 31. The recognized recognition result has an instruction corresponding to the recognition result, and the instruction corresponding to the recognition result recognized by the execution program 34 is executed. In addition, the commands corresponding to the recognized recognition results are sequentially stored in the command storage area 35.
Is stored.

Reference numeral 2 denotes a priority determination unit, which sets the priority of the recognition result recognized by the recognition unit 1 to the priority determination program 32.
According to. In addition, the determination of the priority order of the recognition result,
For example, a method of preparing a correspondence table of commands and priority orders corresponding to the recognition result in advance and making a determination based on the table is used. A storage unit 3 includes a RAM 124.

Reference numeral 4 denotes a rearrangement unit, which prioritizes in accordance with the command classification program 33 based on the priority of commands corresponding to the recognition result determined by the priority determination unit 2 and the commands stored in the command storage area 35 in advance. The order is high. Next, the processing in the first embodiment will be described with reference to the flowchart of FIG. FIG. 4 is a flowchart showing the processing flow of the first embodiment.

In step S31, the locus is input to the digitizer 121 from the electronic pen 122, and the input coordinates are read. In step S32, the input trajectory is recognized.
The trajectory is recognized by a method such as comparison with a trajectory registered in advance. The recognition method is omitted because it is not the main object of the present invention. In step S33, it is determined whether the command corresponding to the recognition result of the recognized trajectory is the start of execution.
If it is a start (YES in step S33), the process proceeds to step S37. If not started (N in step S33)
O), and proceeds to step S34. In step S34, the priority order of the instruction corresponding to the recognition result is determined. Step S
In step 35, the commands are classified based on the priority order together with the commands stored in the command storage area 35. In step S36, the result classified in step S35 is stored in the instruction storage area 35. The instructions stored at this time are stored in descending order of priority.

On the other hand, if it is determined in step S33 that it has started (YES in step S33), in step S37,
It is determined whether an instruction exists in the instruction storage area 35. If it exists (YES in step S37), the process proceeds to step S38. If not present (N in step S37)
O), and returns to step S31. In step S38, the instruction at the head of the instruction storage area 35 is fetched and executed.
Then, when the instruction is executed, the process returns to step S37 again. The above processing is repeated until there are no instructions in the instruction storage area 35.

Next, a specific example of steps S34 and S35 will be described with reference to FIG. FIG. 5 is a diagram showing an example of an instruction corresponding to the recognition result stored in the instruction storage area 35 incorporated in the RAM 3 of the first embodiment. It is assumed that the command corresponding to the recognition result 51 is "cancel" in step S34. Here, it is assumed that “cancel” is an instruction with a high priority and is the instruction with the highest priority among the instructions stored in the instruction storage area 35.
The state of the instruction storage area 35 before the rearrangement is executed in step S35 is as shown in FIG. In step S35, the command “cancel” corresponding to the recognition result 51 has the highest priority, and therefore the command of FIG.
The data is rearranged next to the “character deletion” executed immediately before as shown in (b) of FIG. As a result, here, the execution of the "character deletion" is "cancelled", so that the deleted character is returned to the state before the deletion.

An example in which the above-described processing of FIG. 4 is carried out in combination with the window system is shown in FIGS. 6, 7, 8 and 9. FIG. 6 is a diagram showing a display example in the multi-window system displayed on the digitizer 121 of the first embodiment. In the figure, 61 is an iconized window,
Reference numerals 62 and 63 denote windows, and a part of the window 62 is under the window 63. In this state, the trajectory for starting the pause mode, that is, the pause gesture 64 is drawn on the screen using the electronic pen 122. As a result, for example, even if another gesture is recognized, it is not executed until the release gesture 81 for releasing the pause gesture 64 as shown in FIG. 8 is input. That is, when the pause gesture is executed, the execution of step S33 of FIG. 4 is not started, but all are stored.

The "gesture" is a locus drawn by the electronic pen 122. By setting a command corresponding to the form of the locus in advance, a desired command can be executed only by drawing the locus. it can. In FIG. 7, after the pause gesture 64 is drawn, the non-iconified gesture 71 for de-iconifying the iconized icon, the window delete gesture 72 for deleting the window (here, the priority is set high). 7 is a diagram showing an example in which a window movement gesture 73 for moving a window to a desired position is drawn by the electronic pen 122. FIG. At this point, the gestures 71 to 73 are not executed.

When the pause cancel gesture 81 is input in FIG. 8, the execution of step 33 in FIG. 4 is started. As a result, the gestures 71 to 73 drawn in FIG. 7 are executed. As a result of the execution, as shown in FIG. 9, the iconized window 61 is deiconified by the deiconified gesture 71 and becomes a window 91. The window 63 is a window deletion gesture 72.
Has been deleted by. The window 73 is moved to the position shown in the window 92 by the window movement gesture 73.

In the first embodiment, it is assumed that the window deletion gesture 72 has a high priority and is set in advance. Therefore, the deletion of the window 63 is executed before the non-iconization and the movement of the window. next,
A case where the processing of FIG. 4 described above and the editing of the character string input from the keyboard 124 are performed together will be described with reference to FIG.

It should be noted that as an initial setting, the priority of the swapping gesture 103 for swapping words forming a character string to a desired position is set low. Figure 10 shows "Gannon Co., Ltd."
Using the gesture described below for the string
This is an example of editing “Gianon Co., Ltd.”. The user notices the need to insert the "expression" from the "stock company" portion, and inputs the insertion gesture 101 for inserting the "expression". Then, since “YA” is lowercase, a change gesture 102 for changing to uppercase “YA” is input. Finally, a swapping gesture 103 for swapping the order of words is input.

Here, the gestures 101 to 103 described above are used.
When is executed in order, the process intended by the user is executed. However, in the state where the pause gesture 64 of FIG. 6 shown in the first embodiment is executed, the gestures 101 to 1
When the gestures of 03 are collectively input, if the order of the change gesture 102 and the exchange gesture 103 is reversed, conventionally, an apparently wrong instruction to capitalize the “expression” has been executed. However, Example 1
Then, a swapping gesture 103 for swapping words
Since the priority of the change gesture is set low, the change gesture 102
Even if the order of the gestures 103 is replaced, the gesture intended by the user is executed. That is, a gesture input that does not depend on the input order can be realized.

As described above, according to the first embodiment,
In the window system environment, by setting the priority order of the gesture execution in advance, the window 92 moved by the window movement gesture is erased, or the window 92 non-iconified by the non-iconified window is erased. It is possible to prevent an operation that the user does not intend, such as an accident.

In the environment for editing the character string input from the keyboard 124, for example, by setting the priority of the word exchange gesture 103 to be low, the change gesture 102 is input after the exchange gesture 103 is input. Even then, the operation intended by the user can be executed. That is, a gesture input that does not depend on the input order can be realized.

<Second Embodiment> In a second embodiment, a case where the processing of the first embodiment is realized by a multitask processing system will be described. The processing configuration is the same as that of the first embodiment, but RA
Each of the locus recognition program 31, the priority determination program 32, the instruction classification program 33, and the execution program 34 built in the M3 is realized by two processing systems. The process of the second embodiment will be described with reference to FIG.

FIG. 11 is a flow chart showing the processing flow of the second embodiment. In step S41, the digitizer 12
The locus is input to the electronic pen 122 using the electronic pen 122, and the input coordinates are read. In step S42, the input trajectory is recognized. Since the execution of instructions is operating as a separate process,
In step S43, the priority order of the instruction corresponding to the recognition result is determined without making the execution start determination in step S33 of FIG. In step S44, the commands are classified together with the commands stored in the command storage area 35 based on the priority order. In step S45, the result classified in step S44 is stored in the instruction storage area 35. The instructions stored at this time are stored in descending order of priority. Then, the process returns to step S41 again, and the input of the locus is repeated.

On the other hand, in addition to the processing in steps S41 to S45, the processing in step S
46 to step S47 is executed, step S
At 46, it is determined whether an instruction exists in the instruction storage area 35. If it exists (YES in step S46),
It proceeds to step S47. If it does not exist (step S4)
No in step 6), step S46 is repeated. Step S4
In step 7, the command at the head of the command storage area 35 is fetched and executed. Then, when the instruction is executed, step S
Return to 46. The above processing is repeated until there are no instructions in the instruction storage area 35.

Next, a specific example of the processing flow of FIG. 11 will be described with reference to FIG. In FIG. 12, the trajectory of the electronic pen 122 is input and the trajectory is recognized (here, handwritten character recognition by the electronic pen 122).
FIG. 11 is a diagram showing a process of making a correction while inputting a trajectory by using a trajectory cancellation gesture 111 for canceling a drawn trajectory.

In step S42, the gesture is recognized. The recognition of the character drawn by the electronic pen 122 is performed by executing the command in step S47. Therefore, in the result storage of step S45, the command corresponding to the gesture or the locus drawn by the electronic pen 122 is stored in the command storage area 35. When the locus (character locus) stored in the command storage area is recognized by the CPU 123, the locus is converted into a character code.
The recognized locus is converted into a character based on the character code based on the data converted into the character code, and the converted character is displayed on the digitizer 121. Furthermore, the priority of the trajectory cancellation gesture 111 is set in consideration of the coordinates of the trajectory to be canceled, and the priority is set to be one lower than the trajectory to be canceled.

FIG. 12 shows a process of correcting "e" to "u" when "ai" is mistakenly input as "aie". In the figure, the locus indicating "A" has already been recognized and converted into "A" according to the character code. The loci indicating “I” and “E” are in a state of not being recognized. In this state, the trajectory cancel gesture 111 is input, a part of “e” is canceled, and the correct trajectory “u” 112 is input by the electronic pen 122. Since the trajectory cancel gesture 111 has a higher priority than the second stroke of the “u” 112, the input is executed after the second stroke of the “e” is canceled.

In the state displayed on the digitizer 122 in FIG. 12, recognition of the locus indicating "i" may have started, but it is being recognized and converted into "i" according to the character code. Not not. Therefore, after the recognition of "i" is completed, the trajectory cancel gesture 111 cancels the second stroke of "e". As a result, it is possible to correct a part of “e”, and the locus indicating the second stroke of “u” 112 is input by the electronic pen 122 to recognize the locus. Conventionally, when the trajectory cancellation gesture 111 is input, the result of recognizing the trajectory indicating “e” is corrected. In other words, the entire locus indicating "e" is canceled. As a result, the process of inputting a locus indicating "u" from the beginning and recognizing it again has to be performed, and the input efficiency is poor.

As described above, according to the second embodiment,
In a character recognition environment, a trajectory cancellation gesture 11
By setting the priority of 1 to a priority one level lower than the trajectory to be canceled, for example, the trajectory indicating the second stroke of “U” 112 can be input without canceling all the trajectory indicating “E”. it can. In this way, the user can freely set the priority order of the gestures, so that the desired operation can be performed without following the input order, and the input efficiency can be improved.

The present invention may be applied to a system including a plurality of devices or an apparatus including a single device. Further, it goes without saying that the present invention can be applied to the case where it is achieved by supplying a program to a system or an apparatus.

[0042]

As is apparent from the above explanation,
According to the present invention, it is possible to provide an information processing apparatus and a method thereof for improving efficiency of work in a work for inputting a locus and executing a process.

[Brief description of drawings]

FIG. 1 is a flowchart showing a conventional delay recognition processing flow.

FIG. 2 is a flowchart showing a processing flow when the conventional processing of FIG. 1 is realized by a multitask processing system.

FIG. 3 is a block diagram illustrating a configuration of an information processing device according to a first embodiment. .

FIG. 4 is a flowchart showing a processing flow of the first embodiment.

FIG. 5 is a diagram showing an example of an instruction corresponding to a recognition result stored in an instruction storage area 35 incorporated in the RAM 3 of the first embodiment.

FIG. 6 is a diagram showing the process of the flowchart of FIG. 4 of the first embodiment as a specific example in a window system environment.

FIG. 7 is a diagram showing the process of the flowchart of FIG. 4 of the first embodiment as a specific example in a window system environment.

FIG. 8 is a diagram showing the process of the flowchart of FIG. 4 of the first embodiment as a specific example in a window system environment.

FIG. 9 is a diagram showing the process of the flowchart of FIG. 4 of the first embodiment as a specific example in a window system environment.

FIG. 10 is a diagram showing the process of the flowchart of FIG. 4 of the first embodiment as a specific example in an environment for editing a character string.

FIG. 11 is a flowchart showing a processing flow of the second embodiment.

FIG. 12 is a diagram showing the process of the flowchart of FIG. 11 of the second embodiment as a concrete example in an environment for character recognition.

FIG. 13 is a functional block diagram showing functions of the information processing apparatus according to the first embodiment.

[Explanation of symbols]

 1 recognition unit 2 priority determination unit 3 storage unit 4 rearrangement unit 31 trajectory recognition program 32 priority determination program 33 instruction classification program 34 execution program 35 instruction storage area 121 liquid crystal display integrated digitizer 122 electronic pen 123 CPU 124 RAM 125 keyboard

Claims (10)

[Claims] 1. An information processing apparatus for performing processing based on trajectory information, the recognition means recognizing processing indicated by each of a plurality of types of trajectory information, and a plurality of types of processing recognized by the recognition means in advance. An information processing apparatus, comprising: an executing unit that executes each process according to a priority set. 2. The executing means includes a storage means for storing the process recognized by the recognizing means and its priority, and a changing means for changing the storage order of the process stored in the storage means according to the priority. The information processing apparatus according to claim 1, further comprising: a storage unit that executes processing in accordance with the storage order. 3. The information processing apparatus according to claim 1, wherein the processing is control of a window displayed on a display screen. 4. The information processing apparatus according to claim 1, wherein the processing is editing of a character string displayed on a display screen. 5. The information processing apparatus according to claim 3, wherein the control includes moving a window, deiconifying an iconified window, and deleting the window. 6. The information processing apparatus according to claim 4, wherein the editing includes changing a lowercase character to an uppercase character, inserting a character, and replacing a character. 7. An information processing apparatus for performing processing based on trajectory information, comprising a combination of determination means for determining whether an input trajectory is a stroke or a cancellation instruction, and strokes sequentially input. A recognition unit for recognizing a character, a detection unit for detecting a stroke at the input position of the locus when the input locus is a cancellation instruction, and a stroke detected by the detection unit is not used by the recognition unit. An information processing apparatus, comprising: 8. The control means gives a priority to execute a process next to the detected stroke, and the recognizing means recognizes a stroke immediately before the stroke when a cancel instruction is executed in the process of the process. The information processing apparatus according to claim 7, wherein the stroke is erased. 9. An information processing method for performing processing based on trajectory information, comprising: a recognition step of recognizing a plurality of types of trajectory information; and a plurality of types of processing recognized in the recognition step in advance. An information processing method, comprising: an execution step that is executed according to the priority set for each process. 10. An information processing method for performing processing based on trajectory information, comprising a combination of a determination step of determining whether an input trajectory is a stroke or a cancellation instruction, and strokes sequentially input. A recognition step of recognizing a character, a detection step of detecting a stroke at an input position of the trajectory when the input trajectory is a cancellation instruction, and a stroke detected in the detection step is not used in the recognition step. An information processing method, comprising: