JP3227219B2 - Information processing method and apparatus - Google Patents

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an information processing method and apparatus, and more particularly to an information processing method and apparatus capable of registering a user's own handwriting in a handwriting recognition dictionary.

[0002]

2. Description of the Related Art Conventionally, when it is desired to reflect a user's own handwriting input by a user who does not become a target recognition result by the original recognition means in the recognition means, the above-mentioned characteristic of the user's unique handwriting is stored in a user dictionary. Registration is performed by storing and storing, and character recognition processing is performed by using the user dictionary to obtain a desired recognition result. Therefore, even if the handwriting is the same, if the users are different users, the target recognition result may be different, and as a result, a plurality of user dictionaries are required for a plurality of users. For this reason, as shown in FIG. 25, when a certain user performs character recognition, an operation screen for executing a user dictionary switching unit in advance displays a list of user dictionary holders displayed in a list. A method has been adopted in which a user dictionary is selected by selecting a user to be used from among them, and a user dictionary of the specific user is set.

[0003]

However, in the above configuration, when a plurality of users who register a user dictionary use the same character recognition device alternately, even if each user has some other application. It is necessary to call the operation screen for executing the user dictionary switching means and switch the user dictionary even while performing the operation in, and it is very difficult to select the user dictionary when there are many user dictionary holders. It was a laborious task. Furthermore, it is very inconvenient when a plurality of users use the above at the same time.

[0004]

In order to solve the above-mentioned problems, the present invention sets a priority order for a plurality of user dictionaries for online character recognition stored in a storage means, and performs display for performing handwriting input. By detecting that the display direction of the screen has been switched, the change of the user is detected,
According to another aspect of the present invention, there is provided an information processing method and apparatus, wherein a priority order of the set plurality of user dictionaries for online character recognition is updated in response to detection of the change of the user. Preferably, further, when the characters input by handwriting are recognized using the plurality of user dictionaries for online character recognition, the order according to the priority order of the set plurality of user dictionaries for online character recognition is set. To output candidates.

[0005]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Preferred embodiments according to the present invention will be described below in detail with reference to the accompanying drawings.

FIG. 30 is a schematic configuration diagram showing the configuration of an information processing apparatus according to one embodiment of the present invention. In FIG. 1, reference numeral 1 denotes a CPU that controls the entire apparatus, and performs various processes according to a program stored in a ROM 2. Reference numeral 2 denotes a ROM that stores a control program, an error processing program, a program that operates according to a flowchart described later, and the like. Reference numeral 3 denotes a RAM used as a work area for various programs and a temporary save area for error processing. The RAM stores various databases such as a dictionary to be used for recognition described later, a user dictionary 106, a user name index file 107, a character type file 108, and a character standard stroke count database 109. Reference numeral 4 denotes a coordinate input unit including a transparent coordinate input plate (not shown) and a pen (not shown) for indicating a position of a coordinate point with respect to the coordinate input plate.
In detecting the position of the coordinate point, a method using electromagnetic induction or ultrasonic vibration is used. Reference numeral 5 denotes a memory having a one-to-one memory corresponding to coordinate points on a coordinate input plate (not shown). Bit information of coordinate points input on the coordinate input plate or bit information of dots calculated based on coordinate points described later. Is a VIDEO RAM (hereinafter, referred to as “VRAM”). Reference numeral 6 denotes a display unit for displaying a bit image based on the bit information stored in the VRAM 5. The display unit 6 uses an LCD. For example, a display method using an EL element or a CRT may be used. . This display section 6
Then, various windows described later are displayed.

FIG. 1 is a block diagram showing the configuration of a user registration application for realizing the present invention. 101-10
Each of the sections 7 is responsible for a function of user registration in online character recognition, and includes a window application execution section using a GUI (graphical user interface) and a dictionary section. A list of registered users is displayed on the initial screen section 101, and the owner of the currently set user dictionary can be confirmed. Other functions include both instruction functions for registering a new user and editing registered characters in the user dictionary. The new user registration unit 102 is a place where the registration of the new user is performed. The user dictionary editing unit 103 displays a list of characters in the user dictionary, and can instruct each character to delete or reproduce handwriting. It also includes an instruction function for newly registering a character by handwriting of the user. In the new character registration section of 104, the previous 1
This is the place where the character registration designated by 03 is performed. 10
The handwritten character reproducing section 5 is a place where the registered characters specified in the preceding step 103 are reproduced and drawn in the order of handwriting. The user dictionary unit 106 is a place where registered character information is stored in order to realize these functions. Here, a plurality of users each have different user dictionaries. The user dictionary switching unit 107 switches the user dictionary set in 101 based on the information from the pen input unit and the screen output unit processed by the user application.

FIG. 2 is a window state transition diagram of the user registration application. Parts 201 to 205 represent windows for executing the functions described above, and the system 206 is a place where control is returned when the user registration application is terminated. Arrows in the figure show the flow of control commands by button control in each window. Hereinafter, the flow and the transition of windows will be described.

When a "new user registration" command is designated on the initial screen section 201, a new user registration screen section 202 newly appears in the form of a pop-up window. When the “registration & end” command is instructed on the new user registration screen unit 202, the pop-up window is deleted, and the control returns to the new screen unit 201 again. When the "user dictionary editing" command is instructed on the initial screen unit 201, the new screen unit 201 is deleted, and a new user dictionary editing unit 203 appears. Here, when the "new character registration" command is instructed, a new character registration screen section 204 appears in the form of a pop-up window. The character registration operation in this window can be repeatedly executed unless an "end" command is instructed. After the characters are registered, when "end" is instructed, the new character registration screen unit 204 is erased, and the control moves to the user dictionary editing screen unit 203. The “delete character” command on the user dictionary editing screen unit 203 can be executed a plurality of times. Further, when the "handwriting reproduction" command is instructed, the handwritten character reproduction unit 205 appears in the form of a pop-up window. The reproduction starts as soon as the window is displayed, and can be repeatedly displayed by a “redisplay” command. The “end” command deletes the handwritten character reproduction section window and returns control to the user dictionary editing screen section. When an “end” command is instructed on the user dictionary editing screen unit 203, the own window is deleted and the initial screen 201 is displayed again. Therefore, the user registration application can be terminated only in the initial screen unit 201.
Only when the "end" command is instructed.

As described above, the number of windows related to the user registration application is displayed on the screen units 202 and 20.
When the pop-up windows 4 and 205 are displayed, the number is two, and when the window 201 or 203 is displayed, the number is one.

FIG. 26 is a block diagram showing the operation of the user dictionary switching unit of the user registration application. 2
Each of the units 601 to 2604 is a user dictionary switching unit 260
1 and the flow of information between related parts. Here, from the initial screen unit 2603 to the user dictionary switching unit 260
1, the owner and main user information of the currently selected user dictionary, and the user dictionary switching unit 26
From 01, the updated main user information is sent to the initial screen unit 2603. The user dictionary switching unit 260
The display unit state information is sent from the system 2604, which is the called party of 1. Reference numeral 2602 denotes an arbitrary application with a recognition operation performed by the user.
4 is the display information of the application or the system 2
Display state information is sent from the 604 to the application 2602.

Next, the details of the functions in each screen section and the flow of processing will be described with reference to FIG.

First, the flow of processing in the initial screen section is shown in FIG.
7 and the flowchart of FIG. In FIG. 17, reference numeral 1701 denotes a message display area; 1702, a user name list display and user dictionary owner display area;
Reference numeral 3 denotes a scroll bar for when the registered user cannot fit on one screen, and reference numerals 1704 to 1707 denote buttons which can be called by a pen tap.

When the user registration application is started, a window is created at 301. At this time, the registered user name is read from the user name index file 107 at 309. This user name index file 107 is a disk file having the structure shown in FIG. 23, and is a readable and writable file. The created window is as shown in FIG. At 302, the owner of the user dictionary set in the system is determined. When the owner is determined, a registration mark is added to the user who is the owner of the user dictionary in the 1701 user name display area for the dictionary of the selected owner determined in 303. At this time, a main user mark indicating that the user is a main user is particularly attached to a specific user registered as a user who is a main user. For example, in FIG. 17, two users, a user whose user name is "arai" and a user whose user user name is "uzuki", are registered as users. Of those users, the user whose user name is "arai" is a main user. It also has a main user mark to indicate that it is a user. When the processes up to this point are completed, a state (304) of waiting for a command instruction from the user is entered.

When a user name is directly selected with a pointing device such as a pen, the system requests the system to add an owner of a user dictionary at 308 and changes the setting. Similarly, if you select the check button part indicating that you are the main user directly with a pointing device such as a pen,
At 309, the system requests main user registration of the user dictionary 107 and changes the setting. For other button command operations, if the user designates the “user dictionary edit” button 1704 (306), control is transferred to the user dictionary edit routine, and if the “new user registration” button 1705 is designated (307) new user registration. When the control is transferred to the routine and the “cancel” button 1706 is instructed, the user dictionary setting change by the user name selection performed so far is invalidated, and the user dictionary setting is returned to the state before the application is started. If the "end" button of 1707 is instructed (305), this user registration application is ended, and control is returned to the system.

Next, the flow of processing in the new user registration screen will be described with reference to the flowcharts of FIGS. In FIG. 18, 1801 is a user name input area for inputting a user name, 1802 is a function button for canceling the input of the user name, and 1803 is a function button for registering the input user name and closing this window.

When a "new user registration" command of 1704 is designated on the previous initial screen section, a pop-up window shown in FIG. 18 is displayed (401). After that, it enters a state of waiting for a command instruction from the user. When an event signal due to pen-down is detected in the user name input area 1801 (404), the existing recognition routine is called. Using this, the character handwriting drawn in the user name input area is subjected to online character recognition processing, and character data is converted into a character code (407). If there is an instruction of the “register & end” button command in 1803, the user name converted and input in the user name input area is determined as a new user name, and additionally registered in the user name index file 107 in 409 (406). After that, the own window is deleted, and the control is returned to the initial screen again. On the other hand, if there is an instruction of the "cancel" button command of 1802, all the characters entered in the user name input area are deleted (408), and the apparatus enters a state of waiting for the user name input command instruction again.

Next, the flow of processing in the user dictionary editing unit will be described with reference to the flowcharts of FIGS. In FIG. 21, reference numeral 2101 denotes a message display area; 2102, a registered character list display area; 2103, a scroll bar capable of displaying a large number of registered characters;
Reference numeral 108 denotes a function call button with a pen tap.

When "edit user dictionary" of 1705 is instructed on the previous initial screen section, the designated user dictionary is first copied and stored separately (512). This is so that the dictionary editing operation can be canceled. Next, the user dictionary 106 is opened, and the character codes in the user dictionary are read into the buffer area (50).
2). Here, a character code correspondence table is created to make the characters in the user dictionary 106 correspond to the characters to be displayed on a one-to-one basis (601 in FIG. 6). For example, if the registered characters are six characters, the result is as shown in FIG. The meaning of creating this character code correspondence table is that if there is more than one dictionary character data with the same character code, editing of characters with the "delete" and "reproduce" commands will not This is because the search cannot be performed uniquely. The user dictionary editing screen shown in FIG. 21 is displayed based on the character code correspondence table (503). The character code read at this time is 210
1 in the registered character list display area (50
4). Thereafter, the process enters a state of waiting for a command instruction from the user (505). When a signal due to pen down or the like is detected in the registered character list display area, the character at the place where the pen is down is selected (506). The display number on the character code table is obtained from the position information of the selected character. The storage location of the dictionary character data actually stored in the user dictionary is determined from the display number, and the dictionary character data information to be edited is obtained. When the "character registration" button command of 2104 is designated (507), control is transferred to a new character registration routine (701 in FIG. 7). When the "letter delete" button command of 2105 is instructed (509), it is determined whether or not a character in the registered character list display area has been selected (801 in FIG. 8). Return to the state. If it has already been selected, the storage location of the dictionary data of the character to be deleted is searched using the above-mentioned character code correspondence table. When found, the dictionary character data stored in the actual user dictionary 106 is deleted (802).

When the contents of the user dictionary are changed, the character code correspondence table is also changed, and the character display in the registered character list display area is updated (504). When the "handwriting reproduction" button 2106 is instructed (509), if a character has been selected, control is transferred to the handwriting reproduction routine, and if not, a state of waiting for a character to be selected again is entered (901). ). When the "cancel" button command of 2107 is instructed (510), it is determined whether or not a character in the registered character list display area is selected (10 in FIG. 10).
01), if it is selected, the character is invalidated, and no character is selected on the display (1)
002) Return the contents of the registered dictionary to the state before the dictionary edit window was started (1003). With this operation, the editing work can be resumed again. An “end” button command 2108 deletes the user dictionary editing window and returns the control to the previous initial screen.

Next, the flow of processing in the new character registration unit will be described with reference to the flowcharts of FIGS. 19, 20, and 11. 1901 in FIG. 19 is a message display area, 1
902, a handwritten character input area, 1903, a printed character input area, 1904, an input code list area, 190
Reference numeral 5 denotes a scroll bar capable of displaying a plurality of character codes, and reference numerals 1906 to 1908 denote function call buttons by pen tap.

When "Character registration" of 2104 is instructed in the previous user dictionary editing unit, the skeleton of the screen shown in FIG. 19 is created and displayed in the form of a pop-up window (1101). Here, the character registration refers to an operation of assigning character data by a user's own handwriting to a corresponding character code. Therefore, a character input unit corresponding to the data input unit for acquiring the user's handwriting data is necessary. However, in FIG. 19, the “handwriting” column of 1902 is a handwriting data input unit, and the “print” column of 1903 is a character code input unit. Department. Reference numeral 1904 at the lower center of FIG. 19 is an input code list for inputting this character code.
A method of inputting by selecting a character from these is adopted. Therefore, the input code list must display the character types that can be registered, but this is because the character type file 10 in which the character types that can be registered are stored in advance.
8 may be created (1109). By reading this file, the character types that can be registered are displayed (1
102). When this display is completed, a command instruction from the user is waited (1103). When the user's pen-down input signal is detected in the "handwriting" field, the handwriting data is stored in the buffer area as a set of two-dimensional coordinate points (FIG. 12).
1201), and simultaneously draw in the “handwritten” column. FIG.
Shows a state in which the user has completed writing the handwritten pattern corresponding to “job” as in 1902. The corresponding character code is input by selecting a character from the input code list as described above, temporarily storing the character code in the buffer area, and acquiring the character code (1301 in FIG. 13). ). Each time the selected character is enlarged and displayed in the "type" field (1302).
When the “register” button command of 1906 is instructed, it is checked whether both the handwritten characters in the “handwritten” column and the characters in the “printed type” column have been input (1401). Start creation (140
3). The method of creating a recognition dictionary is performed by creating a standard pattern from character data, which utilizes a known technique. As a result, this standard pattern is newly created or added to the user dictionary 106 (1404). If the handwriting data and the character code are insufficiently input, a warning is issued (1402), and the process is repeated so that both the handwritten character data and the character code of the character to be registered are input. When the "cancel" button command of 1907 is instructed, the character data and character code entered in the "handwriting" and "print" fields are invalidated (1501 in FIG. 15),
Enable input again. FIG. 20 shows a state in which the character of "job" is selected and input from the character code list. 1908
The "end" button command deletes the new character registration window and returns control to the user dictionary editing unit.

Next, the flow of processing in the handwritten character reproducing section will be described with reference to the flowcharts of FIGS.
Reference numeral 2201 in FIG. 22 denotes a handwritten character reproduction area 2202
Denotes a printable character display area for handwritten characters, 2203 denotes a handwritten character count display area, 2204 denotes a standard print count display area for target prints, and 2205 and 2206 denote function tap buttons by petap.

When "reproduce handwriting" of 2106 is instructed in the previous user dictionary editing unit, the skeleton of the screen shown in FIG. 22 is created and displayed in the form of a pop-up window (1602). Since it is confirmed that the character code has been selected in the user dictionary editing unit, first, the character is displayed in the print area in an enlarged font (1603). The number of strokes of the character is displayed together with the font display (1603).
However, this is performed by preparing a character standard stroke count database 109 (1607) in which the standard stroke count is described for each character, and searching for the corresponding character. To reproduce the character data in the user dictionary 106, first, the data in the dictionary corresponding to the selected character must be uniquely extracted.
This is possible if the above-described character code correspondence table is used. The dictionary data of the corresponding character contains coordinate points,
In addition, since pen down and pen up information is added to this, it is possible to determine to which number of strokes the handwriting (called a stroke) the coordinate point belongs to. Using this, the handwriting is drawn by sequentially connecting the coordinate points within the same stroke with a straight line (1604). Also, the number of pen-downs is counted to obtain the number of handwriting data strokes, which is displayed (16).
05). The operation of the button command (1606) is 2205
If it is "redisplay" of, delete the reproduced drawing data,
Start handwriting reproduction again using the data in the dictionary. 220
If the "end" of step 6 is instructed, the handwritten character reproduction window is deleted, and the control is returned to the registered character editing unit. FIG. 22 is a diagram in which the character "A" is selected and the character handwriting is reproduced halfway.

Finally, the flow of processing in the user dictionary switching section will be described with reference to the flowcharts of FIGS. 26 and 27. The application 2602 in FIG. 26 is an arbitrary application. Here, the “loan calculation application” by handwriting input shown in FIGS. 28 and 29 is used.
And A system 2604 controls the user dictionary registration application according to the present invention and the above-mentioned application 2602. In this system, there is a specification that when the screen inversion button 2803 in FIG. 28 is pressed, the upper and lower sides of the display screen portion 2802 are inverted by 180 degrees and switched to an inverted display mask 2901 as shown in FIG. This function is very convenient when a plurality of users facing each other perform input alternately in an application that assumes a presentation with many handwritten input items as shown in FIGS. 28 and 29. It is used in many machines. Now, it is assumed that the registered contents of the user registration application on the application screen in FIG. 28 are as shown in FIG. That is, of the registered user dictionaries, the user having the user name “arai” and the user name “uz” are registered.
The user dictionary of the user “uki” is selected, and the user of the user name “arai” is selected as the main user, and therefore, in the initial use state of FIG. Is used in priority, and as a result, very similar stroke information is stored in the user registration application in the user names “arai” and “uzu”.
ki ", the main user" ar "is registered in the two user dictionaries as different type data.
The registered content registered as “ai” can be displayed as an early candidate, and a comfortable operation can be expected. At this point, the description on the display screen portion 2802 proceeds, and the user facing the meeting, here, the user name “uzuki” is obtained. When the scene described by the user comes, it is assumed that the system 2604 switches the display screen to the reverse display screen 2901 by pressing the screen reverse button 2803. As a result, the system 2604 is shown in FIG. First, the system 260 is started in 2701.
4 is read, and subsequently, the owner information and the main user information of the user dictionary selected from the initial screen unit 2603 are called (270).
2 and 2703). Next, the main user information is replaced based on the user dictionary information obtained in 2702 and 2703. Finally, in 2706, the initial screen unit 26
The updated main user dictionary information is sent to 03, and the processing of the user dictionary switching unit ends. As a result, FIG.
In the state, the user having the user name "uzuki" is registered in the main user and the user registration application.

As described above, according to the present embodiment, when the system notifies the user of the change of the user who performs the clear handwriting recognition, that is, the display screen inversion, the registered information which has been assigned a priority in advance is registered. The user dictionary of the main user among the plurality of users is automatically switched, and a comfortable handwriting input environment is provided continuously.

The window creation method, signal detection method, and display screen inversion method described in the text are reproduced by using a known technique. In addition, although the pen is taken as a pointing device, it is clear that selection and writing can be performed by operation with a mouse.

An example in which the number of selected user dictionaries is two and the registration of the main user is changed in accordance with two patterns of normal display and reverse display on the display screen to automatically switch the user dictionaries. As described above, more user dictionaries are registered at the same time, and more screen display directions corresponding to the user dictionaries are made to correspond in the internal storage table. By switching the screen display directions, the corresponding user dictionaries are simultaneously set as the main user dictionary. By resetting, it is possible to use a recognition dictionary for user registration that can cope with more complicated switching between users.

Although an example has been described in which the user to be recognized is changed by changing the display direction of the screen, a means for detecting the change of another user instead of the change of the display direction, for example, a plurality of stylus pens is used. By using means for detecting using a pen device, such as a means for providing a device with an identifiable individual ID and making it correspond to a plurality of users, it is possible to detect the replacement of more users. It can be possible.

[Brief description of the drawings]

FIG. 1 is a block diagram of a configuration of a user registration application.

FIG. 2 is a state transition diagram of a user registration application window.

FIG. 3 is a flowchart of processing of an initial screen unit.

FIG. 4 is a flowchart of processing of a new user registration screen unit.

FIG. 5 is a flowchart (1) of processing of a user dictionary editing unit;

FIG. 6 is a flowchart (2) of processing of a user dictionary editing unit;

FIG. 7 is a flowchart (3) of processing of a user dictionary editing unit;

FIG. 8 is a flowchart (4) of a process performed by the user dictionary editing unit;

FIG. 9 is a flowchart (5) of a process performed by the user dictionary editing unit;

FIG. 10 is a flowchart (6) of processing of a user dictionary editing unit;

FIG. 11 is a flowchart (1) of processing of a new character registration unit;

FIG. 12 is a flowchart (2) of processing of a new character registration unit;

FIG. 13 is a flowchart (3) of processing of a new character registration unit.

FIG. 14 is a flowchart (4) of processing of a new character registration unit;

FIG. 15 is a flowchart (5) of processing of a new character registration unit;

FIG. 16 is a flowchart of processing of a handwritten character reproduction unit.

FIG. 17: Initial screen window

FIG. 18: New user registration screen window

FIG. 19 is a new character registration screen window (1).

FIG. 20: New character registration screen window (2)

FIG. 21 is a user dictionary editing screen window

FIG. 22: Handwritten character reproduction screen window

FIG. 23: User name index file

FIG. 24: Character code correspondence table

FIG. 25.

FIG. 26 is a block diagram of a user dictionary switching unit.

FIG. 27 is a flowchart of processing of a user dictionary switching unit.

FIG. 28 is a window (1) of a user dictionary switching unit.

FIG. 29 is a window (2) of a user dictionary switching unit.

FIG. 30 is a configuration block diagram of an information processing apparatus according to the present embodiment.

──────────────────────────────────────────────────続 き Continuing on the front page (72) Takashi Harada, Inventor 3-30-2 Shimomaruko, Ota-ku, Tokyo Canon Inc. (72) Inventor Kazuhiro Matsubayashi 3-30-2 Shimomaruko, Ota-ku, Tokyo Canon (72) Inventor Katsuhiko Sakaguchi 3-30-2 Shimomaruko, Ota-ku, Tokyo Inside Canon Inc. (72) Inventor Hiroto Yoshii 3-30-2 Shimomaruko, Ota-ku, Tokyo Inside Canon Inc. ( 56) References JP-A-62-196774 (JP, A) JP-A-1-145789 (JP, A) JP-A-2-89112 (JP, A) JP-A-59-165182 (JP, A) (58) ) Surveyed field (Int.Cl. ⁷ , DB name) G06K 9/62-9/68 G06F 3/03 380 G06F 17/22 506

Claims (4)

(57) [Claims] 1. A method of setting a priority order for a plurality of user dictionaries for online character recognition stored in a storage unit, and detecting that a display direction of a display screen for performing handwriting input has been switched, thereby using the dictionary. An information processing method comprising: detecting a change of a user; and updating a priority order of the set plurality of user dictionaries for online character recognition according to the detection of the change of the user. 2. The method according to claim 1, further comprising the step of: recognizing the characters input by handwriting using the plurality of user dictionaries for online character recognition. 2. The information processing method according to claim 1, wherein candidates are output in order. 3. A setting means for setting priorities of a plurality of user dictionaries for online character recognition stored in a storage means, and detecting that a display direction of a display screen for performing handwriting input has been switched. Detecting means for detecting a change of the user, and updating the priority order of the plurality of set user dictionaries for online character recognition according to the detection of the change of the user. Processing equipment. 4. When the characters input by handwriting are recognized by using the plurality of user dictionaries for online character recognition, the character set is determined according to the set priority order of the plurality of user dictionaries for online character recognition. 4. The apparatus according to claim 3, further comprising character recognition means for outputting candidates in order.
An information processing apparatus according to claim 1.