JP2003099713A - Device, method, and program for processing hand-written information, recording medium having the program recorded therein, and electronic blackboard - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a hand-written information processing device capable of displaying reshaped characters in correspondence to the sizes and positions of inputted hand-written characters, allowing easy and interesting editing operation of the reshaped characters, allowing efficient inputting of hand-written characters and editing operation, allowing easy learning of operation, and having a user interface, a method and a program for processing hand-written information, a recording medium having the program recorded therein, and an electric blackboard. SOLUTION: This hand-written information processing device 1 performs document recognition processing based on hand-written characters 121 to 123 inputted into an input frame 26 and selects characteristic codes corresponding to the hand-written characters, and performs a character reshaping processing for adjusting character size based on the sizes of the inputted hand-written characters 121 to 123 for the code characters allocated to the selected character codes, and displays the reshaped characters 101 to 103 as reshaped characters 101 to 103 on a display screen 4.

Description

Detailed Description of the Invention

[0001]

TECHNICAL FIELD The present invention relates to a tablet pen,
A handwriting information processing device, a handwriting information processing method, a handwriting information processing program, which performs character recognition processing / character shaping processing of a handwritten character input in an information input frame by a mouse, a touch panel, etc., and displays the shaped character on a display screen. The present invention relates to a recording medium on which a program is recorded and an electronic blackboard.

[0002]

2. Description of the Related Art In recent years, handwritten character input has been frequently used for character input. In the handwritten character input, unlike the keyboard input, when the character input is performed by writing a character with a pen in a predetermined input frame, the input handwritten character is recognized and converted into a character. Specifically, the code character closest to the shape of the handwritten character (previously JIS, ASC
The character assigned to the character code based on the standard such as II) is selected, and this code character is displayed on the display screen. For handwriting input, an input means such as a tablet pen, a mouse, a touch panel, etc. is used.

This handwritten character input is very convenient because it does not require skill like conventional keyboard input and allows easy character input, and recently, handwritten character input has been performed on various devices such as portable information terminals. The input method is adopted.

For example, Japanese Unexamined Patent Publication No. 09-319503 discloses a document inputting method or a document editing method in which a writing character string inputting method and a recognition character string inputting method are used together or mixed, by a simple operation. Has been done. JP 2000-
The one disclosed in Japanese Patent No. 076380 is for freely inputting handwritten characters in any input direction without being conscious of setting of an input frame or a document format when inputting characters by handwriting on a touch panel. It is disclosed. JP 200
In the 0-099223 publication, a user can display a plurality of character candidates and edit commands that can be executed, for example, in the same pop-up menu by simply designating a character candidate in which a handwritten character is erroneously recognized. There is disclosed a data processing device having a handwritten character input interface which is easy to operate when a handwritten character is erroneously recognized and has high work efficiency by making the selection. Japanese Patent Laid-Open No. 2001-
Japanese Laid-Open Patent Publication No. 014103 discloses a character input device capable of efficiently inputting characters by switching various input functions according to the input purpose.

This handwritten character input is roughly divided into 1
There are two methods: a method in which a character-by-character input frame is provided and one character is handwritten in the input frame to input characters, and a method in which a plurality of handwritten characters can be input in the input frame. . In the former case, the character recognition means does not need to perform character segmentation for each character in character recognition, but the input person needs to input each character in each input frame. For example, Japanese Patent Laid-Open Nos. 2000-099223 and 200
The method disclosed in JP-A-1-014103 is based on this method. On the other hand, the latter is easy to operate in that the user can continuously input characters as if he or she would normally write characters on the paper with a pen, without being aware of the frame. . For example, JP 2000-
The method disclosed in Japanese Patent Application No. 076380 and Japanese Patent Application Laid-Open No. 09-319503 is based on this method.

Recently, Japanese Patent Laid-Open No. 2000-0434 has been used.
As disclosed in Japanese Patent Publication No. 85, an application of this handwriting input to an electronic blackboard used for meetings and the like has been devised. According to the one disclosed in Japanese Patent Application Laid-Open No. 2000-043485, when handwriting input is performed on the touch surface of the electronic blackboard, the input handwritten character is character-recognized, is printed, and is displayed on the touch surface. For example, when recording an agenda or minutes on an electronic blackboard at a meeting or the like, even if the handwriting is messy, it is convenient because the handwritten characters are printed and an orderly minutes can be obtained. is there.

[0007]

However, the above-mentioned JP-A-09-319503 and JP-A-2000-07 are known.
6380, Japanese Patent Application Laid-Open No. 2000-099223,
Also, in all of those disclosed in Japanese Patent Laid-Open No. 2001-014103, character recognition / typing is performed using only the information on the shape of the input handwritten character, and the position information and size of the character input by handwriting are used. Information is not used.
Therefore, even if the user inputs the handwritten character at any size and at any position, the code character is displayed only at the predetermined character position and character size. There is.

For example, when creating a document such as minutes, it is desired to display items to be emphasized or important items in large characters. In addition, there is a case where a part of the blank is left blank and additional writing is desired later.

[0009] However, according to the conventional handwriting input, it is not possible to perform emphasis by changing the character size, additional writing to a blank portion, etc. when the handwriting input is printed, and after the printing is made. , It is necessary to change the character size by selecting a character to be emphasized or to add a character after inputting a space at a desired position to add a character, which is not convenient.

Such an operation imposes a heavy load on the user, and it is preferable that the number of operations is as small as possible.
Therefore, it is desirable to provide a handwriting input with an excellent user interface, which can reflect the user's intention when inputting handwritten characters as it is and display the characters to be emphasized at the time of inputting handwritten characters in a large size or provide a blank portion. It is rare.

Further, in inputting handwritten characters, due to the nature that the user can freely write in the input frame, the handwritten characters are correctly converted into code characters intended by the user due to the character input habits of the user. It is difficult to set the accuracy, that is, the character recognition rate to 100%. Therefore, it is necessary to edit the code characters displayed after input, but this editing operation also burdens the user.
It is preferable that various operations can be performed by simple operations as much as possible.
If the editing operation is easy to grasp intuitively, or if it is an interesting and interesting operation, even if there are various kinds of editing operations, it will be easy to learn and easily accepted by the user. The appeal is high even if the operation is surprising or interesting.

[0012] Especially during meetings where time is limited,
It is necessary to summarize the minutes of various important items that are proposed with the progress of the meeting in an easy-to-understand manner for many members who participate in the meeting. Therefore, on the electronic blackboard used for the meeting, the items are highlighted, added, and edited. Etc. should be able to be done by a user-friendly user interface.

The present invention has been made in view of the above circumstances, and it is possible to display a shaped character corresponding to the size and position of an input handwritten character, and it is easy and interesting to edit the shaped character. There is a handwriting information processing device, a handwriting information processing method, a handwriting information processing program, and a program therefor that can efficiently input and edit handwritten characters and has a user interface that is easy to learn and easy to use. It is an object to provide a recording medium in which is recorded and an electronic blackboard.

[0014]

In order to solve the above-mentioned problems, the handwritten information processing apparatus according to claim 1 of the present application,
Character recognition processing is performed based on the handwritten characters input in the information input frame, the character code corresponding to the handwritten character is selected, and the code character assigned to the character code is selected based on the input state of the handwritten character. Character shaping processing is performed, and the shaped characters obtained by the character shaping processing are displayed on the display screen.

The handwritten information processing apparatus according to claim 2 is
The handwritten information processing apparatus according to claim 1, wherein the code character is subjected to character shaping processing for adjusting the character size based on the size of the input handwritten character, and the shaped character obtained by the character shaping processing is shaped. Characterized by displaying characters on a display screen.

The handwritten information processing apparatus according to claim 3 is
The handwritten information processing apparatus according to claim 1 or 2, wherein the character size of the shaped character is at the position of the highest point and the lowest point of the first handwritten character among the handwritten characters, or the leftmost of the first handwritten character. It is characterized in that it is adjusted based on the positions of the point and the rightmost point.

The handwritten information processing apparatus according to claim 4 is
The handwritten information processing apparatus according to any one of claims 1 to 3, wherein the character size of the shaped character is substantially the same as the size of the handwritten character.

The handwritten information processing apparatus according to claim 5 is
The handwritten information processing apparatus according to any one of claims 1 to 4, wherein the display position of the shaped character is adjusted and displayed on the display screen based on the input position of the input handwritten character. Is characterized by.

A handwritten information processing apparatus according to claim 6 is
In the handwritten information processing apparatus according to claim 5, the display position of the shaped character is substantially the same position corresponding to the input position of the handwritten character.

A handwritten information processing apparatus according to claim 7 is
The handwriting information processing apparatus according to any one of claims 1 to 6, when an edit process is performed on a shaped character, an edit panel indicating the contents of the edit process is displayed on a display screen. It is characterized by

The handwritten information processing apparatus according to claim 8 is
The handwriting information processing apparatus according to claim 7, wherein the edit panel is provided with edit buttons corresponding to a process of deleting a well-formed character, a process of inserting a blank space, and a process of replacing a well-formed character with another well-formed character. It is characterized by

The handwritten information processing apparatus according to claim 9 is
In the handwriting information processing device according to any one of claims 1 to 6, when an edit operation input for performing edit processing on a shaped character is performed in the information input frame, the edit operation input indicates It is characterized in that the editing process is performed on the formatted characters corresponding to the input operation.

A handwritten information processing apparatus according to a tenth aspect is the handwritten information processing apparatus according to the ninth aspect, in which the operation speed of the input operation is higher than a predetermined speed and the operation speed of the input operation is equal to or lower than a predetermined speed. In some cases, different editing processing is performed on the shaped characters.

The handwritten information processing apparatus according to claim 11 is the handwritten information processing apparatus according to claim 10,
When the operation speed of the input operation is higher than a predetermined speed, the shaped characters are aligned with the display screen edge corresponding to the operation direction of the input operation.

A handwritten information processing apparatus according to a twelfth aspect is the handwritten information processing apparatus according to any one of the ninth to eleventh aspects, wherein the number of repetitive input operations is greater than a predetermined number. It is characterized in that different editing processes are performed on the shaped characters when the number of times of repeating the input operation is less than or equal to a predetermined number.

The handwritten information processing apparatus according to claim 13 is the handwritten information processing apparatus according to claim 12,
When the number of times of repeating the input operation is more than a predetermined number of times, the process of translating the formatted character is performed.

A handwritten information processing apparatus according to a fourteenth aspect is the handwritten information processing apparatus according to any one of the first to sixth aspects, for performing an editing process on a shaped character in an information input frame. When the edit operation input is performed, the featured character edit processing is performed corresponding to the input shape indicated by the edit operation input.

The handwritten information processing apparatus according to claim 15 is the handwritten information processing apparatus according to claim 14,
14. The handwriting information processing apparatus according to claim 13, wherein the handwriting information processing device performs an editing process of deleting a crossed shaped character corresponding to an input shape that crosses the shaped character from left to right.

The handwritten information processing apparatus according to claim 16 is the handwritten information processing apparatus according to claim 14 or 15, wherein the shaped character is enclosed in a shape corresponding to an input shape that encloses a shaped character in a substantially circular shape. It is characterized by performing an editing process for changing the character color of a character.

A handwritten information processing apparatus according to a seventeenth aspect is the handwritten information processing apparatus according to any one of the first to sixteenth aspects, immediately before a handwritten character is not input for a predetermined time. Character input processing and character shaping processing are collectively performed for each character line block, including the input of the handwritten character set as above.

The handwritten information processing apparatus according to claim 18 is the handwritten information processing apparatus according to claim 17,
When the character line block area is set on the display screen so as to surround the character line block for each character line block, and the character line block area is selected, the editing process for each character is performed on the formatted character. A one-character editing pointer that is set for each well-formed character to be performed, and a character-line block editing pointer that is set for each character-line block to perform editing processing on the character-line block are displayed on the display screen. It is characterized by

The handwritten information processing apparatus according to claim 19 is the handwritten information processing apparatus according to claim 18,
When multiple character line blocks are displayed on the display screen and one character line block is moved to another character line block area, the character attributes of the formatted characters in one character block and the other character block It is characterized in that it is associated with the character attribute of the well-formed character in.

In the handwritten information processing method according to claim 20, character recognition processing is performed based on the handwritten character input in the information input frame, a character code corresponding to the handwritten character is selected, and the character code is assigned to the character code. It is characterized in that the character shaping process is performed on the code character that is being generated based on the input state of the handwritten character, and the shaped character obtained by the character shaping process is displayed on the display screen.

The handwritten information processing method according to claim 21 is the same as the handwritten information processing method according to claim 20,
It is characterized in that a character shaping process for adjusting a character size is performed on a code character based on the size of an input handwritten character, and the shaped character obtained by the character shaping process is displayed on a display screen.

A handwritten information processing method according to a twenty-second aspect is the handwritten information processing method according to the twentieth or twenty-first aspect, wherein the display position of the shaped character is adjusted based on the input position of the input handwritten character. And is displayed on the display screen.

A handwritten information processing method according to a twenty-third aspect is the handwritten information processing method according to any one of the twentieth to twenty-second aspects, in which the editing processing is performed on the shaped characters. It is characterized in that an edit panel showing the contents of processing is displayed on the display screen.

A handwritten information processing method according to a twenty-fourth aspect is the handwritten information processing method according to any one of the twentieth to thirty-third aspects, which is for performing editing processing on the shaped characters in the information input frame. It is characterized in that, when an edit operation input is performed, an edit process is performed on a shaped character corresponding to an input operation indicated by the edit operation input.

A handwritten information processing method according to a twenty-fifth aspect of the present invention is the handwritten information processing method according to any one of the twentieth to twenty-fourth aspects, which is for performing editing processing on a shaped character in an information input frame. When the edit operation input is performed, the featured character edit processing is performed corresponding to the input shape indicated by the edit operation input.

The handwritten information processing method according to claim 26 is the handwritten information processing method according to any one of claims 20 to 25, which is immediately before the handwriting character is not input for a predetermined time. Character input processing and character shaping processing are collectively performed for each character line block, including the input of the handwritten character set as above.

A handwriting information processing program according to claim 27 is a character recognition process for performing a character recognition process on a computer based on a handwritten character input to an information input frame and selecting a character code corresponding to the handwritten character. On the display screen, the procedure, the character shaping procedure that performs the character shaping processing based on the input state of the handwritten character for the code character assigned to the selected character code, and the shaped character obtained by the character shaping processing. It is characterized in that the display procedure displayed in (1) is executed.

A computer-readable recording medium according to claim 28 is a character for causing a computer to perform character recognition processing based on a handwritten character input in an information input frame and select a character code corresponding to the handwritten character. The recognition processing procedure, the character shaping processing procedure that performs character shaping processing based on the input state of handwritten characters for the code characters assigned to the selected character code, and the shaped characters obtained by the character shaping processing are displayed. It is characterized in that a handwritten information processing program for executing the display procedure displayed on the screen is recorded.

In the electronic blackboard according to claim 29, character recognition processing is performed based on the handwritten character input in the information input frame, the character code corresponding to the handwritten character is selected, and the character code is assigned to the character code. The present invention is characterized by including a handwriting information processing device that performs a character shaping process on a code character based on an input state of the handwritten character and displays the shaped character obtained by the character shaping process on a display screen.

The electronic blackboard according to claim 30 is the same as that according to claim 2.
In the electronic blackboard according to 9, the character shaping process for adjusting the character size is performed on the code character based on the size of the input handwritten character, and the shaped character obtained by the character shaping process is displayed on the shaped character display screen. It is characterized by being displayed above.

According to the inventions according to claims 1, 20, 27, 28 and 29, the character shaping process is performed based on the input state of the handwritten character, and the shaped character obtained by the character shaping process is displayed on the display screen. Therefore, it is possible to display well-formed characters that reflect the state of handwriting input with ease of use. Since the input state of the handwritten characters is reflected in the well-formed characters, there is almost no need to edit and adjust the well-formed characters later, and the handwritten characters can be efficiently input, providing a user-friendly user interface. can do.

According to the inventions according to claims 2, 21, and 30, the character size of the shaping character is adjusted and displayed based on the size of the input handwritten character, so that the shaping of various sizes is convenient. Characters can be displayed.
For example, if the characters to be emphasized are handwritten in large size, they will be displayed in large size.Therefore, it is almost unnecessary to edit and adjust the size of the shaped characters after they are displayed. it can.

According to the third aspect of the invention, the character size of the shaped character is at the positions of the highest point and the lowest point of the first handwritten character among the handwritten characters, or the leftmost point and the lowest point of the first handwritten character. Since the adjustment is performed based on the position of the right point, it is possible to easily grasp the size of the shaped character displayed during handwriting.

According to the fourth aspect of the present invention, the size of the shaped character is substantially the same as the size of the handwritten character. Therefore, the handwritten character only needs to be input in the size at which the shaped character is desired to be displayed, which is convenient. There is almost no need to edit and adjust the size of the well-formed character after it is displayed.

According to the inventions of claims 5 and 22, the display position of the shaped character is adjusted and displayed on the display screen based on the input position of the input handwritten character. You can display well-formed characters in. It is almost unnecessary to adjust the display position of the well-formed character after the well-formed character is displayed, and the handwritten character can be efficiently input.

According to the invention of claim 6, the display position of the shaped character is substantially the same position corresponding to the input position of the handwritten character. Therefore, it is sufficient to input the handwritten character at the position where the shaped character is desired to be displayed. , Easy to use. It is hardly necessary to adjust the display position of the well-formed character after the well-formed character is displayed.

According to the inventions of claims 7 and 23, when the editing processing is performed on the shaped characters, the editing panel showing the contents of the editing processing is displayed on the display screen. Will be easier. In addition to being able to perform editing operations efficiently, learning the operations is easy and convenient.

According to the eighth aspect of the present invention, it is possible to easily perform the processing of deleting the shaped character, inserting the blank, and replacing it with another candidate character.

According to the ninth and twenty-fourth aspects of the present invention, since the editing process for the shaped characters is performed corresponding to the input operation indicated by the editing operation input entered in the information input frame, the editing operation is easy and interesting. , The editing operation can be performed efficiently, and the operation can be easily learned. Therefore, the user interface can be easily used.

According to the invention of claim 10, different editing processing can be performed only by speeding up or slowing down the input operation. Therefore, the editing operation is easy and interesting, the editing operation can be efficiently performed, and the operation is easily learned.

According to the eleventh aspect of the present invention, the shaped characters can be easily aligned by a simple editing operation that speeds up the input operation.

According to the twelfth aspect of the present invention, different editing processing can be performed only by increasing the number of repetitive input operations to a predetermined number or less than the predetermined number. Therefore, the editing operation is easy and interesting, the editing operation can be efficiently performed, and the operation is easily learned.

According to the thirteenth aspect of the present invention, the formatted characters can be translated by a simple editing operation in which the operation is repeated more than a predetermined number of times.

According to the fourteenth and twenty-fifth aspects of the present invention, the editing operation of the shaped characters is performed corresponding to the input shape indicated by the editing operation input entered in the information input frame, so that the editing operation is easy and interesting. , The editing operation can be performed efficiently, and the operation can be easily learned. Therefore, the user interface can be easily used.

According to the fifteenth aspect of the present invention, it is possible to perform the editing process for deleting the formatted characters by a simple editing operation input.

According to the sixteenth aspect of the present invention, it is possible to perform the editing process of changing the character color of the shaped character by a simple editing operation input.

According to the seventeenth and twenty-sixth aspects, since the character recognition processing and the character shaping processing are collectively performed when handwritten characters are not input for a predetermined time, the user does not feel uncomfortable or burdened. It is possible to perform character recognition processing and character shaping processing. Therefore, the user interface can be easily used.

Further, since the shaped characters corresponding to a series of handwritten characters continuously handwritten are grasped as one character line block, the editing process for the entire character line block becomes easy.

According to the eighteenth aspect of the invention, the editing process for each character and the editing process for the character line block can be easily performed.

According to the nineteenth aspect of the present invention, the character attribute of a shaped character in one character block can be associated with the character attribute of a shaped character in another character block by a simple editing operation.

[0064]

BEST MODE FOR CARRYING OUT THE INVENTION <Structure of Handwriting Information Processing Device> An embodiment of the present invention will be described below with reference to the drawings.
FIG. 1 shows a handwriting information processing device 1 according to the embodiment of the present invention. The handwritten information processing apparatus 1 performs character recognition processing / character shaping processing of an input handwritten character to display the generated shaped character, and edits the shaped character based on a handwriting editing operation input. In general, the electronic blackboard 2 and the computer 3 are configured.

Here, the character recognition is based on a character shape input by handwriting, and from a character code conforming to the standard such as JIS / ASCII, a code character (character code is determined to be the closest to the shape of a handwritten character. This is the process of selecting the corresponding character), but the details are omitted because it is known.
In addition, the character shaping process is a process for adjusting the character size of the displayed well-formed character based on the information on the size of the handwritten input character, and a process for adjusting the well-formed character based on the position information of the handwritten input character. The processing for adjusting the display position, or both of them, will be described in detail later.

The electronic blackboard 2 has a data input / output interface 5, and is connected to the computer 3 by the data input / output interface. A display screen 4 is provided on the front surface of the electronic blackboard 2. The display screen 4 has a function of displaying processing information and data sent from the computer 3 via the data input / output interface. As the display screen, a CRT display, a liquid crystal display, a plasma display or the like is used.

The display screen 4 is of a touch panel type and, as disclosed in Japanese Patent Laid-Open No. 2000-105671, handwriting is performed by detecting the light shielding position of the laser emitted from both ends of the screen along the surface of the display screen 4. It also has a function as a handwritten information input means capable of detecting the input position of information. Since the input position of handwritten information is detected by the light shield of the laser, it is enough to touch the screen lightly when inputting, and the user's finger or various pen-shaped members (input pen)
Can be input using, and the input handwritten information can also be displayed on the screen.

In addition to the above, as a handwriting information input means configured to input handwriting information on the display screen, a touch panel having a film-shaped piezoelectric sensor, an electrostatic sensor or the like formed on the display screen may be used. Good. Further, the display screen and the handwritten information input means may be separate configurations, such as a configuration using a mouse connected to a computer and a configuration using a tablet and an electronic pen. In addition, the screen is projected and displayed on a whiteboard or a screen, and the
Inc. The handwriting information may be input by using a known input means such as Mimio manufactured by Mfg. Co., Ltd. and eBeam manufactured by EFI.

As shown in FIG. 2, the computer 3 has a data input / output interface 6 for inputting / outputting data to / from the electronic blackboard 2, and has a signal processing means 7 and a hard disk 8 as a storage means therein. .

A handwriting information processing program 9 is provided in the hard disk 8. The handwriting information processing program 9 is for causing the computer 3 to execute the character recognition processing procedure and the character shaping processing procedure, and performs the character recognition processing and the character shaping processing of the handwritten character input to the display screen 4. The generated well-formed characters are displayed on the display screen 4, or an edit operation is performed on the well-formed characters based on an edit operation input performed on the display screen 4.

When the handwriting information processing program 9 is activated, a screen display as shown in FIG. 3 is displayed on the display screen 4. On the display screen 4, reference numeral 26 is an input frame (information input frame), and handwritten character input or handwriting editing operation input can be performed on the input frame 26.

At the top of the display screen 4, a recognition button 27,
Clear button 28, refresh button 29, uniform button 30, padding button 31, line width slider 32, mode selection slider 33, recognition result display frame 34, change button 3
5, a kanji conversion button 36, a save button 37, and an end button 38 are displayed.

The recognition button 27 is a button for immediately starting the character recognition process. The clear button 28 is for deleting all the display in the input frame 26 and for initializing the contents of the coordinate value memory 10, the recognition result memory 11, and the character line block area memory 13 which will be described later. The refresh button 29 is for temporarily erasing the display on the display screen 4 and re-displaying it, and is mainly used for recovering the inconvenience when the screen display is inconvenient.

The uniform button 30 is for displaying the character spacing of the shaped characters displayed in the input frame 26 by the uniform allocation. The padding button 31 is for displaying the character spacing of the shaped characters displayed in the input frame 26 at a predetermined spacing.

The line width slider 32 is for changing the thickness of the line when inputting by handwriting. The mode selection slider 33 is for selecting a mode in which the character recognition process is preferentially recognized among the character types such as hiragana, katakana, and English characters.

The recognition result display frame 34 is a display frame for displaying the code character selected as a result of the character recognition processing. The change button 35 is for changing the code character displayed in the recognition result display frame 34, and when the character recognition processing based on the handwritten character is difficult, the change button 35 is used to input using a keyboard or the like (not shown). To be used when The Kanji conversion button 36 is for converting the code characters displayed in the recognition result display frame 34 into Kanji characters.

The save button 37 is for saving the formatted characters displayed in the input frame 26 as text data or HTML data. Finish button 38
Is for ending this handwriting information processing program.

In the hard disk 8 of the computer 3, the coordinate value memory 10, the recognition result memory 11, the character editing memory 12, the character line block area memory 13, the character line block editing memory 14, the gesture editing memory 15, the character code data 16 are stored. Also, kanji conversion dictionary data 17, national language dictionary data 18, and Japanese-English dictionary data 19 are provided.

The coordinate value memory 10 is a memory for holding the input coordinates of the input handwritten information on the input frame 26. As shown in FIG. 4A, the user touches the input frame 26 with the input pen 4 and the coordinates of the input start point 22 at which the input is started, and the input start point 22 when the input point moves on the input frame 26 From the input end point 24 to the input end point 24, that is, the coordinates of the midway input point 23 at a constant time interval (about 10 msec) on the input stroke 25, and the input end point at which the input pen is released from the input frame 26 to end the input. The 24 coordinates are held in the coordinate value memory 10.

Since the coordinates of the midway input point 23 on the input stroke 25 are acquired at fixed time intervals, when the input stroke is moved at high speed, the midway input on the input stroke 25 is performed as shown in FIG. 4B. Point 23 is reduced. Therefore, based on the coordinates of the input start point 22, the midway input point 23, the input end point 24, and the number of midway input points 23, the operation speed, the operation direction, the shape, and the like of the input stroke 25 can be grasped.

The recognition and shaping result memory 11 is a memory for holding the recognition and shaping result after the character shaping process is performed by the handwriting information processing program 9 and the character shaping process is performed. This recognition and shaping result memory 11 is
As shown in FIG. 5, it is composed of character data 11p for each character, and in the character data of that one character, the selected character code data 11a selected as a result of the character recognition processing of the handwritten character, The candidate character code data 11b that is a candidate, the number 11c of the character line block to which the shaped character corresponding to the handwritten character belongs, the character number 11d where this shaped character is located in the character line block, and this shaped character are displayed. In addition to the position information 11e on the display screen 4, font type 1 for displaying this well-formed character
Information about display attributes such as 1f, character size 11g, and character color 11h is also held.

The character line block is a unit of a character group for performing various editing operations on the block as a block when a series of handwritten characters is input. In the present embodiment,
When no handwritten character is input for a predetermined time, the handwritten character input up to immediately before is determined to be one character line block, and character recognition processing is collectively performed for each character line block. Therefore, when a plurality of handwritten characters are input, the character line block is composed of a plurality of shaped characters corresponding to the plurality of handwritten characters. If no handwritten character is input for a predetermined time after inputting only one handwritten character, the shaped character corresponding to the one handwritten character becomes one character line block.

For example, in FIG. 5, when the font type 11f is Mincho, the character size 11g is 20 points, and the character color 11h is black, the position coordinates (x1, y1) on the input frame 26 are called "ayu". The character data 11p is shown for the first handwritten character "a" when the hiragana is handwritten as one character line block.

When "A" is selected as the code character, the JIS character code "0x2422" corresponding to "A" is held in the selected character code data 11a, and the handwritten character "11" is stored in the candidate character code data 11b. The shape is similar to "a", and multiple JIS characters such as the JIS character code "0x242a" corresponding to "O" and the JIS character code "0x2461" corresponding to "me" that are candidates for character recognition processing Code data is retained.

When the character line block corresponding to this "a" is the third character line block handwritten on the input frame 26, the character line block number 11c is "3". In addition, of the three characters "a" that compose this character line block, "a" is the first character, so the character number 11d
Becomes "1".

The character editing memory 12 holds the contents of the editing process for editing the shaped characters displayed on the display screen 4 on a character-by-character basis. In the present embodiment, the character editing memory 12 holds the contents of character deleting, character inserting, changing to another candidate character, and character rewriting processes, each of which is associated with a predetermined editing operation input. Assigned. The editing process is input by selecting an edit button in the edit panel described later.

The character line block area memory 13 holds position information for specifying the character line block area 21 (see FIG. 6) set on the display screen 4 within a predetermined range so as to surround the character line block 20. Therefore, in the present embodiment, the coordinates (xa, ya) of the point A at the upper left corner of the character line block area 21 and the coordinates (xb, yb) of the point B at the lower right corner thereof.
Holds the information of. When a plurality of character line block areas are displayed on the display screen 4, the coordinates of the respective character line block areas are held in the character line block area memory 13.

The character line block editing memory 14 holds the contents of the editing process performed on the entire character line block 20. In the present embodiment, the character line block editing memory 14 stores the contents of the character size changing process, the character line block moving process, the character aligning process, the character translation process of the character line block, and the character attribute associating process. Is held.

Each editing process held in the character line block editing memory 14 is associated with the input operation of the editing operation input to the input frame 26. That is, each editing process assigned according to the operation direction, operation speed, and operation distance of the input stroke 25 is performed.

Here, the character alignment processing is performed by inputting a character line block 20 displayed at an appropriate position on the display screen 4 as shown in FIG. 7A as shown in FIG. 7B. The editing process is to indent the left end of the frame 26 or indent the right end of the input frame 26 as shown in FIG. 7C.
At the same time as indenting, the characters in the character line block are packed (see Fig. 7 (b) for narrowing the space between characters), or evenly allocated (while keeping the entire length of the character line block This is to equally allocate the intervals, and FIG. 7C may be performed.

The translation process of characters in a character line block is
As shown in FIG. 8, it is a process of displaying an English translation of a word formed of a formatted character displayed in the character line block 20 on the display screen 4 based on the Japanese-English dictionary data 19. Of course, if the word formed of the formatted characters displayed in the character line block 20 is English, the English translation of the English may be displayed on the display screen 4 based on the English-Japanese dictionary data (not shown). In addition, as shown in FIG.
Based on the above, the meaning and content of the phrase formed of the formatted characters displayed in the character line block 20 may be displayed on the display screen 4.

The association of the character attributes is a process of associating the character attributes of the formed characters when the character attributes of the formed characters forming the character line block are different in the two character line blocks. For example, as shown in FIG. 10, when two character line blocks 20 and 39 displayed with different character sizes and different character intervals are displayed on the display screen 4, the character line block 20 is replaced by the character line block 39. When moving to the character line block area, the character size of the formatted character "Kakiku" that forms the character line block 20
This is a process in which the character spacing is aligned with the character size and character spacing of the shaped character "aka" forming the character line block 39, and the appearance is adjusted and displayed. This is a process used when it is desired to display the character line blocks 20 and 39 input by handwriting separately as neat paragraph items in a good appearance.

The gesture edit memory 15 holds the content of the gesture edit process assigned according to the input shape of the gesture input. Here, the gesture input is an edit operation input of a characteristic shape that is assigned in advance to a predetermined edit process and is determined in advance in order to facilitate complicated and many edit operation inputs to the character line block 20. .

For example, in the present embodiment, FIG.
As shown in (a), when a gesture input 54 is performed such that the character line block 20 composed of the formatted character "aiueo" crosses over the formatted character "eo" from right to left, the formatted character "e" The "O" is deleted, and the character line block 20 becomes "Au". In addition, as shown in FIG. 11B, when a gesture input 55 is performed to draw a circle so as to enclose the shaped character “Ue” in the character line block 20 including the shaped character “Aiueo”, the shaped character “U The color of "" is changed.

In addition to this, various editing processes are assigned corresponding to gesture inputs of characteristic shapes such as “Le”, “□”, and “Δ”, and the contents of the editing process are gesture editing. Although it is held in the memory 15, the description thereof is omitted in the present embodiment.

The character code data 16 is a character code conforming to JIS and a character (print type) corresponding to the character code.
Holds the code character as. At the time of character recognition processing, the selected character code data 11a and the candidate character code 1 corresponding to the handwritten character are extracted from this character code data 16.
1b is extracted.

The Kanji conversion dictionary data 17 is dictionary data used when converting from Hiragana to Kanji when the Kanji conversion mode is selected by the Kanji conversion button 36. The Japanese dictionary data 18 and the Japanese-English dictionary data. 19 is
As shown in FIGS. 8 and 9, the dictionary data is used when displaying the meaning of the displayed well-formed characters and displaying the English translation. <Operation of Handwritten Information Processing Device> Next, the operation of the handwritten information processing device 1 will be described based on the flowchart shown in FIG.

When the handwriting information processing program 9 is activated (S.1), an input frame 26 is displayed on the display screen 4 as shown in FIG. When the user inputs handwritten information into the input frame 26 with the input pen (S.2), the input is detected, and the input information is sent to the computer 3 functioning as an input stroke detecting means to input strokes. The detection process is started.

[Input Stroke Detection Processing] The computer 3 functioning as an input stroke detection means detects the input stroke 25 (path taken by the input operation) of the input handwritten information (S.3). Specifically, FIG.
As shown in (4), it is constantly monitored whether or not the handwriting input on the input frame 26 is detected (S.20). When the handwriting input is detected, the input coordinates of the input point are sent to the coordinate value memory 10. (S.21). In the handwriting information processing device 1, the light emitted from the laser emitted along the surface of the display screen 4 detects the handwriting input on the input frame 26 formed on the display screen 4, and the light shielding is performed. The input coordinates are detected by detecting the position. The computer 3 detects the input coordinates at predetermined time intervals (about 10
every ms) and the detected coordinates of the input points 22 to 24 are all sent to the coordinate value memory 10 (see also FIG. 4).
The coordinate value memory 10 holds the input coordinates sent.

The computer 3 detects whether or not the input is completed (S.22), and if the input is not completed, the input is continuously detected. When the input is completed, the input stroke 25 is confirmed (S.23), and the handwriting information determination process is started. The end of the input of handwritten information is detected by the fact that the laser emitted along the surface of the display screen 4 is no longer shielded.

In the input stroke 25, the first input point is the input start point 22, the point detected in the middle of the stroke is the intermediate input point 23, and the point at which the input is completed is the input end point 24.
As a result, the operation and the shape of the stroke are grasped and determined by the computer 3. The input stroke 25 is displayed on the display screen 4 at the time of input.

[Handwriting information judgment processing] Input stroke 2
After determining 5, the input stroke 25 is determined by the computer 3 functioning as a handwritten information determination means to determine whether the input stroke 25 is a handwritten character input or an edit operation input (S.4). The handwritten information determination processing by the handwritten information determination means is specifically performed by the procedure shown in FIG.

First, the information of the character line block area 21 of the character line block 20 displayed on the display screen 4 is acquired from the character line block area memory 13 (S.3).
0). As shown in FIG. 6, the character line block area 21 has the coordinates (xa, y) of the upper left point A of the character line block 20.
a) and the coordinates (xb, yb) of the lower right point B.

Next, the input points 22 to 2 of the input stroke 25
4 and the character line block area 21 are compared (S.31). It is determined whether the coordinates of the input points 22 to 24 are in the character line block area 21 (S.32), and the coordinates of the input points 22 to 24 are 1 in the character line block area 21.
If even one exists, it is determined that the input stroke 25 is the input stroke of the editing operation input (S.34),
The editing operation type determination process is started. Also, the input point 22
If none of the coordinates -24 exists in the character line block area 21, it is determined that the input stroke 25 is an input stroke for handwriting character input (S.33), and the character recognition start determination processing is started. .

For example, as shown in FIG. 15, when a character line block 20 'composed of shaped characters 101 to 103 ("a") is displayed on the display screen 4, the input stroke 40 has its input point 40a. Is a character line block 20 '
Since it exists in the character line block area, it is determined to be the input stroke of the editing operation input. On the other hand, the input stroke 41 is determined to be an input stroke for handwritten character input because no input point exists in the character line block area of the character line block 20 '.

When the handwritten information determination process does not display the shaped characters on the display screen 4, the input stroke 25 is of course determined to be the input stroke for handwritten character input.

[Character Recognition Start Judgment Processing] When the input stroke 25 is judged to be an input stroke for handwritten character input, a computer functioning as character recognition start judgment processing means determines whether or not to start character recognition. 3 (S.5). The character recognition start determination processing by the character recognition start processing means is specifically performed by the procedure as shown in FIG.

The computer 3 detects whether or not the next input is started (S.40). When the next input is detected, the computer 3 returns to the input stroke detection process and the detection of a new input is started. It If the next input is not started, it is determined whether a predetermined set time has elapsed (S.41),
When the set time elapses without the next input, the character recognition process is started.

The above-mentioned set time can be changed according to the usability of the user.
Then, it is set to 1.5 sec in advance.

[Character recognition processing] When the start of character recognition of a handwritten character is determined, the character recognition processing is started by the computer 3 functioning as a character recognition processing means (S.
6). The character recognition processing by the character recognition processing means is specifically performed by the procedure shown in FIG.

Input stroke 25 from coordinate value memory 10
The coordinates of each input point are acquired (S.50). When there are multiple input strokes, the coordinates of each input point of all of those input strokes are acquired. Character cutout (S.51) and character recognition processing (S.52) are performed based on the coordinates of each input point.

This character cutout is a process of dividing the input strokes of a plurality of handwritten character inputs into input strokes corresponding to one character, and the character recognition process uses a known character recognition engine (character recognition processing program). This is a process for selecting the character code data closest to the input handwritten character by using it, but these processes are publicly known and will be omitted.

In the handwritten information processing apparatus 1, at the time of character recognition, the character code data closest to the handwritten character (selected character code data 11a) is selected, and the handwritten character has a shape relatively similar to that of the candidate. Was done 10
The character code data (candidate character code data 11b) of the candidate character is also extracted. These selected character code data 1
1a and the candidate character code data 11b are sent to the recognition shaping result memory 11 as a character recognition result (S.5).
3). In this way, character recognition processing is performed one character at a time,
When the character recognition processing of all handwritten characters is completed (S.5
4) The character shaping process is started.

[Character shaping process] When the handwriting character recognition process is completed, the computer 3 functioning as a character shaping process starts the character shaping process (S.
7). The character shaping processing by the character shaping processing means is specifically performed by the procedure shown in FIG.

Input stroke 25 from coordinate value memory 10
The coordinates of each input point are acquired (S.60). When there are multiple input strokes, the coordinates of each input point of all of those input strokes are acquired.

Input stroke 25 of this handwritten character input
19 is calculated and set from the coordinates of the respective input points (S.6).
1). As shown in FIG. 19, when the handwritten characters 121 to 123 corresponding to the character "aka" are input in the input frame 26, the first character 121 ("
From the coordinates of the uppermost point 42, the lowermost point 43, and the leftmost point 44 of the input stroke "a"), the handwritten characters 121 to 12
The coordinates (xp, yp) of the reference point P of the handwritten character block area 46 set for 3 (“a”) and its height h are calculated.

The reference point P is used as a reference position when displaying the shaped characters 101 to 103 corresponding to the handwritten character, and the height h is used as a reference for the character size of the shaped characters 101 to 103. Specifically, when the font height h of the formatted character and the aspect ratio of the font are t, n from the beginning
The second well-formed character is (xp + (n−1) × t × h, y
It is displayed based on the coordinate position of p).

By the above calculation method, the character size of the well-formed character corresponding to the handwritten character is determined (S.63).
At the same time, the display position is also determined (S.64). Information on the character size and display position of this well-formed character is
The character size 11g and the position information 11e are sent to the recognition and shaping result memory 11.

In this embodiment, handwritten character 1
Although the case where 21 to 123 are input horizontally is described, it goes without saying that the handwritten characters 121 to 123 may be input vertically. In that case, the uppermost point 42, the leftmost point 44, and the rightmost point 45 of the input stroke of the first character 121 ("a")
From the coordinates of, the coordinates and the character width of the reference point P of the handwritten character block area 46 set for the handwritten character "Ai" are calculated.

When the character size and display position of the shaped character corresponding to the handwritten character are determined, the shaped character is displayed on the display screen 4. <Editing Operation> When it is determined that the input stroke 25 is an input stroke of an editing operation input, the computer 3 functioning as an editing processing type determining processing unit determines the type of editing processing corresponding to the editing operation input ( S.
9). This editing process type determination process is specifically shown in FIG.
The procedure is as shown in.

It is determined whether the input start point 22 of the input stroke 25 is within the character line block area 21 (S.7).
0), if it is not in the character line block area 21,
It is determined whether or not it is on the character line block editing pointer 47 (S.71).

Here, the character line block editing pointer 4
As shown in FIG. 21, 7 is a character line block 20 ("
This is an instruction pointer for a small square range which is set for each character line block and displayed on the display screen 4 in order to perform the editing process for the whole "." A 1-character editing pointer 48 is also displayed as an instruction pointer for a small square area set for each character to perform an editing process.In this embodiment, the character-line block editing pointer 47 is a character line. The one-character editing pointer 48 is set outside the block area 21, and is set inside the character line block area 21.
These editing pointers correspond to the shaped characters 101 to 10
3 ("I") may be displayed together with the display screen 4, or may be displayed after the character line block area 21 is selected by the input pen.

When the input starting point 22 is on the character line block editing pointer 47, it is judged that this editing operation input is to perform the character size changing editing process for the entire character line block 20, and the character line block editing process is executed. Be started. If the input start point 22 is not on the character line block editing pointer 47, it is determined that this editing operation input is to perform gesture editing, and the gesture editing process is started.

The input start point 22 is the character line block area 21.
If it is within the range, it is further determined whether or not the input start point 22 is on the one-character editing pointer 48 (S.7).
2). When the input start point 22 is on the 1-character editing pointer 48, it is determined that the editing process for one character is performed, and the 1-character editing process is started. If the input start point 22 is not on the 1-character editing pointer 48, it is determined that the entire character line block 20 is edited.
The character line block editing process is started.

[1 Character Editing Process] When the input start point 22 is on the 1 character editing pointer 48, it is judged that the 1 character editing pointer 48 has been selected, and the computer 3 functioning as a 1 character editing processing means 1 character. The editing process is started (S.10). The one-character edit processing by this one-character edit processing means is specifically performed by the procedure shown in FIG.

By selecting the one-character editing pointer 48,
The edit panel 49 is displayed on the display screen 4 (S.8).
0). For example, as shown in FIG. 23, when it is desired to edit the shaped character 102 '("ji") in the character line block 20 among the displayed shaped characters 101, 102', 103 ("jiji"). , Well-formed character 102 '("ji")
When the one-character editing pointer 48 corresponding to is selected, the editing panel 49 is displayed in the vicinity of the shaped character 102 '("ji"). Along with that, well-formed characters 102 '("ji")
Is highlighted.

This edit panel has a delete button 50, an insert button 51, a candidate character button 52, and a cancel button 5.
3 is provided, and a button ID is assigned to each button. The delete button 50 is assigned with a process of deleting a character, the insert button 51 is assigned with a process of inserting a blank, and the candidate character button 52 is assigned with a process of replacing with a candidate character. The contents of these one-character edit processes by the edit panel 49 are held in the edit memory 12 in association with the corresponding button IDs and the contents of the edit processes.

When any button in the edit panel 49 is selected (S.81), the button ID is acquired (S.82), and the edit process corresponding to the acquired button ID is executed ( S.83).

For example, when the delete button 50 is selected, the shaping character 102 '("
The same ") is deleted and the insert button 51 is selected,
As shown in FIG. 24 (b), a space 1 for one character is formed between the well-formed character 101 ("a") and the well-formed character 102 '("ji").
25 is inserted. In addition, among the candidate character buttons 52,
When the button corresponding to the code character “i” is selected, the formatting character 102 ′ (”is displayed as shown in FIG.
The """and the shaped character 102 (" i ") are replaced, and the shaped characters 101 to 103 (" a ") are displayed in the character line block 20.

When a new handwritten character 104 ("ki") is input at the position where the shaping character 102 '("ji") is displayed while the editing panel 49 is displayed, the new handwritten character 104 ( The character "KI") is recognized and shaped, and the shaped character 102 '("Ji") is deleted.
As shown in (d), the formatted characters 101, 104, 103 ("Akiu") are displayed in the character line block 20.
The cancel button 53 is a button for canceling the one-character editing process, and when this button is selected, the display on the editing panel 49 disappears.

When the one-character editing process is performed, the editing result is reflected and displayed on the display screen 4.

[Character Line Block Editing Process] When the character line block editing process is started by the computer 3 functioning as a character line block editing process means (S.11),
As shown in FIG. 25, first, it is determined whether the input start point 22 of the input stroke 25 is on the character line block edit pointer 47 (S.90). If the input start point 22 is on the character line block edit pointer 47, it is determined that the character size change process for the entire character line block is performed.
91).

This character size changing process is performed based on the motion direction and motion distance from the input start point 22 of the input stroke 25 to the input end point 24.
This is a process of changing the character size of the formatted character within 0. For example, as shown in FIG.
In the character line block 20, when the input stroke 25 started from the character line block edit pointer 47 of the character line block 20 composed of 3 (“a”) moves in the diagonally lower right direction and ends at the input end point 24. Formatted characters 101-
The character size of 103 (“a”) is enlarged with reference point P as a reference, as shown in the figure.

In this case, the shaping characters 101 to 103 in the character line block 20 are kept constant with the aspect ratio of the character line block 20 based on one of the horizontal movement distance and the vertical movement distance of the input stroke 25. You may change the font size of ("I say"). In addition, the character size of the shaped characters 101 to 103 (“a”) in the character line block 20 is changed while changing the aspect ratio of the character line block 20 based on the movement distance of the input stroke 25 in both up, down, left and right directions. Good.

When the input start point 22 is not on the character line block edit pointer 47, it is determined whether or not the number of times the input stroke 25 is repeated in the predetermined direction is greater than the predetermined number of times (S.92). When the number of times the input stroke 25 is repeated in the predetermined direction is greater than the predetermined number of times, the character translation process is performed (S.93).

This character translation processing is performed by the character line block 20.
This is a process of displaying a translation of a word / phrase displayed in the text. For example, as shown in FIG. 9, the character line block 20
When the formatted characters 106 and 107 composed of "translation" are displayed in the character string, and the input stroke 25 repeatedly moves in the left-right direction within the character line block area 21 a predetermined number of times, the Japanese-English dictionary data 19 in the hard disk 8 is displayed. The English translation 56 ("Tra" corresponding to the phrase "translation" is used
nslation ”) is displayed on the display screen 4.

When the alphabet is input by handwriting, the characters are recognized and shaped, and the English words or English sentences consisting of the shaped characters of the alphabet are displayed in the character line block 20, the character translation process is performed by the English-Japanese dictionary data. May be used to display an English word or a Japanese translation of an English sentence. In addition, as shown in FIG.
The meaning and content of the word or phrase formed of the formatted characters 106 and 107 (“translation”) displayed inside may be displayed.

The predetermined number of repetitive motions as a criterion for starting the character translation processing is, for example, about 3 to 6 times, and the user can clearly judge that the repetitive motion is intentional and the repetitive motion is repeated. The number of times is selected within the range that does not burden the user. In the first embodiment, the direction of the repetitive operation is the left-right direction, but of course it may be the up-down direction, and it is of course possible to assign different character translation processes to the left-right direction and the up-down direction. .

Not only the character translation process, but also various processes such as a process of displaying ruby characters and a process of displaying a coined word when the number of repetitive motions of the input stroke 25 in the predetermined direction is greater than the predetermined number of times. May be performed.

When the number of repetitive operations of the input stroke 25 is less than or equal to the predetermined number of times, it is determined whether or not the operation speed of the input stroke 25 is higher than the predetermined speed (S.94), and the operation speed of the input stroke 25 is the predetermined speed. When it is larger, the character alignment process (S.95) is performed. The character alignment process is a process of aligning the shaped characters at the end of the display screen 4 corresponding to the operation direction of the input stroke 25.

For example, as shown in FIG. 7A, in the case where a character line block 20 composed of the shaped characters "Aiueo" is displayed at the approximate center position of the display screen 4, the character line block area 21 is displayed. When the input stroke 25 is input to the left at a speed higher than the predetermined speed from FIG.
As shown in, the character line block 20 is indented at the left end of the input frame 26 of the display screen 4. At the same time, the characters in the character line block 20 are padded to improve the appearance of the characters.

When the operation direction of the input stroke 25 is the right direction, the character line block 20 is indented at the right end of the input frame 26 of the display screen 4 as shown in FIG. 7C. At the same time, the character spacing of the shaped characters in the character line block 20 is evenly allocated to improve the appearance of the character display. Of course, when the operation direction of the input stroke 25 is the upward direction and the downward direction, the process of aligning with the upper end and the lower end of the input frame 26 may be performed.

When the operation speed of the input stroke 25 is equal to or lower than the predetermined speed, it is determined whether or not the input end point 25 of the input stroke 25 is within another character line block area (S.96). ), If the input end point 25 of the input stroke 25 is within the area of another character line block area, the character attribute associating process is performed.

This character attribute association processing is performed on the display screen 4
In the case where there are a plurality of character line blocks displayed above and the character attributes of each well-formed character are different, the character attributes of those well-formed characters are associated.

For example, as shown in FIG. 10, the input start point 22 of the input stroke 25 is in the character line block area 21 corresponding to the character line block 20, and the input end point 24 is the character line corresponding to the character line block 39. Block area 3
When it is within 9 ', the character size and character spacing of the formatted character "Kakiku" in the character line block 20 is the character line block 3.
9 are aligned in association with the character size and character spacing of the well-formed character "Ai" in 9, and the well-formed character "Ai" and the well-formed character "Kakiku" are displayed with the same size and the same character spacing.

In the first embodiment, as described above, the character attribute associating process aligns the character size and the character interval, but of course, the font type and the character color may be aligned. Other character attributes may be arranged. Further, the character line block 20 is not limited to the one having the same attribute, and for example, in the above example.
It is also possible to set the character size of the character within the character line block 39 to half the character size of the character.

The input end point 25 of the input stroke 25 is
If it is not within the other character line block area, the moving process is performed. This moving process is a process of moving the entire character line block along the moving direction of the input stroke 25.

For example, as shown in FIG. 27, when the input stroke 25 starts from within the character line block area 21 and ends at a predetermined point outside the other character line block area within the input frame 26, the input is made. Start point 22 to input end point 24
The character line block 20 is moved along.

When the above character line block editing process is performed, the editing result is reflected and displayed on the display screen 4.

[Gesture editing process] Input stroke 2
5 is not within the character line block 21 and is not on the character line block editing pointer 47, the gesture editing process is started by the computer 3 functioning as the gesture editing processing means (S.
12).

In this gesture editing process, various editing processes are performed on the shaped character based on the input shape of the input stroke 25. If the input stroke 25 never enters the character line block area 21 from the input start point 22 to the input end point 24, it is determined that the input stroke 25 is input of a handwritten character. In order to start the gesture editing process, at least one of the input points of the input stroke 25 needs to be within the character line block area 21. For example,
When the input stroke 25 started from outside the character line block area 21 ends in the character line block area 21, or when the input stroke 25 started from outside the character line block area 21 enters the character line block area 21 once. enter,
After that, this is the case, for example, when the process ends outside the character line block area 21 again.

As shown in FIG. 28, when the gesture editing process is started, the shape of the input stroke 25 is first grasped (S.100). The gesture editing memory 15 in the hard disk 8 holds the content of the gesture editing process which is assigned in advance according to the shape of the input stroke. For example, a process of deleting a crossed character is assigned according to the shape of an input stroke that crosses the character from right to left. Further, in the case of an input stroke that draws a circle so as to enclose a character, a process of changing the character color of the enclosed character is assigned.

The shape of the input stroke 25 is grasped on the basis of the information in the gesture edit memory 15, and the gesture edit processing is determined according to the shape of the input stroke 25 (S.101). At the same time, the character to be edited is determined based on the shape of the input stroke 25 (S.102).

For example, as shown in FIG. 11A, for the character line block 20 consisting of the shaping characters 108 to 112 ("aiueo"), the shaping characters 111 and 112 ("eo") are moved from right to left. When the gesture input 54 of the input stroke 25 that crosses over is performed, the well-formed characters 111 and 112 (“Eo”) are deleted by the gesture editing process, and the display in the character line block 20 shows the well-formed characters 108 to. It will be 110 ("I say").

Further, as shown in FIG. 11B, a circle is drawn so as to surround the shaping characters 110 and 111 (“up”) in the character line block 20 formed by the shaping characters 108 to 113 (“aiueo”). When the gesture input 55 is performed, the shaped characters 110 and 111 are processed by the gesture editing process.
The character color of ("up") is changed.

In this way, the gesture editing process is executed for the character to be edited based on the input shape of the input stroke 25 (S.103). When the gesture edit process is performed, the edit result is reflected and displayed on the display screen 4.

The contents of the one-character editing process, the character line block editing process, the gesture editing process, and the assignment of the input operation to those editing processes are not limited to those of the present embodiment, and may be variously changed. can do. It suffices that the contents of each editing process and each editing operation input are assigned in advance and held in the panel editing memory 12, the character line block editing memory 14, the gesture editing memory 15, and the like.

Further, in the present embodiment, the electronic blackboard 2 and the computer 3 are configured separately, but of course, even if the electronic blackboard is provided with a computer and the electronic blackboard itself is a handwriting information processing device. Good.

[0159]

As described above, the claims 1 and 2 of the present application
According to the inventions of 20, 27, 28, and 29, character shaping processing is performed based on the input state of handwritten characters, and the shaped characters obtained by the character shaping processing are displayed on the display screen. You can display well-formed characters that reflect the state of. Since the input state of the handwritten characters is reflected in the well-formed characters, there is almost no need to edit and adjust the well-formed characters later, and the handwritten characters can be efficiently input, providing a user-friendly user interface. can do.

According to the inventions of claims 2, 21 and 30, since the character size of the shaped character is adjusted and displayed based on the size of the input handwritten character, the shaping of various sizes is convenient. Characters can be displayed.
For example, if the characters to be emphasized are handwritten in large size, they will be displayed in large size.Therefore, it is almost unnecessary to edit and adjust the size of the shaped characters after they are displayed. it can.

According to the third aspect of the present invention, the character size of the formatted character is such that the handwritten character is at the highest point and the lowest point of the first handwritten character, or the leftmost point and the lowest point of the first handwritten character. Since the adjustment is performed based on the position of the right point, it is possible to easily grasp the size of the shaped character displayed during handwriting.

According to the invention of claim 4, the size of the shaped character is substantially the same as the size of the handwritten character. Therefore, the handwritten character only needs to be input in the size in which the shaped character is desired to be displayed, which is convenient. There is almost no need to edit and adjust the size of the well-formed character after it is displayed.

According to the present invention as set forth in claims 5 and 22, the display position of the shaped character is adjusted and displayed on the display screen based on the input position of the input handwritten character. You can display well-formed characters in. It is almost unnecessary to adjust the display position of the well-formed character after the well-formed character is displayed, and the handwritten character can be efficiently input.

According to the invention of claim 6, since the display position of the shaped character is substantially the same position as the input position of the handwritten character, it is sufficient to input the handwritten character at the position where the shaped character is desired to be displayed. , Easy to use. It is hardly necessary to adjust the display position of the well-formed character after the well-formed character is displayed.

According to the inventions of claims 7 and 23, when the editing processing is performed on the shaped characters, the editing panel showing the contents of the editing processing is displayed on the display screen. Will be easier. In addition to being able to perform editing operations efficiently, learning the operations is easy and convenient.

According to the invention of claim 8, it is possible to easily perform the processing of deleting the shaped character, inserting the blank, and replacing it with another candidate character.

According to the inventions as claimed in claims 9 and 24, since the editing process for the shaped characters is performed corresponding to the input operation indicated by the editing operation input entered in the information input frame, the editing operation is easy and interesting. , The editing operation can be performed efficiently, and the operation can be easily learned. Therefore, the user interface can be easily used.

According to the tenth aspect of the invention, different editing processing can be performed only by speeding up or slowing down the input operation. Therefore, the editing operation is easy and interesting, the editing operation can be efficiently performed, and the operation is easily learned.

According to the eleventh aspect of the invention, it is possible to easily align the shaped characters by a simple editing operation of speeding up the input operation.

According to the twelfth aspect of the invention, different editing processing can be performed only by increasing the number of times of repeating the input operation to a predetermined number or less than the predetermined number of times. Therefore, the editing operation is easy and interesting, the editing operation can be efficiently performed, and the operation is easily learned.

According to the thirteenth aspect of the present invention, it is possible to translate the formatted character by a simple editing operation in which the operation is repeated more than a predetermined number of times.

According to the inventions as claimed in claims 14 and 25, since the editing processing of the shaped characters is performed corresponding to the input shape indicated by the editing operation input entered in the information input frame, the editing operation is easy and interesting. , The editing operation can be performed efficiently, and the operation can be easily learned. Therefore, the user interface can be easily used.

According to the fifteenth aspect of the present invention, it is possible to perform the editing process for deleting the shaped character by a simple editing operation input.

According to the sixteenth aspect of the present invention, it is possible to perform the editing process of changing the character color of the shaped character by a simple editing operation input.

According to the seventeenth and twenty-sixth aspects of the invention, when the handwritten character is not input for a predetermined time, the character recognition processing and the character shaping processing are collectively performed, so that the user does not feel discomfort or burden. It is possible to perform character recognition processing and character shaping processing. Therefore, the user interface can be easily used.

Further, since the shaped characters corresponding to a series of handwritten characters continuously handwritten are grasped as one character line block, the editing process for the entire character line block becomes easy.

According to the eighteenth aspect of the invention, the editing process for each character and the editing process for the character line block can be easily performed.

According to the nineteenth aspect of the present invention, the character attribute of a shaped character in one character block can be associated with the character attribute of a shaped character in another character block by a simple editing operation.

[Brief description of drawings]

FIG. 1 is an external perspective view showing a schematic configuration of a handwriting information processing apparatus according to an embodiment of the present invention.

2 is a block diagram showing an internal configuration of a computer used in the handwriting information processing apparatus of FIG.

FIG. 3 is a diagram showing a screen display when a handwriting information processing program is activated.

FIG. 4 is a diagram showing an input stroke of handwriting information input, in which (a) shows an example of an input stroke input at a relatively low speed, and (b) shows an example of an input stroke input at a relatively high speed. Indicates.

FIG. 5 is a diagram illustrating the content of the data configuration of a recognition and shaping result memory.

FIG. 6 is a diagram for explaining a character line block area.

FIG. 7 is a diagram for explaining character alignment processing,
(A) shows the state before alignment, and (b) shows the characters are indented to the right edge of the input frame when the operation direction of the input stroke is to the left, and the characters are aligned within the character line block. FIG. 6C shows a state in which the characters are indented at the right end of the input frame and the characters are evenly allocated when the operation direction of the input stroke 25 is the right direction.

FIG. 8 is a diagram illustrating a translation process, showing how an English translation of a phrase is displayed on a display screen.

FIG. 9 is a diagram showing how the meaning and content of a word is displayed on a display screen.

FIG. 10 is a diagram for explaining the character attribute associating process and is a diagram showing a manner in which the character sizes and the character display intervals of the shaped characters forming the two character line blocks on the display screen are aligned.

11A and 11B are diagrams for explaining a gesture editing process, in which FIG. 11A shows a state in which a shaping character is deleted by a gesture input, and FIG. 11B shows a character color of the shaping character is changed by a gesture input. Show the situation.

FIG. 12 is a flowchart illustrating an operation of the handwriting information input device.

FIG. 13 is a flowchart illustrating a procedure of input stroke detection processing.

FIG. 14 is a flowchart illustrating a procedure of handwritten information determination processing.

FIG. 15 is a diagram illustrating a case where there is an input point of an input stroke in a character line block area and a case where there is no input point.

FIG. 16 is a flowchart illustrating a procedure of character recognition start processing.

FIG. 17 is a flowchart illustrating a procedure of character recognition processing.

FIG. 18 is a flowchart illustrating a procedure of character shaping processing.

FIG. 19 is a diagram illustrating how a handwritten character block area is set.

FIG. 20 is a flowchart illustrating a procedure of edit processing type determination processing.

FIG. 21 is a diagram showing a state in which a 1-character editing pointer and a character-line block editing pointer are displayed.

FIG. 22 is a flowchart illustrating a procedure of a one-character editing process.

FIG. 23 is a diagram showing a state in which an edit panel is displayed.

FIG. 24 is a diagram showing a state in which one-character edit processing is performed, and FIG. 24 (a) shows a case where a delete button is selected.
(B) shows the case where the insert button is selected, (c) shows the case where the button corresponding to "i" among the candidate character buttons is selected, and (d) shows the new handwritten character "ki". It shows a case where handwritten input is performed and a well-formed character corresponding to the "ki" is displayed.

FIG. 25 is a flowchart illustrating a procedure of a character line block editing process.

FIG. 26 is a diagram for explaining a character size changing process of a character line block.

FIG. 27 is a diagram for explaining processing for moving a character line block.

FIG. 28 is a flowchart illustrating a procedure of a gesture editing process.

[Explanation of symbols]

A: coordinates B: coordinates P: Reference point h: height 1: Handwritten information processing device 2: Electronic blackboard 3: Computer 4: Display screen (display means, handwriting information input means) 5,6: Data input / output interface 7: Signal processing means 8: Hard disk (storage means) 9: Handwritten information processing program 10: Coordinate value memory 11: Recognition result memory 11a: Selected character code data 11b: Candidate character code data 11c: Number of character line block 11d: Character number 11e: Position information 11f: font type 11g: font size 11h: Text color 11p: Character data 12: Panel edit memory 13: Character line block area memory 14: Character line block edit memory 15: Gesture editing memory 16: Character code data 17: Kanji conversion dictionary data 18: Japanese dictionary data 19: Japanese-English dictionary data 20: Character line block 21: Character line block area 22: Input start point 23: Midway input point 24: Input end point 25: Input stroke 26: Input frame (information input frame) 27: Recognition button 28: Clear button 29: Refresh button 30: Equal button 31: button for closing characters 32: Line width slider 33: Mode selection slider 34: Recognition result display frame 35: Change button 36: Kanji conversion button 37: Save button 38: Finish button 39: Character line block 39 ': character line block area 40, 41: Input stroke 40a: input point 42: highest point 43: lowest point 44: leftmost point 45: rightmost point 46: Handwritten character block area 47: Character line block editing pointer 48: 1 character editing pointer 49: Editing panel 50: Delete button 51: Insert button 52: Candidate character button 53: Cancel button 54, 55: Gesture input 56: English translation 101-112, 102 ': well-formed characters 121-123 ,: handwritten characters 125: blank

Claims (30)

[Claims] 1. A character recognition process is performed based on a handwritten character input to an information input frame, a character code corresponding to the handwritten character is selected, and the handwriting is performed for the code character assigned to the character code. A handwriting information processing apparatus, which performs a character shaping process based on a character input state and displays a shaped character obtained by the character shaping process on a display screen. 2. A character shaping process for adjusting the character size based on the size of the input handwritten character is performed on the code character, and a shaped character obtained by the character shaping process is displayed on the shaped character display screen. The handwritten information processing device according to claim 1, wherein the handwritten information processing device is displayed above. 3. The character size of the shaped character is at the positions of the highest point and the lowest point of the first handwritten character among the handwritten characters, or at the positions of the leftmost point and the rightmost point of the first handwritten character. The handwriting information processing apparatus according to claim 1 or 2, wherein the handwriting information processing apparatus is adjusted based on the above. 4. The character size of the well-formed character is substantially the same as the size of the handwritten character.
Thru | or the handwriting information processing apparatus of any one of Claim 3. 5. The display position of the shaped character is adjusted based on the input position of the input handwritten character and displayed on the display screen.
The handwritten information processing apparatus according to any one of the above. 6. The handwritten information processing apparatus according to claim 5, wherein the display position of the shaped character is substantially the same position as the input position of the handwritten character. 7. The editing panel for displaying the contents of the editing process when the editing process is performed on the shaped character is displayed on the display screen.
The handwritten information processing apparatus according to any one of the above. 8. The edit panel is provided with edit buttons corresponding to the processing of deleting the well-formed character, the processing of inserting a blank, and the processing of replacing the well-formed character with another well-formed character. The handwritten information processing device according to claim 7. 9. When the edit operation input for performing the edit processing for the shaped character is performed in the information input frame, the edit processing for the shaped character is performed corresponding to the input operation indicated by the edit operation input. 7. The handwriting information processing device according to claim 1, wherein the handwriting information processing device is a handwriting information processing device. 10. A different editing process is performed on the shaped character depending on whether the operation speed of the input operation is higher than a predetermined speed or when the operation speed of the input operation is equal to or lower than the predetermined speed. The handwritten information processing apparatus according to claim 9. 11. The handwriting according to claim 10, wherein when the operation speed of the input operation is higher than a predetermined speed, the shaped characters are aligned with a display screen edge corresponding to the operation direction of the input operation. Information processing equipment. 12. When the number of times of repeating the input operation is greater than a predetermined number and when the number of times of repeating the input operation is less than the predetermined number of times, different editing processing is performed on the shaped character. Claim 9 thru | or Claim 1 characterized by the above-mentioned.
1. The handwritten information processing device according to any one of 1. 13. The handwriting information processing apparatus according to claim 12, wherein when the number of times of repeating the input operation is greater than the predetermined number of times, processing for translating the shaped character is performed. 14. When an edit operation input for performing edit processing on the shaped character is performed in the information input frame,
The handwriting information processing apparatus according to claim 1, wherein the handwritten information processing apparatus edits the shaped character corresponding to an input shape indicated by the editing operation input. 15. The handwriting according to claim 14, wherein an editing process for deleting the crossed shaped character is performed corresponding to the input shape that crosses the shaped character from left to right. Information processing equipment. 16. The editing process for changing the character color of the enclosed shaped character corresponding to the input shape enclosing the shaped character in a substantially circular shape. The handwritten information processing device described in. 17. The character recognition process and the character shaping are collectively performed for each character line block up to the input of the handwritten character immediately before that when the handwritten character is not input for a predetermined time. The handwritten information processing apparatus according to any one of claims 1 to 16, which performs processing. 18. If the character line block area is set on the display screen so as to surround the character line block for each of the character line blocks, and the character line block area is selected, the formed character is On the other hand, a one-character edit pointer that is set for each shaped character to perform an edit process for each character, and a character line block that is set for each character line block to perform an edit process for the character line block. The handwriting information processing apparatus according to claim 17, wherein an editing pointer is displayed on the display screen. 19. When a plurality of the character line blocks are displayed on the display screen and one character line block is moved to another character line block area, a shaped character in the one character block is formed. 19. The handwriting information processing apparatus according to claim 18, wherein the character attribute of No. 1 is associated with the character attribute of the formatted character in another character block. 20. A character recognition process is performed based on a handwritten character input to an information input frame, a character code corresponding to the handwritten character is selected, and the handwriting is performed for the code character assigned to the character code. A handwriting information processing method characterized by performing a character shaping process based on an input state of a character and displaying a shaped character obtained by the character shaping process on a display screen. 21. A character shaping process for adjusting the character size is performed on the code character based on the size of the input handwritten character, and the shaped character obtained by the character shaping process is displayed on a display screen. 21. The handwritten information processing method according to claim 20, wherein: 22. The display position of the shaped character is adjusted based on the input position of the input handwritten character and displayed on the display screen. Handwritten information processing method. 23. When performing an editing process on the shaped character, an editing panel showing the contents of the editing process is displayed on the display screen. The handwritten information processing method according to any one of items. 24. When an edit operation input for performing edit processing on the shaped character is performed in the information input frame,
The handwriting information processing method according to any one of claims 20 to 23, wherein an editing process for the shaped character is performed corresponding to an input operation indicated by the editing operation input. 25. When an edit operation input for performing edit processing on the shaped character is made in the information input frame,
The handwriting information processing method according to any one of claims 20 to 24, characterized in that the editing processing of the shaped character is performed corresponding to an input shape indicated by the editing operation input. 26. The character recognition processing and the character shaping are collectively performed for each of the character line blocks, up to the input of the handwritten character immediately before the input of the handwritten character when a predetermined time has not been input, as a character line block. 26. The handwritten information processing method according to any one of claims 20 to 25, characterized by performing processing. 27. A character recognition processing procedure for performing character recognition processing on a computer based on a handwritten character input to an information input frame and selecting a character code corresponding to the handwritten character, assigning to the selected character code. Performs a character shaping processing procedure for performing character shaping processing on the coded characters based on the input state of the handwritten character, and a display procedure for displaying the shaped characters obtained by the character shaping processing on the display screen. A handwritten information processing program characterized by the following. 28. A character recognition processing procedure for performing character recognition processing on a computer based on a handwritten character input to an information input frame and selecting a character code corresponding to the handwritten character, assigning to the selected character code. Performs a character shaping processing procedure for performing character shaping processing on the coded characters based on the input state of the handwritten character, and a display procedure for displaying the shaped characters obtained by the character shaping processing on the display screen. A computer-readable recording medium having a handwritten information processing program recorded thereon. 29. A character recognition process is performed based on a handwritten character input to an information input frame, a character code corresponding to the handwritten character is selected, and the handwriting is performed for the code character assigned to the character code. An electronic blackboard provided with a handwriting information processing device that performs a character shaping process based on a character input state and displays a shaped character obtained by the character shaping process on a display screen. 30. A character shaping process for adjusting the character size based on the size of the input handwritten character is performed on the code character, and the shaped character obtained by the character shaping process is displayed on the shaped character display screen. 30. The electronic blackboard according to claim 29, which is displayed above.