JP5671895B2 - Handwritten information recognition apparatus and handwritten information recognition program - Google Patents

Description

  The present invention relates to a handwritten information recognition apparatus and a handwritten information recognition program.

  2. Description of the Related Art Conventionally, there is an information processing apparatus that recognizes information input by a user by hand using a finger or a pen as characters. In such an apparatus, for example, there is an apparatus in which an area for one character is provided on a touch panel as an area for inputting characters by handwriting. In addition, there is an apparatus that determines a character delimiter by touching a button for each character delimiter input by handwriting. In addition, there is a device that recognizes each stroke input by a finger or a pen, generates a candidate character string, and determines the most similar character string as a character string written by a user.

Japanese Patent Laid-Open No. 9-16709 JP-A-7-31656 JP 2007-220145 A

  However, in the conventional apparatus, the user performs an operation unrelated to the operation of writing a character by selecting one of a plurality of displayed character candidates or pressing a specific button for each character break. There is a problem that it is not possible to input characters continuously in succession. In addition, there is an apparatus for separating characters when a user does not input characters for a certain period of time while inputting characters by handwriting. In such an apparatus, the user writes characters one by one with a gap at each character break, and thus there is a problem that the characters cannot be input continuously continuously.

  It is an object of the present invention to provide a handwritten information recognition apparatus and a handwritten information recognition program capable of continuously inputting characters.

  The handwritten information recognition apparatus includes an input area, a start point area, an area determination unit, and a recognition unit. The input area is an area where handwritten characters are input. The starting point area is arranged outside the input area. The region determination unit determines whether or not the starting point of the handwritten character is included in the starting point region. When the recognition unit determines that the start point of the handwritten character is included in the start point region by the region determination unit, it is assumed that one character has been delimited immediately before the start of writing from within the start point region. recognize.

  The handwritten information recognition program causes the computer to execute a determination step, a confirmation step, and a recognition step. In the determination step, the processor determines whether or not a handwritten character has begun to be written from within the start point area arranged outside the input area. When it is determined that the start point of the handwritten character is included in the start point area, in the confirmation step, the processor recognizes that a single character has been separated immediately before the start of writing from within the start point area. To confirm one character. When it is determined that a point at which a handwritten character starts to be written is included in the input area, in the recognition step, the processor recognizes that it is in the middle of one character and continues to recognize the character.

  According to the handwritten information recognition device and the handwritten information recognition program, it is possible to input characters continuously.

It is a block diagram which shows the handwritten information recognition apparatus concerning Example 1. FIG. 10 is a flowchart illustrating handwritten information recognition processing according to the first embodiment. It is a block diagram which shows the hardware constitutions of the handwritten information recognition apparatus concerning Example 2. FIG. It is a figure which shows the structure of the touchscreen of the handwritten information recognition apparatus concerning Example 2. FIG. It is a block diagram which shows the functional structure of the handwritten information recognition apparatus concerning Example 2. FIG. 12 is a flowchart illustrating handwritten information recognition processing according to the second embodiment. It is a figure which shows the example of input of the hiragana by handwriting. It is a figure which shows the example of input of the hiragana by handwriting. It is a figure which shows the example of input of the hiragana by handwriting. It is a figure which shows the example of input of the hiragana by handwriting. It is a figure which shows the example of input of the symbol by handwriting. FIG. 9 is a block diagram illustrating a hardware configuration of a handwritten information recognition apparatus according to a third embodiment. It is a figure which shows the structure of the touchscreen of the handwritten information recognition apparatus concerning Example 3. FIG. It is a figure which shows the structure of the touchscreen of the handwritten information recognition apparatus concerning Example 3. FIG. It is a block diagram which shows the functional structure of the handwritten information recognition apparatus concerning Example 3. FIG.

  Exemplary embodiments of a handwritten information recognition apparatus and a handwritten information recognition program will be described below in detail with reference to the accompanying drawings. When the handwritten information recognition device and the handwritten information recognition program start writing a handwritten character from the start point area arranged outside the input area, the one handwritten character Recognize that a delimiter has been added, and determine one character. In the following description of each embodiment, the same components are denoted by the same reference numerals, and redundant descriptions are omitted.

Example 1
Description of Handwritten Information Recognition Device FIG. 1 is a block diagram illustrating a handwritten information recognition device according to the first embodiment. As shown in FIG. 1, the handwritten information recognition apparatus includes an input area 1, a start point area 2, an area determination unit 3, and a recognition unit 4. The input area 1 is an area where handwritten characters are input by the user. The start point area 2 is arranged outside the input area 1. The area determination unit 3 determines whether or not the starting point area 2 includes the point at which the handwritten character input by the user is written. When the area determination unit 3 determines that the start point of the handwritten character is included in the range of the start point region 2, the recognition unit 4 immediately before the start of writing from the range of the start point region 2. Recognize that a single character has been separated at the stage.

  In the handwritten information recognition apparatus described above, the input area 1 and the start point area 2 are realized by hardware capable of inputting characters by handwriting such as a touch panel and a tablet. The region determination unit 3 and the recognition unit 4 are not shown, but may be realized by, for example, a processor executing a handwritten information recognition program. The handwritten information recognition program may be a program that causes a computer to execute handwritten information recognition processing described below, for example. The handwritten information recognition program and the handwritten information being input may be stored in a memory accessible by the processor.

FIG. 2 is a flowchart of the handwritten information recognition process according to the first embodiment. As shown in FIG. 2, when the handwriting information recognition process is started, the area determination unit 3 first determines whether or not the user has started to write handwritten characters from within the range of the start point area 2 (step S1). . When the area determination unit 3 determines that the start point of the handwritten character is included in the start point region 2 (step S1: Yes), the recognition unit 4 immediately before the start of writing from within the start point region 2 In step S2, it is recognized that one character has been separated, and the character is determined (step S2). Further, the recognizing unit 4 recognizes that the information input by starting writing from the current start point region 2 is the start of a new character (step S3).

  On the other hand, when it is determined by the area determination unit 3 that the point at which the handwritten character starts to be written is included in the input area 1 (step S1: No), the recognition unit 4 recognizes that it is in the middle of one character. Then, the character recognition is continued (step S3). Following step S3, the process returns to step S1, and steps S1 to S3 are repeated until the input of handwritten characters from the user is completed.

  According to the first embodiment, when a user starts to write a handwritten character from the start point area 2, a character is automatically separated, so that the user does not need to perform an operation unrelated to the operation of writing the character. In addition, the user does not need to leave a space for each character break. Therefore, the user can input characters continuously continuously.

(Example 2)
Description of Handwritten Information Recognition Device FIG. 3 is a block diagram of a hardware configuration of the handwritten information recognition device according to the second embodiment. As shown in FIG. 3, the handwritten information recognition apparatus includes, for example, a touch panel 11 as a hardware capable of inputting characters by handwriting, a display 12, a CPU (Central Processing Unit) 13 as a processor, and a memory 14. ing. The touch panel 11 is overlaid on the display 12. The memory 14 stores a handwritten information recognition program. The CPU 13 reads the handwritten information recognition program from the memory 14 and executes it.

  FIG. 4 is a diagram illustrating the configuration of the touch panel of the handwritten information recognition apparatus according to the second embodiment. As shown in FIG. 4, the display 12 includes an input area 21, a start point area 22, a candidate display area 23 for displaying character candidates, and a character string display area 24 for displaying fixed character strings and characters to be fixed. Is displayed. The user can visually recognize the respective areas 21 to 24 that pass through the touch panel 11 and the handwriting and characters displayed in the respective areas 21 to 24. By touching the touch panel 11 with a finger or a pen, the user can input handwritten characters in the input area 21 and the start point area 22 and select candidate characters displayed in the candidate display area 23. As an example, in the second embodiment, the start point region 22 is arranged along the four sides of the input region 21 so as to surround the input region 21.

  FIG. 5 is a block diagram of a functional configuration of the handwritten information recognition apparatus according to the second embodiment. As shown in FIG. 5, the handwritten information recognition apparatus includes a display control unit 31, a touch panel input control unit 32, an area determination unit 33, a recognition unit 34, a timer management unit 35, and a dictionary 36. These units 31 to 35 and the dictionary 36 are realized by the CPU 13 executing a handwritten information recognition program.

  The touch panel input control unit 32 detects that the user has touched the touch panel 11 with a finger or a pen (pen down) or that the user has touched the touch panel 11 with the finger or pen removed from the touch panel 11 (pen up). The touch panel input control unit 32 obtains coordinates on the touch panel 11 where the finger or pen touches the touch panel 11 when the finger or pen touches the touch panel 11, and passes the coordinate information to the area determination unit 33. The area determination unit 33 determines whether or not the starting point of the character handwritten by the user is included in the range of the start point area 22 based on the coordinate information passed from the touch panel input control unit 32.

  The recognition unit 34 uses the coordinate information passed from the touch panel input control unit 32 as handwriting information, selects a character with a high recognition rate for the handwriting information from the dictionary 36, and recognizes it as a candidate character. The dictionary 36 stores the correspondence between handwriting information and characters for various characters. The timer management unit 35 manages a timer (not shown). This timer measures the time from when the finger or pen touching the touch panel 11 leaves the touch panel 11 until the finger or pen touches the touch panel 11 again. The display control unit 31 displays the input area 21, the start point area 22, the candidate display area 23, the character string display area 24, the trajectory of the finger or pen touching the touch panel 11, the candidate character or the fixed character, etc. Image processing and display control are performed.

FIG. 6 is a flowchart of the handwritten information recognition process according to the second embodiment. As shown in FIG. 6, when the handwritten information recognition process is started, first, the handwritten information recognition apparatus waits in a state as it is until the finger or pen touches the touch panel 11 (pen down) (step S <b> 11). The touch panel input control unit 32 detects that a finger or a pen touches the touch panel 11 (pen down) (step S12). Then, the touch panel input control unit 32 obtains the coordinates of the finger or pen touching the touch panel 11.

  Next, the recognizing unit 34 determines whether the finger or pen has selected any candidate character in the candidate display area 23 based on the coordinate information of the finger or pen touching the touch panel 11 ( Step S13). If no candidate character is selected (step S13: No), the area determination unit 33 determines that the starting point is the starting point area based on the information of the coordinates of the starting point detected in step S12. 22 is determined (step S14).

  When it is determined by the area determination unit 33 that the starting point is included in the starting point area 22 (step S14: Yes), the recognizing unit 34 reads one character immediately before starting the writing from the starting point area 22. The character having the highest recognition rate is determined as the character written by the user based on the information input so far (step S15). However, when handwritten characters are started to be written from the start point area 22 for the first time, there is no information on the handwritten characters that have been input so far, so that the characters are not confirmed.

  The recognizing unit 34 recognizes the information input by starting writing from the current start point area 22 as the start of a new character and performs character recognition processing (step S16). That is, even if the user does not perform a special operation or leave a gap, the character is delimited in step S15 and the character is confirmed, and at the same time, the next character recognition process is started. Then, the recognition unit 34 continues the character recognition process (step S16) until the touch panel input control unit 32 detects that the finger or the pen is released from the touch panel 11 (pen up) (step S17: No).

  When the touch panel input control unit 32 detects that a finger or pen has been removed from the touch panel 11 (pen up) (step S17: Yes), the timer management unit 35 starts measuring time using the timer. And the timer management part 35 judges whether predetermined time passes (step S18). While the predetermined time has not elapsed, that is, while the timeout has not occurred (step S18: No), the touch panel input control unit 32 waits for the finger or pen to touch the touch panel 11 again (pen down) (step S11). When a finger or a pen touches the touch panel 11 again, the processes after step S12 are performed.

  While the processing from step S11 to step S18 is performed, the region determination unit 33 may determine that the point at which writing is detected in step S12 is included in the input region 21 (step S12). S14: No). In that case, the recognizing unit 34 has not yet reached a single character break, recognizes that it is in the middle of a single character, and continues character recognition processing (step S16).

  Further, during the processing from step S11 to step S18, the time measured by the timer may time out after a predetermined time (step S18: Yes). In that case, the recognizing unit 34 recognizes that one character has been separated, and determines the character with the highest recognition rate as the character written by the user based on the information input so far (step S19).

  On the other hand, during the processing from step S11 to step S18, the finger or pen touching the touch panel 11 may select any candidate character in the candidate display area 23 (step S13: Yes). In that case, the recognizing unit 34 recognizes that one character has been separated, and determines the candidate character in the candidate display area 23 touched by the finger or pen as the character written by the user (step S21).

  When the character is confirmed in step S19 or step S21, the handwritten information recognition apparatus determines whether or not the input of the handwritten character is finished (step S20). If not completed (step S20: No), the process returns to step S11, and the processes after step S11 are repeated. When the process has been completed (step S20: Yes), the series of handwritten information recognition processing is completed.

-Input example of hiragana and symbol FIGS. 7-10 is a figure which shows the input example of hiragana by handwriting. FIG. 11 is a diagram showing an example of handwritten symbol input. In the notation of each character or each symbol in these figures, the portion surrounded by a broken circle or ellipse is the starting point of writing of the character or symbol. The part enclosed by a dotted circle or ellipse is not considered the starting point. A portion surrounded by a dotted circle or ellipse is a portion where a finger or pen that moves while touching the touch panel 11 protrudes from the input region 21 to the start point region 22.

  As described above, when a finger or a pen protrudes from the input area 21 to the start point area 22 when handwriting a character or symbol, the recognition unit 34 does not regard it as a starting point of writing. For example, in the flowchart of the handwritten information recognition process shown in FIG. 6, since the finger or pen does not move away from the touch panel 11 (Step S17: No), the recognition unit 34 determines that the coordinate value in the start point region 22 is from the touch panel input control unit 32. Even if given, it is determined that the input of one character continues.

  Japanese notation often starts writing letters or symbols from the top or left. Accordingly, as is apparent from FIGS. 7 to 11, it can be seen that in most hiragana characters and symbols, there is no problem even if the writing is started so that the starting point of the character is included in the starting point region 22.

  However, as shown in FIG. 8, since the hiragana “no” is originally started to be written downward from the center of the input area 21, the exception is to start writing from the upper part of the input area 21 in the start point area 22. It may be. The recognizing unit 34 recognizes, as a hiragana character “no”, a character whose central portion of the hiragana character “no” protrudes upward. The recognition unit 34 is configured to perform recognition processing in consideration of such an exception.

  As shown in FIG. 10, the horizontal line is originally written from the center of the input area 21 to the right for the hiragana “yo”, but the upper part of the input area 21 in the start point area 22. You may start writing a vertical line first. Since the recognizing unit 34 recognizes characters in a font regardless of the writing order, there is no problem even if the writing order is changed. As an example, hiragana and some symbols are shown, but the same applies to katakana and other symbols.

  According to the second embodiment, the user automatically starts writing the next character from the start point area 22 except when inputting the last character and when selecting one of a plurality of character candidates. The same effect as in the first embodiment can be obtained.

Example 3
FIG. 12 is a block diagram of a hardware configuration of the handwritten information recognition apparatus according to the third embodiment. As shown in FIG. 12, the handwritten information recognition apparatus includes an inclination sensor 15. The inclination sensor 15 detects the degree of inclination of the handwritten information recognition apparatus. In the third embodiment, the start point area 22 is arranged on a part of the outside of the input area 21 based on the inclination detected by the inclination sensor 15.

  13 and 14 are diagrams illustrating the configuration of the touch panel of the handwritten information recognition apparatus according to the third embodiment. For example, as shown in FIG. 13, when the inclination of the handwritten information recognition apparatus is smaller than a preset threshold value, the start point area 22 may be arranged along the left and upper two sides of the input area 21. With respect to characters or symbols that can be written from the top or the left, there is no problem if the start point region 22 is arranged as shown in FIG. For example, as shown in FIG. 14, when the inclination of the handwritten information recognition apparatus is larger than a preset threshold value, the start point area 22 may be arranged along the right and bottom two sides of the input area 21. Good. For example, when a reading point (“,”) or a punctuation point (“.”) Shown in FIG. 10 is input by handwriting, the start point region 22 may be arranged as shown in FIG. Note that the start point region 22 may be arranged along any one of the left, right, upper, and lower sides of the input region 21 according to the degree of inclination.

  FIG. 15 is a block diagram of a functional configuration of the handwritten information recognition apparatus according to the third embodiment. As shown in FIG. 15, the handwritten information recognition device includes an inclination determination unit 37. The inclination determination unit 37 passes information on the degree of inclination detected by the inclination sensor 15 to the area determination unit 33. The inclination determination unit 37 may obtain the inclination from the inclination sensor 15 by interruption or polling, for example. The inclination determination unit 37 may pass the information on the inclination obtained from the inclination sensor 15 to the area determination unit 33 by interruption or polling, for example. The area determination unit 33 manages the arrangement of the start point area 22 based on the information on the inclination obtained from the inclination determination unit 37. When changing the arrangement of the start point area 22, the area determination unit 33 passes information on the arrangement of the new start point area 22 to the display control unit 31. The display control unit 31 performs image processing and display control when displaying the start point region 22 based on the arrangement information passed from the region determination unit 33.

  Other hardware configurations and functional configurations are the same as those in the second embodiment. The handwritten information recognition process is the same as that in the second embodiment.

  According to the third embodiment, since the arrangement of the start point area 22 can be changed by tilting the handwritten information recognition apparatus, there is no problem even if the start point area 22 is not arranged along the four sides of the input area 21. That is, the same effect as in the second embodiment can be obtained.

  As an example of an apparatus including the handwritten information recognition apparatus according to the first to third embodiments, a portable electronic information device including a mobile phone, an electronic dictionary, and the like can be given. The touch panel may be a capacitive panel or a resistive film panel. In general, in a capacitive touch panel, a contact area between a finger or a pen and the touch panel needs to be large to some extent in order to release charges from the surface of the panel. Therefore, when using a capacitive touch panel, a certain large input area 21 is required. Therefore, the number of input areas 21 is often one in a small portable device.

  According to the first to third embodiments, even if the number of the input areas 21 is one, the user starts to write characters from the start point area 22 so that one character is separated, so that the user can input characters continuously continuously. it can. On the other hand, if there are two or more input areas 21, a character can be separated by changing the input area 21 in which a character is written for each character. Such a method is often used in a resistive touch panel. Even in the case of a resistive film type touch panel, if the number of input areas 21 is one, applying the handwritten information recognition apparatus according to the first to third embodiments provides the same effect as when using a capacitive touch panel. It is done. Moreover, Examples 1-3 can be applied also when inputting a character by handwriting using a tablet.

  The following additional notes are disclosed with respect to the above-described first to third embodiments.

(Supplementary note 1) Area determination for determining whether or not an input area where handwritten characters are input, a start point area arranged outside the input area, and a start point of writing of handwritten characters are included in the start point area And the region determination unit determine that the start point of the handwritten character is included in the start point region, a single character is added immediately before the start of writing from the start point region. A handwritten information recognizing device comprising: a recognizing unit recognizing

(Additional remark 2) It further has the inclination sensor which detects the inclination of the said input area, The said starting point area | region is arrange | positioned in a part of the outer side of the said input area based on the inclination detected by the said inclination sensor. The handwritten information recognition device according to Supplementary Note 1.

(Additional remark 3) The said starting point area | region is based on the said inclination, the state arrange | positioned above the said input area, the state arrange | positioned on the left side of the said input area, the state arrange | positioned below the said input area, and the said Switching to a state arranged on the right side of the input area, or switching to a state arranged on the upper side and the left side of the input area and a state arranged on the lower side and the right side of the input area based on the degree of inclination The handwritten information recognition apparatus according to Supplementary Note 2, wherein

(Additional remark 4) The said recognition part is begun to write in the said starting point area | region, it extends toward the center part of the said input area, The handwriting information written in the predetermined font in the center part of the said input area | region is said starting point area | region The handwritten information recognition apparatus according to any one of appendices 1 to 3, wherein the character is recognized as a character having no portion extending from a point at which writing starts to a center portion of the input area.

(Supplementary note 5) The handwritten information recognition apparatus according to supplementary note 4, wherein a character having no portion extending from a starting point of writing in the starting point region to a central portion of the input region is a hiragana character "NO".

(Supplementary Note 6) A step in which the processor determines whether or not a handwritten character has started to be written from within a starting point area arranged outside the input area, and a starting point for writing the handwritten character is within the starting point area. If it is determined that the character is included, the processor recognizes that one character has been delimited immediately before the start of writing from within the start point region, determines one character, and starts writing a handwritten character. When it is determined that a point is included in the input area, the processor causes the computer to execute a step of recognizing that the character is in the middle of one character and continuing to recognize the character. Information recognition program.

(Supplementary note 7) When there is no input information from the starting point area or the input area for a predetermined period, the processor further includes a step of recognizing that one character is separated and determining one character. The handwritten information recognition program according to attachment 6.

DESCRIPTION OF SYMBOLS 1 Input area 2 Start point area 3 Area determination part 4 Recognition part 15 Inclination sensor

Claims (5)

An input area where handwritten characters are entered;
A starting point area arranged to surround the input area;
An area determination unit for determining whether or not a start point of handwritten characters is included in the start point area;
When it is determined by the area determination unit that the start point of handwritten characters is included in the start point area, it is recognized that a single character has been separated immediately before the start of writing from within the start point area. A recognition unit;
A handwritten information recognition apparatus comprising: A tilt sensor for detecting the tilt of the input area;
The handwritten information recognition apparatus according to claim 1, wherein the start point area is arranged on a part of the outside of the input area based on a degree of inclination detected by the inclination sensor.   The starting point area is arranged on the upper side of the input area, on the left side of the input area, on the lower side of the input area, and on the right side of the input area based on the degree of inclination. Or the state arranged on the upper side and the left side of the input region and the state arranged on the lower side and the right side of the input region based on the degree of inclination. The handwritten information recognition apparatus according to claim 2.   The recognizing unit starts writing from within the start point region, extends toward the center of the input region, and starts writing handwriting information written in a predetermined font in the center of the input region in the start point region. The handwritten information recognition apparatus according to any one of claims 1 to 3, wherein the handwritten information is recognized as a character having no part extending from the point to the center of the input area. A step of determining whether or not a handwritten character has begun to be written from within a start point area arranged so as to surround the input area;
When it is determined that the starting point of a handwritten character is included in the starting point area, the processor recognizes that a single character has been separated immediately before starting writing from the starting point area. A step of determining a character;
If it is determined that the starting point of a handwritten character is included in the input area, the processor recognizes that it is in the middle of one character and continues to recognize the character;
A program for recognizing handwritten information, characterized by causing a computer to execute.

Images