JP3882805B2 - Handwriting information generation method, handwriting information generation device, and character input device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To create handwriting information from drawing on a certain drawing surface without requiring dedicated paper or the like on which a special pattern for detection of a drawing position is printed. <P>SOLUTION: This device includes a contact detection means 101 for detecting contact made by drawing to a certain drawing surface 200; an image input means 102 which, as drawing takes place, moves over the drawing surface 200 detected for contact by the contact detection means 101 and which sequentially samples partial images 203 in an input area 201 moved as drawing on the drawing surface 200 takes place; a movement detection means 107 for comparing the positions of features 204 present in the plurality of partial images 203 sampled by the image input means 102 to detect the movement of the drawing position; and a handwriting information creation means 108 for creating handwriting information 205 on the basis of the movement of the drawing position detected by the movement detection means 107. <P>COPYRIGHT: (C)2005,JPO&amp;NCIPI

Description

  The present invention is based on the movement change of the drawing position detected by comparing the positions of features that appear in a plurality of partial images captured in an input area that is moved in conjunction with drawing on an arbitrary drawing surface. The present invention relates to a handwriting information generation method, a handwriting information generation device, and a character input device that can acquire character information and graphic information from handwriting information generated from drawing on a drawing surface by generating handwriting information. .

  Conventionally, in a portable information device such as a PDA (Personal Digital Assistant), a character input device in which a touch panel display device and a pen-type operation device are combined has been used. Recently, by combining a special pen-type operating device that oscillates ultrasonic waves and an ultrasonic receiving device, by measuring the position of the pen-type operating device at any time with this ultrasonic receiving device, and recording its movement, There is also known an apparatus capable of inputting a freehand written character.

  In such a conventional character input device, in order to detect the position of the pen-type operation device, a touch panel type display device or an ultrasonic receiving device is indispensable, and thus downsizing of the character input device is limited. It had been.

  Therefore, a pen equipped with an infrared irradiation LED (Light-Emitting Diode) and a CCD (Charge Coupled Device) that senses only near-infrared light is combined with a special paper on which a special pattern including position information is printed with infrared absorbing ink. When the pen moves on the surface of the dedicated paper for drawing, position information is acquired from a night vision image of a special pattern obtained by photographing the reflected light of the infrared dedicated paper irradiated from the LED with the CCD. Discloses a technique relating to a movement sensing device that can sense the movement of the pen and generate handwriting information.

  According to this movement sensing device, any information drawn freehand is acquired based on handwriting information generated from the movement of the pen, without the need for devices such as a touch panel display device and an ultrasonic receiving device. Therefore, information drawn freehand can be input to an arbitrary information device installed in a communication range with the pen. Since this pen is about the size of a normal pen, it is convenient to carry. Therefore, the technology of this movement sensing device is effective in reducing the size of the character input device.

Japanese translation of PCT publication No. 2003-500722 (FIGS. 8 and 9, paragraph numbers [0114] to [0126] and [0328] to [0373])

  However, in the movement sensing device described in Patent Document 1, a special paper on which a special pattern is printed with infrared absorbing ink has to be carried with a pen equipped with an LED and a CCD. When there is no printed dedicated paper, there is a problem that the input operation cannot be executed.

  The present invention solves the above-described problems and can generate handwriting information from drawing without requiring special paper on which a special pattern including position information for detecting the drawing position is printed. It is an object to provide a method, a handwriting information generation device, and a character input device.

In order to solve the above-described problem, the handwriting information generation method according to the present invention sequentially captures and captures partial images of a surface to be drawn in an input area that is moved in conjunction with drawing on any surface to be drawn. a method of generating a handwriting information by drawing from the partial image, and storing an authentication pattern that shows a characteristic manifested in the drawing surface, comprising the steps of: detecting a contact between the drawing surface by the portrayal, the contact A step of sequentially capturing a partial image in an input area on the detected surface to be drawn; a feature that appears in the plurality of partial images captured here; and an authentication pattern that indicates a feature that appears on the surface to be drawn that is stored in advance and determining comparison and collation with the authentication / reject, and detecting a movement change of the drawing position on the basis of the judgment result of the authentication, the mobile detected change in drawing position here Characterized by a step of generating a handwriting information based.

According to the handwriting information generation method according to the present invention, partial images of a drawing surface are sequentially captured in an input area that is moved in conjunction with drawing on an arbitrary drawing surface, and handwriting by drawing from the captured partial images. In the case of generating information, when it is determined as authentication, character information and graphic information can be acquired from handwriting information generated from drawing on the drawing surface.

The handwriting information generation apparatus according to the present invention sequentially captures a partial image of a drawing surface in an input area that is moved in conjunction with drawing on an arbitrary drawing surface, and draws handwriting information by drawing from the captured partial image. A generating device that detects contact with the surface to be drawn by the drawing, moves above the surface of the drawing that has been contact-detected by the contact detecting means, and moves along with the drawing; and sequentially capturing image input means a partial image in the input area of the surface, an authentication pattern storage means for storing an authentication pattern that shows a characteristic manifested in the drawing surface, manifested in a plurality of partial images captured by the images input means and features, an authentication means for determining comparison and collation with the authentication / reject the stored authentication pattern authentication pattern storage means, based on the authentication that has been judged by the authentication means Dzu A movement detecting means for detecting a movement change of the drawing position Te, characterized in that it comprises a handwriting information generating means for generating handwriting information based on the movement detected change in drawing position by the movement detection means.

According to the handwriting information generation apparatus according to the present invention, partial images of a drawing surface are sequentially captured in an input area that is moved in conjunction with drawing on an arbitrary drawing surface, and handwriting by drawing from the captured partial images. When the information is generated, the authentication pattern storage means stores an authentication pattern indicating a feature that appears on the drawing surface. On the premise of this, contact with the surface to be drawn due to drawing is detected by the contact detection means, and the image input means moves in conjunction with the drawing above the surface of the drawing to which contact has been detected. And by this image input means, a partial image is sequentially taken in with the drawing in the input area on the drawing surface. The features that appear in the plurality of partial images captured here and the authentication pattern stored in the authentication pattern storage means are compared and verified by the authentication means to determine authentication / rejection. The movement detection means based on the determined authentication by the authentication means detects the movement changes drawing position. Handwriting information is generated by the handwriting information generating means based on the movement change of the drawing position. Therefore, when it is determined as authentication, character information and graphic information can be acquired from handwriting information generated from drawing on the drawing surface.

A character input device according to the present invention sequentially captures a partial image of a drawing surface in an input area that is moved in conjunction with drawing on an arbitrary drawing surface, and draws handwriting information by drawing from the captured partial image. An input device that detects contact with the drawing surface by drawing and moves above the drawing surface detected by the contact detection means in conjunction with the drawing. and sequentially capturing image input means a partial image in the input area of the surface, an authentication pattern storage means for storing an authentication pattern that shows a characteristic manifested in the drawing surface, manifested in a plurality of partial images captured by the images input means and features, an authentication means for determining comparison and collation with the authentication / reject an authentication pattern stored in the authentication pattern storage means, based on the authentication that has been judged by the authentication means Movement detecting means for detecting a movement change of the drawing position, handwriting information generating means for generating handwriting information based on the movement change of the drawing position detected by the movement detecting means, and a handwriting generated by the handwriting information generating means Character recognition means for recognizing information to convert it into a character code, and character string storage means for storing the character code input from the character recognition means as a coded character string.

According to the character input device of the present invention, the partial image of the drawing surface is sequentially captured in the input area that is moved in conjunction with the drawing on the arbitrary drawing surface, and the handwriting information by drawing from the captured partial image. When inputting characters, the handwriting information generating apparatus according to the present invention is applied. Therefore, when it is determined as authentication, character information and graphic information can be acquired from handwriting information generated from drawing on the drawing surface.

According to the handwriting information generation method according to the present invention, partial images of a drawing surface are sequentially captured in an input area that is moved in conjunction with drawing on an arbitrary drawing surface, and handwriting by drawing from the captured partial images. when generating information, and features manifested in a plurality of partial images captured, and compares and collates the authentication pattern indicating a characteristic of overt determines authentication / rejection prestored be drawn surface, authentication detecting a movement change of the drawing position on the basis of, it is adapted to generate the handwriting information based on the movement change of the drawing position.

  With this configuration, character information and graphic information can be acquired from handwriting information generated from drawing on the surface to be drawn, so that a special device such as a touch panel or special paper, which has been conventionally required, is not required. Freehand character input can be realized.

According to the handwriting information generation apparatus according to the present invention, partial images of a drawing surface are sequentially captured in an input area that is moved in conjunction with drawing on an arbitrary drawing surface, and handwriting by drawing from the captured partial images. when generating information includes a feature that manifested in a plurality of partial images captured, the authentication means for determining comparison and collation with the authentication / reject the stored authentication pattern authentication pattern storage means, the authentication Based on this, a movement change of the drawing position is detected, and handwriting information is generated based on the movement change of the drawing position.

  With this configuration, character information and graphic information can be acquired from handwriting information generated from drawing on the surface to be drawn, so that a special device such as a touch panel or special paper, which has been conventionally required, is not required. Freehand character input can be realized.

  According to the character input device of the present invention, the partial image of the drawing surface is sequentially captured in the input area that is moved in conjunction with the drawing on the arbitrary drawing surface, and the handwriting information by drawing from the captured partial image. When inputting characters, the handwriting information generating apparatus according to the present invention is applied.

  Therefore, since character information and graphic information can be obtained from handwriting information generated from drawing on the surface to be drawn, a free hand can be used without requiring a special device such as a touch panel or special paper, which has been conventionally required. Character input by can be realized.

  DESCRIPTION OF EXEMPLARY EMBODIMENTS Hereinafter, preferred embodiments of a handwriting information generation method, a handwriting information generation device, and a character input device according to the present invention will be described with reference to the accompanying drawings.

  In the present embodiment, when a partial image of a drawing surface is sequentially captured in an input area that is moved in conjunction with drawing on an arbitrary drawing surface, and handwriting information by drawing is generated from the captured partial image, A movement detecting means is provided for detecting the movement change of the drawing position by comparing the positions of the features that appear in the plurality of captured partial images, and the handwriting information is generated based on the movement change of the drawing position. Thus, character information and graphic information can be acquired from handwriting information generated from drawing on the surface to be drawn.

[1] First Embodiment FIG. 1 is a schematic conceptual diagram showing a configuration example of a character input device 100 as a first embodiment of the present invention, and FIG. 2 shows a configuration example of the character input device 100. It is a block diagram.

  As shown in FIG. 1, the character input device 100 has a pen-shaped appearance and can easily draw characters, figures, and the like on an arbitrary drawing surface 200. Here, drawing refers to drawing a trajectory of characters and figures on the drawing surface 200 by moving a contact point between an arbitrary drawing surface 200 and the character input device 100. For example, the character input device Also included is a so-called virtual drawing in which a trajectory such as a character or a graphic is drawn in a state where 100 does not supply ink or the like, and a handwriting does not remain on the drawing surface 200.

  The pen-type character input device 100 (hereinafter referred to as a pen 100) includes a contact detection unit 101, an image input unit 102, an entire image input unit 103, and a display unit 104.

  The contact detection unit 101 is a touch sensor composed of a pressure sensor or the like. The touch sensor 101 is installed at a position corresponding to the pen tip of a normal pen, for example, and is in contact with the drawing surface 200 by drawing. Is detected.

  The image input means 102 is a solid-state imaging device made up of a charge coupled device (CCD), and is installed at a position that moves in conjunction with drawing on the drawing surface 200 detected by the touch sensor 101 in contact. The The CCD 102 sequentially captures partial images of the drawing surface 200 in a shooting range, that is, an input area 202 that is moved in conjunction with drawing at predetermined time intervals such as 1/30 (second) intervals. take in.

  The whole image input means 103 is a solid-state image pickup device similar to the CCD 102, and is located farther from the drawing surface 200 than the CCD 102, for example, at a position where a wide range image of the drawing surface 200 can be input (photographed). It can be attached to the position. The CCD 103 inputs an image of the entire drawing area 201 that is the entire area drawn by the pen 100 on the drawing surface 200.

  The display unit 104 includes a liquid crystal display (LCD) or the like, and displays handwriting (stroke) drawn on the drawing surface 200 as handwriting information (stroke information).

  As shown in FIG. 2, the pen 100 includes a touch sensor (contact detection unit) 101, a CCD (image input unit) 102, a CCD (overall image input unit) 103, and a display unit (display unit) 104. A drawing region detection unit (drawing region detection unit) 105, a drawing region storage unit (drawing region storage unit) 106, a movement detection unit (movement detection unit) 107, a stroke generation unit (handwriting information generation unit) 108, Stroke storage unit (handwriting information storage unit) 109, character recognition unit (character recognition unit) 110, character string storage unit (character string storage unit) 111, transmission processing unit (transmission unit) 112, recognition instruction input unit 113, and abnormality detection An output unit 114 is further provided.

  The functions of the drawing area detection unit 105, the movement detection unit 107, the stroke generation unit 108, and the character recognition unit 110 are a ROM (Read Only Memory) in which a control program for controlling the pen 100 as a whole is stored in advance, and this ROM. Is given to a CPU (Central Processing Unit) that controls the pen 100 by executing the control program stored therein. This CPU is provided with a DRAM (Dynamic Random Access Memory) as a chip set so that it can be used as a work area. Further, the functions of the drawing area storage unit 106 and the stroke storage unit 109 are given to a semiconductor memory such as a DRAM, and the function of the character string storage unit 111 is given to a nonvolatile memory such as a flash memory.

  The contact detection unit 101 is connected to the stroke generation unit 108, the image input unit (CCD) 102 is connected to the movement detection unit 107, and the entire image input unit (CCD) 103 is connected to the drawing area detection unit 105 for display. The unit 104 is connected to the character string storage unit 111.

  The drawing area detection unit 105 is connected to the whole image input unit 103 and the drawing area storage unit 106 and detects the whole drawing area 201 from the image of the whole drawing area 201 input by the whole image input unit 103. To do.

  The drawing area storage unit 106 is connected to the drawing area detection unit 105 and the movement detection unit 107, and stores the features that appear in all the drawing areas 201 detected by the drawing area detection unit 105. As a result, features that appear in the entire drawing area 201 are set in the pen 100 as an image pattern of the drawing surface 200.

  The movement detection unit 107 is connected to the image input unit 102, the drawing area storage unit 106, the stroke generation unit 108, and the detection abnormality output unit 114, and the positions of features that appear in a plurality of partial images captured by the image input unit 102. Are compared, and the movement change of the drawing position, that is, the position of the pen 100 is detected.

  In addition, when the movement change of the pen 100 is large, the movement detection unit 107 reads out the features that appear in the entire drawing area 201 from the drawing area storage unit 106 and stores all the drawing objects stored in the drawing area storage unit 106. The feature that appears in the region 201 is compared with the feature that appears in the partial image of the drawing surface 200, and the movement change of the pen 100 is detected from the comparison result. In this case, when the movement detection fails because the drawing with the pen 100 is executed outside the entire drawing area 201, the failure of the movement detection is sent to the detection abnormality output unit 114.

  The stroke generation unit 108 is connected to the contact detection unit 101, the movement detection unit 107, and the stroke storage unit 109, and generates handwriting information, that is, stroke information based on the movement change of the drawing position detected by the movement detection unit 107. Specifically, the stroke generation unit 108 detects the pen 100 from the contact state between the pen 100 and the drawing surface 200 detected by the contact detection unit 101 and the movement state of the pen 100 detected by the movement detection unit 107. The movement of the pen 100 from the contact with the drawing area 200 to the separation of the drawing area 200 is recognized as one stroke, and the stroke drawn by the pen 100 is generated as stroke information.

  The stroke storage unit 109 is connected to the stroke generation unit 108 and the character recognition unit 110, and sequentially stores the stroke information generated by the stroke generation unit 108.

  The character recognition unit 110 is connected to the stroke storage unit 109, the character string storage unit 111, and the recognition instruction input unit 113, reads the stroke information generated by the stroke generation unit 108 from the stroke storage unit 109, and recognizes the stroke information as character recognition. To convert to character code.

  Specifically, the character recognizing unit 110 uses a group of strokes related to one or more strokes stored in the stroke storage unit 109 as triggered by the input of a character recognition start instruction from the recognition instruction input unit 113 (Trigger). Is read out, and a character is recognized by composing one character from a group of strokes restored based on the stroke information. The character recognition unit 110 retrieves the stroke information from the character code corresponding to the character by searching from a character code standardized in advance, such as Unicode (Universal multi-octet coded character set: ISO / IEC10646). Convert to code.

  The character string storage unit 111 is connected to the display unit 104, the character recognition unit 110, and the transmission processing unit 112, and stores a character code input from the character recognition unit 110 as a coded character string. The character string storage unit 111 sends the stored encoded character string to the display unit 104 as needed, and also sends it to the transmission processing unit 112 in response to an instruction from the outside.

  Accordingly, as described above, the display unit 104 not only displays an image of the stroke information stored in the stroke storage unit 109 but also generates a graphic character corresponding to the coded character string stored in the character string storage unit 111. Can also be displayed.

  That is, the display unit 104 can display an image of the unrecognized stroke group as information drawn by freehand, and can also display a graphic character corresponding to the character code converted from the stroke group in font. . Here, the graphic character is a character group including all characters that can be displayed in font with the above-mentioned standardized character code, which is composed of national languages including Japanese and symbols.

  The transmission processing unit 112 is connected to the character string storage unit 111, and is configured to comply with a wireless communication standard such as Bluetooth (R) standard or CDMA (Code Division Multiple Access) standard, or an infrared port. It has an output port corresponding to the communication standard. The transmission processing unit 112 reads the encoded character string stored in the character string storage unit 111 according to an instruction from the outside, and the encoded character string is a PDA (Personal Digital Assistant: portable terminal) within a communicable range. And an arbitrary external device such as a PC (Personal Computer).

  The transmission processing unit 112 also has a function of creating an e-mail so that the encoded character string stored in the character string storage unit 111 can be e-mailed to the external device.

  The recognition instruction input unit 113 is connected to the character recognition unit 110 and has an input button (not shown) that is input to instruct the start of recognition. The recognition instruction input unit 113 operates when the input button is operated to instruct the start of character recognition, that is, when the end of input of one character is clearly indicated, or contact detection by the contact detection unit 101 is not performed for a predetermined time. If this happens, the character recognition unit 110 is instructed to start character recognition.

  The detection abnormality output unit 114 includes a light emitting device such as an LED (Light-Emitting Diode) or a vibrator (vibration device) including a flat coreless vibration motor. The detection abnormality output unit 114 is connected to the movement detection unit 107, and when the movement detection unit 107 is notified of the failure in movement detection, the detection abnormality output unit 114 notifies the outside of the movement detection failure by light emission or vibration.

  Next, the operation of the pen 100 will be described with reference to FIGS. FIG. 3 is a schematic conceptual diagram showing an example of use of the pen 100, FIG. 4 is a schematic conceptual diagram showing an example of image input of the entire drawing area 201a by the CCD 103, and FIG. FIG. 6 is a diagram for explaining a method for detecting a change in drawing position by the movement detection unit 107. FIG.

  When the power of the pen 100 configured as described above is turned on, for example, as shown in FIG. 3, the palm 200a that is characterized by the palm print 204 is set as the drawing surface 200, and preparation for drawing is performed above the palm 200a. The palm 103 a is photographed by the CCD 103, and an image of the palm 200 a is input to the drawing area detection unit 105.

  In the drawing area detection unit 105, as shown in FIG. 4, the palm 201 a in the range photographed by the CCD 103 is detected as the entire drawing area 201. The image of the palm 201a detected here is stored (saved) in the drawing area storage unit 106, so that features 204 such as a palm print, a fingerprint, and a finger shape appear on the pen 100 as features that appear on the palm 200a. Is set.

  For example, when drawing is performed on the palm 200 a by the pen 100 and a partial image 203 a of the palm 200 a is captured by the CCD 102, the movement detection unit 107 detects the palm 201 a stored in the partial image 203 a and the drawing area storage unit 106. The pattern matching process is executed on the image. In this pattern matching process, a comparative analysis is performed so that the features 204a such as palm print and thumb shape included in the partial image 203a are matched (matched) with the features 204 included in the image of the palm 201a. What has been captured in the input area 202a is derived as a comparison result.

  Therefore, this pattern matching processing can specify the corresponding position of the partial image 203a in the image 201a of the palm 201a. Therefore, the movement detection unit 107 can detect the pen for the palm 200a when the partial image 203a is captured by the CCD 102. 100 absolute positions can be identified (detected) and converted to position coordinates.

  For example, when drawing the hiragana “a” on the palm 200a with the pen 100, as shown in FIG. 5A, when the first stroke having the start point 205b is drawn, the touch sensor 101 detects contact at the start point 205b. The partial image 203b is captured by the CCD 102 in the input area 202b moved in conjunction with the drawing. This partial image 203b includes a palm print 204b as a feature that appears on the palm 201b.

  Further, as shown in FIG. 5B, when the second stroke having the start point 205c is drawn, the touch sensor 101 detects the contact at the start point 205c, and the input area 202c is moved in conjunction with the drawing. Thus, the partial image 203 c is captured by the CCD 102. Similar to the partial image 203b described above, the partial image 203c includes the palm print 204b as a feature that appears on the palm 201b.

  The movement detection unit 107 detects the movement change of the pen 100 by comparing the features that appear in the partial image 203b and the partial image 203c captured by the CCD 102, that is, the position of the palm print 204b. Specifically, the movement detection unit 107 matches the palm pattern 204b included in the partial image 203b with the palm pattern 204b included in the partial image 203c, thereby determining the absolute position of the stroke having the start point 205b with respect to the palm 201b and the start point 205c. The absolute position of the stroke with respect to the palm 201b is specified and converted into position coordinates.

  As a result, as shown in FIG. 5C, the positional relationship between the stroke having the start point 205b and the stroke having the start point 205c can be expressed by two-dimensional position coordinates (x, y). Based on the position coordinates representing the positional relationship between the plurality of strokes determined by the movement detection unit 107, stroke information for restoring the stroke group 205d composed of a series of strokes can be generated.

  In this example, since the stroke group 205 d constituting the hiragana “a” is drawn in the drawing area in which the same features 204 b are included in the input areas 202 b and 202 c, the image of the palm 201 a is input by the CCD 103. Even without this, it is possible to detect the movement change of the pen 100 from the partial images 203b and 203c sequentially input from the CCD 102, and to reconstruct the positional relationship between a plurality of strokes. Of course, the positional relationship between a plurality of strokes may be reconstructed by executing pattern matching between the partial image 203b or the partial image 203c and the palm image 201a as well as the partial images 203b and 203c.

  After drawing the two stroke groups 205d in this manner, as shown in FIG. 6A, when a third stroke 205e is newly drawn, the partial image 203d shown in FIG. Subsequently, the partial image 203e shown in FIG. 6C is captured by the CCD 102.

  A pattern matching process is performed on these two partial images 203d and 203e captured continuously in time, and as shown in FIG. 6D, these partial images 203d and 203e are overlaid. The two-dimensional movement change amount of the pen 100 can be detected from the deviation between the two partial images 203d and 203e. That is, the movement detection unit 107 analyzes the amount of deviation between the two partial images 203d and 203e, so that the contact point between the pen 100 and the palm 200a is present when the partial images 203d and 203e are captured. The relative movement of (x, y) can be expressed in coordinates using the start point (a1, b1) and end point (a2, b2) of the vector V.

  As shown in FIG. 6E, the stroke generation unit 108 updates the stroke 205e so as to connect the start point (a1, b1) and the end point (a2, b2) detected by the movement detection unit 107, and the stroke 205f. To generate stroke information by this drawing based on the contact between the pen 100 and the palm 200a, that is, the movement change of the drawing position, from the partial images 203d and 203e captured at predetermined time intervals. Can do.

  The stroke generation unit 108 determines that one stroke has been input when contact is no longer detected by the touch sensor 101, and generates stroke information for restoring this additional drawn stroke 205f. Then, the stroke information generated here is stored in the stroke storage unit 109 so that it can be restored by adding the stroke 205f to the previously drawn two strokes 205d.

  When an input button (not shown) for instructing the start of character recognition is operated here, the stroke information stored in the stroke storage unit 109 is read out by the character recognition unit 110, and the character recognition process is started.

  At this time, as shown in FIG. 6 (f), the stroke groups 205 d and 205 f for constructing the hiragana “a” are restored based on the stroke information read from the stroke storage unit 109, and the bitmap (Bit Map ). As a result, a bitmap image (image) of the hiragana “a” drawn is generated and displayed on the LCD 104 as stroke information. Therefore, it can be quickly confirmed whether or not the drawn characters are correctly input to the pen 100.

  The character recognition unit 110 matches the on-bit point of the hiragana “a” transferred to the bitmap with the on-bit point when generating a font corresponding to the standardized character code. By processing, one character (most approximate character) that is closest to the drawn stroke groups 205d and 205f is searched. Then, the character recognition unit 110 inputs the character code corresponding to the closest character searched here into the character string storage unit 111 as a result of character recognition. As a result, the character recognition unit 110 can recognize the stroke information generated by the stroke generation unit 108 and convert it into a character code.

  The character code input to the character string storage unit 111 is stored following the character code corresponding to the character recognized before the character recognition of the hiragana character “a”. Accordingly, a series of characters drawn by the pen 100 is stored in the character string storage unit 111 as a coded character string.

  The encoded character string stored in the character string storage unit 111 is sent to the LCD 104 as needed, and the display is switched so that the font image “A” is replaced with the font “A”. For this reason, it is possible to continue character input by drawing while confirming the input character string with the character string displayed in an easy-to-read font.

  When the character input is completed and, for example, communication with the pen 100 is started by a PDA or the like compatible with the Bluetooth standard and the pen 100 is instructed to transmit (transmit) the input character string, the code stored in the character string storage unit 111 is stored. The converted character string is read by the transmission processing unit 112, processed and transmitted so as to be transmitted to an external PDA in the designated form.

  As a result, since a character string input freehand by the pen 100 is transmitted to the PDA or the like, it is necessary to operate the input pen on a touch panel type small screen such as a PDA or to input a key from a small keyboard. Disappears. Therefore, it is possible to improve the operability of an external device such as a PDA that has a small operation unit and poor usability.

  As described above, according to the pen 100 according to the first embodiment, the touch panel display device or the drawing position is detected by using the features 204 such as the palm print, the fingerprint, and the finger shape that appear on the palm 200a as a reference. Since the movement of the pen 100 can be recorded (stored) as stroke information without the need for special paper or the like on which a special pattern is printed, characters can be input freehand only with the pen 100. It becomes like this.

  Next, as a handwriting information generation method according to the present invention, an example of handwriting information generation by the above-described pen 100 will be described. 7 and 8 are flowcharts showing examples of handwriting information generation by the pen 100. FIG.

  In the example of handwriting information generation by the pen 100, the partial image 203 of the palm 200a is sequentially captured in the input area 202 that is moved in conjunction with the rendering on the palm 200a on the surface to be rendered, and the drawing is performed from the captured partial image 203. When the stroke information is generated by the above, the movement of the drawing position is detected by comparing the positions of the features 204 that appear in the captured partial images 203, and the stroke information (handwriting information) is detected based on the movement change of the drawing position. ).

  On the premise of this, when the power of the pen 100 is turned on, the image of the entire drawing area 201a is captured by the CCD 103 in step S1 of the flowchart shown in FIG.

  If the power is off in step S2, the generation of stroke information is terminated. However, since the power is on, the process proceeds to the next step S3, where the touch sensor 101 detects contact with the palm 200a by drawing. Then, it is determined that stroke input by drawing with the pen 100 has started, and in step S4, the partial image 203 is photographed and captured by the CCD 102 in the input area 202 of the palm 200a where contact is detected. .

  In step S5, the movement detection unit 107 compares the position of the feature 204 that appears in the captured partial image 203 with the position of the feature 204 that appears in the entire drawing area 201a that has been previously captured, and the next step In S6, the position of the pen 100, that is, the drawing position is detected, and the position coordinates (a, b) are regarded as the drawing position (x, y) at the time of capturing the partial image 203.

  If it is determined in step S7 that the movement detection unit 107 has failed to detect the position of the pen 100, the process proceeds to step S8, and detection failure is notified to the user by LED blinking or vibration (vibration) by the detection abnormality output unit 114. Notify and return to step S2. The loop from step S2 to step S8 is repeated until the position of the pen 100 is successfully detected or the power is turned off.

  If the movement detection unit 107 succeeds in detecting the position of the pen 100 in step S7, the process proceeds to step S9, and the detected position coordinates (a, b) of the pen are represented by the drawing position at the time when the partial image 203 is captured ( x, y) is temporarily stored, and the process returns to step S3.

  Then, in step S3, the partial image 203 is sequentially captured by the CCD 102 in the input area 202 in the palm 200a by repeating the loop of steps S3 to S9 until the touch sensor 101 no longer detects contact with the palm 200a. Then, the movement detection unit 107 compares the positions of features that appear in the plurality of partial images 203 captured by the CCD 102 and detects the movement change of the position of the pen 100.

  If contact by the touch sensor is not detected in step S3, the process proceeds to step S10 in the flowchart shown in FIG. 8, and the stroke generation unit 108 stores the drawing position (x, y) at the time of capturing the partial image 203. The handwriting information (stroke information) is generated by connecting the position coordinates (a, b) of the plurality of pens 100, and the stroke information is stored in the stroke storage unit 109.

  If there is no input instructing the start of character recognition in the next step S11, the process returns to step S2 to wait for the input of the next stroke, and the generation and storage of stroke information is continued in the same manner as described above.

  In step S11, if the start of character recognition is instructed by an input button or the like, or if drawing is not executed for a predetermined time, for example, 2 seconds, an instruction to start character recognition is sent from the recognition instruction input unit 113 to the character recognition unit 110. The As a result, the character recognition unit 110 determines that character recognition has started. If there is no instruction to start character recognition from the recognition instruction input unit 113, the process returns to step S2 without character recognition.

  If the character recognition unit 110 determines in step S11 that character recognition has started, then in step S12, the character recognition unit 110 reads stroke information for restoring a stroke group that has not been character-recognized from the stroke storage unit 109 and executes character recognition processing. In step S13, the stroke information is converted into a character code corresponding to the most approximate character searched by the character recognition process. In step S14, the character code converted from the stroke information is converted into a character string storage unit 111 as a recognition result. To remember.

  As a result, the character code is accumulated as a recognition result in the character string storage unit 111 for each character recognition process, so that a coded character string based on a series of stroke inputs can be stored in the character string storage unit 111.

  The character codes stored in the character string storage unit 111 in this manner are sequentially sent to the display unit 14, and the graphic characters drawn on the palm 200a are displayed as characters (fonts) in step S15.

  If there is no instruction to transmit the recognition result in the next step S16, the process returns to step S2 as it is, and generation and storage of stroke information, character recognition processing, and coded character string until the power is turned off in step S2. Will continue to accumulate.

  If there is an instruction to transmit the recognition result in step S16, the process proceeds to the next step S17, in which the transmission processing unit 112 reads the encoded character string stored in the character string storage unit 111, and the PDA that has transmitted the transmission instruction. After the encoded character string is transmitted to the external device by the wireless technology based on the Bluetooth standard, the process returns to step S2. In step S2, when the power is turned off, the generation of the stroke information is finished.

  As described above, according to the handwriting information generation method according to the present invention, character information and graphic information can be obtained from stroke information generated from drawing on the surface to be drawn. Graphic information and the like can be code-converted and transmitted to an external device such as a PDA. Accordingly, it is possible to realize freehand character input by various information devices without requiring a touch panel type input device or a special device such as special paper, which is essential in a conventional device capable of freehand input. become able to.

  In the present embodiment, the LCD 104 is exemplified as the display unit. However, the display means in the present invention is not particularly limited to the LCD, and an organic EL (Electro Luminescence) display device and an electronic paper having an image display function. Any thin display device capable of reducing power consumption and downsizing can be used.

  In this embodiment, as an example of transmission input of a coded character string to an external device, communication with an information device such as a PDA conforming to the Bluetooth standard is illustrated. However, the coded character string is sent to an external device as an e-mail. Even if it is configured to transmit, the same effect as this embodiment can be obtained.

  The external device to which the character input device according to the present invention can be applied is not particularly limited to an information device such as a PDA, and can also be applied to general home appliances such as a mobile phone and a microwave oven.

  For example, by incorporating a character input function of the character input device according to the present invention in a mobile phone, a character string input using a pen-type character input device attached to the mobile phone is stored in advance in the mobile phone. It is also possible to directly input text information to the address book, telephone book, memo pad, etc., or text information for e-mail creation and editing.

  This allows you to create and edit address books, phone books, notepads, e-mails, etc. with just one small pen without having to operate a limited number of small buttons on your mobile phone. It will be possible to make full use of the function “can process information regardless of location and time” given to mobile phones.

  In this case, the transmission processing unit 112 is configured to be communicable by a wireless method compliant with a well-known CDMA standard that can be used in a mobile phone, or to be diverted from an infrared communication port that is normally mounted on the mobile phone. Is done.

  Further, for example, by applying the above-described configuration of the mobile phone and incorporating the character input function of the character input device according to the present invention in a so-called information home appliance such as a microwave oven, a recipe or the like can be added to a highly functional microwave oven or the like. It can also be used conveniently when entering.

  In the present embodiment, the palm 200a is illustrated as the drawing surface. However, the drawing surface that can be drawn by the character input device according to the present invention is not particularly limited to the palm, and the position coordinates can be set like a palm print. The material and the shape are not particularly limited as long as the characteristics that can be used as a reference are obvious and the contact detection means can detect the contact. For example, a document on which arbitrary character information is printed Recording paper such as paper, special paper such as wallpaper on which a pattern is printed, and cloth, as well as the surface of a wood plate material and the surface of a resin plate on which a pattern is formed, can be used as the drawing surface.

[2] Second Embodiment FIG. 9 is a block diagram showing a configuration example of a character input device 300 as a second embodiment of the present invention. In the character input device 300 according to the second embodiment, the image input unit 102 is also connected to the drawing area detection unit 105, and the function assigned to the entire image input unit 103 in the character input device 100 described above is It is different from the character input device 100 in that it is assigned to the image input unit 102.

  Therefore, in the block diagram shown in FIG. 9, the same functions as those of the character input device 100 are given the same reference numerals as those in the block diagram shown in FIG. Only explained.

  The character input device 300 is configured to have the same external shape as the pen 100 shown in FIG. 1, and as described above, the image input unit 102, that is, the CCD 102 installed in the vicinity of the pen tip, the CCD 103, that is, the entire image input. It is configured to assign the function of the means. Therefore, the CCD 103 is not mounted on the character input device 300 (hereinafter referred to as the pen 300).

  When the pen 300 is used, after turning on the power, the CCD 102 is directed to the surface 200 to be drawn, and the pen 300 is moved for a certain time so as to fill the entire drawing area 201 in the input area 202. The image of the entire drawing area 201 can be sequentially divided and input as a plurality of partial images.

  The drawing area detection unit 105 is connected to the CCD 102 and reconstructs an image of the entire drawing area 201 from a plurality of partial images divided and input by the CCD 102 to detect the entire drawing area 201.

  With this configuration, according to the pen 300 according to the present embodiment, the number of CCDs mounted can be reduced to one, so that the pen 300 can be manufactured at a lower cost than the pen 100. In addition, the failure rate can be reduced by reducing the number of parts.

[3] Third Embodiment FIG. 10 is a block diagram showing a configuration example of a character input device 400 as a third embodiment of the present invention. The character input device 400 according to the third embodiment further includes a user information storage unit 401 that functions as an authentication pattern storage unit and a user authentication unit 402 that functions as an authentication unit. Is different.

  Therefore, in the block diagram shown in FIG. 10, the same functions as those of the character input device 300 are given the same reference numerals as those in the block diagram shown in FIG. 9 and description thereof is omitted. Hereinafter, only differences from the character input device 300 will be described. explain.

  The character input device 400 is configured in the same external shape as the pen 300 shown in FIG. 9 and includes the user information storage unit 401 and the user authentication unit 402 as described above. The user information storage unit 401 is connected to the user authentication unit 402 and stores an authentication pattern for comparison with features that appear in the partial image captured from the CCD 102. When the palm 200a is used as the drawing surface 200, the palm print 204 that appears on the user's palm 200a is stored in advance in the user information storage unit 401 as an authentication pattern.

  The user authentication unit 402 is connected to the user information storage unit 401, the CCD 102, and the drawing area detection unit 105, and is manifested in the palm print 204 stored as an authentication pattern in the user information storage unit 401 and a partial image captured from the CCD 102. The palm print 204 is compared and collated, and authentication / rejection is determined based on the collation result.

  When the user authentication unit 402 determines that the authentication is performed, the movement detection unit 107 detects the position of the pen 400 and detects a change in the drawing position based on the detection result. Thus, the stroke generation unit 108 can generate stroke information only when the user authentication unit 402 determines that the authentication is successful.

  On the other hand, when the user authentication unit 402 determines that the object is rejected, the operation of the movement detection unit 107 is invalidated, so that the stroke generation unit 108 cannot generate stroke information.

  Therefore, according to the pen 400 according to the present embodiment, the character input function by the pen 400 is effectively limited to only those who have been stored in advance in the user information storage unit 401 as fingerprints or palm prints as authentication patterns. Can be used. For this reason, it can be conveniently used when security is important, such as taking measures against information leakage in a character input device.

  As mentioned above, although embodiment of this invention and its effect were described in detail, this invention is not limited to the structure of these 1st thru | or 3rd embodiment, The claim attached to this-application specification Any configuration that can achieve the function of the configuration of the above-described embodiment without departing from the scope of application of the present invention defined by the scope can be applied.

It is a schematic conceptual diagram which shows the structural example of the character input device which concerns on this invention. 2 is a block diagram illustrating a configuration example of a character input device 100. FIG. 4 is a schematic conceptual diagram showing an example of use of the character input device 100. FIG. 5 is a schematic conceptual diagram showing an example of image input of the entire drawing area 201. FIG. It is a figure explaining the identification method of a drawing position. It is a figure explaining the detection method of the movement change of a drawing position. 5 is a flowchart (part 1) illustrating an example of handwriting information generation by the character input device. 12 is a flowchart (part 2) illustrating an example of handwriting information generation by the character input device. 3 is a block diagram illustrating a configuration example of a character input device 300. FIG. 3 is a block diagram illustrating a configuration example of a character input device 400. FIG.

Explanation of symbols

DESCRIPTION OF SYMBOLS 100,300,400 ... Character input device, 101 ... Contact detection means, 102 ... Image input means, 103 ... Whole image input means, 104 ... Display means, 105 ... Drawing Area detection means 106 ... Draw area storage means 107 ... Movement detection means 108 ... Handwriting information generation means 109 109 Handwriting information storage means 110 ... Character recognition means 111 · ..Character string storage means, 112... Transmission means, 200... Drawing surface, 201... All drawing area, 202. Features appearing in the partial image, 205 ... handwriting information, 401 ... authentication pattern storage means, 402 ... authentication means

Claims (5)

A method of sequentially capturing a partial image of the surface to be drawn in an input area that is moved in conjunction with drawing on an arbitrary surface to be drawn, and generating handwriting information by the drawing from the captured partial image,
Storing an authentication pattern indicating a feature that is manifested on the surface to be drawn;
Detecting contact with the drawing surface by the drawing ;
And sequentially take write No step the partial image at the object input area in said detected object rendering surface the contact,
A step of judging authentication / rejection by comparing and comparing a feature that appears in the plurality of captured partial images and an authentication pattern that indicates a feature that appears in advance on the drawing surface;
Detecting a movement change of the drawing position on the basis of the determination result of the authentication,
And a step of generating the handwriting information based on the detected movement change of the drawing position. A device that sequentially captures partial images of the drawing surface in an input area that is moved in conjunction with drawing on an arbitrary drawing surface, and generates handwriting information by the drawing from the captured partial images,
Contact detection means for detecting contact with the drawing surface by the drawing;
An image input unit that moves in conjunction with the drawing on the drawing surface detected by the contact detection unit and sequentially captures the partial image in the input area on the drawing surface;
An authentication pattern storage means for storing an authentication pattern indicating a characteristic that appears on the drawing surface ;
Authentication means for comparing / matching the features that appear in the partial images captured by the image input means with the authentication patterns stored in the authentication pattern storage means to determine authentication / rejection;
A movement detecting means for detecting a movement change of the drawing position on the basis of authentication that has been determined by the authentication means,
Handwriting information generating means, comprising: handwriting information generating means for generating the handwriting information based on the movement change of the drawing position detected by the movement detecting means. The front Ki認 license pattern storage means,
Information related to palm print or fingerprint is stored as the authentication pattern,
The authentication means includes
The palm pattern or fingerprint that appears in the palm image and the palm pattern or fingerprint stored as the authentication pattern are compared and collated when a palm image is captured by the image input means. Character input device. A device that sequentially captures partial images of the drawing surface in an input area that is moved in conjunction with drawing on an arbitrary drawing surface, and inputs handwriting information by the drawing from the captured partial images. ,
Contact detection means for detecting contact with the drawing surface by the drawing;
An image input unit that moves in conjunction with the drawing on the drawing surface detected by the contact detection unit and sequentially captures the partial image in the input area on the drawing surface;
An authentication pattern storage means for storing an authentication pattern indicating a characteristic that appears on the drawing surface ;
Authentication means for comparing / matching the features that appear in the partial images captured by the image input means with the authentication patterns stored in the authentication pattern storage means to determine authentication / rejection;
A movement detecting means for detecting a movement change of the drawing position on the basis of authentication that has been determined by the authentication means,
Handwriting information generating means for generating the handwriting information based on the movement change of the drawing position detected by the movement detecting means;
Character recognition means for recognizing the handwriting information generated by the handwriting information generation means and converting it into a character code;
A character input device comprising: character string storage means for storing the character code input from the character recognition means as a coded character string. The front Ki認 license pattern storage means,
Information related to palm print or fingerprint is stored as the authentication pattern,
The authentication means includes
The palm pattern or fingerprint that appears in the palm image and the palm pattern or fingerprint stored as the authentication pattern are compared and collated when a palm image is captured by the image input means. Character input device.

Images