JP2005275599A - Handwriting output device, handwriting output method, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To read handwritten input information associated with attribute information of each field of a form by using the form in which regular various formats are printed, and perform output. <P>SOLUTION: A handwriting output device holds a form 300 in a handwritten output clip 100, reads handwritten input with an exclusive pen 310, and performs output. Bar codes and a reference position mark 302 to identify the form and the reference position of the form are printed in the form 300, and the form is identified by reading this bar codes and the reference position mark 302 with a line image sensor 103. Handwriting of an exclusive pen 310 is outputted outside with the attribute information of the entry field 301 printed in the form by using a form database. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to a handwriting output device that reads and outputs handwritten input information.

  To import freehand drawn characters and pictures into a computer, a device such as a tablet or scanner is required. However, what you are currently drawing on a tablet can only be confirmed on the display, and once written on paper with a scanner There is a problem that it cannot be imported in real time.

  Therefore, a technology has been developed in which the content written on the paper is read by a computer as it is, and as shown in Patent Literature 1 and Patent Literature 2, if the paper is fixed with a clip of the main body and written with a dedicated pen, drawing is performed. A technology has been disclosed that can be displayed on a computer display in real time and can be loaded into application software such as a word processor.

  Patent Document 1 discloses a technique related to a coordinate input device with improved coordinate indication resolution, and discloses a method for measuring the two-dimensional position of a pen based on a difference in arrival time of ultrasonic waves.

  Further, in Patent Document 2, a pen reads an identifier composed of fine dots indicating a pre-printed position on the front surface of a sheet, identifies which sheet is something, identifies a sheet identifier, and recorded information. It has the feature that it can recognize what is written on which paper, and output manually entered information.

JP-A-6-83528 US Pat. No. 6,548,768

  Conventional tablets and reading devices that read in real time cannot recognize handwritten information associated with an arbitrary field on the paper and recognize which paper, and which “paper” created in various formats. It was not possible to recognize which position “what” was written. In addition, the technique disclosed in Patent Document 2 has a restriction that a dedicated sheet on which fine blue dots indicating positions printed on paper are printed is used. Although this special paper does not interfere with writing, there is a problem that the entire paper looks bluish.

  In the present invention, one of the purposes is to read and output handwritten input information associated with attribute information of each field of a sheet using a sheet on which various ordinary formats are printed. Further, one of the purposes is that papers of various formats can be used.

  In order to achieve the above object, a handwriting output device according to the present invention has a clip for holding a sheet in which an entry area is set in advance and an identifier and a reference mark are attached, and uses a pen to In a handwriting output device that reads information input by handwriting on a sheet and outputs a result of reading, the clip includes a handwriting detection sensor that detects handwriting data of a pen, and an identifier reading unit that reads an identifier attached to the sheet And a reference position reading means for reading a reference mark given to the paper, and the position or inclination of the clip held by the clip is corrected by the read reference mark, and at least the paper from the paper database based on the read identifier. Entry area information and field name attribute information, and output the attribute information along with the detected handwriting data And butterflies.

  In the handwriting output device according to the present invention, the identifier and the reference mark given to the paper are configured by at least a barcode, a position detection mark, a notch, a hole, or an embossing that specifies the paper. And

  Further, in the handwriting output device according to the present invention, the handwriting detection sensor includes an optical lens system that forms a light concentration region by spherical aberration, and a light receiving element that detects the light concentration region formed by the optical lens system. In addition, the handwriting of the pen having the light source is detected by one or two cameras based on the detection information of the light concentration area detected by the light receiving element.

  Still further, in the handwriting output device according to the present invention, the identifier reading means for reading the identifier given to the paper and the reference position reading means for reading the reference mark on the paper are read by a contact type line sensor. And

  The handwriting output method according to the present invention has a clip for holding a sheet with a pre-filled area and an identifier and a reference mark, and reads and reads information handwritten on the sheet using a pen. In the handwriting output method for outputting the results, a handwriting detection step for detecting pen handwriting data, an identifier reading step for reading an identifier attached to the paper, and a reference position for reading a reference mark attached to the paper A reading step, correcting the position or inclination at which the clip holds the paper by the read reference mark, and acquiring at least the entry area information of the paper and the attribute information of the field name from the paper database based on the read identifier, The attribute information is output together with the detected handwriting data.

  In the handwriting output method according to the present invention, the identifier reading step for reading the identifier given to the paper and the reference position reading step for reading the reference mark on the paper may be performed by using the read result instead of the contact type line sensor. It is characterized in that the pen is read by causing the handwriting detection sensor to detect it with a pen that converts it into, and tracing over the identifier and the reference mark.

  The handwriting output program according to the present invention is a result of reading information read by handwriting input on the paper using a pen, the clip holding a paper having an entry area set beforehand and an identifier and a reference mark. In the handwriting output program for outputting, the computer includes a handwriting detecting step for detecting pen handwriting data, an identifier reading step for reading an identifier attached to the paper, and a reference for reading a reference mark attached to the paper. A position reading step, correcting the position or inclination of the paper held by the clip by the read reference mark, and obtaining at least the paper entry area information and field name attribute information from the paper database based on the read identifier. And the attribute information is output together with the detected handwriting data.

  According to the present invention, it becomes possible to recognize “what” is written in “which position” of “which paper” created in various formats, and these attribute information is added to the read information and output. be able to. In addition, without using dedicated paper on which fine blue dots indicating the position printed on the paper are printed in advance, the attributes of each field of the paper can be obtained by using paper and a paper database on which various normal formats are printed. There is an effect that handwritten input information associated with information can be read and output in real time.

  Hereinafter, embodiments of the present invention (hereinafter referred to as embodiments) will be described with reference to the drawings.

  FIG. 1 is a configuration diagram illustrating a configuration of a handwritten output clip 100 according to the first embodiment. A camera arm 107 is fixed to the clip body 102, and an optical camera 108 for detecting an optical position using optical aberration is fixed to the tip of the camera arm 107. Further, the clip presser 101 is incorporated into the clip main body 102 by the hinges 104 and 105 and the spring 106, and can hold the paper by sandwiching it. In addition, the clip main body 102 includes a line image sensor 103 for correcting a positional deviation of the paper and reading a bar code indicating the identification ID of the paper printed on the paper. Includes a controller and a control circuit (not shown), and data processed by these is sent to an external computer (not shown) via the connection cable 109.

  FIG. 2 is an overall configuration diagram illustrating a configuration of a handwriting output device that holds the paper 300 in the handwriting output clip 100 according to the first embodiment, reads the handwritten input by the dedicated pen 310, and outputs the handwritten input. The dedicated pen 310 includes the same ink cartridge 311 as that of a normal ballpoint pen, a circuit that detects that the pen tip has contacted the paper 300, and turns on the infrared LED 312 and a button battery (not shown). When the pen tip comes into contact with the paper, a handwriting is left on the paper with ink, and the optical camera 108 detects the light source of the infrared LED 312 and the coordinates of the pen tip are calculated by the controller based on the distance and the angle. A sheet reference position, a barcode for identifying the sheet, and a reference position mark 302 are printed on both sides of the sheet 300, and the bar code and the reference position mark 302 can be read by the line image sensor 103. Further, an entry field 301 that can be identified with the naked eye is printed on the sheet 300. As shown in FIG. 2, characters such as “name”, “age”, and “address” are urged to be entered in each entry field 301. Is printed, and this information is stored in a paper database to be described later. In this embodiment, the barcode and the reference position mark are printed on both sides, but may be printed only on the back side where the line image sensor is arranged.

  FIG. 3 is a diagram illustrating the second embodiment, in which the line sensor in the first embodiment is removed, and a paper identification ID is obtained by tracing the pen with a hand along a groove or edge provided in a handwritten output clip. FIG. 6 is a configuration diagram of a second embodiment showing a configuration of a clip that performs sheet position correction.

  Instead of the line image sensor 103 in the first embodiment, the photo detector (not shown) provided on the pen tip reads the barcode and the reference position mark 302 by tracing with a hand along a groove or edge provided on the clip. The optical camera 108 can detect by turning on the infrared LED 312 provided in the pen. With such a configuration, the line image sensor 103 can be omitted, cost can be reduced, and further downsizing can be achieved. In this case, needless to say, the barcode and the reference position mark are printed on the surface of the paper.

  FIG. 4 is a configuration diagram showing the configuration of the handwritten output clip in the third embodiment. The clip main body 202 includes a line image sensor 203 and a controller (not shown), and the processed result is output by the cable 209. Further, the clip presser 201 is incorporated into the clip main body 202 by hinges 204 and 205 and a spring 206.

  In the third embodiment, two optical cameras 208 and 211 are installed at the tips of camera arms 207 and 210 at both ends of the clip body 202. By using two optical cameras, it is possible to detect a handwriting on a wide sheet such as A3 or B3 at an increased cost. In this embodiment, the optical camera is used. However, it is needless to say that an ultrasonic sensor, a magnetic sensor, and a combination of these sensors can be preferably used in place of the optical camera.

  FIG. 5 is a schematic diagram showing a bar code indicating an ID for identifying a sheet given to the sheet and a position mark for detecting a positional deviation of the sheet in the present embodiment. On the left side of the sheet, there are 'N' type position marks 61 to 65 indicating positions, bar codes 51 to 54 on which IDs for identifying the sheets are recorded, and n bar codes 51 to 51 alternately with position marks. 54 is printed.

  FIG. 6 shows a state in which misregistration is detected using a bar code indicating an ID for identifying a sheet given to the sheet and a position mark in the present embodiment (a), (b), (c). It is a schematic diagram of a kind. In the figure, the double line indicates the position of the line image sensor, and is an enlarged view of the position mark and part of the bar code shown in FIG. (A) shows a state in which a line image sensor having a certain length is translated. In this case, the position in the depth direction can be determined by changing the interval across the 'N' type position mark 1 (61), the barcode 1 (51), and the position mark 2 (62). The position can also be determined. (B) shows a state in which the sheet is inclined with respect to the line image sensor. In the same manner, the right and left depths change with barcode 1 (51) in between, and the interval between ‘N’ and ‘N’, which does not change originally, changes, so that the inclination can be determined. (C) shows a state in which parallel movement and inclination are combined. Similarly, it is possible to determine the position in the depth direction and the horizontal direction based on the interval across the 'N' type position mark and the barcode 1 (51) and the interval between 'N' and 'N' which does not change originally. . In this embodiment, the “N” type position mark is used. However, a reference mark may be formed by combining non-linear curves to detect the reference position.

  FIG. 7 is a schematic diagram showing a position mark of a sheet given to the sheet and a reading sensor in the present embodiment. Instead of position marks, rectangular marks such as glyphs or two-dimensional barcodes are printed on the paper, and the clips are provided with reading sensors 71 and 72 that can read the rectangular marks. Since the marks indicate individual positions, the coordinates and inclination on the paper can be obtained from two reading values. In this embodiment, the position mark and the barcode are read by the optical sensor. Instead of the position mark and the barcode, a notch, a rectangular hole, an embossed unevenness, or a wireless IC tag is used. Needless to say, it is possible to suitably obtain the position and inclination by providing the sheet.

  FIG. 8 is a schematic diagram illustrating an example of a position detection sensor using the optical aberration used in the first embodiment. In FIG. 8, the light emitted from the point light source 1 provided on the pen enters the plane which is the first surface of the hemispherical lens 2 as indicated by the locus 4 of the light source. Here, light is refracted according to Snell's law. Next, the light reaches the second lens surface of the spherical shape and is refracted. Since the second surface is a spherical surface, the light is collected on the optical axis. However, since the spherical aberration of the lens is large, the light is not collected at one point. It is focused on a certain range.

  When the light beam is traced, the light beam passing through the lens region close to the optical axis is collected on the optical axis far from the lens, but the light beam passing through the lens region far from the optical axis is collected on the optical axis close to the lens. I understand that. Therefore, when the light receiving surface of the light receiving element 3 such as a CCD sensor is installed at a position on the optical axis as shown in FIG. 8, the light position on the light receiving surface is the same as the light moves away from the vicinity of the optical axis of the lens. However, when the light further moves away from the optical axis of the lens, the effect of refraction by the lens increases and begins to approach the optical axis.

  In other words, as the light passing through the lens moves away from the optical axis, the light first moves away from the optical axis on the light receiving surface, then turns back and approaches the optical axis, and further passes through the optical axis and spreads to the opposite side. It shows the behavior to go.

  On the two-dimensional plane of the light-receiving surface, the turning point is a circle centered on the optical axis, and further, since the turning point is a light concentration region with high light density, an optical ring is formed. The coordinates of the light source can be measured from these signals. In the present embodiment, the light ring is measured, and the arithmetic unit 9 calculates the coordinates of the light source.

  FIG. 9 is a block diagram illustrating functional blocks of the handwriting output device according to the present embodiment. A clip 420 indicated by a dotted line is centered on a controller 406 that controls the paper, a misalignment detector 407 of the paper 300, a paper identifier detector 408 that detects the paper identifier, a paper entry field and area based on the paper identifier There is a paper database 409 in which information, character type, etc. are stored, and a communicator 410 for communicating with an external computer (not shown), and these power sources are supplied by a battery or a power line (not shown).

  The dedicated pen 310 includes a contact switch 402 that detects contact with the paper 300 and an infrared light emitter 401. Further, a pen position detection sensor 403 that detects infrared rays and a contact determination unit 404 that determines that the pen tip has contacted the paper 300 are connected to the handwriting detector 405, and the handwriting detected by the handwriting detector 405 is connected to the clip 420. Is sent from the communication device 410 to an external computer (not shown) together with attribute information obtained from the paper ID by the controller 406.

  FIG. 10 is a flowchart showing the flow of processing of the handwriting output device in the present embodiment. The flow of processing is shown using FIG. 9 and FIG.

  First, in step S10, the barcode printed on the paper 300 and the position mark 302 are captured as a digital image by the line image sensor 203, and the reference mark is recognized by the misalignment detector 407 (step S10). The positional deviation of the sheet is detected by the bar code and the reference mark 302 and stored in a memory (not shown) inside the controller 406 (step S11). Next, the identification ID of the sheet is recognized from the output of the sheet identifier detector (step S12).

  Based on the identification ID, the controller 406 identifies the sheet currently held in the clip 420, and reads the entry area, field name, and character type (step S13). Next, the vector information of the handwriting detected by the handwriting detector 405 is read (step S14), and the field name and character type corresponding to the entry area are combined with the entry area read from the paper database 409, and in step S15. The detected handwriting vector information is output through the communication device 410. Further, in step S16, an end determination is made. If not completed, the process is repeated. When the end of the entry process printed on the paper is marked or the paper is removed from the clip, the handwriting detector 405 generates an end signal. The end of input is detected and the process is terminated.

  FIG. 11 is a schematic diagram showing an outline of the attribute information table stored in the paper database in the present embodiment. The ID shown in FIG. 11 is set when the paper is created, and the paper size, the paper name, the field name to be entered on the paper, the X, Y coordinate system with the upper left corner of the paper as the origin, and the coordinates of the upper left and lower right coordinates of the box The type of the character that is specified and entered last is set.

  In the present embodiment, a customer registration form is created by a document creation application, each entry area is indicated by coordinates with the entry field as “name”, “address”, “phone number”, “age” and “profession”, and is a guideline at the time of OCR conversion. We used a paper database that entered 'Kanji', 'Numbers', 'English characters', etc.

  In this embodiment, a paper database is constructed using a nonvolatile memory inside the clip. However, a similar function may be realized by constructing a paper database with an external computer and communicating with the external computer. In the present embodiment, the handwriting detector outputs handwriting vector data to an external computer, but it goes without saying that the controller 406 performs OCR processing together with attribute information and outputs the text data.

It is a block diagram which shows the structure of the handwritten output clip in 1st Embodiment. It is a whole lineblock diagram showing the composition of the handwriting output device which holds the paper in the handwriting output clip in a 1st embodiment, and outputs the content inputted by handwriting with the pen. It is a figure which shows the structure of 2nd Embodiment, removes the line sensor in 1st Embodiment, and identifies paper identification ID and paper by tracing a pen along the groove | channel or edge provided in the handwritten output clip. It is a block diagram of 2nd Embodiment which showed the structure of the clip which performs position correction of this. It is a block diagram which shows the structure of the handwritten output clip in 3rd Embodiment. FIG. 6 is a schematic diagram illustrating a barcode indicating an ID for identifying a sheet assigned to a sheet and a position mark for detecting a positional deviation of the sheet in the present embodiment. Three types of schematic diagrams (a), (b), and (c) showing a state in which a positional deviation is detected by using a bar code indicating an ID for identifying a sheet given to the sheet and a position mark in the present embodiment. It is. FIG. 6 is a schematic diagram illustrating a position mark of a sheet given to the sheet and a reading sensor in the present embodiment. It is a schematic diagram which shows an example of the position detection sensor using the optical aberration used for 1st Embodiment. It is a block diagram which shows the functional block of the handwriting output device in this embodiment. It is a flowchart which shows the flow of a process of the handwriting output device in this embodiment. It is a schematic diagram which shows the outline | summary of the attribute information table memorize | stored in the paper database in this embodiment.

Explanation of symbols

  1 point light source, 2 hemispherical lens, 3 light receiving element, 4, 5 locus, 9 arithmetic unit, 61-65 position mark, 51-54 bar code, 71, 72 sensor, 100 output clip, 102, 202 clip body, 103 lines Image sensor, 104, 105 hinge, 106 spring, 107 camera arm, 108, 208, 211 optical camera, 109 connection cable, 300 paper, 301 entry field, 302 reference position mark, 310 dedicated pen, 311 ink cartridge, 312 infrared LED , 401 Infrared light emitter, 402 Contact switch, 403 Pen position detection sensor, 405 Handwriting detector, 406 Controller, 407 Misalignment detector, 408 Paper identifier detector, 409 Paper database, 404 Contact determination device, 410 Communication , 420 clip.

Claims (7)

In a handwriting output device that has a clip for holding a sheet to which an entry area is set in advance and an identifier and a reference mark are provided, reads information handwritten on the sheet using a pen, and outputs the read result ,
The clip
A handwriting detection sensor for detecting pen handwriting data;
Identifier reading means for reading the identifier given to the paper;
A reference position reading means for reading a reference mark given to the paper;
With
The position or inclination of the paper held by the clip is corrected by the read reference mark, and at least the entry area information of the paper and the attribute information of the field name are acquired from the paper database based on the read identifier, and the attribute information together with the detected handwriting data A handwriting output device characterized in that The handwriting output device according to claim 1,
The handwritten output device is characterized in that the identifier and the reference mark given to the paper are constituted by at least a barcode, a position detection mark, a notch, a hole or an embossing for specifying the paper. The handwriting output device according to claim 1,
The handwriting detection sensor
An optical lens system that forms a light concentration region by spherical aberration; and
A light receiving element for detecting a light concentration region formed by the optical lens system;
Including
A handwriting output device that detects a handwriting of a pen having a light source by one or two cameras based on detection information of a light concentration area detected by the light receiving element. The handwriting output device according to claim 1,
The handwriting output device, wherein an identifier reading unit that reads an identifier given to the sheet and a reference position reading unit that reads a reference mark of the sheet are read by a contact line sensor. In a handwriting output method that has a clip for holding a sheet with a pre-filled area and an identifier and a reference mark, reads information input by handwriting on the sheet using a pen, and outputs the read result ,
A handwriting detection process for detecting pen writing data;
An identifier reading step of reading an identifier assigned to the paper;
A reference position reading step of reading a reference mark given to the paper;
With
The position or inclination of the paper held by the clip is corrected by the read reference mark, and at least the entry area information of the paper and the attribute information of the field name are acquired from the paper database based on the read identifier, and the attribute information together with the detected handwriting data Is output. The handwriting output method according to claim 5,
The identifier reading step for reading the identifier given to the paper and the reference position reading step for reading the reference mark on the paper are detected by a handwriting detection sensor with a pen that converts the reading result into light instead of the contact type line sensor. A handwriting output method, wherein the pen reads by tracing the identifier and the reference mark. In a handwriting output program that has a clip for holding a sheet in which an entry area is set in advance and an identifier and a reference mark are provided, reads information handwritten on the sheet using a pen, and outputs the read result ,
Computer
A handwriting detection step for detecting pen handwriting data;
An identifier reading step of reading an identifier assigned to the paper;
A reference position reading step of reading a reference mark given to the paper;
Run
The position or inclination of the paper held by the clip is corrected by the read reference mark, and at least the entry area information of the paper and the attribute information of the field name are obtained from the paper database based on the read identifier, and the attribute information together with the detected handwriting data A handwriting output program characterized by outputting.

Images