JP2009282727A - Digital pen data processor - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a digital pen data processor for visually and electronically erasing handwritten information with a digital pen. <P>SOLUTION: A digital pen for writing and a digital pen for erasure are prepared, and when handwriting is desired to be erased by correction or the like, the handwriting is actually erased by using a digital pen for erasure. Unique pen ID is assigned to each of the digital pen for writing and the digital pen for erasure, and whether writing is performed with a normal ink refill or a sheet is followed by an erasure refill is recognized on the basis of the ID. The data indicating which of them is used are also recorded in the handwriting data. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a data processing apparatus using a digital pen, and more particularly to a digital pen data winning apparatus capable of visually and electronically erasing handwritten information by a digital pen.

A method of digitizing handwritten information and using it for document management has been studied. Recently, there is a system for acquiring handwritten information called digital pen as digital data. In such a system, a device that reads the address information of the paper, for example, a device such as a camera, is mounted on a pen that actually writes using ink, and the user writes as if using a normal pen. The handwritten information can be acquired as digital data by reading the address information of the position written by the system. Since current digital pens are generally pens that use ink, once written, they cannot be erased.
On the other hand, as a method of erasing written handwriting information, handwriting information acquired as digital data can be virtually changed in ink color. For example, by setting to white ink, the handwriting is virtually erased. Such a method can be considered. However, in this case, handwriting information electronically erased with white ink remains on the actual paper, so that the appearance on the actually written paper and the appearance of the digital data are different.

  To eliminate the discrepancy between the actual handwriting and the handwriting of the digital data, use a pencil instead of ink and erase the actual handwriting using an eraser to match the appearance on the actual written paper Is also possible. However, in the erasing method using an eraser or the like, when erasing, erase scraps are generated and impurities are attached to the paper. These impurities cause a problem when the digital pen reads the address data of the paper, and the digital pen cannot read the address data correctly, and thus there is a practical problem, for example, a problem that rewriting cannot be performed. In addition, a method using a so-called correction liquid that considers that the handwriting has been erased by overcoating the white ink on the handwriting can be considered. There is a problem that the pen cannot read the address data attached to the paper, and the writing at the same place cannot be read as data.

Thus, in the conventional erasing method, rewriting to the erasing area is hindered.
In recent years, products that can erase actual writing have been developed even for pens using ink, such as ballpoint pens. Pens that can erase these inks use, for example, silicone rubber to trace the actual ink handwriting, thereby changing the physical properties of the ink by its frictional heat, making the ink itself transparent and eliminating the apparent handwriting. Is. In this case, since the silicon rubber does not generate swarf, it does not affect the address reading performance of the digital pen paper even after erasing. However, if such erasable ink is used, the address reading performance is not affected. However, the information actually written on the paper and the erased information and the digital data are taken in and stored as electronic data. Currently, there is no method for matching the information to be written, and it is necessary to check the match between the written data and the erased information with the electronic data.

  A writing digital pen for writing and a erasing digital pen for erasing handwriting are prepared, and writing is usually performed using a digital pen for writing. When it is desired to erase the handwriting by correction or the like, the actual handwriting is erased by using a digital pen for erasing. A unique pen ID is assigned to each of the writing digital pen and the erasing digital pen. Data is transmitted from each pen to a server such as a PC. In the server, handwriting data transmitted from the writing digital pen is acquired as actual writing data, and handwriting data transmitted from the erasing digital pen is acquired as erasing data. In the digital pen used in the present invention, the writing time is also included in the handwriting data, so by processing the handwriting data of both pens in chronological order, it is possible to distinguish the portion that is not erased from the portion of the handwriting. .

  In addition, according to one feature of the present invention, both ink refill and erase refill can be mounted as a digital pen, and writing is performed with a digital pen that can be used by switching between these. The dual-purpose digital pen recognizes whether you are writing with normal writing ink refill or tracing paper with erasing refill, and the handwriting data also records and retains which data is being used. Has been. The digital pen transmits data to a server such as a PC. The server erases the erasure by processing the handwriting data in chronological order while distinguishing whether the handwriting data is written information in normal ink or erased information traced by erasure refill. An area and a handwriting area that is not erased can be distinguished.

  Below, the concrete realization method in this invention is demonstrated according to a flow. These embodiments are merely examples for realizing the present invention, and the present invention can be realized by methods other than the embodiments shown here.

  First, a method for handwriting input will be described in detail. In the present embodiment, handwriting input is performed by the Anoto method.

  FIG. 1 is an example of a configuration showing a digital pen data processing apparatus of the present invention. It comprises a writing digital pen 101, an erasing digital pen 102, a writing / erasing process analysis server 103, a data transmission box 104, and Anoto paper 105. The user writes on the anoto sheet 105 using the writing digital pen 101 and erases the written locus using the erasing digital pen 102.

  FIG. 2 shows a configuration example of the writing / erasing process analysis server 103. The server 103 includes a CPU 10301, a program storage memory 10302, and a hard disk 10303. The program storage memory 10302 includes a system program 1030201, a data transmission / reception program 1030201, and a writing / erasing process analysis program 1030203. The hard disk 10303 includes pen event (writing locus) data 1030301, erasure event (erasing locus) data 1030302, and paper format data 1030303.

FIG. 3 is a schematic diagram showing an outline of one structural example of the digital pen 100 that can be used as the writing digital pen 101 or the erasing digital pen 101 used in the present invention. The digital pen 100 includes an ink refill 111, a pressure sensor 113, an optical module 115, a camera 117, a light irradiation device 119, a battery 121, a CPU 123, a memory 125, a clock 129, a USB (Universal Serial Bus) 131, a wireless communication system 133, and a vibration. A child 135 and an LED (Light Emitting Diode) 137 are provided. The increfill 111 stores the ink for recording the handwriting by transferring the ink to paper as in the case of a normal writing pen.
In one embodiment of the present invention, a special erasing refill for erasing may be loaded instead of or together with the writing ink fill 111. The pressure sensor 113 is a means for detecting that the user is performing handwriting input or erasing operation with the writing digital pen 101 or the erasing digital pen 102, and the pressure sensor 113 detects pressure during handwriting input.

  The optical module 115 includes a camera 117 and a light irradiation device 119, and detects handwriting by receiving light from the light irradiation device 119 by the camera 117. The camera 117 is a light receiving device for receiving light irradiated from the light irradiation device 119 and reflected by a dedicated paper (hereinafter referred to as “Anoto paper”) 105 used in the Anoto method. The light irradiation device 119 is a device that emits light for receiving light by the camera 117. The light here uses infrared rays. However, as long as the light is received by the camera 117 and can be detected by the optical module 115, the light is not limited to infrared rays but may be light of another wavelength.

  The battery 121 is a power supply unit for supplying power to each unit constituting the writing digital pen 101 and / or the erasing digital pen 102. The CPU 123 is a control unit that is incorporated in the writing digital pen 101 and the erasing digital pen 102 and controls them. The memory 125 is storage means for storing data in the writing digital pen 101 and the erasing digital pen 102.

  The clock 129 is time measuring means for measuring a time during which handwritten input is performed, for example, a writing time and an erasing time. The USB 131 is data transmission means for transferring handwriting information such as handwriting or erasure information input by the writing digital pen 101 or the erasing digital pen 102 to a connected electronic device. The wireless communication system 133 is data transmission means for transmitting handwriting information and erasure information and their position information to other electronic devices provided with wireless communication means. As the wireless communication means, a Bluetooth (registered trademark) system or the like is preferably used, but is not particularly limited.

If one of the USB 131 and the wireless communication system 133 is provided, the handwritten information sharing system according to the present invention can operate even if the other is not provided. The vibrator 135 is a means for transmitting information to the user by vibration. The LED 137 is a notification unit that conveys information to the user by lighting or blinking. If one of the vibrator 135 and the LED 137 is provided, information can be transmitted to the user even if the other is not provided. Alternatively, notification may be performed by sound such as a buzzer.
In order for the digital pen 101 to record handwritten information, it is necessary to perform handwriting input on the Anoto paper 16. FIG. 4 is a schematic diagram showing a configuration example of the Anoto sheet 105 used in this embodiment. On the Anoto sheet 105, dots 24 having the same diameter are printed so that the outer circumferences are in contact with the intersections 25 of the lattices 23 at regular intervals. The dot 24 may be printed in a color that cannot be identified by the human eye as long as it can be detected by the optical module 115. For example, when the built-in camera 117 in the digital pen is an infrared camera, the point 24 can be detected by the optical module 115 because the entire paper 15 reflects infrared rays and the point 24 is printed with ink that absorbs infrared rays. is there.

Further, the grid 23 does not need to be actually seen, and may be an imaginary grid. As the interval between the lattices 23 is shorter, an image with higher resolution can be obtained. In the present embodiment, considering the reading accuracy of the optical module 115, about 0.3 mm is preferable. In this case, the diameter of the point 24 is preferably 80 to 120 microns. However, these values are not particularly limited.
The point 24 is printed at a position shifted from the intersection 25 of the lattice 23 in any of the upper, lower, left and right directions. The information in the four directions (up, down, left and right) can be 2-bit information. That is, each point 24 has 2 bits of information, and 6 × 6 36 intersections 25 and points 24 located above, below, left and right have 6 × 6 × 2 = 72 bits. Become. The Anoto sheet 105 is recorded as position information by changing the vertical and horizontal arrangement of the points 24 for each of the 6 × 6 36 intersection areas.

  The digital pen 100 captures the 24 points of the Anoto paper 105 by the built-in camera 117 from 50 to 100 times per second, detects the arrangement of the 24 points by the optical module 115, and the positional information of the Anoto paper 16 from the detected arrangement. To get. In this manner, the digital pen 100 can detect and record which position on the anoto sheet 16 is entered when the user performs handwriting input.

Next, the ink used in the present invention and the mechanism for erasing the ink will be described in detail.
The ink used in the present invention is a liquid or gel-like solid as in the case of normal ink, and there are inks of various colors. This liquid has a unique visible color at room temperature, but has a characteristic that when the temperature exceeds a certain temperature, the color of the ink itself disappears and becomes transparent. This ink is loaded into the refill 111 and is mounted on the digital pen 100 in the same manner as a normal refill. The user can write without changing from normal refilling. When the written ink is traced with silicon rubber, frictional heat is locally generated at the contact point between the paper and the rubber, and when this heat exceeds the denaturation (discoloration) temperature of the ink, the ink becomes transparent. Will be erased. At this time, silicon rubber or the like is intended to generate frictional heat, and it is important to select a material that does not generate swarf or the like due to friction with the paper. In the present invention, the method for erasing the handwriting is not limited to this.

  Next, the writing digital pen 101 and the erasing digital pen 102 for erasing the writing will be described. A digital pen 101 equipped with the writing ink refill described above and an erasing digital pen 102 equipped with an erasing refill for erasing the handwriting are prepared. A digital pen with a writing refill is a digital pen with an ink refill that uses an ink that changes from visible to transparent by applying a certain amount of heat, as described in the mechanism for erasing ink. That is, writing can be performed in the same manner as a digital pen equipped with an ink refill loaded with normal ink.

  A digital pen for erasing handwriting (hereinafter referred to as an erasing digital pen) is a digital pen with all equivalent functions, such as an optical component that reads address information on paper and an address calculation unit, as with a normal digital pen. The only difference is that there is no ink refill for writing, and there is a refill shape with silicon rubber used for erasing ink at the tip where the ink refill was installed. The stick is attached. Since this bar has the same shape as the ink refill, a digital pen having the same structure as the writing digital pen can be used.

  Similarly to the writing digital pen, this erasing digital pen can be used to write on the paper, thereby obtaining information on where the erasing refill made of silicon rubber or the like has moved on the paper. To fill in the Anoto paper with the erasing digital pen means that the handwriting previously written in the writing portion is erased.

  The writing digital pen and the erasing digital pen record all handwriting information of each pen. Each pen can transmit handwriting data to a server such as a PC or a server. There are two methods for transmitting data from the digital pen to the server: a method of transmitting via USB (abbreviation) and a method of transmitting by wireless communication using Bluetooth. As for the transmission timing, the digital pen temporarily stores the written data in the memory provided in the digital pen, and transmits it in a batch later. When the user is writing, the data is instantly stored in the server. There is a way to send to. Regardless of which transmission method is used, the data received and processed on the server side is the same. In this example, the writing data and the erasure data are transmitted to the writing / erasing process analysis server 103 via the pen data transmission box 104.

  The writing / erasing process analysis server 103 analyzes the received data. Each of the writing digital pen and the erasing digital pen has a unique identification number (hereinafter referred to as a pen ID). The data transmitted from the digital pen 100 to the server 103 includes this ID, and on the server side, it is possible to link which digital pen is the received data.

The data transmitted from the digital pen to the server also includes information on the writing time (writing start time, writing end time, writing time zone). Therefore, the server can reproduce the handwriting data along the time series written by the user.
The user writes with normal writing using the writing digital pen 101 equipped with an ink refill filled with ink. If you want to erase the handwriting, such as correcting an error, trace the handwriting you want to erase using the erasing digital pen 102 equipped with a silicon rubber for erasing and a special refill stick. .
The handwriting data written by the writing digital pen 101 and the trajectory moved on the Anoto paper surface by the erasing digital pen 102 are temporarily stored in the memory in each digital pen, and then collectively transmitted to the server 103. When the handwriting data of the erasing digital pen 102 is received, the relationship between the handwriting and the handwritten handwritten previously is determined from the coordinate data, and the handwritten handwriting of this time (erased area) is duplicated The process which erases the part to perform is performed. The server extracts time information of each handwriting data and integrates each data in time series.

  By following this procedure, the visible handwritten information actually written and the electronic handwritten information on the data can be made the same. Specifically, processing is performed in the following steps. First, as shown in FIG. 5, desired writing is performed on the Anoto paper 105 using the writing digital pen 101. Next, when it is desired to erase the written portion, as shown in FIG. 6, the handwriting such as a character string to be erased is erased using the erasing digital pen 102. The written trajectory data and erased trajectory data are stored in a database as shown in FIG. The pen operation state database includes a state ID 700, a pen ID 701, an operation start time 702, an operation time zone 703, an operation area 704, and an operation frame 705. An operation frame 705 indicates an area to be written that is registered as the paper format data 1030303. For example, as the answer area for the question, the answer area for question 1 is the action frame “1”, and the answer area for question 2 is the action frame “2”.

  In the same pen ID, when the gap time from the writing end time to the next writing start time becomes, for example, 1 s, a state ID is newly generated, and also when the pen is changed, the state ID Is newly generated. For each pen ID, the time when writing starts or erasure starts is recorded, and the operation time zone is calculated from the operation start time and end time. Further, the grid 23 of the Anoto paper 105 that the pen has passed between the operation start time and the end time is recorded as point data. As the position information of the Point data, there is a Point data position information database, and by referring to this database, a writing locus area and an erasure locus area, which are operation areas in each state ID, are calculated. As a method for calculating an erasable area, a point data group that is a writing trajectory area that overlaps a point data group that is an erasing trajectory area is searched, and the writing position in the common point data is erased. Using the point data group registered in FIG. 7 as the object of writing and erasing, it is determined whether it is a partial area or the entire area of the writing trajectory area in the state ID, and FIG. Register in the written / erased state management data shown.

  8 includes a state ID 801 indicating a writing trajectory, an operation frame 802, data 803 indicating operation contents, the number of times of partial erasing 804, and the number of in-area additions 805. For example, in the state ID1 that is a writing locus, first, when a new writing is performed, a state ID (writing locus) is generated and registered as the state ID1. At this time, an action frame including the writing locus is specified, and the number of the frame is registered. When the point group which is the Anoto lattice that is assumed to have passed in the initial state overlaps with the point group that the erasing digital pen 102 has passed, and the overlapping portion is a part of the initial state, partial erasure is performed. As a result, “1” is registered in the operation content data 803, and the number of partial erasures is incremented. Furthermore, if the point group that the erasing digital pen passed through overlaps the point group that remains after partial erasing, and the overlapping part is a part of the initial state, further partial erasing was performed. As a result, the partial erase count is incremented. When all the initial point groups are erased, “2” is registered in the operation content data 803 as the entire area erase. If the writing trajectory subsequently overlaps with the erased point group, “3” is registered as the in-area addition in the operation content data 803, and the in-area addition count is incremented. .

An example of a block diagram showing a system configuration of an embodiment of the present invention. An example of the block diagram which shows the structure of the server 103 for a writing / erasing process analysis. Example of writing / erasing digital pen. Anoto paper example. One screen example of the writing situation. One screen example of the writing situation. An example of a pen operation state database. An example of the data structure of writing / erasing state management data. Explanatory drawing of the apparatus operation | movement flow of embodiment of this invention.

Explanation of symbols

  101: Digital pen for writing, 102: Digital pen for erasing, 103: Server for writing / erasing process analysis, 104: Pen data transmission box, 105: Anoto paper

Claims (3)

In a digital pen data processing device that records handwritten information written on paper, transmits the handwritten information, and receives and processes the transmitted handwritten information,
A digital pen capable of acquiring the address data from the paper on which the address data is printed; a server connected to the digital pen so as to be communicable; and means for generating information written on the paper from the address data. The digital pen has a writing digital pen for writing and an erasing digital pen for erasing, and the erasing digital pen has a function of visually erasing information written on the paper; A digital pen data processing device having a function of detecting an electronic erasure area corresponding to a visible erasure area. The digital pen data processing device according to claim 1,
The digital pen has a unique identification number, has handwriting and erasure time information, and determines the overlap of handwriting based on the time information of each writing digital pen and erasing digital pen, and is written on the paper A digital pen data processing apparatus characterized in that visible handwriting information and electronic handwriting information stored as data are the same. In the digital pen data processing device according to claim 1 or 2,
The handwriting data has time information, the digital pen movement process is extracted from the time information of the handwriting and the time information of the erasure. A digital pen data processing device characterized in that the stored handwriting information and erase information of a digital pen are made to coincide.

Images