JP2004127199A - Document for electronic pen, and document entry content textization system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a textization system in which contents entered on a document are converted into text data without recognizing characters. <P>SOLUTION: In the document entry content textization system, a user enters required matters on the dedicated document with an electronic pen. The electronic pen supplies entry data corresponding to the entered matters to a server. In the server, position data and stroke data are first acquired from the entry data and converted into text data corresponding thereto. In the system, the contents are textized without recognizing characters, so that accuracy in textization is improved. <P>COPYRIGHT: (C)2004,JPO

Description

[0001]
TECHNICAL FIELD OF THE INVENTION
The present invention relates to a form entry contents text conversion system that converts contents entered in a dedicated form using an electronic pen into text data without character recognition.
[0002]
[Prior art]
For example, there is an automobile maintenance form used at an automobile maintenance shop when each maintenance person keeps a record of each maintenance of the automobile. Conventionally, each time a mechanic performs car maintenance, he or she manually writes necessary items such as a maintenance work date, a worker in charge, a customer name, and a maintenance record in the form using a ballpoint pen or the like. The information entered in the form is often converted to text data to enable secondary use such as customer management.In such a case, the operator inputs the content using a keyboard. Had to be converted to text data. For example, based on the contents entered by the maintenance staff on the maintenance report, the operator uses the terminal device to enter characters such as “June 21st, worker No. 250, customer No. 338, right front tire change and oil change” using a terminal device and keyboard. I had to enter it, which was very annoying.
[0003]
On the other hand, as a technique for converting handwritten characters into text, a character recognition system (OCR system) is also known. In the OCR system, a handwritten character written on a form by a user with a pen is read by an optical device such as a scanner, converted into electronic data, and further converted into text data by character recognition software.
[0004]
[Problems to be solved by the invention]
However, the conventional OCR system cannot recognize handwritten characters with 100% accuracy, and cannot convert the information entered by a user into a text accurately.
[0005]
In such a situation, in order to eliminate the inconvenience associated with the conversion to text, a pen-type input device that has recently appeared, such as an “electronic pen” or a “digital pen” (hereinafter, referred to as an “electronic pen” in this specification) .), "Anoto pen" developed by Swedish company Anoto has attracted attention.
[0006]
The anoto pen is used as a pair with a special paper on which a predetermined dot pattern is printed. The Anoto pen is equipped with a small camera for reading a dot pattern on dedicated paper and a Bluetooth compatible communication unit in addition to a normal ink type pen tip. When a user writes characters or the like on an exclusive paper with an anoto pen, a small camera detects a dot pattern on the exclusive paper as the pen moves, and input data such as characters written by the user is acquired. The input data is transmitted from the Anoto pen to a nearby terminal device such as a personal computer or a mobile phone by a Bluetooth-compatible communication unit.
[0007]
However, if this anoto pen is used, it is possible for the user to directly acquire the contents described in the form as image data, and the work of reading the contents of the form with an optical device such as a scanner can be omitted. A character recognition system had to be used, and it was impossible to convert the text to 100% accuracy.
[0008]
The present invention has been made in view of the above points, and it is an object of the present invention to provide a text conversion system that can convert the contents entered in a form into text data without character recognition.
[0009]
[Means for Solving the Problems]
In one aspect of the present invention, a form entry text conversion system is a form entry content conversion system that converts the content of a form into text data without recognizing characters, wherein a predetermined dot pattern is printed. An electronic pen that optically reads the dot pattern from the form, obtains entry data corresponding to the content entered by the user in the form, and transmits the data to the terminal device, and an electronic pen transmitted from the electronic pen. The terminal device that receives the entry data and transmits it to the server via the network, and receives the entry data transmitted from the terminal device, and indicates from which location on the form the user has entered the entry from the entry data. Acquires position data, and associates the position data with text data prepared in advance for each position of the form. It allows and a server for converting the entered data into text data.
[0010]
According to the form entry contents text conversion system, the user enters necessary items on the form with the electronic pen. The electronic pen generates entry data such as stroke information and position information corresponding to the entry, and supplies the entry data to the server. In the server, first, position information is obtained from the entry data, and the position information is converted into text by associating the position information with text data prepared in advance for each position information. That is, text data is converted into text data prepared in advance for each position on the form, not on what the user wrote on the form, but on the position of the handwriting on the form. As a result, since there is no need to perform character recognition (recognition of what has been written), it can be converted to text with 100% accuracy.
[0011]
In one form of the form entry content text conversion system, the server acquires not only the position data but also the stroke data from the entry data received from the terminal device, and obtains the stroke data and the stroke data in advance for each of the stroke data. The entry data is converted into text data by associating it with the prepared text data.
[0012]
By using the stroke data to convert it to text, the text data is converted into text data prepared in advance depending on where and what kind of handwriting is present, so that more complicated and diverse text conversion is possible.
[0013]
According to another aspect of the present invention, there is provided a dot pattern printed so as to be readable by an electronic pen, and an entry column, and the dot pattern printed in the entry column is associated with predetermined text information. Form is provided.
[0014]
According to the above-described form, when a user makes an entry in an entry field printed on the form, text data corresponding to the entry field can be specified. Therefore, text data can be obtained accurately using the electronic pen.
[0015]
According to another aspect of the present invention, there is provided a form readable by an electronic pen and having an entry field, wherein the position information of the entry field on the form is associated with predetermined text information. You.
[0016]
According to the above-described form, when the user makes an entry in an entry field printed on the form, the user can specify the text data corresponding to the position information of the entry field on the form. . Therefore, text data can be obtained accurately using the electronic pen.
[0017]
BEST MODE FOR CARRYING OUT THE INVENTION
Hereinafter, preferred embodiments of the present invention will be described with reference to the drawings.
[0018]
[Electronic pen]
First, the electronic pen will be described. FIG. 1 is a diagram schematically showing a usage form of the electronic pen, and FIG. 2 is a functional block diagram showing a structure of the electronic pen. As shown in FIG. 1, the electronic pen 10 is used in combination with a form 20 on which a dot pattern is printed. The electronic pen 10 has a pen tip 17 similar to a normal ink pen, and a user writes a character or the like on a form 20 similarly to a normal ink pen.
[0019]
As shown in FIG. 2, the electronic pen 10 includes a processor 11, a memory 12, a Bluetooth transceiver 13, a battery 14, an infrared LED 15, a camera 16, and a pressure sensor 18 therein. The electronic pen 10 has an ink cartridge (not shown) as a component similar to a normal ink pen.
[0020]
The electronic pen 10 does not convert the locus of ink drawn on the form 20 by the pen tip portion 17 into data, but converts the locus coordinates of the movement of the electronic pen 10 on the form 20 into data. While the infrared LED 15 illuminates the vicinity of the pen tip 17 on the form 20, the camera 16 reads the dot pattern printed on the form 20 and converts it into data. That is, the electronic pen 10 can acquire a stroke generated by the user moving the electronic pen 10 on the form 20 as image data or vector data.
[0021]
The pressure sensor 18 detects a pressure applied to the pen tip portion 17 when a user writes a character or the like on a form using the electronic pen 10, that is, a writing pressure, and supplies the pressure to the processor 11. The processor 11 switches on / off the infrared LED 15 and the camera 16 based on the pen pressure data provided from the pressure sensor 18. That is, when a user writes a character or the like on the form 20 with the electronic pen 10, pen pressure is applied to the pen tip portion 17. Therefore, when the writing pressure equal to or more than the predetermined value is detected, it is determined that the user has started the description, and the infrared LED 15 and the camera 16 are operated.
[0022]
The camera 16 reads the dot pattern on the special paper 20 and supplies the pattern data to the processor 11. The processor 11 calculates X / Y coordinates on the form from the supplied dot pattern.
[0023]
The processor 11 acquires the pen pressure array data and the X / Y coordinate data while the user is being described, and stores them in the memory 12 in association with the time stamp (time information). Therefore, data corresponding to the description content of the user is stored in the memory 12 in chronological order. The capacity of the memory 12 can be, for example, about 1 Mbyte.
[0024]
All acquired data is held in the memory 12 until a transmission instruction is issued by the user. When the user gives a transmission instruction, the data in the memory 12 is transmitted by the Bluetooth transceiver 13 to the terminal device 25 located within a predetermined distance from the electronic pen 10. Basically, once a transmission instruction is given, the electronic pen 10 transmits all data stored in the memory 12 to the terminal device 25, so that the memory 12 is cleared. Therefore, if the user wants to transmit the same information to the terminal device 25 again after the transmission, the user needs to describe the information on the form 20 again. In this case, the user has only to trace characters written on the form 20 with an ink pen.
[0025]
The electronic pen 10 itself does not have a function button such as a send button, and a transmission instruction and other instructions are executed by a user checking a dedicated box provided at a predetermined position on the form 20 with the electronic pen 10. Is done. A transmission instruction is previously associated with the position coordinates of the dedicated box. When the processor 11 receives the position coordinates of the dedicated box, the processor 11 supplies the data in the memory 12 to the Bluetooth transceiver 13 and transmits the data to the terminal device 25. Let it do. Note that the electronic pen 10 does not have a display, buttons, or the like, but the completion of data transmission can be indicated by vibration of the electronic pen.
[0026]
The battery 14 is for supplying power to each element in the electronic pen 10, and for example, the power of the electronic pen 10 itself can be turned on / off by a cap (not shown) of the electronic pen.
[0027]
As described above, the electronic pen 10 has a function of acquiring coordinate data and writing pressure data corresponding to characters and the like written on the form 20 by the user and transmitting the data to the nearby terminal device 25. Since the tip part 17 is a normal ink pen, the contents described on the form 20 remain as original originals. That is, at the same time as describing the original paper, the contents can be digitized in real time in the form of coordinate data or the like.
[0028]
In the above example, data transmission from the electronic pen 10 to the terminal device 25 is performed by Bluetooth wireless transmission. However, instead of this, for example, wired data transmission using a cable, Data transmission from the electronic pen 10 to the terminal device 25 can be performed by various methods, such as data transmission by contact of a terminal or the like provided in a part of the terminal device 25.
[0029]
According to the standard functions of the electronic pen 10, the data obtained by the electronic pen 10 is in principle in the form of coordinate data or vector data, not text data. However, the electronic pen 10 has a function of converting only alphanumeric characters into text by describing it in a dedicated area provided on the form 20 as a standard function. In the terminal device 25 and the like, it is of course possible to obtain text data from the coordinate data and vector data transmitted from the electronic pen 10 using a character recognition application.
[0030]
The electronic pen 10 can hold property information (pen information and pen owner information) on the pen itself and its owner, and can be referred to from an application. As the pen information, a battery level, a pen ID, a pen manufacturer number, a pen software version, a subscription provider ID, and the like can be held. The pen owner information can include a nationality, a language, a time zone, an email address, a free memory capacity, a name, an address, a fax / telephone number, a mobile phone number, and the like.
[0031]
Next, a method of acquiring X / Y data of the content described by the user using the electronic pen will be described. As described above, a predetermined dot pattern is printed on the form 20. The camera 16 of the electronic pen 10 reads a dot pattern on the form 20 instead of reading a locus of ink written on the form 20 by the user. Actually, as shown in FIG. 1, the illumination area of the infrared LED 15 and the imaging area of the camera 16 (located in the illumination area) are shifted from the position where the pen tip 17 contacts the form 20.
[0032]
The dot pattern is printed with a special ink containing carbon or the like, and the camera 16 can recognize only the pattern using the special ink. Even if a ruled line or a frame is printed on a form using an ink (not including carbon) other than the special ink, the electronic pen does not recognize them. Therefore, when creating various forms, input frames, ruled lines, notes, and the like are printed with ink other than the special ink.
[0033]
In the dot pattern, as illustrated in FIG. 3, the position of each dot is associated with data. In the example of FIG. 3, two-bit information of 0 to 3 is displayed by shifting the position of the dot vertically and horizontally from the grid reference position (the intersection of the vertical line and the horizontal line). The position coordinates on the form are determined by the combination of the information thus expressed. As illustrated in FIG. 4A, 36 dots are arranged in a grid within a range of 2 mm in length and width, and an array of data indicated by these dots (FIG. 4B) is printed on the dedicated paper. Are associated with the position coordinates. Therefore, when the camera 16 of the electronic pen 10 captures a dot pattern as shown in FIG. 4A, the processor 11 changes the data array shown in FIG. Then, position coordinates on the form corresponding to the acquired position information (that is, where the dot pattern is located on the form) are calculated in real time. Note that the minimum unit for recognizing the dot pattern is 2 mm × 2 mm, and the camera 16 shoots about 100 times per second.
[0034]
Next, the form will be described. FIG. 5 shows an example of the form structure. As shown in the figure, the form 20 has a dot pattern 32 printed on a backing sheet 30 and a pattern 34 such as a ruled line printed thereon. The backing paper 30 is usually paper, and the dot pattern 32 is printed with a special ink containing carbon as described above. In addition, the design 34 is printed with ordinary ink or the like. The dot pattern and the design may be printed at the same time, or one of them may be printed first.
[0035]
An example of the design 34 is shown in FIG. FIG. 6 shows an example of a form 20, in which a plurality of entry fields 38 and a transmission box 39 are printed. Although not clearly shown in FIG. 6, a dot pattern is actually printed on the entire surface of the form 36, and an entry field 38 and a transmission box 39 are printed thereon with ordinary ink. The user may use the electronic pen 10 to fill in the required items in the entry fields 38 of the form 20 in the same manner as a conventional form, without being aware of the dot pattern.
[0036]
The area on the form 20 can be roughly divided into two types of areas. One is an entry area, in which the contents described by the electronic pen 10 are directly handled as information. In the example of FIG. 6, a plurality of entry fields 38 correspond to this. The other is a functional element, which executes an action, an instruction, and the like defined in advance for the area when the corresponding area is checked with the electronic pen 10. The transmission box 39 in the example of FIG. 6 corresponds to this.
[0037]
The transmission box 39 is used when giving an instruction to transmit data stored in the electronic pen 10 to the nearby terminal device 25 as described above. When the user checks the transmission box 39 with the electronic pen 10, the electronic pen 10 reads the dot pattern in the transmission box. The pattern is associated with the transmission instruction, and the processor 11 in the electronic pen 10 issues a transmission command of the data stored in the memory 12 to the Bluetooth transceiver 13.
[0038]
The assignment of the dot pattern is usually performed for each application (type of paper). That is, the dot patterns in a certain application do not overlap in one sheet, but the same application is printed with the same dot pattern. Therefore, when the user inputs necessary items with the electronic pen 10, it is possible to specify which item of the form the input item is for from the coordinate data on the form.
[0039]
As described above, various forms can be created by printing a predetermined design on the form on which the dot pattern is printed. If the user uses the electronic pen 10 to fill in the necessary items in the usual manner, the electronic data is automatically obtained.
[0040]
In the above example, the dot pattern is printed on the dedicated paper with ink containing carbon, but it is also possible to print the dot pattern on ordinary paper using a printer and ink containing carbon. Further, the design on the special paper can be formed not by printing but by a printer. When dot patterns are formed on paper by a printer, different dot patterns can be formed on each sheet. Therefore, it is possible to identify and discriminate these sheets one by one based on the difference between the formed dot patterns.
[0041]
In the present specification, the term “print” is a concept that includes not only normal printing but also printing by a printer.
[0042]
Next, transmission processing of data acquired by the electronic pen will be described. As described above, the communication function of the electronic pen 10 is based on Bluetooth, and data cannot be directly transmitted from the electronic pen 10 to a server that handles (converts to text) the data input to the form 20. Therefore, the data acquired by the electronic pen 10 is transmitted from the terminal device 25 to the server.
[0043]
The process at that time will be described with reference to FIG. The data obtained by the electronic pen 10 is mainly data of items input by the user, but usually does not include information on where the server to which the data is transmitted is. Instead, information for specifying an application or service related to the special paper is included in a dot pattern on the special paper, and the information is obtained from the special paper during a user input operation. Therefore, the terminal device 25 that has received the input data from the electronic pen 10 first makes an inquiry to the inquiry server 26 to which service server 27 the data input for the dedicated paper should be transmitted. The inquiry server 26 has information of a corresponding service server for each dedicated paper, and in response to an inquiry from the terminal device 25, stores information (a URL or the like) of the service server 27 that performs services related to the dedicated paper. Reply to terminal device 25. Then, the terminal device 25 transmits the input data obtained from the electronic pen to the service server 27.
[0044]
In the above example, the terminal device 25, the inquiry server 26, and the service server 27 are configured separately, but some or all of them may be configured as one device.
[0045]
[Procedure system configuration]
Next, as an embodiment of the form entry text conversion system of the present invention, the system will be described by taking as an example a case where a record is written in a form each time a maintenance person repairs a car in an automobile maintenance shop. I do.
[0046]
FIG. 7 shows a schematic configuration of a form entry text conversion system using an electronic pen. Each maintenance person (user) uses the above-described electronic pen 10 to make an input on the automobile maintenance form 4 (hereinafter, may be simply referred to as “form”). The vehicle maintenance form 4 is a form having a configuration dedicated to the electronic pen described with reference to FIGS. The contents entered in the automobile maintenance form 4 are acquired as entry data by the electronic pen 10 and transmitted to the terminal device 25 by Bluetooth communication. The entry data is transmitted from the terminal device 25 to the server 3 via the network 2. The server 3 is a server that receives a car maintenance report created by a maintenance staff and converts the content into text, and includes a database 8 for storing text data and the like described later.
[0047]
To explain the outline of the procedure for using this system, first, the maintenance staff uses the electronic pen 10 to enter a maintenance record and other necessary items in the automobile maintenance form 4 having a configuration dedicated to the electronic pen. Here, the automobile maintenance form 4 has a configuration corresponding to the text conversion system of the present invention as described later. When the maintenance person fills in the form using the electronic pen 10, the corresponding entry data (set of coordinate data) is transmitted from the electronic pen 10 to the terminal device 25, and the terminal device 25 writes the entry data. Is transmitted to the server 3. The server 3 performs text processing corresponding to the position data included in the received entry data, and acquires text data of the contents entered in the automobile maintenance form 4 by the maintenance staff. Then, the server 3 performs necessary processing such as embedding the text data of the entry contents in an electronic form corresponding to the vehicle maintenance form 4.
[0048]
[Form configuration]
Next, the configuration of the automobile maintenance form 4 will be described. FIG. 8 schematically shows a configuration of a form used in the form entry content text conversion system of the present invention. First, the automobile maintenance form 4 shown in FIG. 8 has a configuration dedicated to the electronic pen described above with reference to FIG. That is, a predetermined dot pattern 32 is printed on the mount 30 with ink that the electronic pen 10 can recognize, and a design 34 as a form is printed with ink that the electronic pen 10 cannot recognize.
[0049]
FIG. 8 shows an example of the design 34. The car maintenance form 4 shown in FIG. 8 is the above-described car maintenance form, and is a text converted by the text conversion system of the present invention when a user leaves a handwriting on the character or figure using the electronic pen. Characters or graphics related to the data are printed.
[0050]
More specifically, for example, the automobile maintenance form 4 includes a maintenance work date column 81 as an entry. The maintenance work date column 81 includes characters 82 indicating the month in which the maintenance work was performed (for example, “Jan” in January, “Feb” in February, etc.), and the day in which the maintenance work was performed (for example, “ The letters 83 indicating "1" and "2" on the second day) are printed with ink that cannot be read by the electronic pen. In addition, the character 83 indicating the date on which the maintenance work was performed is printed like a calendar as shown in FIG. Then, text data corresponding to the position data of the area where the respective characters 82 and 83 are printed is recorded in the server (or a database provided therein).
[0051]
Therefore, when entering the date when the maintenance work was performed, the maintenance staff may leave a handwriting such as a check mark on the corresponding character using an electronic pen. At this time, the mechanic can easily guess the text data that will be converted by the system of the present invention from the printed characters 82 and 83, and a third party can later view the automobile maintenance form. Even in this case, the maintenance work date can be confirmed, which is very convenient. In other words, for example, since handwriting such as a check mark remains on the character "Jun" and the character "21", the text of "June 21" is converted into a text by the system of the present invention. Can be easily guessed, and a third party can confirm it.
[0052]
In addition, the automobile maintenance form 4 includes a maintenance staff number column 84 and a customer number column 85 as entry items. When such a so-called ID number is to be entered, an ID input field 86 is printed on the automobile maintenance form 4 in advance, as shown in FIG. In FIG. 8, check boxes corresponding to the respective numbers are printed on the automobile maintenance form 4. The numerical value corresponding to each frame is associated with the data indicated by the dot pattern in the check box. That is, the check box at the top corresponds to the hundreds digit of the mechanic number (same for the customer number), and the dot pattern in the leftmost check mark at the top is the hundreds digit of the mechanic number. Is zero. Such a dot pattern and the number of digits of the maintenance personnel number and the text information of the number are recorded in the server 3 (or the database 8 provided therein) in association with each other. Therefore, if the mechanic leaves a handwriting such as a check mark with the electronic pen 10 in the corresponding check box of the mechanic number column 84 and the customer number column 85, then the system of the present invention uses the system of the present invention. Is converted to text. In a normal mark sheet, it is necessary to accurately fill in an entry field such as an ellipse, but in an ID entry field using an electronic pen, the camera recognizes a dot pattern simply by writing a check mark in a check box. , Can be easily input.
[0053]
Furthermore, the vehicle maintenance form 4 includes a maintenance record column 87 as an entry. As shown in FIG. 8, a picture 89 of a car, which is schematically shown, is printed in the maintenance record section. Each part (for example, tires 90 to 93, lights 94 to 95, engine 96, etc.) is printed on the picture 89 of the car, and the position of the area where these respective parts 90 to 96 are printed Text data corresponding to the data is recorded on a server (or a database provided therein).
[0054]
Therefore, when the maintenance staff fills in the maintenance record, the maintenance staff may leave a handwriting such as a check mark in an area corresponding to the part maintained by the user using an electronic pen. That is, for example, when the right front tire is changed and the engine oil is further changed, if handwriting such as a check mark is left on the right front tire 91 and the engine 96 in the picture 89 of the car, then the According to the system of the invention, "Right front tire change and oil change" is transcribed. By associating the text data with the position data of each part area printed on the form, the form can be given a design property, and the degree of freedom in the design of the form can be increased. Furthermore, if stroke data (vector data related to the shape of a handwriting) is also obtained from the entry data transmitted to the server by the electronic pen, for example, when there is a handwriting on the same right front tire (that is, when the position data is the same). However, the stroke data differs depending on whether the handwriting is a check mark or a circle. Therefore, by preparing in advance a text data associated with the stroke data in a server (or a database provided therein), the text data can be converted into text data corresponding to a combination of the position data and the stroke data. .
[0055]
[Function of the form entry text conversion system]
Next, a functional configuration of the text conversion system according to the present invention will be described with reference to FIG. In FIG. 9, a terminal device 25 that receives entry data by a user (maintenance staff) from the electronic pen 10 has an entry data transmission / reception function 25a. The entry data transmission / reception function 25a is a function of receiving entry data from the electronic pen 10 by Bluetooth communication, and transmitting the entry data to the server 3 via the network 2. The entry data transmission / reception function 25a is realized by the terminal device 25 executing a program prepared in advance.
[0056]
On the other hand, the server 3 includes a data reception function 51, a position data / stroke data acquisition function 52, and a text conversion function 53 as functional components necessary for the text conversion system according to the present invention. Each of these functions is realized by the server 3 executing a prepared program. Further, the server 3 stores text data 54 corresponding to the position data and the stroke data. The text data may be stored in the database 8 instead of the server 3.
[0057]
The data receiving function 51 receives entry data transmitted from the terminal device 25 via the network 2 or the like.
[0058]
The position data / stroke data acquisition function 52 has, from the entry data received by the data reception function 51, position data on which position in the form is entered and a handwriting of any shape. Get the stroke data related to or
[0059]
The text conversion function 53 is a function of associating the text data possessed by the server with the position data and the stroke data in advance, and converting the entry data into text data. Since the text data 54 is stored in association with each of the input fields 81 to 86 and 91 to 96 provided on the automobile maintenance form 4, the server 3 stores the text corresponding to the position data received from the terminal device 25. Data can be obtained.
[0060]
[Text Conversion]
Next, the flow of the text conversion process executed by the server 3 in the text conversion system of the present invention will be described.
[0061]
FIG. 10 is a flowchart of the text processing. First, the maintenance person uses the electronic pen 10 and the vehicle maintenance form 4 to enter a maintenance record on the vehicle maintenance form 4. Then, when the user completes the entry of the maintenance record, the user checks the transmission box 39 of the automobile maintenance form 4 and transmits the entry data to the server 3 via the terminal device 25. That is, when the maintenance person checks the transmission check box of the automobile maintenance form 4, the stroke data stored in the memory 12 of the electronic pen 10 at that time is input to the terminal device 25 as entry data for one automobile maintenance form 4. Sent. The terminal device 25 transmits the entry data to the server 3 via the network 2.
[0062]
When the server 3 receives the entry data from the terminal device 25 (step S1), first, the position data / stroke data acquisition function 52 acquires the position data and stroke data relating to the handwriting from the received entry data (step S2).
[0063]
Next, the text conversion function 53 performs a text conversion process in association with the obtained position data and stroke data depending on whether or not the position data and stroke data have been obtained. Specifically, for example, in the case where the maintenance work date column in the automobile maintenance form shown in FIG. 8 is converted into text, first, whether or not position data corresponding to the area where “Jan” is printed is acquired. Is determined (step S3), and when the position data corresponding to the area is acquired, the text “January” corresponding to the position data of the area is substituted into a variable (step S4). On the other hand, when the position data corresponding to the area is not acquired, it is determined whether or not the position data corresponding to the area where “Feb” is newly printed is acquired (step S5). When the position data is obtained, the text “February” corresponding to the position data of the area is substituted into a variable (step S6). By repeating this operation until "Dec" (December), the text of the maintenance work month can be converted.
[0064]
Basically, the same processing as the above described text for maintenance work month is applied to all areas of the entry on the automobile maintenance report (for example, text for maintenance work date, maintenance staff number, customer number, etc.). Done.
[0065]
In addition, in the text processing of the maintenance record column, for example, it is determined whether or not position data corresponding to an area where a picture of “right front tire” is printed is acquired (step S20). When the position data to be obtained is obtained, it is further determined whether or not the stroke data corresponding to the area is the stroke data of the "check mark" (step S21). If the stroke data is a "check mark", a text corresponding to the position data and the stroke data, for example, a text "Right front tire replacement" is substituted for a variable (step S22). On the other hand, if the stroke data is not “check mark”, then it is determined whether or not the stroke data is “x” (step S23). If the stroke data is the stroke data of “x”, the text corresponding to the position data and the stroke data, for example, the text “for example, right front tire pressure adjustment” is substituted into a variable (step S24). This process is repeated for each part in the picture of the car.
[0066]
In this way, by preparing text data in association with various marks for each part in the picture of the car, the maintenance staff simply enters a simple mark on the form, and converts the maintenance content into text. be able to. Then, by performing the process for all the areas of the form, for example, the automobile maintenance form shown in FIG. 8 becomes a text “June 21 maintenance person No. 250, customer No. 338, right front tire change, oil change”. Can be converted.
[0067]
【The invention's effect】
As described above, according to the form entry text conversion system of the present invention, entry data entered using an electronic pen can be converted to text using the position data and stroke data without character recognition. it can. Therefore, the contents of the form can be converted to text more accurately than when the character recognition software (OCR) is used.
[0068]
Further, according to the form of the present invention, the user can easily and visually fill in necessary items visually and intuitively, and since it is converted into text as it is, the entry time can be reduced.
[Brief description of the drawings]
FIG. 1 is a diagram schematically showing a usage pattern of an electronic pen.
FIG. 2 is a block diagram illustrating a structure of an electronic pen.
FIG. 3 is a diagram illustrating a method of expressing information by a dot pattern printed on a form.
FIG. 4 is a diagram illustrating an example of a dot pattern and information corresponding to the dot pattern.
FIG. 5 is a diagram showing a structure of a form.
FIG. 6 is a diagram illustrating an example of a form.
FIG. 7 is a diagram showing a schematic configuration in a case where the form entry text conversion system of the present invention is applied to an automobile maintenance work.
8 is a diagram showing an example of an automobile maintenance form used in the text conversion system shown in FIG. 7;
FIG. 9 is a diagram showing a functional configuration of a form entry text conversion system according to the present invention.
FIG. 10 is a flowchart of text conversion processing in a server of the form entry text conversion system of the present invention.
[Explanation of symbols]
2 Network 3 Server 4 Report 8 Database 10 Electronic pen 11 Processor 12 Memory 13 Transceiver 14 Battery 15 LED
16 Camera 17 Pen Tip 25 Terminal Device 51 Data Reception Function 52 Position Data / Stroke Data Acquisition Function 53 Text Conversion Function

Claims (4)

A form entry text conversion system for converting the contents entered in a form into text data without character recognition,
An electronic pen that obtains entry data corresponding to the content entered by the user by reading the dot pattern optically from a form on which a predetermined dot pattern is printed, and transmits the data to the terminal device;
The terminal device that receives the entry data transmitted from the electronic pen and transmits it to a server via a network,
Receiving the entry data transmitted from the terminal device, obtains from the entry data the position data indicating in which position of the form the user has entered, the position data, for each position of the form A server that converts the entry data into text data by associating the text data prepared in advance with a text data;
A form entry text conversion system comprising: The server acquires not only the position data from the entry data received from the terminal device, but also stroke data, and associates the stroke data with text data prepared in advance for each of the stroke data. 2. The form entry text conversion system according to claim 1, wherein the entry data is converted into text data. A form having a dot pattern printed so as to be readable by an electronic pen and an entry field, wherein the dot pattern printed in the entry field is associated with predetermined text information; . A form readable by an electronic pen and having an entry field, wherein position information of the entry field on the form is associated with predetermined text information.

Images