JP2008217508A - Terminal device, processing system, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a processing system capable of confirming and transmitting a data using an electronic pen, even in an environment having no network. <P>SOLUTION: A user fills a form 3, using the electronic pen 10, in this processing system of the present invention. This terminal device 25 of the present invention acquires a stroke data from the electronic pen 10, and stores it in a local DB 4. The terminal device 25 analyzes the stroke data to prepare a confirmation data, and displays a confirmation screen. The terminal device 25 erases the confirmation data in a step of closing the confirmation screen. The terminal device 25 is further connected communicably to a server 5 and transmits the stroke data. The server 5 analyzes the stroke data acquired from the terminal device 25 and prepares an analytical data. The server 5 executes prescribed processing after storing the analytical data into an analysis result DB 6. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to a technique for processing information entered in an electronic pen form by an electronic pen.

  In recent years, pen-type input devices called “electronic pens” and “digital pens” have appeared (hereinafter referred to as “electronic pens” in this specification). The developed “Anoto pen” is known. Anotopen is used in a pair with dedicated paper (hereinafter also referred to as “dedicated paper”) on which a predetermined dot pattern is printed. In addition to the normal ink-type pen tip, the Anoto pen is equipped with a small camera for reading the dot pattern on the dedicated paper and a data communication unit. When a user writes characters on the special paper with an anotopen or checks an image that is designed on the special paper, the small camera detects the dot pattern on the special paper as the pen moves, and the user Stroke data corresponding to the written character, image, etc. is acquired. The stroke data is transmitted from the Anotopen by a data communication unit to a terminal device such as a nearby personal computer or mobile phone. The system using this anotopen can be used as an input device in place of the keyboard, and is very easy to use for users who are reluctant to use the personal computer and keyboard described above. Therefore, as a technique for digitizing data entered in various business documents, application forms, contracts, etc., a system using an electronic pen is becoming widespread (for example, Patent Document 1).

  Usually, in a system using an electronic pen, a method of transmitting data acquired by the electronic pen to a server via a network and analyzing and storing the data on the server side is common. In this case, the user confirms the data analysis result by connecting to the server from the local terminal via the network (for example, Patent Document 2). That is, in such a system, since data analysis is performed on the server side, there is a problem that it is difficult to use in an environment where a network is not established.

JP 2004-153612 A JP 2004-127200 A

  The present invention has been made in view of the above points, and provides a processing system capable of confirming and transmitting data using an electronic pen even in an environment where a network is not maintained. Is an issue.

  In one aspect of the present invention, in a terminal device that processes information entered in an electronic pen form on which a dot pattern recognizable by an electronic pen is printed, the terminal device includes a display unit and the electronic pen form. Stroke data acquisition means for acquiring stroke data corresponding to the contents to be entered from the electronic pen, stroke data storage means for storing the stroke data, and filling in the electronic pen form based on the stroke data Confirmation data creating means for creating confirmation data for displaying a confirmation screen indicating the contents on the display section, display means for displaying the confirmation screen on the display section based on the confirmation data, and When the display of the confirmation screen is completed, it is possible to communicate with the server and the erasing means for erasing the confirmation data that is the basis of the confirmation screen. Connect, and a stroke data transmission means for transmitting the stroke data to the server.

  In the processing apparatus configured as described above, the user fills in the electronic pen form using the electronic pen. Then, the electronic pen reads the dot pattern on the electronic pen form as it moves, and acquires coordinate data corresponding to the contents entered by the user and time information related to the entry time. And an electronic pen transmits the stroke data which linked | related the acquired coordinate data and time information to the nearby terminal device. The terminal device is a mobile phone or a personal computer that can exchange data with the electronic pen. The terminal device acquires stroke data from the electronic pen and stores it in a state before analysis. Further, the terminal device creates check data corresponding to the contents entered in the electronic pen form by the electronic pen by analyzing the stroke data. The confirmation data is the analysis result of the stroke data, and is the data that is the basis of the confirmation screen showing the contents entered in the electronic pen form by the electronic pen. Then, the terminal device displays a confirmation screen on a display unit such as a display based on the created confirmation data. When the display of the confirmation screen is completed, the terminal device deletes the confirmation data that is the basis of the confirmation screen. Furthermore, the terminal device is connected so as to be communicable with a server that analyzes stroke data and executes predetermined processing, and transmits the stroke data to the server. In this manner, the terminal device stores the stroke data, transmits the stroke data to the server after being connected to the server so as to be communicable. Therefore, the terminal device and the server do not need to be connected so that they can always communicate with each other, and stroke data can be easily transmitted even in an environment where a network is not established. In addition, since the terminal device analyzes the stroke data and displays a confirmation screen, the user must fill in the electronic pen form with the electronic pen before sending the stroke data to the server. It can be easily confirmed whether or not the analysis result is different. Further, by deleting the confirmation data obtained by analyzing the stroke data when the confirmation screen is closed, it is possible to reduce the risk of information leakage caused by storing the data in the terminal device.

  In one aspect of the terminal device, the terminal device further comprises image data acquisition means for acquiring image data corresponding to the contents entered in the electronic pen form based on the stroke data, and the confirmation data creation The means creates the confirmation data based on the image data. According to this, the terminal device creates the confirmation data after converting the stroke data corresponding to the content entered by the user into the electronic pen form into image (image) data. For this reason, the user can confirm both his / her handwriting and the written contents on the confirmation screen based on the confirmation data.

  In another aspect of the terminal device, the electronic pen form has a plurality of items filled in by the electronic pen, and the terminal device includes the items and the items on the dot pattern. A coordinate table storage unit that stores a coordinate table that associates coordinate data that is position coordinates, and the stroke data acquired by the stroke data acquisition unit by referring to the coordinate table, Item stroke data extraction means for extracting corresponding item stroke data, and text data acquisition means for acquiring text data corresponding to the contents entered in each item by character recognition of the item stroke data. The confirmation data creating means is configured to generate the confirmation data based on the text data. To create a.

  The terminal device configured as described above corresponds to the contents entered in each item constituting the electronic pen form from the stroke data acquired from the electronic pen by referring to the coordinate table stored in advance. The item stroke data to be extracted is extracted. Further, the terminal device acquires text data corresponding to the entry contents in each item by recognizing the item stroke data. Then, the terminal device creates confirmation data based on the acquired text data. According to this, the user can confirm whether or not the character recognition result is different from the content entered in the electronic pen form by the confirmation screen based on the confirmation data.

  In another aspect of the terminal device, the stroke data storage unit stores information indicating whether or not the stroke data has been transmitted to the server in association with the stroke data. A transmission instruction information acquiring means for acquiring the transmission instruction information, wherein the stroke data transmitting means is connected so as to be communicable with the server when the transmission instruction information is acquired, and is a non-transmitted stroke; Send data to the server in batch.

  The terminal device configured as described above stores stroke data and information indicating whether or not the stroke data has been transmitted to the server in association with each other. When transmitting the stroke data, the user transmits the transmission instruction information by operating the terminal device. Here, the operation of transmitting the transmission instruction information is arbitrary. When the terminal device acquires the transmission instruction information, the terminal device collectively transmits the stroke data that has not been transmitted at that time to the server. According to this, stroke data can be transmitted to a server at a user's arbitrary timing. In this way, the transmission time can be shortened by collectively transmitting the stroke data.

  In another aspect of the terminal device, the stroke data transmission means is connected so as to be communicable with the server when a predetermined time has elapsed, and transmits untransmitted stroke data to the server in a lump. To do. According to this, the terminal device can automatically transmit the stroke data to the server at a timing when a predetermined time set in advance has elapsed. As described above, the transmission time can be shortened by automatically transmitting the stroke data collectively.

  In another aspect of the present invention, in a program executed by a computer that processes information entered in an electronic pen form printed with a dot pattern recognizable by an electronic pen, the computer includes a display unit, and a server The program stores stroke data, stroke data acquisition means for acquiring stroke data corresponding to the content entered in the electronic pen form from the electronic pen, and the program stores the stroke data. Stroke data storage means, based on the stroke data, confirmation data creation means for creating confirmation data for displaying on the display section a confirmation screen showing the contents to be entered in the electronic pen form, the confirmation data Based on the display means for displaying the confirmation screen on the display unit, and the display of the confirmation screen is terminated. Then, erase means for erasing the confirmation data underlying the confirmation screen, the stroke data transmitting means for transmitting the stroke data to said server, said causing the computer to function as a.

  By executing the above program by a computer, the above-described terminal device can be realized. Moreover, each aspect of the above-described terminal device can be realized in the same manner.

  In still another aspect of the present invention, in a processing system for processing information entered in an electronic pen form printed with a dot pattern recognizable by an electronic pen, the processing system includes a terminal device and a server. The terminal device includes a display unit, first stroke data acquisition means for acquiring stroke data corresponding to the entry contents in the electronic pen form from the electronic pen, and stroke data storage for storing the stroke data. A confirmation data creating means for creating confirmation data for displaying on the display unit a confirmation screen indicating the contents to be entered in the electronic pen form based on the stroke data; and the confirmation data Based on the display means for displaying the confirmation screen on the display unit and the display of the confirmation screen, Erasure means for erasing the confirmation data to become, and stroke data transmission means for connecting to the server so as to be communicable and transmitting the stroke data to the server, the server from the terminal device, Stroke data acquisition means for acquiring the stroke data, analysis data generation means for generating analysis data obtained by analyzing the stroke data based on the stroke data, analysis data storage means for storing the analysis data, and the analysis Processing execution means for executing a predetermined process based on the data.

  In the processing system configured as described above, the user fills in the electronic pen form using the electronic pen. Then, the electronic pen acquires stroke data corresponding to the entry content and transmits it to a nearby terminal device. The terminal device acquires stroke data from the electronic pen and stores it in a state before analysis. Further, the terminal device creates check data corresponding to the contents entered in the electronic pen form by the electronic pen by analyzing the stroke data. Then, the terminal device displays a confirmation screen on a display unit such as a display based on the created confirmation data. When the display of the confirmation screen is completed, the terminal device deletes the confirmation data that is the basis of the confirmation screen. Furthermore, the terminal device is connected so as to be communicable with a server that analyzes stroke data and executes predetermined processing, and transmits the stroke data to the server. The server analyzes the stroke data acquired from the terminal device and creates analysis data. Then, the server stores the analysis data and executes a predetermined process based on the analysis data. As described above, according to the processing system of the present invention, the terminal device and the server do not need to be connected so that they can always communicate with each other, and stroke data can be easily transmitted even in an environment where the network is not maintained. Can do. In addition, since the terminal device analyzes the stroke data and displays a confirmation screen, the user must fill in the electronic pen form with the electronic pen before sending the stroke data to the server. It can be easily confirmed whether or not the analysis result is different.

  The present invention makes it possible to perform data confirmation and transmission using an electronic pen even in an environment where a network is not maintained.

  Preferred embodiments of the present invention will be described below with reference to the drawings. First, an outline of an electronic pen used as an input device in the system of the present invention will be described.

[Electronic pen]
FIG. 1 is a diagram schematically showing how the electronic pen is used, and FIG. 2 is a functional block diagram showing the structure of the electronic pen. As shown in FIG. 1, the electronic pen 10 is used in combination with a dedicated paper 20 on which a dot pattern is printed. The electronic pen 10 includes a pen tip portion 17 similar to a normal ink pen, and a user writes characters on the dedicated paper 20 in the same manner as a normal ink pen.

  As shown in FIG. 2, the electronic pen 10 includes a processor 11, a memory 12, a data communication unit 13, a battery 14, an LED 15, a camera 16, and a pressure sensor 18 therein. The electronic pen 10 includes an ink cartridge (not shown) as a component similar to a normal ink pen.

  The electronic pen 10 does not convert the locus of the ink drawn on the dedicated paper 20 by the pen tip unit 17, but converts the locus coordinates of the movement of the electronic pen 10 on the dedicated paper 20 into data. While the LED 15 illuminates the vicinity of the pen tip 17 on the dedicated paper 20, the camera 16 reads the dot pattern printed on the dedicated paper 20 and converts it into data. That is, the electronic pen 10 can acquire a stroke generated when the user moves the electronic pen 10 on the dedicated paper 20 as image data or vector data.

  The pressure sensor 18 detects the pressure applied to the pen tip portion 17 when the user writes characters on the dedicated paper with the electronic pen 10, that is, the writing pressure, and supplies the detected pressure to the processor 11. The processor 11 switches the LED 15 and the camera 16 on and off based on the writing pressure data given from the pressure sensor 18. That is, when the user writes characters or the like on the dedicated paper 20 with the electronic pen 10, writing pressure is applied to the pen tip portion 17. Therefore, when the writing pressure exceeding the predetermined value is detected, it is determined that the user has started the description, and the LED 15 and the camera 16 are operated.

  The camera 16 reads the dot pattern on the dedicated paper 20 and supplies the pattern data to the processor 11. The processor 11 calculates X / Y coordinates on the dedicated paper 20 from the supplied dot pattern.

  The processor 11 acquires the writing pressure array data and the X / Y coordinate data while the description of the user is performed, and stores them in the memory 12 in association with the time stamp (time information). Therefore, data corresponding to the description content of the user is stored in the memory 12 in time series. The capacity of the memory 12 can be about 1 Mbyte, for example.

  All the acquired data is held in the memory 12 until a transmission instruction is given by the user. When the user issues a transmission instruction, the data communication unit 13 transmits the data in the memory 12 to the terminal device 25 within a predetermined distance from the electronic pen 10. Basically, once a transmission instruction is given, the electronic pen 10 transmits all the data stored in the memory 12 to the terminal device 25, so that the memory 12 is cleared. Therefore, when it is desired to transmit the same information to the terminal device 25 again after transmission, the user needs to write the description on the dedicated paper 20 again. In this case, the user only has to trace characters written on the dedicated paper 20 with an ink pen.

  The transmission instruction and other instructions are executed when the user checks the dedicated box provided at a predetermined position on the dedicated paper 20 with the electronic pen 10. A transmission instruction is associated with the position coordinates of the dedicated box in advance. When the processor 11 receives the position coordinates of the dedicated box, the processor 11 supplies data in the memory 12 to the data communication unit 13 and transmits the data to the terminal device 25. To do. The electronic pen 10 can indicate completion of data transmission by vibration of the electronic pen. Further, the electronic pen 10 itself may be equipped with a transmission function.

  The battery 14 is for supplying power to each element in the electronic pen 10, and the electronic pen 10 itself can be turned on / off by a cap (not shown) of the electronic pen, for example.

  As described above, the electronic pen 10 has a function of acquiring coordinate data and writing pressure data corresponding to characters and the like described on the dedicated paper 20 by the user and transmitting them to the nearby terminal device 25. Since the pen tip portion 17 is a normal ink pen, the content described on the dedicated paper 20 remains as an original original. That is, at the same time as describing the original paper, its contents can be digitized in the form of coordinate data in real time.

  According to the standard function of the electronic pen 10, data obtained by the electronic pen 10 is in principle in the form of coordinate data or vector data, and is not text data. However, as a standard function, the electronic pen 10 has a function of converting text into alphanumeric characters by describing it in a dedicated area provided on the dedicated paper 20.

  Also, the electronic pen 10 can hold property information (pen information and pen owner information) regarding the pen itself and its owner, and can be referred to from an application. As the pen information, a battery level, a pen ID, a pen manufacturer number, a pen software version, a subscription provider ID, and the like can be held. The pen owner information can hold nationality, language, time zone, email address, free memory capacity, name, address, fax / phone number, mobile phone number, and the like.

  In the data communication unit 13 in the above example, the electronic pen 10 is connected to the terminal device 25 by various methods such as Bluetooth (registered trademark) wireless transmission, wired transmission using a USB cable, and data transmission by contact with a terminal. It is conceivable to perform data transmission.

  Next, a method for acquiring X / Y coordinate data of contents described by the user with the electronic pen will be described. As described above, a predetermined dot pattern is printed on the dedicated paper 20. The camera 16 of the electronic pen 10 does not read the locus of ink described on the dedicated paper 20 by the user, but reads the dot pattern on the dedicated paper 20. Actually, as shown in FIG. 1, the illumination area by the LED 15 and the shooting area of the camera 16 (located in the illumination area) are deviated from the position where the pen tip 17 contacts the dedicated paper 20.

  The dot pattern is printed with a special ink containing carbon, and the camera 16 can recognize only the pattern with the special ink. Even if ruled lines or frames are printed on dedicated paper with inks other than dedicated ink (not including carbon), the electronic pen does not recognize them. Therefore, when creating forms such as various application forms using dedicated paper, input frames, ruled lines, cautions, etc. are printed with ink other than dedicated ink.

  In the dot pattern, as illustrated in FIG. 3, the position of each dot is associated with data. In the example of FIG. 3, the 2-bit information of 0 to 3 is displayed by shifting the dot position vertically and horizontally from the reference position (intersection of vertical and horizontal lines) of the grid. The position coordinates on the dedicated paper are determined by the combination of information expressed in this way. As illustrated in FIG. 4A, 36 dots are arranged in a grid within a range of 2 mm in length and width, and the data array (FIG. 4B) indicated by these dots is displayed on the dedicated paper. Are associated with the position coordinates. Therefore, when the camera 16 of the electronic pen 10 captures a dot pattern as shown in FIG. 4A, the processor 11 changes the data array shown in FIG. 4B based on the dot pattern data input from the camera 16. The position coordinates on the dedicated paper (that is, where the dot pattern is located on the dedicated paper) corresponding to the acquired position are calculated in real time. The minimum unit for recognizing the dot pattern is 2 mm × 2 mm, and the camera 16 takes about 100 shots per second.

  Next, the dedicated paper will be described. An example of the structure of the dedicated paper is shown in FIG. As shown in the figure, the dedicated paper 20 has a dot pattern 32 printed on a mount 30 and a design 34 such as a ruled line printed thereon. The mount 30 is usually paper, and the dot pattern 32 is printed with dedicated ink containing carbon as described above. Also, the design 34 is printed with normal ink or the like. The dot pattern and the design may be printed at the same time, or one of them may be printed first.

  An example of the design 34 is shown in FIG. FIG. 6 shows an example of a certain application form 36 in which a plurality of entry fields 38 and a transmission box 39 are printed. Although it is not clearly shown in FIG. 6 and will be described in detail later, a dot pattern is actually printed on the entire surface of the application form 36, and an entry box 38 and a transmission box 39 are formed on the entire surface using ordinary ink. It is printed. The user can enter the necessary items in each entry field 38 of the application form 36 using the electronic pen 10 in the same manner as a conventional application form without being aware of the dot pattern.

  The area on the dedicated paper 20 can be roughly divided into two types. One is an entry area, in which the content described by the electronic pen 10 is handled as information as it is. In the example of FIG. 6, a plurality of entry fields 38 correspond to this. The other is a functional element, and when the corresponding area is checked with the electronic pen 10, actions, instructions, etc. defined in advance for the area are executed. The transmission box 39 in the example of FIG. 6 corresponds to this.

  The transmission box 39 is used when giving an instruction to transmit data stored in the electronic pen 10 to the nearby terminal device 25 as described above. When the user checks the transmission box 39 with the electronic pen 10, the electronic pen 10 reads the dot pattern in the transmission box. The pattern is associated with a transmission instruction, and the processor 11 in the electronic pen 10 issues a command to transmit data stored in the memory 12 to the data communication unit 13.

  The dot pattern is normally assigned for each application (paper type). In other words, the dot patterns in a certain application form do not overlap in one sheet, but the same dot pattern is printed on the same application form. Therefore, when the user inputs necessary items with the electronic pen 10, it can be specified from the coordinate data on the application form which item of the application form the input item is for.

  As described above, by printing a predetermined design on the dedicated paper on which the dot pattern is printed, various application forms using the dedicated paper can be created. If the user uses the electronic pen 10 and fills in necessary items in a normal manner, the electronic data is automatically acquired.

  In the above example, the dot pattern is printed on the dedicated paper with carbon-containing ink. However, the dot pattern can be printed on ordinary paper using a printer and carbon-containing ink. Furthermore, the design on the dedicated paper can also be formed by a printer instead of printing. When dot patterns are formed on paper by a printer, different dot patterns can be formed on each sheet. Therefore, it is possible to identify and distinguish each of these sheets by the difference in the formed dot patterns.

  In the present specification, the term “printing” has a concept including not only normal printing but also printing by a printer.

  Next, transmission processing of data acquired by the electronic pen will be described with reference to FIG. The data acquired by the electronic pen 10 is mainly data of items input by the user, but usually does not include information on where the service server that is the transmission destination of the data is. Instead, information specifying the application or service related to the dedicated paper is included in the dot pattern on the dedicated paper, and the information is acquired from the dedicated paper during the user's input operation. Therefore, the terminal device 25 that has received the stroke data from the electronic pen 10 first makes an inquiry to the inquiry server 26 to which service server 27 the data input to the dedicated paper should be transmitted. The inquiry server 26 has information on a corresponding service server for each dedicated paper, and in response to an inquiry from the terminal device 25, information (such as a URL) of the service server 27 that performs a service related to the dedicated paper. Reply to the terminal device 25. Then, the terminal device 25 transmits the stroke data acquired from the electronic pen to the service server 27.

  In the above example, the terminal device 25, the inquiry server 26, and the service server 27 are separately configured. However, some or all of them may be configured as one device. The server described later in this embodiment also serves as the inquiry server 26 and the service server 27.

[Processing system]
Next, the processing system in this embodiment will be described. FIG. 7 shows a schematic configuration of the processing system 100. The processing system shown in FIG. 7 is a system that enables transmission and confirmation of data using the electronic pen 10 even when the network environment is not maintained. In this embodiment, an electronic pen form (hereinafter referred to as “form”) 3 as shown in FIG. 8A is used as the dedicated paper.

  As shown in FIG. 7, the processing system 100 is configured by connecting the terminal device 25 and the server 5 through the network 2. Here, one suitable example of the network 2 is the Internet.

  The terminal device 25 includes a display unit such as a display, and can exchange data with the electronic pen 10 and the server 5. If necessary, the terminal device 25 converts the stroke data into text by character recognition processing such as OCR (Optical Character Recognition). Has the function of converting to data. Examples of the terminal device 25 include a personal computer and a mobile phone used by a user.

  The terminal device 25 acquires stroke data corresponding to the contents entered in the form 3 from the electronic pen 10 and stores it in the local DB. The local DB connected to the terminal device 25 is composed of two, a first local DB 4a and a second local DB 4b, to avoid the risk of data corruption, and stroke data is stored in both. The first local DB 4a and the second local DB 4b are collectively referred to as “local DB 4”.

  In this embodiment, the stroke data is stored in the two local DBs 4 in order to avoid the risk of data corruption. However, the present invention is not limited to this, and the storage location of the stroke data is 2. It may be more than the number of places. For this reason, the stroke data may be stored in two locations, an HDD (Hard Disc Drive) inside the terminal device 25 and an external HDD.

  Here, the stroke data is data in which coordinate data corresponding to a stroke (trajectory) to the form 3 by the electronic pen 10 is associated with time information that is an entry time. When the user fills in the form 3 with the electronic pen 10, the coordinate data indicating the position coordinates corresponding to the dot pattern on the form 3 is associated with the time information that is the stroke entry time, and the electronic pen is used as the stroke data. 10 is obtained.

  Further, the terminal device 25 obtains confirmation data for displaying a confirmation screen corresponding to the contents entered in the form 3 by analyzing the stroke data. Then, the terminal device 25 displays a confirmation screen based on the confirmation data. Note that the confirmation data may be either image data or text data as long as the data is a basis for displaying a confirmation screen for confirming the contents entered in the form 3. When the confirmation screen is closed by a predetermined operation by the user, the terminal device 25 deletes the confirmation data. Further, when receiving the transmission instruction information from the user, the terminal device 25 is connected so as to be communicable with the server 5 via the network 2 and transmits stroke data. In this case, all the untransmitted stroke data acquired before receiving the transmission instruction information is transmitted to the server 5 at once. As described above, since the plurality of stroke data are transmitted at once when the terminal device 25 and the server 5 are connected, the terminal device 25 and the server 5 do not need to be always connected. Therefore, data can be transmitted even when the network environment is not completely maintained. Further, the storage and transmission confirmation of the stroke data can be a process completed by the terminal device 25 without going through the network 2.

  The server 5 analyzes the stroke data acquired from the terminal device 25 and creates image data or text data corresponding to the contents entered in the form 3 as analysis data. Then, the server 5 stores the analysis data in the analysis result DB 6 and executes a predetermined process based on the analysis data.

  Here, the form 3 will be described in detail with reference to FIG. FIG. 8 is an example of the form 3 used in the present embodiment. The form 3 is a product order form, and as shown in FIG. 8A, a user ID item 42, a product name item 43, and a user name item 43 for entering a user ID, a product name, a price, a destination, a name, etc., respectively. A price item 44, a destination item 45, a name item 46, and the like are provided. FIG. 8B is a diagram illustrating coordinate data corresponding to each item. As shown in the figure, in the present embodiment, the arrangement of each item on the dot pattern printed on the form 3 is shown by the upper left vertex coordinates and the lower right vertex coordinates. Therefore, on the dot pattern printed on the form 3, the coordinate data indicating the arrangement of the user ID item 42 is “(x1, y1) to (x2, y2)”. Similarly, on the dot pattern printed on the form 3, the coordinate data indicating the arrangement of the product name item 43 is “(x3, y3) to (x4, y4)”.

  Here, a flow of data confirmation, transmission, and processing execution by the processing system 100 of the present embodiment will be described.

  The user uses the electronic pen 10 to enter necessary items in each item provided in the form 3. When the entry is completed, the user transmits the stroke data acquired by the electronic pen 10 to the terminal device 25. That is, the electronic pen 10 transmits stroke data corresponding to the contents entered in the form 3 to the terminal device 25. As a method for transmitting stroke data, an arbitrary method such as entering a check mark in a transmission box 39 provided on the form 3 or executing a transmission function mounted on the electronic pen 10 by a predetermined operation is applied. can do.

  When the stroke data is acquired from the electronic pen 10, the terminal device 25 stores the stroke data in both the first local DB 4a and the second local DB 4b. Then, the terminal device 25 analyzes the stroke data by referring to the coordinate table in which the items provided in the form 3 and the coordinate data of the items are associated with each other, and creates confirmation data. Furthermore, the terminal device 25 displays a confirmation screen on a display unit such as a display based on the confirmation data. That is, the terminal device 25 creates confirmation data, temporarily stores it in the memory, and displays a confirmation screen so that the user can confirm the stroke data before transmission. As a result, the user can check whether the result of analyzing the stroke data is different from the content that he / she entered in the form 3 with the electronic pen 10. When the confirmation screen is closed by the user, the terminal device 25 deletes the confirmation data from the memory. When receiving the transmission instruction information from the user, the terminal device 25 is connected so as to be communicable with the server 5 via the network 2 and transmits untransmitted stroke data in a lump.

  When the stroke data is acquired from the terminal device 25, the server 5 analyzes the stroke data, thereby acquiring image data or text data corresponding to the contents entered in the form 3 as analysis data. And the server 5 preserve | saves analysis data in analysis result DB6. Moreover, the server 5 performs a predetermined process based on the analysis data.

  Thus, the terminal device 25 displays the confirmation screen, so that the user can confirm the analysis result of the stroke data before transmitting the stroke data to the server 5. That is, the user can check with the nearby terminal device 25 before transmission whether or not the image data or text data is not different from the content entered on the form 3 based on the stroke data. it can.

  Further, since the stroke data can be transmitted collectively at an arbitrary timing, the terminal device 25 and the server 5 need not always be connected. Therefore, even if the network environment is not completely maintained, data can be confirmed and transmitted.

[Terminal device]
Next, the terminal device 25 will be described in detail with reference to FIG. FIG. 9 shows the internal configuration of the terminal device 25 and the server 5 in the processing system 100.

  As illustrated, the terminal device 25 includes a confirmation processing program 101, a stroke data acquisition function 102, a stroke data storage function 103, a confirmation data creation function 104, a confirmation screen display function 105, a confirmation data deletion function 106, and stroke data transmission. Function 107 is provided. In addition, each function is implement | achieved when CPU which the terminal device 25 has runs the program prepared beforehand.

  The confirmation processing program 101 is a program that divides and stores stroke data acquired from the electronic pen 10 into a first local DB 4a and a second local DB 4b in a state before analysis. The confirmation processing program 101 is a program that analyzes the stroke data to create confirmation data and displays a confirmation screen on a display unit such as a display. The confirmation processing program 101 is a program for deleting confirmation data and transmitting stroke data to the server 5 when the confirmation screen is closed.

  The stroke data acquisition function 102 is a function for acquiring stroke data corresponding to the contents entered in the form 3 by the user using the electronic pen 10 by executing the confirmation processing program 101.

  The stroke data storage function 103 is a function for storing the stroke data acquired by the stroke data acquisition function 102 in the first local DB 4a and the second local DB 4b. Here, the local DB 4 will be described with reference to FIG. FIG. 10 is a diagram schematically showing the data structure of the local DB 4. As shown in the figure, the local DB 4 is composed of stroke ID, stroke data, and transmission items. The stroke ID is a serial number that identifies stroke data stored in the local DB 4. The stroke data corresponds to the contents entered in the form 3 and is data in which the position coordinates on the dot pattern and the entry time are associated with each other. “Transmission” is information indicating whether or not the stroke data has been transmitted to the server 5, and for the sake of convenience, the transmission item is “completed” if it has been transmitted, and “not yet” if it has not been transmitted. It is remembered. The first local DB 4a and the second local DB 4b have the same data structure, and the stroke data storage function 103 saves the stroke data to the two first local DB 4a and the second local DB 4b in order to avoid the risk of data corruption. save.

  The stroke data storage function 103 may take measures in consideration of information leakage when storing the stroke data. For example, the stroke data itself may be stored after being divided into a plurality of parts or encrypted so that it is difficult to restore.

  The confirmation data creation function 104 is a function that creates the confirmation data by analyzing the stroke data acquired by the stroke data acquisition function 102. The confirmation data is the analysis result of the stroke data and is the data that is the basis of the confirmation screen showing the contents entered in the form 3. In this embodiment, the confirmation data creation function 104 has a coordinate table storage function, an item stroke data extraction function, and a text data acquisition function.

  The coordinate table storage function is a function for storing a coordinate table that is referred to in order to create confirmation data based on stroke data. Here, the coordinate table will be described with reference to FIG. FIG. 11 is a diagram schematically illustrating the data structure of the coordinate table. As shown in the figure, the coordinate table is composed of item ID, item name, and coordinate data items. The item ID is information for identifying each item provided in the form 3. The item name is the name of each item provided in the form 3. The coordinate data is position coordinates indicating the arrangement of each item on the dot pattern printed on the form 3. In the present embodiment, as described above, the arrangement of each item that is a quadrangle on the dot pattern is indicated by the upper left vertex coordinate and the lower right vertex coordinate of each item.

  The item stroke data extraction function refers to items corresponding to the contents entered in each item of the form 3 from the stroke data acquired by the stroke data acquisition function 102 by referring to the coordinate table stored in the coordinate table storage function. This is a function for extracting stroke data. As shown in FIG. 11, since the coordinate table stores the items on the form 3 and their coordinate data in association with each other, the item stroke data extraction function can easily extract the item stroke data from the stroke data based on the coordinate table. Can be extracted.

  The text data acquisition function is a function for acquiring text data by performing character recognition based on item stroke data. The confirmation data creation function 104 creates confirmation data based on the text data acquired by the text data acquisition function. The created confirmation data is temporarily stored in the memory.

  In the present embodiment, the confirmation data creation function 104 acquires text data by recognizing characters in the stroke data, and creates confirmation data based on the text data. However, the present invention is not limited to this, and image data may be acquired based on the stroke data, and confirmation data may be created based on the image data. In this case, the confirmation data creation function 104 has an image data acquisition function for acquiring image data that is an image of the contents entered in the form 3 by the electronic pen 10 based on the stroke data.

  The confirmation screen display function 105 is a function for displaying a confirmation screen on a display unit such as a display based on the confirmation data created by the confirmation data creation function 104. Thus, the user can confirm whether or not the analysis result of the stroke data is different from the content entered in the form 3 by the electronic pen 10 on the confirmation screen before transmitting the stroke data. it can.

  The confirmation data erasure function 106 is a function for completely erasing the confirmation data temporarily stored in the memory when the confirmation screen is closed by the user.

  The stroke data transmission function 107 is a function of connecting to the server 5 via the network 2 so as to be communicable and transmitting untransmitted stroke data to the server 5 in a lump. In the present embodiment, the stroke data transmission function 107 has a transmission instruction information acquisition function. The transmission instruction information acquisition function is a function for acquiring transmission instruction information transmitted by a user through a predetermined operation. When the transmission instruction information acquisition function acquires transmission instruction information, the stroke data transmission function 107 connects to the server 5 via the network 2 and transmits untransmitted stroke data at once. Further, the stroke data transmission function 107 rewrites the transmission item corresponding to the transmitted stroke data in the local DB 4 to “done”. It is assumed that the server 5 to be connected and the folder for transmitting stroke data are set in advance. Further, it is assumed that the operation for transmitting the transmission instruction information by the user can be arbitrarily set such as pressing a predetermined button.

  In the present embodiment, when the stroke data is acquired from the electronic pen 10, the stroke data is automatically stored and the confirmation data is created. However, the present invention is not limited to this and is used. It may be performed after obtaining the storage instruction information from the person. In other words, the terminal device 25 may store the stroke data and create the confirmation data when the storage instruction information from the user is acquired. It should be noted that the operation for transmitting the save instruction information by the user can be arbitrarily set such as pressing a predetermined button.

  Further, in the present embodiment, when transmission instruction information from a user is acquired, stroke data that has not been transmitted is transmitted at once. However, the present invention is not limited to this, and the user receives the transmission instruction information. Regardless of the transmission instruction information, the untransmitted stroke data may be automatically transmitted at once after a predetermined time has elapsed.

[server]
Next, the server 5 will be described in detail with reference to FIG.

  As illustrated, the server 5 includes a process execution program 201, a stroke data acquisition function 202, an analysis data creation function 203, an analysis data storage function 204, and a process execution function 205. Each function is realized by the CPU included in the server 5 executing a program prepared in advance.

  The process execution program 201 is a program that analyzes the stroke data acquired from the terminal device 25 to create analysis data, and stores the analysis data in the analysis result DB 6. The process execution program 201 is a program that executes a predetermined process based on the analysis data.

  The stroke data acquisition function 202 is a function of acquiring stroke data from the terminal device 25 when connected to the terminal device 25 via the network 2 so as to be communicable. The acquired stroke data is digital data corresponding to the content entered in the form 3 by the user using the electronic pen 10.

  The analysis data creation function 203 is a function for creating analysis data by analyzing the stroke data acquired by the stroke data acquisition function 202. In this embodiment, the analysis data creation function 203 has a coordinate table storage function, an item stroke data extraction function, and a text data acquisition function.

  The coordinate table storage function is a function for storing a coordinate table that is referred to in order to create analysis data based on stroke data. Since the coordinate table is the same as the coordinate table stored in the terminal device 25 described above, the description is omitted for the sake of convenience.

  The item stroke data extraction function refers to items corresponding to the contents entered in each item of the form 3 from the stroke data acquired by the stroke data acquisition function 202 by referring to the coordinate table stored in the coordinate table storage function. This is a function for extracting stroke data. As shown in FIG. 11, since the coordinate table stores the items on the form 3 and their coordinate data in association with each other, the item stroke data extraction function can easily extract the item stroke data from the stroke data based on the coordinate table. Can be extracted.

  The text data acquisition function is a function for acquiring text data by performing character recognition based on item stroke data. The analysis data creation function 203 creates analysis data based on the text data acquired by the text data acquisition function. The created analysis data is temporarily stored in the memory.

  In the present embodiment, the analysis data creation function 203 obtains text data by recognizing characters of stroke data, and creates analysis data based on the text data. However, the present invention is not limited to this, and image data may be acquired based on stroke data, and analysis data may be generated based on the image data. In this case, the analysis data creation function 203 has an image data acquisition function for acquiring image data obtained by imaging the contents entered in the form 3 by the electronic pen 10 based on the stroke data.

  The analysis data storage function 204 is a function for storing the analysis data created by the analysis data creation function 203 in the analysis result DB 6.

  The process execution function 205 is a function for executing a predetermined process based on the analysis data created by the analysis data creation function 203. The predetermined process can be arbitrarily set.

[Verification process]
Next, the confirmation process executed by the terminal device 25 configuring the above-described processing system 100 will be described. FIG. 12 is a flowchart of the confirmation process.

  First, the user uses the electronic pen 10 to enter necessary items in each item of the form 3 as shown in FIG. Then, the electronic pen 10 acquires stroke data corresponding to the contents entered in the form 3 and transmits it to the nearby terminal device 25. In other words, the terminal device 25 acquires stroke data corresponding to the contents entered in the form 3 from the electronic pen 10 (step S1).

  The terminal device 25 stores the stroke data acquired from the electronic pen 10 in both the first local DB 4a and the second local DB 4b in a state before analysis (step S2). Further, the terminal device 25 creates confirmation data by analyzing the stroke data with reference to a coordinate table as shown in FIG. 11 (step S3). Further, the terminal device 25 temporarily stores the created confirmation data in the memory, and displays a confirmation screen on a display or the like based on the confirmation data (step S4). With the confirmation screen, the user can confirm whether or not the content entered in the form 3 with the electronic pen 10 is different from the result of analyzing the stroke data. When the confirmation screen is closed, the terminal device 25 deletes the confirmation data from the memory (step S5). That is, as data to be transmitted to the server 5, only stroke data is present on the terminal device 25.

  When transmitting the stroke data confirmed on the confirmation screen, the user operates the terminal device 25 to transmit transmission instruction information. When the terminal device 25 acquires the transmission instruction information, the terminal device 25 is connected to be able to communicate with the server 5 via the network 2. Then, the terminal device 25 refers to the local DB 4 and transmits untransmitted stroke data to the server 5 in a lump (step S6). The terminal device 25 rewrites the transmission item corresponding to the transmitted stroke data to “completed” in the local DB 4. Thereby, the confirmation process by the terminal device 25 is completed.

  The server 5 creates analysis data by referring to the coordinate table based on the stroke data acquired from the terminal device 25 and stores it in the analysis result DB 6. Moreover, the server 5 performs a predetermined process based on the created analysis data.

  According to the processing system 100 of the present embodiment, the stroke data is stored in the local environment (terminal device 25), and the stroke data is transmitted to the server 5 at a given timing, whereby the terminal device 25 and the server 5 It is not necessary to always be connected so that communication is possible, and stroke data can be easily transmitted even in an environment where a network is not established. Furthermore, the transmission time can be shortened by collectively transmitting the stroke. In addition, since the terminal device 25 analyzes the stroke data and displays a confirmation screen, before the user transmits the stroke data to the server 5, the user himself / herself fills the form 3 with the electronic pen 10 and the stroke data. It is possible to easily confirm whether or not there is a difference from the analysis result. As described above, by realizing the reduction of the transmission time and the confirmation in the local environment, the reception time before the server 5 executes the predetermined process can be shortened.

  The terminal device 25 deletes the confirmation data obtained by analyzing the stroke data when the confirmation screen is closed, and does not leave the data on the terminal device 25. That is, only the stroke data that has not been analyzed is stored in the local DB 4. As described above, the processing system 100 according to the present embodiment realizes a mechanism that takes into account the risk of information leakage caused by storing data in the local environment (terminal device 25).

  The present invention can be used as a processing system using an electronic pen that can transmit and check data even in an environment where a network is not established.

It is a figure which shows the usage pattern of an electronic pen typically. It is a functional block diagram which shows the structure of an electronic pen. It is a figure explaining the expression method of the information by the dot pattern printed on the exclusive paper. It is an example of a dot pattern and the information corresponding to it. The structure of a form composed of dedicated paper is shown. An example of an electronic pen form is shown. 1 shows a schematic configuration of a processing system. It is an example of the electronic pen form used in the present embodiment. It is a functional block diagram of the terminal device and server which are included in a processing system. It is a figure which shows typically the data structure of local DB. It is a figure which shows typically the data structure of a coordinate table. It is a flowchart of a confirmation process.

Explanation of symbols

2 ... Network 3 ... Electronic pen form 4a ... First local DB
4b ... Second local DB
5 ... Server 6 ... Analysis result DB
DESCRIPTION OF SYMBOLS 10 ... Electronic pen 11 ... Processor 12 ... Memory 13 ... Data communication unit 14 ... Battery 25 ... Terminal device 26 ... Inquiry server 27 ... Service server 100 ... Processing system

Claims (7)

In a terminal device that processes information entered in an electronic pen form printed with a dot pattern that can be recognized by an electronic pen,
The terminal device
A display unit;
Stroke data acquisition means for acquiring stroke data corresponding to the contents entered in the electronic pen form from the electronic pen;
Stroke data storage means for storing the stroke data;
Based on the stroke data, confirmation data creating means for creating confirmation data for displaying on the display unit a confirmation screen showing the contents to be entered in the electronic pen form;
Display means for displaying the confirmation screen on the display unit based on the confirmation data;
When the display of the confirmation screen is finished, erasing means for erasing the confirmation data on which the confirmation screen is based,
A terminal device comprising stroke data transmission means connected so as to be communicable with a server and transmitting the stroke data to the server. The terminal device
Based on the stroke data, further comprising image data acquisition means for acquiring image data corresponding to the content entered in the electronic pen form,
The terminal device according to claim 1, wherein the confirmation data creating unit creates the confirmation data based on the image data. The electronic pen form has a plurality of items filled in by the electronic pen,
The terminal device
A coordinate table storage unit that stores a coordinate table in which the item is associated with coordinate data that is a position coordinate of the item on the dot pattern;
By referring to the coordinate table, from the stroke data acquired by the stroke data acquisition means, item stroke data extraction means for extracting item stroke data respectively corresponding to entry contents in each item;
Text data acquisition means for acquiring text data corresponding to the entry contents in each item by recognizing the item stroke data;
The terminal device according to claim 1, wherein the confirmation data creating unit creates the confirmation data based on the text data. The stroke data storage means stores information indicating whether the stroke data is transmitted to the server in association with the stroke data,
The terminal device
Further comprising transmission instruction information acquisition means for acquiring the transmission instruction information;
The stroke data transmitting unit is connected so as to be communicable with the server when the transmission instruction information is acquired, and transmits untransmitted stroke data to the server in a lump. The terminal device according to any one of 1 to 3.   The stroke data transmitting means is connected so as to be communicable with the server when a predetermined time elapses, and stroke data that has not been transmitted is collectively transmitted to the server. The terminal device according to any one of 3. In a program executed by a computer that processes information entered in a form for an electronic pen printed with a dot pattern that can be recognized by the electronic pen,
The computer includes a display unit and is communicably connected to a server,
The program is
Stroke data acquisition means for acquiring stroke data corresponding to the contents entered in the electronic pen form from the electronic pen,
Stroke data storage means for storing the stroke data;
Based on the stroke data, confirmation data creating means for creating confirmation data for displaying a confirmation screen on the display unit showing contents to be entered in the electronic pen form;
Display means for displaying the confirmation screen on the display unit based on the confirmation data;
When the display of the confirmation screen is finished, the erasing means for erasing the confirmation data on which the confirmation screen is based
A program for causing the computer to function as stroke data transmitting means for transmitting the stroke data to the server. In a processing system for processing information entered in an electronic pen form on which a dot pattern that can be recognized by an electronic pen is printed,
The processing system includes a terminal device and a server,
The terminal device
A display unit;
First stroke data acquisition means for acquiring stroke data corresponding to the entry contents on the electronic pen form from the electronic pen;
Stroke data storage means for storing the stroke data;
Based on the stroke data, confirmation data creating means for creating confirmation data for displaying on the display unit a confirmation screen showing the contents to be entered in the electronic pen form;
Display means for displaying the confirmation screen on the display unit based on the confirmation data;
When the display of the confirmation screen is finished, erasing means for erasing the confirmation data on which the confirmation screen is based,
Stroke data transmitting means for connecting to the server so as to be communicable and transmitting the stroke data to the server,
The server
Stroke data acquisition means for acquiring the stroke data from the terminal device;
Based on the stroke data, analysis data creating means for creating analysis data obtained by analyzing the stroke data;
Analysis data storage means for storing the analysis data;
And a process execution means for executing a predetermined process based on the analysis data.

Images