JP2012038176A - Slip server device, slip information processing system, slip information processing method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To perform printing excluding a part unnecessary for the printing when printing contents entered by an entry person on exclusive paper by using a digital pen in combination with the exclusive paper.SOLUTION: Printing excluding a part unnecessary for the printing is performed by generating printing data by eliminating the use of slip data concerning an area, where an area for prohibiting printing on a duplicate document is defined by slip definition data, or using the slip data concerning an area, where an area for prohibiting printing on a duplicate document is not defined by the slip definition data, in response to a printing request on a duplicate document to be transmitted from an image forming apparatus.

Description

  The present invention relates to a form server device, a form information processing system, a form information processing method, and a program for generating copy print data for matters described with a digital pen.

  Conventionally, there are many flows in which necessary items are filled in an application form printed on paper as part of a workflow. In this workflow, there are two roles of a writer and a registration checker, and it is common that the application form entry by the writer and the application content check of the registration checker are physically and temporally different. Therefore, if there were any unclear points in the contents to be filled in, it was necessary for the writer to contact the question desk, and both the writer and the question desk took time. In addition, if there is an error in the entry, it may be returned to the person who filled out the application form and filled in again. In order to solve this problem, a method is generally widely adopted in which an application sample sample with entry examples and notes is distributed together with an application form with a blank entry field.

  Patent Document 1 discloses a technique regarding a method for reusing a printed form document. When this technology is applied to the use case of “distribution of application form”, the applicant can arbitrarily print a blank form document as long as the application form with this example is received. Therefore, there is an effect that it is not necessary for the distribution source of the application form to prepare both an application form with an entry example and a blank application form.

  Patent Document 2 discloses a technique for digitizing a trajectory entered by a user using an anotopen (digital pen) and printing an electronic report sheet including the digitized trajectory.

JP 2006-074439 A JP 2010-108101 A

  However, when the technique of Patent Document 1 is used, an image reading device is required to restore a blank form document at the application distribution destination.

  Furthermore, in the technique of Patent Document 1, it is necessary to cause the image reading apparatus to read the form document every time in order to restore the blank form document, and it takes time to fill in the application form.

  Furthermore, in the technique of Patent Document 1, the application distributor only needs to create one entry example, but the application distribution destination reads the image and restores the blank form document, resulting in paper Will need two. Furthermore, the application fee distribution destination will be responsible for the blank application fee that has been borne by the application distributor.

Furthermore, although the technology of Patent Document 1 can call attention by an example of entry, the final check confirmation is performed by another personality in another place. If there is an error, it will be necessary to send it back and fill it out, which will take time and effort.
Furthermore, although the technique of Patent Document 1 is based on the premise of reading an entry example, it is not effective because the entry example described on paper is often not read.

  In the technique of Patent Document 2, the locus of the digital pen can be printed on the electronic report sheet. However, since all the operator's entries that are the locus of the digital pen are printed, the sheet is printed for storage as a copy. There is a problem that it is not suitable.

  Therefore, the first object of the present invention is to use a combination of a digital pen and a dedicated paper, and when printing the contents entered by the writer on the dedicated paper, printing that does not require unnecessary printing. Is to provide a mechanism for

  In addition, the second object of the present invention is to determine whether or not a certificate is necessary by the user by determining whether or not scanning after printing is necessary based on information written by the user using a digital pen. It is to provide a mechanism to prevent.

  The first invention of the present application reads a predetermined dot pattern printed on the paper by an information reading unit that reads the dot pattern from the paper on which the predetermined dot pattern is formed, and based on the read dot pattern, A form server device that receives handwritten data including the position information transmitted from a digital pen that transmits position information by a communication unit, and is an area that prohibits printing on a copy document among a plurality of areas included in the form A form definition storage means for storing form definition data defining the data, a conversion means for analyzing writing data including position information transmitted using the digital pen, and converting the data into form data as character data, The form definition data stored in the form definition storage means in accordance with the print request for the copy document transmitted from the image forming apparatus. For the area where the prohibition of printing in the copy document is defined, the form data converted by the conversion means is not used, and the definition of the area in which the print on the copy document is prohibited by the form definition data. An area that has not been processed is provided with copy print data generation means for generating print data using the form data converted by the conversion means.

  Further, the form definition storage means further stores a scan condition for performing a scan instruction in the image forming apparatus after printing a copy of at least one of a plurality of areas included in the form. The form server device includes: a scan condition determining unit that determines whether the form data of the predetermined area converted by the converting unit satisfies a scan condition stored in the form definition storing unit; A scan instruction adding unit for adding a scan instruction to the image forming apparatus to be transmitted together with the print data generated by the copy print data generating unit when the scan condition determining unit determines that the scan condition is satisfied. Is further provided.

  A notification area determining means for determining whether or not the position information is a notification area for performing the voice notification provided on the sheet based on the position information read by the information reading unit of the digital pen; When the notification area determination means determines that the voice notification area is to be notified, the notification data corresponding to the notification area in the form definition data corresponding to the voice notification is reproduced by the digital pen. Output means for outputting as much as possible is further provided.

  Further, based on the position information read by the information reading unit of the digital pen, a start area determination unit that determines whether the position information is a start area, and the start area determination unit determines that the position is the start area. The writing data for specifying the contents of the form identification information entered with the digital pen in the form identification area on the paper is transmitted to the form server device, or a predetermined button is used with the digital pen. When the button is pressed, the form identification information can be communicated with the digital pen provided with form identification information transmitting means for transmitting form identification information obtained by reading the start area on the form to the form server device. Stored in the form definition storage means according to the form identification information sent by the information sending means or the form identification information obtained from the writing data Further comprising: a definition data transmission means for transmitting the form definition data corresponding to the document identification information to the digital pen being.

  In addition, the information reading unit that reads the dot pattern from the paper on which the predetermined dot pattern is formed reads the predetermined dot pattern printed on the paper, and the position information of the paper is based on the read dot pattern by the communication unit. A form information processing system including a digital pen to be transmitted, an image forming apparatus, and a form server, wherein the form server defines an area that prohibits printing on a copy document among a plurality of areas included in the form A form definition storage means for storing the form definition data being processed, a conversion means for analyzing handwritten data including position information transmitted using the digital pen and converting it into form data as character data, and the image formation The form definition data stored in the form definition storage means is used according to the print request for the copy document sent from the device. For the area where the prohibition of printing on the document is defined, the form data converted by the conversion means is not used, and the area for prohibiting the printing on the copy document is defined by the form definition data. A non-printing area, and a copy print data generation unit that generates print data using the form data converted by the conversion unit, and the image forming apparatus uses the copy print data generation unit of the form server device. The printing apparatus includes a printing unit that prints the copy document using the generated print data.

  The printing unit of the image forming apparatus further prints a registration sheet on which a predetermined dot pattern is formed and has an area to be filled in by the user. A form definition data transmitting means for transmitting form definition data in which an area and its notification data are associated to the digital pen is further provided, and the digital pen includes the position information read by the information reading unit of the digital pen. Based on a notification area determination means for determining whether or not the position information is a notification area on the sheet where the voice notification is to be performed, and a notification area where the voice notification is to be performed by the notification area determination means. If it is determined that there is a voice, the digital pen replays the voice according to the notification data corresponding to the notification area where the voice notification should be performed in the form definition data. Characterized in that it comprises a voice output means for and output.

  Further, the digital pen further includes writing data transmitting means for transmitting to the image forming apparatus writing data for specifying the contents entered with the digital pen in the notification area; In accordance with the form check data indicating whether or not to fill in the area and the handwritten data transmitted by the handwritten data transmitting means, the form check data is filled in the items that must be filled in. The image forming apparatus further includes an error message transmission unit that transmits an error message to the digital pen when it is determined that the error message is not transmitted to the digital pen voice output unit. In such a case, the sound is reproduced and output according to the error message.

  In addition, the information reading unit that reads the dot pattern from the paper on which the predetermined dot pattern is formed reads the predetermined dot pattern printed on the paper, and the position information of the paper is based on the read dot pattern by the communication unit. A form information processing method in a form server device that receives handwritten data including the position information transmitted from a digital pen to transmit, wherein among the plurality of areas included in the form, an area that prohibits printing on a copy document The form server device includes form definition storage means for storing the defined form definition data, and the conversion means of the form server device analyzes handwritten data including position information transmitted using the digital pen. A conversion step for converting the data into form data that is character data, and a copy print data generation of the form server device For the area in which the area for which printing on the copy document is prohibited is defined in the form definition data stored in the form definition storage unit in accordance with the print request for the copy document transmitted from the image forming apparatus. The form data converted by the conversion means is used for the area in which the form definition data does not use the form data and the area for which printing on the copy-forbidden document is not defined in the form definition data. And a copy print data generation step for generating print data.

  The information reading unit that reads the dot pattern from the paper on which the predetermined dot pattern is formed reads the predetermined dot pattern printed on the paper, and the position information of the paper is transmitted by the communication unit based on the read dot pattern. A program executed by a form server device that receives handwritten data including the position information transmitted from a digital pen, and defines a region that prohibits printing on a copy document among a plurality of regions included in a form. The form server device is provided with form definition storage means for storing the form definition data, and the form server device analyzes handwritten data including position information transmitted using the digital pen, According to the conversion request for converting to certain form data, and the print request for the copy document transmitted from the image forming apparatus The form definition data stored in the form definition storage means does not use the form data converted by the conversion means for the area where the prohibition of printing on the copy document is defined, and the form is not used. For areas where definition data is not defined to prohibit printing on copy documents, the form data converted by the conversion means is used to function as copy print data generation means for generating print data. And

  According to the first invention of the present application, by using a combination of a digital pen and a dedicated sheet, when printing the contents entered by the writer on the dedicated sheet, printing excluding unnecessary portions is performed. It can be carried out.

  In addition, according to the second invention of the present application, by determining whether the scan after printing is necessary or unnecessary based on information written by the user using a digital pen, it is possible to determine whether the certificate is necessary or not by the user. Can be prevented.

The figure which shows an example of a structure of the writing system 1 which concerns on this invention The block diagram which shows an example of the hardware constitutions of the digital pen 100 Block diagram showing an example of the hardware configuration of the form management server 200 The block diagram which shows an example of a function structure of the writing system 1 The figure explaining the expression method of the information by the dot pattern formed on the exclusive paper The figure which shows the example of a dot pattern and the information corresponding to it Diagram showing an example of the structure of dedicated paper Process overview of writing system 1 The flowchart which shows an example of the area | region acquisition process of the writing system 1 The flowchart which shows an example of the starting process of the writing system 1 The flowchart which shows an example of the notification process of the writing system 1 The flowchart which shows an example of the completion | finish process of the writing system 1 The figure which shows an example of the digital pen data 110 The figure which shows an example of writing data 120 A figure showing an example of form common data 130 The figure which shows an example of the area | region data 140 The figure which shows an example of form definition DB207 The figure which shows an example of the form definition data 260 The figure which shows an example of the area | region attribute 132 The figure which shows an example of the form check data 270 The figure which shows an example of form data DB208 The figure which shows an example of the form data 282 The figure which shows an example of the error message 290 The figure which shows an example of the message 291 Figure showing an example of a form output on paper The figure which shows an example of a structure of the writing system 2 which concerns on this invention The figure which shows the hardware constitutions of the multifunctional machine 400 Block diagram showing the functional configuration of the writing system 2 Process overview of writing system 2 The flowchart which shows an example of the area | region acquisition process of the writing system 2 The flowchart which shows an example of the starting process of the writing system 2 The flowchart which shows an example of the completion | finish process of the writing system 2 An image diagram showing an example of a screen displayed on the operation unit 3030 of the multifunction machine 400 The figure which shows an example of the digital pen data 110 of the writing system 2 The figure which shows an example of the form definition DB207 of the writing system 2 The figure which shows an example of the form information 406 of the writing system 2 The figure which shows an example of the form output on the paper of the writing system 2 Block diagram showing the functional configuration of the writing system 3 Process overview of writing system 3 The flowchart which shows an example of the completion | finish process of the writing system 3 The flowchart which shows an example of the completion | finish process of the writing system 3 An image diagram showing an example of a screen displayed on the operation unit 3030 of the MFP 400 of the writing system 3 The figure which shows an example of the form definition DB207 of the writing system 3 The figure which shows an example of the form definition data 260 of the writing system 3 The figure which shows an example of form data DB208 of the writing system 3

Hereinafter, a preferred embodiment of a writing system 1 according to the present invention will be described in detail with reference to the accompanying drawings.
FIG. 1 is a diagram showing an example of the configuration of a writing system 1 according to the present invention.

  As shown in FIG. 1, for example, one or a plurality of digital pens 100 (for example, one for a user) and one or a plurality of communication relay units 300 (for example, one for a floor) are connected by wireless communication. Further, the communication relay unit 300, one or a plurality of form management servers 200 (for example, installed at each base) are connected by a LAN (Local Area Network) 900.

  The digital pen 100 includes a pen tip portion similar to a normal ink pen, and a user can write characters on a sheet in the same manner as a normal ink pen. Although details will be described later, the digital pen 100 is used in combination with the dedicated paper 10 on which a dot pattern is formed. By using the dedicated paper 10, the digital pen 100 can convert the written content into data and store it.

In recent years, as digital pen 100, devices using various methods have appeared, and representative examples thereof include Anoto (registered trademark) digital pen (Anoto) developed by Anoto (registered trademark) in Sweden.
pen) ". The anotopen is used in pairs with a dedicated paper (hereinafter referred to as “dedicated paper”) on which a predetermined dot pattern is formed. In addition to a normal ink-type pen tip, the Anoto pen is equipped with a small camera for reading a dot pattern on dedicated paper and a communication unit compatible with Bluetooth (registered trademark). When the user writes characters or the like on the dedicated paper with an anotopen, the small camera detects a dot pattern on the dedicated paper as the pen moves, and input data such as characters written by the user is acquired. This data is transmitted to a terminal such as a personal computer or mobile phone near Anotopen by a communication unit compatible with Bluetooth (registered trademark).

  The system using this anotopen can be used as an input device in place of a keyboard or a mouse pointer, and is very easy to use for a user who is not good at using the above personal computer and keyboard.

  On the other hand, even at document submission destinations such as government offices and financial institutions, user entries can be acquired as input electronic data instead of paper documents as in the past, so subsequent electronic processing There is a merit that can be performed. (See Patent Document 1)

  The form management server 200 is a server for managing form data such as various application forms and registration forms. It has a wireless communication function and can communicate with the digital pen 100. With the wireless communication function, the form data can be transmitted to the digital pen 100 and the writing data can be received from the digital pen 100. The form management server 200 may be composed of a single server. Further, the form management server 200 may be configured by two servers, a primary server and a secondary server. Further, the form management server 200 may be configured by three or more servers.

  The communication relay unit 300 is a device for relaying communication between the digital pen 100 and the form management server 200. The communication relay unit 300 has a wireless communication function and a wired communication function. Wireless communication is suitable as a communication means for a mobile terminal such as the digital pen 100. However, due to its nature, the communication terminals need to exist at a short distance because of a short communication distance. However, when it is desired to communicate with a server having only one base such as the form management server 200, wireless communication is not suitable. Therefore, the communication relay unit 300 is intended to eliminate the demerits while taking advantage of the wireless communication by performing the wireless communication with the digital pen 100 and performing the wired communication with the form management server 200. Note that the communication relay unit 300 is intended to perform communication in this way, and therefore the communication relay unit 300 is not necessarily required in an environment where the digital pen 100 and the form management server 200 can directly communicate with each other.

Further, the communication relay unit 300 may have a function of a recognition system “Paper Look-up Service” (also referred to as PLS) for determining a user and related services from input data from a digital pen and transmitting them to the corresponding services. Good. In this case, the communication relay unit 300 having the PLS function can specify an appropriate service (server) according to the input data transmitted from the digital pen 100. In the case of this embodiment, the form management server 200 is determined. The input data can be transmitted, and the communication port of the determined form management server 200 can be returned to the digital pen 100 so that the digital pen 100 and the form management server 200 can directly communicate with each other. is there. In the present embodiment, since the digital pen service assumes only the form management server 200, the digital pen service may be configured to always transmit to the form management server 200 without using the PLS function.
Next, the digital pen 100 and the form management server 200 will be described with reference to FIGS.
FIG. 2 is a diagram illustrating a hardware configuration of the digital pen 100, and FIG. 3 is a diagram illustrating a hardware configuration of the form management server 200.

  As shown in FIG. 2, the digital pen 100 includes a memory 1001, a button 1002, an LED (Light Emitting Diode) 1003, a speaker 1004, a processor 1005, a wireless communication I / F controller 1006, a pressure sensor 1007, and an infrared LED 1008. A camera 1009, a battery 1010, and a cartridge 1011.

  The memory 1001 stores a predetermined application program for controlling the digital pen 100. It also holds digital pen data 110 (FIG. 13) used in the application. Furthermore, property information (pen information and pen owner information) regarding the digital pen 100 itself and its owner can be held and can be referenced from the application. The pen information includes battery level, pen ID, pen manufacturer number, pen software version, subscription provider ID, and the like. The memory 1001 of the digital pen 100 further stores a dot pattern arrangement of the dedicated paper in order to specify the position (coordinates) of the digital pen 100 on the dedicated paper with a predetermined application program. In addition, the area of the dot pattern arrangement of the dedicated paper in the Anoto technology is prepared for 60 million square kilometers in area, and the digital pen 100 reads the dot pattern to which position (coordinates) of which dedicated paper. It is possible to immediately determine whether the digital pen is inserted.

  The pen owner information includes nationality, language, time zone, mail address, free memory capacity, name, address, fax, telephone number, mobile phone number, and the like. The pen owner information is transmitted to and stored in the digital pen 100 side by specifying a setting value from a predetermined application and performing wireless communication.

A button 1002 receives an instruction from the user. The processor 1005 is notified that the button 1002 has been pressed. Therefore, an application mounted on the digital pen 100 can detect a press event of the button 1002. As will be described later, when this button 1002 is pressed, a message of the notification data is reproduced by voice with the digital pen 100 and outputted from the speaker 1004 as voice.
The LED 1003 is controlled by the processor 1005 to turn on / off.
The speaker 1004 is controlled by the processor 1005 and generates designated audio data.

By cooperation of the button 1002, the LED 1003, and the speaker 1004, the digital pen 100 can perform two-way communication with the user. Specifically, when the button 1002 is pressed while the LED 1003 is shining, processing such that a message flows from the speaker 1004 can be performed.
The processor 1005 comprehensively controls each device and controller in the digital pen 100.

  The wireless communication I / F controller 1006 can connect and communicate with an external device by performing wireless communication using light or radio waves. The wireless communication I / F controller 2012 can perform, for example, IrDA (Infrared Data Association) communication, Bluetooth (registered trademark) communication, communication using the IEEE 802.11 standard, and the like.

The pressure sensor 1007 detects the pressure applied to the pen tip when the user writes characters or the like on the dedicated paper 10 with the digital pen 100, that is, the writing pressure, and supplies the detected pressure to the processor 1005.
The infrared LED 1008 irradiates the imaging area of the camera 1009.
A camera 1009 serving as an information processing reading unit reads a dot pattern on the dedicated paper 10 and supplies the pattern data to the processor 1005.

  By the cooperation of the pressure sensor 1007, the infrared LED 1008, and the camera 1009, the user's written data (FIG. 14) can be recorded. Specifically, the processor 1005 switches on / off the infrared LED 1008 and the camera 1009 based on writing pressure data provided from the pressure sensor 1007. That is, when the user writes characters on the dedicated paper 10 with the digital pen 100, the pen tip portion is subjected to writing pressure. Therefore, when a writing pressure of a predetermined value or more is detected, it is determined that the user has started the description, and the infrared LED 1008 and the camera 1009 are operated.

The battery 1010 is for supplying power to each element in the digital pen 100. For example, the digital pen 100 itself can be turned on / off by attaching or removing a cap (not shown) of the digital pen 100. .
The cartridge 1011 is a component similar to a normal ink pen. When pressure is applied, the internal ink is applied to the ground plane.
Next, a method for acquiring X / Y data having contents described by the user using the digital pen 100 will be described.

  As described above, a predetermined dot pattern is formed on the dedicated paper 10. The camera 1009 of the digital pen 100 does not read the locus of ink described on the dedicated paper 10 by the user, but reads the dot pattern on the dedicated paper 10. Actually, the illumination area by the infrared LED 1008 and the imaging area of the camera 1009 (located in the illumination area) are slightly different from the position where the pen tip portion contacts the dedicated paper 10.

  The dot pattern is formed of a special ink containing carbon, and the camera 1009 can recognize only the pattern of the special ink. Even if a ruled line, a frame, or the like is formed on the dedicated paper 10 with an ink other than the dedicated ink (not including carbon), the electronic pen does not recognize them. Therefore, when creating paper such as various application forms using the dedicated paper 10, an input frame, ruled lines, cautions, etc. are formed with ink other than the dedicated ink.

  As described above, the digital pen 100 has a function of acquiring coordinate data and writing pressure data corresponding to characters and the like described on the dedicated paper 10 by the user and transmitting them to the communication relay unit 300 in the vicinity. Since the pen tip portion is a normal ink pen, the content described on the dedicated paper 10 remains as an original original. That is, at the same time as describing the original paper, its contents can be digitized in the form of coordinate data in real time.

As shown in FIG. 3, the form management server 200 includes a CPU (Central Processing Unit) 2001, a RAM (Random Access Memory) 2002, a ROM (Read Only Memory) 2003, an input controller 2005, and a video controller 2006 via a system bus 2004. The memory controller 2007, the communication I / F controller 2008, and the wireless communication I / F controller 2012 are connected.
The CPU 2001 controls each device and controller connected to the system bus 2004 in an integrated manner.

  The ROM 2003 or the external memory 2011 holds a basic input / output system (BIOS) and an operating system (OS) that are control programs of the CPU 2001, various programs executed by each server or each PC, and the like.

A RAM 2002 functions as a main memory, work area, and the like for the CPU 2001. The CPU 2001 implements various operations by loading a program necessary for execution of processing from the ROM 2003 or the external memory 2011 to the RAM 2002 and executing the loaded program.
An input controller 2005 controls input from a pointing device such as a keyboard (KB) 2009 or a mouse (not shown).

  The video controller 2006 controls display on a display device such as a CRT (Cathode Ray Tube) 2010. The display is not limited to the CRT, but may be another display such as a liquid crystal display. These are used by the administrator as needed.

  The memory controller 2007 is a hard disk (HD), flexible disk (FD), or PCMCIA (Personal Computer Memory Card International Association) that stores a boot program, various applications, font data, user files, editing files, various data, and the like. Controls access to an external memory 2011 such as a Compact Flash (registered trademark) memory or an SSD (Solid State Drive) connected to the card slot via an adapter.

  A communication I / F controller 2008 connects and communicates with an external device via a network such as a LAN (Local Area Network) 900, and executes communication control processing on the network. The communication I / F controller 2008 can perform communication using, for example, TCP / IP (Transmission Control Protocol / Internet Protocol), UDP (User Datagram Protocol), and the like.

  The CPU 2001 can display on the CRT 2010 by executing outline font rasterization processing on a display information area in the RAM 2002, for example. Further, the CPU 2001 enables a user instruction using a mouse cursor (not shown) on the CRT 2010 or the like.

Various programs operating on the hardware of the form management server 200 are recorded in the external memory 2011, loaded into the RAM 2002 as necessary, and executed by the CPU 2001. Definition files and various information tables used when executing the program are stored in the external memory 2011.
Next, the dot pattern formed on the dedicated paper 10 and the configuration of the dedicated paper will be described with reference to FIGS.

  FIG. 4 is a diagram for explaining a method of expressing information using a dot pattern formed on dedicated paper. In the dot pattern, as illustrated in FIG. 4, the position of each dot is associated with data.

  In the example of FIG. 4, 2-bit information (“00” to “11”) of 0 to 3 is displayed by shifting the dot position vertically and horizontally from the reference position of the grid (intersection of vertical and horizontal lines). It is an example. The digital pen reads the combination of information expressed in this manner, and compares the read information with information corresponding to the dot pattern of the dedicated paper 10 to determine the position coordinates on the dedicated paper 10.

  FIG. 5 is a diagram illustrating an example of a dot pattern and information corresponding thereto. As illustrated in FIG. 5A, the dot pattern has 36 dots arranged in a grid within a range of about 2 mm in length and width, and the data array (FIG. 5B) indicated by these dots is The position coordinates on the dedicated paper 10 are associated with each other.

  Therefore, when the dot pattern input from the camera 1009 of the digital pen 100 is photographed, the processor 1005 acquires the data array shown in FIG. 5B based on the dot pattern data input from the camera 1009 and responds to it. The position coordinates on the dedicated paper 10 (that is, where the dot pattern is located on the dedicated paper) can be calculated in real time using a predetermined application stored in the memory 1001. Note that the minimum unit for recognizing a dot pattern is 2 mm × 2 mm, and the camera 1009 captures about 100 times per second. Since the technique for obtaining the position coordinates on the dedicated paper 10 from the dot pattern data read by the camera 1009 is a known technique as the Anoto technique, detailed description of a predetermined application program by the processor 1005 is omitted.

  FIG. 6 is a diagram illustrating an example of the structure of a dedicated sheet. As shown in the figure, the dedicated paper 10 has a dot pattern 13 formed on a mount 11 and a pattern 12 such as a ruled line formed thereon. The mount 11 is ordinary paper, and the dot pattern 13 is formed of a dedicated ink containing carbon as described above. Further, the design 12 is formed of normal ink or the like. The dot pattern 13 and the design may be formed simultaneously, or one of them may be formed first. Moreover, although the example which formed the dot pattern 13 in the whole surface of the mount 11 was shown, you may make it form in a part of mount.

  The dot pattern 13 is normally assigned for each type of paper (dedicated paper). That is, the dot patterns in the paper do not overlap in one paper, but the same dot pattern 13 is formed on all papers of the same type (same form). Further, as described above, what is meant by the area where the dot pattern 13 is formed is predefined. Therefore, when the user inputs necessary items to the dedicated paper 10 with the digital pen 100, it is possible to specify from the coordinate data on the paper which item of the paper corresponds to the input item.

  In this way, by designing and forming the design 12 including the entry portion 14 necessary as a sheet on the dedicated paper 10 on which the dot pattern 13 is formed, by writing something in the entry portion 14 with the digital pen 100, Forms that can automatically convert the entered information into electronic data can be created.

  The dot pattern 13 or the entry section 14 and other necessary information are formed by printing a preprinted printing plate using a so-called printing apparatus such as an offset printing machine (hereinafter simply “printing”). Or “print formation”) or by means of sending data from the computer to a so-called printer device connected to and controlled by the computer (hereinafter simply referred to as “print” or “print formation”). .

Printing with a printing press is suitable for producing the same in large quantities. Therefore, when the paper of the present invention is created by printing, the same dot pattern 13 is usually formed if the paper is the same type.
Needless to say, even if the same dot pattern is formed on all sheets, the printing may be performed by the printer.

  When the paper of the present invention is printed by the printer, if the data to be sent to the printer is unique for each paper, a unique dot pattern 13 is defined for each paper, and this is printed. Is possible. In this case, it is possible to specify a sheet for each sheet by simply reading the dot pattern 13 at an arbitrary position formed on the dedicated sheet 10 of the present invention with the digital pen 100. For example, it can be used when a serial number is assigned to a sheet in advance, such as a delivery slip, or when a user's personal information is printed for each sheet and individual sheets are specified.

  Next, with reference to FIGS. 7, 13, 14, 15, 16, 17, 18, 18, 19, 20, 21, 22, and 25, the functions and use of the writing system 1 will be described. The data to be described will be described.

  7 is a block diagram showing a functional configuration of the writing system 1 according to the present invention, FIG. 13 is a diagram showing an example of the digital pen data 110, and FIG. 14 is a diagram showing an example of the writing data 120. is there. 15 is a diagram illustrating an example of the form common data 130, FIG. 16 is a diagram illustrating an example of the area data 140, and FIG. 17 is a diagram illustrating an example of the form definition DB 207 (form definition storage unit). FIG. 18 is a diagram illustrating an example of the form definition data 260. 19 is a diagram illustrating an example of the area attribute 132, FIG. 20 is a diagram illustrating an example of the form check data 270, and FIG. 21 is a diagram illustrating an example of the form data DB 208. FIG. 25 is a diagram illustrating an example of form data 282, and FIG. 25 is a diagram illustrating an example of a form output on paper.

  The digital pen data 110 in FIG. 13 is data stored in the memory 1001 of the digital pen 100. The digital pen data 110 includes the number of shots 111 by the camera 1009, the current data ID 112 read by the camera 1009, the writing data 120 (FIG. 14) entered by the digital pen 100, the form common data 130 (FIG. 15), and the form ID 113. (Form identification information) and form definition data 114 (similar to FIGS. 18 and 260).

  The writing data 120 of FIG. 14 has a time 121 written with the digital pen 100, coordinates 122 indicating the written position, and writing pressure 123 when written. These pieces of information are automatically stored when the user enters characters using the digital pen 100. Since the handwritten data 120 is a set of coordinates, a set of coordinates in a region where time and coordinates are continuous is set as region data 140 from the set.

  The form common data 130 in FIG. 15 is data stored in advance in the memory 1001 of the digital pen 100, and has a data ID 131, a region attribute 132, and a region 133. These pieces of information are data used by a predetermined application program stored in the memory 1001 of the digital pen 100. By using these pieces of information, the position (coordinates) on the dedicated paper to which the digital pen 100 is pointing. ) Can be specified.

  The area data in FIG. 16 is a set of the writing data in FIG. 14, but a continuous writing data area 141 and stroke data 142 are obtained when the processor 1005 of the digital pen 100 operates a predetermined application program. It is done. The region is a region of characters entered by the user obtained from the writing data, and the stroke data is data indicating characters entered by the user in the region, and is, for example, a bitmap image.

The form definition DB 207 of FIG. 17 is a database that the form server 200 has, and has a form ID 250, form definition data 260 (FIG. 18), and form check data 270 (FIG. 20).
The form definition data 260 in FIG. 18 includes a data ID 261, a region attribute 132 (FIG. 19), a region 263, a notification state 264, and notification data 265.

The area attribute 132 in FIG. 19 has four attributes of “start”, “end”, “notification”, and “not notified”. A plurality of values in the region 263 in FIG. 18 indicate “X coordinate of the start point, Y coordinate of the start point, width, and height”, respectively.
The form check data 270 in FIG. 20 has three items of data ID 271, essential 272, and check 273.

The form data DB 208 in FIG. 21 is a database that the form server has, and has a form data ID 280, form ID 281 and form data 282 (described later in FIG. 22). Details of this will be described later.
The function of each device of the present embodiment will be described with reference to FIG. First, a function for executing processing of the digital pen 100 will be described.

  The digital pen 100 includes a writing storage unit 101, a wireless communication unit 102, a voice notification unit 103, an LED notification unit 104, a button control unit 105, a data management unit 106, a region determination unit 107, digital pen data 110, and the like.

  The writing storage unit 101 controls the pressure sensor 1007, the infrared LED 1008, and the camera 1009 to record writing data. When the pressure sensor 1007 detects the writing pressure, the imaging region is irradiated with the infrared LED 1008 and the camera 1009 captures an image. While the pressure sensor 1007 detects the writing pressure, the photographing is performed about 100 times per second. When the writing pressure is not detected, the photographing is finished. The photographed data is stored in the digital pen data 110 as writing data 120.

The writing data 120 includes a time 121, coordinates 122, writing pressure 123, and the like. The time 121 is identification information for managing shooting in units of 100 times per second in time series, and stores a time stamp at the time of shooting. A coordinate 122 indicates a photographed absolute coordinate, and a coordinate is specified from the photographed dot pattern. The pen pressure 123 stores data detected by the pressure sensor 1007.
In addition to these pieces of information, the writing data 120 also stores speed, pen inclination, and the like using an acceleration sensor (not shown).

  Further, by analyzing the handwritten data, the handwriting written on the paper can be reproduced. In addition, since the coordinates can be specified, it is possible to acquire in real time information on which area of the paper the user is writing.

  The wireless communication unit 102 has a function of communicating with an external device using light or radio waves. Specifically, communication is performed with an external device using a wireless technology such as IrDA (Infrared Data Association) or Bluetooth (registered trademark).

The voice notification unit 103 controls the speaker 1004 to notify the voice. When the data to be notified is audio data, the audio data is analyzed, and audio having a frequency represented by the audio data is output from the speaker 1004. Further, the notification target data may be text data instead of voice data. In this case, the voice notification unit 103 converts text data into voice data using a TTS (Text To Speech) system. Specific examples of the TTS system include HVScript (Humanoid Voice Script) that uses SMAF (Synthetic Mobile Application Format (registered trademark)) for voice data, and VoiceXML that expresses voice by marking up text.
The LED notification unit 104 controls the LED 1003. The LED can be turned on under certain conditions to alert the user.
The button control unit 105 controls the button 1002. It is detected that the button 1002 has been pressed by the user.

  The data management unit 106 manages the digital pen data 110 in FIG. 13 stored in the memory 1001. Data can be read / written and updated by accessing the memory 1001.

The area determination unit 107 determines which area the coordinates written with the digital pen 100 are. In determining the area, the form common data 130 registered in advance in the digital pen data 110 and the form definition data 114 acquired from the form management server 200 are used. Since a plurality of areas 133 are registered in the form common data 130, it is determined whether or not the acquired coordinates are included in any area 133 of the form common data 130.
The digital pen data 110 in FIG. 13 stores data related to writing, and is data held in the memory 1001.

The digital pen data 110 is composed of a shooting count 111, a current data ID 112, writing data 120, a form common data 130, a form ID 113, and a form definition data 114.
The number of shootings 111 is data for temporarily counting the number of shootings. Since the imaging frequency is different from the region determination frequency, it is used to adjust the frequency.
The current data ID 112 is information for storing in which region the coordinates where the digital pen 100 is currently located are located.

  The form common data 130 is data that defines a common area for all forms. This data is registered in advance in the digital pen 100, and includes a data ID 131, a region attribute 132, and a region 133.

The data ID 131 is an ID for uniquely identifying the area. The area attribute 132 is data representing the attribute of the area as shown in FIG. The area attribute 132 includes types of start, end, notification, and unnotified. All types can be used in the form common data 130, but only notification can be used in the form definition data 260. The meaning of each area is as follows. When written in the start area, the digital pen 100 acquires specific form definition data 260 from the form definition server 200. When writing in the end area, the digital pen 100 transmits the writing data 120 to the form management server 200. When writing is made in the notification area, the digital pen 100 makes a voice notification to the user. When written in the unreported area, the digital pen 100 does not perform any processing. The area 133 is information representing a range in the form. A rectangle may be expressed by information on X, Y, length, and height, or a circle may be expressed using an expression.
The form ID 113 is an ID for identifying the form.

The form definition data 114 is data that defines a form-specific area, and is acquired from the form management server 200. Specifically, arbitrary form definition data 260 stored in the form definition DB 207 of the form management server 200 is stored.
Next, a function for executing the processing of the form management server 200 will be described.

  The form management server 200 includes a wired communication unit 201, a character recognition unit 202, a data check unit 203, a form definition management unit 204, a form data management unit 205, an area calculation unit 206, a form definition DB 207, a form data DB 208, and the like.

  The wired communication unit 201 connects and communicates with an external device via a network such as the LAN 900, and controls communication according to a communication protocol such as TCP / IP or UDP. As a result, the form management server 200 can communicate with the communication relay unit 300 or the like similarly connected to the LAN 900.

The character recognition unit 202 converts the writing data 120 sent from the digital pen 100 into form data 282. Since each data area is defined in the form definition data 260, the area data 140 is extracted from the writing data using the information. The stroke data 142 of the extracted area data 140 is converted from image data to text data using a known technique. The stroke data 142 stores data as a set of coordinates, for example, a format such as a bitmap.
The data check unit 203 uses the form check data 270 to determine whether the form data 282 is in the correct format.

  The form definition management unit 204 manages the form definition data 260 in the form definition DB 207. Specifically, the form definition data 260 is read, written, updated, deleted, and the like.

The form data management unit 205 manages the form data 282 in the form data DB 208. Specifically, the form data 282 is read, written, updated, deleted, and the like.
The area calculation unit 206 acquires the stroke data 142 in the area data 140 from the writing data 120.

  The form definition DB 207 in FIG. 17 is information managed by the external memory 2011. The form definition DB 207 includes a set of a form ID 250, form definition data 260, and form check data 270. These sets are stored for the number of form templates. A form ID 250 is an ID for identifying a form template. The form definition data 260 is data defining each area of the form. The form check data 270 is data that defines values to be satisfied by values included in each area of the form.

  The form definition data 260 in FIG. 18 includes a data ID 261, a region attribute 132, a region 263, a notification state 264, notification data 265, and the like. The data ID 261 is an ID for identifying data. Data is a minimum unit of information such as “name” and “address”, and is handled by various data such as form definition data 260, form check data 270, form data 282. Data ID is used to handle the same information between these different data. The area attribute 132 is data representing the attribute of the area. Note that the area attribute included in the form definition data 260 cannot define start, end, or unnotified. It is assumed that the area attribute of the form definition data 260 is always “notification”. An area 263 is information representing a range in the form. A rectangle may be expressed by the X coordinate of the start point, the Y coordinate of the start point, the length (width in the X-axis direction), and the height (height in the Y-axis direction), or a circle using an expression It may be expressed. The notification state 264 is information indicating whether the notification data 265 has been notified to the user. It is represented by information of “not yet” and “completed”. Note that the default value of the notification data 265 is “not yet”. The notification data 265 represents data for voice notification to the user. This data may be voice data itself or text data. Either data is appropriately processed by the voice notification unit 103 of the digital pen 100 and output as voice. Note that the notification state 264 and the notification data 265 are not directly used in the form management server 200. The form definition data 260 is copied to the digital pen data 110 and used by the digital pen 100.

  The form check data 270 in FIG. 20 includes a data ID 271, a required item 272, a check item 273, and the like. The data ID 271 is a unique value for identifying data. The required item 272 indicates whether “required” and “arbitrary” values are set and the value is required. The check item 273 means a condition that the attribute value should satisfy. For example, conditions such as “only numbers are allowed” or “only numbers and hyphens are allowed” are specified. These values may be general regular expressions or may be in a unique format that can be interpreted by the data check unit 203.

  The form data DB 208 in FIG. 21 is information managed by the external memory 2011, and stores a plurality of form data 282. The information managed by the form definition DB 207 is a form template, and the information managed by the form data DB 208 is actual data using the form template.

The form data DB 208 in FIG. 21 includes a set of form data ID 280, form ID 281 and form data 282. These sets are stored for the number of form data. A form data ID 280 is an ID for identifying form data. The form ID 281 is an ID for specifying form template information managed by the form definition data 260. The form data 282 in FIG. 22 is actual data of the form, and includes a data ID 283, a data value 284, and the like. Note that the form data 282 in FIG. 22 is data managed by the form server 200 based on the area data 140 calculated from the coordinates of characters entered with the digital pen 100 from the coordinates.
As shown in FIG. 25, a paper form 500 is a diagram showing an example of a form output on paper.

  The paper form 500 includes an ID area 501, a start area 502, an information entry area 503, an end area 504, and the like. The ID area 501, the start area 502, and the end area 504 are areas common to all forms, and area information is stored in advance in the digital pen data 110 as form common data 130. That is, the digital pen 100 can identify these areas without communicating with the form management server 200. On the other hand, since the information entry area 503 is an area specific to a form, the digital pen 100 cannot identify the area without obtaining the form definition data 260 from the form management server 200.

  An ID area 501 is an area where the user enters a form ID. The digital pen 100 can recognize the form ID when the user transcribes the form ID described in advance into the ID area 501. Here, as the method for identifying the form by the digital pen 100, a method for copying the form ID is presented, but the form may be identified by other methods. For example, a method is conceivable in which the digital pen 100 is prepared for each form and the form definition data 260 is stored in the digital pen 100 in advance. In addition, a method is conceivable in which a unique dot pattern is defined for each form and the form ID is identified by the read dot pattern.

  The start area 502 is an area that serves as a trigger for the digital pen 100 to acquire the form definition data 260 from the form management server 200. When written in this area, the digital pen 100 transmits the information written in the ID area to the form management server 200. As a result, the digital pen 100 can acquire the form definition data 260 from the form management server 200. As an example of writing in the start area, there is a method of marking a check mark.

The end area 504 is an area for the digital pen 100 to transmit the writing data 120 to the form management server 200 and finish the form entry. As an example of writing in the end area, there is a method of marking a check mark.
Next, an outline of processing of the writing system 1 according to the present invention will be described with reference to FIG. FIG. 8 is a process outline diagram of the writing system 1.

  In FIG. 8, the digital pen 100 and the form management server 200 communicate directly, but as described above, the digital pen 100 communicates with the communication relay unit 300 wirelessly, and then the communication relay unit 300 is wired. Communication with the form management server 200 may be performed. Here, the relay of the communication relay unit 300 will be omitted.

  First, the form ID is entered by the user (1-1), and when the start area is checked, the digital pen 100 transmits the entered form ID to the form management server 200 (1-2). Specifically, when the start area is checked, the processor 1005 of the digital pen 100 compares the dot pattern arrangement stored in the memory 1001 with the read dot pattern and confirms that the start area is checked. To detect. When it is detected that the start area has been checked, the writing data (data actually entered with a digital pen, such as bitmap data and stroke data) entered in the entry area of the form ID is transmitted to the form server 200. If anoto paper using the anoto technology is used, it is possible to uniquely identify which form the dot pattern arrangement of the dedicated paper corresponds to, so which form is determined from the dot pattern read by the camera 1009 of the digital pen 100. It can be uniquely identified. In this case, as shown in FIG. 8, it is not necessary to fill in the form ID, and the form (form ID) specified from the dot pattern is transmitted to the form server 200 only by checking the start area with the digital pen 100. be able to. Therefore, it is not essential for the user to enter the form ID in the form ID entry area. Also, by checking the start area with the digital pen 100, the processor 1005 detects the start area check using a predetermined application program stored in the memory 1001, and transmits the form ID. However, the present invention is not limited to this, and when the button 1002 is pressed after checking the start area, the stored written data (check to the start area) read immediately before is transmitted to the form server 200. May be.

  The form management server 200 searches the form definition DB 207 for form definition data 260 that matches the form ID (1-3) and transmits it to the digital pen 100 (1-4).

  Next, when the user enters information with the digital pen 100 in the information entry column, the digital pen 100 reads the dot pattern 13 and instantly determines the entered coordinates using the Anoto technique. The digital pen 100 uses the form definition data 260 (notification data 265 in FIG. 18) received from the form management server 200 to determine the area filled in by the user, and plays a voice message corresponding to the area (2- 1). Note that the notification data 265 is audio data, and the processor 1005 can reproduce the audio data using a predetermined application program stored in the memory 1001, and an audio message is output from the speaker 1004. The writing data entered with the digital pen 100 in the information entry field is stored in the memory 1001.

  When the end area is checked, the digital pen 100 transmits the stored writing data 120 to the form management server 200 (3-1). Also in this process, by checking the end area with the digital pen 100, the processor 1005 detects the end area check using a predetermined application program stored in the memory 1001, and transmits the form ID. ing. However, the present invention is not limited to this, and the configuration is such that when the button 1002 is pressed after checking the end area, the stored written data (check for the end area) read immediately before is transmitted to the form server 200. May be.

The form management server 200 receives the writing data 120, converts the image data into text data (3-2), and checks whether the text data conforms to the check conditions (3-3). If it does not match, the digital pen 100 is notified of an error, and the digital pen 100 notifies the user of the error information by voice. As examples that do not fit, there are cases where mandatory items are not filled in or hiragana is filled in only numeric items. If the check item matches, the form management server 200 registers the form data 282 in the form data DB 208 (3-4).
Next, detailed processing of the writing system 1 according to the present invention will be described with reference to FIGS. 9, 10, 11, 12, 23, and 24.

FIG. 9 is a flowchart showing an example of area acquisition processing of the writing system 1, FIG. 10 is a flowchart showing an example of start processing of the writing system 1, and FIG. 11 is a flowchart showing an example of notification processing of the writing system 1. 12 is a flowchart illustrating an example of the termination process of the writing system 1, FIG. 23 is a diagram illustrating an example of the error message 290, and FIG. 24 is a diagram illustrating an example of the message 291.
First, the area acquisition process of the writing system 1 will be described with reference to FIG.
In FIG. 9, the digital pen 100 determines the writing state of the user and stores writing data, or performs processing according to the written area.

  As shown in FIG. 9, the digital pen 100 detects the writing pressure using a writing pressure sensor (insulator omitted) (step S <b> 100). If the writing pressure cannot be detected, it waits until it can be detected. This is to prevent the camera and the storage area from being wasted when the camera is not written. Therefore, the writing state is confirmed based on whether or not the writing pressure is detected.

  When the pen pressure can be detected, the digital pen 100 stores the writing data 120 (step S101). As the writing data 120, a time stamp is obtained and time 121 is obtained, a dot pattern is obtained from an image photographed by a camera, coordinates 122 are obtained, and writing pressure 123 is obtained based on information obtained from a pressure sensor. To do.

The digital pen 100 determines whether or not the number of shootings 111 has reached the specified number (step S102). As described above, when the digital pen 100 detects the writing pressure, the digital pen 100 captures about 100 times per second. Coordinates can be acquired each time, but it is not necessary to determine the area each time shooting is performed considering the speed at which humans write. This does not apply to writing in meaningless figures that are not stenographs or characters, but considering writing meaningful characters in application forms and registration forms, it is determined 1/100 seconds when judged 100 times per second. There is not much change in the area. In addition, if the area determination is performed 100 times per second, a considerable load is applied to the processor 1005. Therefore, the area determination is performed only when the number of shootings 111 reaches a certain number, thereby improving the processing performance and realizing a system that is easy for the user to use.
If the number of shootings 111 has not reached the specified number, the digital pen 100 counts up the number of shootings 111 (step S103).

  The digital pen 100 performs area determination when the number of shootings 111 reaches a specified number. For example, if the shooting is performed 100 times per second and the area determination is performed twice per second, the specified number of times is 50. This value is set in advance. Further, in order to perform the area determination again at the same frequency, the digital pen 100 resets the number of times of photographing 111 when the number of times of photographing 111 reaches the specified number of times (step S104).

  The digital pen 100 acquires a data ID based on the coordinates 122 of the writing data 120 stored in step S101 in order to determine the area. Specifically, first, it is determined whether or not the current coordinates are included in each area of the form common data 130 registered in advance. If the coordinates are included in any area, the data indicated by the area is displayed. ID 131 is acquired. If no current coordinates are included in any area, it is determined whether each area of the form definition data 114 acquired from the form management server 200 includes the current coordinates, and the coordinates are included in any area. If so, the data ID 261 indicated by the area is acquired. Note that this determination is not performed when the form definition data 114 is not acquired from the form management server 200.

  The digital pen 100 determines whether or not the data ID has been acquired in the previous process (step S106). If the data ID cannot be acquired, the digital pen 100 resets the current data ID 112 (step S107). On the other hand, if the data ID can be acquired, it is determined whether the acquired data ID is the same as the current data ID 112 (step S108). If the determination result is the same, the writing pressure detection is performed again without performing any processing. On the other hand, if not the same, the data ID is stored as the current data ID 112 (step S109).

  By storing the current data ID 112, it is possible to perform voice notification at the moment of entering a certain area and not to perform voice notification until the area is subsequently exited. This is because if the current data ID 112 is not stored, the same sound continues to flow while writing in a certain area, which is inconvenient for the user.

The digital pen 100 determines the region attribute (step S110). When the current data ID 112 is acquired from the form common data 130 in step S105, the data area attribute 132 that matches the data ID 131 of the form common data 130 is acquired and determined. When the current data ID 112 is acquired from the form definition data 114 in step S105, the area attribute 132 of data that matches the data ID 261 of the form definition data 260 is acquired and determined.
If the determined region attribute is “start”, the digital pen 100 performs a start process shown in FIG. 10 (step S111).
When the determined area attribute is “notification”, the digital pen 100 performs the notification process illustrated in FIG. 11 (step S112).
If the determined region attribute is “end”, the digital pen 100 performs the notification process shown in FIG. 12 (step S113).
If the determined region attribute is “not notified”, the digital pen 100 returns to step S100 and performs pen pressure detection again.
In this way, a system that can perform various two-way communication with the user is realized by performing different processing depending on the area.
Next, the start process of the writing system 1 will be described with reference to FIG.

  In FIG. 10, the digital pen 100 acquires form definition data 260 from the form management server 200. In actual communication, the digital pen 100 communicates with the communication relay unit 300 wirelessly, and then the communication relay unit 300 communicates with the form management server 200 by wire. Here, the relay of the communication relay unit 300 will be omitted.

  As shown in FIG. 10, the digital pen 100 acquires form ID area data from the writing data 120 (step S200). Since the handwritten data 120 is a set of coordinates, a set of coordinates of the area specified by the ID area of the form common data 130 is acquired from the set. The acquired data is acquired as area data 140. In the area 141 of the area data 140, an area cut from the writing data 120 is stored, and in the stroke data 142 of the area data 140, a set of coordinates in the area cut from the writing data 120 is stored as image data.

  The digital pen 100 determines the stroke data 142 of the area data 140 acquired in the previous stage (step S201). If the image data acquired as the stroke data 142 is blank, it is assumed that the form ID is not entered in the ID area, and a form ID area data acquisition error is notified (step S202). Specifically, the error message ERR01 shown in FIG. 23 is selected, and the message “Form ID is not entered” is notified by voice. For example, as a case where this voice notification is made, a case where writing is performed in the start area without describing anything in the form ID area can be considered. In this way, when the user performs writing in an incorrect procedure, it is possible to dynamically prompt the user to make a call by voice notification.

  As a result of the determination in step S201, if it is recognized that some character is written in the area data 140, that is, if there is handwritten coordinate data in the area, the digital pen 100 sends the area data 140 to the form management server 200. Transmit (step S203).

  Further, as described above, if anoto paper using the anoto technology is used, it is possible to uniquely identify which form the dot pattern arrangement of the dedicated paper corresponds to. Therefore, it may be possible to uniquely identify which form is the dot pattern read by the camera 1009 of the digital pen 100. In this case, the form ID area data becomes unnecessary, and the form (form ID) specified from the dot pattern can be transmitted to the form server 200 simply by checking the start area with the digital pen 100. Therefore, step S200 by the user entering the form ID in the form ID entry area is not necessary, and instead, a process for uniquely identifying which form is the form from the read dot pattern is required. In the following description, the area data of the form ID area will be used, but the form ID uniquely specified from the dot pattern read by the camera 1009 may be used as the form ID area data. It is not limited to the method of. Further, a step of determining whether the button 1002 is pressed may be provided between step S201 and step S203.

  The form management server 200 receives the area data 140 of the form ID area transmitted from the digital pen 100 (step S204), and analyzes the stroke data 142 included in the area data 140 (step S205). Specifically, since the stroke data 142 is described as image data of a set of coordinates such as a bitmap format, the stroke data 142 is analyzed by a known technique and converted into text data. Note that when the form ID uniquely specified is transmitted from the digital pen 100, the process of step S204 is not necessary.

  The form management server 200 searches for the form definition data 260 from the form definition DB 207 (step S206). As a search condition, it is assumed that the form ID 250 matches the text data acquired in the previous stage.

  The form management server 200 determines whether form definition data 260 matching the text data specified in the form definition DB 207 has been found (step S207).

  If the form definition data 260 is not found as a result of the determination in step S207, the form management server 200 transmits a form definition data acquisition error to the digital pen 100 (step S208).

  The digital pen 100 accepts a form definition data acquisition error (step S209) and notifies the form definition data acquisition error (step S210). Specifically, the error message ERR02 shown in FIG. 23 is selected, and a message “Form definition data not found.” Is notified by voice. For example, when this voice notification is made, it is conceivable that an invalid form ID is written in the form ID area, or the form ID is erroneously transferred. In this way, when the user performs writing in an incorrect procedure, it is possible to dynamically prompt the user to make a call by voice notification.

  When the form definition data 260 is found as a result of the determination in step S207, the form management server 200 transmits the found form definition data 260 to the digital pen 100 (step S211).

  The digital pen 100 receives the form definition data 260 from the form management server 200 (step S212) and stores it as the form definition data 114 of the digital pen data 110 (step S213). At this time, if the form definition data 114 already stored exists, the data is overwritten.

The digital pen 100 stores the form ID in the digital pen data 110 as the form ID 113 (step S214), and initializes the writing data 120 stored so far (step S215).
Next, the notification process of the writing system 1 will be described with reference to FIG. In FIG. 11, the digital pen 100 performs voice notification according to the written area.

As shown in FIG. 11, the digital pen 100 acquires a notification state (step S300). Specifically, the line having the data ID 261 that matches the current data ID 112 of the digital pen data 110 is acquired from the form definition data 114 of the digital pen data 110, and the notification state 264 is acquired.
The digital pen 100 checks the acquired notification state 264 (step S301).

  If the notification state 264 is “not yet” as a result of the determination in step S301, the digital pen 100 notifies the notification data 265 (step S302), and sets the notification state 264 to “completed” (step S303). The notification process of the notification data 265 is a process in which the processor 1005 reproduces voice according to a predetermined application program and outputs the voice through the speaker 1004, specifically, voice data.

  If the notification state 264 is “done” as a result of the determination in step S301, the digital pen 100 suspends the sound reproduction by the notification data 265 and turns on the LED 1003 (step S304).

The digital pen 100 determines whether or not the button 1002 has been pressed (step S305). If the button 1002 has been pressed, the process proceeds to step S302, where voice notification is performed.
As a result, necessary alerting can be dynamically performed according to the writing state of the user, and a system that is easier for the user to use is realized.

  If the button 1002 has not been pressed, the digital pen 100 determines whether a predetermined time has elapsed (step S306), and if the predetermined time has not elapsed, the digital pen 100 determines whether the button 1002 has been pressed again.

Here, when the notification state 264 is “completed”, the reason for performing the LED display without starting the voice notification is as follows. It is troublesome for the user to reproduce the notified voice data every time, and it cannot be said that the system is easy to use. However, if you accidentally write in another area, or if you miss a voice notification, you may want to hear it again. Therefore, the LED is turned on for the voice notification area, and if the button is pressed within a certain period of time, the voice notification is performed again on the recycled paper, and if the button is not pressed, the processing is continued as it is. A system that is easy to use while maintaining its characteristics.
Next, the termination process of the writing system 1 will be described with reference to FIG.

  In FIG. 12, the digital pen 100 transmits the writing data 120 to the form management server 200. In actual communication, the digital pen 100 communicates with the communication relay unit 300 wirelessly, and then the communication relay unit 300 communicates with the form management server 200 by wire. Here, the relay of the communication relay unit 300 will be omitted.

  As shown in FIG. 12, the digital pen 100 transmits the form ID 113 and the writing data 120 stored in the digital pen data 110 to the form management server 200 (step S400).

  The form management server 200 receives the form ID 113 and the writing data 120 from the digital pen 100 (step S401), and acquires the form definition data 260 and the form check data 270 from the form definition DB 207 using the received form ID 113 as a key (step S401). S402).

  The form management server 200 acquires each area data 140 (step S403). Specifically, first, each area 263 defined in the form definition data 260 is extracted from the writing data 120 as area data 140.

  The form management server 200 analyzes each area data 140 and acquires form data 282 (step S404). Specifically, the stroke data 142 of each area data 140 acquired in the previous stage is converted from image data to text data using a known technique. This text data is used as the data value 281 of the form data 282. The data ID 281 of the form data 282 uses the data ID 261 of the form definition data 260 used for area extraction.

  The form management server 200 checks the form data 282 using the form check data 270 (step S405). Specifically, first, a line in which the data ID 271 of the form check data 270 matches the data ID 281 of the form data 282 is extracted. Here, the data value 282 is checked in two stages. First, the essential item 272 is checked. If the required item 272 of the form check data 270 is “arbitrary”, nothing is checked. On the other hand, if it is “essential”, it is checked whether there is any data in the data value 282. Next, check the format. If there is no check content in the check item 273, nothing is checked. On the other hand, if there is any check content, it is checked whether the data value 282 satisfies the check content. For example, the contents of this check may be such that only numbers or specific symbols are not permitted. Moreover, a regular expression etc. can be considered as a description method of the check content.

  If it is determined in step S405 that the check is caught, the form management server 200 transmits a form data check error to the digital pen 100 (step S406).

  The digital pen 100 receives a form data check error from the form management server 200 (step S407), and notifies the form data check error (step S408). Specifically, the error message ERR03 or ERR04 shown in FIG. 23 is selected, and a message “Mandatory item is not entered” or “The entered item is invalid” is notified by voice. For example, the case where the voice notification is made may be that the name of an essential item is not entered, or that an address is entered incorrectly in an item of a telephone number that cannot be used except numbers and hyphens.

  Conventionally, in such a case, the user could not check when filling in. It was time-consuming to register because the application form filled out by the user was sent and the error was not known until the checker checked. As described above, by performing the check dynamically, it is possible to save the trouble of filling in at the time of the user and the trouble of checking by the person in charge of the check. In addition, the time required for re-entry and correction entry can be reduced, and the time until registration can be shortened.

If it is determined in step S405 that there is no problem with the check, the form management server 200 registers the form data 282 in the form data DB 208 (step S409). At this time, the form data ID 280 is automatically numbered and assigned a unique value. The form ID 281 uses the form ID received from the digital pen 100 in step S401. By this processing, the contents entered on the paper by the user are registered as data and can be reused.
The form management server 200 transmits a completion notification to the digital pen 100 (step S410).

  The digital pen 100 receives a completion notification from the form management server 200 (step S411), and notifies the user of the completion (step S412). Specifically, the message MSG01 in the message shown in FIG. 24 is selected, and the message “Data registration is completed” is notified by voice.

  The digital pen 100 initializes various data of the digital pen data 110 (step S413). Specifically, the form definition data 114, form ID 113, and writing data 120 are initialized.

The digital pen 100 is provided with a character recognition unit, and when the digital pen 100 receives the form definition data 260, the form check data 270 is also received, so that the processing from step S403 to step S406 is performed digitally. You may make it process with the pen 100. FIG.
Next, a preferred embodiment of the writing system 2 according to the present invention will be described in detail.

  In the writing system 1, communication between the digital pen 100 and the form management server 200 is performed by the user writing in the start area and the end area. The voice notification for the specific area is performed according to the form definition data 260 received from the form management server 200.

  In the writing system 2, when the user holds the digital pen 100 over the multifunction device 400, the digital pen 100 communicates with the form management server via the multifunction device 400. The voice notification for the specific area is performed according to the form definition data 260 received from the form management server 200.

  As described above, the writing system 2 provides voice notification for a specific area, as with the writing system 1. However, unlike the writing system 1, the writing system 2 is more convenient by cooperating with the MFP 400. It provides a high system. Specifically, there are the following advantages.

  Since an application can be printed by selecting a form on the start screen of the multifunction device 400 and holding the digital pen 100 over the multifunction device 400, it is not necessary to prepare an application in advance.

  Further, by selecting a form on the start screen of the multifunction machine 400 and holding the digital pen 100 over the multifunction machine 400, the form definition data 260 is received from the form management server 200 via the multifunction machine 400. It is not necessary to write or write in the start area, so it is easy for the user to understand.

  In addition, by holding the digital pen 100 over the multifunction device 400 on the end screen of the multifunction device 400, data can be sent to the form management server 200 via the multifunction device 400. At this time, by performing printing with the multi-function device 400, it is possible to print a copy at the same time as data transmission, and to provide a more convenient system.

Furthermore, since it is not necessary to print the start area and the end area on the form, the degree of freedom of the form layout is increased. Furthermore, since there is no need for a start area or an end area, it is not necessary to provide the form common data 130 in the digital pen data 110. Therefore, more memory 1001 of the digital pen 100 can be used, so that more writing data 120 can be stored. Complex form definition data 260 can be stored.
Hereinafter, Embodiment 2 will be described with reference to FIGS.

Note that FIG. 1 of the writing system 1 is replaced with FIG. FIG. 7 of the writing system 1 is replaced with FIG. FIG. 8 of the writing system 1 is replaced with FIG. 9 of the writing system 1 is replaced with FIG. FIG. 10 of the writing system 1 is replaced with FIG. FIG. 12 of the writing system 1 is replaced with FIG. FIG. 13 of the writing system 1 is replaced with FIG. FIG. 17 of the writing system 1 is replaced with FIG. FIG. 25 of the writing system 1 can be realized by replacing FIG.
Regarding the other drawings, the writing system 1 and the writing system 2 are the same, and the description thereof is omitted.
Next, the configuration of the writing system 2 will be described with reference to FIG.
FIG. 26 is a diagram showing an example of the configuration of the writing system 2 according to the present invention.

  In FIG. 1 of the writing system 1, the communication relay server 300 exists, but in FIG. 26 of the writing system 2, the MFP 400 exists instead of the communication relay server 300. The other components are the same in the writing system 1 and the writing system 2, and the description thereof is omitted.

  As shown in FIG. 26, for example, one or a plurality of digital pens 100 (for example, one for each user) and one or a plurality of multifunction devices 400 (for example, one for each floor) are connected by wireless communication. Further, the multifunction peripheral 400, one or a plurality of form management servers 200 (for example, installed at each base) are connected by a LAN (Local Area Network) 900.

The multifunction machine 400 is an image forming apparatus having functions such as a printer, a scanner, a copy, and a facsimile. Further, it is possible to restrict user use of the printer, scanner, copy, and facsimile functions according to the use authority corresponding to the card ID read by the card reader 3040.
Next, the multifunction peripheral 400 will be described with reference to FIG.
FIG. 27 is a diagram illustrating a hardware configuration of the multifunction machine 400.

  As shown in FIG. 27, the multi-function device 400 is configured to have hardware configurations of a controller unit 3020, an operation unit 3030, a card reader 3040, a printer 3050, and a scanner 3060.

  The controller unit 3020 includes a CPU 3001, a RAM 3002, a ROM 3003, a hard disk drive (HDD) 3004, a network interface (Network I / F) 3005, a modem (MODEM) 3006, and an operation unit interface (operation unit I / F). F) 3007, image bus interface (IMAGE BUS I / F) 3008, external interface (external I / F) 3009, system bus 3010, raster image processor (RIP) 3011, printer interface (printer I / F) ) 3012, a scanner interface (scanner I / F) 3013, an image processing unit 3014, an image bus 3015, and a wireless communication I / F 3016. .

The controller unit 3020 is connected to a scanner 3060 that functions as an image input device and a printer 3050 that functions as an image output device, while the network 110 and, for example, a PSTN (Public Switched Telephone Network) or ISDN (Integrated Services Digital Network). By connecting to a public network (WAN), image data and device information are input and output.
The CPU 3001 is a processor that comprehensively controls each device connected to the system bus 3010 and the image bus 3015.

  A RAM 3002 is a work memory for the CPU 3001 to operate, and also has functions of a program memory for recording a program and an image memory for temporarily recording image data. For example, the card ID read by the card reader 3040 is stored.

  The ROM 3003 stores a system boot program and various control programs. The HDD 3004 stores various programs for controlling the system, image data, and the like. Note that the ROM 3003 or the HDD 3004 stores form information 406 shown in FIG. The HDD 3004 is a medium for permanently storing information, and the form is not limited to the HDD. For example, a medium such as SSD (Solid State Drive) may be used.

  A network I / F 3005 is connected to the LAN 900 and performs data input / output. The MODEM 3006 is connected to a public line network and inputs / outputs data such as transmission / reception by FAX.

  An operation unit I / F 3007 is an interface in the operation unit 3030 that is a user interface (UI), and outputs image data to be displayed on the operation unit 3030 to the operation unit 3030. The operation unit I / F 3007 plays a role of transmitting information (for example, user information) input from the operation unit 3030 by the user of this system to the CPU 3001. Note that the operation unit 3030 includes a display unit having a touch panel corresponding to a keyboard, and performs various instructions by a user pressing (touching with a finger or the like) a button on the keyboard displayed on the display unit. Can do.

  The IMAGE BUS I / F 3008 is a bus bridge that connects the system bus 3010 and an image bus 3015 that transfers image data at high speed and converts the data structure.

  The external I / F 3009 is an interface that accepts external inputs such as USB, IEEE 1394, printer port, and RS-232C. For example, the external I / F 3009 is connected to a card reader 3040 for reading IC card information necessary for IC card authentication. The CPU 3001 can control reading of information from the IC card by the card reader 3040 via the external I / F 3009, and can acquire information read from the IC card.

The wireless communication I / F 3016 can connect to and communicate with an external device by performing wireless communication using light or radio waves. The wireless communication I / F controller 2012 can perform, for example, IrDA (Infrared Data Association) communication, Bluetooth (registered trademark) communication, communication using the IEEE 802.11 standard, and the like.
The devices shown in 3001 to 3009 and 3016 are arranged on the system bus 3010 and can communicate with each other.
For example, the RIP 3011 expands vector data such as PDL code and page data in XML format in XPS data into a bitmap image.
A printer I / F 3012 connects the printer 3050 and the controller unit 3020, and performs synchronous / asynchronous conversion of image data.
A scanner I / F 3013 connects the scanner 3060 and the controller unit 3020, and performs synchronous / asynchronous conversion of image data.

  An image processing unit 3014 performs correction processing, processing processing, and editing processing on input image data, and performs printer correction processing, resolution conversion processing, and the like on print output image data. In addition to these processes, the image processing unit 3014 performs rotation processing of image data, compression / decompression processing such as JPEG for multi-valued image data, JBIG, MMR, MH, etc. for binary image data. I do.

  The devices shown in the above 3008, 3011-3014 are arranged on the image bus 3015 and can communicate with each other. The image bus 3015 is constituted by, for example, a PCI (Peripheral Component Interconnect) bus or IEEE1394.

  Specifically, the operation unit 3030 has an LCD (Liquid Crystal Display) display unit, and a touch panel sheet is pasted on the LCD display unit to display the operation screen of the present system and the displayed operation screen. When a key (button) is pressed, the position information is transmitted to the CPU 3001 via the operation unit I / F 3007. The operation unit 3030 includes keyboard functions such as a start key, a stop key, an ID key, and a reset key as various operation keys.

  Here, the start key of the operation unit 3030 is operated, for example, when starting a document image reading operation. At the center of the start key, for example, there are two colors of LEDs (Light Emitting Diode) of green and red, and whether or not the start key can be used is indicated by light emission of each color. Further, the stop key of the operation unit 3030 is operated, for example, when stopping an operation in operation. The ID key of the operation unit 3030 is operated when, for example, the user ID of the user (user) is input. The reset key of the operation unit 3030 is operated, for example, when initializing settings by the operation unit 3030.

  A card reader 3040 reads user identification information stored in an IC card corresponding to an authentication card (for example, FeliCa (registered trademark) of Sony (registered trademark)) under the control of the CPU 3001. is there. The user identification information read by the card reader 3040 is notified to the CPU 3001 via the external I / F 3009.

  The printer 3050 converts, for example, raster image data as an image on paper. The conversion method includes an electrophotographic method using a photosensitive drum and a photosensitive belt, and an ink jet method in which an image is directly printed on paper by ejecting ink from a minute nozzle array. It doesn't matter. Activation of the printing operation of the printer 3050 is started by an instruction from the CPU 3001. The printer 3050 includes a plurality of paper feed stages so that different paper sizes or different paper orientations can be selected, and a paper cassette corresponding to each paper feed stage is provided.

  The scanner 3060 illuminates an image on paper as a document, and scans the document using a CCD (Charge Coupled Device) line sensor, thereby converting the image of the document into an electrical signal as raster image data. The original paper is set on the tray of the original feeder, and when the user of the multi-function peripheral 400 issues a reading start instruction from the operation unit 3030, the CPU 3001 gives an instruction to the scanner 3060, and the feeder feeds the original paper one by one. Read the original image.

With the configuration described above, the multi-function device 400 can transmit the image data read from the scanner 3060 to the LAN 900 and print out the print data received from the LAN 900 with the printer 3050. Further, the multi-function device 400 can send the image data read from the scanner 3060 by FAX from the MODEM 3006 to the public line network, and print out the image data received by FAX from the public line network by the printer 3050.
Next, functions of the writing system 2 and data to be used will be described with reference to FIGS. 28, 33, 34, 35, 36, and 37. FIG.

FIG. 28 is a block diagram showing a functional configuration of the writing system 2 according to the present invention, FIG. 33 is an image diagram showing an example of a screen displayed on the operation unit 3030 of the multifunction machine 400, and FIG. 34 is a digital pen of the writing system 2. FIG. 35 is a diagram illustrating an example of the data 110, FIG. 35 is a diagram illustrating an example of the form definition DB 207 of the writing system 2, FIG. 36 is a diagram illustrating an example of the form information 406 of the writing system 2, and FIG. It is a figure which shows an example of the form output on the paper.
First, a function for executing processing of the digital pen 100 will be described.

  The digital pen 100 includes a writing storage unit 101, a wireless communication unit 102, a voice notification unit 103, an LED notification unit 104, a button control unit 105, a data management unit 106, a region determination unit 107, digital pen data 110, and the like.

  Note that the writing storage unit 101, the wireless communication unit 102, the voice notification unit 103, the LED notification unit 104, the button control unit 105, the data management unit 106, and the area determination unit 107 are the same as the writing system 1, and thus description thereof is omitted. .

Unlike the writing system 1, the digital pen data 110 does not have the form common data 130. This is because the start process and the end process are performed via the multi-function peripheral 400, and therefore it is not necessary to have a start area and an end area in the form.
Next, a function for executing the processing of the form management server 200 will be described.

  The form management server 200 includes a wired communication unit 201, a character recognition unit 202, a data check unit 203, a form definition management unit 204, a form data management unit 205, an area calculation unit 206, a form definition DB 207, a form data DB 208, and a printer driver unit 209. Etc.

  The wired communication unit 201, the character recognition unit 202, the data check unit 203, the form definition management unit 204, the form data management unit 205, the area calculation unit 206, and the form data DB 208 are the same as those in the writing system 1, so that the description is omitted. Omitted.

  Unlike the writing system 1, the form definition DB 207 has a form layout 295. The form layout 295 is data for outputting a form layout on paper. In other words, it is electronic data of the design 12. For example, a layout like the form example shown in FIG. 37 is held as vector data or text data.

The printer driver unit 209 converts image data generated by the application into page description language (PDL) data that can be printed by the multi-function peripheral 400. For example, the form layout 295 is converted into PDL data.
Next, functions for executing processing of the multifunction machine 400 will be described.
The MFP 400 includes a wireless communication unit 401, a wired communication unit 402, a screen control unit 403, a form information management unit 404, a printing unit 405, a form information 406, and the like.

  The wireless communication unit 401 has a function of communicating with an external device using light or radio waves. Specifically, communication is performed with an external device using a wireless technology such as IrDA (Infrared Data Association) or Bluetooth (registered trademark). Thereby, it is possible to communicate with the digital pen 100 having the same wireless communication function.

  The wired communication unit 402 connects and communicates with an external device via a network such as a LAN 900, and controls communication according to a communication protocol such as TCP / IP or UDP. As a result, the multi-function device 400 can communicate with the form management server 200 or the like similarly connected to the LAN 900.

  The screen control unit 403 is for displaying a screen for the user to operate the multifunction device 400 on the operation unit 3030 of the multifunction device 400. As shown in FIG. 33, screens such as an initial screen 4000, a start screen 4100, an end screen 4200, and a dialog 4300 are displayed.

  The initial screen 4000 includes a copy button 4001, a scan button 4002, a print button 4003, a digital pen button 4004, a start button 4005, an end button 4006, and the like. A copy button 4001, a scan button 4002, a print button 4003, and a digital pen button 4004 are menu buttons for each function, and are displayed in common on all screens. When these buttons are touched, the screen changes to the respective function screen. Since the initial screen 4000 is an initial screen for the digital pen function, the initial screen 4000 is the first screen displayed when the copy, scan, and print screens are changed to the digital pen screen. When a start button 4005 is touched, the screen transitions to a start screen 4100, and when the end button 4006 is touched, the screen transitions to an end screen 4200.

  The start screen 4100 includes a return button 4101, a form button 4102, and the like. When the return button 4101 is touched, the screen transitions to the initial screen 4000. One or more form buttons 4102 are displayed. Form buttons 4102 are displayed for the number of forms stored in the form information 406. If the form button 4102 is touched while the digital pen 100 is held over the multifunction device 400, the multifunction device 400 performs a start process. When the form button 4102 is touched while the digital pen 100 is not held up, a dialog 4300 is displayed and a message “Please select the form again by holding the digital pen up” is displayed.

  The end screen 4200 includes a return button 4201 and the like. When the return button 4201 is touched, the screen transitions to the initial screen 4000. If the digital pen 100 is held over the multifunction device 400 while the end screen 4200 is displayed, the multifunction device 400 performs a termination process.

  The dialog 4300 includes a message 4301, an OK button 4302, and the like. The dialog 4300 is not formed as a single screen, but is displayed in a pop-up on the initial screen 4000, the start screen 4100, and the end screen 4200, and is used to prompt the user to give some attention. A message 4301 displays a message to be transmitted to the user. Further, the dialog 4300 can be closed by touching an OK button 4302. In the example of FIG. 33, the message “Mandatory items have not been entered.” Is displayed, but this is not a limitation. As mentioned above, “Please hold the digital pen and select the form again. May be displayed.

  The form information management unit 404 manages the form information 406 stored in the HDD 3004. The HDD 3004 can be accessed to read / write or update data.

  The printing unit 405 is for controlling the printer 3050 of the multifunction machine 400. The designated print data is analyzed and converted into a bitmap image, and printing is performed on a medium such as paper using a known printing technique.

The form information 406 manages one or a plurality of sets of form ID 410 and form name 411. The form ID 410 is an ID for specifying a form managed by the form definition DB 207 of the form management server 200. The form name 411 is a name to be displayed on the screen of the multifunction machine 400. Specifically, it is used as the name of the form button 4102 on the start screen 4100. It is assumed that the form information 406 is set in the multifunction device 400 by the administrator in advance.
As shown in FIG. 37, a paper form 500 is a diagram showing an example of a form output on paper in the writing system 2.

The paper form 500 includes an information entry area 503 and the like. Unlike the writing system 1, the ID area 501, the start area 502, and the end area 504 are not provided. This is because the start process and the end process are performed via the multifunction machine 400. Therefore, it is not necessary to have a form common area such as a start area and an end area in the form. Therefore, there is an advantage that the flexibility of the form layout is increased.
Next, an outline of processing of the writing system 2 according to the present invention will be described with reference to FIG.
FIG. 29 is a process outline diagram of the writing system 2.

First, when a user selects a form on the start screen 4100 of the multifunction machine 400 (1-1), the multifunction machine 400 transmits the form ID of the selected form to the form management server 200 (1-2). .
The form management server 200 searches the form definition DB 207 for form definition data 260 that matches the form ID (1-3), and transmits the form definition data 260 to the multifunction machine 400 (1-4).
The multi-function device 400 transmits the form definition data 260 to the digital pen 100 that has been enabled for wireless communication with the multi-function device 400 by the user (1-5).
The multi-function peripheral 400 acquires the form layout 295 from the form management server 200 and prints it (1-6).

  When the user fills in the form, the digital pen 100 reads the dot pattern 13 using the camera 1009 and determines the coordinates written using the Anoto technology. The digital pen 100 uses the form definition data 260 received from the form management server 200 to determine the area that the user tried to fill in, and plays a voice message corresponding to the area (2-1).

When the digital pen 100 is held over while the end screen 4200 of the multifunction device 400 is displayed, the digital pen 100 transmits the stored writing data 120 to the multifunction device 400 (3-1). This process is performed when communication is possible by holding the digital pen 100, but as a trigger, when the button 1002 of the digital pen 100 is pressed, the digital pen 100 and the multifunction device 400 start communication. Written data 120 may be transmitted.
The multi-function device 400 receives the writing data 120 and transmits it to the form management server 200 (3-2).

The form management server 200 receives the writing data 120, converts the image data into text data (3-3), and checks whether the text data meets the check conditions (3-4). If not matched, an error is notified to the multifunction device 400, and the multifunction device 400 displays a dialog 4300 to notify the error. As examples that do not fit, there are cases where mandatory items are not filled in or hiragana is filled in only numeric items. If the check item matches, the form management server 200 registers the form data 282 in the form data DB 208 (3-5).
The multifunction machine 400 combines the form layout acquired from the form management server 200 and the form data and prints it as a copy (3-6).
Next, detailed processing of the writing system 2 according to the present invention will be described with reference to FIGS.

  30 is a flowchart showing an example of the area acquisition process of the writing system 2, FIG. 31 is a flowchart showing an example of the start process of the writing system 2, and FIG. 32 is a flowchart showing an example of the end process of the writing system 1. .

In addition, about notification processing, since the writing system 1 and the writing system 2 are the same processing procedures, description is abbreviate | omitted. In the writing system 1, the start processing is performed after the region acquisition processing is performed as the processing order. However, in the writing system 2, the area acquisition process is performed after the start process.
First, the area acquisition process of the writing system 2 will be described with reference to FIG.
In FIG. 30, the digital pen 100 determines the writing state of the user and stores writing data, or performs processing according to the written area.

The difference from the writing system 1 is that step S110, step S111, and step S112 do not exist. This is because the start process and the end process are performed via the multi-function peripheral 400, so that the form does not need to have a start area or an end area.
In addition, about another step, since it is a process equivalent to the writing system 1, description is abbreviate | omitted.
Next, the start process of the writing system 2 will be described with reference to FIG.

In FIG. 31, the multifunction device 400 communicates with the form management server 200 and acquires the form definition data 260 that matches the form selected on the screen of the multifunction device 400. The multifunction device 400 transmits the acquired form definition data 260 to the digital pen 100 and simultaneously prints the form layout. It is assumed that the form button 4102 is pressed on the start screen 4100 of the MFP 400 at the start of the start process.
Note that steps S206 to S208 and steps S211 to S215 are the same as the writing system 1, and the description thereof is omitted.

  As shown in FIG. 31, the multi-function device 400 determines whether or not communication with the digital pen 100 is started (step S250). Specifically, when the multifunction device 400 and the digital pen 100 establish communication with each other using wireless communication means such as Bluetooth (registered trademark) and enter a state where they recognize each other, it is determined that communication has started. .

If it is determined in step S250 that communication has started, the multi-function device 400 acquires the selected form ID (step S251). Note that the form name 411 of the form information 406 is assigned to the form button 4102. Therefore, the multi-function device 400 extracts the button name from the selected form button 4102, searches the form information 406 for a matching form name 411, and acquires the form ID 410 corresponding thereto.
The multi-function device 400 transmits the form ID to the form management server 200 (step S252).
The form management server 200 receives the form ID from the multifunction machine 400 (step S253).

  The multi-function device 400 accepts a form definition data acquisition error from the form management server 200 (step S254) and notifies the error (step S255). Specifically, a dialog 4300 is displayed on the start screen 4100. At this time, ERR02 is selected from the error message shown in FIG. 23 in the message 4301 of the dialog 4300, and “Form definition data not found.” Is displayed.

  This error rarely occurs during normal operation. This error occurs when there is a mismatch between the form information 406 registered in advance by the administrator and the form definition DB 207 of the form management server 200. The present embodiment is configured such that the system operates safely even when such management deficiencies exist.

The multi-function device 400 accepts the form definition data 260 from the form management server 200 (step S256), and transmits the form definition data 260 to the digital pen 100 that is in a wirelessly communicable state (step S257).
The digital pen 100 notifies the multifunction device 400 that the reception of the form definition data 260 has been completed (step S258).
The multi-function device 400 accepts a reception completion notification from the digital pen 100 (step S259), and issues a print request to the form management server 200 (step S260).
At this time, the form ID used in step S252 is also transmitted.

  The form management server 200 receives a print request together with the form ID from the multi-function peripheral 400 (step S261), and acquires a form layout (step S262). Specifically, the form management server 200 searches the form layout 295 from the form definition DB 207 using the form ID as a key.

  The form management server 200 instructs the multifunction peripheral 400 to print the form layout 295 (step S263). Specifically, the form management server 200 uses the printer driver unit 209 to convert the form layout 295 to PDL, and transmits it to the multi-function peripheral 400 using a printing protocol such as RAW or LPR (Line Printer Daemon). To do.

  The multi-function peripheral 400 receives a print instruction from the form management server 200 and prints the form layout 295 on a medium such as paper using a known technique (step S264). At this time, the dot pattern 13 is also printed at the same time. Alternatively, a sheet on which the dot pattern 13 is printed in advance may be prepared, and the form layout 295 may be printed on the sheet.

In this way, a desired form sheet can be printed simply by holding the digital pen 100 over the multifunction device 400. Therefore, it is not necessary to prepare paper in advance, so that the management cost can be reduced.
Next, the termination process of the writing system 2 will be described with reference to FIG.

In FIG. 32, the multifunction device 400 accepts the writing data 120 from the digital pen 100 and transmits it to the form management server 200. The form management server 200 analyzes the writing data 120 and registers it in the form data DB 208. When registration is completed, a copy of the form is printed from the multifunction device 400. It is assumed that the end screen 4200 of the multifunction device 400 is at the start of the end processing.
Note that steps S401 to S406 and steps S409 to S410 are the same as the writing system 1, and the description thereof is omitted.

  As shown in FIG. 32, the multi-function device 400 determines whether communication with the digital pen 100 is started (step S450). Specifically, when the multifunction device 400 and the digital pen 100 establish communication with each other using wireless communication means such as Bluetooth (registered trademark) and enter a state where they recognize each other, it is determined that communication has started. .

  If it is determined in step S450 that communication has started, the multi-function device 400 requests the digital pen 100 for a form ID and writing data 120 (step S451).

  The digital pen 100 receives a request for a form ID and writing data 120 from the multifunction device 400 (step S452), and transmits the form ID 113 and the writing data 120 stored in the digital pen data 110 to the multifunction device 400 (step S453). .

  The multi-function device 400 receives the form ID and the writing data 120 from the digital pen 100 (step S454), and transmits the form ID and the writing data 120 to the form management server 200 as they are (step S455).

The multi-function device 400 accepts an area data check error from the form management server 200 (step S456) and notifies the error (step S457). Specifically, a dialog 4300 is displayed on the end screen 4200. At this time, ERR03 to ERR04 are selected from the error message shown in FIG. 23 in the message 4301 of the dialog 4300, and “Essential items are not entered” to “The entered items are invalid” are displayed.
The multi-function device 400 receives a completion notification from the form management server 200 (step S458), and makes an end request to the digital pen 100 (step S459).

The digital pen 100 receives an end request from the multi-function device 400 (step S460), and initializes various data of the digital pen data 110 (step S461). Specifically, the form definition data 114, form ID 113, and writing data 120 are initialized.
The digital pen 100 notifies the multifunction device 400 of completion (step S462).

The multi-function device 400 can receive a completion notification from the digital pen 100 (step S463), and can issue a print request for a copy document to the form management server 200 (step S464). At this time, the form ID used in step S454 is also transmitted. It should be noted that a print request for a copy document is made when the user gives an instruction via the operation panel of the multi-function device 400.
The form management server 200 accepts a print request issue together with the form ID from the multi-function peripheral 400 (step S465).

The form management server 200 acquires form data 282 that matches the form ID from the form data DB 208. This form data 282 is entry contents entered by the user in the entry field 503 of the user registration form (FIG. 37) with the digital pen 100, and may be bitmap data or OCR processed text data. Also good. At the same time, the form management server 200 acquires a form layout 295 that matches the form ID from the form definition DB 207. The two data are combined using a known technique (step S466), and a printing instruction is given to the multi-function device 400 (step S467).
The multi-function peripheral 400 receives a print instruction from the form management server 200 and prints data on a medium such as paper using a known technique (step S468).

As a result, the user can automatically obtain a copy at the end of writing the application form. Since there is no need to scan the written paper as in the past, it is possible to save the user's trouble. In recent years, there are simple machines that do not have a scanner function even in multifunction machines. Many companies use such inexpensive, simple machines to reduce office costs or to effectively use office space. According to the present embodiment, a copy can be obtained even with such a simple machine.
It should be noted that the configuration and contents of the various data described above are not limited to this, and it goes without saying that the various data and configurations are configured according to the application and purpose.

Next, a preferred embodiment of the writing system 3 according to the present invention will be described in detail.

  As described above, in the writing system 1, communication between the digital pen 100 and the form management server 200 is performed by the user writing in the start area and the end area. The voice notification for the specific area is performed according to the form definition data 260 received from the form management server 200.

In the writing system 2, when the user holds the digital pen 100 over the multifunction device 400, the digital pen 100 and the form management server 200 communicate with each other via the multifunction device 400. When the multifunction device 400 registers the written data in the form management server 200, the multifunction device 400 prints a copy.
In a copy printed matter printed by the writing system 2, the content input by the user with the digital pen is printed after being overlayed with the form.

  In the writing system 3, when data written by the user using the digital pen 100 is registered in the form management server 200, a copy is printed. At this time, the writing system 3 explains a mechanism in which the multi-function peripheral 400 can distinguish between application documents and copy documents (print copies) by not outputting copy prohibition items in cooperation with the form definition data during copy printing. To do. A mechanism for displaying a voucher scan screen in accordance with the written content will also be described.

As described above, the writing system 3 provides a highly convenient system in which a copy can be printed after writing data registration by cooperating with the MFP 400 in the same manner as the writing system 2. In contrast to this, it is possible to provide a more convenient system by cooperating with the form definition data at the time of copy printing, or by cooperating with the multifunction peripheral 400 after the copy printing. Specifically, there are the following advantages.
Since the items defined as prohibition of printing in advance are not printed during printing, it is possible to provide a system with high security and privacy.

  For example, in a user registration application, there is a case in which a password is written on an application form. At this time, the original person of the application form is held by the entry person, and a copy of the application form is held by the person who accepted the application.

  That is, according to the embodiment of the writing system 3, by defining the password item as print prohibition in advance, the password item can be prevented from being printed during copy printing.

In addition, if a certificate is required in addition to the written data, the screen will be shifted to the scan screen after copy printing, and the scanned data will be managed in association with the form data. -Since a series of flow of certificate data storage is automated, it becomes a user-friendly system.
Further, in connection with the above, it is possible to prevent mistakes due to human judgment by automatically determining whether a certificate is necessary.
Further, in connection with the above, by automatically storing the certificate data, it is possible to prevent forgetting to store or wrong storage location.

  For example, in an application for product purchase, if the applicant is a minor, the parental consent form may be required. At this time, the person who accepted the application or who applied for Judgment to determine whether parental consent is required. At this time, if it is determined that the consent form of the guardian is necessary, the person who accepted the application must digitize the guardian's consent form into the system and store it in association with the application data.

  Furthermore, according to the writing system 3, by defining in advance conditions that require parental consent whether or not the age written on the form is a minor, and by cooperating with the scanning function of the MFP, These series of processes can be automated.

In addition, as an example as mentioned above, a resident's card is required for a transfer from outside the ward when applying for a resident transfer, or a receipt is required when using a taxi for applying for transportation expenses. There are cases in which a boss's seal or signature is required for a certain amount or more when applying for equipment purchase. There are many cases where the necessity of scanning is determined according to the written contents.
The third embodiment will be described below with reference to FIGS.

Note that FIG. 28 of the writing system 2 is replaced with FIG. FIG. 29 of the writing system 2 is replaced with FIG. FIG. 32 of the writing system 2 is replaced with FIG. 40 and FIG. FIG. 35 of the writing system 2 is replaced with FIG. FIG. 18 of the writing systems 1 and 2 is replaced with FIG. FIG. 21 of the writing systems 1 and 2 can be realized by replacing FIG.
Regarding the other drawings, the writing system 2 and the writing system 3 are equivalent and will not be described again because they are repeated.
Next, functions of the writing system 3 and data to be used will be described with reference to FIGS. 38, 42, 43, 44, and 45. FIG.

38 is a block diagram showing a functional configuration of the writing system 3 according to the present invention, FIG. 42 is an image diagram showing an example of a screen displayed on the operation unit 3030 of the multifunction machine 400, and FIG. 43 is a writing system. FIG. 3 is a diagram illustrating an example of a form definition DB 207 of FIG. 44 is a diagram illustrating an example of the form definition data 260 of the writing system 3, and FIG. 45 is a diagram illustrating an example of the form data DB 208 of the writing system 3.
The functional configuration of the digital pen 100 in FIG. 38 is the same as that of the writing system 2 in FIG.
First, a function for executing the processing of the multifunction machine 400 will be described.

  The MFP 400 includes a wireless communication unit 401, a wired communication unit 402, a screen control unit 403, a form information management unit 404, a printing unit 405, and form information 406. Each functional configuration up to this point is the writing system 2 in FIG. It is the same. The difference is that a scan transmission unit 407 is provided.

  The scan transmission unit 407 provides a function of controlling the scanner 3060 of the multifunction peripheral 400 to digitize an image on paper as a document, convert it to an arbitrary image format, and transmit it to an arbitrary folder on an arbitrary server. . The file format includes, for example, JPEG (Joint Photographic Expert Group), TIFF (Taged Image File Format), PDF (Portable Document Format M), XPS (XML Paper SpecMlOX).

The file generated by scanning is also transmitted to an external device using a protocol such as SMB (Server Message Block), WebDAV (Web-based Distributed Authoring and Versioning), or FTP (File Transfer Protocol).
Here, FIG. 42 is a diagram illustrating an example of a scan screen 4400 displayed on the operation unit 3030 of the multi-function peripheral 400.

As shown in FIG. 42, the scan screen 4400 includes a scan button 4401 and the like. The scan screen 4400 is a screen that is displayed when a certificate needs to be scanned after copy printing. When this screen is displayed, the user sets the certificate written on the screen in the MFP 400 and scans it. A button 4401 is pressed.
Note that other functions constituting the multi-function device 400 are the same as those of the writing system 2, and thus the description thereof is omitted.
Next, a function for executing the processing of the form management server 200 will be described.

  The form management server 200 includes a wired communication unit 201, a character recognition unit 202, a data check unit 203, a form definition management unit 204, a form data management unit 205, an area calculation unit 206, a form definition DB 207, a form data DB 208, and a printer driver unit 209. A form condition determining unit 210 and the like.

  The form condition determination unit 210 determines the scan condition 296 of the form definition DB 207, determines whether or not the certificate needs to be scanned after copy printing, and controls to scan after copy printing if necessary. Further, the copy prohibition flag 266 of the form definition data 260 is determined, and if it is a copy prohibition item, control is performed so that the corresponding item is not output to the copy print data.

The form definition DB 207 includes a form ID 250, form definition data 260, form check data 270, form layout 295, scan conditions 296, and the like. The scan condition 296 is an item for determining whether or not the certificate needs to be scanned after the slip of the form is printed. For example, when determining whether a certificate is necessary based on written information, a condition such as “age item is 20 or more” is set. Actually, when the form definition data ID 261 of the item of age is “999”, it is expressed by a mathematical expression such as “999> 20”. For example, when determining whether or not a certificate is necessary according to the type of form regardless of written information, conditions such as “*” and “−” are set.
The other items constituting the form definition DB 207 are the same as the writing system 2 and will not be described.

The form definition data 260 includes a data ID 261, a region attribute 132, a region 263, a notification state 264, notification data 265, a record prohibition flag 266, and the like. The copy prohibition flag 266 is an item for determining whether or not to output this form data item when performing copy printing. Specifically, “true” or “false” is set, and if “true”, copy printing is prohibited, and if “false”, copy printing is possible. For example, for a highly confidential item such as a password, a case where this value is set to “true” can be considered.
The other items constituting the form definition data 260 are the same as the writing system 2 and will not be described.

The form data DB 208 is composed of a form data ID 280, a form ID 281, form data 282, scan data 283, and the like. The scan data 283 is a place to store scan data when a certificate is scanned after copy printing. By storing the scan data here, it becomes possible to manage it in association with the form data for which a certificate is required.
The other items constituting the form data DB 208 are the same as the writing system 2 and will not be described.
Note that other functions that constitute the form management server 200 are the same as the writing system 2, and thus description thereof is omitted.
Next, an outline of processing of the writing system 3 according to the present invention will be described with reference to FIG.
FIG. 39 is a process outline diagram of the writing system 3. In addition, about the process of 1-1 to 3-5, since it is equivalent to the writing system 2, description is abbreviate | omitted.

The form management server 200 determines whether the registered form data 208 has no copy prohibition items (3-6). As a result of the determination, if there is a prohibited item, the form data 282 (written data) of the corresponding item is made empty or hidden (* or ●). The form management server 200 determines the scan condition of the form definition 207 (3-7). If the registered form data 208 satisfies the scan condition, the form management server 200 transmits the form information to the multi-function peripheral 400 and print scan. Issue instructions.
Based on the instruction from the form management server 200, the multifunction machine 400 outputs the form information in which the prohibited items are hidden (3-8).

Further, the multifunction device 400 displays a screen for allowing the user to scan a certificate based on an instruction from the form management server 200, accepts a certificate scan from the user (3-9), and stores the scanned data in the form data 208. (3-10).
Next, detailed processing of the writing system 3 according to the present invention will be described with reference to FIGS.
FIG. 40 is a flowchart illustrating an example of an end process of the writing system 3, and FIG. 41 is a flowchart illustrating an example of an end process of the writing system 3.
The notification process, the area acquisition process, and the start process are omitted because the writing system 2 and the writing system 3 have the same processing procedure.
First, the termination process of the writing system 3 will be described with reference to FIG.

  In FIG. 40, the multi-function device 400 receives the writing data 120 from the digital pen 100 and transmits it to the form management server 200. The form management server 200 analyzes the handwritten data 120, converts it into form data 282, and registers it in the form data DB 208. When the registration is completed, a request for copy printing of the form is issued from the multifunction device 400 to the form management server 200.

The difference from the writing system 2 is that the processing of FIG. 41 is added in place of steps S466, S467, and S468. In the writing system 3, details of processing for performing control during copy printing are shown in FIG.
The other steps are the same as the writing system 2 and will not be described.
Next, the termination process of the writing system 3 will be described with reference to FIG.

  In FIG. 41, the form management server 200 determines whether or not a scan is necessary, and issues a scan instruction to the multifunction peripheral 100. Further, the form management server 200 determines whether there is a prohibited item, and if there is a prohibited item, the form management server 200 does not output the item.

  As shown in FIG. 41, the form management server 200 includes an item in which the record prohibition flag is set to true (value is “1”) in one or a plurality of form definition data 260 held by the form definition. Whether or not (step S500).

As a result of the determination in step S500, if there is an item for which the prohibition prohibition flag is set to true (value is “1”), the form management server 200 sets the data ID 282 of the form definition data 260 with the prohibition prohibition flag set to true. The data value of the matching form data 282 is temporarily replaced with empty characters, hidden characters (*, ●), etc. (step S501).
As a result, items with high confidentiality such as passwords can be prevented from being output during printing, so a system with high security can be realized.

  On the other hand, as a result of the determination in step S500, for the item for which the refusal prohibition flag is set to False (value is “0”), the replacement process in step S501 is skipped and the process proceeds to step S502. It should be noted that the processing of steps S500 to S502 is to be loop-processed for all items (all areas in which form data is entered) for one form.

  The form management server 200 overlays the two data, the form data 282 and the form layout 295, using a known technique (step S502). When the overlay is completed, the data value of the form data 282 replaced in the previous stage is returned to the original value. This processing is realized by converting the data value of the form data 282 into a predetermined data value and performing overlay processing. However, the present invention is not limited to this, and the data value of the form data 282 is not printed as it is. That's fine. In other words, it may be blank and not printed.

  The form management server 200 determines whether the form data 282 registered in the previous stage (step S409) satisfies the scan condition 296 of the form definition 207 (step S503).

If it is determined in step S503 that the scan condition 296 is not satisfied, the form management server 200 issues a print instruction to the multi-function peripheral 400 (step S504). Specifically, the print instruction is generated by combining the form data 282 and the form layout 295 by overlaying the two data of the form data 282 and the form layout 295 in step S502. A print instruction is received from the management server 200, and data is printed on a medium such as paper using a known technique (step S505).

  If the determination result in step S503 satisfies the scan condition 296, the form management server 200 issues a print scan instruction to the multifunction device 400 (step S506). Specifically, the print scan instruction is generated by combining print data generated by overlaying the form data 282 and the form layout 295 using a known technique in step S502, and the print data. Includes an instruction command and a scan ID for displaying a scan screen on the multi-function peripheral after printing.

  In this way, the form management server 200 determines whether scanning is necessary or unnecessary based on information written by the user, so that it is possible to prevent a user from making a mistake in determining whether a certificate is necessary. For example, when the age input by an operator with a digital pen is less than 20 years (scanning conditions), the operation of automatically scanning an ID with a multifunction device and registering it in a form management server is automatically realized. Can do.

  The multi-function device 400 receives a print scan instruction from the form management server 200 and prints print data included in the print scan instruction on a medium such as paper using a known technique (step S507).

  The multi-function device 400 displays the scan screen 4400 (FIG. 42) on the operation unit 3030 (step S508). When the user presses a scan button 4401 to accept a scan instruction, the multi-function peripheral 400 executes a scan process for the document (certificate) placed on the document table (step S509), and scans the document. The read data is transmitted to the form management server 200 together with the scan ID included in the print scan instruction (step S510).

  The form management server 200 accepts scan data transmission including the scan ID and the data (scan data) read from the multifunction peripheral 400 (step S511), and stores it in the scan data 283 of the form data 208 (step S512).

  As a result, written data and scanned data are automatically linked and stored without being conscious of the user who performed the scan, so forget to store the scan data or make a mistake in the storage location of the scan data Or mistakes. Also, the trouble of storing scan data can be eliminated.

  In the present embodiment, scanning is performed after preliminary printing, but processing may be performed in the order in which preliminary printing is performed after scanning. In this case, a copy of the certificate is also printed in the copy printing, which makes the system easier to use in cases where a copy of the certificate is required.

  Although one embodiment has been described above, the present invention can take an embodiment as, for example, a system, apparatus, method, program, or recording medium, and specifically includes a plurality of devices. The present invention may be applied to a system including a single device.

  Further, the program according to the present invention is a program that allows a computer to execute the processing methods of the flowcharts shown in FIGS. 9 to 12 and 30 to 32, and the storage medium of the present invention includes FIGS. 9 to 12 and FIGS. A program capable of being executed by the computer in the processing method of FIG. 32 is stored. The program in the present invention may be a program for each processing method of each device in FIGS. 9 to 12 and 30 to 32.

As described above, a recording medium that records a program that implements the functions of the above-described embodiments is supplied to a system or apparatus, and a computer (or CPU or MPU) of the system or apparatus stores the program stored in the recording medium. It goes without saying that the object of the present invention can also be achieved by executing the reading.

  In this case, the program itself read from the recording medium realizes the novel function of the present invention, and the recording medium storing the program constitutes the present invention.

  As a recording medium for supplying the program, for example, a flexible disk, hard disk, optical disk, magneto-optical disk, CD-ROM, CD-R, DVD-ROM, magnetic tape, nonvolatile memory card, ROM, EEPROM, silicon A disk, solid state drive, or the like can be used.

  Further, by executing the program read by the computer, not only the functions of the above-described embodiments are realized, but also an OS (operating system) operating on the computer based on an instruction of the program is actually It goes without saying that a case where the function of the above-described embodiment is realized by performing part or all of the processing and the processing is included.

  Furthermore, after the program read from the recording medium is written to the memory provided in the function expansion board inserted into the computer or the function expansion unit connected to the computer, the function expansion board is based on the instructions of the program code. It goes without saying that the case where the CPU or the like provided in the function expansion unit performs part or all of the actual processing and the functions of the above-described embodiments are realized by the processing.

  Further, the present invention may be applied to a system composed of a plurality of devices or an apparatus composed of a single device. Needless to say, the present invention can be applied to a case where the present invention is achieved by supplying a program to a system or apparatus. In this case, by reading a recording medium storing a program for achieving the present invention into the system or apparatus, the system or apparatus can enjoy the effects of the present invention.

Furthermore, by downloading and reading a program for achieving the present invention from a server, database, etc. on a network using a communication program, the system or apparatus can enjoy the effects of the present invention.
In addition, all the structures which combined each embodiment mentioned above and its modification are also included in this invention.

100 Digital pen 200 Form management server 400 MFP

Claims (9)

The information reading unit that reads the dot pattern from the paper on which the predetermined dot pattern is formed reads the predetermined dot pattern printed on the paper, and the position information of the paper is transmitted by the communication unit based on the read dot pattern. A form server device for receiving writing data including the position information transmitted from a digital pen,
A form definition storage means for storing form definition data defining an area that is prohibited from printing on a copy of a plurality of areas included in the form;
Analyzing the writing data including the positional information transmitted using the digital pen, and converting it into form data which is character data;
In accordance with a print request relating to a copy document transmitted from the image forming apparatus, the conversion means for an area in which the print definition data stored in the form definition storage means defines a region for which printing on the copy document is prohibited For the areas where the form data that is converted in the above-mentioned conversion means is not used, and the areas that are not defined to be prohibited from printing on the memorandum in the form definition data, the form data converted by the conversion means are used as the print data. A copy printing data generating means for generating
A form server device comprising: The form definition storage means further stores a scan condition for performing a scan instruction in the image forming apparatus after printing a copy document for at least one of a plurality of areas included in the form. And
The form server device
Scan condition determination means for determining whether or not the form data of the predetermined area converted by the conversion means satisfies a scan condition stored in the form definition storage means;
A scan instruction adding unit that adds a scan instruction to the image forming apparatus to be transmitted together with the print data generated by the copy print data generating unit when the scan condition determining unit determines that the scan condition is satisfied; The form server device according to claim 1, further comprising: Based on the position information read by the information reading unit of the digital pen, notification area determination means for determining whether or not the position information is a notification area to be provided with the voice notification provided on a sheet;
When the notification area determination means determines that the notification area should be the voice notification, the notification data corresponding to the notification area in the form definition data corresponding to the voice notification is played back with the digital pen. Output means for outputting as much as possible,
A form server device characterized by further comprising: Start area determination means for determining whether the position information is a start area based on the position information read by the information reading unit of the digital pen;
When the start area determination means determines that the area is a start area, the form server apparatus receives writing data for specifying the contents of the form identification information entered with the digital pen in the form identification area on the paper. A form identification information transmitting means for transmitting the form identification information obtained by reading the start area on the paper to the form server device when a predetermined button is pressed with the digital pen. It is possible to communicate with the digital pen comprising,
According to the form identification information transmitted by the form identification information transmitting means or the form identification information obtained from the writing data, the form definition data corresponding to the form identification information stored in the form definition storage means is stored in the digital pen. The form server device according to claim 3, further comprising definition data transmission means for transmitting to the document server. The information reading unit that reads the dot pattern from the paper on which the predetermined dot pattern is formed reads the predetermined dot pattern printed on the paper, and the position information of the paper is transmitted by the communication unit based on the read dot pattern. A form information processing system including a digital pen, an image forming apparatus, and a form server,
The form server
A form definition storage means for storing form definition data defining an area that is prohibited from printing on a copy of a plurality of areas included in the form;
Analyzing the writing data including the positional information transmitted using the digital pen, and converting it into form data which is character data;
In accordance with a print request relating to a copy document transmitted from the image forming apparatus, the conversion means for an area in which the print definition data stored in the form definition storage means defines a region for which printing on the copy document is prohibited For the areas where the form data that is converted in the above-mentioned conversion means is not used, and the areas that are not defined to be prohibited from printing on the memorandum in the form definition data, the form data converted by the conversion means are used as the print data. A copy printing data generation means for generating
The image forming apparatus includes:
A form information processing system comprising printing means for printing a copy document using print data generated by the copy print data generation means of the form server device. The printing unit of the image forming apparatus further prints a registration sheet on which a predetermined dot pattern is formed and has an area to be filled by the user,
The image forming apparatus includes:
Further comprising a form definition data transmitting means for transmitting form definition data in which a notification area to be notified by voice and its notification data are associated with each other to the digital pen;
The digital pen is
Based on the position information read by the information reading unit of the digital pen, notification area determination means for determining whether or not the position information is a notification area to be provided with the voice notification provided on a sheet;
When it is determined by the notification area determination means that the notification area should be the voice notification, the digital pen performs voice playback according to the notification data corresponding to the notification area in the form definition data corresponding to the voice notification. Audio output means for outputting
The form information processing system according to claim 5, further comprising: The digital pen further comprises writing data transmitting means for transmitting to the image forming apparatus writing data for specifying the contents entered with the digital pen in the notification area,
According to the form check data indicating the area where the voice notification is to be performed and whether or not the entry to the area is essential, and the writing data transmitted by the writing data transmitting means, the entry is mandatory with the form check data. The image forming apparatus further comprises an error message transmitting means for transmitting an error message to the digital pen when it is determined that an item is not filled in,
The form information processing system according to claim 6, wherein the voice output unit of the digital pen reproduces and outputs the voice according to the error message when the error message is transmitted by the error message transmission unit. The information reading unit that reads the dot pattern from the paper on which the predetermined dot pattern is formed reads the predetermined dot pattern printed on the paper, and the position information of the paper is transmitted by the communication unit based on the read dot pattern. A form information processing method in a form server device that receives writing data including the position information transmitted from a digital pen,
The form server device is provided with form definition storage means for storing form definition data that defines areas that are prohibited from printing on copy documents among a plurality of areas included in the form,
A converting step in which the converting means of the form server device analyzes writing data including position information transmitted using the digital pen, and converts it into form data that is character data;
An area in which the copy print data generation unit of the form server device prohibits printing of the copy document with the form definition data stored in the form definition storage unit in accordance with a print request related to the copy document transmitted from the image forming apparatus. Is not used for the area defined by the conversion means, and the conversion means is not defined for the area that prohibits printing on the copy document in the form definition data. A copy print data generation step for generating print data using the form data converted in step 1,
The form information processing method characterized by including. The information reading unit that reads the dot pattern from the paper on which the predetermined dot pattern is formed reads the predetermined dot pattern printed on the paper, and the position information of the paper is transmitted by the communication unit based on the read dot pattern. A program executed by a form server device that receives writing data including the position information transmitted from a digital pen,
The form server device is provided with form definition storage means for storing form definition data that defines areas that are prohibited from printing on copy documents among a plurality of areas included in the form,
The form server device
Analyzing the writing data including the positional information transmitted using the digital pen, and converting it into form data which is character data;
In accordance with a print request relating to a copy document transmitted from the image forming apparatus, the conversion means for an area in which the print definition data stored in the form definition storage means defines a region for which printing on the copy document is prohibited For the areas where the form data that is converted in the above-mentioned conversion means is not used, and the areas that are not defined to be prohibited from printing on the memorandum in the form definition data, the form data converted by the conversion means are used as the print data. A copy printing data generating means for generating
A computer-readable executable program characterized by being made to function.

Images