JP2007274597A - Slip processor, slip processing system and slip image correction method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a slip processor, a slip processing system and a slip image correction method for executing application processings for which a seal is required via the Internet, and for surely correcting the deformations of seal image contained in a slip image. <P>SOLUTION: This slip processor is provided with a coordinate storage part for storing the coordinate data of a plurality of reference intersections configured of the intersections of the reference ruled lines of a form; a retrieval part for retrieving the intersections of seal ruled lines forming a seal stamp column in slip image as seal column intersections, corresponding to the reference intersections; a detection part for detecting the coordinate data of each retrieved seal column intersection; a ruled line correction part for converting the coordinate data of each retrieved seal column intersection into the coordinate data of each corresponding reference intersection, and for correcting the deformation of the seal column ruled lines in the slip image; and an image correction part for setting a plurality of points in the seal stamp column as seal column interpolation points, and for converting the coordinate data of each seal column interpolation point, based on the conversion of the coordinate data of the seal column intersections, and for correcting the deformation of the seal image. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to a form processing apparatus, a form processing system, and a form image correction method that can correct deformation of a seal image of a seal stamped on a form.

  Conventionally, when applying for an account transfer for a utility bill, a customer obtains in advance an account transfer request form, for example, as a form issued by a paying institution, and the name and account number are included in the account transfer request form. The account information consisting of, for example, is entered and a registered seal stamp registered in advance for the account is stamped. Then, the customer mails the form to the bank office via the payee's institution or directly.

  After the form arrives at the sales office, reception work for the form is performed. For example, a high-accuracy image acquisition device such as a flatbed scanner is installed in the sales store, and the operator of the sales store operates the image acquisition device to convert the form into image data without any deformation. A high-quality form image is acquired. Subsequently, the account information included in the acquired form image is read and recognized by a form processing apparatus connected to the image acquisition apparatus, for example, a form OCR (Optical Character Reader) image processing apparatus, and the form information is stamped on the form. A seal image of the seal is acquired. Thereafter, a verification process is performed between the acquired seal image and a pre-registered seal image.

  However, in this case, there is a problem that it takes a cost and days for mailing the form to the bank.

  In order to solve the above problem, for example, a method of transmitting a form to a bank by FAX is conceivable. However, since the image of sufficient quality cannot be acquired by FAX, it is impossible to carry out a form receiving operation.

  In addition, a method in which a customer acquires a form image with an image acquisition device such as a digital camera or a scanner and transmits it to a bank via the Internet is conceivable. However, conventionally, an image acquisition device has not been widely used and realized. There wasn't.

  Even when the above method is realized, when a form image is obtained by photographing a form with a digital camera, the obtained form image includes a trapezoid shape caused by a barrel distortion caused by lens distortion or a shooting angle of view. Deformation such as distortion occurs. In the case of the above-mentioned application for direct debit, it is necessary to acquire an accurate seal image from the form image for the verification process with the registered seal image. Image correction software had to be developed, and there was a problem that it took time and cost.

On the other hand, Patent Document 1 discloses a technique of a non-contact type image reading apparatus. According to the technology of this image reading apparatus, it is possible to correct an image of a medium that is bent or lifted and read characters or the like written on the medium.
JP 2000-115510 A

  However, since the technique disclosed in Patent Document 1 does not support deformation such as the above-described barrel distortion, an accurate seal image with the deformation corrected can be obtained from a form image having such deformation. Is impossible.

  On the other hand, digital cameras, scanners, etc. have become widespread due to the recent progress of IT technology and the spread of the Internet, and the Internet facilities and environment have also been improved, and the form image acquired by the image acquisition device owned by the customer can be obtained. It is expected to realize a system that can transmit to an institution such as a bank via the Internet and perform reception work on the form.

  Accordingly, there has been a demand for a form processing apparatus, form processing system, and form image correction method capable of executing application processing requiring a seal stamp via the Internet and reliably correcting deformation of the seal image included in the form image.

  The present invention adopts the following configuration in order to solve the above points.

<Configuration 1>
The form processing apparatus according to the present invention extracts a seal image of a seal stamped in a seal stamp field from a form image of a form having a form in which a seal stamp field is provided, and a plurality of intersections of reference ruled lines of the form A coordinate storage unit for storing coordinate data of a reference intersection, a search unit for searching for an intersection of a seal column ruled line forming a seal stamp column in a form image corresponding to the reference intersection as a seal column intersection, and each searched seal A detection unit that detects the coordinate data of the column intersection, and a ruled line correction that converts the coordinate data of each detected seal column intersection into coordinate data of each corresponding reference intersection, and corrects deformation of the stamp column ruled line in the form image And a plurality of points in the seal stamp column are set as seal column interpolation points, and the coordinate data of each seal column interpolation point is converted based on the conversion of the coordinate data of the seal column intersection, Characterized in that it comprises an image correction unit that corrects the deformation of di.

  The form processing apparatus according to the present invention further includes a ruled line tracking unit that tracks a seal column ruled line based on a plurality of seal column intersections searched by the search unit, and the coordinate storage unit further includes any one of the reference ruled lines. Using the division points divided by the predetermined division number as points on the reference line, the coordinate data of the respective points on the reference line are stored, and the search unit further displays the seal column ruled line tracked by the ruled line tracking unit with the corresponding predetermined division number The dividing point divided by the above is searched as a point on the seal column line, the detection unit further detects the coordinate data of the point on the stamp column line, and the ruled line correction unit further detects the coordinate data of the point on the seal column line. The image data is converted into the coordinate data of each point on the reference line in the corresponding seal field stamping field to correct the deformation of the ruled line of the seal field, and the image correction unit further converts each stamp based on the conversion of the coordinate data of the point on the seal field line. Convert the coordinate data of the field interpolation point It is possible to correct the deformation of the seal image.

  In this case, the points on the reference line stored in the coordinate storage unit are division points obtained by equally dividing any of the reference ruled lines by the predetermined number of divisions, and the search unit selects the predetermined number of divisions corresponding to the seal column ruled lines. The division point equally divided by is searched as a point on the seal stamp line.

In the form processing apparatus according to the present invention, the search unit further searches for the intersection of the form ruled lines in the form image as the form intersection corresponding to the reference intersection, and the detection unit further obtains the coordinate data of each searched form intersection. And the ruled line correction unit further converts the coordinate data of each detected form intersection into coordinate data of each corresponding reference intersection, and corrects the deformation of the form ruled line in the form image,
The image correction unit further sets a plurality of points in the form image as form interpolation points, converts the coordinate data of each form interpolation point based on the conversion of the coordinate data of the form intersection, and corrects the deformation of the form image. Can do.

  The form processing apparatus according to the present invention further includes a ruled line tracking unit that traces a form ruled line based on a plurality of form intersections searched by the search unit, and the coordinate storage unit further includes any reference ruled line for each predetermined ruled line. Using the dividing points divided by the number of divisions as points on the reference line, the coordinate data of each point on the reference line is stored, and the search unit further divides the form ruled line tracked by the ruled line tracking unit by the corresponding predetermined number of divisions The division point is searched as a point on the form line, the detection unit further detects coordinate data of the found point on the form line, and the ruled line correction unit further detects the coordinate data of the detected point on the form line on each corresponding reference line. By converting to point coordinate data, the deformation of the form ruled line is corrected, and the image correction unit further converts the coordinate data of each form interpolation point based on the conversion of the coordinate data of the points on the form line, thereby generating a form image. Correction of deformation of Door can be.

  In this case, the points on the reference line stored in the coordinate storage unit are division points obtained by equally dividing any of the reference ruled lines by a predetermined number of divisions, and the search unit has a predetermined number of divisions of the form ruled lines. Search for equally divided points as points on the form line.

  In the popular processing apparatus according to the present invention, the image correction unit can convert the coordinate data of the seal column interpolation point and the form interpolation point by affine transformation.

  In this case, the image correction unit can convert the coordinate data of the seal column interpolation point by triangulation affine transformation based on the three intersections or the line points located closest to the seal column interpolation point.

  In addition, the image correction unit can convert the coordinate data of the form interpolation point by triangulation affine transformation based on the three intersections or line points located closest to the form interpolation point.

  Furthermore, the image correction unit can convert the coordinate data of the seal stamp column interpolation point and the form interpolation point by perspective conversion.

  In the form processing apparatus according to the present invention, the ruled line tracking unit can track the seal stamp ruled line and the form ruled line by Hough conversion.

  The ruled line tracking unit can also track the seal column ruled line and the form ruled line with the chain code.

<Configuration 2>
A form processing system according to the present invention includes a terminal device that acquires a form image of a form having a form, and a form processing device that can communicate with the terminal device, the terminal device including an acquisition unit that acquires a form image; A terminal transmission unit that transmits the acquired form image to the form processing apparatus, the form processing apparatus includes a coordinate storage unit that stores coordinate data of a plurality of reference intersections including intersections of the reference ruled lines of the form, and a reference intersection Correspondingly, a search unit that searches the intersection of the stamp column ruled lines forming the seal stamp column in the form image received from the terminal device as the stamp column intersection, and a detection unit that detects the coordinate data of each searched stamp column intersection A ruled line correction unit that converts the coordinate data of each detected seal column intersection into coordinate data of each corresponding reference intersection and corrects deformation of the stamp column ruled line in the form image; An image correction unit that sets a plurality of points in the stamping column as stamp column interpolation points, converts the coordinate data of each stamp column interpolation point based on the conversion of the coordinate data of the stamp column intersection, and corrects the deformation of the stamp image; It is characterized by providing.

  In the form processing system according to the present invention, the form is used for various application processes from the customer to the institution, the terminal device has a personal computer provided on the customer side, and the acquisition unit is connected to the personal computer. The form processing apparatus is provided on the institution side, and communication between the form processing apparatus and the terminal device is performed via the Internet.

  The terminal device has a personal computer provided on the customer side, the acquisition unit is composed of a digital camera connected to the personal computer, and the form processing device is provided on the institution side, and the form processing device and the terminal device Communication with is performed via the Internet.

  Furthermore, the terminal device is a mobile phone with a digital camera of the customer, the acquisition unit is a digital camera, the form processing device is provided on the institution side, and communication between the form processing device and the terminal device is wireless. Over the network.

  In the form processing system according to the present invention, the form processing apparatus further includes a ruled line tracking unit that tracks a seal column ruled line based on a plurality of seal column intersections searched by the search unit, and the coordinate storage unit further includes any one of Stores the coordinate data of each point on the reference line, using the dividing point obtained by dividing the reference ruled line by the predetermined number of divisions as the point on the reference line, and the search unit further supports the seal column ruled line tracked by the ruled line tracking unit The division point divided by the predetermined number of divisions is searched as a point on the seal column line, the detection unit further detects the coordinate data of the point on the stamp column line that has been searched, and the ruled line correction unit is further detected on the seal column line The coordinate data of the points is converted into the coordinate data of the points on each reference line in the corresponding seal field stamping field, and the deformation of the seal field ruled line is corrected, and the image correction unit further converts the coordinate data of the points on the seal field line Based on each seal column interpolation point Performing coordinate conversion data, it is possible to correct the deformation of the seal image.

  In this case, the points on the reference line stored in the coordinate storage unit are division points obtained by equally dividing any of the reference ruled lines by the predetermined number of divisions, and the search unit selects the predetermined number of divisions corresponding to the seal column ruled lines. The division point equally divided by is searched as a point on the seal stamp line.

  In the form processing system according to the present invention, the search unit further searches for an intersection of the form ruled lines in the form image as a form intersection corresponding to the reference intersection, and the detection unit further obtains coordinate data of each searched form intersection. And the ruled line correction unit further converts the coordinate data of each detected form intersection into coordinate data of each corresponding reference intersection to correct the deformation of the form ruled line in the form image, and the image correction unit further A plurality of points in the form image can be set as form interpolation points, and the coordinate data of each form interpolation point can be converted based on the conversion of the coordinate data of the form intersection, thereby correcting the deformation of the form image.

  The form processing apparatus further includes a ruled line tracking unit that tracks a form ruled line based on a plurality of form intersections searched by the search unit, and the coordinate storage unit further adds any reference ruled line to each predetermined division number. The coordinate points of each reference line point are stored with the division point divided in step 2 as the reference line point, and the search unit further divides the form ruled line tracked by the ruled line tracking unit by the corresponding predetermined number of divisions. Is detected as a point on the form line, the detection unit further detects the coordinate data of the searched point on the form line, and the ruled line correction unit further detects the coordinate data of the detected point on the form line as the corresponding point on the reference line. Convert to coordinate data to correct the deformation of the form ruled line, and the image correction unit further converts the coordinate data of each form interpolation point based on the conversion of the coordinate data of the points on the form line, and deforms the form image Can be corrected Kill.

  In this case, the points on the reference line stored in the coordinate storage unit are division points obtained by equally dividing any of the reference ruled lines by a predetermined number of divisions, and the search unit has a predetermined number of divisions of the form ruled lines. Search for equally divided points as points on the form line.

  In the form processing system according to the present invention, the image correction unit can convert the coordinate data of the seal column interpolation point and the form interpolation point by affine transformation.

  In this case, the image correction unit can convert the coordinate data of the seal column interpolation point by triangulation affine transformation based on the three intersections or the line points located closest to the seal column interpolation point.

  In addition, the image correction unit can convert the coordinate data of the form interpolation point by triangulation affine transformation based on the three intersections or line points located closest to the form interpolation point.

  Furthermore, the image correction unit can convert the coordinate data of the seal stamp column interpolation point and the form interpolation point by perspective conversion.

  In the form processing apparatus according to the present invention, the ruled line tracking unit can track the seal stamp ruled line and the form ruled line by Hough conversion.

  The ruled line tracking unit can also track the seal column ruled line and the form ruled line with the chain code.

<Configuration 3>
The form processing system according to the present invention extracts a seal image of a seal stamped in a seal stamp field from a form image of a form having a form provided with a seal stamp field, and communicates with the form processing apparatus. The form processing apparatus includes a coordinate storage unit for storing coordinate data of a plurality of reference intersections including intersections of the reference ruled lines of the form, and a seal stamp field in the form image corresponding to the reference intersections. A search unit that searches for the intersection of the seal column ruled lines as a seal column intersection, a detection unit that detects the coordinate data of each searched stamp column intersection, and the coordinate data of each detected seal column intersection, A ruled line correction unit that converts to the coordinate data of the intersection point and corrects the deformation of the stamp column ruled line in the form image, and sets a plurality of points in the stamp stamping column as the stamp column interpolation points. Based on the transformation of the coordinate data of the intersection, the coordinate data of each seal column interpolation point is converted to correct the deformation of the seal image, and the correction form image in which the deformation of the seal column ruled line and the seal image is corrected is a server The server includes a server receiving unit that receives a corrected form image from the form processing apparatus, and a server storage unit that stores the received corrected form image.

  In the form processing system according to the present invention, a personal computer can be adopted as the form processing apparatus. In this case, the form image can be acquired by an image scanner or a digital camera connected to a personal computer, and communication between the form processing apparatus and the server is performed via the Internet.

  In addition, a mobile phone with a digital camera can be adopted as the form processing apparatus. In this case, the form image can be acquired by a digital camera, and communication between the form processing apparatus and the server is performed via a wireless network.

  In the form processing system according to the present invention, the form processing apparatus further includes a ruled line tracking unit that tracks a seal column ruled line based on a plurality of seal column intersections searched by the search unit, and the coordinate storage unit further includes any one of Stores the coordinate data of each point on the reference line, using the dividing point obtained by dividing the reference ruled line by the predetermined number of divisions as the point on the reference line, and the search unit further supports the seal column ruled line tracked by the ruled line tracking unit The division point divided by the predetermined number of divisions is searched as a point on the seal column line, the detection unit further detects the coordinate data of the point on the stamp column line that has been searched, and the ruled line correction unit is further detected on the seal column line The coordinate data of the points is converted into the coordinate data of the points on each reference line in the corresponding seal field stamping field, and the deformation of the seal field ruled line is corrected, and the image correction unit further converts the coordinate data of the points on the seal field line Based on each seal column interpolation point Performing coordinate conversion data, it is possible to correct the deformation of the seal image.

  In this case, in the form processing apparatus, the point on the reference line stored in the coordinate storage unit is a division point obtained by equally dividing any reference ruled line by a predetermined number of divisions, and the search unit corresponds to the seal column ruled line. The division points equally divided by the predetermined number of divisions are searched for as points on the seal stamp line.

  In the form processing system according to the present invention, the search unit further searches for an intersection of the form ruled lines in the form image as a form intersection corresponding to the reference intersection, and the detection unit further obtains coordinate data of each searched form intersection. And the ruled line correction unit further converts the coordinate data of each detected form intersection into coordinate data of each corresponding reference intersection to correct the deformation of the form ruled line in the form image, and the image correction unit further A plurality of points in the form image can be set as form interpolation points, and the coordinate data of each form interpolation point can be converted based on the conversion of the coordinate data of the form intersection, thereby correcting the deformation of the form image.

  In the form processing system according to the present invention, the form processing apparatus further includes a ruled line tracking unit that tracks a form ruled line based on a plurality of form intersections searched by the search unit, and the coordinate storage unit further includes any reference ruled line. The coordinate data of each point on the reference line is stored with the dividing point obtained by dividing the image by the predetermined number of divisions as the point on the reference line, and the search unit further selects the form ruled line tracked by the ruled line tracking unit as the corresponding predetermined point. The division point divided by the number of divisions is searched as a point on the form line, the detection unit further detects the coordinate data of the found point on the form line, and the ruled line correction unit further detects the coordinate data of the detected point on the form line, By converting the coordinate data of the points on each reference line to correct the deformation of the form ruled line, the image correction unit further converts the coordinate data of each form interpolation point based on the conversion of the coordinate data of the points on the form line. Go and form Correction of the deformation of the image can be performed.

  In this case, in the form processing apparatus, the point on the reference line stored in the coordinate storage unit is a division point obtained by equally dividing any of the reference ruled lines by the predetermined number of divisions, and the search unit corresponds to the form ruled line. A division point equally divided by a predetermined number of divisions is searched as a point on the form line.

  In the form processing system according to the present invention, the image correction unit can convert the coordinate data of the seal column interpolation point or the form interpolation point by affine transformation.

  In this case, the image correction unit converts the coordinate data of the seal column interpolation point or the form interpolation point by triangulation affine transformation based on the three intersection points or line points located closest to the seal column interpolation point or the form interpolation point. be able to.

  In the form processing system according to the present invention, the image correcting unit can also convert the stamp column interpolation point or the coordinate data of the form interpolation point by perspective transformation.

  In the form processing system according to the present invention, the ruled line tracking unit can track the seal stamp ruled line or the form ruled line by Hough conversion.

  The ruled line tracking unit can also track the seal column ruled line or the form ruled line by the chain code.

<Configuration 4>
The form image correction method according to the present invention corrects deformation of a form image of a form having a form provided with a seal stamping column, and stores coordinate data of a plurality of reference intersections composed of intersections of the reference ruled lines of the form. Corresponding to the reference intersection, searching for the intersection of the seal column ruled lines forming the seal stamp column in the form image as the seal column intersection, and detecting the detected stamp column intersection to detect the coordinate data By converting the coordinate data of the stamp column intersection into coordinate data of each corresponding reference intersection, correcting deformation of the stamp column ruled line in the form image, and using a plurality of points in the seal stamp column as the stamp column interpolation points Setting and correcting the deformation of the seal image by converting the coordinate data of each seal column interpolation point based on the conversion of the coordinate data of the seal column intersection.

  The form image correction method according to the present invention further comprises tracking a seal field ruled line based on a plurality of searched seal field intersections, and further dividing any reference ruled line by a predetermined number of divisions. Is used as a reference point on the reference line, the coordinate data of each point on the reference line is stored, and the seal column ruled line tracked by the ruled line tracking unit is further divided into a predetermined predetermined number of divisions and searched as a point on the seal column line. Further, the detected coordinate data of the point on the seal column line is detected, and the detected coordinate data of the point on the seal column line is converted into the coordinate data of each reference line point in the corresponding seal column stamping column, It is possible to correct the deformation of the seal image by correcting the deformation of the ruled line and further converting the coordinate data of each seal column interpolation point based on the conversion of the coordinate data of the points on the seal column line.

  In this case, the stored points on the reference line are division points obtained by equally dividing any of the reference ruled lines by the predetermined number of divisions, and the division points obtained by equally dividing the stamp column ruled lines by the corresponding predetermined number of divisions are stamped. Search as a point on the column line.

  The form image correction method according to the present invention further searches for the intersection of the form ruled lines in the form image as a form intersection corresponding to the reference intersection, further detects the coordinate data of each searched form intersection, and is further detected. Convert the coordinate data of each form intersection into the coordinate data of each corresponding reference intersection, correct the deformation of the form ruled line in the form image, and set multiple points in the form image as form interpolation points, and form intersection points It is possible to correct the deformation of the form image by converting the coordinate data of each form interpolation point based on the conversion of the coordinate data.

  The form image correction method according to the present invention further comprises tracking a form ruled line based on a plurality of searched form intersections, and further dividing a reference point obtained by dividing any reference ruled line by a predetermined number of divisions. The coordinate data of each reference line point is stored as a line point, and further, the document ruled line tracked by the ruled line tracking unit is divided into the corresponding predetermined number of divisions, and the division point is searched and further searched. The coordinate data of the point on the form line is detected, the coordinate data of the detected point on the form line is converted into the coordinate data of the corresponding point on the reference line, the deformation of the form ruled line is corrected, and the point of the point on the form line is further corrected. Based on the conversion of the coordinate data, it is possible to correct the deformation of the form image by converting the coordinate data of each form interpolation point.

  In this case, the stored point on the reference line is a division point obtained by equally dividing one of the reference ruled lines by the predetermined number of divisions, and the division point obtained by equally dividing the form ruled line by the corresponding predetermined number of divisions is displayed on the form line. Search as a point.

  The form image correction method according to the present invention can convert the coordinate data of a seal column interpolation point or a form interpolation point by affine transformation.

  In this case, the coordinate data of the seal field interpolation point or the form interpolation point can be converted by the triangulation affine transformation based on the three intersection points or the line points located closest to the seal field interpolation point or the form interpolation point.

  The form image correction method according to the present invention can also convert the coordinate data of the seal column interpolation point or the form interpolation point by perspective transformation.

  The form image correction method according to the present invention can track a seal column ruled line or a form ruled line by Hough transformation.

  In addition, it is possible to track a seal column ruled line or a form ruled line by a chain code.

  According to the form processing apparatus, form processing system, and form image correction method of the present invention, it is possible to reliably correct the deformation of the seal image included in the form image, so that the form image of the form that requires the seal is transmitted via the Internet. Thus, the application process can be executed, the cost is reduced, and the time required for the application process is shortened.

  Embodiments of the present invention will be described below in detail with reference to the drawings, taking as an example a form processing apparatus to which the form image correction method according to the present invention is applied and a form processing system including the form processing apparatus.

FIG. 1 is a block diagram showing a configuration of a first embodiment of a form processing system according to the present invention.
As shown in FIG. 1, the form processing system 10 according to the first embodiment of the present invention communicates with a server 11 installed in, for example, a sales office of a financial institution via the Internet 12. And the terminal device 13 to be performed. Using this form processing system 10, the customer can execute an application process using a form such as an account transfer request form via the Internet.

  In this embodiment, the terminal device 13 includes a personal computer 14, an image scanner 15, and a printer 16.

  The image scanner 15 is connected to the personal computer 14 as a peripheral device of the personal computer 14 via, for example, a USB cable. The image scanner 15 has a function as an acquisition unit, scans a form on which a seal is imprinted, and acquires a form image including a seal image. The acquired form image is sent to the personal computer 14.

  The printer 16 is connected to the personal computer 14 as a peripheral device of the personal computer 14 via, for example, a USB cable or a printer cable. The printer 16 has a function of printing image data such as a form image of a form described later received from the personal computer 14 on a medium such as paper.

  The personal computer 14 includes a terminal display unit 17, a terminal input unit 18, a terminal storage unit 19, a terminal communication unit 20, and a terminal control unit 21 that controls these units.

  The terminal display unit 17 includes, for example, a display, and has a function of displaying an image acquired by the image scanner 15 and a function of displaying various screens.

  The terminal input unit 18 includes, for example, a mouse and a keyboard, and has a function of causing a customer to input input data and selection data.

  The terminal storage unit 19 temporarily stores image data acquired by the image scanner 15, input data input by the terminal input unit 18, data received by a terminal communication unit 20 described later, and the like. It is.

  The terminal communication unit 20 is a communication interface that communicates with the server 11 via the Internet 12, and has a function as a terminal transmission unit that transmits a form image to the server 11. Further, the terminal communication unit 20 may have a transmission data encryption function and a reception data decryption function.

  The terminal control unit 21 includes a program for controlling the above-described display function, input function, storage function, communication function, and the like.

  The server 11 includes a server communication unit 22, a server terminal device 32, an account information storage unit 33, a form processing device 34, and a server control unit 35 that controls these units.

  The server communication unit 22 is a communication interface that communicates with the terminal device 13 via the Internet 12 and has a function of receiving a form image. The received form image is sent to the form processing apparatus 34 via the server control unit 35 described later. The server communication unit 22 may have a reception data decryption function and a transmission data encryption function.

  The server terminal device 32 is composed of, for example, a terminal device such as a personal computer installed at a financial institution's sales office. It has a function to perform.

  The account information storage unit 33 is a dedicated storage unit for storing customer information including a name and address, a seal image registered for the account, and the like corresponding to the account number in the customer's account, which will be described later. It has a function of storing various processing results by the form processing device 34 in association with account numbers.

  The server control unit 35 has a function of controlling the above-described functions and the form processing device 34.

  The form processing device 34 is arranged in the server 11 and performs processing on the form image transmitted from the terminal device 13, so that the temporary storage unit 23, the form storage unit 24, the coordinate storage unit 25, the search unit 26, A detection unit 27, a ruled line tracking unit 28, a ruled line correction unit 29, an image correction unit 30, a processing unit 31, and an apparatus control unit 36 for controlling these units are provided.

  The temporary storage unit 23 has a function of temporarily storing data such as a form image received from the server control unit 35 and output results of each unit described later.

  The form storage unit 24 is a storage unit that stores a plurality of forms in association with form identification information for identifying each form.

  The coordinate storage unit 25 stores reference intersection coordinate data in association with each form. Here, the reference intersection consists of the intersection of the reference ruled lines in the form of the form, and can be searched and detected by the search unit 26 and the detection unit 27 described later. In the present embodiment, the coordinate data of the reference intersection is stored in advance in the coordinate storage unit 25. However, each time a form is processed, the corresponding form is read from the form storage unit 24, and the search unit 26 and the detection unit 27 read it. You may search and detect.

  The coordinate storage unit 25 stores coordinate data of points on the reference line in association with each form. Here, the point on the reference line is a division point obtained by dividing each reference ruled line in the form by a predetermined number of divisions, and can be tracked, searched, and detected by a ruled line tracking unit 28, a search unit 26, and a detection unit 27 described later. It is. In this embodiment, the coordinate data of the point on the reference line is stored in advance in the coordinate storage unit 25. However, as in the case of the reference intersection described above, tracking, searching, and detection may be performed each time the form processing is performed. .

The search unit 26 has a function of searching for the intersection of ruled lines in the form image stored in the temporary storage unit 23 as a form intersection. The search method for the form intersection by the search unit 26 can be, for example, a method of determining on the condition that the black pixel density is a certain value or more in a minute rectangular area of a certain size, but is not limited thereto.
The search unit 26 has a function of searching for a division point obtained by dividing each ruled line by a predetermined number of divisions as a point on the form line.

  The detection unit 27 has a function of detecting coordinate data such as a form intersection or a form line point searched by the search unit 26.

  The ruled line tracking unit 28 has a function of tracking the form ruled line in the form image stored in the temporary storage unit 23 based on a plurality of form intersections searched by the search unit 26. For the tracking of the form ruled line by the ruled line tracking unit 28, for example, a line detection logic such as a Hough transform, which is a well-known image processing element technique, a line tracking logic, or a line detection logic such as a chain code can be applied. However, the present invention is not limited to this.

  The ruled line correction unit 29 converts the coordinate data of each form intersection and each form line upper point detected by the detection unit 27 into the corresponding reference intersection and each reference line point coordinate data stored in the coordinate storage unit 25. Thus, the deformation of the form ruled line in the form image is corrected.

  The image correction unit 30 sets a plurality of points in the form image stored in the temporary storage unit 23 as the form interpolation points, and based on the conversion of the coordinate data of the form intersection point and the point on the form line by the ruled line correction unit 29, By transforming the coordinate data of the form interpolation point, the deformation of the seal image and the description image included in the form image is corrected. In this embodiment, the conversion of the coordinate data of each form interpolation point by the image correction unit 30 is, as will be described later, a triangulation affine transformation based on the three form intersections or the points on the form line that are closest to the form interpolation point. However, the present invention is not limited to this.

  The processing unit 31 has a function of performing various processes, such as text description processing and seal collation processing, on a form image whose deformation has been corrected by a form processing apparatus 34 to be described later, that is, a corrected form image.

  For example, the processing of converting the description content into text by the processing unit 31 determines a character recognition target area in the corrected form image based on a form form stored in the form storage unit 24 in advance, This is done by performing OCR (Optical Character Reader) recognition processing.

Also, the seal collation process by the processing unit 31 is performed, for example, by determining the seal stamp field in the corrected form image based on the form form stored in advance in the form storage unit 24, and for the seal stamp field, After the seal image is extracted, the extracted seal image and the seal image of the corresponding registered seal registered in advance in the account information storage unit 33 are collated.
Detailed description of each process performed by the processing unit 31 is omitted.

  The apparatus control unit 36 has a function of controlling each unit described above, and has a function of sending each processing result and the corrected form image for the form image received from the server control unit 35 to the server control unit 35.

Next, the flow of using the form processing system 10 to execute an application process that requires a seal via the Internet 12 will be described with reference to a flowchart, taking as an example an account transfer request.
FIG. 2 is a flowchart showing the operation in the first embodiment of the form processing system according to the present invention.

  For example, a customer requests access to the server 11 by operating the terminal input unit 18 of the personal computer 14 in order to obtain an account transfer request form as a form for applying for an account transfer for public utility charges, etc. When the access request signal is input, the terminal control unit 21 causes the terminal communication unit 20 to transmit the access request signal to the server 11 (S101).

  In the server 11, when the server communication unit 22 receives the access request signal, the server control unit 35 causes the server communication unit 22 to transmit a form selection screen for causing the customer to select the type of form to be downloaded to the terminal device 13. .

  In the terminal device 13, when the terminal communication unit 20 receives the form selection screen, the terminal control unit 21 displays the form selection screen on the terminal display unit 17 (S102).

  In the form selection screen, when the customer operates the terminal input unit 18 to select an account transfer request form, selected form identification information indicating that the account transfer request form has been selected is input. Upon receiving this input, the terminal control unit 21 causes the terminal communication unit 20 to transmit the selected form identification information to the server 11 (S103).

  In the server 11, when the server communication unit 22 receives the selected form identification information, the server control unit 35 sends the selected form identification information together with the form request signal for requesting the form to the form processing device 34. When the form processing device 34 receives the form request signal and the selected form identification information, the apparatus control unit 36 reads the form of the account transfer request form from the form storage unit 24 based on the selected form identification information, and the form is stored in the server. The data is sent to the control unit 35. Then, the server control unit 35 controls the server communication unit 22 to transmit the form and an account transfer request form transmission screen as a form transmission screen for transmitting the form image to the terminal device 13 (S104). ).

  In the terminal device 13, when the terminal communication unit 20 receives the account transfer request form and the account transfer request form transmission screen, the terminal control unit 21 stores the form in the terminal storage unit 19 and stores the form in the terminal display unit 17. Display the transfer request transmission screen. When the customer selects printing of the form using the terminal input unit 18, the terminal control unit 21 causes the printer 16 to print the form (S105).

FIG. 3 is an explanatory diagram of a form form, a written form, and a form image.
As shown in FIG. 3A, the form form used in the present embodiment has ruled lines for designating areas for describing necessary items, that is, form ruled lines. In addition, a seal stamp field 39 for stamping a seal is provided at a predetermined position on the lower right of the form.

  In the printed account transfer request form, the customer fills in necessary information such as account information including the account number of the customer's account, the customer's name, address, etc. in a predetermined area, and the seal stamp column 39 After imprinting the registered seal in the account, the account transfer request document, that is, a written form is placed at a predetermined position of the image scanner 15. Then, when the customer operates the terminal input unit 18 and performs input for causing the image scanner 15 to acquire an image, the terminal control unit 21 reads the image of the description form placed on the image scanner 15, that is, The form image 37 is acquired (S106). The form image 37 acquired by the image scanner 15 is sent to the personal computer 14 and stored in the terminal storage unit 19 (S106).

  In the entry form shown in FIG. 3 (2), only the account number area 38 for entering the account number is entered for the sake of simplicity. In addition, a seal is stamped in the seal stamp column 39 of the written form.

  An image of the written form acquired by the image scanner, that is, a form image 37 is shown in FIG. The form image 37 acquired by the operation of the customer is different from the form image acquired by a skilled operator of a financial institution using a high-accuracy image acquisition device, for example, and some deformation including bending, floating, distortion, etc. occurs. End up. It can be seen that the form image 37 shown in FIG. 3 (3) is deformed as compared with the written form shown in FIG. 3 (2). In order to extract a correct seal image without deformation from the form image 37, it is necessary to correct at least the deformation in the seal stamp field 39 of the form image 37. The correction of this deformation will be described later.

  Subsequently, when the customer operates the terminal input unit 18 on the account transfer request document transmission screen displayed on the terminal display unit 17 and selects transmission of the form image 37 to the server 11, the terminal control unit 21 The terminal communication unit 20 is controlled to transmit the form image 37 stored in the terminal storage unit 19 and the form identification information indicating the account transfer request document to the server 11 (S107).

  In the server 11, when the server communication unit 22 receives the form image 37 and the form identification information, the server control unit 35 sends them to the form processing device 34.

  When the form processing device 34 receives the form image 37 and the form identification information from the server control unit 35, the device control unit 36 stores them in the temporary storage unit 23 (S108). Subsequently, based on the form identification information stored in the temporary storage unit 23, the apparatus control unit 36 reads out the coordinate data of the reference intersection point and the reference line point of the form of the form and stores them in the temporary storage unit 23. (S108).

FIG. 4 is an explanatory diagram of intersection points and line points in forms and form images.
In the form shown in FIG. 4A, a plurality of white circles “◯” indicate the position of each reference intersection point 40, which corresponds to the intersection point of each reference ruled line in the form. A plurality of black circles “●” indicate the position of each reference line point 41. In this embodiment, the ruled line tracking unit 28 performs tracking of the reference ruled line on the form image of the form in advance, acquires the coordinate line of the reference ruled line, and acquires each coordinate acquired for each reference ruled line. The coordinate data is stored in advance in the coordinate storage unit 25 with the points thinned out at predetermined intervals as points on the reference line.

  Subsequently, the apparatus control unit 36 reads the form image 37 from the temporary storage unit 23, and causes the search unit 26 to search for the intersection of the form ruled lines in the form image 37, that is, the form intersection 42 (S109). The search unit 26 searches for a form intersection 42 corresponding to each reference intersection 40 of the form. Then, the server control unit 35 causes the detection unit 27 to detect the coordinate data of the searched form intersection 42 (S109). The detected coordinate data of the form intersection 42 is associated with the coordinate data of the corresponding reference intersection 40 by the ruled line correction unit 29 and stored in the temporary storage unit 23 (S109). Further, the ruled line correction unit 29 provides an area for storing a corrected form image, that is, a corrected form image area in the temporary storage unit 23, and the coordinate data of each form intersection 42 is stored in the area in the coordinates of each corresponding reference intersection 40. The data is converted and stored (S109).

  In the form image 37 shown in FIG. 4B, a plurality of white circles “◯” indicates the position of the form intersection 42 searched by the search unit 26. Reference intersections 40a and 40b shown in FIG. 4 (1) correspond to intersections 42a and 42b shown in FIG. 4 (2), respectively.

FIG. 5 is a diagram for explaining the principle of ruled line correction processing in the form image correction method according to the present invention.
The ruled line correction unit 29 converts the coordinate data of each form intersection 42 detected by the search unit 26 in the form image 37 and detected by the detection unit 27 into coordinate data of each corresponding reference intersection 40, thereby generating a form. The form ruled lines in the image 37 are corrected.

  Next, the server control unit 35 causes the ruled line tracking unit 28 to track a line segment connecting the two form intersections 42 in the form image 37, that is, a form ruled line (S110). The ruled line tracking unit 28 tracks, for example, a form ruled line 44 connecting the two form intersections 42a and 42b shown in FIG. 4B, and acquires a coordinate string of the form ruled line 44. Subsequently, the server control unit 35 causes the search unit 26 to search for points on the form line that are obtained by thinning the traced form ruled lines 44 at a predetermined interval. In the form image 37 shown in FIG. 4 (3), division points obtained by dividing the form ruled line 44 into eight equal parts are shown as form line upper points 43-1, 43-2,... 43-7. .

  When the search unit 26 searches for a plurality of form line points 43, the server control unit 35 causes the detection unit 27 to detect the coordinate data of each form line point 43 (S110). The detected coordinate data of each point on the form line 43 is associated with the coordinate data of the corresponding point on the reference line 41 by the ruled line correction unit 29 and stored in the temporary storage unit 23 (S110). Further, the ruled line correction unit 29 converts the coordinate data of each form line upper point 43 into the coordinate data of each corresponding reference line upper point 41 and stores it in the corrected form image area in the temporary storage unit 23 (S110).

  The correspondence between the points on the form line and the points on the reference line is performed when the number of intersections of the reference ruled lines in the form, that is, the reference intersections are small, and the image correction is insufficient only by the association of the reference intersections. . Therefore, when it is determined that a sufficient effect can be obtained by correcting the image using only the reference intersection, the ruled line tracking unit 28 performs tracking of the form ruled line, and the search unit 26 and the detection unit 27 search for and detect points on the form line. The operation (S110) may be omitted.

  In the above-described image correction process using the form intersection point and the point on the form line, the deformation is corrected only for the form ruled line, and the deformation of the image in the form ruled line is not corrected. Therefore, the server control unit 35 controls the image correction unit 30 to correct the image in the form ruled line (S111).

The image correction unit 30 determines a correction target region based on the form. In the present embodiment, the deformation of the image of the entire form image 37 is corrected. For the sake of simplicity, correction of the image in the seal stamp column 39, that is, the seal image will be described.
FIG. 6 is an explanatory diagram of the image correction process in the seal stamp field.

  When the correction target area is the seal stamp field 39, the image correction unit 30 sets a plurality of points in the seal stamp field 39 as the seal field interpolation points. For example, the image correcting unit 30 sets each pixel point in the seal stamp column 39 in the form image 37 as each seal column interpolation point. In FIG. 6 (1), the seal stamp column 39 in the form image 37 before the correction processing is shown, and the seal column interpolation point 45 is indicated by “×”. The seal stamp interpolation point 45 is one of the seal stamp interpolation points set at a plurality of points, and is located on the seal image.

Then, the image correction unit 30 selects three points on the form intersection or the point on the form line that is closest to the seal column interpolation point 45. The selected form intersection or form line point is the ruled line forming the seal stamp field, that is, the seal field intersection or the seal field line point located on the seal field rule line.
In FIG. 6 (1), the seal field intersection 42c and the seal field line upper points 43a and 43b located closest to the seal field interpolation point 45 are selected.

Subsequently, the image correction unit 30 calculates the seal column interpolation point 45 and each selected point based on the coordinate data of the seal column interpolation point 45 and the coordinate data of the selected three points 42c, 43a and 43b. Each distance is calculated. Then, the image correction unit 30 reads the coordinate data of the three points coordinate-converted by the ruled line correction unit 29, that is, the reference intersection point 40c of FIG. 6B and the reference line upper points 41a and 41b from the temporary storage unit 23, In order to make the relative ratio of the distance to these three points coincide with the relative ratio of the distance to each point calculated with respect to the seal column interpolation point 45 in FIG. Coordinate data of the correction seal column interpolation point 46 is calculated.
That is, the relative ratios of the distances between the correction seal stamp interpolation point 46 and the reference 40c and the reference line points 41a and 41b in FIG. 6 (2) are the stamp seal interpolation point 45 and the seal stamp intersection 42c and the seal stamp in FIG. 6 (1). This corresponds to the relative ratio of the distances to the column line upper points 43a and 43b.

  As described above, the image correcting unit 30 performs coordinate conversion from the seal stamp interpolation point 45 in FIG. 6A to the corrected seal stamp interpolation point 46 in FIG. 6B to all the pixel points in the seal stamp column 39. To correct the deformation of the image in the seal stamp field. In other words, by detecting the luminance value of the seal column interpolation point before conversion and copying the luminance value to the calculated correction seal column interpolation point position of the conversion destination, image conversion is performed, and the seal stamp column The deformation of the image in 39, that is, the seal image is corrected.

  Note that the image correction processing method performed by the image correction unit 30 described in this embodiment is merely an example, and other methods may be applied.

  The image correcting unit 30 performs image correction of the form image 37 by performing the same conversion as the image conversion in the seal stamp field 39 on all the pixel points in the form image 37 (S111). The corrected form image, that is, the corrected form image 47 is stored in the temporary storage unit 23.

  Subsequently, the processing unit 31 performs various processes such as text conversion and seal verification processing on the corrected form image 47 (S112). The processing result is sent to the server control unit 35 together with the corrected form image 47.

  When the server control unit 35 receives the corrected form image 47 and the corresponding processing result, the server control unit 35 displays the correction form image 47 on the display unit of the server terminal device 32, and correction input is performed by the input unit of the server terminal device 32 as necessary. Then, the server control unit 35 stores the processing result in the account information storage unit 33 based on the account number included in the processing result (S112).

  Then, the server control unit 35 controls the server communication unit 22 to transmit to the terminal device 13 a reception completion screen indicating that the reception process for the form, that is, the account transfer request form has been completed (S113).

  In the terminal device 13, when the terminal communication unit 20 receives the reception completion screen, the terminal control unit 21 displays the reception completion screen on the terminal display unit 17 (S114), and the form processing system 10 ends the application process. .

  As described above, according to the form processing system of the present embodiment, application processing using a form that requires seal stamping can be executed using a terminal device and an image acquisition device in a customer's house or company. The cost required for mailing the form is reduced and the time required for mailing is shortened. In addition, since it is possible to reliably correct the deformation of the seal image included in the form image, it is not necessary to use a high-accuracy image acquisition device when acquiring the form image, and a commonly used digital camera or the like is used. Therefore, the degree of freedom in apparatus configuration is increased and the initial investment cost on the customer side is reduced.

  In the present embodiment, a terminal system including a personal computer and an image scanner is employed as the terminal device, but a digital camera may be employed as the acquisition unit instead of the image scanner.

  A mobile phone with a digital camera can also be adopted as the terminal device. In this case, communication between the server as the form processing device and the terminal device is performed via a wireless network.

FIG. 8 is a block diagram showing the configuration of the second embodiment of the form processing system according to the present invention.
As shown in FIG. 8, the form processing system 50 according to the second embodiment of the present invention includes a server 51 installed in an organization such as a company or a financial institution, and the server 51 via a wireless network 52. And a mobile phone 53 with a digital camera of a customer who can communicate.
Using this form processing system 50, a customer who owns the mobile phone 53 can perform various application processes with respect to the institution where the server 51 is installed.
In the present embodiment, the same configurations and operations as those of the first embodiment are denoted by the same reference numerals, and description thereof will be omitted.

  The cellular phone 53 includes a digital camera 55, a display unit 56, an input unit 57, a communication unit 65, a form processing device 54, and a control unit 58 that controls these units as terminal devices having a form processing function.

  The digital camera 55 has a function of taking a form on which a seal is imprinted and acquiring a form image including a seal image.

  The display unit 56 includes, for example, a liquid crystal display, and has a function of displaying a form image acquired by the digital camera 55 and a function of displaying various screens.

  The input unit 57 includes, for example, an input button, and has a function of allowing an operator to input input data and selection data.

  The communication unit 65 is a communication interface that communicates with the server 51 via the wireless network 52, and the server 51 displays the form image whose image has been corrected by the form processing device 54 described later, that is, the corrected form image and the processing result. It has a function as an apparatus transmission part which transmits to.

  The control unit 58 has a function of controlling the above-described units, and also has a function of sending a form image acquired by the digital camera 55 to the form processing apparatus 54.

  The form processing device 54 is arranged in the mobile phone 53 and performs processing on the form image acquired by the digital camera 55 to temporarily store the form 59, the form storage 60, the coordinate storage 61, and the search unit 26. A detection unit 27, a ruled line tracking unit 28, a ruled line correction unit 29, an image correction unit 30, a device communication unit 65, and a device control unit 62.

  The temporary storage unit 59 has a function of temporarily storing a form image acquired by the digital camera 55, an output result from each unit, and the like.

  The form storage unit 60 is a storage unit for storing a form of a form. The form stored in the form storage unit 60 is downloaded in advance from the server 51 on the engine side.

The coordinate storage unit 25 stores the coordinate data of the reference intersection and the reference line point in the form. Here, the reference intersection point and the reference line point stored in the coordinate storage unit 25 are a ruled line tracking unit 28, a search unit 26, a detection unit 27, and a ruled line tracking unit, which will be described later, with respect to the form stored in the form storage unit 60. By 28, tracking, searching and detection are performed and stored.
Note that the configurations and operations of the ruled line tracking unit 28, the search unit 26, and the detection unit 27 are the same as those in the first embodiment, and thus detailed description thereof is omitted.

  The device control unit 62 has a function of controlling the above-described units.

  The server 51 is disposed on the institution side and includes a server communication unit 63, a processing unit 31, a server terminal device 32, and an account information storage unit 33.

  The server communication unit 63 is a communication interface that communicates with the mobile phone 53 via the wireless network 52, and receives a corrected form image, a processing result for the form, and the like.

  The server control unit 64 has a function of controlling each unit described above.

Next, a flow of executing an application process that requires a seal using the form processing system 50 will be described with reference to a flowchart.
FIG. 9 is a flowchart showing the operation of the form processing system according to the second embodiment of the present invention.

  In the present embodiment, application processing requiring a seal is performed via the wireless network 52 using the mobile phone 53 with a digital camera owned by the customer. The form for the application process is downloaded by the customer from the server 51 and printed in advance by a printer (not shown), for example. When the customer obtains the form, the customer fills in the necessary items on the form and imprints the seal in the seal stamping column.

  The customer operates the input unit 57 of the mobile phone 53 to perform input for performing the form processing. In response to this input, the control unit 58 causes the display unit 56 to display an image acquisition screen for acquiring a form image. When the acquisition of the form image is selected by the input unit 57, the control unit 58 that has received the selection controls the digital camera 55 to photograph the written form that has been filled and stamped by the customer, and the form image is obtained. Obtain (S201).

Subsequently, the control unit 58 displays a selection screen for selecting a form type on the display unit 56. Then, the form identification information of the form is input by the selection by the input unit 57 (S201).
The acquired form image and the input form identification information are sent to the form processing apparatus 54 by the control unit 58 (S201).

  Upon receiving the form image and the form identification information, the apparatus control unit 62 stores the form image and the form identification information in the temporary storage unit 59.

  Subsequently, the apparatus control unit 62 reads out the coordinate data of the reference intersection point and the reference line point of the form of the form from the coordinate storage unit 61 based on the form identification information, and stores them in the temporary storage unit 59 ( S108). When the coordinate data of the reference intersection and the point on the reference line is not stored in the coordinate storage unit 61, the coordinate data of the reference intersection is detected by the search unit 26 and the detection unit 27, and the ruled line tracking unit 28, the search unit 26, and the detection unit 27, the coordinate data of the point on the reference line is detected (S108).

  Subsequently, the apparatus control unit 62 reads out the form image from the temporary storage unit 59, causes the search unit 26 to search for the intersection of the form ruled lines in the form image, that is, the form intersection 42, and causes the detection unit 27 to detect the form intersection. The coordinate data is detected (S109). The detected coordinate data is associated with the coordinate data of the corresponding reference intersection by the ruled line correction unit 29 and stored in the temporary storage unit 59 (S109). Further, the ruled line correction unit 29 converts the coordinate data of each form intersection into coordinate data of each reference intersection, and stores it in the corrected form image area provided in the temporary storage unit 59 (S109).

  Next, the apparatus control unit 62 causes the ruled line tracking unit 28 to track a form ruled line connecting two form intersections in the form image (S110), and causes the search unit 26 to search for a plurality of line points, that is, points on the form line ( S110). When the coordinate data of each point on the form line is detected by the detection unit 27, the ruled line correction unit 29 associates the coordinate data of the point on the form line with the coordinate data of the point on the reference line, and the temporary storage unit 59 Stores the coordinate data (S110). Further, the ruled line correction unit 29 converts the coordinate data of the points on each form line into the coordinate data of the points on the reference line, and stores them in the corrected form image area provided in the temporary storage unit 59 (S110).

  Then, the device control unit 62 controls the image correction unit 30 to set a form interpolation point in the form image and perform coordinate conversion on the form interpolation point, thereby correcting the image in the form image. The correction form image is acquired (S111). The acquired corrected form image is stored in the temporary storage unit 59.

  Subsequently, the apparatus control unit 62 reads out the corrected form image and the form identification information from the temporary storage unit 59 and sends them to the control unit 58.

  Upon receiving the corrected form image and form identification information, the control unit 58 controls the communication unit 65 to transmit the corrected form image and form identification information to the server 51 (S202).

  In the server 51, when the server communication unit 63 receives the corrected form image and the form identification information, the server control unit 64 controls the processing unit 31 to perform a description content text processing process, a seal collation process, etc. on the corrected form image. Each process is performed (S203). The processing result is displayed on the display unit of the server terminal device 32, and correction input or the like is performed as necessary.

  Then, the server control unit 64 stores the corrected form image and the processing result in the account information storage unit 33 (S203). Each process by the processing unit 31 may be executed after the application process is completed.

  Subsequently, the server control unit 64 causes the server communication unit 63 to transmit a reception completion screen indicating that the reception process has been completed to the mobile phone 53 (S204).

  In the cellular phone 53, when the communication unit 65 receives the reception completion screen, the control unit 58 displays the reception completion screen on the display unit 56 (S205), and the form processing system 50 ends the application process.

  As described above, according to the form processing system of the present embodiment, the form processing apparatus is provided on the terminal device side, and the terminal apparatus can acquire the form image, perform image correction, and transmit the corrected form image to the server. Because it is possible, when a form image that cannot be modified by the form processing device is acquired by the acquisition unit, it is not necessary to repeat communication with the server, so the time required for application processing can be shortened. , The load on the server is reduced.

  In addition, by providing a cellular phone with a digital camera with a form processing function, it is possible to reduce the size and price of the apparatus, reduce costs, and carry the form processing apparatus. The operator on the side can bring in a mobile phone with a digital camera having the form processing device, visit the customer's house or company, etc., and accept application processing from the customer, further expanding the range of use .

  In this embodiment, a mobile phone with a digital camera is used as a terminal device having a form processing function, but a mobile terminal device can also be used. In this case, an image scanner or a digital camera connected to the portable terminal device is employed as the acquisition unit of the terminal device.

It is a block diagram which shows the structure of Example 1 of the form processing system which concerns on this invention. It is a flowchart which shows the operation | movement in Example 1 of the form processing system which concerns on this invention. It is explanatory drawing of a form of a form, a description form, and a form image. It is explanatory drawing of the intersection and line point in a form and a form image. It is explanatory drawing of the ruled line correction process in the form image correction method which concerns on this invention. It is explanatory drawing of the image correction process in a seal stamp column. It is explanatory drawing of the image correction process in a form image. It is a block diagram which shows the structure of Example 2 of the form processing system which concerns on this invention. It is a flowchart which shows the operation | movement in Example 2 of the form processing system which concerns on this invention.

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 Form processing system 11 Server 12 Internet 13 Terminal device 14 Personal computer 15 Image scanner 16 Printer 17 Terminal display part 18 Terminal input part 19 Terminal storage part 20 Terminal communication part 21 Terminal control part 22 Server communication part 23 Temporary storage part 24 Form storage Unit 25 coordinate storage unit 26 search unit 27 detection unit 28 ruled line tracking unit 29 ruled line correction unit 30 image correction unit 31 processing unit 32 server display unit 33 account information storage unit 34 device control unit 35 server control unit 36 form processing device

Claims (70)

In a form processing apparatus for extracting a seal image of a seal stamped in the seal stamp field from a form image of a form having a form provided with a seal stamp field,
A coordinate storage unit for storing coordinate data of a plurality of reference intersections composed of intersections of reference ruled lines of the form;
Corresponding to the reference intersection, a search unit that searches for an intersection of the seal column ruled line forming the seal stamp column in the form image as a seal column intersection,
A detection unit for detecting coordinate data of each searched seal column intersection;
A ruled line correction unit that converts the coordinate data of each detected seal column intersection detected into the coordinate data of each corresponding reference intersection, and corrects deformation of the seal column ruled line in the form image;
A plurality of points in the seal stamp field are set as stamp field interpolation points, and the coordinate data of each seal field interpolation point is converted based on the conversion of the coordinate data of the seal field intersection, thereby correcting deformation of the seal image An image correction unit to perform,
A form processing apparatus comprising: Further comprising a ruled line tracking unit that tracks the stamp column ruled lines based on the plurality of stamp column intersections searched by the search unit;
The coordinate storage unit further stores coordinate data of each point on the reference line, with a division point obtained by dividing any one of the reference ruled lines by a predetermined number of divisions as a point on the reference line, and the search unit further includes The dividing line obtained by dividing the seal column ruled line tracked by the ruled line tracking unit by the corresponding predetermined number of divisions is searched as a point on the seal column line, and the detection unit further searches for the point on the stamp column line. Coordinate data is detected, and the ruled line correction unit further converts the detected coordinate data of the points on the seal column line into coordinate data of the respective points on the reference line in the corresponding seal column stamping column, and the seal column The deformation of the ruled line is corrected, and the image correction unit further converts the coordinate data of each seal column interpolation point based on the conversion of the coordinate data of the points on the seal column line, thereby correcting the deformation of the seal image. It is characterized by performing Form processing apparatus according to claim 1.   The points on the reference line stored in the coordinate storage unit are division points obtained by equally dividing any of the reference ruled lines by a predetermined number of divisions, and the search unit corresponds to the predetermined line corresponding to the seal column ruled line. The form processing apparatus according to claim 2, wherein a division point equally divided by the number of divisions is searched as the point on the seal column line.   The search unit further searches for the intersection of the form ruled lines in the form image as a form intersection corresponding to the reference intersection, and the detection unit further detects the coordinate data of each searched form intersection, The ruled line correction unit further converts the detected coordinate data of each form intersection into coordinate data of each corresponding reference intersection, corrects the deformation of the form ruled line in the form image, and the image correction unit Further, a plurality of points in the form image are set as form interpolation points, and the coordinate data of each form interpolation point is converted based on the conversion of the coordinate data of the form intersection, thereby correcting the deformation of the form image. The form processing apparatus according to claim 1. Further comprising a ruled line tracking unit for tracking the form ruled line based on the plurality of form intersections searched by the search unit;
The coordinate storage unit further stores coordinate data of each point on the reference line, with a division point obtained by dividing any one of the reference ruled lines by a predetermined number of divisions as a point on the reference line, and the search unit further includes A division point obtained by dividing the form ruled line tracked by the ruled line tracking unit by the corresponding predetermined number of divisions is searched as a point on the form line, and the detection unit further obtains coordinate data of the searched point on the form line. And the ruled line correction unit further converts the detected coordinate data of the points on the form line into coordinate data of the corresponding points on the reference line to correct deformation of the form ruled line, and the image correction unit 5. The form according to claim 4, further comprising: converting the coordinate data of each of the form interpolation points based on the conversion of the coordinate data of the points on the form line to correct the deformation of the form image. Processing equipment.   The point on the reference line stored in the coordinate storage unit is a division point obtained by equally dividing any of the reference ruled lines by a predetermined number of divisions, and the search unit corresponds to the predetermined ruled line corresponding to the form ruled line. 6. The form processing apparatus according to claim 5, wherein a division point equally divided by the number of divisions is searched as a point on the form line.   The form processing apparatus according to claim 1, wherein the image correction unit converts coordinate data of the seal stamp interpolation point by affine transformation.   The image correction unit converts the coordinate data of the seal column interpolation point by triangulation affine transformation based on the three intersections or the linear points located closest to the seal column interpolation point. Item 7. The form processing apparatus according to Item 7.   The form processing apparatus according to claim 1, wherein the image correction unit converts coordinate data of the seal stamp interpolation point by perspective conversion.   5. The form processing apparatus according to claim 4, wherein the image correction unit converts coordinate data of the form interpolation point by affine transformation.   The image correction unit converts the coordinate data of the seal column interpolation point by triangulation affine transformation based on the three intersections or the linear points located closest to the form interpolation point. 10. The form processing apparatus according to 10.   The form processing apparatus according to claim 4, wherein the image correction unit converts coordinate data of the form interpolation point by perspective transformation.   3. The form processing apparatus according to claim 2, wherein the ruled line tracking unit tracks the seal column ruled line by Hough conversion.   The form processing apparatus according to claim 2, wherein the ruled line tracking unit tracks the seal column ruled line using a chain code.   6. The form processing apparatus according to claim 5, wherein the ruled line tracking unit tracks the form ruled line by a Hough transform.   6. The form processing apparatus according to claim 5, wherein the ruled line tracking unit tracks the form ruled line using a chain code. In a form processing system including a terminal device that acquires a form image of a form having a form and a form processing device that can communicate with the terminal device,
The terminal device
An acquisition unit for acquiring the form image;
A terminal transmission unit that transmits the acquired form image to the form processing apparatus;
The form processing apparatus includes:
A coordinate storage unit for storing coordinate data of a plurality of reference intersections composed of intersections of reference ruled lines of the form;
Corresponding to the reference intersection, a search unit that searches for an intersection of seal stamp ruled lines forming the seal stamp column in the form image received from the terminal device as a seal stamp intersection,
A detection unit for detecting coordinate data of each searched seal column intersection;
A ruled line correction unit that converts the coordinate data of each detected seal column intersection detected into the coordinate data of each corresponding reference intersection, and corrects deformation of the seal column ruled line in the form image;
A plurality of points in the seal stamp field are set as stamp field interpolation points, and the coordinate data of each seal field interpolation point is converted based on the conversion of the coordinate data of the seal field intersection, thereby correcting deformation of the seal image An image correction unit to perform,
A form processing system characterized by comprising:   The form is used for various application processes from a customer to an institution, the terminal device has a personal computer provided on the customer side, and the acquisition unit is an image scanner connected to the personal computer. 18. The form processing system according to claim 17, wherein the form processing apparatus is provided on the institution side, and communication between the form processing apparatus and the terminal device is performed via the Internet. .   The form is used for various application processes from a customer to an institution, the terminal device has a personal computer provided on the customer side, and the acquisition unit is a digital camera connected to the personal computer 18. The form processing system according to claim 17, wherein the form processing apparatus is provided on the institution side, and communication between the form processing apparatus and the terminal device is performed via the Internet. .   The form is used for various application processes from the customer to the institution, the terminal device is a mobile phone with a digital camera of the customer, the acquisition unit is the digital camera, and the form processing apparatus is The form processing system according to claim 17, wherein the form processing system is provided on the institution side, and communication between the form processing apparatus and the terminal device is performed via a wireless network. The form processing apparatus further includes a ruled line tracking unit that tracks the seal column ruled lines based on the plurality of seal column intersections searched by the search unit,
The coordinate storage unit further stores coordinate data of each point on the reference line, with a division point obtained by dividing any one of the reference ruled lines by a predetermined number of divisions as a point on the reference line, and the search unit further includes The dividing line obtained by dividing the seal column ruled line tracked by the ruled line tracking unit by the corresponding predetermined number of divisions is searched as a point on the seal column line, and the detection unit further searches for the point on the stamp column line. Coordinate data is detected, and the ruled line correction unit further converts the detected coordinate data of the points on the seal column line into coordinate data of the respective points on the reference line in the corresponding seal column stamping column, and the seal column The deformation of the ruled line is corrected, and the image correction unit further converts the coordinate data of each seal column interpolation point based on the conversion of the coordinate data of the points on the seal column line, thereby correcting the deformation of the seal image. It is characterized by performing Form processing system of claim 17, wherein.   The points on the reference line stored in the coordinate storage unit are division points obtained by equally dividing any of the reference ruled lines by a predetermined number of divisions, and the search unit corresponds to the predetermined line corresponding to the seal column ruled line. The form processing system according to claim 21, wherein a division point equally divided by the number of divisions is searched as a point on the seal column line.   The search unit further searches for the intersection of the form ruled lines in the form image as a form intersection corresponding to the reference intersection, and the detection unit further detects the coordinate data of each searched form intersection, The ruled line correction unit further converts the detected coordinate data of each form intersection into coordinate data of each corresponding reference intersection, corrects the deformation of the form ruled line in the form image, and the image correction unit Further, a plurality of points in the form image are set as form interpolation points, and the coordinate data of each form interpolation point is converted based on the conversion of the coordinate data of the form intersection, thereby correcting the deformation of the form image. The form processing system according to claim 17. The form processing apparatus further includes a ruled line tracking unit that tracks the form ruled line based on the plurality of form intersections searched by the search unit,
The coordinate storage unit further stores coordinate data of each point on the reference line, with a division point obtained by dividing any one of the reference ruled lines by a predetermined number of divisions as a point on the reference line, and the search unit further includes A division point obtained by dividing the form ruled line tracked by the ruled line tracking unit by the corresponding predetermined number of divisions is searched as a point on the form line, and the detection unit further obtains coordinate data of the searched point on the form line. And the ruled line correction unit further converts the detected coordinate data of the points on the form line into coordinate data of the corresponding points on the reference line to correct deformation of the form ruled line, and the image correction unit 24. The form according to claim 23, further comprising: converting coordinate data of each form interpolation point based on conversion of coordinate data of points on the form line to correct deformation of the form image. Processing system .   The point on the reference line stored in the coordinate storage unit is a division point obtained by equally dividing any of the reference ruled lines by a predetermined number of divisions, and the search unit corresponds to the predetermined ruled line corresponding to the form ruled line. 25. The form processing system according to claim 24, wherein division points equally divided by the number of divisions are searched as points on the form line.   18. The form processing system according to claim 17, wherein the image correction unit converts coordinate data of the seal column interpolation point by affine transformation.   The image correction unit converts the coordinate data of the seal column interpolation point by triangulation affine transformation based on the three intersections or the linear points located closest to the seal column interpolation point. Item 27. The form processing system according to Item 26.   18. The form processing system according to claim 17, wherein the image correction unit converts coordinate data of the seal column interpolation point by perspective conversion.   The form processing system according to claim 23, wherein the image correction unit converts coordinate data of the form interpolation point by affine transformation.   The image correction unit converts the coordinate data of the seal column interpolation point by triangulation affine transformation based on the three intersections or the linear points located closest to the form interpolation point. 29. The form processing system according to 29.   The form processing system according to claim 23, wherein the image correction unit converts coordinate data of the form interpolation point by perspective transformation.   The form processing system according to claim 21, wherein the ruled line tracking unit tracks the seal column ruled line by Hough conversion.   The form processing system according to claim 21, wherein the ruled line tracking unit tracks the seal column ruled line by a chain code.   25. The form processing system according to claim 24, wherein the ruled line tracking unit tracks the form ruled line by a Hough transform.   25. The form processing system according to claim 24, wherein the ruled line tracking unit tracks the form ruled line by a chain code. Form processing including a form processing device that extracts a seal image of a seal stamped in the seal stamping field from a form image of a form having a form provided with a seal stamping field, and a server that can communicate with the form processing device In the system,
The form processing apparatus includes:
A coordinate storage unit for storing coordinate data of a plurality of reference intersections composed of intersections of reference ruled lines of the form;
Corresponding to the reference intersection, a search unit that searches for an intersection of the seal column ruled line forming the seal stamp column in the form image as a seal column intersection,
A detection unit for detecting coordinate data of each searched seal column intersection;
A ruled line correction unit that converts the coordinate data of each detected seal column intersection detected into the coordinate data of each corresponding reference intersection, and corrects deformation of the seal column ruled line in the form image;
A plurality of points in the seal stamp field are set as stamp field interpolation points, and the coordinate data of each seal field interpolation point is converted based on the conversion of the coordinate data of the seal field intersection, thereby correcting deformation of the seal image An image correction unit to perform,
A communication unit that transmits to the server a corrected form image in which deformation of the seal column ruled line and the seal image is corrected,
The server
A server receiving unit for receiving the corrected form image from the form processing apparatus;
A server storage unit for storing the received correction form image;
A form processing system characterized by comprising:   The form processing apparatus comprises a personal computer, the form image is acquired by an image scanner connected to the personal computer, and communication between the form processing apparatus and the server is performed via the Internet. The form processing system according to claim 36.   The form processing apparatus includes a personal computer, the form image is acquired by a digital camera connected to the personal computer, and communication between the form processing apparatus and the server is performed via the Internet. The form processing system according to claim 36.   The form processing apparatus includes a mobile phone with a digital camera, the form image is acquired by the digital camera, and communication between the form processing apparatus and the server is performed via a wireless network. The form processing system according to claim 36. The form processing apparatus further includes a ruled line tracking unit that tracks the seal column ruled lines based on the plurality of seal column intersections searched by the search unit,
The coordinate storage unit further stores coordinate data of each point on the reference line, with a division point obtained by dividing any one of the reference ruled lines by a predetermined number of divisions as a point on the reference line, and the search unit further includes The dividing line obtained by dividing the seal column ruled line tracked by the ruled line tracking unit by the corresponding predetermined number of divisions is searched as a point on the seal column line, and the detection unit further searches for the point on the stamp column line. Coordinate data is detected, and the ruled line correction unit further converts the detected coordinate data of the points on the seal column line into coordinate data of the respective points on the reference line in the corresponding seal column stamping column, and the seal column The deformation of the ruled line is corrected, and the image correction unit further converts the coordinate data of each seal column interpolation point based on the conversion of the coordinate data of the points on the seal column line, thereby correcting the deformation of the seal image. It is characterized by performing Form processing system of claim 36, wherein.   In the form processing device, the point on the reference line stored in the coordinate storage unit is a division point obtained by equally dividing any of the reference ruled lines by a predetermined number of divisions, and the search unit includes the seal field 41. The form processing system according to claim 40, wherein a division point obtained by equally dividing the ruled line by the predetermined number of divisions is searched as the point on the seal column line.   In the form processing apparatus, the search unit further searches for an intersection of form ruled lines in the form image as a form intersection corresponding to the reference intersection point, and the detection unit further coordinates of the searched form intersection points. The data is detected, and the ruled line correction unit further converts the detected coordinate data of each form intersection into corresponding coordinate data of each reference intersection, and corrects the deformation of the form ruled line in the form image. The image correction unit further sets a plurality of points in the form image as form interpolation points, converts the coordinate data of each form interpolation point based on the conversion of the coordinate data of the form intersection, and generates the form image. The form processing system according to claim 36, wherein the deformation of the form is corrected. The form processing apparatus further includes a ruled line tracking unit that tracks the form ruled line based on the plurality of form intersections searched by the search unit,
The coordinate storage unit further stores coordinate data of each point on the reference line, with a division point obtained by dividing any one of the reference ruled lines by a predetermined number of divisions as a point on the reference line, and the search unit further includes A division point obtained by dividing the form ruled line tracked by the ruled line tracking unit by the corresponding predetermined number of divisions is searched as a point on the form line, and the detection unit further obtains coordinate data of the searched point on the form line. And the ruled line correction unit further converts the detected coordinate data of the points on the form line into coordinate data of the corresponding points on the reference line to correct deformation of the form ruled line, and the image correction unit 43. The form according to claim 42, further comprising: transforming the coordinate data of each form interpolation point based on the transformation of the coordinate data of the points on the form line to correct the deformation of the form image. Processing system .   In the form processing device, the point on the reference line stored in the coordinate storage unit is a division point obtained by equally dividing any of the reference ruled lines by a predetermined number of divisions, and the search unit is configured to use the form ruled line. 44. The form processing system according to claim 43, wherein a division point obtained by equally dividing the predetermined number of divisions is searched for as a point on the form line.   37. The form processing system according to claim 36, wherein in the form processing apparatus, the image correction unit converts coordinate data of the seal column interpolation point by affine transformation.   In the form processing apparatus, the image correction unit converts the coordinate data of the seal field interpolation point by triangulation affine transformation based on the three intersections or the line points located closest to the seal field interpolation point. 46. The form processing system according to claim 45.   37. The form processing system according to claim 36, wherein in the form processing apparatus, the image correction unit converts coordinate data of the seal column interpolation point by perspective conversion.   43. The form processing system according to claim 42, wherein in the form processing apparatus, the image correction unit converts coordinate data of the form interpolation point by affine transformation.   In the form processing apparatus, the image correction unit converts the coordinate data of the seal column interpolation point by triangulation affine transformation based on the three intersections or the line points located closest to the form interpolation point. 49. The form processing system according to claim 48.   43. The form processing system according to claim 42, wherein in the form processing apparatus, the image correction unit converts coordinate data of the form interpolation point by perspective transformation.   41. The form processing system according to claim 40, wherein in the form processing apparatus, the ruled line tracking unit tracks the seal stamp ruled line by Hough conversion.   41. The form processing system according to claim 40, wherein in the form processing apparatus, the ruled line tracking unit tracks the seal column ruled line by a chain code.   44. The form processing system according to claim 43, wherein in the form processing apparatus, the ruled line tracking unit tracks the form ruled line by a Hough transform.   44. The form processing system according to claim 43, wherein in the form processing apparatus, the ruled line tracking unit tracks the form ruled line using a chain code. In a form image correction method for correcting deformation of a form image of a form having a form provided with a seal stamp field,
Storing coordinate data of a plurality of reference intersections composed of intersections of reference ruled lines of the form;
Corresponding to the reference intersection, searching for the intersection of the seal column ruled line forming the seal stamp column in the form image as a seal column intersection,
Detecting coordinate data of the searched seal column intersection;
Converting the detected coordinate data of the seal column intersection into coordinate data of the corresponding reference intersection, and correcting deformation of the seal column ruled line in the form image;
A plurality of points in the seal stamp field are set as stamp field interpolation points, and the coordinate data of each seal field interpolation point is converted based on the conversion of the coordinate data of the seal field intersection, thereby correcting deformation of the seal image To do
A form image correction method characterized by comprising: In the form image correction method, further comprising tracking the seal field ruled line based on the searched seal field intersections,
Furthermore, the division point obtained by dividing any one of the reference ruled lines by a predetermined number of divisions is used as a reference line point, the coordinate data of each point on the reference line is stored, and the seal column tracked by the ruled line tracking unit Search the division points obtained by dividing the ruled line by the corresponding predetermined number of divisions as points on the seal column line, further detect the coordinate data of the searched points on the seal column line, and further on the detected seal column line The coordinate data of the points is converted into the coordinate data of the points on each reference line of the corresponding seal field stamping field, the deformation of the seal field ruled lines is corrected, and further based on the conversion of the coordinate data of the points on the seal field line The form image correction method according to claim 55, further comprising: converting the coordinate data of each of the seal column interpolation points to correct the deformation of the seal image.   In the form image correction method, the stored point on the reference line is a division point obtained by equally dividing any one of the reference ruled lines by a predetermined number of divisions, and the seal column ruled line is associated with the predetermined number of divisions. 57. The form image correction method according to claim 56, wherein the division points equally divided in step (b) are searched as points on the seal column line.   Further, corresponding to the reference intersection point, the intersection of the form ruled lines in the form image is searched as a form intersection point, the coordinate data of each searched form intersection point is further detected, and the detected coordinate data of each form intersection point is detected. Is converted to the coordinate data of the corresponding reference intersections, the deformation of the form ruled line in the form image is corrected, and a plurality of points in the form image are set as the form interpolation points, and the form intersection points 56. The form image correction method according to claim 55, wherein the form image correction is performed by converting the coordinate data of each form interpolation point based on the conversion of the coordinate data to correct the deformation of the form image. In the form image correction method, further comprising tracking the form ruled line based on the searched form intersections,
Further, the division rule obtained by dividing any one of the reference ruled lines by a predetermined number of divisions is used as a reference line point, the coordinate data of each point on the reference line is stored, and the form ruled line tracked by the ruled line tracking unit Is searched as a point on the form line, the coordinate data of the detected point on the form line is further detected, and the coordinate data of the detected point on the form line is further detected. The coordinate data of each point on the reference line is converted into the coordinate data of the corresponding point on the reference line, the deformation of the form ruled line is corrected, and the coordinate data of the interpolated point of each form is converted based on the conversion of the coordinate data on the point on the form line. 59. The form image correction method according to claim 58, wherein the deformation of the form image is corrected.   In the form image correction method, the stored point on the reference line is a division point obtained by equally dividing any of the reference ruled lines by a predetermined number of divisions, and the form ruled line is divided by the corresponding predetermined number of divisions. 60. The form image correction method according to claim 59, wherein equally divided division points are searched for as points on the form line.   56. The form image correction method according to claim 55, wherein the coordinate data of the seal column interpolation point is converted by affine transformation.   62. The form image according to claim 61, wherein the coordinate data of the seal column interpolation point is converted by triangulation affine transformation based on the three intersections or the linear points located closest to the seal column interpolation point. Correction method.   56. The form image correction method according to claim 55, wherein the coordinate data of the seal column interpolation point is converted by perspective conversion.   59. The form image correction method according to claim 58, wherein the coordinate data of the form interpolation point is converted by affine transformation.   65. The form processing apparatus according to claim 64, wherein the coordinate data of the seal column interpolation point is converted by triangulation affine transformation based on the three intersections or the linear points located closest to the form interpolation point. .   59. The form image correction method according to claim 58, wherein the coordinate data of the form interpolation point is converted by perspective conversion.   57. The form image correction method according to claim 56, wherein the stamp line ruled line is traced by Hough conversion.   57. The form image correction method according to claim 56, wherein the seal line ruled line is traced by a chain code.   60. The form image correction method according to claim 59, wherein the form ruled line is traced by Hough transform. 60. The form image correction method according to claim 59, wherein the ruled line tracking unit tracks the form ruled line using a chain code.

Images