JP2016126763A - Information processing system, and information processing method and program thereof - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a mechanism for improving the accuracy of an entry error check of a document for copying.SOLUTION: An information processing system for checking errors of documents of a copying source and a copying destination manages a recognition area and a recognition condition of a document and acquires the document as image data. Whether contents written in the recognition area included in the acquired image data are suitable to the recognition condition is checked by using the recognition area and the recognition condition. In the case that a document determined to have an error is specified to be a document of the copying destination, a check result obtained from the image data of the document of the copying source is outputted as a check result of the document of the copying destination.SELECTED DRAWING: Figure 6

Description

  The present invention relates to an information processing system, a processing method, and a program for performing an entry defect check.

  Conventionally, there is a mechanism in which form data is transmitted from a user terminal to a form server, the form server checks whether there are any deficiencies in the entered contents, and returns a check result to the user terminal. In addition, there is a copy form in which a plurality of forms are bundled and copied using the pen pressure as the type of form paper. In the copy form, the first form is called A piece, the second and subsequent forms are called B piece, C piece, D piece,.

  Patent Document 1 discloses an electronic processing system that performs all processing such as determination of contents of form data transmitted from a user terminal, error correction by an operator's operation, and creation of a processing result with a correction result message on the form server side. The technology is described.

JP-A-6-28275

  However, when the system configuration of Patent Document 1 is used to check the incompleteness of the copied form such as the B and C pieces of the copied form, the characters are blurred due to insufficient writing pressure, and "missing entry" or "reading error" There is a problem that it is determined.

  SUMMARY OF THE INVENTION An object of the present invention is to provide a mechanism for improving the accuracy of a check for deficiencies in a copy document.

  An information processing system for checking deficiencies of a copy source document and a copy destination document, a management unit that manages a recognition area and a recognition condition of the document, a capture unit that captures the document as image data, and the management Whether or not the content entered in the recognition area included in the image data captured by the capturing means conforms to the recognition condition using the recognition area and recognition conditions managed by the means Incompleteness check means for checking whether the image data captured by the capture means is a copy source document or a copy destination document, and the incompleteness check means. When the document that has been determined to be a copy destination document is specified by the document specifying means, the check result obtained from the image data of the copy source document is used as the check result of the copy destination document. The information processing system characterized in that it comprises a check result outputting means for outputting as a click results.

  ADVANTAGE OF THE INVENTION According to this invention, the structure which improves the precision of the check for deficiencies in the document for copying can be provided.

The figure which shows an example of a structure of the information processing system 100 of this invention. The figure which shows an example of the hardware constitutions of the information processing apparatus 101 Block diagram showing an example of the information processing apparatus 101 Flowchart showing an example of duplication check processing for a copy form Flow chart showing an example of entry deficiency check processing The figure which shows the example of the screen which copied the picked-up image (text part) of A piece to B piece The figure which shows the example of the screen which copied the picked-up image (circled part) of A piece to B piece The figure which shows an example of the screen which displays the deficiency check result (there is no deficiency) The figure which shows an example of the screen which displays the deficiency check result (there is deficiency) The figure which shows an example of the table which manages the form form The figure which shows an example of the table which manages a deficiency check recognition area and a deficiency check method The figure which shows an example of the table which manages a deficiency check result list The figure which shows an example of the table which manages the copy form relation 8 is a flowchart showing an example of a copy form entry deficiency check process in the information processing system 100 according to the second embodiment. FIG. 10 is a diagram showing an example of a copy form recognition difference display screen in the information processing system 100 according to the second embodiment. 9 is a flowchart showing an example of a copy form entry deficiency check process in the information processing system 100 according to the third embodiment. The figure which shows an example of the screen which identifies and displays the synthesized image in the entry defect check result display

[First Embodiment]
Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.
As illustrated in FIG. 1, the information processing system 100 according to the present embodiment has a configuration in which an information processing apparatus 101 and a server 102 are connected to be communicable via a network 103. The information processing apparatus 101 captures an image of a form using a camera or the like and performs a check for incomplete entry of the form. The server 102 manages the recognition area and recognition conditions of the entry contents necessary for checking the form entry defect for each form form identification information (hereinafter referred to as form ID).

In the present embodiment, the object to be checked for incompleteness is a form, but is not limited to a form, and may be other documents, characters, pictures, and the like.
The information processing apparatus 101 is a portable terminal such as a mobile phone, a smart phone, a tablet terminal, a notebook PC, and a PDA terminal, and a browser or an information processing system application is installed on the network 103 by wireless communication. And can communicate with the server 102.

Hereinafter, an example of a hardware configuration applicable to the information processing apparatus 101 illustrated in FIG. 1 will be described with reference to FIG.
In FIG. 2, reference numeral 201 denotes a CPU that comprehensively controls each device and controller connected to the system bus 204. Further, the ROM 203 or the external memory 212 is necessary to realize a BIOS (Basic Input / Output System) or an operating system program (hereinafter referred to as an OS), which is a control program of the CPU 201, or a function executed by each server or each PC. Various programs are stored.

  A RAM 202 functions as a main memory, work area, and the like for the CPU 201. The CPU 201 implements various operations by loading a program or the like necessary for execution of processing from the ROM 203 or the external memory 212 to the RAM 202 and executing the loaded program.

  An input controller 205 controls input from the touch sensor 210. A video controller 206 controls display on a display device such as the display 211. In FIG. 2, the display 211 is described, but the display may be not only a CRT but also other display such as a liquid crystal display. These are used by the user of the information processing apparatus 101 as necessary.

  A memory controller 207 is provided in an external storage device (hard disk (HD)), a flexible disk (FD), or a PCMCIA card slot for storing a boot program, various applications, font data, user files, editing files, various data, and the like. Controls access to an external memory 212 such as a compact flash (registered trademark) memory connected via an adapter.

  A communication I / F controller 208 is connected to and communicates with an external device via the network 103, and executes communication control processing on the network. For example, communication using TCP / IP is possible.

  Note that the CPU 201 enables display on the display 211 by, for example, executing outline font rasterization processing on a display information area in the RAM 202. In addition, the CPU 201 can accept a user's touch operation instruction on the touch sensor 210 on the display 211.

Various programs to be described later for realizing the present invention are recorded in the external memory 212, and are executed by the CPU 201 by being loaded into the RAM 202 as necessary. Further, definition files, map data, and the like used when executing the program are also stored in the external memory 212, and detailed descriptions thereof will be described later.
A captured image input controller 209 controls input from the camera 215 via the captured image input processing unit 214. A captured image input from the camera 215 can be recognized.

FIG. 3 is a block diagram illustrating an example of a functional configuration of the information processing system 100.
The recognition condition storage unit 301 is a functional unit that stores recognition conditions for each area of a document.
The capturing unit 302 is a functional unit that captures a document as image data.

The entry defect check unit 303 is a functional unit that checks the document area for defect in accordance with the image data captured by the capture unit 302 and the recognition conditions stored in the recognition condition storage unit 301.
The document identification unit 304 is a functional unit that identifies whether the image data captured by the capture unit 302 is a copy source document or a copy destination document.

  The check result output unit 305 is obtained from the image data of the copy source document when the document specified by the deficiency check unit 303 determines that the document is a copy destination document by the document specifying unit 304 This is a functional unit that outputs the check result as the check result of the copy destination document.

The check result output unit 305 uses the check result of the document specified by the document specification unit 304 and checked by the entry defect check unit 303 as the copy destination by the document specification unit 304. This is a functional unit that outputs the specified document as a check result.
The image output unit 306 is a functional unit that outputs the check result by the entry defect check unit 303 as an image using the image data captured by the capture unit 302.

  The image output unit 306 uses the image data of the copy source document when the document determined to be deficient by the deficiency check unit 303 is identified as the copy destination document by the document specifying unit 304. And a functional unit that outputs a document that is determined to be deficient.

  Further, when outputting the document determined to be deficient using the image data of the copy source document, the image output unit 306 identifies and displays the portion using the image data of the copy source document. It is a functional part that

  In addition, when the document determined to be deficient by the entry deficiency check unit 303 is identified as a copy destination document by the document specifying unit 304, the image output unit 306 determines the image data of the copy destination document as It is a functional unit that outputs the image data of the copy source document side by side.

  When the document determined to be deficient by the deficiency check unit 303 is identified as the copy destination document by the document identification unit 304, the selection receiving unit 307 outputs the image using the image data of the copy source document. It is a functional unit that accepts selection of whether or not to do.

  Further, when the document determined to be deficient by the entry deficiency check unit 303 is identified as a copy destination document by the document identification unit 304, the capture unit 302 captures the copy source document as image data. It is a functional part.

FIG. 4 is a flowchart showing an example of a copy form entry defect check process. In the following, the process for checking the incompleteness of the copy form will be described with reference to FIG.
In step S <b> 401, the CPU 201 of the information processing apparatus 101 receives a login to the information processing system 100 performed by a user of the information processing system 100. Note that the form application serving as the user interface in this copy form entry defect check process may be an application installed in the information processing apparatus 101 or an application such as a Web application displayed on the browser. .

  In step S <b> 402, the CPU 201 of the information processing apparatus 101 captures a plurality of forms to be checked for deficiencies using the camera 215, and stores the captured images (hereinafter referred to as captured images) in the external memory 212. In this embodiment, the captured image is obtained using the camera 215 of the information processing apparatus 101. However, the information processing apparatus displays an image captured using a digital camera or an image scanned using a scanner. 101 may be taken in. That is, step S402 is a step showing an example of processing for taking a document as image data.

  In step S403, the CPU 201 of the information processing apparatus 101 searches all records in the form table 1000 (FIG. 10), and extracts the form image extracted from the external memory 212 using the file path stored in the “form image” column. By comparing the captured images, the form form identification information of the form form to be checked for deficiencies is specified. This identification process is performed for all the captured images.

  Specifically, the form image extracted from the external memory 212 is compared with the photographed image, and if the images match at a rate equal to or greater than a predetermined value, the photographed image is a form form of the form image extracted from the external memory 212. The form form identification information of the determined and photographed form is specified as the form form identification information corresponding to the form image matched in the image comparison.

  It should be noted that the images used for this image comparison may be compared without being processed, or image comparison may be performed after image processing such as extracting contours in order to increase the accuracy of image comparison. At that time, the form IDs of all the records in the form table 1000 are listed and stored in the RAM 202.

  In this embodiment, the form form to be checked for deficiencies is identified by comparing the captured image with the form image obtained in advance. However, the present invention is not limited to this method, and the form ID is not limited to this form. Alternatively, a method may be used in which a bar code or a number is recorded, and the captured image is analyzed to identify the form ID of the captured image. In the present embodiment, it is assumed that “shopping credit application form A piece” with form ID = 2001 and “shopping credit application form B piece” with form ID = 2002 are specified from the captured images of two forms.

  In step S404, the CPU 201 of the information processing apparatus 101 rearranges the captured images so that the entry defect check process performed in step S405 is performed in the order of the copy source and the copy destination. Specifically, when the form ID of the form specified in step S403 is the first photographed image = 2002 and the second photographed image = 2001, the incomplete entry check process is performed in the order of the copy source and the copy destination. , 2001 and 2002.

  In this embodiment, by simply arranging in the ascending order of the form IDs, the copy source and the copy destination are arranged in order (see the copy form related table 1300). Otherwise, the copy form related table 1300 (see FIG. 13), it is determined whether it is a copy form. If it is a copy form, it is rearranged in the order of copy source and copy destination.

  In step S405, the CPU 201 of the information processing apparatus 101 performs an entry defect check process (FIG. 5). In other words, step S405 is a step showing an example of processing for checking the deficiency of the document area in accordance with the captured image data and recognition conditions. Also, step S405 is an example of processing for checking whether the content entered in the recognition area included in the captured image data matches the recognition condition using the recognition area and the recognition condition. It is a step which shows. Here, the incomplete entry check process of FIG. 5 will be described.

FIG. 5 is a flowchart illustrating an example of the entry defect check process.
FIG. 11 is an example of a table for managing a deficiency check recognition area and a deficiency check method for each form. The entry defect check table 1100 (FIG. 11) includes a form ID, a check ID assigned to the check location, recognition conditions for entry defect check, start coordinates (X, Y) and end point coordinates (X, Y) of the entry defect check recognition area. Is remembered.

  In this embodiment, in the entry defect check table 1100, the entry defect check recognition area at the same position in the copy source and the copy destination has the same check ID, but the check ID may not be limited to the same value. . In that case, in step S409, which will be described later, it is not determined that the check entry is the same entry deficiency check recognition area, but records with the same recognition conditions, start point coordinates, and end point coordinates are recognized at the copy source and copy destination. It may be determined as an area.

  The entry defect check table 1100 is a table created and maintained by the system administrator as form definition information (form form identification information, entry content recognition area and recognition conditions) used in the information processing system 100. That is, the incomplete entry check table 1100 is an example of a unit that stores recognition conditions for each area of a document. The incomplete entry check table 1100 is an example of a means for managing the recognition area and the recognition condition of the document.

In step S501, the CPU 201 of the information processing apparatus 101 searches the entry defect check table 1100 using the form ID = form ID of the photographed image specified in step S403 as a search key, and acquires an entry defect check record.
In step S <b> 502, the CPU 201 of the information processing apparatus 101 assigns 1 to the variable i and stores it in the RAM 202.

In step S503, the CPU 201 of the information processing apparatus 101 starts from the i-th entry deficiency check record, the starting point (X coordinate, Y coordinate) and end point (X coordinate, Y coordinate) of the entry deficiency check recognition area, and the entry deficiency check recognition condition. To get.
In step S504, the CPU 201 of the information processing apparatus 101 determines the value of the entry defect check recognition condition.

  If the entry deficiency check recognition condition in step S504 is “essential”, it is an input-required item, and in step S505, the check recognition area of the photographed image (rectangular area having two starting and ending points as diagonal points) is displayed. It is determined whether characters or symbols are entered. This determination process uses an analysis technique such as OCR, but since it is a known technique, a description thereof will be omitted.

In step S505, if the CPU 201 of the information processing apparatus 101 determines that characters or symbols have been entered, in step S506, “OK” is substituted for the variable result [i] that stores the check result in the RAM 202. To do.
If it is determined in step S505 that no character or symbol is entered, “NG” is substituted for variable result [i] in step S507.

  If the deficiency check recognition condition in step S504 is “circle”, it is an item that encloses one of a plurality of options with a circle, and therefore in step S508, the check recognition area (start point / end point 2) of the photographed image is displayed. It is determined whether or not a circle is entered in a rectangular area having a diagonal point. This determination process uses an analysis technique such as OCR, but since it is a known technique, a description thereof will be omitted. In the present embodiment, the presence / absence of a circle is determined. However, the present invention is not limited to the circle, and a check of a check point or other figure may be used.

  In the above description, the number of circles is “1”. However, an “upper limit value” or “check number” column is provided in the entry defect check table 1100, and “NG” is exceeded when the upper limit value is exceeded. May be determined as “NG” when the number is not “the number of checks”.

  In addition, a “digits” column is provided in the incomplete entry check table 1100, and “OK” is determined if the number of characters entered is permitted, and “NG” is determined if the number is not permitted. Good. Further, a “character attribute” column may be provided in the entry defect check table 1100, and OK / NG determination may be made based on the attribute of the entered character, for example, “number”, “hiragana”, “katakana”, “alphanumeric character”, and the like. .

  Further, when the entered character cannot be recognized as a result of analysis by OCR or the like, it may be determined as “NG”. Further, the value of the variable result [i] is not limited to two, “OK” and “NG”, and may have values such as “unclear”, “unrecognizable”, and “contradiction”.

  If the CPU 201 of the information processing apparatus 101 determines in step S508 that a circle has been entered, it substitutes “OK” for the variable result [i] in step S509.

  If the CPU 201 of the information processing apparatus 101 determines in step S508 that no circle has been entered, it substitutes “NG” for the variable result [i] in step S510.

In step S511, the CPU 201 of the information processing apparatus 101 registers a result value, which is a check result, in the entry defect check result table 1200 (FIG. 12). More specifically, a deficiency check record is created using the system date, the form ID of the captured image identified in step S403, the variable i, and the value of the variable result [i], and is registered in the deficiency check result table 1200. .
In step S512, the CPU 201 of the information processing apparatus 101 increments the variable i.

  In step S513, the CPU 201 of the information processing apparatus 101 determines whether there is an incomplete check record with check ID ≧ i. If it does not exist, the incomplete entry check process is terminated. If it exists, the minimum check ID existing in i is set, and the process returns to step S503.

  The description of the entry defect check process in FIG. By this processing, the entry defect check result corresponding to the form ID of the photographed image is stored in the entry defect check result table 1200.

Returning to the description of the entry defect check process in FIG.
In step S406, the CPU 201 of the information processing apparatus 101 determines whether NG exists in the check result of the captured image. Specifically, using the form ID = form ID of the photographed image specified in step S403 and the result = NG as a search key, the entry defect check result table 1200 is searched to determine whether or not the record is hit. In addition, it is stored in the RAM 202 as a record entry check result record that has been hit.

  If it is determined in step S406 that NG does not exist, in step S407, the CPU 201 of the information processing apparatus 101 uses the corresponding captured image and a message “There was no deficiency in entry.” Was written. A deficiency check result screen (no deficiency) 800 (FIG. 8) is displayed. The entry deficiency check result screen (no deficiency) 800 is an example of a screen for displaying the entry deficiency check result, and is a case where there is no entry deficiency. “There was no incomplete entry” is displayed at the top of the screen, and the form shot image is displayed below it.

  If it is determined in step S406 that NG exists, it is determined in step S408 whether the captured image is a copy destination form. That is, step S408 is a step showing an example of processing for specifying whether the captured image data is a copy source document or a copy destination document.

  Specifically, the form ID = the form ID of the photographed image specified in step S403 is used as a search key to search the copy destination form ID 1302 column of the copy form related table 1300 (FIG. 13). It is determined that the photographed image is a copy destination form, and the process proceeds to step S409. If the record does not hit, it is determined that the form is not a copy destination form, and the process proceeds to step S413. The hit copy form-related record is stored in the RAM 202.

  In step S409, the CPU 201 of the information processing apparatus 101 determines whether or not the check recognition area of the result NG of the copy destination is the result OK at the copy source. If the result is OK at the copy source, the process proceeds to step S410. If the result is OK at the copy source, the process proceeds to step S413.

  Specifically, form ID = copy source form ID of copy form related record stored in RAM 202 in step S408, check ID = check ID of entry defect check result record stored in RAM 202 in step S406, as search keys. The entry deficiency check result table 1200 is searched, and it is determined whether or not the value of the result column of the hit entry deficiency check result record is OK.

In step S410, the CPU 201 of the information processing apparatus 101 copies the copy source image to the copy destination for the check recognition area of copy source = result OK & copy destination = result NG. Specifically, the entry deficiency check table 1100 is searched using the form ID of the (copy destination) photographed image and the check ID of the entry deficiency check result record stored in the RAM 202 in step S406 as a search key, and the origin coordinates (X, Y) and end point coordinates (X, Y) are acquired. Thereafter, an image extracted from the copy source photographed image as a rectangle having the start point coordinates (X, Y) and the end point coordinates (X, Y) as diagonal lines is combined with the rectangular portion of the same coordinates of the (copy destination) photographed image. .
Specific examples of the image composition processing in step S410 are shown in FIGS.

  FIG. 6 is a diagram showing an example of a screen in which a text portion of a photographed image of A piece (copy source) is copied to B piece (copy destination). If the “mandatory NG” area 621 in the B piece photographed image 620 and the area 611 at the same position in the A piece photographed image 610 are “mandatory OK”, the image in the area 611 is overwritten on the area 621.

FIG. 7 is a diagram showing an example of a screen in which a circled portion of a shot image of A piece (copy source) is copied to B piece (copy destination). If the “circled NG” area 721 in the B shot image 720 and the area 711 at the same position in the A shot image 710 are “circled OK”, the image in the area 611 is overwritten on the area 621. To do.
As described above, the copy source image is used in the recognition area that is not filled in in the copy destination document, so that unclear portions in the image of the copy destination document can be reduced.

  In step S411, the CPU 201 of the information processing apparatus 101 sets the copy destination check result to OK for the check recognition area of copy source = result OK & copy destination = result NG. Specifically, the form defect check result table using the form ID = form ID of the (copy destination) photographed image and check ID = check ID of the record defect check result record stored in the RAM 202 in step S406 as a search key. 1200 is searched, and the value of “result” in the hit memory deficiency check result record is updated from NG to OK. As described above, it is possible to improve the accuracy of the check for deficiencies in the copy document.

  In this embodiment, the check result of the copy destination photographed image is updated to OK in step S411. However, the present invention is not limited to this method, and a new copy destination created by combining in step S410 is created. The memory deficiency check may be performed again using the photographed image.

  In step S412, the CPU 201 of the information processing apparatus 101 determines whether or not NG exists in the check result of the captured image. If it is determined that there is no NG, the process proceeds to step S407, and if it is determined that NG exists. Advances to step S413. Specifically, using the form ID = form ID of the photographed image specified in step S403 and the result = NG as a search key, the entry defect check result table 1200 is searched to determine whether or not the record is hit.

  In step S413, the CPU 201 of the information processing apparatus 101 uses the captured image to display an incomplete entry check result screen (incomplete) 900 (FIG. 9) in which a message “Incomplete entry” is written.

  In step S414, the CPU 201 of the information processing apparatus 101 searches the entry defect check table (client) 1310 using the form ID = form ID of the photographed image and the result = NG as a search key, and starts the coordinates of the entry defect check recognition area ( X, Y) and end point coordinates (X, Y) are acquired, and a rectangle with the start point coordinates (X, Y) and end point coordinates (X, Y) of the acquired entry defect check recognition area as diagonals is displayed on the captured image. Draw and fill in red. Thereby, it is possible to display an incompletely filled area in an identifiable manner.

  The incomplete entry portion 901 is not limited to red filling, but may be any display that can be identified by the user, such as filling with a color other than red, surrounding with a frame, blinking, enlargement, and color reversal display. Good. Moreover, the display is not limited to the display that can be identified, and a voice identification method such as reading out a deficient entry by voice may be used.

  In other words, when it is determined that the document determined to be deficient is the copy destination document, step S407 and step S413 indicate the check result obtained from the image data of the copy source document as the copy destination document. It is a step which shows an example of the process output as a check result.

Steps S407 and S413 are steps showing an example of processing for outputting the check result of the document specified as the copy destination using the check result of the document specified as the copy source.
Steps S407 and S413 are steps showing an example of processing for outputting the check result as an image using the captured image data.

In step S407 and step S413, if the document determined to be deficient is identified as the copy destination document, the document determined to be deficient using the image data of the copy source document. It is a step which shows an example of the process which outputs.
Note that steps S405 to S414 are repeated for the number of captured images.
This is the end of the description of the entry defect check process in FIG.

As a result, the result of the check for deficiencies in the photographed image is displayed on the display 211.
As described above, it is possible to improve the accuracy of the check for deficiencies in the copy document. Further, by using the copy source image in the recognition area that is not filled in in the copy destination document, it is possible to reduce unclear portions in the image of the copy destination document.

[Second Embodiment]
The first embodiment is a mechanism for outputting the check result of the copy source (A piece) as the check result of the copy destination (B piece), and the second embodiment is the check result of the copy source (A piece). The copy destination (B piece) check results are output side by side, and the user selects whether to output the copy source (A piece) check results as the copy destination (B piece) check results.

FIG. 14 is a flowchart showing an example of a copy form entry deficiency check process in the information processing system 100 according to the second embodiment. FIG. 15 is a diagram illustrating an example of a copy form recognition difference display screen in the information processing system 100 according to the second embodiment. In the second embodiment, the flowchart of FIG. 4 in the first embodiment is replaced with FIG. 14, and the same process as the step of the first embodiment is assigned the same step number and the description is omitted.
The second embodiment will be described with reference to FIGS. 14 and 15.

  In step S1401, the CPU 201 of the information processing apparatus 101 displays the copy source captured image and the copy destination captured image side by side (FIG. 15). That is, in step S1401, when it is determined that a document determined to be deficient is a copy destination document, the image data of the copy destination document and the image data of the copy source document are output side by side. It is a step which shows an example.

  Specifically, like the recognition difference display screen 1500, the check recognition area 1501 of the copy source result OK and the check recognition area 1502 of the copy destination result NG are arranged, surrounded by a frame, enlarged, and the like. To display. Also, the recognition difference display screen 1500 displays a “button 1503 for copying an A piece image to a B piece deficient location” and a “button 1504 for re-photographing” for the user to press.

  In step S1402, the CPU 201 of the information processing apparatus 101 accepts a button press by the user. If it is accepted that the “button 1503 for copying the A piece image to the B piece deficient location” has been pressed, the process proceeds to step S410, and the copy source image is copied to the copy destination to be combined. If it is accepted that the “re-photographing button 1504” is pressed, the process returns to step S402 to perform re-photographing.

  That is, step S1402 is an example of processing for accepting selection of whether to output using image data of a copy source document when a document determined to be deficient is identified as a copy destination document. It is a step which shows.

  Thus, the user can compare the check result of the copy source with the check result of the copy destination, and whether or not to output the check result of the copy source (A piece) as the check result of the copy destination (B piece). The user can select.

[Third Embodiment]
The first embodiment is a mechanism for performing an imperfect check after photographing the copy source (A piece) and the copy destination (B piece), and the third embodiment photographs the copy destination (B piece). This is a mechanism for checking the deficiency of entry and checking the deficiency of entry by photographing the copy source (A piece) when there is an entry deficiency in the copy destination (B piece).

  This is because in this embodiment, the image of the copy destination (B piece) is an image that should be stored by the company using the information processing system 100, as “Our copy” is written in 620 of FIG. is there. Therefore, if the image to be stored by the company using the information processing system 100 is the copy source (A piece), the copy source (A piece) is photographed to check the deficiency of entry, and the copy source (A If there is an entry deficiency in the piece, a copy destination (B piece) is photographed to check the entry deficiency.

FIG. 16 is a flowchart showing an example of a copy form entry defect check process in the information processing system 100 according to the third embodiment. In the third embodiment, the flowchart of FIG. 4 in the first embodiment is replaced with FIG. 16, and the same process as the step of the first embodiment is given the same step number and the description is omitted.
A third embodiment will be described with reference to FIG.

  In step S <b> 1601, the CPU 201 of the information processing apparatus 101 captures a form for performing an incompleteness check using the camera 215, and stores the captured image in the external memory 212. In this embodiment, the captured image is obtained using the camera 215 of the information processing apparatus 101. However, the information processing apparatus displays an image captured using a digital camera or an image scanned using a scanner. 101 may be taken in. That is, step S1601 is a step showing an example of processing for taking a document as image data.

  In step S402 of the first embodiment, the copy source (A piece) and the copy destination (B piece) are photographed. However, in step S1601 of the third embodiment, the copy destination (B piece) is taken. ) Take only the form.

In step S1602, the CPU 201 of the information processing apparatus 101 determines whether there is a copy destination form in the image captured in step S1601. If yes, the process proceeds to step S1603. If not, the process returns to step S1601. This process is the same as the process of step S408 in the first embodiment. That is, step S1602 is a step showing an example of processing for specifying whether the captured image data is a copy source document or a copy destination document.

  In step S1603, the CPU 201 of the information processing apparatus 101 performs an incomplete entry check process (FIG. 5) for the photographed image determined to be the copy destination form. That is, step S1603 is a step showing an example of a process for checking the deficiency of the document area in accordance with the captured image data and recognition conditions.

In step S1604, the CPU 201 of the information processing apparatus 101 determines whether there is a copy source form in the image captured in step S1601. If yes, the process proceeds to step S1606. If not, the process proceeds to step S1605. This process is the same as step S408 in the first embodiment. That is, step S1604 is a step showing an example of processing for specifying whether the captured image data is a copy source document or a copy destination document.

  In step S <b> 1605, the CPU 201 of the information processing apparatus 101 uses the camera 215 to capture a copy source form that is checked for entry defects, and stores the captured image in the external memory 212. That is, step S1605 is a step showing an example of processing for fetching a copy source document as image data when a document determined to be deficient is identified as a copy destination document.

  In step S <b> 1606, the CPU 201 of the information processing apparatus 101 performs a deficiency check process (FIG. 5) on the copy source captured image acquired in step S <b> 1605. In other words, step S1606 is a step showing an example of processing for checking the deficiency of the document area in accordance with the captured image data and recognition conditions.

  As described above, if there is an incomplete entry at the copy destination, the copy source is photographed and the entry incompleteness check is performed. Therefore, if there is no entry incomplete at the copy destination, the image of the copy source can be omitted.

  Finally, FIG. 17 will be described. FIG. 17 is a diagram illustrating an example of a screen for identifying and displaying an image synthesized in the entry defect check result display. FIG. 17 is a screen displayed in steps S407 and S413 of the first to third embodiments.

  When the images are combined in step S410 of FIGS. 4, 14, and 16, the combined image is displayed as surrounded by a frame as indicated by 1701 in FIG. 17, and is displayed as indicated by 1702 in FIG. A balloon is displayed in the vicinity of 1701 so that the user can identify the synthesized part. Note that the display 1701 is not limited to the frame display, and may be any display that can be identified by the user, such as blinking, enlargement, and color reversal display.

  In order to display 1701 in FIG. 17, in step S410, the start point coordinates (X, Y) and end point coordinates (X, Y) of the synthesized image are stored in the RAM 202, and from the RAM 202 in steps S407 and S413. A frame is displayed by acquiring and using the coordinates.

That is, steps S407 and S413 identify and display a portion using the image data of the copy source document when outputting the document determined to be deficient using the image data of the copy source document. It is a step which shows an example of the process to perform.
As described above, the user can identify that the copy source image is used as the copy destination document image.

  In the above description, it is described that the information processing apparatus 101 performs all processing. However, the present invention is not limited to this, and the information processing apparatus 101 executes steps S401 to 402, step S407, and steps S413 to 414. However, the information processing apparatus 101 or the server 102 may perform other processes. The same applies to the first to third embodiments.

  When the server 102 performs the form specifying process in step S403, the server 102 manages the form table 1000. Similarly, when the server 102 performs the entry deficiency check process in step S405, the server 102 manages the entry deficiency check table 1100 and the entry deficiency check result table 1200. However, even in that case, the incomplete entry check table 1100 and the incomplete entry check result table 1200 are also managed by the information processing apparatus 101 in order to execute step S414.

  The records of the form table 1000, the incomplete entry check table 1100, and the copy form related table 1300 are registered by the administrator of the information processing system 100, and maintenance is performed each time a form is added or changed. To do. The records in these tables are managed by the server 102 and downloaded to the information processing apparatus 101 as necessary or periodically.

  As described above, a recording medium that records a program that implements the functions of the above-described embodiments is supplied to a system or apparatus, and a computer (or CPU or MPU) of the system or apparatus stores the program stored in the recording medium. It goes without saying that the object of the present invention can also be achieved by reading and executing.

  In this case, the program itself read from the recording medium realizes the novel function of the present invention, and the recording medium recording the program constitutes the present invention.

  As a recording medium for supplying the program, for example, a flexible disk, hard disk, optical disk, magneto-optical disk, CD-ROM, CD-R, DVD-ROM, magnetic tape, nonvolatile memory card, ROM, EEPROM, silicon A disk or the like can be used.

  Further, by executing the program read by the computer, not only the functions of the above-described embodiments are realized, but also an OS (operating system) operating on the computer based on an instruction of the program is actually It goes without saying that a case where the function of the above-described embodiment is realized by performing part or all of the processing and the processing is included.

  Furthermore, after the program read from the recording medium is written to the memory provided in the function expansion board inserted into the computer or the function expansion unit connected to the computer, the function expansion board is based on the instructions of the program code. It goes without saying that the case where the CPU or the like provided in the function expansion unit performs part or all of the actual processing and the functions of the above-described embodiments are realized by the processing.

  The present invention may be applied to a system constituted by a plurality of devices or an apparatus constituted by a single device. Needless to say, the present invention can be applied to a case where the present invention is achieved by supplying a program to a system or apparatus. In this case, by reading a recording medium storing a program for achieving the present invention into the system or apparatus, the system or apparatus can enjoy the effects of the present invention.

  The form of the program may be in the form of object code, program code executed by an interpreter, script data supplied to an OS (operating system), and the like.

DESCRIPTION OF SYMBOLS 100 Information processing system 101 Information processing apparatus 102 Server 103 Network

Claims (10)

An information processing system for checking a deficiency of a copy source document and a copy destination document,
Management means for managing the recognition area and recognition conditions of the document;
Capture means for capturing the document as image data;
Using the recognition area and the recognition condition managed by the management means, the content written in the recognition area included in the image data captured by the capture means conforms to the recognition condition. A deficiency check means to check whether or not,
A document specifying unit for specifying whether the image data captured by the capturing unit is a copy source document or a copy destination document;
When the document determined to be deficient by the deficiency check means is identified as the copy destination document by the document identification means, the check result obtained from the image data of the copy source document is used as the copy result. An information processing system comprising check result output means for outputting a check result of a previous document. The check result output means includes:
Using the check result of the document specified as the copy source by the document specifying means, checked by the entry defect check means, and output as the check result of the document specified as the copy destination by the document specifying means The information processing system according to claim 1, wherein: Using the image data captured by the capture means, an image output means for outputting the check result by the entry defect check means as an image,
The image output means includes
If the document determined to be deficient by the deficiency check means is identified as a copy destination document by the document specifying means, it is determined that the deficiency is present using image data of the copy source document. The information processing system according to claim 1, wherein the processed document is output. The image output means includes
2. When outputting a document determined to be deficient using image data of the copy source document, a portion using the image data of the copy source document is identified and displayed. 3. The information processing system according to 3. The image output means includes
If the document determined to be deficient by the deficiency check means is identified as the copy destination document by the document identification means, the image data of the copy destination document and the image data of the copy source document The information processing system according to claim 3 or 4, wherein the information is output side by side. Whether or not the document determined to be deficient by the deficiency check means is output using image data of the copy source document when the document specifying means specifies that the document is a copy destination document The information processing system according to claim 1, further comprising selection receiving means for receiving a selection. The capturing means includes
The document of the copy source is fetched as image data when the document determined to be deficient by the deficiency check means is identified as a copy destination document by the document specifying means. The information processing system according to any one of 1 to 6.   The information processing system according to claim 1, wherein the information processing system is a mobile terminal. A processing method in an information processing system comprising management means for managing a recognition area and recognition conditions of a document, and checking for incompleteness of the document at a copy source and a copy destination,
The information processing system is
A capturing step of capturing the document as image data;
Using the recognition area and the recognition condition managed by the management means, the content entered in the recognition area included in the image data captured by the capture step conforms to the recognition condition. A deficiency check step to check whether or not,
A document specifying step for specifying whether the image data captured in the capturing step is a copy source document or a copy destination document;
When the document determined to be deficient by the deficiency check step is identified as the copy destination document by the document specifying step, the check result obtained from the image data of the copy source document is used as the copy result. And a check result output step of outputting the check result of the previous document as a check result. A program that can be executed by an information processing system that includes a management unit that manages a recognition area and a recognition condition of a document, and that checks for deficiencies in the copy source and copy destination documents;
The information processing system;
Capture means for capturing the document as image data;
Using the recognition area and the recognition condition managed by the management means, the content written in the recognition area included in the image data captured by the capture means conforms to the recognition condition. A deficiency check means to check whether or not,
A document specifying unit for specifying whether the image data captured by the capturing unit is a copy source document or a copy destination document;
When the document determined to be deficient by the deficiency check means is identified as the copy destination document by the document identification means, the check result obtained from the image data of the copy source document is used as the copy result. A program that functions as a check result output unit that outputs a check result of a previous document.

Images