JP6826293B2 - Information information system and its processing method and program - Google Patents

Description

The present invention relates to an information processing system for notifying an incompleteness of a read document, and a processing method and program thereof.

Conventionally, there is a mechanism to read a completed document with a terminal, check for deficiencies, and display the check result.

Patent Document 1 describes a technique of an electronic processing system that checks the contents of application data and determines an unacceptable error such as a format error or omission of entry of an item.

Japanese Unexamined Patent Publication No. 6-28275

However, in the system configuration of Patent Document 1, there is a problem that even if there is a missing document in the read document, it cannot be detected in a plurality of documents (a document over a plurality of sheets). In addition, since batch reading of multiple documents, multiple types of documents, documents by multiple customers, or documents in which these documents are mixed is not considered, even when these documents are mixed, the user can fill in the documents incorrectly. There is a problem of notifying.

Specific examples of a plurality of documents (a document covering a plurality of sheets) include a life insurance and mortgage application form having many items to be filled in.

Further, as a specific example of a document by a plurality of customers, it is possible to read a plurality of shopping credit application forms, etc. filled out by each customer at once in a shopping center or an exhibition hall with a large number of customers. For example, after filling out a plurality of documents (a plurality of documents) for one application, the receptionist may read the plurality of documents at once and check for deficiencies. In the deficiency check result display, it is desired to display the check results in descending order of the number of deficiencies from the viewpoint that the document having the largest number of deficiencies is to be corrected first.

On the other hand, in consideration of processing efficiency, application forms of multiple customers may be read at once and checked for deficiencies. When the documents of multiple applicants are read, it is necessary to notify the check result after considering the order of the customers who submitted the application forms.

In addition, when a plurality of customers submit a plurality of types of documents, it is difficult to appropriately notify the check result in order to reduce the waiting time of the applicant. In particular, when a document of a plurality of customers is read, it is necessary to notify the check result after considering the order of the customers who submitted the document.

Also, if there is a document that you forgot to read out of multiple documents (multiple documents), you may be asked to fill in the document that you forgot to read, so it is better than other documents. It is desirable to notify first. In addition, when the customer corrects the deficiency after checking the deficiency and performs the deficiency check again, it is expected that the number of deficiencies is naturally small, and if the check result is notified in order from the document with the largest number of deficiencies, the customer who corrected the deficiency is notified. Since it will make you wait for a long time, it is desirable to give priority to customers who carry out checks frequently.

Therefore, an object of the present invention is to provide a mechanism for efficiently notifying a defective document from a plurality of read documents.

An information processing system including an information processing device for controlling image data, wherein the information processing device is a combination information of an acquisition means for acquiring image data of a set of documents and a plurality of forms in the set of documents . If, based on the foam obtained from the image data acquired by the acquisition unit, and a checking means for checking whether there is image data down missing among a plurality of sets of documents, based on the check result by the check means Information processing including an output means for outputting a check result of a set of documents lacking image data so that a set of documents lacking image data is preferentially confirmed. system.

According to the present invention, it is possible to provide a mechanism for efficiently notifying a defective document from a plurality of read documents.

The figure which shows an example of the structure of the document system 100 of this invention The figure which shows an example of the hardware composition of the information processing apparatus 101 Block diagram showing an example of the information processing apparatus 101 and the server 102 A flowchart showing an example of a process in which the information processing apparatus 101 acquires a check result of entry deficiency from the server 102. Flowchart showing an example of entry deficiency check processing performed on server 102 Diagram showing an example of processing image in the case of multiple applications by one applicant Diagram showing an example of processing image in the case of multiple applications by multiple applicants The figure which shows an example of the screen which displays the entry defect check result list in the information processing apparatus 101. The figure which shows an example of the screen which displays the entry deficiency check result (there is deficiency) in the information processing apparatus 101. The figure which shows an example of the screen which displays the entry deficiency check result (no deficiency) in the information processing apparatus 101. The figure which shows an example of the table which manages a document form in a server 102 The figure which shows an example of the table which manages the entry deficiency check recognition area and deficiency check method for each form in server 102. The figure which shows an example of the table which manages the entry deficiency check result list for each form in information processing apparatus 101. Diagram showing an example of processing image when multiple applicants do not consider the number of deficiency checks In the second embodiment, a diagram showing an example of a processing image when a plurality of applicants consider the number of deficiency checks. A flowchart showing an example of a process in which the information processing apparatus 101 according to the second embodiment acquires a check result of entry deficiency from the server 102. The figure which shows an example of the screen which displays the entry defect check result list in the information processing apparatus 101 which concerns on 2nd Embodiment. The figure which shows an example of the table which manages the document form in the server 102 which concerns on 2nd Embodiment The figure which shows an example of the table which manages the entry deficiency check result list for every form in the information processing apparatus 101 which concerns on 2nd Embodiment.

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

As shown in FIG. 1, the document system 100 has a configuration in which the information processing device 101 and the server 102 are communicably connected by the network 103 in the present embodiment. The information processing device 101 captures an image of a document using a camera or the like, and checks for deficiencies in the document entry. The server 102 manages the recognition area and the recognition condition of the entry contents necessary for checking the entry deficiency of the document for each document form identification information. The information processing device 101 is a portable terminal such as a mobile phone, a smartphone, a tablet terminal, a notebook PC, and a PDA terminal, and an application of a browser or a document system is installed in the information processing device 101, and a network 103 is installed by wireless communication or wired communication. It is possible to communicate with the server 102 via.

In the present embodiment, the information processing device 101 and the server 102 communicate with each other to check for deficiencies and display the result. However, the information processing device 101 has all the functions of the server 102 in the present embodiment. The present invention can be carried out without the server 102. However, in the following description, assuming a more general-purpose document system, the functions of the information processing device 101 and the server 102 will be described separately.

Hereinafter, an example of a hardware configuration applicable to the information processing apparatus 101 shown in FIG. 1 will be described with reference to FIG.

In FIG. 2, 201 is a CPU that comprehensively controls each device and controller connected to the system bus 204. Further, the ROM 203 or the external memory 212 is necessary to realize a function executed by a BIOS (Basic Input / Output System) or an operating system program (hereinafter, OS) which is a control program of the CPU 201, and each server or each PC. Various programs etc. are stored.

Reference numeral 202 denotes a RAM, which functions as a main memory of the CPU 201, a work area, and the like. The CPU 201 realizes various operations by loading a program or the like necessary for executing the process from the ROM 203 or the external memory 212 into the RAM 202 and executing the loaded program.

Further, 205 is an input controller, which controls the input from the touch sensor 210. Reference numeral 206 denotes a video controller, which controls the display on a display such as the display 211. Although the display 211 is described in FIG. 2, the display may be not only a CRT but also another display such as a liquid crystal display. These are used by the user of the information processing apparatus 101 as needed.

The 207 is a memory controller, which can be used in an external storage device (hard disk (HD)) for storing boot programs, various applications, font data, user files, edit files, various data, etc., a flexible disk (FD), or a PCMCIA card slot. Controls access to an external memory 212 such as a compact flash® memory connected via an adapter.

Reference numeral 208 denotes a communication I / F controller, which connects and communicates with an external device via the network 103, and executes communication control processing on the network. For example, communication using TCP / IP is possible.

The CPU 201 can display the outline font on the display 211 by executing the outline font expansion (rasterization) process on the display information area in the RAM 202, for example. Further, the CPU 201 makes it possible to receive a user's touch operation instruction on the touch sensor 210 on the display 211.

Various programs to be described later for realizing the present invention are recorded in the external memory 212, and are executed by the CPU 201 by being loaded into the RAM 202 as needed. Further, definition files, map data, and the like used when executing the above program are also stored in the external memory 212, and detailed description of these will be described later.

209 is a captured image input controller, which controls input from the camera 215 via the captured image input processing unit 214. It is possible to recognize the captured image input from the camera 215.

FIG. 3 is a block diagram showing an example of the functional configuration of the information processing device 101 and the server 102.

The storage unit 301 is a functional unit that stores definition information that defines a combination of document identification information and recognition result conditions for each area of the document.

The acquisition unit 302 is a functional unit that acquires image data obtained by reading a plurality of documents.

The identification unit 303 is a functional unit that identifies the identification information of the document from the image data acquired by the acquisition unit 302.

The deficiency check unit 304 is a functional unit that checks the combination of documents according to the definition information related to the identification information of the document specified by the specific unit 303, and checks the deficiency of the description contents according to the recognition result condition stored by the storage unit 301. ..

When the combination of documents is inadequate in the check by the deficiency check unit 304, the notification unit 305 allows the user to recognize the missing document in preference to the display of the result of the deficiency in the description contents in other documents. It is a functional part to notify.

When the deficiency area display unit 306 is checked by the deficiency check unit 304 and the description content is deficient, the user can identify the deficiency description content according to the recognition area included in the definition information stored in the storage unit 301. It is a functional part to be displayed on.

The notification unit 305 is a functional unit that notifies the user in order from the document having the largest number of deficiencies in the description contents in the check by the deficiency check unit 304.

The deficiency number display unit 307 is a functional unit that aggregates and displays the number of deficiencies described above for each document form by checking by the deficiency check unit 304.

The applicant identification unit 308 is a functional unit that identifies the applicant of the document from the image data acquired by the acquisition unit 302.

The applicant storage unit 309 is a functional unit that stores the applicant specified by the applicant identification unit 308.

The notification unit 305 is a functional unit that notifies the user in order from the document entered by the applicant having a large number of cases stored in the applicant storage unit 309.

FIG. 4 is a flowchart showing an example of a process in which the information processing apparatus 101 acquires a check result of entry deficiency from the server 102 (hereinafter, referred to as an entry deficiency check result acquisition process).

In step S401, the information processing apparatus 101 accepts a login to the document system performed by the user of the document system. The document application that serves as the user interface in this entry deficiency check result acquisition process may be an application installed in the information processing apparatus 101, or an application such as a Web application displayed on a browser.

In step S402, the information processing apparatus 101 photographs a plurality of application forms for checking entry deficiencies one by one using the camera 215, and stores the photographed images (hereinafter, photographed images) in the external memory 212. In this embodiment, the captured image is obtained by using the camera 215 of the information processing device 101, but the image taken by a digital camera or the like or the image scanned by a scanner or the like is used as an information processing device. It may be taken into 101. That is, step S402 is a step showing an example of a process of acquiring image data obtained by reading a plurality of documents. The "application form" in this embodiment is an example of a "document" handled by the document system 100 of the present invention.

The plurality of application forms are a plurality of documents (a plurality of documents), a plurality of types of documents, a document by a plurality of customers, or a document in which these are mixed.

Here, FIG. 6 is shown as a specific example of a combination of a plurality of documents (a document spanning a plurality of sheets) and a plurality of types of documents. FIG. 6 is a diagram showing an example of a processing image in the case of a plurality of applications by one applicant. Specifically, there is a case where one applicant, Mr. A, makes a total of two types of applications, application 1 and application 2, at the same time. Since Form 2 is four documents (documents spanning four sheets), Form 2-3 is missing in Application 2 of FIG. Therefore, in the case of FIG. 6, in step S402, the captured images captured by the information processing apparatus 101 are a total of four application forms with form ID = 1, 2-1, 2-2, 2-4.

In step S403, the information processing apparatus 101 transmits the captured images captured in step S402 to the server 102 while maintaining the captured order.

In step S404, the server 102 receives the captured image and stores the captured image in the external memory 212. Further, the photographed image file name is stored in the "photographed image file name" column of the photographed image list 1120 on the external memory 212 in the order of the received photographed images.

In step S405, the server 102 extracts the captured images stored in the external memory 212 one by one into the RAM 202 in order, and the extracted captured images and the files stored in the "form image" column in each record of the form table 1110. By comparing the form images taken out from the external memory 212 in order using the path, the document form to be checked for entry deficiency is specified. When a matching form image can be identified, the form ID of the identified document is stored in the "form ID" column of the captured image list 1120 on the external memory 212.

The process of step S405 is performed on all the captured images stored in the external memory 212. The image comparison performed in this step is performed by image analysis, image comparison, and character analysis of the frame line written in the application form and the application form name described at the beginning of the application form. These techniques are not described as known techniques. At that time, the form IDs of all the records of the form table 1110 which are the search results are listed and stored in the RAM 202. That is, step S405 is a step showing an example of a process for identifying document identification information from the acquired image data.

In this embodiment, the document form for checking the entry deficiency is specified by comparing the photographed image with the form image stored in the server 102, but the document is not limited to this method. It may be a method of writing a bar code or a number indicating the form ID in the above and analyzing the photographed image to specify the form ID of the photographed image. Here, it is assumed that the form ID = 1, 2-1, 2-2, 2-4 is specified from the captured image. In this embodiment, the process S405 is performed by the server 102, but the information processing device 101 may store the form table 1110 and perform the process by the information processing device 101.

In step S406, the server 102 performs character recognition by OCR for all the captured images, identifies the applicant name described in the application form, and identifies the applicant name described in the application form, and the “applicant name” column of the captured image list 1120 on the external memory 212. Memorize the name of the applicant identified in. That is, step S406 is a step showing an example of processing for identifying the applicant of the document from the acquired image data. In this embodiment, the process S406 is performed by the server 102, but the information processing device 101 may perform character recognition by OCR to specify the applicant name described in the application form.

When the form ID specified in step S405 is the second or subsequent sheet of a plurality of documents (documents spanning a plurality of sheets) (for example, form ID = 2-2, 2-3, 2- in the form table 1110). 4) It is assumed that the name is the same as the applicant name of the first photographed image (form ID = 2-1).

According to the above steps S405 and S406, the form ID and the applicant name can be specified for all the captured images. At this point, the captured image list stored in the RAM 202 is in a state as shown in the captured image list 1120 of FIG. That is, the photographed image list 1120 is an example of a storage unit that stores the specified applicant. In this embodiment, the captured image list 1120 is stored in the server 102, but may be stored in the information processing device 101.

In step S407, the server 102 searches the captured image list 1120 and determines whether or not a plurality of documents (documents spanning a plurality of sheets) exist. That is, step S407 is a step showing an example of a process of checking the combination of a plurality of documents according to the definition information related to the identification information of the specified document and identifying the missing document. Specifically, if the form ID contains a hyphen such as "2-1", "2-2", "2-3", and "2-4", it is determined that the form ID exists.

In addition, in this embodiment, it is said that the form ID of a plurality of documents (a document spanning a plurality of sheets) contains a hyphen, but the form ID is not limited to this format, and is "2 (1/4)". It may be determined by including parentheses or slashes such as "2 (2/4)", "2 (3/4)", and "2 (4/4)". Further, it may have columns such as "child form ID" and "related form ID" in addition to the form ID, and may be in a format representing a parent-child relationship and a context.

If it is determined in step S407 that it exists, the process proceeds to step S408, and if it is determined in step S407 that it does not exist, the process proceeds to step S409.

In step S408, the server 102 determines whether or not there is a missing document form in the captured image list 1120. Specifically, the form ID containing the hyphen in the captured image list 1120 is decomposed into two parts, "character string before hyphen + hyphen" and "character string after hyphen", and "character string before hyphen". By performing a prefix search of the form table 1110 using "+ hyphen" as a search key, it is determined whether or not there is a missing document form in the photographed image list 1120.

For example, in this embodiment, the form IDs including the hyphens in the captured image list 1120 are "2-1", "2-2", and "2-4". Further, regarding these three form IDs, "character string before hyphen + hyphen" is "2-", and "character string after hyphen" is "1", "2", and "4". When the prefix match search of the form table 1110 is performed using "2-" as the search key, the search results are "2-1", "2-2", "2-3", and "2-4". It can be seen that the form ID "2-3" that does not exist in the captured image list 1120 is missing.

If it is determined in step S408 that there is a missing document form, the process proceeds to step S409, and if it is determined that there is no missing document form, the process proceeds to step S410.

In step S409, the server 102 inserts a record into the captured image list 1120 using the missing document form ID acquired in step S408. Specifically, a record of the photographed image file name = NULL, the form ID = the missing document form ID, and the applicant name = the applicant name specified in step S406 is inserted. As a result, in the photographed image list 1120, it can be seen that the record of the photographed image file name = NULL is a missing document form.

In step S410, the server 102 performs an entry deficiency check process (FIG. 5). That is, step S410 is a step showing an example of a process of checking for deficiencies in the description contents according to the stored recognition conditions. In this embodiment, the process S410 is performed by the server 102, but the information processing device 101 may store the entry deficiency check table 1200 and perform the process by the information processing device 101.
Here, the entry deficiency check process of FIG. 5 will be described.

FIG. 5 is a flowchart showing an example of the entry deficiency check process performed by the server 102.

In step S501, the server 102 acquires one photographed image record from the photographed image list 1120 on the external memory 212 and stores it in the RAM 202.

In step S502, the server 102 determines whether or not the photographed image file name of the photographed image record stored in the RAM 202 is NULL, and if it is NULL, the process proceeds to step S503, and if it is not NULL, the process proceeds to step S504.

In step S503, the server 102 inserts a record of the captured image file name = NULL into the entry deficiency check result list 1310, and returns to step S501 to perform an entry deficiency check for the next captured image record. By doing so, in a plurality of documents (a document spanning a plurality of sheets), even if there is a missing document form in the read document, it can be detected and notified to the user.

In step S504, the server 102 searches the entry deficiency check table 1200 (FIG. 12) using the form ID of the captured image record stored in the RAM 202 as the search key in step S501, and the entry deficiency check record related to the document form to be checked. Is acquired and stored in the RAM 202. Specifically, since the form ID of the first record in the photographed image list 1120 (FIG. 11) is "1", the form ID = 1 is used as a search key from the entry deficiency check table 1200, and the form ID = 1. Acquires a list of deficiency check records related to the "shopping credit application form" and stores it in the RAM 202.

The entry deficiency check table 1200 in FIG. 12 is an example of a table that manages the entry deficiency check recognition area and recognition conditions for each form ID. Incomplete entry In the check table 1200, the form ID, the check ID which is the serial number of the check target item, the recognition condition which is the check content, the start point coordinates (X, Y) and the end point coordinates (X, Y) indicating the recognition area of the check target item are shown. Is remembered.

The entry deficiency check table 1200 is a table created and maintained by the system administrator as document definition information (document form identification information, recognition area and recognition condition of entry contents) used in the document system 100. That is, the entry deficiency check table 1200 is an example of a table that stores definition information that defines a combination of document identification information and recognition result conditions for each area of the document. In this embodiment, the entry deficiency check table 1200 is stored in the server 102, but may be stored in the information processing device 101.

In step S505, the server 102 assigns 0 to the variable error and stores the variable error in the RAM 202. This variable error is a variable that counts up each time there is an entry deficiency in the photographed image to be checked for entry deficiency.

In step S506, the server 102 assigns 1 to the variable i and stores the variable i in the RAM 202. This variable i is a variable that serves as a check ID for the entry deficiency check to be performed on the captured image, and is a variable that counts up to check the next check ID after the check is completed.

In step S507, the server 102 sets the start point (X coordinate, Y coordinate) and end point (X coordinate) of the recognition area of the entry deficiency check record of the check ID = i in the entry deficiency check record list stored in the RAM 202 in step S504. (Coordinates, Y coordinates) and recognition conditions are acquired. Specifically, in the entry deficiency check record list of the form ID = 1 of the check target form, when the check ID = 1, the recognition area of the entry deficiency check record = start point (100, 100) and end point (300, 150). , Recognition condition = "required" is acquired.

In step S508, the server 102 determines the acquired recognition condition.

When the recognition condition is "essential", since the recognition area is an input essential item, in step S509, it is determined whether or not characters or symbols are written in the rectangle indicated by the recognition area of the captured image. That is, step S509 is a step showing an example of a process of checking the combination of documents according to the definition information related to the identification information of the specified document and checking the deficiency of the description contents according to the stored recognition result condition. Although this determination process uses an analysis technique such as OCR, the description thereof will be omitted because it is a known technique.

If it is determined that characters or symbols have been entered, the process proceeds to step S513, and if it is determined that no characters or symbols have been entered, the process proceeds to step S511.

When the recognition condition is "circled", since the recognition area is a multiple-choice selection item, it is determined in step S510 whether or not a circle is entered in the rectangle indicated by the recognition area of the captured image. That is, step S510 is a step showing an example of a process of checking the combination of documents according to the definition information related to the identification information of the specified document and checking the deficiency of the description contents according to the stored recognition result condition. This determination process uses an analysis technique such as OMR or OCR, but since it is a known technique, the description thereof will be omitted. In this embodiment, the presence or absence of the circle mark is determined by setting the entry deficiency check recognition condition as "circle", but the presence or absence of the circle mark is not limited to the circle mark, and even if the check mark or other figure is determined. Good.

In addition, in the above, the number of circles is set to "1", but if the entry deficiency check table 1200 is provided with "upper limit" and "number of checks" columns and the upper limit is exceeded, "NG", the number of marks If is other than the "number of checks", it may be determined as "NG". In addition, even if the entry deficiency check table 1200 is provided with a "number of digits" column, it is judged as "OK" if the entered characters are the permitted number of digits, and "NG" if the entered characters are not permitted. Good. In addition, a "character attribute" column may be provided in the entry deficiency check table 1200, and OK / NG may be determined based on the entered character attributes such as "number", "hiragana", "katakana", and "alphanumeric characters". ..

Further, if the entered character cannot be recognized in the analysis result by OCR or the like, it may be determined as "NG". Further, the value of the variable result [i] is not limited to "OK" and "NG", and may have values such as "unclear", "unrecognizable", and "contradiction".

If it is determined in step S510 that the circle mark is entered, the process proceeds to step S513, and if it is determined that the circle mark is not entered, the process proceeds to step S511.

In step S511, the server 102 counts up the variable error. In other words, a deficiency was found.

In step S512, the server 102 inserts a record indicating the error content into the entry deficiency check result list 1310. The entry deficiency check result record to be inserted in the entry deficiency check result list 1310 is "photographed image file name", "form ID", "applicant name", "check ID", "error content", "start point coordinates (X, Y)), and" end point. Coordinates (X, Y) ". This entry deficiency check result record is transmitted to the information processing apparatus 101 after completing the entry deficiency check process, and is used for displaying the entry deficiency check result list screen.

In step S513, the server 102 counts up the variable i, determines whether or not the entry deficiency check record of check ID = i exists in the RAM 202, and if it exists, the entry deficiency check of the document form remains. Since it means that the document has been entered, the process returns to step S507 and continues to check for deficiencies in the document form. If it does not exist, it means that all the entry deficiency checks of the document form have been completed. Therefore, the process returns to step S501, and the entry deficiency check of the document form is performed for the next captured image record in the captured image list 1120 on the external memory 212. I do. If the next captured image record does not exist in the RAM 202, it means that all the entered / deficient checks have been completed for all the captured image records in the captured image list 1120, so this entry / deficiency check process is terminated.

At this point, in this embodiment, an entry deficiency check result record such as the entry deficiency check result list 1310 (FIG. 13) is stored.

This completes the explanation of the entry deficiency check process shown in FIG. By this process, all the captured images are checked for deficiencies. Return to the explanation of the entry deficiency check result acquisition process in FIG.

In step S411, the server 102 totals the number of deficiencies for each form in the entry deficiency check result list 1310 (FIG. 13) stored in the entry deficiency check process (FIG. 5). Specifically, the records of check ID ≠ NULL in the entry deficiency check result list 1310 are grouped and counted for each form ID. In this embodiment, form ID = 1 deficiency count = 3, form ID = 2-1 deficiency count = 1, form ID = 2-2 deficiency count = 5, form ID = 2-3. The deficiency count = 1 and the form ID = 2-4 deficiency count = 0 (= no deficiency).

In step S412, the server 102 counts the number of applicants for the entry deficiency check result list 1310, proceeds to step S415 if it is determined to be one, and proceeds to step S413 if it is determined to be a plurality of applicants. In the embodiment shown in FIG. 6, the number of applicants is one, Mr. A. Further, in the embodiment shown in FIG. 7, there are four applicants, Mr. B, Mr. C, Mr. D, and Mr. E.

In step S413, the server 102 determines whether or not the same applicant has made a plurality of applications for the entry deficiency check result list 1310, and if it is determined that the same applicant has made a plurality of applications, the process proceeds to step S414 and it is determined that the application has not been made. If so, the process proceeds to step S415. In the embodiment shown in FIG. 6, Mr. A has made two applications, Form 1 and Form 2. Further, in the embodiment of FIG. 7, the applicant C makes a total of two applications, form 3 and form 4.

In step S414, since the same applicant has made a plurality of applications, the server 102 sorts the records of the entry / deficiency check results of the plurality of applications by the same applicant so as to be continuous. Specifically, in the embodiment of FIG. 7, since the applicant B has applied for the application 1 and the application 4 twice in total, Mr. B is displayed on the deficiency check result list screen, which is later performed on the information processing apparatus 101. In order to be able to report multiple applications by Mr. B at once, we will summarize the entry check result record of multiple applications by Mr. B.

In step S415, when one applicant makes a plurality of applications, the server 102 fills in the deficiency check result record in the order of the most deficient applications so that the applicant can be notified from the application with the largest number of deficiencies. Sort the entry deficiency check result list 1310 so that

In step S416, the server 102 determines whether or not a plurality of documents (a plurality of documents) (= a plurality of documents) exist in the entry deficiency check result list 1310. If there are a plurality of forms, the process proceeds to step S417. If the plurality of forms does not exist, the process proceeds to step S418.

In step S417, the server 102 checks for deficiencies so that the deficiency check result records are arranged in the order of the form IDs with the most deficiencies so that the applicant can be notified of the plurality of forms from the document form having the most deficiencies. Sort the result list 1310. However, since we want to notify the applicant of the document form in which the photographed image file is missing as soon as possible, the deficiency check result record of the photographed image file name = NULL should be the first record in the multiple form. To do.

That is, step S417 is an example of a process in which when there is a defect in the combination of documents, the user can recognize the missing document in preference to displaying the result of the defect in the description contents in the other document. This is the step shown.

As described above, as a result of sorting the entry deficiency check result list 1310 in steps S421 to S417, the entry deficiency check result list 1310 is the entry deficiency check result list (when transmitted to the client) 1320 (hereinafter, entry deficiency). The order is as shown in the check result list 1320). This sort process can be summarized as ORDER BY applicants (in order of application), applications (in descending order of number of defects), and document form (photographed image file name = NULL, in order of most defects).

By doing this, even if there are multiple documents (multiple documents) (= multiple documents), multiple types of documents, documents by multiple customers, or documents in which these are mixed, the user can accurately tell the user that the document is incomplete. You can notify efficiently.

In step S418, the server 102 transmits the entry deficiency check result list 1320 to the information processing apparatus 101.

In step S419, the information processing apparatus 101 receives the entry deficiency check result list 1320 and stores it in the RAM 202.

In step S420, the information processing apparatus 101 counts the number of deficiencies in each form using the entry deficiency check result list 1320, and displays the entry deficiency check result list screen 800 (FIG. 8) on the display 211. This makes it possible to see the missing document form in the captured image. You will also be able to see the number of deficiencies in each form. The person in charge of customer service can grasp the number of deficiencies to be notified to the customer by looking at the entry deficiency check result list screen 800.

That is, step S420 is a step showing an example of a process of totaling and displaying the number of checked defects for each document form.

In step S421, the information processing device 101 accepts the button press by the user and determines the pressed button. When the end button is pressed, the entry deficiency check result acquisition process is terminated. If the entry deficiency check result record is touched and dragged, the entry deficiency check result record is moved to the dragged part. As a result, the person in charge of customer service can change the order of notification to the customer. When the application form confirmation button is pressed, the process proceeds to step S423 in order to display the application form (form 2-2 in the case of FIG. 8) currently instructed by the cursor. Also, when the user touches this cursor, it moves to the touched entry deficiency check result record.

In step S423, the information processing apparatus 101 uses the entry deficiency check result list 1320 to display the application form image 910 (FIG. 9) indicated by the cursor on the display 211. Specifically, when displaying Form 2-2, the image file name "20140625_101730.jpg" is acquired from the first line 1322 of Form ID = 2-2 in the entry deficiency check result list 1320, and externally in step S404. Of the captured image files stored in the memory 212, the image corresponding to this image file name is acquired and displayed on the display 211.

If the form does not have any deficiencies, the application form image 1000 (FIG. 10) is displayed. Specifically, when displaying Form 2-4, the image file name "20140625_101820.jpg" and the check ID = FULL can be obtained from the first line 1323 of Form ID = 2-4 in the entry deficiency check result list 1320. Therefore, among the captured image files stored in the external memory 212 in step S404, the image corresponding to this image file name is acquired and displayed on the display 211 together with the message "There was no entry defect".

In addition, on this screen (application form image 910), by displaying the total number of incomplete entries in this form and highlighting the incomplete entries, the person in charge of customer service informs the applicant of this screen (application form). Since it is possible to explain the deficiency while showing the image 910), it is possible to efficiently notify the deficient document from the plurality of read documents.

That is, step S423 is a step showing an example of a process of displaying the deficient description content so that the user can identify it according to the recognition area included in the definition information when the description content is deficient in the check. That is, step S423 is a step showing an example of a process of notifying the user in order from the document having the largest number of deficiencies in the description contents.

Specifically, by aggregating the records of form ID = 2-2 in the entry deficiency check result list 1320, the message "There are 5 deficiencies" of the total number of entry deficiencies in the displayed form is output. To do. In addition, by displaying the start point coordinates (X, Y) and end point coordinates (X, Y) of the record of form ID = 2-2 in the entry deficiency check result list 1320 in a rectangular shape, a plurality of read documents can be identified. It is possible to efficiently notify defective documents from. In this embodiment, it is assumed that the deficient part is highlighted, but the method is not limited to this method, and the rectangles of the start point coordinates (X, Y) and the end point coordinates (X, Y) are surrounded by a frame or blink. You can make it stand out by making it stand out. Further, the notification may be made by voice or the like.

In step S424, the information processing device 101 accepts the button press by the user and determines the pressed button. When the end button 912 is pressed, the process returns to step S420 in order to end the entry deficiency display for this form. If the next button 911 is pressed, the process proceeds to step S425.

In step S425, the information processing apparatus 101 determines whether the next entry deficiency (at the beginning of this form in the case of initial display) exists by using the entry deficiency check result list 1320, and if not, in this form. Since there are no more deficiencies to be displayed, the process returns to step S422 in order to display the next form. If it exists, there are still deficiencies to be displayed in this form, so the process proceeds to step S426 to display the next deficiency.

In step S426, the information processing apparatus 101 enlarges and displays the area of the next deficiency (in the case of the initial display, at the beginning of this form) in order to notify the user of the deficiency. (922 in FIG. 9) As a result, it is possible to efficiently notify a defective document from a plurality of read documents. In addition, when enlarging the display, even if only the starting point coordinates (X, Y) and the ending point coordinates (X, Y) are enlarged, it becomes difficult for the user to understand where the enlargement is, so the starting point coordinates (X-). By expanding and enlarging the rectangular range such as 20, Y-20) and the end point coordinates (X + 20, Y + 20), it is possible to make it easier to understand the deficient part in the entire document form.

In this embodiment, the user is notified of the entry deficiency by enlarging the display, but the method is not limited to this method, and the user may be made to stand out as in step S423. For example, at the positions of the start point coordinates (X, Y) and the end point coordinates (X, Y), the character string of the error content of the entry deficiency check result list 1320 is displayed like a balloon 923, and the reason for the entry deficiency is displayed to the user. You may be notified. By doing so, at the entry deficiency displayed in step S423, the customer service staff can explain to the applicant the entire form currently being displayed, and in this step S425, each entry deficiency can be explained in detail. it can. That is, it is possible to efficiently notify a defective document from a plurality of read documents.

As described above, in a plurality of documents (a document spanning a plurality of sheets), even if there is a missing document form in the read document, it can be detected and notified to the user. In addition, even for multiple documents (multiple documents), multiple types of documents, documents by multiple customers, or documents in which these are mixed, it is possible to efficiently notify defective documents from multiple read documents. it can.

After that, the process returns to step S424 in order to accept the button press from the user.
This is the end of the description of the document system setting process of FIG.

[Second Embodiment]
Next, the second embodiment will be described. In the first embodiment, the results are displayed in the order of applications with the largest number of deficiencies and the order of documents with the largest number of deficiencies. However, as shown in FIG. 14, when the customer (applicant G) corrects the deficiency and performs the deficiency check again after performing the deficiency check, it is expected that the number of deficiencies is naturally small, and from the document with a large number of deficiencies. If they are shown in order, the customer (applicant G) who has corrected the deficiency will be kept waiting for a long time. Therefore, as shown in FIG. 15, in the second embodiment, the customer who frequently performs the check is given priority. Notice.

Note that FIG. 4 of the first embodiment is replaced with FIG. Further, the same process as the step of the first embodiment is given the same step number and the description thereof will be omitted.

Further, FIG. 8 of the first embodiment is replaced with FIG. FIG. 17 shows an addition of a “check execution count” column to the entry deficiency check result list of FIG.

Further, FIG. 11 of the first embodiment is replaced with FIG. The captured image table 1810 (FIG. 18) is a table in which "reception ID", "reception date and time", and "check execution count" columns are added to the configuration of the captured image list 1120 (FIG. 11) stored as on the external memory 212. Is. With this photographed image table 1810, it becomes possible to acquire the number of times the check has been performed for the target applicant. That is, the captured image table 1810 is an example of a table that stores the specified applicant.

Further, FIG. 13 of the first embodiment is replaced with FIG. The entry deficiency check result list 1910 and the entry deficiency check result list 1920 (Fig. 19) are tables in which the "check execution count" column is added to each of the entry deficiency check result list 1310 and the entry deficiency check result list 1320 (Fig. 13). is there.

Hereinafter, the second embodiment will be described with reference to FIGS. 16 to 19. The same configuration and processing as in the first embodiment will be described without description.

A process in which the information processing apparatus 101 according to the second embodiment acquires a check result of entry deficiency from the server 102 will be described with reference to FIG.

In step S1601, the server 102 acquires the number of times the check is performed for the applicant specified in step S406. Specifically, the photographed image table 1810 is searched by the "applicant name" specified in step S406, and the number of hits = the number of times the check is performed this time. Explaining with reference to FIG. 18, when the entry deficiency check has been completed up to the captured image with the reception ID = 1 and the entry deficiency check is performed for three captured images with the reception ID = 2 (captured image records 1812 to 1814), shooting Since the applicant name of the image record 1814 = G, searching the photographed image table 1810 with the applicant name = G results in a total of two hits, the photographed image record 1811 and the photographed image record 1814.

From this, it can be seen that this check is the second time for the applicant name = G. Similarly, for the applicant name = E of the photographed image record 1812, when the photographed image table 1810 is searched with the applicant name = E, it is found that this check is performed for the first time, and the application for the photographed image record 1813 is performed. When the photographed image table 1810 is searched with the applicant name = F for the person name = F, it can be seen that this check is performed for the first time.

In this embodiment, the search condition of the captured image table 1810 in step S1601 is only the "applicant name", but not only the "applicant name" but also the "reception date and time" is set to a predetermined range such as only on the current day. The "form ID" specified in step S405, which is limitedly added to the search condition, may be added to the search condition. The search condition in step S1601 is a condition for determining the number of times the check is performed. When the application forms of a plurality of applicants are photographed in step S402, the number of applicant names specified in step S406 is plural. Therefore, the search process of the photographed image table 1810 performed in step S1601 is performed on the applicant name. It will be repeated as many times as there are.

In step S1602, the server 102 updates the "check execution count" column with the check execution count acquired in step S1601 for the record to be checked for entry deficiency. Explaining with reference to FIG. 18, since the number of hits searched by the applicant name = G = 2, the “number of checks” of the captured image record 1814 is updated to 2. Similarly, the "number of checks performed" of the captured image record 1812 is updated to 1, and the "number of checks performed" of the captured image record 1813 is updated to 1.

In step S1603, the server 102 "checks the number of times the deficiency check is performed" so that the applicant who has the most deficiency checks can be notified in order of the entry deficiency check result list 1910 (FIG. 19) stored in the deficiency check process (FIG. 5). The applicants are sorted in descending order.

After step S1603, by sorting in steps S415 and S417, the entry deficiency check result list 1910 is transmitted to the information processing apparatus 101 in the state of the entry deficiency check result list 1920 (FIG. 19), and is entered in step S420. The deficiency check result list screen 1700 (FIG. 17) is displayed. The "number of checks performed" on the entry deficiency check result list screen 1700 indicates the number of checks of the application form by the applicant, and is displayed in descending order of the "number of checks performed". That is, step S420 is a step showing an example of a process of notifying the user in order from the document entered by the applicant having a large number of cases stored in the photographed image table 1810.

After step S420, in step S423, since the check result image of the application form is displayed in the order displayed on the entry deficiency check result list screen 1700, that is, in the order of the "check execution count", the customer with a large number of check executions. You can give priority to notification without making you wait for a long time. This makes it possible to provide a mechanism for efficiently notifying a defective document from a plurality of read documents.

As described above, the recording medium on which the program that realizes the functions of the above-described embodiment is recorded is supplied to the system or the device, and the computer (or CPU or MPU) of the system or the device stores the program in the recording medium. Needless to say, the object of the present invention can be achieved by reading and executing.

In this case, the program itself read from the recording medium realizes the novel function of the present invention, and the recording medium on which the program is recorded constitutes the present invention.

Recording media for supplying programs include, for example, flexible disks, hard disks, optical disks, magneto-optical disks, CD-ROMs, CD-Rs, DVD-ROMs, magnetic tapes, non-volatile memory cards, ROMs, EEPROMs, and silicon. A disc or the like can be used.

Further, by executing the program read by the computer, not only the function of the above-described embodiment is realized, but also the OS (operating system) or the like running on the computer is actually operated based on the instruction of the program. Needless to say, there are cases where a part or all of the processing is performed and the processing realizes the functions of the above-described embodiment.

Further, the program read from the recording medium is written to the memory provided in the function expansion board inserted in the computer or the function expansion unit connected to the computer, and then the function expansion board is based on the instruction of the program code. It goes without saying that there are cases where the CPU or the like provided in the function expansion unit performs a part or all of the actual processing, and the processing realizes the functions of the above-described embodiment.

Further, the present invention may be applied to a system composed of a plurality of devices or a device composed of one device. It goes without saying that the present invention can also be applied when it is achieved by supplying a program to a system or device. In this case, by reading the recording medium in which the program for achieving the present invention is stored into the system or device, the system or device can enjoy the effect of the present invention.

The form of the program may consist of object code, program code executed by an interpreter, script data supplied to an OS (operating system), and the like.

Further, by downloading and reading a program for achieving the present invention from a server, database, or the like on the network by a communication program, the system or device can enjoy the effect of the present invention. It should be noted that all the configurations in which the above-described embodiments and modifications thereof are combined are also included in the present invention.

100 Document system 101 Information processing device 102 Server 103 Network

Claims (7)

An information processing system equipped with an information processing device that controls image data.
The information processing device
An acquisition method for acquiring image data of a set of documents,
And combination information of a plurality of forms in a document to be set, based on the foam obtained from the image data acquired by the acquisition unit, and a checking means for checking whether there is image data down missing,
The plurality of sets of documents, based on the check result by the check means, the so image data can be confirmed by preference a set of documents that are missing, check documents set of the image data is missing An information processing system characterized by including an output means for outputting a result. An information processing system equipped with an information processing device that controls image data .
The information processing device
An acquisition method for acquiring image data of multiple documents,
Based on the recognition condition of the document and the image data acquired by the acquisition means, a checking means for checking the content of the document to see if the image data conforms to the recognition condition, and a check means.
Wherein by comparing the number of deficiencies based on the result of the check by the checking means, information processing system and an outputting unit operable to determine the output order of the plurality of documents, and outputs the check result in the output order. The information processing system according to claim 2 , wherein the output order is an order in which documents having a large number of defects based on the check result by the check means are preferentially output. It is a processing method of an information processing device that controls image data.
The information processing device
The acquisition step to acquire the image data of a set of documents,
A checking step of checking the combination information of the multiple forms of document to be set, based on the foam obtained from the image data acquired by the acquisition step, whether there is image data down missing,
The plurality of sets of documents, based on the check result of the checking step, the so image data can be confirmed by preference a set of documents that are missing, check documents set of the image data is missing A processing method characterized by executing an output step that outputs a result. A processing method for an information processing apparatus for controlling image data,
The information processing device
Acquisition step to acquire image data of multiple documents,
Based on the recognition condition of the document and the image data acquired in the acquisition step, a check step for checking the content of the document to see if the image data conforms to the recognition condition, and a check step.
Wherein by comparing the number of deficiencies based on the result of the check by the checking step, the processing method of the output order determined in the plurality of documents, and executes an output step of outputting a check result in the output order. An information processing device that controls image data
An acquisition method for acquiring image data of a set of documents,
And combination information of a plurality of forms in a document to be set, based on the foam obtained from the image data acquired by the acquisition unit, and a checking means for checking whether there is image data down missing,
The plurality of sets of documents, based on the check result by the check means, the so image data can be confirmed by preference a set of documents that are missing, check documents set of the image data is missing A program to function as an output means to output the result. An information processing device that controls image data
An acquisition method for acquiring image data of multiple documents,
Based on the recognition condition of the document and the image data acquired by the acquisition means, a checking means for checking the content of the document to see if the image data conforms to the recognition condition, and
Comparison of the number of deficiencies based on the result of the check by the check means, the output order determined in the plurality of documents, a program to function as output means for outputting a check result in the output order.

Images