JP2019204534A - Information processing device, information processing method, program for information processing device, and document management system - Google Patents

Abstract

To provide an information processing device, information processing method, program and a document management system for improving work productivity in performing document examination by collating a plurality of parts about a plurality of documents.SOLUTION: In a management system, a collation terminal device displays examination images. Cut-out images of a document name (a "contract", a "resident card") and cut-out regions 50a, 51a to be compared and collated with each other are displayed in an array on the screen of an output part. The collation terminal device functions as one example of display means for displaying item image data of different documents to items of one document in order to mutually collate the one document of the documents with the different documents. Described items are highlighted by cutting out the items in this manner. When an operator performs collation to find that a collation result is correct, an OK button 55 is selected by an operation part, and when the collation result is not correct, an NG button 55 is selected.SELECTED DRAWING: Figure 24

Description

  The present invention relates to an information processing apparatus that manages electronic data of a document, an information processing method, a program for the information processing apparatus, and a document management system.

  In order to improve business efficiency, the contents of documents are digitized into electronic data, and predetermined information is extracted from them. For example, Patent Document 1 discloses an information extraction device that specifies a form of document image data and extracts information from document image data based on extraction area data indicating an area from which information is extracted.

JP 2013-41539 A

  However, when reviewing documents by collating multiple locations for multiple documents, the conventional technology cannot keep a record of the items used for collation confirmation. The work productivity was not sufficient.

  Therefore, the present invention has been made in view of the above-described problems and the like, and an example of the problem is to provide an information processing apparatus and the like that can improve work productivity.

  In order to solve the above problems, the invention described in claim 1 acquires work information by an operator for information on an item of the document in image data of the document on which information on one or more items is described. In the work information storage means for storing the document and the item in association with the storage means, and in the display means for displaying the image data of the document, the position corresponding to the item on which the work has been performed by the operator, In order to display a graphical display showing the work information, the work information output means for extracting the work information with reference to the storage means and outputting the extracted work information is provided. .

  According to a second aspect of the present invention, in the information processing apparatus according to the first aspect, the graphical display is a mark.

  The invention according to claim 3 is the information processing apparatus according to claim 1 or 2, wherein the work by the worker is a work for examining the document.

  According to a fourth aspect of the present invention, in the information processing apparatus according to any one of the first to third aspects, the graphical display is different for each item.

  The invention according to claim 5 is the information processing apparatus according to any one of claims 1 to 4, wherein the graphical display is different for each document.

  Further, in the invention described in claim 6, the work information storage means obtains work information by the worker for the item information of the document in the image data of the document in which the information of one or more items is described, The work information storage step for storing the document in association with the item in the storage means, and the work information output means for displaying the image data of the document on the item on which the work has been performed by the operator. A work information output step of extracting the work information with reference to the storage means and outputting the extracted work information to display a graphical display showing the work information at a corresponding position. It is characterized by.

  According to the seventh aspect of the present invention, in the image data of a document in which information of one or more items is described, the computer acquires work information by an operator for the item information of the document, and the document and In the work information storage means associated with the item and stored in the storage means, and the display means for displaying the image data of the document, the work information is located at a position corresponding to the item where the work is performed by the worker. In order to display a graphical display indicating the above, the work information is extracted with reference to the storage means, and is functioned as work information output means for outputting the extracted work information.

  The invention according to claim 8 is a document management system comprising: an information processing apparatus that processes document information relating to a document in which information of one or more items is described; and a terminal device having a display unit. An information processing apparatus acquires work information by an operator for information on an item of the document in the image data of the document, stores work information in a storage unit in association with the document and the item, and information on the document In the display means on which image data is displayed, the work is referred to the storage means in order to display a graphical display indicating the work information at a position corresponding to the item on which work by the worker has been performed. Work information output means for extracting information and outputting the extracted work information to the terminal device is provided.

  According to the present invention, a record of which item of the document was worked at the time of the work remains, and the work history can be easily confirmed later, so that the document can be managed with an improvement in work productivity.

It is a mimetic diagram showing an example of outline composition of a management system concerning an embodiment of the present invention. It is a schematic diagram which shows an example of a document. It is a schematic diagram which shows an example of a document. It is a schematic diagram which shows an example of a document. It is a schematic diagram which shows an example of a document. It is a block diagram which shows an example of schematic structure of the management server of FIG. It is a schematic diagram which shows an example of the data of the database in the management server of FIG. It is a schematic diagram which shows an example of the data of the database in the management server of FIG. It is a schematic diagram which shows an example of the positional information on an item. It is a schematic diagram which shows an example of the relationship between an item and difficulty. It is a schematic diagram which shows an example of the data of the database in the management server of FIG. It is a schematic diagram which shows an example of the data of the database in the management server of FIG. It is a schematic diagram which shows an example of the data of the database in the management server of FIG. It is a schematic diagram which shows an example of the data of the database in the management server of FIG. It is a block diagram which shows an example of schematic structure of the registration apparatus of FIG. It is a block diagram which shows an example of schematic structure of the image input device of FIG. It is a schematic diagram which shows an example of the image input device of FIG. It is a block diagram which shows an example of schematic structure of the collation terminal device of FIG. It is a schematic diagram which shows an example of the work process in the management system of FIG. It is a sequence diagram which shows the operation example of the management server and registration apparatus of FIG. It is a sequence diagram which shows the operation example of the management server of FIG. 1, and an image input device. It is a schematic diagram which shows an example of a front page. FIG. 21 is a flowchart illustrating an image cutout subroutine of FIG. 20. FIG. It is a sequence diagram which shows the operation example of the management server of FIG. 1, and a collation terminal device. It is a schematic diagram which shows an example of the examination screen of an item. It is a schematic diagram which shows an example of the item in a document. It is a schematic diagram which shows an example of the examination screen of an item. It is a schematic diagram which shows an example of the examination screen of an item. It is a schematic diagram which shows an example of the examination screen of an item. It is a schematic diagram which shows an example of the examination screen of an item. It is a schematic diagram which shows an example of the examination screen of an item. It is a schematic diagram which shows an example of the examination screen of an item.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. The embodiment described below is an embodiment when the present invention is applied to a management system.

[1. Overview of management system configuration and functions]
(1.1 Configuration and function of management system)
First, the configuration and outline function of a management system according to an embodiment of the present invention will be described with reference to FIGS.

  FIG. 1 is a schematic diagram illustrating a schematic configuration example of a management system 1 according to the present embodiment. 2 to 4 are schematic diagrams showing examples of documents.

  As shown in FIG. 1, the management system 1 includes a management server 10 that manages document information related to documents, a registration device 20 that performs registration work such as document types and clip regions (an example of item image data) for each type. An image input device 30 that captures an image of a document and captures the image data, and a collation terminal device 40 that collates the items of the document are provided. Here, as an example of the document information, electronic data such as document image data, feature amounts extracted from the document image data, text data created from the image data, and delivery data for delivery to the customer are listed. It is done.

  The management server 10 manages work in the registration device 20, the image input device 30, and the verification terminal device 40.

  In the registration device 20, master registration work for document types, setting work for setting out areas for document items for each type, setting work for item matching difficulty, setting work for worker proficiency, and the like are performed in advance. .

  The image input device 30 captures an image of a document deposited by a customer and creates a front page attached to the document. The document with the front page is stored in the storage 5.

  The verification terminal device 40 is, for example, a portable terminal such as a portable wireless phone or a tablet terminal including a personal computer or a smartphone. The collation terminal device 40 displays an image of a document for collation and examination. The verification terminal device 40 is installed according to each worker.

  The management server 10, the registration device 20, the image input device 30, and the verification terminal device 40 can transmit and receive data to and from each other via the network 3 using, for example, TCP / IP as a communication protocol. . The network 3 is constructed by, for example, a local area network, the Internet, a dedicated communication line (for example, a CATV (Community Antenna Television) line), a mobile communication network, and a gateway.

  The document is, for example, an application document such as a contract. In addition, the documents for confirming the identity will include a resident's card, driver's license, family register card, health insurance card, passport, and receipt (for example, a receipt for utilities such as electricity and gas). ), Copy of register book, invoice. Note that the document may be not only flat paper but also a three-dimensional shape, as long as readable information is written on the surface of the document.

  Examples of document types include contracts, resident cards, and licenses. Further, the types of documents are classified according to the format of the contract for each customer in the case of a contract, and according to the format of each municipality in the case of a resident's card.

  As shown in FIG. 2, when the document is a contract (document 50), the contract contents, name, address, telephone number, etc. are written on the surface of the document. Common areas for contracts of the same format include contract details, name items, address items, telephone number items, seal stamp items (not shown), and the like. Non-common areas of the contract include personal information such as name (cutout area 50a), address (cutout area 50b), telephone number (cutout area 50c), and the like. The common area is a common format portion common to documents of the same format. The non-common area is a different part for each applicant regarding documents of the same format.

  As shown in FIGS. 3A and 3B, when the document is a resident card, the name of the municipality, address, name, date of birth, gender, etc. are described on the surface of the document. As common area of resident's card of form of a certain municipality (an example of a prescribed form according to the document), the name of the document, the name of the municipality, the address item, the name item, the date of birth, the item of sex, etc. It is done. As the non-common area of the resident's card, an address (cutout area 51b), a name (cutout area 51a), a date of birth, sex, and the like, which are personal information, can be cited.

  As shown in FIGS. 3A and 3B, when the document is a resident's card, the format (an example of a predetermined format corresponding to the document) differs depending on the municipality.

  As shown in FIG. 4, as an example of a predetermined format corresponding to a document, when the document is a license, a name, date of birth, address, photograph, etc. are described on the surface of the document. Common fields for licenses include name items, address items, date of birth items, and photo items. Non-common areas of licenses include personal information such as name, date of birth, address, and personal photo.

  The plurality of related documents are a plurality of documents related to one individual or one corporation. At least two or more documents relating to the same individual or the same corporation. For example, application documents such as contracts, documents for confirming the identity of individuals or corporations (resident card, license, family register card, health insurance card, passport, receipt), documents such as invoices, etc. There are at least two documents. As an example of a plurality of related documents, for example, a combination of a contract, a resident card, and a license, a combination of a contract, a resident card, and a passport, an application document, and a combination of a health insurance card, an application document, A combination of receipts, contracts, and transcripts. These related documents are sent, for example, in an envelope containing a set of documents.

(1.2 Configuration and Function of Management Server 10)
Next, the configuration and function of the management server 10 will be described with reference to FIGS.

  FIG. 5 is a block diagram illustrating an example of a schematic configuration of the management server 10. 6 to 13 are schematic diagrams illustrating an example of database data in the management server 10.

  As shown in FIG. 5, the management server 10 that is a computer includes a control unit 11 that controls the management server 10, a storage unit 12 that has various databases, and a communication unit 13 that communicates with each management server 10 and the registration device 20. And an output unit 14 for displaying management information and the like.

  The control unit 11 includes, for example, a CPU (Central Processing Unit), a ROM (Read Only Memory), and a RAM (Random Access Memory). The control unit 11 includes, for example, a CPU, a ROM, and a RAM. In the control unit 11, the CPU reads and executes various control programs stored in the ROM or RAM. The control unit 11 controls each unit (the storage unit 12, the communication unit 13, the output unit 14, etc.) of the management server 10. Note that the control unit 11 may read and execute a recording medium storing these programs.

  The storage unit 12 (an example of a storage unit) is configured by, for example, a hard disk drive. The storage unit 12 includes a registration database 12a that stores data to be registered in advance, a worker database 12b that stores the level of the worker, an image database 12c that stores image data and cut-out images of captured documents, A work result database 12d that stores workers collating document items, an examination result database 12e that stores document examination results, and the like are constructed.

  In the document type registration database 12a, as shown in FIG. 6, document types such as a resident's card, a license, and a contract are recorded in association with the document type code. Further, the registration database 12a stores the name of the municipality for the resident card, the customer name for the contract, and the like.

  Further, as shown in FIG. 7, the registration database 12a for the item cutout area is associated with the cutout area corresponding to each item of the document format in association with the ID indicating the document type and stored. Yes. As shown in FIG. 8, when the cutout area 50a is a rectangle, the position information of the vertexes located on the diagonal of the rectangle is the cutout area 50a. In the registration database 12a for the item cutout area, various templates relating to a contract for each customer, a resident card for each municipality, and the like are stored.

  Further, as shown in FIG. 9, information on the difficulty level of collation for each item is stored in the registration database 12a for the difficulty level of items. Since the gender is male / female or M / F, collation is easy, but in the case of names, there are different characters, and in the case of addresses, there are several ways to write, making collation difficult. In addition, for example, the name may be different from “Name XX”, “Insured Person XX”, “Household XX”, and “Non-Dependent XX”, making verification difficult. Become.

  The registration database 12a stores information such as a customer name and whether or not a document has been cut after delivery in association with the customer ID.

  Further, as shown in FIG. 10, the worker database 12b stores a work level for each worker ID. The work level is determined according to the proficiency level, appropriateness, etc. of the worker. The work level is classified into, for example, “A”, “B”, “C”, and the like. The worker ID is associated with a login ID and password, an IC card carried by the worker, a code printed on a name tag, and the like.

  In addition, in the image database 12c, as shown in FIG. 11, for each document ID, captured image data, a cut-out image cut out from the image data (an example of item image data, each item portion in the document) Image) and the like are stored. The clipped image is associated with the item and stored in the image database 12c. Note that the image data and the cut-out image may be separate databases. In addition to the document ID, the document ID may be an ID that can specify a document, such as a document feature amount and a work ID.

  Further, in the work result database 12d (an example of the storage unit), as shown in FIG. 12, the worker ID of the worker who collated the item and the document used for the collation are associated with the packaging ID and the item ID. Document ID, selection information indicating which part of the document is used for collation, and the like are stored.

  Further, as shown in FIG. 13, the examination result database 12e (an example of a storage unit) stores the worker ID and examination result of the worker who collated the items in association with the packaging ID and the item ID. Yes. The examination result is, for example, a collation result indicating whether the contents described in the set documents are the same, or data indicating whether or not there is a description. The examination result database 12e may store text data read from a resident card or the like.

  It may be managed by the same database of the same management server 10, or each database may be stored in a database of another management server.

  The storage unit 12 may store various programs such as an operating system and a server program. Note that the various programs may be acquired from another server or the like via the network 3, or may be recorded on a recording medium and read via a drive device.

  The communication unit 13 is connected to the network 3 and controls communication with the registration device 20, the image input device 30, and the verification terminal device 40.

  The output unit 14 is configured by, for example, a liquid crystal display element or an EL (Electro Luminescence) element.

(1.3 Configuration and Function of Registration Device 20)
Next, the configuration and function of the registration device 20 will be described with reference to FIG.

  FIG. 14 is a block diagram illustrating an example of a schematic configuration of the registration device 20.

  Note that configurations and functions different from those of the management server 10 will be mainly described.

  As illustrated in FIG. 14, the registration device 20 that functions as a computer includes a control unit 21, a storage unit 22, a communication unit 23, an output unit 24, and an operation unit 25.

  The control unit 21 includes a CPU, a ROM, and a RAM, and controls the registration device 20. In the control unit 21, the CPU reads and executes various control programs stored in the ROM or RAM. The control unit 21 may read and execute a recording medium storing these programs.

  The storage unit 22 is configured by a hard disk drive or the like, and stores various programs.

  The communication unit 23 controls communication with the management server 10 and the like through the network 3.

  The output unit 24 is configured by, for example, a liquid crystal display element or EL, and displays various registration screens.

  The operation unit 25 is configured by, for example, a keyboard and a mouse.

(1.4 Configuration and Function of Image Input Device 30)
Next, the configuration and function of the image input device 30 will be described with reference to FIGS. 15 and 16.

  FIG. 15 is a block diagram illustrating an example of a schematic configuration of the image input device 30. FIG. 16 is a schematic diagram illustrating an example of the image input device 30.

  As illustrated in FIG. 15, the image input device 30 includes a control unit 31, a storage unit 32, a communication unit 33, an output unit 34, an operation unit 35, and an imaging unit 36.

  The control unit 31 has the same configuration as the control unit 21 and controls the image input device 30. The storage unit 32 has the same configuration as the storage unit 22 and stores various programs. The communication unit 33 controls communication with the management server 10 and the like.

The output unit 34 has the same configuration as that of the output unit 24 and displays a captured image.
Further, the output unit 34 has a printer and prints a front page.

The operation unit 35 is configured by, for example, a keyboard and a mouse.
Furthermore, the operation unit 35 includes an image input switch 35a that performs an imaging operation of the imaging unit 36 by the user's foot.

The imaging unit 36 is a digital camera having an imaging element such as a charge coupled device (CCD) image sensor or a complementary metal oxide semiconductor (CMOS) image sensor.

  As shown in FIG. 16, the imaging unit 36 includes a plurality of digital cameras 36a. A plurality of documents (for example, a contract (document 50), a resident's card (document 51), etc.) are arranged on the table. In order to increase the resolution, each document is partially divided and a plurality of digital cameras 36a are used. Take an image. The imaging unit 36 may be a scanner, and scans and captures a document.

(1.5 Configuration and Function of Verification Terminal Device 40)
Next, the configuration and function of the verification terminal device 40 will be described with reference to FIG.

  As shown in FIG. 17, the collation terminal device 40 that functions as a computer is a portable terminal such as a portable wireless telephone or a PDA including a personal computer or a smartphone, for example, and includes a control unit 41, a storage unit 42, and a communication unit. 43, an output unit 44, and an operation unit 45.

  The control unit 41 has the same configuration as the control unit 21 and controls the verification terminal device 40. The storage unit 42 has the same configuration as the storage unit 22 and stores various programs. The communication unit 43 controls communication with the management server 10 and the like. The output unit 44 has the same configuration as the output unit 24, and displays an image for examination.

[2. Management System Operation]
Next, the operation of the management system according to one embodiment of the present invention will be described with reference to the drawings.

(2.1 Work process in management system)
First, an operation process in the management system will be described with reference to FIG.

  FIG. 18 is a schematic diagram illustrating an example of a work process in the management system 1.

  A set of documents composed of a plurality of documents is sent together from a customer (for example, a card company, an insurance company, etc.). For example, a cardboard box filled with an envelope containing a set of documents is sent from a customer.

  The set of a plurality of documents is, for example, a set of documents applied to the customer from each user of the customer (for example, an individual or a corporation applying for a card company, an insurance company, etc.). The set of documents includes application documents (for example, contracts and application forms) and identification documents. When two documents are required for identity verification, for example, a resident's card and a license, a resident's card, and a health insurance card. In the case of a corporation, it is a document with the representative director's mark on it as a corporate confirmation document.

  As shown in FIG. 18, in the process P1, an opening operation such as an envelope that has been sent is performed. For example, the delivered cardboard is opened, and an envelope containing a set of documents is taken out. Then, the envelope is opened and a set of documents is taken out.

  Next, in the process P2, confirmation of document deficiencies is performed. The document is transported to the place of the process P2, and it is checked whether all the document sets are prepared and whether the document is damaged. After the confirmation work, the document set is conveyed to the storage 5.

  Next, in the process P3, the image input device 30 converts the document taken out from the storage 5 into image data. The image input device 30 images a document and converts the document into image data. The image input device 30 transmits the image data to the management server 10. The management server 10 stores the received image data in the image database 12c. The management server 10 cuts out an image of each item of each document and stores the cut-out image in the image database 12c. A set of documents that have been converted into document image data is stored in the storage 5.

  Next, in step P4, a document item collation operation is performed. The verification terminal device 40 receives the worker ID of the worker, acquires a cut-out image of an item corresponding to the worker from the management server 10 and displays it. The verification terminal device 40 receives the verification result from the worker and transmits the verification result to the management server 10. The management server 10 stores the work results such as the worker ID and the collation process in the work result database 12d. The management server 10 stores the collation result and the like in the examination result database 12e.

  A front page may be created for a set of a plurality of documents. The front page includes a customer name, a front page ID for specifying a set of documents, the number of documents, a reception date, a process number, and the like. This front page may be included in the document set, or may exist in the electronic data and may not be included in the document set. The database of the storage unit 12 may store the document ID of each document in association with the front page ID. Further, the database of the storage unit 12 may store process numbers associated with front page IDs for front page management information.

  In step P1, a document ID for identifying each document such as a code may be assigned to each document. Examples of codes to be given include barcodes and two-dimensional codes. In step P3, a document ID may be assigned to each document by a code generated from the feature amount of the document image. Each document may be put in the receiving port of the apparatus for applying the barcode, and the code may be attached to the front page of the document set, or the code may be manually attached.

  Next, in step P5, return document collation is performed. The set of documents for which all items have been verified is carried out of the storage as return documents. In a terminal device (not shown) for collating returned documents that functions as a computer, the code on the front page of the document set is read by a reader, and collation for returning documents and delivery of examination results Preparations are made.

(2.2 Operation example of management server and registration device)
Next, operation examples of the management server and the registration apparatus will be described with reference to FIG.

  FIG. 19 is a sequence diagram illustrating an operation example of the management server 10 and the registration device 20.

  As shown in FIG. 19, the registration device 20 accepts a master registration operation for a document type (step S1). Specifically, the control unit 21 of the registration apparatus 20 receives an input such as a type for the document type ID from a registration worker. For example, in order to determine the content of the document type ID, on the screen of the output unit 24 of the registration device 20, a document name entry field or selection field together with the document type ID, or a municipality field or selection field if the type is a resident's card When the type is a contract, a customer name entry field is displayed. The registration device 20 receives input from the worker and transmits it to the management server 10.

  Next, the management server 10 performs master registration of the document type (step S2). Specifically, as shown in FIG. 6, the control unit 11 of the management server 10 stores the information received from the registration device 20 in the document type registration database 12a.

  Next, the registration device 20 accepts master registration work for the cutout area for each type (step S3). Specifically, the control unit 21 receives an input of each cutout area corresponding to the item of each document with respect to the document type ID from the registration worker. For example, in order to determine a cutout area of an image, an entry entry field or selection field, a cutout area coordinate entry field or area selection screen, together with a document type ID, a document name, etc., on the screen of the output unit 24 of the registration device 20 Etc. are displayed. The registration device 20 receives input from the worker and transmits it to the management server 10.

  Next, the management server 10 performs master registration of the cut-out area for each type (step S4). Specifically, as shown in FIG. 7, the control unit 11 stores the information received from the registration device 20 in the registration database 12a for the item cutout area.

  Next, the registration device 20 accepts master registration work of the difficulty level of the item (step S5). Specifically, the control unit 21 receives an input such as a difficulty level of matching for each item from a registration worker. For example, in order to determine the difficulty level of item matching, a difficulty level entry field or an area selection screen is displayed on the screen of the output unit 24 of the registration device 20 together with the item name. The registration device 20 receives input from the worker and transmits it to the management server 10.

  Next, the management server 10 performs master registration of the difficulty level of the item (step S6). Specifically, the control unit 11 stores the information received from the registration device 20 in the registration database 12a for item difficulty.

  Next, the registration device 20 accepts master registration work of the skill level of the worker (step S7). Specifically, the control unit 21 receives an input of a work level indicating the work ability of the worker for each worker from the registered worker. For example, in order to determine the work level, a work level entry field or an area selection screen is displayed on the screen of the output unit 24 of the registration device 20 together with the worker name, worker ID, and the like. The registration device 20 receives input from the worker and transmits it to the management server 10.

  Next, the management server 10 performs master registration at the worker level (step S8). Specifically, the control unit 11 stores the information received from the registration device 20 in the worker database 12b.

  Note that the order of the registration work is not limited to the above order, and the registration work requiring registration may be sequentially performed.

(2.3 Example of operation of management server and image input device)
Next, an operation example of the management server and the image input device, which is an operation of converting image data in the process P3, will be described with reference to FIGS.

  FIG. 20 is a sequence diagram illustrating an operation example of the management server 10 and the image input device 30. FIG. 21 is a schematic diagram illustrating an example of a front page.

  As shown in FIG. 20, the image input device 30 images a document (step S10). The control unit 31 of the image input device 30 images the document by the imaging unit 36. As shown in FIG. 16, the documents 50 and 51 are arranged side by side on the table. When the operator steps on the image input switch 35a, the control unit 31 images the documents 50 and 51 with the digital camera 36a. Note that the control unit 31 may accept input of a customer name of a document to be imaged. Further, the control unit 31 may accept input of the type of each document in the document set. In addition, the control unit 31 may automatically generate a reception number, a work number, or the like as the packaging ID and document ID, or may receive an input of a reception number, a work number, or the like.

  Next, the image input device 30 corrects the image data (step S11). Specifically, the control unit 31 corrects the inclination of the captured image data. For example, the control unit 31 detects a document frame in the image by image processing and corrects the inclination.

  Next, the image input device 30 determines whether or not an image has been appropriately captured (step S12). Specifically, the control unit 31 detects folding or chipping of a document, and determines that an image is not properly captured when the degree of folding or the ratio of chipping is a predetermined value or more. In addition, even when the number of captured documents is not a specified number, the control unit 31 determines that an image is not properly captured. The control unit 31 displays the captured document on the screen of the output unit 34, the operator confirms, and the control unit 31 inputs the input whether or not the image is properly captured. You may accept via.

  When the image is appropriately captured (step S12; YES), the image input device 30 transmits the captured image (step S13). Specifically, the control unit 31 transmits image data to the management server 10 via the communication unit 33.

  When the image is not properly captured (step S12; NO), the image input device 30 returns to the process of step S10.

  Next, the image input device 30 deletes the image data (step S14). Specifically, after transmitting the image data, the control unit 31 deletes the image data captured from the storage unit 32, the RAM, or the like.

  Next, the management server 10 registers an image (step S15). Specifically, the control unit 11 receives image data from the image input device 30. The control unit 11 stores the received image data in the image database 12c.

  As described above, the management server 10 functions as an example of an image data acquisition unit that acquires image data obtained by capturing an image of each document in which information of items in the document is described.

  Next, the management server 10 cuts out an image (step S16). Specifically, the control unit 11 specifies and extracts an image for each item (an example of item image data) by a later-described image cutout subroutine.

  As described above, the management server 10 functions as an example of item image data specifying means for specifying item image data corresponding to each item from the image data.

  Next, the management server 10 registers the cutout image (step S17). Specifically, the control unit 11 stores the image data for each extracted item in the image database 12c in association with the item.

  Next, the image input device 30 creates a front page (step S18). Specifically, the control unit 31 prints the front page by the printer of the output unit 34 based on the type of document included in the document set. As shown in FIG. 21, document type information, a barcode corresponding to the wrapping ID, and the like are printed on the front page. A front page is attached on the set of documents and stored in the storage 5.

(2.4 Image cropping subroutine)
Next, an image clipping subroutine will be described with reference to FIG.

  FIG. 22 is a flowchart illustrating a subroutine for image cropping.

  As shown in FIG. 22, the management server 10 specifies the type of document (step S20). For example, the control unit 11 specifies the type of contract (format of the contract for each customer) from the customer name or specifies the type of received document. In addition, the control unit 11 may recognize characters from the image data of the document, recognize a contract, a resident card, a municipality, and the like, and specify the type of the document.

  Next, the management server 10 cuts out an image of each item based on the document type (step S21). Specifically, the control unit 11 refers to the registration database 12a for the item cutout area and specifies and extracts an image for each item by the item cutout area based on the specified document type. As shown in FIGS. 2 and 3A, clipped images such as clipped areas 50a, 50b, and 50c, clipped areas 51a and 51b, and the like are clipped. When there is a ruled line as shown in FIG. 3A, the cutout area may or may not include a ruled line, and the cutout area may or may not include a common area. If it is not included.

  Note that the control unit 11 may cut out an image for each item by image processing. For example, the control unit 11 may extract an image for each item by pattern matching with reference to a template of the registration database 12a for the item extraction region.

  As described above, the management server 10 functions as an example of item image data specifying means for specifying item image data corresponding to each item from the image data.

(2.5 Example of operation of management server and verification terminal device)
Next, an operation example of the management server and the verification terminal device, which is the item verification operation in the process P4, will be described with reference to FIGS.

  FIG. 23 is a sequence diagram illustrating an operation example of the management server 10 and the verification terminal device 40. FIG. 24 is a schematic diagram illustrating an example of an item examination screen. FIG. 25 is a schematic diagram illustrating an example of items in a document. FIG. 26A, FIG. 26B, and FIG. 27 are schematic diagrams illustrating an example of an item examination screen.

  As shown in FIG. 23, the collation terminal device 40 receives input of worker information (step S30). Specifically, the control unit 41 of the verification terminal device 40 receives a login ID and password from the operation unit 45 as worker information. Note that the control unit 41 may receive worker information from an IC card carried by the worker or a code printed on a name tag by a reader. The control unit 41 transmits a request for a cut-out image for examination to the management server 10 together with the worker information.

  Next, the management server 10 specifies the level of the worker (step S31). Specifically, the control unit 11 refers to the worker database 12b and specifies the level of the worker based on the worker ID corresponding to the worker information.

  Next, the management server 10 transmits a cutout image corresponding to the level (step S32). Specifically, the control unit 11 refers to the registration database 12a for the difficulty level of the item, and specifies an item according to the level. The control unit 11 refers to the image database 12c and extracts a cutout image corresponding to the item to be specified. For example, the control unit 11 extracts a gender cut-out image for the beginner “C” level worker, and extracts an address cut-out image for the advanced “A” level worker. Extract.

  In the output unit 44 of the collation terminal device 40, the control unit 11 cuts out the cutout image together with the package ID and the document ID so that a cutout image corresponding to the item of the other document is displayed for the item of one document. Is transmitted to the collation terminal device 40 that requested it. The control unit 11 transmits the cut-out image to each verification terminal device 40 so that the level of the worker matches the difficulty level of the verification for each item.

  As described above, the management server 10 functions as an example of a transmission unit that transmits the item image data of the other document corresponding to the item of one document of the document to the terminal device. The management server 10 is an example of an output unit that causes the display unit to output item image data of another document for the item of the one document in the display unit in order to collate the one document with the other document. Function as. The management server 10 functions as an example of an output unit that outputs the item image data corresponding to the level. The management server 10 functions as an example of an output unit that outputs the item image data of the first document and the item image data of the other document so that they can be displayed side by side on the display unit.

  Next, the collation terminal device 40 displays the examination image (step S33). Specifically, the control unit 41 displays the clipped image to be examined on the screen of the output unit 44. As shown in FIG. 24, on the screen of the output unit 44, document names to be compared and compared (“contract”, “resident's card”), and cut-out images of the cut-out areas 50a and 51a are displayed side by side. By cutting out in this way, the described items are highlighted.

  As shown in FIG. 25, when the document set is a document α, a document β, and a document γ, since the document β has the same items, when comparing the items of the document α with the items of the document β, As shown in FIG. 26A, the control unit 41 may display a clipped image of each item on the screen of the output unit 44.

  In this way, the collation terminal device 40 displays the item image data of the other document for the item of the one document in order to collate the one document of the document with the other document. It functions as an example of means.

  Next, the collation terminal device 40 receives an input of examination work (step S34). Specifically, as shown in FIG. 24, the control unit 41 displays a matching result button 55 on the screen of the output unit 44. When the operator performs collation and the collation result is correct, the operation unit 45 selects the OK button 55, and when the collation result is not correct, the operator selects the NG button 55.

  Thus, the collation terminal device 40 functions as an example of an input unit that receives a collation result obtained by collating one document of the document with another document.

  Also, as shown in FIG. 26B, one item of document α, which is item image data highlighted by being cut out and displayed, and a plurality of corresponding items of document β (item a, item a ′, item) The item used for collation among a ″) may be selected by the operator, and the control unit 41 may display the mark M to be added.

  The control unit 41 may determine the collation result based on information on the locus of the mark drawn by the operator with an input pen, a mouse, or the like. For example, when the operator draws the mark M with the input pen and the shape of the mark is close to a circle, the control unit 41 determines “OK”, and when the mark is close to “×”, the control unit 41 determines “NG”. May be. The management server 10 that has received the mark trajectory and shape information may determine the collation result.

  Further, as shown in FIG. 27, for each item of the document α, marks M1, M2, M3, etc. may be displayed to be added to the documents β and γ in the items used for collation. . The mark M1, the mark M2, and the mark M3 may be the same, and the shape, form, and the like may be changed for each item. When a plurality of documents are used for collation for one document item, a mark may be set for each document used for collation. In this case, the mark may be changed so that the first priority collation location, the second priority collation location, and the like can be understood.

  Note that the control unit 41 may generate information associated with the document ID and the item ID as tag information so that the operator can know which item of which document is used for collation and examination.

  Here, as selection information (an example of information on the items of other documents corresponding to the output item image data), information indicating whether an appropriate OK button 55 or an inappropriate NG button 55 has been selected. , Information on the locus of the mark in the document, information on the form of the mark, information on the clicked position, information on the selected item or item ID, the order of operations, and the operation time. In addition, as an example of information on item image data selected from a plurality of item image data, as shown in FIGS. 26B and 27, information on mark trajectories, information on mark forms, and clicks on documents β and γ are clicked. Examples include position information, information such as a selected item or item ID, operation order, and operation time.

  Next, the collation terminal device 40 transmits a work result (step S35). Specifically, the control unit 41, through the communication unit 43, as a work result (an example of a collation result), worker ID, bag ID, item ID, examination result, selection information selected in the document, etc. It transmits to the management server 10.

  Next, the management server 10 combines the work results (step S36). Specifically, the control unit 11 receives the work result from each verification terminal device 40. The control part 11 memorize | stores the work result received from each collation terminal device 40 in work result database 12d for every packing ID which is an example of the information of the item of one document, and item ID. As shown in FIG. 12, when the database is organized by classification for each bag ID and item ID, the work results are combined as a result. When the items are not sorted and arranged, the control unit 11 searches for the work result based on the packaging ID and the item ID, and integrates the work results.

  Thus, the management server 10 functions as an example of a collation result acquisition unit that acquires the collation result. The management server 10 functions as an example of a collation result acquisition unit that acquires information on item image data selected from the plurality of item image data as a result of the collation. The management server 10 is an example of a storage unit that stores information on the items of other documents corresponding to the output item image data in association with the information on the items of the first document according to the result of the collation. Function.

  Next, the management server 10 registers the examination result (step S37). Specifically, the control unit 11 refers to the work result database 12d, searches the work result based on the packaging ID, collects appropriate / unsuitable information from the work result, and obtains the examination result as the examination result database 12e. To remember.

  As described above, the management server 10 stores the information on the items of the other documents corresponding to the output item image data in association with the information on the items of the first document in accordance with the result of the collation. It functions as an example of means.

  When the collation work is completed for all items, a document confirmation work for returning the document is performed in step P5. Information such as packaging ID that reads the code on the front page of the set of documents to check the work history from the terminal device for collation of returned documents when incomplete documents, missing examination results, etc. are found Is transmitted to the management server 10.

  The management server 10 refers to the work result database 12d, extracts the work result based on the packaging ID, and transmits it to the terminal device for collation work.

  For example, as shown in FIG. 26B or FIG. 27, the collation work terminal device displays an image supplemented with a mark on the screen of the output unit. The worker confirms the work history based on the image supplemented with the mark.

  As described above, according to the present embodiment, in order to identify a cutout image (an example of item image data) corresponding to each item in a document and collate one document with another document, display means (output unit 44) ), The item image data of the other document is output for the item of the one document, the input of the result of the collation is obtained, and the item image data corresponding to the output item image data according to the result of the collation By storing the information of the items in the document in association with the information of the items in one document, a record of which item of which document was collated at the time of collation remains, and the collation history can be easily confirmed later So you can manage documents to improve work productivity.

  In addition, work productivity is improved by collating the items.

  When the level of difficulty of collation is classified according to the item and item image data corresponding to the level is output, the work according to the level of the worker can be shared, so that productivity is improved.

  If the information of the item in the other document corresponding to the output item image data is a mark in the other document, it is easy to check graphically where on the document it was used for confirmation, improving productivity. To do. By adding a mark, the accuracy of the work can be guaranteed. In addition, if there is fluctuation in the description related to personal information of general consumers (for example, if there is an unusual character such as “Sai” or “齊” or if there is a simplified character), It is possible to provide the customer with information such as the described fluctuation by adding the mark.

  When the item image data of one document and the item image data of another document are output so that they can be displayed side by side on the display means (screen of the output unit 44), the items are easily compared and productivity is improved. To do.

  When there are multiple item image data of another document corresponding to the item, each item image data of the other document is highlighted on the display means, and the item image selected from the plurality of item image data as a result of collation When acquiring data information, it becomes easy to compare items and productivity is improved.

  As an example of the item image data, in addition to the item cut-out image, as shown in FIG. 28A, the item to be collated may be highlighted with a frame or the like. Further, as shown in FIG. 28B, the items to be checked may be masked so that other items are difficult to see or displayed so that they cannot be seen at all. Further, as shown in FIG. 29, for example, the items of the resident card may be displayed by extracting the description of the items by image recognition, and only the item image data of the contract may be displayed.

  Furthermore, the present invention is not limited to the above embodiments. Each of the embodiments described above is an exemplification, and any configuration that has substantially the same configuration as the technical idea described in the claims of the present invention and has the same operational effects can be used. It is included in the technical scope of the present invention.

1: Management system (management device)
10: Management server (management device)
11: Control unit 12: Storage unit (storage unit)
12d: Work result database (storage means)
12d: Examination result database (storage means)
40: Verification terminal device (terminal device)
44: Output unit (display means)
45: Operation unit (input means)
50, 51: Documents 50a, 50b, 50c, 51a: Cutout area (item image data)
M, M1, M2, M3: Mark

Claims (8)

Work information storage means for acquiring, in image data of a document in which information of one or more items is described, work information by an operator for the information on the items of the document, and storing the information in the storage means in association with the document and the items When,
In the display means for displaying the image data of the document, refer to the storage means to display a graphical display indicating the work information at a position corresponding to the item where the work is performed by the worker. Work information output means for extracting the work information and outputting the extracted work information;
An information processing apparatus comprising: The information processing apparatus according to claim 1,
The information processing apparatus, wherein the graphical display is a mark. The information processing apparatus according to claim 1 or 2,
The information processing apparatus characterized in that the work performed by the worker is an examination work of the document. The information processing apparatus according to any one of claims 1 to 3,
The information processing apparatus, wherein the graphical display is different for each item. The information processing apparatus according to any one of claims 1 to 4,
The information processing apparatus, wherein the graphical display is different for each document. The work information storage means acquires the work information by the worker for the information of the item of the document in the image data of the document in which information of one or more items is described, and associates the document with the item in the storage means. A work information storage step for storing;
In order to display a graphical display indicating the work information at a position corresponding to the item on which the work has been performed by the worker, the work information output means displays the image data of the document on the display means. A work information output step of extracting the work information with reference to storage means and outputting the extracted work information;
An information processing method comprising: Computer
Work information storage means for acquiring, in image data of a document in which information of one or more items is described, work information by an operator for the information on the items of the document, and storing the information in the storage means in association with the document and the items ,and,
In the display means for displaying the image data of the document, refer to the storage means to display a graphical display indicating the work information at a position corresponding to the item where the work is performed by the worker. A program for an information processing apparatus that functions as work information output means for extracting the work information and outputting the extracted work information. In a document management system comprising: an information processing device that processes document information relating to a document in which information of one or more items is described; and a terminal device that includes a display unit;
The information processing apparatus is
In the image data of the document, work information storage means for acquiring work information by an operator for information on the item of the document and storing the information in the storage means in association with the document and the item;
In the display means for displaying the image data of the document, the storage means is referred to in order to display a graphical display indicating the work information at a position corresponding to the item on which the work has been performed by the worker. Extracting the work information and outputting the extracted work information to the terminal device;
Document management system characterized by comprising