JP6493684B2 - Management device, management method, program for management device, and management system - Google Patents

Description

  The present invention relates to a management device that manages electronic data of documents, a management method, and a program for the management device.

  In order to improve business efficiency, the contents of documents are digitized into electronic data, and predetermined information is extracted from them. For example, Patent Document 1 discloses an information extraction device that specifies a form of document image data and extracts information from document image data based on extraction area data indicating an area from which information is extracted.

JP 2013-41539 A

  However, conventionally, when a document to be digitized is received, there has been a labor for a person to paste an ID such as a barcode on the document. Further, since the document information is not directly included in the mere barcode itself, there is no direct relationship between the barcode itself and a plurality of documents. If the same barcode was assigned to different documents by mistake, or if the barcode was accidentally pasted to another document, management was difficult.

  Accordingly, the present invention has been made in view of the above-described problems and the like, and an example of the problem is to provide a management device that can easily manage documents.

In order to solve the above problems, the invention described in claim 1 is a plurality of related documents, wherein information of one or more items in the documents is described according to a predetermined format corresponding to each document. An image acquisition means for acquiring an image of each document, and a description area for extracting information from the image of each document based on a predetermined format corresponding to each document It comprises a region extracting means, an image for specifying a plurality of documents to the relevant, and a synthesized image generating means for generating a composite image in which the was combining the described region of each document, the synthesized image generation The means generates a composite image in which the description areas are overlapped so that a part of the description information described in the description areas of the documents overlaps .
According to a second aspect of the present invention, in the management device according to the first aspect, the composite image generating unit is configured such that a part of the characters of the description information described in the description area of each document overlaps. A composite image in which the description areas are superimposed is generated.

The invention according to claim 3 is the management device according to claim 1 or 2 , wherein the composite image generation means superimposes an image for superimposition having a predetermined porosity on the composite image. A composite image is generated.

According to a fourth aspect of the present invention, in the management device according to the third aspect , the composite image generating means generates a superimposed composite image in which a plurality of different superposition images are superimposed on the composite image. It is characterized by.

The invention according to claim 5 is the management apparatus according to claim 3 or 4 , wherein the superimposing image is an image in which symbols are arranged.

Further, in the invention described in claim 6, the image acquisition means is a plurality of related documents, and information on one or more items in the document is described according to a predetermined format corresponding to each document. An image acquisition step for acquiring an image of each document, and a description area extraction means, based on a predetermined format corresponding to each document, describes a description area in which information is described for each item as an image of each document. A description area extracting step that extracts from the image, and an image generation unit that generates an image for specifying the plurality of related documents, and that combines the areas including the description areas of the documents. an image generation step, only contains, in the composite image generation step, the as part of the description information described in the description region of each document overlap to generate the composite image by superimposing the described region this The features.

According to a seventh aspect of the present invention, there is provided the computer according to any one of the plurality of related documents, in which information of one or more items in the document is described according to a predetermined format corresponding to each document. Image acquisition means for acquiring an image of the document, description area extraction means for extracting a description area in which information is described for each item from the image of each document, based on a predetermined format corresponding to each document, and , An image for specifying the plurality of related documents, and functions as a composite image generation unit that generates a composite image obtained by combining the description areas of the documents, and the composite image generation unit includes so as to overlap a portion of the described information described in the description region of the document, it characterized that you generate a composite image overlaid the described region.
The invention according to claim 8 is a management system comprising: a management device that manages document information relating to a document; and an image input device that captures an image of the document and captures image data. Image acquisition means for acquiring an image of each document in which information of one or more items in the document is described according to a predetermined format corresponding to each document, from the image input device; Based on a predetermined format corresponding to each document, a description region extracting means for extracting a description region in which information is described for each item from the image of each document, and specifying the plurality of related documents an image for, and a synthesized image generating means for generating a composite image in which the was combining the described region of each document, the composite image generating means, according to the described area of the respective document As part of the description information overlap that, and generates a composite image by superimposing the described region.

  According to the present invention, an image of each document that includes a plurality of related documents and includes information on items according to a predetermined format of each document is obtained, and based on a predetermined format of each document, A description area in which information is described is extracted from an image of each document, and a code image for specifying a plurality of related documents can be generated by combining the extracted description areas of each document. For this reason, the code image itself contains a part of the contents of each related document and the position information of the description area, and becomes unique information for a group of a plurality of documents. It becomes easy to manage documents.

It is a mimetic diagram showing an example of outline composition of a management system concerning an embodiment of the present invention. It is a schematic diagram which shows an example of a document. It is a schematic diagram which shows an example of a document. It is a schematic diagram which shows an example of a document. It is a schematic diagram which shows an example of a document. It is a block diagram which shows an example of schematic structure of the management server of FIG. It is a schematic diagram which shows an example of the data of the database in the management server of FIG. It is a schematic diagram which shows an example of the data of the database in the management server of FIG. It is a schematic diagram which shows an example of the positional information on an item. It is a schematic diagram which shows an example of the relationship between an item and difficulty. It is a schematic diagram which shows an example of the data of the database in the management server of FIG. It is a schematic diagram which shows an example of the data of the database in the management server of FIG. It is a schematic diagram which shows an example of the data of the database in the management server of FIG. It is a schematic diagram which shows an example of the data of the database in the management server of FIG. It is a block diagram which shows an example of schematic structure of the registration apparatus of FIG. It is a block diagram which shows an example of schematic structure of the image input device of FIG. It is a schematic diagram which shows an example of the image input device of FIG. It is a block diagram which shows an example of schematic structure of the collation terminal device of FIG. It is a schematic diagram which shows an example of the work process in the management system of FIG. It is a sequence diagram which shows the operation example of the management server and registration apparatus of FIG. It is a sequence diagram which shows the operation example of the management server of FIG. 1, and an image input device. FIG. 21 is a flowchart illustrating an image cutout subroutine of FIG. 20. FIG. FIG. 21 is a flowchart illustrating a code image generation subroutine of FIG. 20. FIG. It is a schematic diagram which shows an example of a dummy layer image. It is a schematic diagram which shows an example of a dummy layer image. It is a schematic diagram which shows an example of a dummy layer image. It is a schematic diagram which shows an example of a dummy layer image. It is a schematic diagram which shows an example of the image of the description area | region where the information was described. It is a schematic diagram which shows an example of the image of the description area | region where the information was described. It is a schematic diagram which shows an example of the image of the description area | region where the information was described. It is a schematic diagram which shows an example of a code image. It is a schematic diagram which shows an example of the code image on which the dummy layer image was superimposed. It is a schematic diagram which shows an example of the code image on which the dummy layer image was superimposed. It is a schematic diagram which shows an example of the code image on which the dummy layer image was superimposed. It is a schematic diagram which shows an example of the code image on which the dummy layer image was superimposed. It is a schematic diagram which shows an example of a front page. It is a schematic diagram which shows an example of a front page. It is a sequence diagram which shows the operation example of the management server of FIG. 1, and a collation terminal device. It is a schematic diagram which shows an example of the examination screen of an item. It is a schematic diagram which shows an example of the item in a document. It is a schematic diagram which shows an example of the examination screen of an item. It is a schematic diagram which shows an example of the examination screen of an item.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. The embodiment described below is an embodiment when the present invention is applied to a management system.

[1. Overview of management system configuration and functions]
(1.1 Configuration and function of management system)
First, the configuration and outline function of a management system according to an embodiment of the present invention will be described with reference to FIGS.

  FIG. 1 is a schematic diagram illustrating a schematic configuration example of a management system 1 according to the present embodiment. 2 to 4 are schematic diagrams showing examples of documents.

  As shown in FIG. 1, the management system 1 includes a management server 10 that manages document information related to documents, a registration device 20 that performs registration work such as document types and clip regions (an example of item image data) for each type. An image input device 30 that captures an image of a document and captures the image data, and a collation terminal device 40 that collates the items of the document are provided. Here, as an example of the document information, electronic data such as document image data, feature amounts extracted from the document image data, text data created from the image data, and delivery data for delivery to the customer are listed. It is done.

  The management server 10 manages work in the registration device 20, the image input device 30, and the verification terminal device 40.

  In the registration device 20, master registration work for document types, setting work for setting out areas for document items for each type, setting work for item matching difficulty, setting work for worker proficiency, and the like are performed in advance. .

  The image input device 30 captures an image of a document deposited by a customer and creates a front page attached to the document. Documents with front pages are stored in the vault.

  The verification terminal device 40 is, for example, a portable terminal such as a portable wireless phone or a tablet terminal including a personal computer or a smartphone. The collation terminal device 40 displays an image of a document for collation and examination. The verification terminal device 40 is installed according to each worker.

  The management server 10, the registration device 20, the image input device 30, and the verification terminal device 40 can transmit and receive data to and from each other via the network 3 using, for example, TCP / IP as a communication protocol. . The network 3 is constructed by, for example, a local area network, the Internet, a dedicated communication line (for example, a CATV (Community Antenna Television) line), a mobile communication network, and a gateway.

  The document is, for example, an application document such as a contract. In addition, the documents for confirming the identity will include a resident's card, driver's license, family register card, health insurance card, passport, and receipt (for example, a receipt for utilities such as electricity and gas). ), Copy of register book, invoice. Note that the document may be not only flat paper but also a three-dimensional shape, as long as readable information is written on the surface of the document.

  Examples of document types include contracts, resident cards, and licenses. Further, the types of documents are classified according to the format of the contract for each customer in the case of a contract, and according to the format of each municipality in the case of a resident's card.

  As shown in FIG. 2, when the document is a contract (document 50), the contract contents, name, address, telephone number, etc. are written on the surface of the document. Examples of the common area C of contracts of the same format include contract contents, name items, address items, telephone number items, seal stamp items (not shown), and the like. Examples of the non-common area NC of the contract include a personal name (cutout area 50a), an address (cutout area 50b), a telephone number (cutout area 50c), and the like. The common area C is a common format portion common to documents of the same format. The non-common area NC is a different part for each applicant regarding documents of the same format.

  As shown in FIGS. 3A and 3B, when the document is a resident's card, the name of the municipality, address, name, date of birth, sex, etc. are described on the surface of the document. As common area of resident's card of form of a certain municipality (an example of a prescribed form according to the document), the name of the document, the name of the municipality, the address item, the name item, the date of birth, the item of gender, etc. It is done. As the non-common area of the resident's card, an address (cutout area 51b), a name (cutout area 51a), a date of birth, sex, and the like, which are personal information, are listed.

  As shown in FIGS. 3A and 3B, when the document is a resident's card, the format (an example of a predetermined format corresponding to the document) differs depending on the municipality.

  As shown in FIG. 4, as an example of a predetermined format corresponding to a document, when the document is a license, a name, date of birth, address, photograph, etc. are described on the surface of the document. Common fields for licenses include name items, address items, date of birth items, and photo items. Non-common areas of licenses include personal information such as name, date of birth, address, and personal photo.

  The plurality of related documents are a plurality of documents related to one individual or one corporation. At least two or more documents relating to the same individual or the same corporation. For example, application documents such as contracts, documents for confirming the identity of individuals or corporations (resident card, license, family register card, health insurance card, passport, receipt), documents such as invoices, etc. There are at least two documents. As an example of a plurality of related documents, for example, a combination of a contract, a resident's card and a license, a combination of a contract, a resident's card and a passport, an application document, and a combination of a health insurance card, an application document, A combination of receipts, contracts, and transcripts. These related documents are sent, for example, in an envelope containing a set of documents.

  The non-common area where the name, address, etc. are described is an example of the description area. Moreover, the described content is an example of description information.

(1.2 Configuration and Function of Management Server 10)
Next, the configuration and function of the management server 10 will be described with reference to FIGS.

  FIG. 5 is a block diagram illustrating an example of a schematic configuration of the management server 10. 6 to 12 are schematic diagrams illustrating an example of database data in the management server 10.

  As shown in FIG. 5, the management server 10 that is a computer includes a control unit 11 that controls the management server 10, a storage unit 12 that has various databases, and a communication unit 13 that communicates with each management server 10 and the registration device 20. And an output unit 14 for displaying management information and the like.

  The control unit 11 includes, for example, a CPU (Central Processing Unit), a ROM (Read Only Memory), and a RAM (Random Access Memory). In the control unit 11, the CPU reads and executes various control programs stored in the ROM or RAM. The control unit 11 controls each unit (the storage unit 12, the communication unit 13, the output unit 14, etc.) of the management server 10. Note that the control unit 11 may read and execute a recording medium storing these programs.

  The storage unit 12 (an example of a storage unit) is configured by, for example, a hard disk drive. The storage unit 12 includes a registration database 12a that stores data to be registered in advance, a worker database 12b that stores the level of the worker, an image database 12c that stores image data and cut-out images of captured documents, A work result database 12d that stores workers collating document items, an examination result database 12e that stores document examination results, and the like are constructed.

  In the document type registration database 12a, as shown in FIG. 6, document types such as a resident's card, a license, and a contract are recorded in association with the document type code. Further, the registration database 12a stores the name of the municipality for the resident card, the customer name for the contract, and the like.

  Further, as shown in FIG. 7, the registration database 12a for the item cutout area is associated with the cutout area corresponding to each item of the document format in association with the ID indicating the document type and stored. Yes. As shown in FIG. 8, when the cutout area 50a is a rectangle, the position information of the vertexes located on the diagonal of the rectangle is the cutout area 50a. In the registration database 12a for the item cutout area, various templates relating to a contract for each customer, a resident card for each municipality, and the like are stored.

  Further, as shown in FIG. 9, information on the difficulty level of collation for each item is stored in the registration database 12a for the difficulty level of items. Since the gender is male / female or M / F, collation is easy, but in the case of names, there are different characters, and in the case of addresses, there are several ways to write, making collation difficult. In addition, for example, the name may be different from “Name XX”, “Insured Person XX”, “Household XX”, and “Non-Dependent XX”, making verification difficult. Become.

  The registration database 12a stores information such as a customer name and whether or not a document has been cut after delivery in association with the customer ID.

  Further, as shown in FIG. 10, the worker database 12b stores a work level for each worker ID. The work level is determined according to the proficiency level, appropriateness, etc. of the worker. The work level is classified into, for example, “A”, “B”, “C”, and the like. The worker ID is associated with a login ID and password, an IC card carried by the worker, a code printed on a name tag, and the like.

  In addition, in the image database 12c, as shown in FIG. 11, for each document ID, captured image data, a cut-out image cut out from the image data (an example of item image data, each item portion in the document) Image) and the like are stored. The clipped image is associated with the item and stored in the image database 12c. Note that the image data and the cut-out image may be separate databases. In addition to the document ID, the document ID may be an ID that can specify a document, such as a document feature amount and a work ID.

  Further, in the work result database 12d (an example of the storage unit), as shown in FIG. 12, the worker ID of the worker who collated the item and the document used for the collation are associated with the packaging ID and the item ID. Document ID, selection information indicating which part of the document is used for collation, and the like are stored.

  Further, as shown in FIG. 13, the examination result database 12e (an example of a storage unit) stores the worker ID and examination result of the worker who collated the items in association with the packaging ID and the item ID. Yes. The examination result is, for example, a collation result indicating whether the contents described in the set documents are the same, or data indicating whether or not there is a description. The examination result database 12e may store text data read from a resident card or the like.

  It may be managed by the same database of the same management server 10, or each database may be stored in a database of another management server.

  The storage unit 12 may store various programs such as an operating system and a server program. Note that the various programs may be acquired from another server or the like via the network 3, or may be recorded on a recording medium and read via a drive device.

  The communication unit 13 is connected to the network 3 and controls communication with the registration device 20, the image input device 30, and the verification terminal device 40.

  The output unit 14 is configured by, for example, a liquid crystal display element or an EL (Electro Luminescence) element.

(1.3 Configuration and Function of Registration Device 20)
Next, the configuration and function of the registration device 20 will be described with reference to FIG.

  FIG. 14 is a schematic diagram illustrating an example of the registration device 20. It is a block diagram which shows an example of a principal structure.

  Note that configurations and functions different from those of the management server 10 will be mainly described.

  As illustrated in FIG. 14, the registration device 20 that functions as a computer includes a control unit 21, a storage unit 22, a communication unit 23, an output unit 24, and an operation unit 25.

  The control unit 21 includes a CPU, a ROM, and a RAM, and controls the registration device 20. In the control unit 21, the CPU reads and executes various control programs stored in the ROM or RAM. The control unit 21 may read and execute a recording medium storing these programs.

  The storage unit 22 is configured by a hard disk drive or the like, and stores various programs.

  The communication unit 23 controls communication with the management server 10 and the like through the network 3.

  The output unit 24 is configured by, for example, a liquid crystal display element or EL, and displays various registration screens.

  The operation unit 25 is configured by, for example, a keyboard and a mouse.

(1.4 Configuration and Function of Image Input Device 30)
Next, the configuration and function of the image input device 30 will be described with reference to FIGS. 15 and 16.

  FIG. 15 is a block diagram illustrating an example of a schematic configuration of the image input device 30. FIG. 16 is a schematic diagram illustrating an example of the image input device 30.

  As illustrated in FIG. 15, the image input device 30 includes a control unit 31, a storage unit 32, a communication unit 33, an output unit 34, an operation unit 35, and an imaging unit 36.

  The control unit 31 has the same configuration as the control unit 21 and controls the image input device 30. The storage unit 32 has the same configuration as the storage unit 22 and stores various programs. The communication unit 33 controls communication with the management server 10 and the like.

  The output unit 34 has the same configuration as that of the output unit 24 and displays a captured image. Further, the output unit 34 has a printer and prints a front page.

  The operation unit 35 is configured by, for example, a keyboard and a mouse. Furthermore, the operation unit 35 includes an image input switch 35a that performs an imaging operation of the imaging unit 36 by the user's foot.

  The imaging unit 36 is a digital camera having an imaging element such as a charge coupled device (CCD) image sensor or a complementary metal oxide semiconductor (CMOS) image sensor.

  As shown in FIG. 16, the imaging unit 36 includes a plurality of digital cameras 36a. A plurality of documents (for example, a contract (document 50), a resident's card (document 51), etc.) are arranged on the table. In order to increase the resolution, each document is partially divided and a plurality of digital cameras 36a are used. Take an image. The imaging unit 36 may be a scanner, and scans and captures a document.

(1.5 Configuration and Function of Verification Terminal Device 40)
Next, the configuration and function of the verification terminal device 40 will be described with reference to FIG.

  As shown in FIG. 17, the collation terminal device 40 that functions as a computer is a portable terminal such as a portable wireless telephone or a PDA including a personal computer or a smartphone, for example, and includes a control unit 41, a storage unit 42, and a communication unit. 43, an output unit 44, and an operation unit 45.

  The control unit 41 has the same configuration as the control unit 21 and controls the verification terminal device 40. The storage unit 42 has the same configuration as the storage unit 22 and stores various programs. The communication unit 43 controls communication with the management server 10 and the like. The output unit 44 has the same configuration as the output unit 24, and displays an image for examination.

[2. Management System Operation]
Next, the operation of the management system according to one embodiment of the present invention will be described with reference to the drawings.

(2.1 Work process in management system)
First, an operation process in the management system will be described with reference to FIG.

  FIG. 18 is a schematic diagram illustrating an example of a work process in the management system 1.

  A set of documents composed of a plurality of documents is sent together from a customer (for example, a card company, an insurance company, etc.). For example, a cardboard box filled with an envelope containing a set of documents is sent from a customer.

  The set of a plurality of documents is, for example, a set of documents applied to the customer from each user of the customer (for example, an individual or a corporation applying for a card company, an insurance company, etc.). The set of documents includes application documents (for example, contracts and application forms) and identification documents. When two documents are required for identity verification, for example, a resident's card and a license, a resident's card, and a health insurance card. In the case of a corporation, it is a document with the representative director's mark on it as a corporate confirmation document.

  As shown in FIG. 18, in the process P1, an opening operation such as an envelope that has been sent is performed. For example, the delivered cardboard is opened, and an envelope containing a set of documents is taken out. Then, the envelope is opened and a set of documents is taken out.

  Next, in the process P2, confirmation of document deficiencies is performed. The document is transported to the place of the process P2, and it is checked whether all the document sets are prepared and whether the document is damaged. After confirmation, a set of documents is transported to the storage.

  Next, in step P3, the image input device 30 converts the document taken out from the storage into image data. The image input device 30 images a document and converts the document into image data. The image input device 30 transmits the image data to the management server 10. The management server 10 stores the received image data in the image database 12c. The management server 10 cuts out an image of each item of each document and stores the cut-out image in the image database 12c. A set of documents that have been converted into document image data is stored in a storage.

  Next, in step P4, a document item collation operation is performed. The verification terminal device 40 receives the worker ID of the worker, acquires a cut-out image of an item corresponding to the worker from the management server 10 and displays it. The verification terminal device 40 receives the verification result from the worker and transmits the verification result to the management server 10. The management server 10 stores the work results such as the worker ID and the collation process in the work result database 12d. The management server 10 stores the collation result and the like in the examination result database 12e.

  A front page may be created for a set of a plurality of documents. The front page includes a customer name, a front page ID for specifying a set of documents, the number of documents, a reception date, a process number, and the like. This front page may be included in the document set, or may exist in the electronic data and may not be included in the document set. The database of the storage unit 12 may store the document ID of each document in association with the front page ID. Further, the database of the storage unit 12 may store process numbers associated with front page IDs for front page management information.

  In step P1, a document ID for identifying each document such as a code may be assigned to each document. Examples of codes to be given include barcodes and two-dimensional codes. In step P3, a document ID may be assigned to each document by a code generated from the feature amount of the document image. Each document may be put in the receiving port of the apparatus for applying the barcode, and the code may be attached to the front page of the document set, or the code may be manually attached.

  Next, in step P5, return document collation is performed. The set of documents for which all items have been verified is carried out of the storage as return documents. In a terminal device (not shown) for collating returned documents that functions as a computer, the code on the front page of the document set is read by a reader, and collation for returning documents and delivery of examination results Preparations are made.

(2.2 Operation example of management server and registration device)
Next, operation examples of the management server and the registration apparatus will be described with reference to FIG.

  FIG. 19 is a sequence diagram illustrating an operation example of the management server 10 and the registration device 20.

  As shown in FIG. 19, the registration device 20 accepts a master registration operation for a document type (step S1). Specifically, the control unit 21 of the registration apparatus 20 receives an input such as a type for the document type ID from a registration worker. For example, in order to determine the content of the document type ID, on the screen of the output unit 24 of the registration device 20, a document name entry field or selection field together with the document type ID, or a municipality field or selection field if the type is a resident's card When the type is a contract, a customer name entry field is displayed. The registration device 20 receives input from the worker and transmits it to the management server 10.

  Next, the management server 10 performs master registration of the document type (step S2). Specifically, as shown in FIG. 6, the control unit 11 of the management server 10 stores the information received from the registration device 20 in the document type registration database 12a.

  Next, the registration device 20 accepts master registration work for the cutout area for each type (step S3). Specifically, the control unit 21 receives an input of each cutout area corresponding to the item of each document with respect to the document type ID from the registration worker. For example, in order to determine a cutout area of an image, an entry entry field or selection field, a cutout area coordinate entry field or area selection screen, together with a document type ID, a document name, etc., on the screen of the output unit 24 of the registration device 20 Etc. are displayed. The registration device 20 receives input from the worker and transmits it to the management server 10.

  Next, the management server 10 performs master registration of the cut-out area for each type (step S4). Specifically, as shown in FIG. 7, the control unit 11 stores the information received from the registration device 20 in the registration database 12a for the item cutout area.

  Next, the registration device 20 accepts master registration work of the difficulty level of the item (step S5). Specifically, the control unit 21 receives an input such as a difficulty level of matching for each item from a registration worker. For example, in order to determine the difficulty level of item matching, a difficulty level entry field or an area selection screen is displayed on the screen of the output unit 24 of the registration device 20 together with the item name. The registration device 20 receives input from the worker and transmits it to the management server 10.

  Next, the management server 10 performs master registration of the difficulty level of the item (step S6). Specifically, the control unit 11 stores the information received from the registration device 20 in the registration database 12a for item difficulty.

  Next, the registration device 20 accepts master registration work of the skill level of the worker (step S7). Specifically, the control unit 21 receives an input of a work level indicating the work ability of the worker for each worker from the registered worker. For example, in order to determine the work level, a work level entry field or an area selection screen is displayed on the screen of the output unit 24 of the registration device 20 together with the worker name, worker ID, and the like. The registration device 20 receives input from the worker and transmits it to the management server 10.

  Next, the management server 10 performs master registration at the worker level (step S8). Specifically, the control unit 11 stores the information received from the registration device 20 in the worker database 12b.

  Note that the order of the registration work is not limited to the above order, and the registration work requiring registration may be sequentially performed.

(2.3 Example of operation of management server and image input device)
Next, an operation example of the management server and the image input device, which is an operation of converting image data in the process P3, will be described with reference to FIG.

  FIG. 20 is a sequence diagram illustrating an operation example of the management server 10 and the image input device 20.

  As shown in FIG. 20, the image input device 30 images a document (step S10). The control unit 31 of the image input device 30 images the document by the imaging unit 36. As shown in FIG. 16, the documents 50 and 51 are arranged side by side on the table. When the operator steps on the image input switch 35a, the control unit 31 images the documents 50 and 51 with the digital camera 36a. Note that the control unit 31 may accept input of a customer name of a document to be imaged. Further, the control unit 31 may accept input of the type of each document in the document set. In addition, the control unit 31 may automatically generate a reception number, a work number, or the like as the packaging ID and document ID, or may receive an input of a reception number, a work number, or the like.

  Next, the image input device 30 corrects the image data (step S11). Specifically, the control unit 31 corrects the inclination of the captured image data. For example, the control unit 31 detects a document frame in the image by image processing and corrects the inclination.

  Next, the image input device 30 determines whether or not an image has been appropriately captured (step S12). Specifically, the control unit 31 detects folding or chipping of a document, and determines that an image is not properly captured when the degree of folding or the ratio of chipping is a predetermined value or more. In addition, even when the number of captured documents is not a specified number, the control unit 31 determines that an image is not properly captured. The control unit 31 displays the captured document on the screen of the output unit 34, the operator confirms, and the control unit 31 inputs the input whether or not the image is properly captured. You may accept via.

  When the image is appropriately captured (step S12; YES), the image input device 30 transmits the captured image (step S13). Specifically, the control unit 31 transmits image data to the management server 10 via the communication unit 33.

  When the image is not properly captured (step S12; NO), the image input device 30 returns to the process of step S10.

  Next, the image input device 30 deletes the image data (step S14). Specifically, after transmitting the image data, the control unit 31 deletes the image data captured from the storage unit 32, the RAM, or the like.

  Next, the management server 10 registers an image (step S15). Specifically, the control unit 11 receives image data from the image input device 30. The control unit 11 stores the received image data in the image database 12c.

  As described above, the management server 10 is an image acquisition unit that acquires a plurality of related documents, and the images of the documents in which information on items in the document is described according to a predetermined format corresponding to the documents. Functions as an example.

  Next, the management server 10 cuts out an image (step S16). Specifically, the control unit 11 specifies and extracts an image for each item by a later-described image cutout subroutine.

  As described above, the management server 10 functions as an example of a description area extracting unit that extracts a description area in which information is described from an image of each document based on a predetermined format corresponding to each document.

  Next, the management server 10 registers the cutout image (step S17). Specifically, the control unit 11 stores the image data for each extracted item in the image database 12c in association with the item.

  Next, the management server 10 generates a code image (step S18). Specifically, the control unit 11 generates a code image by a subroutine for generating a code image described later. The control unit 11 transmits the code image to the image input device 30 via the communication unit 13.

  As described above, the management server 10 functions as an example of a code image generation unit that generates a code image for specifying a plurality of related documents, and which combines the description areas of the respective documents. .

  Next, the image input device 30 creates a front page (step S19). Specifically, the control unit 31 receives a code image from the management server 10. Based on the type of document included in the document set, the control unit 31 prints the front page to which the code image is attached. A front page is attached on top of the set documents and stored in the vault.

(2.4 Image cropping subroutine)
Next, an image clipping subroutine will be described with reference to FIGS.

  FIG. 21 is a flowchart showing an image cutout subroutine. FIG. 22 is a schematic diagram illustrating an example of a front page.

  As shown in FIG. 21, the management server 10 specifies the type of document (step S20). For example, the control unit 11 specifies the contract type (contract form for each customer) from the customer name, and specifies the type of received document. In addition, the control unit 11 may recognize characters from the image data of the document, recognize a contract, a resident card, a municipality, and the like, and specify the type of the document.

  Next, the management server 10 cuts out an image of each item based on the document type (step S21). Specifically, the control unit 11 refers to the registration database 12a for the item cutout area, and cuts out an image for each item using the item cutout area based on the specified document type. As shown in FIGS. 2 and 3A, clipped images such as clipped areas 50a, 50b, and 50c (an example of a description area) and clip areas 51a and 51b (an example of a description area) are cut out. As an example of the description area of each document, when there is a ruled line as shown in FIG. 3A, the cutout area may or may not include a ruled line, and the cutout area includes a common area. May not be included, and other items may not be included.

  Note that the control unit 11 may cut out an image for each item by image processing. For example, the control unit 11 may extract an image for each item by pattern matching with reference to a template of the registration database 12a for the item extraction region.

  As described above, the management server 10 functions as an example of a description area extracting unit that extracts a description area in which information is described from an image of each document based on a predetermined format corresponding to each document.

(2.5 Code image generation subroutine)
Next, an image clipping subroutine will be described with reference to FIGS.

  FIG. 22 is a flowchart showing a subroutine for generating a code image. FIG. 23A to FIG. 23D are schematic diagrams illustrating examples of dummy layer images. 24A to 24C are schematic diagrams illustrating an example of an image of a description area in which information is described. FIG. 25 is a schematic diagram illustrating an example of a code image. 26A to 26D are schematic diagrams illustrating an example of a code image on which a dummy layer image is superimposed. 27A and 27B are schematic diagrams illustrating an example of a front page.

  As shown in FIG. 22, the management server 10 generates a dummy layer image (step S23). For example, the control unit 11 generates a dummy layer image (an example of a superimposition image) from a random character string. As shown in FIGS. 23A to 23D, the control unit 11 generates a dummy layer image so that a character string including alphanumeric characters, symbols, and the like fills a predetermined frame. The dummy layer image may be a character string in which the font size is changed as shown in FIG. 23B, the character is vertically written as shown in FIG. 23C, or the characters are turned upside down as shown in FIG. 23D. The dummy layer image may be a mosaic image.

Next, the management server 10 generates a composite image (step S24). Specifically, as shown in FIG. 24A to FIG. 24C, the control unit 11 starts from a non-common area where a name, etc. is written on each document of a contract, a certificate of proof for proof, and a license. Generate a configured item image. For example, the control unit 11 may generate an item image from a cutout image corresponding to each item. The cut-out images are connected according to the position of each item in the document. The control unit 11, from the image data of the book such, may be cut out item image. In addition, the control unit 11 may reduce or enlarge the size of the item image so as to match the size of the dummy layer image. As shown in FIG. 2, the control unit 11 may use an image of the non-common area NC as an item image.

  Next, as shown in FIG. 25, the control unit 11 generates a composite image from each item image of each document. For example, the control unit 11 binarizes each item image, cuts out a white part, and extracts only a pattern of a description part such as black. Next, the control unit 11 generates a composite image by superimposing the extracted pattern image of the description portion. Note that background images other than the pattern of the description portion may be subjected to transparency or transmission processing, or pixel position information of the pattern of the description portion may be extracted. Only the pattern of the description part may be extracted by OCR (Optical Character Recognition). Since some kind of code information is required, the OCR recognition rate may be low.

  As shown in FIG. 25, the control unit 11 may make the description information partially overlap as shown in FIG. 25, or the overlap of the description information is the most or the overlap is the least. The position of the item image of each document may be adjusted and overlapped.

  As described above, the management server 10 functions as an example of a code image generation unit that generates a code image for specifying a plurality of related documents, and which combines the description areas of the respective documents. . The management server 10 functions as an example of a code image generation unit that generates a code image in which the description areas of the documents are superimposed.

  In step S24, the control unit 11 may generate a superimposed code image in which a predetermined dummy layer image is superimposed on the composite image.

  Next, the management server 10 determines whether the void ratio is appropriate (step S25). Specifically, the control unit 11 calculates the void ratio from the pixel histogram of the composite image or the superimposed code image, and determines whether the void ratio is within a predetermined range.

  When the porosity is appropriate (step S25; YES), the management server 10 stores the code image (step S26). Specifically, the control unit 11 stores the generated code image in the storage unit 12.

  When the porosity is not appropriate (step S25; NO), the management server 10 determines whether the porosity is the upper limit (step S27). Specifically, the control unit 11 determines whether or not the calculated porosity exceeds the upper limit of a predetermined range.

  When the porosity does not exceed the upper limit (step S27; NO), the management server 10 adds one layer of dummy layer image (step S28). Specifically, the control unit 11 superimposes one dummy layer image on the composite image. Note that the control unit 11 may newly generate a dummy layer image and superimpose it.

  When the porosity exceeds the upper limit (step S27; YES), the management server 10 removes one layer of the dummy layer image (step S29). Specifically, the control unit 11 removes any of the dummy layer images superimposed on the composite image. Note that the information of the original composite image and the superimposed dummy layer image is cached in the storage unit 12 or the RAM until a code image with an appropriate void ratio is generated.

  As described above, the management server 10 functions as an example of a code image generation unit that generates a code image for specifying a plurality of related documents, and which combines the description areas of the respective documents. .

  After one layer of the dummy layer image is added or removed, the control unit 11 calculates the void ratio of the superimposed code image in step S25 and determines whether the void ratio is within an appropriate range.

  As described above, the management server 10 functions as an example of a code image generating unit that generates a superimposed code image in which a superimposing image having a predetermined porosity is superimposed on the code image. The management server 10 functions as an example of a code image generation unit that generates a superimposed code image in which a plurality of different images for superimposition are superimposed on the code image.

  Note that a composite image as shown in FIG. 25 may be a code image. In this case, the information of the part where the characters partially overlap is somewhat difficult to read. At first glance it may not be readable.

  As shown in FIG. 26A, a superimposed code image obtained by superimposing a single dummy layer image on a composite image may be used as a new code image. This superimposed code image is harder to read with the naked eye than a composite image as shown in FIG.

  As shown in FIG. 26B, a superimposed code image obtained by superimposing two dummy layer images on a composite image may be used as a new code image. This superimposed code image is more difficult to read with the naked eye, except for some items.

  As illustrated in FIG. 26C, a superimposed code image obtained by superimposing a three-layer dummy layer image on the composite image may be used as a new code image. The superimposed code image is difficult to read with the naked eye except for some characters of the items.

  As shown in FIG. 26D, a superimposed code image obtained by superimposing four layers of dummy layer images on the composite image may be used as a new code image. In this superimposed code image, the item information is almost unreadable with the naked eye.

  When the code image is generated, in step S19, based on the type of document included in the document set, the control unit 31 causes the printer of the output unit 34 to display the code image 60a (see FIG. 27A or 27B). Alternatively, the front pages 60 and 61 with the superimposed code image 61a) are printed.

(2.5 Example of operation of management server and verification terminal device)
Next, an operation example of the management server and the verification terminal device, which is an item verification operation in the process P4, will be described with reference to FIGS.

  FIG. 28 is a sequence diagram illustrating an operation example of the management server and the verification terminal device. FIG. 29 is a schematic diagram illustrating an example of an item examination screen. FIG. 30 is a schematic diagram illustrating an example of items in a document. 31A and 31B are schematic diagrams illustrating an example of an item examination screen.

  As shown in FIG. 28, the collation terminal device 40 receives input of worker information (step S30). Specifically, the control unit 41 of the verification terminal device 40 receives a login ID and password from the operation unit 45 as worker information. Note that the control unit 41 may receive worker information from an IC card carried by the worker or a code printed on a name tag by a reader. The control unit 41 transmits a request for a cut-out image for examination to the management server 10 together with the worker information.

  Next, the management server 10 specifies the level of the worker (step S31). Specifically, the control unit 11 refers to the worker database 12b and specifies the level of the worker based on the worker ID corresponding to the worker information.

  Next, the management server 10 transmits a cutout image corresponding to the level (step S32). Specifically, the control unit 11 refers to the registration database 12a for the difficulty level of the item, and specifies an item according to the level. The control unit 11 refers to the image database 12c and extracts a cutout image corresponding to the item to be specified. For example, the control unit 11 extracts a gender cut-out image for the beginner “C” level worker, and extracts an address cut-out image for the advanced “A” level worker. Extract.

  In the output unit 44 of the collation terminal device 40, the control unit 11 cuts out the cutout image together with the package ID and the document ID so that a cutout image corresponding to the item of the other document is displayed for the item of one document. Is transmitted to the collation terminal device 40 that requested it. The control unit 11 transmits the cut image to each verification terminal device 40 so that the level of the worker matches the difficulty level of the item for each item.

  Next, the collation terminal device 40 displays the examination image (step S33). Specifically, the control unit 41 displays the clipped image to be examined on the screen of the output unit 44. As shown in FIG. 29, on the screen of the output unit 44, the document names to be compared and compared (“contract”, “resident's card”) and the cut-out images of the cut-out areas 50a and 51a are displayed. By cutting out in this way, the described items are highlighted.

  As shown in FIG. 30, when the set of documents is document α, document β, document γ, the same items are present in document β. Therefore, when comparing the items of document α with the items of document β, As illustrated in FIG. 31A, the control unit 41 may display a clipped image of each item on the screen of the output unit 44.

  Next, the collation terminal device 40 receives an input of examination work (step S34). Specifically, as shown in FIG. 29, the control unit 41 displays a matching result button 55 on the screen of the output unit 44. When the operator performs collation and the collation result is correct, the operation unit 45 selects the OK button 55, and when the collation result is not correct, the operator selects the NG button 55.

  Further, as shown in FIG. 31A, one item of document α, which is item image data highlighted by being cut out and displayed, and a plurality of corresponding items of document β (item a, item a ′, item) The item used for collation among a ″) may be selected by the operator, and the control unit 41 may display the mark M to be added.

  The control unit 41 may determine the collation result based on information on the locus of the mark drawn by the operator with an input pen, a mouse, or the like. For example, when the operator draws the mark M with the input pen and the shape of the mark is close to a circle, the control unit 41 determines “OK”, and when the mark is close to “×”, the control unit 41 determines “NG”. May be. The management server 10 that has received the mark trajectory and shape information may determine the collation result.

  In addition, for each item of the document α, a mark or the like may be added to the item used for collation. Each mark may be the same, or the shape, form, etc. may be changed for each item. When a plurality of documents are used for collation for one document item, a mark may be set for each document used for collation. In this case, the mark may be changed so that the first priority collation location, the second priority collation location, and the like can be understood.

  Note that the control unit 41 may generate information associated with the document ID and the item ID as tag information so that the operator can know which item of which document is used for collation and examination.

  Here, as selection information, information indicating which one of the appropriate OK button 55 and the inappropriate NG button 55 is selected, information on the mark trajectory in the document, information on the mark form, information on the clicked position, Information such as the selected item or item ID, the order of operations, and the operation time may be mentioned.

  Next, the collation terminal device 40 transmits a work result (step S35). Specifically, the control unit 41, through the communication unit 43, as a work result that is an example of the collation result, worker ID, bag ID, item ID, examination result, selection information selected in the document, etc. It transmits to the management server 10.

  Next, the management server 10 combines the work results (step S36). Specifically, the control unit 11 receives the work result from each verification terminal device 40. The control part 11 memorize | stores the work result received from each collation terminal device 40 in work result database 12d for every packaging ID and item ID. As shown in FIG. 12, when the database is organized by classification for each bag ID and item ID, the work results are combined as a result. When the items are not sorted and arranged, the control unit 11 searches for the work result based on the packaging ID and the item ID, and integrates the work results.

  Next, the management server 10 registers the examination result (step S37). Specifically, the control unit 11 refers to the work result database 12d, searches the work result based on the packaging ID, collects appropriate / unsuitable information from the work result, and obtains the examination result as the examination result database 12e. To remember.

  When the collation work is completed for all items, a document confirmation work for returning the document is performed in step P5. Information such as packaging ID that read the code on the front page of the set of documents to confirm the work history from the terminal device for collation of returned documents when incomplete documents, missing examination results, etc. are found Is transmitted to the management server 10.

  The management server 10 refers to the work result database 12d, extracts the work result based on the packaging ID, and transmits it to the terminal device for collation work.

  For example, as shown in FIG. 31B, the collation terminal device displays an image with a mark added thereto on the screen of the output unit. The worker confirms the work history based on the image supplemented with the mark.

  As described above, according to the present embodiment, an image of each document, which is a plurality of related documents and in which information on items in the document is described according to a predetermined format corresponding to each document, is acquired, and according to each document. Based on a predetermined format, a description area containing information is extracted from the image of each document, and a code image for identifying a plurality of related documents is synthesized by combining the extracted description areas of each document. Can be generated. For this reason, since the code image itself includes a part of the contents of each related document and the position information of the description area, it becomes unique information for a group of a plurality of documents. Relevance to documents can be added, and it becomes easier to manage documents.

  When a superimposed code image in which a superimposed image having a predetermined porosity is superimposed on a code image is generated, it becomes difficult for humans to read (invisible), and information is easily protected. Further, in this case, the code image is made invisible and the superimposed code image can be used as a pseudo two-dimensional code, so that document management becomes easier.

  When generating a superimposed code image in which a plurality of different superimposing images are superimposed on a code image, it becomes difficult to read. Furthermore, the porosity as a pseudo two-dimensional code can be adjusted according to the code image.

  When the image for superimposition is an image in which symbols are arranged, the symbols look and become difficult to read at first glance.

  When generating a code image in which the description areas of each document are overlapped, the written characters are overlapped with each other, which makes it more difficult to read.

  Furthermore, the present invention is not limited to the above embodiments. Each of the embodiments described above is an exemplification, and any configuration that has substantially the same configuration as the technical idea described in the claims of the present invention and has the same operational effects can be used. It is included in the technical scope of the present invention.

1: Management system 10: Management server (management device)
11: Control unit 50, 51: Document 60a: Code image 61a: Superimposed code image

Claims (8)

Image acquisition means for acquiring an image of each document in which information of one or more items in the document is described according to a predetermined format corresponding to each document, and a plurality of related documents;
Based on a predetermined format corresponding to each document, description region extraction means for extracting a description region in which information is described for each item from the image of each document;
A composite image generation means for generating a composite image, which is an image for specifying the plurality of related documents, and which combines the description regions of the respective documents;
Equipped with a,
The management apparatus, wherein the composite image generation unit generates a composite image in which the description areas are overlapped so that a part of the description information described in the description areas of each document overlaps . The management device according to claim 1,
The management apparatus, wherein the composite image generation unit generates a composite image in which the description areas are overlapped so that a part of characters of the description information described in the description areas of the documents overlap . In the management device according to claim 1 or 2 ,
The management apparatus, wherein the composite image generation unit generates a superimposed composite image in which a composite image having a predetermined porosity is superimposed on the composite image. In the management device according to claim 3 ,
The management apparatus, wherein the composite image generation unit generates a superimposed composite image in which a plurality of different images for superimposition are superimposed on the composite image. In the management device according to claim 3 or 4 ,
The management apparatus, wherein the superimposing image is an image in which symbols are arranged. An image acquisition step for acquiring an image of each document, wherein the image acquisition means is a plurality of related documents, and information of one or more items in the document is described according to a predetermined format corresponding to each document; ,
A description area extracting step for extracting a description area in which information is described for each item from an image of each document based on a predetermined format according to each document;
A composite image generating step for generating a composite image in which the image generation means is an image for specifying the plurality of related documents, and the region including the description region of each document is combined; and
Only including,
A management method characterized in that, in the composite image generation step, a composite image in which the description areas are superimposed is generated so that a part of the description information described in the description areas of the documents overlaps . Computer
Image acquisition means for acquiring images of each of the documents in which information of one or more items in the document is described according to a predetermined format corresponding to each of the documents,
A description area extracting means for extracting a description area in which information is described for each item from an image of each document based on a predetermined format according to each document; and
It is an image for specifying a plurality of related documents, and functions as a composite image generation means for generating a composite image obtained by combining the description areas of each document ,
The composite image generating means, wherein as part of the description information described in the description region of each document overlap, program for managing device characterized that you generate a composite image overlaid the described region . In a management system comprising: a management device that manages document information related to a document; and an image input device that captures an image of the document and captures image data.
The management device is
Image acquisition means for acquiring, from the image input device, an image of each document that is a plurality of related documents and that describes information of one or more items in the document according to a predetermined format corresponding to each document When,
Based on a predetermined format corresponding to each document, description region extraction means for extracting a description region in which information is described for each item from the image of each document;
A composite image generation means for generating a composite image, which is an image for specifying the plurality of related documents, and which combines the description regions of the respective documents;
With
The management system, wherein the composite image generation unit generates a composite image in which the description areas are overlapped so that a part of the description information described in the description areas of the documents overlaps .