JP7392322B2 - Image processing device, image processing method, program for image processing device, and document management system - Google Patents

Description

The present invention relates to an image processing device, an image processing method, a program for the image processing device, and a document management system for processing images of documents.

In order to improve work efficiency, the contents of documents are digitized into electronic data, and after predetermined information is extracted from this data, work is performed for each predetermined information. For example, Patent Document 1 discloses an automatic document division, transmission, reception, and organization system that reads a document image by scanning the document, divides the read document image, and inputs each divided portion from a separate computer. .

Japanese Patent Application Publication No. 2012-199973

However, in the above-mentioned prior art, the divided images of the items of some documents are enlarged and displayed, but during examination etc., the contents of the same items of other documents can also be seen in a list, so it is not enough. Information was not protected.

Therefore, the present invention has been made in view of the above-mentioned problems, etc., and an example of the problem is to provide an image processing device etc. for taking more measures to protect information during work. .

In order to solve the above problem, the invention according to claim 1 includes item partial image specifying means for specifying an item partial image extracted from an image of a document and including an item described in the document; an enlargement means for enlarging the specified item partial image according to the size of a display area displayed on the document; and reducing the visibility of images other than the specified item partial image in the image of the document. mask image generation means for generating a mask image; and outputting image data that is superimposed on the mask image and displays the enlarged item partial image at a location corresponding to the identified location of the item partial image. The invention is characterized by comprising an output means for.

In the image processing apparatus according to claim 1, the invention according to claim 2 is characterized in that the output means superimposes the enlarged item partial image on the mask image and outputs the enlarged item partial image. The present invention is characterized in that image data is output to be displayed in the center of the mask image so as not to overlap the image.

Further, the invention according to claim 3 is the image processing apparatus according to claim 1 or 2, in which the mask image generating means does not completely eliminate visibility in the image of the document, The present invention is characterized in that a mask image is generated in which the visibility of images other than the item partial images is reduced .

Further, the invention according to claim 4 is the image processing apparatus according to claim 1 or 2, wherein the mask image generating means generates an image other than the specified item partial image in the image of the document. The method is characterized in that the mask image filled with black is generated. Further, in the image processing apparatus according to any one of claims 1 to 4, when the enlarging means enlarges the specified item partial image, the enlarged If the specified item partial image does not fit within the size of the display area, the identified item partial image is divided into divided item images, and the divided item images are rearranged so as to fit within the size of the display area. An image processing device further comprising dividing means. Further, in the image processing apparatus according to claim 5, the invention according to claim 6 is characterized in that the image dividing means divides the divided item image by separating the items written in the specified item partial image. It is characterized by being divided into .

In addition, the invention according to claim 7 includes an item partial image specifying step in which the item partial image specifying means specifies an item partial image extracted from the image of the document and including the item described in the document; an enlargement step in which the means enlarges the specified item partial image according to the size of a display area displayed on the screen; and a mask image generating means enlarges the specified item partial image in the image of the document. a mask image generation step of generating a mask image for reducing the visibility of images other than the image; and an output means superimposing the enlarged item partial image on the mask image and converting the enlarged item partial image into the identified item partial image. and an output step of outputting image data to be displayed at a location corresponding to the location .

Further, the invention according to claim 8 provides a computer with an item partial image specifying means for specifying an item partial image extracted from an image of a document and including an item described in the document, and a display displayed on a screen. Enlarging means for enlarging the specified item partial image according to the size of the area; generating a mask image for reducing the visibility of images other than the specified item partial image in the document image; Functions as a mask image generation means and an output means for outputting image data that is superimposed on the mask image and displays the enlarged item partial image at a location corresponding to the identified location of the item partial image. It is characterized by causing

Further, the invention according to claim 9 provides a document management system including an image processing device that processes an image of a document, and a terminal device that displays the image of the document for work, wherein the image processing device an item partial image specifying means for specifying an item partial image including the item described in the document extracted from the image of the document; an enlargement means for enlarging an item partial image; a mask image generation means for generating a mask image for reducing the visibility of images other than the identified item partial image in the image of the document ; and output means for outputting image data for displaying the enlarged item partial image at a location corresponding to the identified location of the item partial image .

According to the present invention, the specified item partial image is enlarged according to the size of the display area displayed on the screen, and the visibility of images other than the specified item partial image in the document image is reduced. Since the image data displaying the item partial image enlarged with respect to the mask image is output, it becomes easier to work on the document while protecting information during work such as examination of the document.

1 is a schematic diagram showing an example of a general configuration of a document management system according to an embodiment of the present invention. FIG. 2 is a schematic diagram showing an example of a document. FIG. 2 is a schematic diagram showing an example of a document. FIG. 2 is a block diagram showing an example of a schematic configuration of the management server in FIG. 1. FIG. FIG. 2 is a schematic diagram showing an example of data in a database in the management server of FIG. 1. FIG. FIG. 2 is a schematic diagram showing an example of data in a database in the management server of FIG. 1. FIG. 2 is a block diagram showing an example of a schematic configuration of the registration device in FIG. 1. FIG. 2 is a block diagram showing an example of a schematic configuration of the image input device of FIG. 1. FIG. FIG. 2 is a block diagram showing an example of a schematic configuration of the verification terminal device in FIG. 1. FIG. FIG. 2 is a sequence diagram showing an example of the operation of the management server and registration device in FIG. 1; 2 is a sequence diagram showing an example of the operation of the management server and image input device in FIG. 1. FIG. FIG. 2 is a sequence diagram showing an example of the operation of the management server and verification terminal device in FIG. 1; 13 is a flowchart showing a subroutine for generating an examination image in FIG. 12. FIG. FIG. 2 is a schematic diagram showing an example of a document to be examined. It is a schematic diagram which shows an example of an examination screen. It is a schematic diagram which shows an example of an examination screen. It is a schematic diagram which shows an example of an examination screen. It is a schematic diagram which shows an example of an examination screen. It is a schematic diagram which shows an example of an examination screen. It is a schematic diagram which shows an example of an examination screen. It is a schematic diagram which shows an example of an examination screen. It is a schematic diagram which shows an example of an examination screen. It is a schematic diagram which shows an example of an examination screen. It is a schematic diagram which shows an example of an examination screen. It is a schematic diagram which shows an example of an examination screen. It is a schematic diagram which shows an example of an examination screen. It is a schematic diagram which shows an example of an examination screen. FIG. 3 is a schematic diagram showing an example of separating item partial images. It is a schematic diagram which shows an example of an examination screen. It is a schematic diagram which shows an example of an examination screen.

Embodiments of the present invention will be described below with reference to the drawings. Note that the embodiment described below is an embodiment in which the present invention is applied to a document management system.

[1. Document management system configuration and functional overview]
(1.1 Structure and functions of document management system)
First, the configuration and general functions of a document management system according to an embodiment of the present invention will be explained using FIGS. 1 to 4.

FIG. 1 is a schematic diagram showing an example of a general configuration of a document management system 1 according to the present embodiment. 2 to 4 are schematic diagrams showing examples of documents.

As shown in FIG. 1, a document management system 1, which is an example of a file generation system, works with a management server 10 that manages document information related to documents, and registers document types and cutout areas of item parts for each type. It includes a registration device 20, an image input device 30 that takes an image of a document and imports the document image, and a verification terminal device 40 that performs verification work of document items. Here, examples of document information include document images, item partial images cut out from document images, text data created from item partial images, electronic data such as delivery data for delivery to customers, etc. . Here, the item partial image is preferably an image of a portion of the document that includes one item and does not include other items.

The management server 10, which is an example of an image processing device, generates a file containing the document image and management information based on the document image from the image input device 30. Furthermore, the management server 10 manages the work in the registration device 20, image input device 30, and verification terminal device 40.

The registration device 20 preliminarily performs master registration of document types, setting of cropping areas for document items for each type, setting of item matching difficulty, setting of operator proficiency, and item partial images. Registration of examination questions will be carried out. Note that the examination questions are the contents of the questions displayed for each item to be examined during the examination. For example, in the case of a name, the question is whether the name has been entered.

The image input device 30, which is an example of an image acquisition device, captures an image of a document received from a customer and acquires the document image. The image input device 30 also creates a front page attached to the document. Documents with front pages attached are stored in the storage 5.

The verification terminal device 40 is, for example, a personal computer, a mobile terminal such as a portable wireless telephone including a smartphone, or a tablet terminal. The verification terminal device 40 displays images of documents to be verified and examined. The verification terminal device 40 is installed according to each worker.

The management server 10, the registration device 20, the image input device 30, and the verification terminal device 40 are capable of mutually transmitting and receiving data via the network 3 using, for example, TCP/IP as the communication protocol. . Note that the network 3 is constructed of, for example, a local area network, the Internet, a dedicated communication line (for example, a CATV (Community Antenna Television) line), a mobile communication network, a gateway, and the like.

The document is, for example, an application document such as a contract. Documents that can be used to confirm the identity of the person include resident card, driver's license, family register, health insurance card, passport, and receipts (for example, receipts for utilities such as electricity and gas that have name and address written on them). documents such as registered documents, certified copies of registers, and delivery notes. Note that the document may be not only a flat sheet of paper but also a three-dimensional document, as long as readable information is written on the surface of the document.

Examples of document types include contracts, resident records, driver's licenses, and the like. Further, the types of documents are classified according to the format of the contract for each customer in the case of a contract, and according to the format of each municipality in the case of a certificate of residence.

As shown in FIG. 2, when the document is an application form (document 50), the title, name, address, telephone number, etc. are written on the surface of the document. Common areas for application forms of the same format include title, name, address, telephone number, and the like. Non-common areas of the application form include personal information such as name (cutout area 50a), address (cutout area 50b), and telephone number (cutout area 50c). Note that the common area is a part of a common format that is common to documents of the same format. Non-common areas are parts of documents of the same format that differ from applicant to applicant. Here, the image of the cutout area is the item partial image.

As shown in FIG. 3, when the document is a residence card, the name of the city, town, village, address, name, date of birth, gender, etc. are written on the surface of the document. Common areas for resident records in the format of a certain municipality (an example of a predetermined format depending on the document) include the name of the document, the name of the municipality, address items, full name items, date of birth, gender items, etc. It will be done. Non-common areas of the resident record include personal information such as address (cutout area 51b), name (cutout area 51a), date of birth, and gender.

If the document is a residence card, the format of the entry (an example of a predetermined format depending on the document) differs depending on the municipality.

As an example of a predetermined format depending on the document, if the document is a driver's license, the name, date of birth, address, photo, etc. are written on the front of the document. Common areas of driver's licenses include name, address, date of birth, photo, etc. Non-common areas of driver's licenses include personal information such as name, date of birth, address, and personal photo.

Here, the types of items include a name item, an address item, a telephone number item, a seal imprint item for seal impression certification, a gender item, a date of birth item, a photo item, and the like. The item type corresponds to the item ID.

Multiple related documents are multiple documents related to one individual or one corporation. At least two or more documents relating to the same individual or the same legal entity. For example, from an individual or a corporation's application documents such as contracts, documents for identifying the person (residence certificate, driver's license, family register, health insurance card, passport, receipt), documents such as delivery notes, etc. At least two or more documents. Examples of multiple related documents include, for example, a combination of a contract, a residence card, and a driver's license, a combination of a contract, a residence card, and a passport, an application document, a combination of a health insurance card, an application document, Examples include combinations of receipts, contracts, and certified copies of registers. These related documents are sent, for example, in an envelope containing a set of documents.

Note that the document is not limited to a paper document, and may be an electronic data document. In this case, the electronic data becomes an image of the document. The management server 10 may accept electronic data documents via the network 3 through web submission. Examples of electronic data documents include electronic data documents digitized by scanning certificates, etc., electronic data documents input on a web input screen, and the like.

(1.2 Configuration and functions of management server 10)
Next, the configuration and functions of the management server 10 will be explained using FIGS. 4 to 6.

FIG. 4 is a block diagram showing an example of a general configuration of the management server. 5 and 6 are schematic diagrams showing an example of data in a database in the management server.

As shown in FIG. 4, the management server 10, which is a computer, includes a control unit 11 that controls the management server 10, a storage unit 12 that has various databases, and a communication unit 13 that communicates with each management server 10 and registration device 20. , and an output unit 14 that displays management information and the like.

The control unit 11 includes, for example, a CPU (Central Processing Unit), a ROM (Read Only Memory), and a RAM (Random Access Memory). The control unit 11 includes, for example, a CPU, a ROM, and a RAM. In the control unit 11, the CPU reads and executes various control programs stored in the ROM and RAM. The control unit 11 controls each unit of the management server 10 (storage unit 12, communication unit 13, output unit 14, etc.). Note that the control unit 11 may read and execute a recording medium or the like that stores these programs.

The storage unit 12 includes, for example, a hard disk drive. The storage unit 12 includes a registration database 12a that stores data registered in advance, a worker database 12b that stores worker levels, etc., an image database 12c that stores image data of captured documents, cut-out images, etc. A work result database 12d etc. that stores the work results of documents is constructed.

Here, for example, for the item partial image of the item "name", examination work, input work, comparison work, and data delivery work are performed in this order. For the item partial image of the item "address," examination work, comparison work, and data delivery work are performed in order. For the item partial image of the item "gender", input work, comparison work, and data delivery work are performed in this order. For the item partial image of the item "date of birth," input work and data delivery work are performed in order.

Examples of the examination work include paper examination work in which a document is examined on paper, screen examination work in which examination is performed on a screen, and the like.

In addition, the examination work includes the work of determining whether an item requires examination or not, and the work of performing a paper examination or performing an examination on a screen if an examination is necessary after determining whether or not an examination is necessary. For example, the work of determining how to conduct the examination, and in the case of screen examination, the work of determining who will conduct the examination. During the screen review, it is determined whether the content of the document is correct and the results are entered.

The input work involves inputting text data such as document information (characters) while looking at the handwritten characters displayed on the screen. Note that the screen examination for determining whether there are any problems with the contents of the document and entering the results may be performed as an examination work or as an input work.

In the comparison work, information input by other workers is compared, or input text is compared with data that has been character-recognized by OCR (Optical Character Recognition).

The data delivery work includes the delivery of materials summarizing examination results, etc., and the return of documents.

In the document type registration database 12a, document types such as application forms, resident cards, licenses, contracts, etc. are recorded in association with type code (document type ID) that specifies the type of document. . Further, the registration database 12a stores the names of cities, towns and villages for resident records, customer names for application forms, and the like.

In addition, the registration database 12a for item cutout areas stores cutout areas and the like corresponding to each item of the document format in association with an ID indicating the type of document. When the cutout area 50a is a rectangle, the position information of the vertices located on the diagonal of the rectangle becomes the cutout area 50a. Each cutout area corresponds to each item and may be associated with an item ID. The registration database 12a for the item extraction area stores various templates related to contracts for each customer, resident records for each municipality, and the like.

Furthermore, the item difficulty level registration database 12a stores information on the difficulty level of matching for each item. Since gender is male/female or M/F, it is easy to check, but names have different characters, and addresses can be written in several ways, making checking difficult. Also, for example, names may be written in different ways, such as "name ○○", "insured person name ○○", "head of household ○○", and "non-dependent person ○○", making verification difficult. Become.

Further, the registration database 12a stores information such as the customer's name, whether or not documents are to be cut after delivery, etc., in association with the customer ID.

Further, as shown in FIG. 5, the worker database 12b stores a work level for each worker ID. Note that the work level is determined based on the proficiency, suitability, etc. of the worker. The work level is classified into "A", "B", "C", etc., for example. Note that the worker ID is associated with a login ID and password, an IC card carried by the worker, a code printed on a name tag, and the like.

The image database 12c also stores, for each document ID, captured image data, cut-out images cut out from the image data (an example of item image data, and item partial images of each item in the document), etc. There is. The cutout images are stored in the image database 12c in association with the items. Note that the image data and the item partial image may be provided in separate databases. In addition to the document ID, the document ID, which is an example of the management number, may be any ID that can identify the document, such as the feature amount of the document or the work ID. When an electronic data document is received through web submission, image data of the received electronic data document may be stored in the image database 12c instead of the captured image data.

As shown in FIG. 6, the work result database 12d stores the worker ID of the worker who verified the item and the examination result in association with the packaging ID and the item ID. The examination result, which is an example of the work result, is, for example, the result of checking whether the contents written in the documents in the set are the same, or the data on whether or not the documents are written. Note that the document ID of each document may be used instead of the package ID that specifies a plurality of documents.

In addition, the work result database 12d also includes the worker ID of the worker who matched the item, the document ID of the document used for matching, and the information about which part of the document was used for matching, in association with the package ID and item ID. The selection information and the like are stored. Further, the work result database 12d may store text data read and input from a residence card or the like. The result of character recognition performed by OCR may be stored in the work result database 12d.

Furthermore, the storage unit 12 may include a received document database that stores electronic data of documents received through web submission. The received document database may store electronic data of received documents in association with management numbers such as reception numbers and document IDs.

They may be managed by the same database of the same management server 10, or each database may be stored in a database of another management server.

Furthermore, the storage unit 12 may store various programs such as an operating system and a server program. Note that the various programs may be obtained, for example, from another server or the like via the network 3, or may be recorded on a recording medium and read via a drive device.

The communication unit 13 is connected to the network 3 and controls communication with the registration device 20, the image input device 30, and the verification terminal device 40.

The output unit 14 is configured by, for example, a liquid crystal display element or an EL (Electro Luminescence) element.

The management server 10 performs processing such as enlarging the specified item partial image according to the size of the display area displayed on the screen.

(1.3 Configuration and functions of registration device 20)
Next, the configuration and functions of the registration device 20 will be explained using FIG. 7.

FIG. 7 is a schematic diagram showing an example of the registration device 20. It is a block diagram showing an example of essential composition.

Note that the configuration and functions that are different from those of the management server 10 will be mainly explained.

As shown in FIG. 7, the registration device 20 functioning as a computer includes a control section 21, a storage section 22, a communication section 23, an output section 24, and an operation section 25.

The control unit 21 includes a CPU, a ROM, and a RAM, and controls the registration device 20. In the control unit 21, the CPU reads and executes various control programs stored in the ROM and RAM. Note that the control unit 21 may read and execute a recording medium or the like that stores these programs.

The storage unit 22 is composed of a hard disk drive or the like, and stores various programs.

The communication unit 23 controls communication with the management server 10 and the like through the network 3.

The output unit 24 is composed of, for example, a liquid crystal display element or an EL, and displays various registration screens.

The operation unit 25 includes, for example, a keyboard, a mouse, and the like.

(1.4 Configuration and functions of image input device 30)
Next, the configuration and functions of the image input device 30 will be explained using FIG. 8.

FIG. 8 is a block diagram showing an example of a schematic configuration of the image input device 30. As shown in FIG.

As shown in FIG. 8, the image input device 30 includes a control section 31, a storage section 32, a communication section 33, an output section 34, an operation section 35, and an imaging section 36.

The control unit 31 has the same configuration as the control unit 21 and controls the image input device 30. The storage unit 32 has the same configuration as the storage unit 22 and stores various programs. The communication unit 33 controls communication with the management server 10 and the like.

The output unit 34 has the same configuration as the output unit 24, and displays captured images. Furthermore, the output unit 34 has a printer and prints a front page.

The operation unit 35 includes, for example, a keyboard and a mouse. Further, the operation unit 35 may include an image input switch that allows the image capturing unit 36 to take an image using the user's foot.

The imaging unit 36 is, for example, a digital camera having an imaging element such as a CCD (Charge Coupled Device) image sensor or a CMOS (Complementary Metal Oxide Semiconductor) image sensor.

The imaging unit 36 is composed of a plurality of digital cameras. Multiple documents (for example, application form (document 50), resident card (document 51), etc.) are lined up on a table, and in order to increase resolution, each document is partially separated and imaged using multiple digital cameras. be done. Note that the imaging unit 36 may be a scanner, and scans the document to take an image. The image input device 30 uses the imaging unit 36 to photograph a document and obtain a document image.

(1.5 Configuration and functions of verification terminal device 40)
Next, the configuration and functions of the verification terminal device 40 will be explained using FIG. 9.

As shown in FIG. 9, the verification terminal device 40 functioning as a computer is, for example, a personal computer, a mobile terminal such as a mobile radio telephone including a smartphone, or a PDA, and includes a control section 41, a storage section 42, and a communication section. 43, an output section 44, and an operation section 45.

The control unit 41 has the same configuration as the control unit 21 and controls the verification terminal device 40. The storage unit 42 has the same configuration as the storage unit 22 and stores various programs. The communication unit 43 controls communication with the management server 10 and the like. The output unit 44 has the same configuration as the output unit 24, and displays images for examination.

[2. Operation of document management system]
Next, the operation of the document management system according to one embodiment of the present invention will be explained using figures.

(2.1 Operation example of management server and registered device)
First, an example of the operation of the management server and the registration device will be described using FIG. 10.

FIG. 10 is a sequence diagram showing an example of the operation of the management server 10 and the registration device 20.

As shown in FIG. 10, the registration device 20 receives a document type master registration operation (step S1). Specifically, the control unit 21 of the registration device 20 receives input of the type, etc. for the document type ID from the registration operator. For example, in order to determine the content of the document type ID, the screen of the output unit 24 of the registration device 20 displays the document type ID as well as an entry field or selection field for the document name, and if the type is a residence card, a municipality entry field or selection field. , if the type is a contract, a column for entering the customer name, etc. will be displayed. The registration device 20 receives input from the worker and transmits it to the management server 10.

Next, the management server 10 performs master registration of document types (step S2). Specifically, the control unit 11 of the management server 10 stores the information received from the registration device 20 in the registration database 12a for document types.

Next, the registration device 20 receives a master registration task for each type of cutout area (step S3). Specifically, the control unit 21 receives an input of each cutout area corresponding to each document item for the document type ID from the registered operator. For example, in order to determine the cropping area of an image, the document type ID, document name, etc. are displayed on the screen of the output unit 24 of the registration device 20, as well as an entry column or selection column for items, a column for inputting the coordinates of the cropping area, or an area selection screen. etc. will be displayed. The registration device 20 receives input from the worker and transmits it to the management server 10.

Next, the management server 10 performs master registration of cutout areas for each type (step S4). Specifically, the control unit 11 stores the information received from the registration device 20 in the registration database 12a for the item extraction area.

Further, the registration device 20 accepts a master registration task for the difficulty level of the item. Specifically, the control unit 21 receives input such as the difficulty level of matching for each item from the registered operator. For example, in order to determine the difficulty level of matching items, an entry column for difficulty level, an area selection screen, etc. are displayed on the screen of the output unit 24 of the registration device 20 together with the item name. The registration device 20 receives input from the worker and transmits it to the management server 10.

Next, the management server 10 performs master registration of the difficulty level of the item. Specifically, the control unit 11 stores the information received from the registration device 20 in the registration database 12a for item difficulty levels.

Next, the registration device 20 receives a master registration task of the worker's proficiency level. Specifically, the control unit 21 receives input from registered workers about the work level indicating the work ability of each worker. For example, in order to determine the work level, an entry field for the work level, an area selection screen, etc. are displayed on the screen of the output unit 24 of the registration device 20 along with the worker name, worker ID, etc. The registration device 20 receives input from the worker and transmits it to the management server 10.

Next, the management server 10 performs master registration of worker levels. Specifically, the control unit 11 stores the information received from the registration device 20 in the worker database 12b.

Note that the order of the registration work is not limited to the above order, and the registration work may be performed in the order in which the need for registration arises.

Next, the registration device 20 receives the registration work of the examination questions for the item partial images (step S5). Specifically, the control unit 21 receives input of examination questions for each item corresponding to the item partial image from the registered operator. For example, in the case of a name, the examination question is ``Whether or not it is filled in?'' and in the case of an address, ``The item to be viewed is...''. On the screen of the output unit 24 of the registration device 20, entry fields for examination questions are displayed along with item names and the like. The registration device 20 receives input from the worker and transmits it to the management server 10.

Next, the management server 10 registers examination questions for the item partial images (step S6). Specifically, the control unit 11 stores the information received from the registration device 20 in the registration database 12a for examination questions.

Note that when receiving a set of documents from a customer, the registration device 20 accepts the task of registering a case number (or reception number) for each set of documents and a barcode corresponding to the management number of the case number. The registration device 20 receives input from the worker and transmits it to the management server 10. The management server 10 stores the case number and the information received from the registration device 20 in a registration database 12a for management numbers. Here, examples of document management numbers include reception numbers, case numbers, and document IDs assigned to each document. The reception number or case number may be for each set of documents received from the customer, or for each user of the customer.

Each of the above registrations may be performed from a separate registration device 20 or from each terminal of a worker who performs the registration work.

(2.2 Operation example of management server and image input device)
Next, an example of the operation of the management server and the image input device will be described using FIGS. 11 and 19.

FIG. 11 is a sequence diagram showing an example of the operation of the management server 10 and the image input device 30.

A customer (for example, a credit card company, an insurance company, etc.) sends a set of multiple documents all at once. For example, a customer may send you a cardboard box filled with envelopes containing a set of documents.

The set of multiple documents is, for example, a set of documents applied to the customer by each user of the customer (for example, an individual or corporation applying to a credit card company, insurance company, bank, etc.). The document set includes application documents (eg, contract, application form), identity verification documents, and the like. When two documents are required for identity verification, for example, a resident's card and a driver's license, a resident's card and a health insurance card, etc. In the case of a corporation, a document stamped with the representative director's seal is required to confirm the corporation. There are various sets of documents, including those for life insurance, non-life insurance, mortgage loans, and bank accounts. Furthermore, in the case of an insurance application, the set of documents may be divided into fire insurance and earthquake insurance, and in the case of a house purchase application or mortgage loan, the set of documents may be divided into land and building. In this case, the reception number or case number may be assigned different numbers for fire insurance, earthquake insurance, land and buildings, or a branch number may be attached.

The envelopes etc. that have been sent will be opened. For example, a delivered cardboard box is opened and an envelope containing a set of documents is removed. The envelope is then opened and the set of documents removed. A case number is assigned as a management number to a set of documents, and the case number and barcode are registered.

Next, a check is performed to determine if there are any deficiencies in the documents. Checks are made to see if all sets of documents are complete and that there are no damaged documents. After the confirmation work, the set of documents is transported to the storage 5.

Next, the document taken out from the storage 5 is converted into image data.

As shown in FIG. 11, the image input device 30 captures an image of the document (step S10). The control unit 31 of the image input device 30 uses the imaging unit 36 to image or scan a document at high resolution to obtain image data of the document image. Here, high resolution includes 2K, 4K, and 8K resolutions. Furthermore, units for measuring resolution include dots per inch (dpi), pixels per inch (ppi), etc.

Note that a document ID such as a two-dimensional code, one-dimensional code, or number may be attached to each document as a management number before the document is photographed. For example, the contents of the document ID are printed or pasted on the upper right corner of the document. In addition, when accepting documents as electronic data such as web submission, the management server 10 issues a reception number as a management number, associates it with the reception number, and stores the electronic data of the document in a received document database, etc. Good too.

For example, documents 50 and 51 are placed side by side on a table. When the worker steps on the image input switch, the control unit 31 images the documents 50 and 51 using a digital camera. Note that the control unit 31 may accept input of the customer name of the document to be imaged. Further, the control unit 31 may accept input of the type of each document in the set of documents. Further, the control unit 31 may automatically generate a reception number, work number, etc. as the package ID and document ID, or may accept input of the reception number, work number, etc. Alternatively, the control unit 31 may identify the type of document by performing character recognition from the photographed document image of the document.

Next, the image input device 30 corrects the image data (step S11). Specifically, the control unit 31 corrects the tilt etc. of the captured document image. For example, the control unit 31 detects the frame of the document in the image through image processing, and corrects the inclination.

Next, the image input device 30 determines whether the image has been appropriately captured (step S12). Specifically, the control unit 31 detects folds, chips, etc. in the document, and determines that the image is not properly captured if the degree of folds or the percentage of chips is greater than a predetermined value. Furthermore, if the number of imaged documents is not the specified number, the control unit 31 determines that the images have not been appropriately captured. Note that the control unit 31 displays the imaged document on the screen of the output unit 34, and allows the operator to check it and input whether the image has been properly captured. It may be accepted via.

If the image has been appropriately captured (step S12; YES), the image input device 30 transmits the captured image (step S13). Specifically, the control unit 31 transmits image data to the management server 10 via the communication unit 33.

If the image is not captured properly (step S12; NO), the image input device 30 returns to the process of step S10.

Next, the image input device 30 erases the image data (step S14). Specifically, after transmitting the image data, the control unit 31 erases the image data of the captured document image from the storage unit 32, RAM, or the like.

Next, the management server 10 registers the image (step S15). Specifically, the control unit 11 receives image data of a document image from the image input device 30. The control unit 11 stores the received image data in the image database 12c. Note that when the document is electronic data from the beginning, such as in the case of web submission, the control unit 11 may acquire image data of the received document image from a received document database or the like.

Next, the management server 10 cuts out the image (step S16). Specifically, the control unit 11 specifies the type of document, and cuts out an item partial image of each item based on the document type.

More specifically, the control unit 11 acquires the document type ID from the management information page data of the document image file, and specifies the type of document. Note that the type of contract (the format of the contract for each customer) may be specified from the customer name, or the type of the received document. Alternatively, the control unit 11 may perform character recognition from the image data of the document to recognize a contract, a resident card, a municipality, etc., and specify the type of document.

The control unit 11 refers to the registration database 12a for item cutout areas, and specifies and extracts the item partial image for each item based on the specified document type using the item cutout area. As shown in FIGS. 2 and 3, item partial images such as cutout areas 50a, 50b, 50c, cutout areas 51a, 51b, etc. are cut out. As shown in Figure 3, if there are ruled lines, the cutout area may or may not include the ruled lines, and the cutout area may or may not include a common area, and other items may or may not be included. should not be included.

Note that the control unit 11 may cut out an item partial image for each item by image processing. For example, the control unit 11 may refer to a template or the like in the registration database 12a for the item cutting region and cut out the item partial image for each item by pattern matching. The control unit 11 may specify the document type and cut out the image of each item from the difference image with the blank document image.

Next, the management server 10 registers the cutout image (step S17). Specifically, the control unit 11 associates the extracted image data for each item with the case number, document ID, item ID, etc., and stores it in the image database 12c.

(2.3 Operation example of management server and verification terminal device)
Next, an example of the operation of the management server and the verification terminal device will be described using FIGS. 12 to 18.

FIG. 12 is a sequence diagram showing an example of the operation of the management server 10 and the verification terminal device 40. FIG. 13 is a flowchart showing a subroutine for generating an examination image. FIG. 14 is a schematic diagram showing an example of a document to be examined. 15 to 18 are schematic diagrams showing examples of examination screens.

As shown in FIG. 12, the verification terminal device 40 receives input of worker information (step S20). Specifically, the control unit 41 of the verification terminal device 40 receives the login ID and password from the operation unit 45 as worker information. Note that the control unit 41 may receive worker information from an IC card carried by the worker or a code printed on a name tag using a reader. The control unit 41 transmits a request for an item partial image for examination to the management server 10 along with worker information.

Next, the management server 10 identifies the work and the level of the worker (step S21). Specifically, the control unit 11 refers to the work information database 12d, acquires work progress information for each document and item based on the document ID, item ID, etc., and specifies the work. The control unit 11 refers to the worker database 12b and identifies the level of the worker based on the worker ID corresponding to the worker information.

Next, the management server 10 generates an examination image and transmits the examination image to the verification terminal device 40 (step S22). The management server 10 generates an examination image using a subroutine for generating an examination image.

Here, the subroutine for generating the examination image will be explained using FIG. 13.

As shown in FIG. 13, the management server 10 identifies the item and acquires the item partial image (step S30). Specifically, the control unit 11 refers to the registration database 12a for item difficulty levels and specifies items according to the level. The control unit 11 refers to the image database 12c and obtains a cutout image corresponding to the specified item. For example, the control unit 11 obtains a cut-out image of gender for a beginner C-level worker, and obtains an address cut-out image for an advanced A-level worker.

For example, when the item "name" is specified at level B, the control unit 11 refers to the image database 12c based on each document ID corresponding to the packaging ID and the name item ID, and uses the information shown in FIG. As shown in FIG. 3, in the application form document 50 and the resident record document 51, an item partial image of the cutout area 50a and an item partial image of the cutout area 51a are obtained.

In this way, the management server 10 functions as an example of an item partial image specifying means for specifying an item partial image extracted from a document image and including an item described in the document.

Next, the management server 10 generates a mask image (step S31). As shown in FIG. 15, the control unit 11 generates a mask image M1 for reducing the visibility of the image of the document 50 in areas other than the cutout area 50a of the item partial image of the specified item. The control unit 11 also generates a mask image M2 for the image of the document 51, which reduces the visibility of areas other than the cutout area 51a of the item partial image of the specified item. The mask images M1 and M2 have windows w at locations corresponding to the identified items.

Note that instead of completely eliminating visibility as shown in FIG. 15, the mask image M may be such that a dot pattern is superimposed to reduce visibility, as shown in FIG. The mask pattern to be superimposed is not limited to dots, and may be, for example, a random character string. At this time, the corresponding item name may or may not be masked.

In this manner, the management server 10 functions as an example of a mask image generation unit that generates a mask image for reducing the visibility of images other than the specified item partial image in the image of the document.

Next, the management server 10 enlarges the item partial image (step S32). Specifically, as shown in FIG. 17, the control unit 11 enlarges each item partial image to fit within the size of the documents 50 and 51 displayed on the screen of the output unit 44 of the collation terminal device 40. . Note that the enlarged item partial images 50A and 51A may protrude somewhat from the size of the mask images M1 and M2. The size of each document 50, 51 displayed on the screen of the output unit 44 is an example of the size of the display area displayed on the screen. The size of the mask images M1 and M2 on the screen of the output unit 44 is an example of the size of the display area displayed on the screen.

When enlarging an item partial image including an item name, it is sufficient that the enlarged image fits within the size of the document 50, as shown in FIG. Further, it is preferable that the enlargement rate is such that the content of a specific item described in the original documents 50, 51 is enlarged to a degree that is easier for the operator to see than other items.

In this way, the management server 10 functions as an example of an enlarging means that enlarges the specified item partial image according to the size of the display area displayed on the screen.

Next, the management server 10 generates image data that displays the item partial image enlarged with respect to the mask image (step S33). Specifically, as shown in FIG. 17, the control unit 11 generates image data in which each enlarged item partial image 50A, 51A is superimposed on each mask image M1, M2. As shown in FIG. 18, the control unit 11 superimposes each enlarged item partial image 50A, 51A on each mask image M1, M2, which makes it more or less clear how the documents 50, 51 are described. image data may also be generated.

Note that the control unit 11 may apply a mask image to the entire image of the documents 50 and 51 and superimpose the enlarged item partial image. In this case, mask image M does not have window w.

In addition, as shown in FIG. 19, the control unit 11 enlarges not only the item partial image (51a) but also the enlarged image of the entire document 51 within the frame of the display area of the size of the original document 51. Then, a mask image M2 having an enlarged window W may be applied. The enlarged item partial image 51A is displayed in the enlarged window W.

Furthermore, as shown in FIG. 20, the mask image may be an image with a resolution that reduces visibility. For example, the resolution is several tens of ppi, which makes it difficult to decipher the description of the item. The control unit 11 may generate image data in which the enlarged item partial image 50A with reduced resolution is superimposed on the entire document 50 as a mask image. The control unit 11 may enlarge the entire document 51, reduce the resolution as a mask image, and generate image data on which the enlarged item partial image 50A is superimposed. The control unit 11 may enlarge the entire document 51 and apply the mask image M2 having the enlarged window W to reduce the visibility of images other than the enlarged specific item partial image.

Furthermore, as shown in FIG. 21, the positions of the enlarged item partial images 50A and 51A in the document image may be aligned. Having them aligned makes it easier to compare.

Further, as shown in FIG. 22, the control unit 11 causes the enlarged item partial images 50A and 51A to be arranged horizontally in the center of the document image for the mask images M1 and M2 as shown in FIG. Image data may be generated in which the enlarged item partial images 50A and 51A are superimposed. Note that an enlarged item partial image may be displayed near the window w. As an example of enlarging the specified item partial image according to the size of the display area displayed on the screen, as shown in FIG. 22, the enlarged item partial image 51A slightly protrudes from the mask image M2. It's okay.

Further, as shown in FIG. 23, the control unit 11 may display only the enlarged item partial images 50A and 51A side by side with respect to the mask image M3. Each enlarged item partial image 50A, 51A is arranged vertically or horizontally. The size of the mask image M3 on the screen of the output unit 44 is an example of the size of the display area displayed on the screen.

The management server 10 transmits the image data of the generated examination image to the verification terminal device 40.

In this way, the management server 10 functions as an example of an output means for outputting image data for displaying the enlarged item partial image with respect to the mask image.

After the examination image generation subroutine, the verification terminal device 40 displays the work image (step S23). Specifically, the control unit 41 receives image data of the examination image from the management server 10, and displays the examination image on the screen of the output unit 44 for use in examination work. For example, as shown in FIG. 17, on the screen of the output unit 44, a document whose name is masked ("contract", "residence card") so as to reduce the visibility of information other than the specified items. , enlarged item partial images (50A, 51A) of the cutout areas 50a, 51a are displayed side by side. A verification result button 55 is also displayed. The control unit 41 may receive image data of examination images for each document and display the images side by side as shown in FIG. 17.

Note that, as shown in FIGS. 18 to 23, the verification terminal device 40 may display enlarged item partial images (50A, 51A) side by side on the screen of the output unit 44.

Furthermore, when the item partial image is not enlarged, the examination image is displayed as shown in FIGS. 15 and 16. Since the visibility of images other than the specified item partial image is reduced, it is possible to concentrate on the examination item.

Next, the verification terminal device 40 accepts image examination and/or input of screen contents (step S24). If the work is "examination" of item partial images, the control unit 41 displays a verification result button 55 on the screen of the output unit 44, as shown in FIG. 17 and the like. The operator performs the verification, and if the verification result is correct, selects the OK button 55 using the operation unit 45, and if the verification result is incorrect, selects the NG button 55. When the task is to "input" the contents of the item partial image, the control unit 41 accepts text input in an input field (not shown).

Note that the control unit 41 may perform character recognition on the item partial image using an OCR function. In particular, when the characters written in the item partial image are not handwritten characters but printed characters, the control unit 41 may convert the item partial image into text data using an OCR function.

Next, the verification terminal device 40 transmits the work result (step S25). Specifically, the control unit 41 transmits work results such as verification results, input results, and character recognition results to the management server 10 via the communication unit 43.

Next, the verification terminal device 40 temporarily registers the data (step S26). Specifically, the control unit 11 receives the work results from each verification terminal device 40 . The control unit 11 temporarily stores the work results received from each verification terminal device 40 in the work result database 12d for each wrapping ID and item ID, which are examples of item information of one document. The work result database 12d may have information on a flag indicating whether the registration is temporary registration or permanent registration. Further, the control unit 11 may temporarily register the work results received from each verification terminal device 40 in the order of reception according to the data format of the work result database 12d. Furthermore, the examination results or input results of a plurality of workers may be registered as temporary registration in the work result database 12d for the inspection target having the same packaging ID and the same item ID.

Next, the management server 10 compares the data (step S27). For example, the control unit 11 may compare character recognition results and input results, compare multiple examination results, or compare multiple input results for the same target in the temporarily registered work results. do.

In addition, as a result of the comparison, if the multiple examination results do not match, the character recognition result and the input result do not match, the multiple input results do not match, etc., the management server 10 40, information to the effect that the work will be redone is transmitted, and the work is redone in the verification terminal device 40.

Next, the management server 10 combines the work results (step S28). For example, the control unit 11 searches the work results such as examination results and input results received from each verification terminal device 40 based on the packaging ID, item ID, etc., and searches the work results for the same packaging ID. be integrated as

Next, the management server 10 registers the work results (step S29). Specifically, the control unit 11 refers to the work result database 12d, searches for work results based on the packaging ID, collects information on suitability and unsuitability from the work results, and stores the examination results in the work result database 12d. to be memorized. The control unit 11 may set a flag in the work result database 12d to indicate that the registration is official.

Once all items have been verified, the delivery process will begin. For example, submitted documents will be returned along with the examination results. Each work on each item partial image is completed, and each data delivery is integrated.

As described above, according to the present embodiment, the specified item partial images (50a, 51a) are enlarged according to the size of the display area displayed on the screen of the output unit 44, and the specified item partial images (50a, 51a) are Image data is output that displays the item partial images (50A, 51A) enlarged against the mask image to reduce the visibility of images other than the item partial images, so it is easy to use when reviewing documents. This makes it easier to work on documents while protecting information.

Item partial images (50a, 51a) of corresponding items are respectively specified from the images of the plurality of documents 50, 51, and each of the identified item partial images is selected according to the size of the display area displayed on the screen. An image that is enlarged, generates mask images M1 and M2 for each image of a plurality of documents, displays each mask image side by side, and displays a corresponding enlarged partial image of each item for each mask image. When outputting data, by displaying corresponding enlarged item partial images in the mask images M1 and M2 that are displayed side by side, items can be separated from each other while protecting information during work such as screening. This makes it easier to compare and work.

(Modified example)
Next, modified examples of examination images will be described using FIGS. 24 to 30.

As shown in FIG. 24, the color of the mask image may be changed for each document. You can tell which documents are being compared based on the color. If one person is judging various combinations, they can be distinguished by color.

As shown in FIG. 25, the color of the mask image may be changed for each item. You can tell which item is being reviewed by the color. If one person is reviewing multiple items, you can tell which item is being reviewed by color.

Note that, as shown in FIG. 26, differences in documents or items may be expressed using colored banners. Further, the type of document or the type of item may be written in the banner.

Next, a method to deal with the case where the cutout region of an item is long horizontally or vertically and therefore extends beyond the size of the original document image when enlarged will be described with reference to FIGS. 27 to 30.

As shown in FIG. 27, when the item is an address, the control unit 11 cuts out the item partial image in the cutting area 50b from the document 50, and cuts out the item partial image in the cutting area 51b from the document 51.

Next, as shown in FIG. 28, the control unit 11 divides the cutout region 51b. For example, the control unit 11 uses character recognition or a database to separate the cutout area 51b into a part p of a city, town, or village name, which is an example of a division of entries, and a number part q of a town name and address part. For example, it may be used as a delimiter between characters. It is fine if letters, numbers, symbols, etc. are not separated in the middle and become difficult to read.

The control unit 11 rearranges the portion p and the portion q vertically, so that the horizontally long cutout region 51b has an aspect ratio approaching 1.

Next, the control unit 11 enlarges the rearranged item partial images (p, q) as in step S32. As in step S33, the control unit 11 generates image data in which the enlarged item partial images 50B and 51B are superimposed on the mask images M1 and M2, as shown in FIG. generate.

Note that, as shown in FIG. 30, the control unit 11 may display only the enlarged item partial images 50B and 51B side by side with respect to the mask image M4. Each enlarged item partial image 50B, 51B is arranged vertically or horizontally.

When the specified item partial image is enlarged and the enlarged item partial image does not fit in the display area, the specified item partial image is divided into divided item images (p, q) and the document is When rearranging the divided item images so that they fit within the size of , the item partial images are enlarged to a sufficient size and can be displayed in the display area, making it easier to see and performing tasks such as examination.

If the specified item partial image is divided into separate item images at the break between the items written in it, it will be divided at the break in the meaning of the item, so the examination of the divided and enlarged item partial image will be necessary. etc. becomes easier.

1: Document management system 10: Management server (image processing device)
30: Image input device 50, 51 Documents 50a, 50b, 51a, 51b: Cutout area (item partial image)
50A, 50B, 51A, 51B: Enlarged item partial images M, M1, M2, M3, M4: Mask images

Claims (9)

Item partial image identifying means for identifying an item partial image extracted from the document image and including the item described in the document;
Enlarging means for enlarging the specified item partial image according to the size of a display area displayed on a screen;
mask image generation means for generating a mask image for reducing the visibility of images other than the identified item partial image in the image of the document;
output means for outputting image data that is superimposed on the mask image and displays the enlarged item partial image at a location corresponding to the identified location of the item partial image;
An image processing device comprising: The image processing device according to claim 1,
The output means outputs image data that is superimposed on the mask image and displays the enlarged item partial image in the center of the mask image so as not to overlap with the specified item partial image. Characteristic image processing device. The image processing device according to claim 1 or 2,
Image processing characterized in that the mask image generation means generates a mask image in the image of the document that does not completely eliminate visibility but reduces the visibility of images other than the specified item partial image. Device. The image processing device according to claim 1 or 2,
The image processing apparatus is characterized in that the mask image generation means generates the mask image by blacking out images other than the specified item partial image in the image of the document. The image processing device according to any one of claims 1 to 4,
When the enlarging means enlarges the specified item partial image, if the enlarged item partial image does not fit within the display area, the specified item partial image is divided into divided item images. , an image processing apparatus further comprising image dividing means for rearranging the divided item images so as to fit within the size of the display area. The image processing device according to claim 5,
The image processing apparatus is characterized in that the image dividing means divides the divided item images into the divided item images at the boundaries of the items written in the identified item partial images. an item partial image specifying step in which the item partial image specifying means specifies an item partial image extracted from the document image and containing the item described in the document;
an enlargement step in which the enlargement means enlarges the specified item partial image according to the size of a display area displayed on the screen;
a mask image generation step in which the mask image generation means generates a mask image for reducing the visibility of images other than the identified item partial image in the image of the document;
an output step in which the output means outputs image data that is superimposed on the mask image and displays the enlarged item partial image at a location corresponding to the identified location of the item partial image;
An image processing method characterized by comprising: computer,
item partial image specifying means for specifying an item partial image extracted from the document image and including the item described in the document;
Enlarging means for enlarging the identified item partial image according to the size of the display area displayed on the screen;
a mask image generating means for generating a mask image for reducing the visibility of images other than the identified item partial image in the image of the document, and
An image that functions as an output means for outputting image data that is superimposed on the mask image and displays the enlarged item partial image at a location corresponding to the identified location of the item partial image. Program for processing equipment. In a document management system that includes an image processing device that processes images of documents, and a terminal device that displays images of the documents for work,
The image processing device
Item partial image specifying means for specifying an item partial image extracted from the image of the document and including the item described in the document;
Enlarging means for enlarging the specified item partial image according to the size of a display area displayed on a screen;
mask image generation means for generating a mask image for reducing the visibility of images other than the identified item partial image in the image of the document;
output means for outputting image data that is superimposed on the mask image and displays the enlarged item partial image at a location corresponding to the identified location of the item partial image;
A document management system characterized by having.

Images