JP7260455B2 - Information processing device, information processing method and information processing program - Google Patents

Description

The present invention relates to an information processing device, an information processing method, and an information processing program.

2. Description of the Related Art Optical character recognition (OCR) is used in office work in which handwritten or printed forms are handled. In recent years, AI-OCR, which uses artificial intelligence (AI) to improve the accuracy of character recognition, is also being used. Financial institution personnel visually check the result of reading documents by OCR or AI-OCR (hereinafter simply referred to as OCR).

JP 2018-156308 A JP-A-10-063773 JP-A-7-239902 Japanese Patent Application Laid-Open No. 2002-279353 Japanese Patent Application Laid-Open No. 2005-018678

In business affairs at a financial institution, information related to procedures entered in forms is read by OCR, and the reading results are visually confirmed by staff members of the financial institution. Since such forms have a large number of items to be entered, visual confirmation of the read results has been a burden for the staff.

An object of one aspect of the disclosed technique is to provide an information processing device, an information processing method, and an information processing program that can reduce the work load of visually confirming the recognition result of character recognition processing.

One aspect of the technology disclosed is exemplified by the following information processing device. This information processing apparatus includes acquisition means for acquiring character information by character recognition processing from a document in which a character string is entered for each input item, and recognition accuracy indicating the correctness of the recognition result by the character recognition processing for each input item. and an output means for outputting a confirmation screen in which the character string and the character information are associated with each input item, and the output means outputs the input items of the document and the presence or absence of confirmation by subsequent processing. , and among the input items whose recognition accuracy is equal to or higher than the reference value, output to the confirmation screen is suppressed for input items to be confirmed by the subsequent process.

The disclosed technique can reduce the work load of visually confirming the recognition result of character recognition processing.

FIG. 1 is a diagram illustrating the configuration of an inheritance work support system according to an embodiment. FIG. 2 is a diagram illustrating an example of processing blocks of the inheritance office support system according to the embodiment. FIG. 3 is a diagram showing an example of an original reference management table stored in the management database in the embodiment. FIG. 4 is a diagram showing an example of an inheritance procedure document. FIG. 5 is a diagram illustrating an example of a confirmation screen output by an output unit in the embodiment; 6 is a diagram illustrating an example of a processing flow of a work terminal in the embodiment; FIG.

<Embodiment>
An information processing apparatus according to an embodiment has, for example, the following configuration. The information processing device according to this embodiment includes:
Acquisition means for acquiring character information by character recognition processing from a document in which a character string is entered for each input item;
calculating means for calculating a recognition accuracy indicating the correctness of the recognition result of the character recognition process for each input item;
output means for outputting a confirmation screen in which the character string and the character information are associated with each input item,
The output means refers to a storage unit that associates the input items of the document with the presence or absence of confirmation by the subsequent process, and among the input items whose recognition accuracy is equal to or higher than a reference value, the input to be confirmed by the subsequent process. For items, the output to the confirmation screen is suppressed.

The information processing device is, for example, a personal computer or a server device. The information processing device acquires a document image obtained by converting the document into a digital image using an image acquisition device. Image acquisition devices are, for example, scanners and digital cameras. The image acquisition device may be connected to the information processing device, or may be connected to another device. In other words, it is sufficient that the information processing device can acquire the document image acquired by the image acquisition device.

The acquiring means acquires character information obtained by digitizing the character strings entered in each of the input items by performing character recognition processing such as OCR on the document image. The calculating means calculates, for each input item, a recognition accuracy indicating the correctness of the recognition result by the character recognition processing. The calculating means calculates, for example, a degree of certainty indicating the correctness of the recognition result by character recognition processing for each character entered in the input item, and selects the lowest degree of certainty among the certainties of the characters included in the input item as the input item. can be the recognition accuracy of There is no limitation on the method of calculating the confidence factor, and various known techniques can be applied. This information processing apparatus can assist the operator in determining whether or not correct character information has been obtained by character recognition processing for each input item by outputting a confirmation screen from the output means.

Here, among the input items whose recognition accuracy is equal to or higher than the reference value, the output means suppresses the output to the confirmation screen of the input items to be confirmed by subsequent processing. The reference value is a reference value indicating that there is a high probability that the character is correctly recognized by the character recognition process. Here, "suppress" means not to output (hide) the input item on the confirmation screen, or to gray out the input item and output the input item to be confirmed by the operator. including outputting in a manner different from For input items to be checked in subsequent processing, the result of character recognition processing can also be checked in the subsequent processing. Therefore, the information processing apparatus reduces the input items to be confirmed by the operator by suppressing the output of the input items to the confirmation screen by the output means, and the operator work of visually confirming the recognition result of the character recognition processing. The burden can be reduced.

The information processing device according to the embodiment may further have the following features. The output means further suppresses output to the confirmation screen of input items for which the recognition accuracy is equal to or greater than the certainty value, which is greater than the reference value. Here, the certainty value is a value indicating that the character recognition process is surely executed. By providing such features, the information processing apparatus can reduce the number of input items to be checked by the operator, thereby reducing the work load on the operator.

The technology described above can also be understood as an information processing method and an information processing program.

Embodiments will be further described below with reference to the drawings. The configuration of the embodiment shown below is an example, and the disclosed technology is not limited to the configuration of the embodiment.

FIG. 1 is a diagram illustrating the configuration of an inheritance work support system according to an embodiment. An inheritance work support system 500 illustrated in FIG. 1 is a system that supports inheritance work in a financial institution. Inheritance office work support system 500 includes work terminal 1 , scanner 2 and management server 3 . The work terminal 1 and the management server 3 are connected by a network N1 so as to be able to communicate with each other.

The work terminal 1 is an information processing device operated by a staff member of a financial institution who receives requests for inheritance procedures from customers. The work terminal 1 is, for example, a desktop personal computer, a notebook personal computer, or a tablet computer. A scanner 2 is connected to the work terminal 1 by wire or wirelessly. The work terminal 1 acquires a digital image of the inheritance procedure document by reading the inheritance procedure document (hereinafter referred to as the inheritance procedure document) filled in by the heir or the like with the scanner 2 . The work terminal 1 acquires the character information entered in the inheritance procedure document by executing OCR on the acquired digital image. Documents for inheritance procedures are often filled out by hand. The work terminal 1 is an example of an “information processing device”.

The scanner 2 is an image acquisition device that acquires inheritance procedure documents as digital images. A scanner 2 is connected to the work terminal 1 . Instead of the scanner 2, another device (for example, a digital camera, etc.) may be connected to the work terminal 1 as long as the device can acquire the inheritance procedure document as a digital image.

The management server 3 is an information processing device that stores information related to customers of financial institutions and procedure flows related to inheritance affairs. The management server 3 is, for example, a server device.

(Hardware configuration)
FIG. 1 also exemplifies the hardware configuration of the work terminal 1 and the management server 3 included in the inheritance support system 500 . The hardware configurations of the work terminal 1 and the management server 3 will be described below with reference to FIG.

(Hardware configuration of work terminal 1)
The work terminal 1 includes a Central Processing Unit (CPU) 101 , a main storage section 102 , an auxiliary storage section 103 , a communication section 104 , a display section 105 and a connection section 106 . The CPU 101, main storage unit 102, auxiliary storage unit 103, communication unit 104, display unit 105 and connection unit 106 are interconnected by a connection bus.

The CPU 101 is also called a microprocessor unit (MPU) or processor. The CPU 101 is not limited to a single processor, and may have a multiprocessor configuration. Also, a single CPU 101 connected by a single socket may have a multi-core configuration. At least part of the processing executed by the CPU 101 is executed by a processor other than the CPU 101, such as a Digital Signal Processor (DS
P), a Graphics Processing Unit (GPU), a numerical processor, a vector processor, an image processor, or other dedicated processor. At least part of the processing executed by the CPU 101 may be executed by an integrated circuit (IC) or other digital circuits. Also, at least part of the CPU 101 may include an analog circuit. Integrated circuits include Large Scale Integrated Circuits (LSIs), Application Specific Integrated Circuits (ASICs), and Programmable Logic Devices (PLDs). PLDs include, for example, Field-Programmable Gate Arrays (FPGAs). CPU 101 may be a combination of a processor and an integrated circuit. A combination is called, for example, a microcontroller unit (MCU), a system-on-a-chip (SoC), a system LSI, a chipset, or the like. In the information processing apparatus 100, the CPU 101 expands the program stored in the auxiliary storage unit 103 into the work area of the main storage unit 102, and controls the peripheral devices through the execution of the program. Accordingly, the information processing apparatus 100 can execute processing that meets a predetermined purpose. The main storage unit 102 and the auxiliary storage unit 103 are recording media readable by the work terminal 1 .

The main storage unit 102 is exemplified as a storage unit directly accessed from the CPU 101 . The main storage unit 102 includes a Random Access Memory (RAM) and a Read
Contains Only Memory (ROM).

The auxiliary storage unit 103 stores various programs and various data in a recording medium in a readable and writable manner. The auxiliary storage unit 103 is also called an external storage device. The auxiliary storage unit 103 stores an operating system (OS), various programs, various tables, and the like. The OS includes a communication interface program for exchanging data with an external device or the like connected via the communication unit 104 . External devices and the like include, for example, other information processing devices and external storage devices connected via a computer network or the like. Note that the auxiliary storage unit 103 may be part of a cloud system, which is a group of computers on a network, for example.

The auxiliary storage unit 103 is, for example, an erasable programmable ROM (EPROM), a solid state drive (SSD), a hard disk drive (HDD), or the like. Further, the auxiliary storage unit 103 is, for example, a Compact Disc (CD) drive device, a Digital Versatile Disc (DVD) drive device, a Blu-ray (registered trademark) Disc (BD) drive device, or the like. Also, the auxiliary storage unit 103 may be provided by Network Attached Storage (NAS) or Storage Area Network (SAN).

The communication unit 104 is, for example, an interface with the network N1. The communication unit 104 communicates with other information processing apparatuses via the network N1.

The display unit 105 displays data processed by the CPU 101 and data stored in the main storage unit 102, for example. Examples of the display unit 105 include a cathode ray tube (CRT) display, a liquid crystal display (LCD), a plasma display panel (PDP), an electroluminescence (EL) panel, an organic EL panel, and the like.

A connection unit 106 is an interface for connecting an external device. The method by which the connection unit 106 connects the external device may be wired or wireless. The connection part 106 is, for example, a U
Examples include Universal Serial Bus (USB), IEEE1394, Small Computer System Interface (SCSI), Bluetooth (registered trademark), and the like.

(Hardware configuration of management server 3)
The management server 3 includes a CPU 101 , a main storage section 102 , an auxiliary storage section 103 and a communication section 104 , like the work terminal 1 .

<Processing Blocks of Inheritance Support System 500>
FIG. 2 is a diagram illustrating an example of processing blocks of the inheritance office support system according to the embodiment. FIG. 2 illustrates processing blocks of the work terminal 1 and the management server 3 . An example of processing blocks of the inheritance support system according to the embodiment will be described below with reference to FIG.

(Processing block of management server 3)
The management server 3, as illustrated in FIG. 2, includes a management database 31 (the database is indicated as DB in the drawing). The CPU 101 of the management server 3 executes a computer program developed in the main storage unit 102 so as to be executable, so that the management database 31 and other units of the management server 3 perform processing.

The management database 31 is a database for managing whether or not each input item of inheritance procedure documents is subject to reference to the ledger. Ledger inquiries are conducted to confirm the information of accounts such as deposits and savings that are subject to inheritance procedures. It is checked whether or not the account information recorded in the ledger matches the information in which the inheritance procedure was offered. In addition to the account number, information such as the depositor's name, date of birth, address, etc., is registered in the ledger. It should be noted that it is possible to search not only by the account number, but also by other information items recorded in the original book, such as name. FIG. 3 is a diagram showing an example of an original reference management table stored in the management database in the embodiment. The master book inquiry management table 311 illustrated in FIG. 3 includes items of “input item” and “master book comparison”. Information indicating the input items of the inheritance procedure document B1 is stored in the "input item". "Inquiry of original book" stores information indicating whether or not each input item of inheritance procedure document B1 is subject to inquiry of original book. In the "inquiry of the ledger", "target" indicates that it is the target of the ledger inquiry, and "non- target " indicates that it is not the target of the ledger inquiry. The ledger inquiry management table 311 illustrated in FIG. 3 indicates that, for example, the input item "Decedent Address" is subject to ledger inquiry, and the input item "Representative Heir Address" is not subject to ledger inquiry. .

(Processing block of work terminal 1)
The work terminal 1 includes an acquisition unit 11, a calculation unit 12, a first determination unit 13, a second determination unit 14, and an output unit 15, as illustrated in FIG. The CPU 101 of the work terminal 1 executes a computer program developed in the main storage unit 102 so as to be executable. 14, the output unit 15, and the like.

Acquisition unit 11 acquires a digital image obtained by digitizing inheritance procedure documents from scanner 2 . The acquisition unit 11 performs OCR on the acquired digital image to acquire the character string entered in the inheritance procedure document as character information that can be edited by the information processing device.

Here, an example of an inheritance procedure document to be subjected to OCR by the acquisition unit 11 will be described. FIG. 4 is a diagram showing an example of an inheritance procedure document. The inheritance procedure document B1 exemplified in FIG. 4 has input fields for entering information related to "inheritee", "representative heir", "spouse", and "child". The entry fields for entering information about the decedent are provided with entry items for "address", "name in kana", "name", "date of birth", and "date of death". The entry fields for entering information relating to the representative heir are provided with entry items for "address", "kana name", "name", and "telephone number". The entry fields for entering information on the spouse are provided with entry items for "name", "death/residence abroad", and "date of death". The input fields for inputting information related to the child are provided with input items such as "name", "minor/deceased/overseas residence", and "date of death". In the inheritance procedure document B1, a character string is handwritten by the representative heir or the like for each input item.

By executing OCR on the inheritance procedure document B1 illustrated in FIG. 4, the acquisition unit 11 can edit, for example, the character string entered in the "Kana name" of the "deceased person" with the information processing device. Get the character information "Yucho Taro". Acquisition unit 11 is an example of “acquisition means”.

The calculation unit 12 calculates, for each character, a degree of certainty indicating the correctness of the recognition result of the character recognition processing by the acquisition unit 11 for each input item. For example, the calculation unit 12 calculates each character (east, Kyoto, Miyako, 〇, 〇, △, △, 1, -, 1, 8, -, 1) written in the "address" of the "inherited person". Confidence is calculated for The calculation unit 12 can set the lowest certainty among the calculated certainties as the recognition certainty of the input item. There is no limitation on the method of calculating the confidence factor by the calculation unit 12, and various known techniques can be applied. The calculator 12 is an example of a “calculator”.

The first determination unit 13 determines whether or not the recognition accuracy calculated by the calculation unit 12 is greater than or equal to the first threshold. If the recognition accuracy is equal to or higher than the first threshold, for example, there is a high possibility that the character information acquired by the acquisition unit 11 and the character string entered in the inheritance procedure document B1 will match. The first threshold is an example of a "reference value".

The second determination unit 14 refers to the management database 31 of the management server 3 to determine whether or not the input item is the target of the ledger inquiry executed after reading the inheritance procedure document B1. A ledger inquiry is an example of "follow-up processing."

The output unit 15 outputs to the display unit 105 a confirmation screen in which the image of the character string entered in the inheritance procedure document B1 and the character information acquired by the acquisition unit 11 are associated with each input item. Here, the output unit 15 determines that the recognition accuracy is equal to or greater than the first threshold value by the first determination unit 13, and determines that the input item is subject to the ledger inquiry by the second determination unit 14. Suppress output to the confirmation screen. Suppression of the output to the confirmation screen is executed by, for example, processing to hide the input item, gray out the input item, or the like.

FIG. 5 is a diagram illustrating an example of a confirmation screen output by an output unit in the embodiment; A confirmation screen D1 illustrated in FIG. 5 includes a left window D11 and a right window D12. An image showing the entire inheritance procedure document B1 is displayed in the left window D11. In the right window D12, an image of the character string entered in the inheritance procedure document B1 and the character information obtained by the obtaining unit 11 are displayed in association with each input item.

In the right window D12, a "scanned image" and a "recognition result" are displayed in association with each input item. In the "scanned image", an image corresponding to the input item is displayed in the digital image of the inheritance procedure document B1 read by the scanner 2. FIG. "Recognition result" displays a character string obtained by the obtaining unit 11 through character recognition processing. The character string displayed in "Recognition result" can be edited. Therefore, the staff member who operates the work terminal 1 can correct the recognition result by comparing the "scanned image" and the "recognition result".

In the example of FIG. 5, for example, in the "inherited address", the inheritance procedure documents B1 include "Tokyo 〇O
△△1-18-1 in Tokyo" is erroneously recognized as "△△1-16-1 in ○○ Ward, Tokyo" as a recognition result. Further, for example, it can be understood that, in the "name of the inheritee", "Yucho Taro" entered in the inheritance procedure document B1 is erroneously recognized as "Yucho Taro" as a recognition result.

In the confirmation screen D1, input items whose output is suppressed by the output unit 15 are grayed out. In the example of FIG. 5, the output unit 15 suppresses the output of the input items "decedent's name in kana" and "decedent's date of birth". In other words, the input items of "decedent's name in kana" and "decedent's date of birth" have a recognition accuracy higher than the first threshold and are subject to confirmation by reference to the ledger.

<Processing flow>
6 is a diagram illustrating an example of a processing flow of a work terminal in the embodiment; FIG. An example of the processing flow of the work terminal 1 will be described below with reference to FIG.

At P<b>1 , the acquisition unit 11 acquires a digital image of the inheritance procedure document B<b>1 from the scanner 2 . At P2, the acquisition unit 11 performs OCR on the digital image acquired at P1, and acquires the character strings entered in each input item of the inheritance procedure document B1 as character information that can be edited by the information processing device.

At P3, the calculation unit 12 calculates a degree of certainty indicating the correctness of the recognition result of the OCR executed at P2 for each character. The calculation unit 12 sets the lowest certainty among the calculated certainties as the recognition certainty of the input item.

At P4, the first determination unit 13 determines whether or not the recognition accuracy calculated at P3 is greater than or equal to the first threshold. If it is greater than or equal to the first threshold (YES in P4), the process proceeds to P5. If it is less than the first threshold (NO in P4), the process proceeds to P7.

In P5, the second determination unit 14 refers to the management database 31 of the management server 3 and determines whether or not the input item is subject to reference to the master book. If it is the target of the original book inquiry (YES at P5), the process proceeds to P6. If it is not subject to the original book inquiry (NO in P5), the process proceeds to P7.

In P6, the output unit 15 determines that the input item is to be suppressed from being displayed on the confirmation screen D1. In P7, the output unit 15 determines that the input item is to be displayed on the confirmation screen D1.

At P<b>8 , the output unit 15 outputs the confirmation screen D<b>1 to the display unit 105 of the work terminal 1 . Here, the output unit 15 suppresses the output to the confirmation screen D1 for the input items determined to be suppressed in P6.

<Action and effect of the embodiment>
In the embodiment, the work terminal 1 suppresses output to the confirmation screen D1 for input items whose recognition accuracy is higher than the first threshold and which are confirmed in the original book inquiry. Therefore, the inheritance clerical work support system 500 according to the embodiment can reduce the number of input items that need to be confirmed by the staff member who checks the OCR result, and can reduce the staff member's confirmation load. That is, the inheritance work support system 500 according to the present embodiment can reduce the work load of visually confirming the recognition result of the character recognition processing.

<Modification>
In the embodiment, the output to the confirmation screen D1 of the input items whose recognition accuracy is higher than the first threshold and is confirmed in the master book inquiry is suppressed, but for the input items whose recognition accuracy is higher than the first threshold and is equal to or higher than the second threshold , the output to the confirmation screen D1 may be suppressed regardless of the presence or absence of reference to the ledger. In this case, the first determination unit 13 further compares the second threshold and the recognition accuracy. Then, the output unit 15 may suppress the output to the confirmation screen D1 for input items for which the recognition accuracy is determined to be equal to or higher than the second threshold. The second threshold is an example of a "confidence value."

Although the management server 3 has the management database 31 in the embodiment, the work terminal 1 may have the management database 31 . The management database 31 may be provided in a device different from the work terminal 1 and the management server 3 as long as the work terminal 1 can access it.

The embodiments and modifications disclosed above can be combined.

<<Computer-readable recording medium>>
An information processing program that causes a computer or other machine or device (hereinafter referred to as a computer or the like) to implement any of the functions described above can be recorded in a computer-readable recording medium. By causing a computer or the like to read and execute the program of this recording medium, the function can be provided.

Here, a computer-readable recording medium is a recording medium that stores information such as data and programs by electrical, magnetic, optical, mechanical, or chemical action and can be read by a computer, etc. Say. Examples of such recording media that can be removed from a computer or the like include flexible discs, magneto-optical discs, Compact Disc Read Only Memory (CD-ROM), Compact Disc-Recordable (CD-R), and Compact Disc-ReWritable. (CD-RW), Digital Versatile Disc (DVD), Blu-ray Disc (BD), Digital Audio Tape (DAT), 8 mm tape, and memory cards such as flash memory. In addition, there are a hard disk, a ROM, and the like as recording media fixed to a computer or the like.

DESCRIPTION OF SYMBOLS 1... Work terminal 11... Acquisition part 12... Calculation part 13... First determination part 14... Second determination part 15... Output part 2... Scanner 3... Management server 31 Management database 311 Master record query management table 101 CPU
102 Main storage unit 103 Auxiliary storage unit 104 Communication unit 105 Display unit 106 Connection unit 500 Inheritance office support system B1 Inheritance procedure documents D1・Confirmation screen N1・・・Network

Claims (4)

Acquisition means for acquiring character information by character recognition processing on image data of character strings obtained by character reading processing from a document in which character strings are entered for each input item ;
calculating means for calculating a recognition accuracy indicating the correctness of the recognition result of the character recognition process for each input item;
output means for outputting a confirmation screen in which the character string and the character information are associated with each input item,
The output means refers to a storage unit that stores whether or not an input item of a document is an inquiry target of a predetermined inquiry process, and selects an input item whose recognition accuracy is equal to or higher than a reference value, and selects the input item according to the predetermined inquiry. Graying out the input items to be inquired for processing on the confirmation screen, or hiding them on the confirmation screen;
Information processing equipment. The output means further grays out on the confirmation screen or hides on the confirmation screen an input item for which the recognition accuracy is equal to or greater than a threshold value set to a value larger than the reference value.
The information processing device according to claim 1 . the computer
an obtaining step of obtaining character information by performing character recognition processing on image data of said character string obtained by character reading processing from a document in which a character string is entered for each input item;
a calculation step of calculating, for each input item, a recognition accuracy indicating the correctness of the recognition result obtained by the character recognition process;
an output step of outputting a confirmation screen in which the character string and the character information are associated with each input item;
The output step refers to a storage unit that stores whether or not an input item of a document is an inquiry target of a predetermined inquiry process, and selects an input item whose recognition accuracy is equal to or higher than a reference value, and the predetermined inquiry is performed. Including a process of graying out the input item that is the inquiry target of the process on the confirmation screen or hiding it on the confirmation screen ,
Information processing methods. to the computer,
an obtaining step of obtaining character information by performing character recognition processing on image data of said character string obtained by character reading processing from a document in which a character string is entered for each input item;
a calculation step of calculating, for each input item, a recognition accuracy indicating the correctness of the recognition result obtained by the character recognition process;
an output step of outputting a confirmation screen in which the character string and the character information are associated with each input item;
The output step refers to a storage unit that stores whether or not an input item of a document is an inquiry target of a predetermined inquiry process, and selects an input item whose recognition accuracy is equal to or higher than a reference value, and the predetermined inquiry is performed. Including a process of graying out the input item that is the inquiry target of the process on the confirmation screen or hiding it on the confirmation screen ,
Information processing program.

Images