JP2021039507A - Information processing apparatus and information processing program - Google Patents

Abstract

To provide an information processing apparatus and an information processing program which can assign an appropriate object item of confirmation work in accordance with specifications of a terminal for use in the confirmation work.SOLUTION: A server device 10 comprises a CPU 11A. The CPU 11A controls the server device to acquire information indicative of specifications of terminals for use in confirmation work being work for confirming whether a recognition result obtained by recognizing a form image is correct or not, and to transmit object items of the confirmation work for the form image to the terminals in accordance with the acquired information indicative of the specifications.SELECTED DRAWING: Figure 2

Description

The present invention relates to an information processing device and an information processing program.

For example, Patent Document 1 describes an OCR processing system in which a reading terminal, a server, and a correction terminal are connected through a transmission line. This reading terminal has a function of reading characters from a form image and distributing the reading result to a server through a transmission line. In addition, this server has a function of storing the reading result delivered from the reading terminal, a function of delivering the list of the stored reading result to the correction terminal through the transmission line, and a reading result in response to a request from the correction terminal. Has a function to deliver. In addition, this correction terminal has a function of setting the conditions of the reading result to be corrected, a function of narrowing down and displaying those satisfying the set conditions from the list of reading results delivered from the server, and this narrowing down. It has a function of selecting a reading result for which distribution is requested from the server from the list of reading results displayed in, and a function of correcting the reading result delivered from the server.

Further, Patent Document 2 describes a form processing system in which an operator performs work of correcting or confirming character data by comparing the image data of a form with the character data acquired by character recognition of the image data. There is. This form processing system defines characters with similar shapes as similar characters in advance, and whether there are many or few similar characters among the characters included in the character data of the form with respect to the character recognition result of the form. An operator with a high proficiency level is in charge of a form with many similar characters, and an operator with a low proficiency level is in charge of a form with few similar characters, based on the information indicating In this way, the operator in charge of the form is designated to perform the work of correcting or confirming the character data of the form.

Further, Patent Document 3 describes a character recognition device that performs error correction work by a plurality of operators. This character recognition device includes an operator attribute registration means for registering operator attributes, a document attribute registration means for registering image data of a document and a document attribute of a document, and a character recognition means for performing character recognition based on the image data. .. Further, this character recognition device has a plurality of image patterns in which characters are recognized as the same character pattern by character recognition means from image data of a plurality of documents, and characters as the same character pattern based on pre-registered operator attributes. It is provided with a selection means for selecting an operator for confirming the recognition results of a plurality of recognized image patterns.

Japanese Unexamined Patent Publication No. 2001-84312 Japanese Patent No. 5715219 JP-A-2017-111500

By the way, the confirmation work of recognizing the form image and confirming whether or not the recognition result obtained is correct is usually carried out by using a personal computer (PC) provided with a keyboard. However, with the diversification of business, it is conceivable that this confirmation work is also performed on a mobile terminal equipped with a touch panel, such as a smartphone or tablet terminal. Since this mobile terminal is a touch operation, when correcting the recognition result in the confirmation work, it may be more troublesome to input characters than the keyboard operation of the PC, which is a burden on the person in charge of the confirmation work. There is.

An object of the present invention is to provide an information processing device and an information processing program capable of assigning appropriate target items for confirmation work according to the specifications of a terminal used for confirmation work.

In order to achieve the above object, the information processing device according to the first aspect is provided with a processor, and the processor is a work of confirming whether or not the recognition result obtained by recognizing the form image is correct. Information indicating the specifications of the terminal used for the above is acquired, and the target item of the confirmation work of the form image is controlled to be transmitted to the terminal according to the information indicating the acquired specifications.

Further, the information processing device according to the second aspect is a plurality of items included in the form image when the processor satisfies a predetermined condition in the specifications of the terminal in the information processing device according to the first aspect. The target item to be transmitted to the terminal is selected from the above.

Further, the information processing device according to the third aspect is the information processing device according to the second aspect, wherein the predetermined condition is that the keyboard is not provided and the touch panel is provided. It is said that the target item is at least one item in which the certainty level indicating the certainty of the recognition result is equal to or higher than the threshold value, an item including a plurality of options, and an item in which a number is entered.

Further, in the information processing device according to the fourth aspect, in the information processing device according to the second aspect, the predetermined condition is that the keyboard is provided, and the selected target item is the recognition result. It is said that it is at least one item in which the certainty level indicating certainty is less than the threshold value, an item that does not include a plurality of options, and an item in which a number is not entered.

Further, in the information processing device according to the fifth aspect, when the recognition result of the target item transmitted by the processor to the terminal in the information processing device according to the first aspect or the second aspect is erroneous by the confirmation work. , Receives a notification from the terminal to suspend correction of the recognition result of the target item, and transmits the target item to another terminal capable of correcting the recognition result of the target item in response to the received notification. Control.

Further, in the information processing device according to the sixth aspect, when the recognition result of the target item transmitted by the processor to the terminal in the information processing device according to the first aspect or the second aspect is erroneous by the confirmation work. , The correction result obtained by correcting the recognition result of the target item is received from the terminal.

Further, in order to achieve the above object, the information processing program according to the seventh aspect defines the specifications of the terminal used for the confirmation work, which is the work of recognizing the form image and confirming whether or not the recognition result obtained is correct. The computer is made to control the acquisition of the information to be shown and the transmission of the target item of the confirmation work of the form image to the terminal according to the information indicating the acquired specifications.

According to the first aspect and the seventh aspect, there is an effect that an appropriate target item of the confirmation work can be assigned according to the specifications of the terminal used for the confirmation work.

According to the second aspect, there is an effect that an appropriate target item for confirmation work can be assigned to a terminal whose specifications satisfy a predetermined condition.

According to the third aspect, at least one of a highly certain item, an item including an option, and an item in which a number is entered can be assigned to a terminal having no keyboard and having a touch panel. , Has the effect.

According to the fourth aspect, it has an effect that at least one of an item having a low certainty, an item not including an option, and an item in which a number is not entered can be assigned to a terminal provided with a keyboard. ..

According to the fifth aspect, even if the correction is suspended at the terminal to which the target item is transmitted, the correction can be made at another terminal.

According to the sixth aspect, there is an effect that the correction result can be obtained from the terminal to which the target item is transmitted.

It is a figure which shows an example of the structure of the form business system which concerns on embodiment. It is a block diagram which shows an example of the electric structure of the server apparatus which concerns on embodiment. It is a block diagram which shows an example of the functional configuration of the server apparatus which concerns on embodiment. It is a flowchart which shows an example of the processing flow by the information processing program which concerns on embodiment. It is a flowchart which shows an example of the flow of the target item allocation processing which concerns on embodiment. It is a flowchart which shows an example of the process flow by the confirmation work application which concerns on embodiment. It is a front view which shows an example of the specification registration screen of the terminal device for a confirmer which concerns on embodiment. It is a front view which shows an example of the confirmation work screen of the terminal device for a confirmer which concerns on embodiment. It is a front view which shows an example of another confirmation work screen of the terminal device for a confirmer which concerns on embodiment. (A) is a front view showing an example of still another confirmation work screen of the confirmer terminal device according to the embodiment. (B) is a front view showing an example of a correction work screen of the confirmer terminal device according to the embodiment. It is a front view which shows an example of still another confirmation work screen of the terminal device for a confirmer which concerns on embodiment. It is a flowchart which shows another example of the process flow by the confirmation work application which concerns on embodiment. It is a front view which shows an example of still another confirmation work screen of the terminal device for a confirmer which concerns on embodiment.

Hereinafter, an example of a mode for carrying out the present invention will be described in detail with reference to the drawings.

FIG. 1 is a diagram showing an example of the configuration of the form business system 90 according to the present embodiment.

As shown in FIG. 1, the form business system 90 according to the present embodiment includes a server device 10, confirmer terminal devices 50A, 50B, ..., Image reading device 60, and administrator terminal device 70. , Is equipped. The server device 10 is an example of an information processing device.

The server device 10 is communicably connected to each of the confirmer terminal devices 50A, 50B, ..., The image reading device 60, and the administrator terminal device 70 via the network N. As an example, a general-purpose computer such as a server computer or a personal computer (PC) is applied to the server device 10. Further, as an example, the Internet, LAN (Local Area Network), WAN (Wide Area Network) and the like are applied to this network N.

The image reading device 60 has a function of optically reading a form on a paper medium to acquire an image, and transmitting the acquired image (hereinafter, referred to as “form image”) to the server device 10. As the form referred to here, for example, various forms including a plurality of items such as an address field and a name field are used. In this form, handwritten characters, printed characters, etc. are entered for each of these plurality of items. Specifically, as will be described later, the server device 10 performs OCR (Optical Character Recognition) processing, which is an example of optical character recognition processing, on the form image received from the image reading device 60, and performs OCR (Optical Character Recognition) processing for a plurality of items. Acquire the recognition result for each corresponding image. As an example, this recognition result includes a character string or the like indicating a sequence of one or more characters. Further, in the form, the area where the description corresponding to the item can be entered is defined by a frame or the like, and the area where the description can be entered is defined as the area to be recognized. OCR processing is performed on the defined area (hereinafter referred to as "definition area"), and a character string for an image corresponding to each of a plurality of items is acquired.

The confirmer terminal device 50A is a terminal device operated by the confirmer U1 performing the confirmation work, and the confirmer terminal device 50B is a terminal device operated by the confirmer U2 performing the confirmation work. When it is not necessary to distinguish and explain these plurality of confirmer terminal devices 50A, 50B, ..., The confirmer terminal devices 50A, 50B, ... Are collectively referred to as the confirmer terminal device 50. Say. Further, when it is not necessary to distinguish and explain these plurality of confirmers U1, U2, ..., The confirmers U1, U2, ... Are also collectively referred to as the confirmer U. As an example, a general-purpose computer such as a personal computer (PC), a portable terminal device such as a smartphone or a tablet terminal, or the like is applied to the confirmer terminal device 50. A confirmation work application program (hereinafter, also referred to as "confirmation work application") for the confirmer U to perform the confirmation work is installed in the confirmation work terminal device 50, and a UI for the confirmation work (hereinafter, also referred to as a "confirmation work application") is installed. User Interface) Generates and displays a screen. The confirmation work referred to here means a work of confirming the recognition result of characters and the like included in the form image, or a work of confirming and correcting the recognition result.

The administrator terminal device 70 is a terminal device operated by the system administrator SE, and form definition data is set by the system administrator SE via a form definition screen (not shown). The form definition data is data required for recognizing a form image, and as an example, information on a paper size and a recognition frame (item name, size, coordinates, character type, recognition dictionary, etc. of the recognition frame). ) Is defined. As an example, a general-purpose computer such as a personal computer (PC), a portable terminal device such as a smartphone or a tablet terminal, or the like is applied to the administrator terminal device 70.

When the certainty of the recognition result obtained by recognizing the image of each item included in the form image (hereinafter referred to as "item image") is less than the threshold value, the server device 10 manually confirms the item. If the certainty level is equal to or higher than the threshold value, the final recognition result is output without performing the manual confirmation work. The degree of certainty is an index showing the certainty of the recognition result, and the higher the value of the degree of certainty, the higher the probability that the item image and the recognition result match.

When performing the above confirmation work, the server device 10 controls to associate the item image with the character string obtained by the OCR process and display it on the UI screen of the confirmer terminal device 50. The confirmer U confirms whether or not the character string corresponding to the item image is correct while looking at the item image. As a result of the confirmation, the confirmer U inputs the correct character string on the UI screen as it is if it is correct, and if it is not correct. The confirmer terminal device 50 transmits the character string input received via the UI screen to the server device 10 as a confirmation result. The server device 10 controls to output the final recognition result based on the confirmation result from the confirmer terminal device 50 and display it on the UI screen of the confirmer terminal device 50.

In the above confirmation work, an entry method indicating a method for performing the confirmation work is set. As an example of this entry method, either "double entry" or "single entry" is set. The "double entry" is a method in which a plurality of confirmers perform confirmation work, and the "single entry" is a method in which one confirmer performs confirmation work.

FIG. 2 is a block diagram showing an example of the electrical configuration of the server device 10 according to the present embodiment.

As shown in FIG. 2, the server device 10 according to the present embodiment includes a control unit 11, a storage unit 12, a display unit 13, an operation unit 14, and a communication unit 15.

The control unit 11 includes a CPU (Central Processing Unit) 11A, a ROM (Read Only Memory) 11B, a RAM (Random Access Memory) 11C, and an input / output interface (I / O) 11D, and each of these units is via a bus. Are connected to each other.

Each functional unit including the storage unit 12, the display unit 13, the operation unit 14, and the communication unit 15 is connected to the I / O 11D. Each of these functional units can communicate with the CPU 11A via the I / O 11D.

The control unit 11 may be configured as a sub control unit that controls a part of the operation of the server device 10, or may be configured as a part of the main control unit that controls the entire operation of the server device 10. For example, an integrated circuit such as an LSI (Large Scale Integration) or an IC (Integrated Circuit) chipset is used for a part or all of each block of the control unit 11. An individual circuit may be used for each of the above blocks, or a circuit in which a part or all of them are integrated may be used. Each of the above blocks may be provided integrally, or some blocks may be provided separately. In addition, a part of each of the above blocks may be provided separately. The integration of the control unit 11 is not limited to the LSI, and a dedicated circuit or a general-purpose processor may be used.

As the storage unit 12, for example, an HDD (Hard Disk Drive), an SSD (Solid State Drive), a flash memory, or the like is used. The information processing program 12A according to the present embodiment is stored in the storage unit 12. The information processing program 12A may be stored in the ROM 11B.

The information processing program 12A may be installed in the server device 10 in advance, for example. The information processing program 12A may be realized by storing it in a non-volatile non-transitory storage medium or distributing it via the network N and appropriately installing it in the server device 10. Examples of non-volatile non-temporary storage media include CD-ROMs (Compact Disc Read Only Memory), optical magnetic disks, HDDs, DVD-ROMs (Digital Versatile Disc Read Only Memory), flash memories, memory cards, and the like. Is assumed.

For the display unit 13, for example, a liquid crystal display (LCD), an organic EL (Electro Luminescence) display, or the like is used. The display unit 13 may have a touch panel integrally. The operation unit 14 is provided with a device for operation input such as a keyboard and a mouse. The display unit 13 and the operation unit 14 receive various instructions from the user of the server device 10. The display unit 13 displays various information such as the result of the process executed in response to the instruction received from the user and the notification for the process.

The communication unit 15 is connected to a network N such as the Internet, LAN, and WAN, and is connected to each of the image reading device 60, the confirmer terminal device 50, and the administrator terminal device 70 via the network N. Communication is possible.

By the way, as described above, with the diversification of business, it is conceivable that the recognition result confirmation work is also performed on a mobile terminal provided with a touch panel, such as a smartphone or tablet terminal. Since this mobile terminal is a touch operation, when correcting the recognition result in the confirmation work, it may be more troublesome to input characters than the keyboard operation of the PC, which is a burden on the person in charge of the confirmation work. There is.

The CPU 11A of the server device 10 according to the present embodiment functions as each unit shown in FIG. 3 by writing the information processing program 12A stored in the storage unit 12 into the RAM 11C and executing the information processing program 12A. The CPU 11A is an example of a processor.

FIG. 3 is a block diagram showing an example of the functional configuration of the server device 10 according to the present embodiment.

As shown in FIG. 3, the CPU 11A of the server device 10 according to the present embodiment functions as a determination unit 20, an extraction unit 21, a recognition unit 22, a selection unit 23, and a transmission control unit 24. Through each of these parts, the CPU 11A acquires information indicating the specifications of the terminal used for the confirmation work of the recognition result for the form image, and transmits the target item of the confirmation work of the form image to the terminal according to the information indicating the acquired specifications. Control to do. As described above, the confirmation work is a work of recognizing the form image and confirming whether or not the recognition result obtained is correct.

Further, the storage unit 12 is provided with a form definition storage unit 12B, a recognition result storage unit 12C, and a terminal specification management unit 12D.

The determination unit 20 acquires the form image of the completed form read by the image reading device 60. The determination unit 20 determines which form image the acquired form image is. For example, the determination is made by extracting the characteristic portion of the form image.

In the form definition storage unit 12B, form definition information in which information regarding an area to be recognized for each form is defined is stored in advance. The form definition storage unit 12B may be a general database or an independent definition file.

The extraction unit 21 extracts an area to be recognized corresponding to the item based on the item information included in the form definition information stored in the form definition storage unit 12B. As an example, this item information includes the position information of the area in the form image, the characteristics of the area (numerical value, alphabet, hiragana, katakana, symbol, choice, etc.) for each item.

The recognition unit 22 takes the form image of the completed form as an input, and executes the OCR process for each item according to the setting contents of the form definition information stored in the form definition storage unit 12B. The recognition unit 22 outputs the item image, the recognition result, and the degree of certainty thereof in association with each item. As described above, this certainty degree is an index showing the certainty of the recognition result, and is expressed as a numerical value in the range of 0 or more and 1 or less, for example. "1" here means 100%. As a method for deriving this certainty, for example, a known technique described in JP-A-2016-212812 may be used. When the certainty of each character constituting the character string is used, a method of converting the certainty of each character into the certainty of the character string is used. Specifically, an appropriate method may be selected from the various methods shown below.

-The maximum value of the certainty of each character in the character string is set as the certainty of the character string.
-The minimum value of the certainty of each character in the character string is set as the certainty of the character string.
-The average value (mode, median, etc.) of the certainty of each character in the character string is used as the certainty of the character string.

The recognition result storage unit 12C stores the item image, the recognition result, and the certainty degree output from the recognition unit 22 as recognition result information in association with each other. This recognition result information includes not only the certainty of the recognition result but also the character type and the number of characters. The character type is information indicating the type of characters in the area to be recognized (for example, numbers, numbers + alphabets, general characters, choices, etc.). The number of characters is information indicating the number of characters when the recognition target is a character string. Further, the recognition result storage unit 12C manages the correction information in association with the recognition result information. This correction information includes the state of correction (including at least unconfirmed, corrected confirmed, and uncorrected confirmed) and the corrected correction result for each item.

The confirmer U confirms the recognition result displayed on the confirmer terminal device 50, and performs correction work if correction is necessary. The confirmer terminal device 50 registers the correction result in the recognition result storage unit 12C according to the operation content by the confirmer U. Further, the confirmer terminal device 50 registers the corrected state as uncorrected confirmation when the correction is only confirmed and the correction is unnecessary.

The terminal specification management unit 12D manages information (hereinafter, referred to as "specification information") indicating the specifications of the terminal used for the confirmation work (terminal device 50 for confirmers in the present embodiment). As an example, this specification information includes the presence / absence of a keyboard, the presence / absence of a touch panel, the size of a display screen, and the like. The keyboard referred to here is a keyboard as hardware in which a plurality of keys that can be pressed by a user's finger are arranged according to a predetermined rule, and does not include a virtual keyboard displayed on the screen. If the specification information cannot be obtained directly from the confirmer terminal device 50, the confirmation work application of the confirmer terminal device 50 is used to display the UI screen for registering the specification information so that the specification information can be registered. May be good.

The selection unit 23 acquires the specification information of the confirmer terminal device 50 used by the confirmer U from the terminal specification management unit 12D when performing the confirmation work. Then, when the acquired specification information satisfies a predetermined condition, the selection unit 23 selects a target item to be transmitted to the confirmer terminal device 50 from a plurality of items included in the form image. Specifically, the predetermined condition is, for example, that the keyboard is not provided and the touch panel is provided. That is, this condition is a condition indicating that the confirmer terminal device 50 is a mobile terminal such as a smartphone or a tablet terminal. In this case, at least one of an item having a certainty level of a threshold value (for example, 0.7) or more, an item including a plurality of options, and an item in which a number is entered is selected as the target item. In the case of an item containing a plurality of options, it is desirable to select an item with the number of options within the range that fits in the maximum screen size obtained from the specification information. The option referred to here may be a form in which a check mark is inserted in a check box, or a form in which a character string (including characters, symbols, numbers, etc.) is surrounded by a circle or the like.

Further, the predetermined condition may be that the keyboard is provided. That is, this condition is a condition indicating that the confirmer terminal device 50 is a general-purpose PC. In this case, at least one of an item whose certainty is less than the threshold value, an item not including a plurality of options, and an item in which a number is not entered is selected as the target item.

When the confirmer terminal device 50 is a mobile terminal, the target item to be transmitted to the mobile terminal may be an item that can be corrected by a simple operation from the touch panel. The simple operation referred to here is, for example, an operation in which the number of operations (the number of touches) per correction unit is a predetermined number of times (for example, a range of 3 times or more and 10 times or less).

Further, in the case of a mobile terminal capable of voice input, among a plurality of items, the language of the voice specified by the specification information matches the language obtained from the recognition result, and the maximum number of characters displayed on the screen of the terminal specifications is the same. Any item that includes the character string in may be selected as the target item even if the certainty level is not equal to or higher than the threshold value.

The transmission control unit 24 controls to transmit the target item selected by the selection unit 23 to the confirmer terminal device 50. When the confirmer terminal device 50 is a mobile terminal, it is desirable that the number of characters transmitted to the mobile terminal is within the number of characters that can be displayed in a predetermined display area of the mobile terminal without scrolling.

Here, for example, when the recognition result of the target item transmitted to the confirmer terminal device 50A is erroneous by the confirmation work, the CPU 11A suspends the correction of the recognition result of the target item from the confirmer terminal device 50A. Accept notifications. In this case, the confirmer terminal device 50A is a mobile terminal. The transmission control unit 24 controls to transmit the target item to another confirmer terminal device 50B capable of correcting the recognition result of the target item in response to the received notification. In this case, another confirmer terminal device 50B is a general-purpose PC.

Further, when the recognition result of the target item transmitted to the confirmer terminal device 50B is found to be an error by the confirmation work, the CPU 11A corrects the recognition result of the target item from the confirmer terminal device 50B. Accept the result. In this case, the confirmer terminal device 50B is a general-purpose PC.

Next, the operation of the server device 10 according to the present embodiment will be described with reference to FIG.

FIG. 4 is a flowchart showing an example of the processing flow by the information processing program 12A according to the present embodiment.

First, when the server device 10 is instructed to execute the recognition result confirmation process, the CPU 11A starts the information processing program 12A and executes each of the following steps.

In step 100 of FIG. 4, it is determined whether or not the CPU 11A has received the allocation request of the target item to be the target of the confirmation work from the confirmer terminal device 50. If it is determined that the target item allocation request has been received (in the case of affirmative determination), the process proceeds to step 101, and if it is determined that the target item allocation request has not been received (in the case of a negative determination), the process waits in step 100. It becomes.

In step 101, the CPU 11A executes the target item allocation process shown in FIG.

FIG. 5 is a flowchart showing an example of the flow of the target item allocation process according to the present embodiment.

In step 110 of FIG. 5, the CPU 11A acquires the terminal specifications corresponding to the allocation request received in step 100 from the terminal specification management unit 12D.

In step 111, the CPU 11A determines whether or not the confirmer terminal device 50 has a keyboard based on the terminal specifications acquired in step 110. If it is determined that the confirmer terminal device 50 does not have a keyboard (in the case of a negative determination), the process proceeds to step 112, and if it is determined that the confirmer terminal device 50 has a keyboard (in the case of an affirmative determination), step 121 Move to.

In step 112, the CPU 11A determines whether or not the confirmer terminal device 50 has a touch panel based on the terminal specifications acquired in step 110. If it is determined that the confirmer terminal device 50 has a touch panel (in the case of affirmative determination), the process proceeds to step 113, and if it is determined that the confirmer terminal device 50 does not have a touch panel (in the case of a negative determination), step 100 Return to and wait.

In step 113, the CPU 11A selects a target item candidate (hereinafter, referred to as “target item candidate”) from a plurality of items included in the form image.

In step 114, the CPU 11A determines whether or not the hold flag is given to the target item candidate selected in step 113. If it is determined that the hold flag is not given (in the case of a negative determination), the process proceeds to step 115, and if it is determined that the hold flag is given (in the case of an affirmative determination), the process proceeds to step 120. It should be noted that this hold flag means that the recognition result of the target item is set as an error by the confirmation work by the confirmer terminal device 50, but the correction work cannot be performed by the confirmer terminal device 50, so that the recognition result of the target item is displayed. This flag is given when the correction is suspended.

In step 115, the CPU 11A determines whether or not the entire target item candidate can be displayed on the display screen of the confirmer terminal device 50. If it is determined that the entire target item candidate can be displayed (in the case of affirmative determination), the process proceeds to step 116, and if it is determined that the entire target item candidate cannot be displayed (in the case of a negative determination), step 120 is performed. Transition.

In step 116, the CPU 11A determines whether or not the target item candidate includes options. If it is determined that the target item candidate includes options (in the case of affirmative determination), the process proceeds to step 117, and if it is determined that the target item candidate does not include options (in the case of a negative determination), the process proceeds to step 119.

In step 117, the CPU 11A assigns the target item candidate as the target item.

In step 118, the CPU 11A determines whether or not it is the last candidate. If it is determined to be the last candidate (in the case of affirmative determination), the process returns to step 102 in FIG. 4, and if it is determined that the candidate is not the last candidate (in the case of negative determination), the process returns to step 113 and the process is repeated.

In step 119, the CPU 11A determines whether or not the certainty of the target item candidate is equal to or greater than the threshold value. When it is determined that the certainty of the target item candidate is equal to or higher than the threshold value (in the case of affirmative judgment), the process proceeds to step 117, and when it is determined that the certainty of the target item candidate is less than the threshold value (in the case of negative judgment). The process proceeds to step 120.

In step 120, the CPU 11A excludes the target item candidate from the target item and proceeds to step 118.

On the other hand, in step 121, the CPU 11A selects a target item candidate from a plurality of items included in the form image.

In step 122, the CPU 11A determines whether or not the hold flag is given to the target item candidate selected in step 121. If it is determined that the hold flag is given (in the case of an affirmative determination), the process proceeds to step 123, and if it is determined that the hold flag is not given (in the case of a negative determination), the process proceeds to step 125.

In step 123, the CPU 11A assigns the target item candidate as the target item.

In step 124, the CPU 11A determines whether or not it is the last candidate. If it is determined to be the last candidate (in the case of affirmative determination), the process returns to step 102 in FIG. 4, and if it is determined that the candidate is not the last candidate (in the case of negative determination), the process returns to step 121 and the process is repeated.

In step 125, the CPU 11A determines whether or not the certainty of the target item candidate is equal to or greater than the threshold value. When it is determined that the certainty of the target item candidate is less than the threshold value (in the case of negative judgment), the process proceeds to step 123, and when it is determined that the certainty of the target item candidate is equal to or higher than the threshold value (in the case of affirmative judgment). The process proceeds to step 126.

In step 126, the CPU 11A determines whether or not the target item candidate includes options. If it is determined that the target item candidate does not include the option (in the case of a negative determination), the process proceeds to step 123, and if it is determined that the target item candidate includes the option (in the case of an affirmative determination), the process proceeds to step 127.

In step 127, the target item candidate is excluded from the target item, and the process proceeds to step 124.

Returning to FIG. 4, in step 102, the CPU 11A controls to transmit the target item assigned in step 117 or step 123 shown in FIG. 5 to the confirmer terminal device 50.

In step 103, it is determined whether or not the CPU 11A has received the confirmation result for the target item transmitted in step 102 from the confirmer terminal device 50. If it is determined that the recognition result for the target item has been received (in the case of affirmative determination), the process proceeds to step 104, and if it is determined that the confirmation result for the target item has not been received (in the case of a negative determination), the process waits in step 103. It becomes.

In step 104, the CPU 11A determines whether or not the confirmation result received in step 103 includes a hold notification. If it is determined that the confirmation result includes the hold notification (in the case of an affirmative determination), the process proceeds to step 105, and if it is determined that the confirmation result does not include the hold notification (in the case of a negative determination), the process proceeds to step 106. It should be noted that this hold notification is that the recognition result of the target item is set as an error in the confirmation work in the confirmer terminal device 50, but the correction work cannot be performed on the own terminal, so the correction of the recognition result of the target item is suspended. This is to notify you that you have done so.

In step 105, the CPU 11A sets the above-mentioned hold flag for the target item whose confirmation result includes the hold notification, and proceeds to step 107.

On the other hand, in step 106, the CPU 11A registers the confirmation result in association with the target item, and proceeds to step 107.

In step 107, as an example, the CPU 11A determines whether or not to end the confirmation work according to the operation by the user. When it is determined that the confirmation work is not completed (in the case of a negative determination), the process returns to step 100 and the process is repeated, and when it is determined that the confirmation work is completed (in the case of an affirmative determination), a series of processes by the information processing program 12A is completed. To do.

Next, the operation of the confirmer terminal device 50 according to the present embodiment will be described with reference to FIG.

FIG. 6 is a flowchart showing an example of the processing flow by the confirmation work application according to the present embodiment. The example of FIG. 6 shows a case where the confirmer terminal device 50 is a mobile terminal.

First, when the confirmer terminal device 50 is instructed to perform the confirmation work, the CPU (not shown) activates the confirmation work application and executes each of the following steps.

In step 130 of FIG. 6, the CPU of the confirmer terminal device 50 controls the server device 10 to send an allocation request for a target item.

In step 131, it is determined whether or not the CPU of the confirmer terminal device 50 has received the target item for the allocation request transmitted in step 130 from the server device 10. If it is determined that the target item for the allocation request has been received (in the case of affirmative determination), the process proceeds to step 132, and if it is determined that the target item for the allocation request has not been received (in the case of a negative determination), the process waits in step 131. It becomes.

In step 132, the CPU of the confirmer terminal device 50 displays the item image and the recognition result on the UI screen for each target item, and the confirmer U performs the confirmation work. The target item here is, for example, at least one of an item whose certainty is equal to or higher than a threshold value, an item including a plurality of options, and an item in which a number is entered.

In step 133, the CPU of the confirmer terminal device 50 controls to transmit the confirmation result, which is the result of the confirmation work performed in step 132, to the server device 10, and ends a series of processes by the confirmation work application. ..

Next, a specific example of the UI screen when the mobile terminal is applied to the confirmer terminal device 50 will be described with reference to FIGS. 7 to 11.

FIG. 7 is a front view showing an example of the specification registration screen 30 of the confirmer terminal device 50 according to the present embodiment.

The specification registration screen 30 shown in FIG. 7 is a screen displayed on the confirmer terminal device 50 when the specification registration function of the above-mentioned confirmation work application is executed.

On the specification registration screen 30, an appropriate resolution is set so that the character string displayed at the time of confirmation work is easy to see. Further, on the specification registration screen 30, an appropriate enlargement ratio is set when enlargement is required. Further, on the specification registration screen 30, the number of lines of the character string and the number of characters of the character string (3 vertical lines and 12 horizontal characters in the example of FIG. 7) that can be displayed without scrolling are set in the display area at the time of confirmation work. To. Further, on the specification registration screen 30, the size of the area for displaying the item image and the recognition result side by side is set. Further, on the specification registration screen 30, a touch-operable registration button and a back button are displayed. This registration button is tapped when registering the specification information set via the specification registration screen 30. When this registration button is tapped, this specification information is transmitted to the server device 10. Further, this back button is tapped when returning to the screen immediately before the specification registration screen 30.

FIG. 8 is a front view showing an example of the confirmation work screen 31 of the confirmer terminal device 50 according to the present embodiment.

The confirmation work screen 31 shown in FIG. 8 is a screen displayed on the confirmer terminal device 50 when the confirmation function of the above-mentioned confirmation work application is executed. The example of FIG. 8 shows an item image in which the certainty of the recognition result is equal to or higher than the threshold value.

The item image and the recognition result thereof are displayed side by side on the confirmation work screen 31. Further, on the confirmation work screen 31, a hold button and a confirmation button that can be touch-operated are displayed. Although the recognition result of this hold button is incorrect, for example, when the confirmer terminal device 50A cannot perform the correction work, another correctable confirmer terminal device 50B takes over and requests the correction. Be tapped. When this hold button is tapped, a confirmation result including a hold notification is transmitted to the server device 10. The confirmer terminal device 50A is a mobile terminal, and the confirmer terminal device 50B is a general-purpose PC. On the other hand, this confirmation button is tapped when the recognition result is correct.

FIG. 9 is a front view showing an example of another confirmation work screen 32 of the confirmer terminal device 50 according to the present embodiment.

The confirmation work screen 32 shown in FIG. 9 is a screen displayed on the confirmer terminal device 50 when the confirmation function of the above-mentioned confirmation work application is executed. The example of FIG. 9 shows an item image in which the recognition result is an option (selected check box). The "selected check box" means a state in which the check mark is recognized and the check box is selected. Further, as described above, a form in which the character string is surrounded by a circle mark or the like may be applied to the options.

On the confirmation work screen 32, the item image and the recognition result thereof are displayed side by side as in the example of FIG. Further, on the confirmation work screen 32, a hold button and a confirmation button that can be touch-operated are displayed. Although the recognition result of this hold button is incorrect, for example, when the confirmer terminal device 50A cannot perform the correction work, another correctable confirmer terminal device 50B takes over and requests the correction. Be tapped. When this hold button is tapped, a confirmation result including a hold notification is transmitted to the server device 10. The confirmer terminal device 50A is a mobile terminal, and the confirmer terminal device 50B is a general-purpose PC. On the other hand, this confirmation button is tapped when the recognition result is correct.

FIG. 10A is a front view showing an example of still another confirmation work screen 33A of the confirmer terminal device 50 according to the present embodiment. Further, FIG. 10B is a front view showing an example of the correction work screen 33B of the confirmer terminal device 50 according to the present embodiment.

The confirmation work screen 33A shown in FIG. 10A is a screen displayed on the confirmer terminal device 50 when the confirmation function of the above-mentioned confirmation work application is executed. The example of FIG. 10A shows an item image in which the recognition result is an option (unselected check box). The "unselected check box" means a state in which the check mark is not recognized and the check box is not selected.

Similar to the examples of FIGS. 8 and 9, the item image and the recognition result thereof are displayed side by side on the confirmation work screen 33A. Further, on the confirmation work screen 33A, a hold button and a confirmation button that can be touch-operated are displayed. Although the recognition result of this hold button is incorrect, for example, when the confirmer terminal device 50A cannot perform the correction work, another correctable confirmer terminal device 50B takes over and requests the correction. Be tapped. When this hold button is tapped, a confirmation result including a hold notification is transmitted to the server device 10. The confirmer terminal device 50A is a mobile terminal, and the confirmer terminal device 50B is a general-purpose PC. On the other hand, this confirmation button is tapped when the recognition result is correct. Further, on the confirmation work screen 33A, a frame 34A surrounding the recognition result is displayed. If you want to correct the recognition result, tap the inside of the frame 34A to move to the correction work screen 33B of FIG. 10B.

On the correction work screen 33B shown in FIG. 10B, unselected check boxes are corrected and selected check boxes are displayed. On the correction work screen 33B, a frame 34B surrounding the correction result is displayed. When it is desired to switch the correction result, the unselected check box and the selected check box are alternately switched by tapping in the frame 34B. On the correction work screen 33B, a button for returning to the previous screen and a button for confirming correction are displayed, which can be touch-operated. The button to return to the previous screen is tapped when returning to the confirmation work screen 33A shown in FIG. 10 (A). The correction confirmation button is tapped to confirm the correction result. When the correction confirmation button is tapped, a confirmation result including the correction result is transmitted to the server device 10.

FIG. 11 is a front view showing an example of still another confirmation work screen 35 of the confirmer terminal device 50 according to the present embodiment.

The confirmation work screen 35 shown in FIG. 11 is a screen displayed on the confirmer terminal device 50 when the confirmation function of the above-mentioned confirmation work application is executed. The example of FIG. 11 shows an item image in which the recognition result is a number.

Similar to the examples of FIGS. 8 and 9, the item image and the recognition result thereof are displayed side by side on the confirmation work screen 35. Further, on the confirmation work screen 35, a hold button and a confirmation button that can be touch-operated are displayed. Further, the numeric keypad input group 35A is displayed on the confirmation work screen 35. If the number in the recognition result is incorrect, correction input is possible using this numeric keypad input group 35A. In this case, when the confirmation button is tapped, the confirmation result including the correction result is transmitted to the server device 10. If the recognition result is a number, it can be corrected if it is a number string displayed without scrolling in the display area.

Next, another operation of the confirmer terminal device 50 according to the present embodiment will be described with reference to FIG.

FIG. 12 is a flowchart showing another example of the processing flow by the confirmation work application according to the present embodiment. The example of FIG. 12 shows a case where the confirmer terminal device 50 is a general-purpose PC.

First, when the confirmer terminal device 50 is instructed to perform the confirmation work, the CPU (not shown) activates the confirmation work application and executes each of the following steps.

In step 140 of FIG. 12, the CPU of the confirmer terminal device 50 controls the server device 10 to send an allocation request for a target item.

In step 141, it is determined whether or not the CPU of the confirmer terminal device 50 has received the target item for the allocation request transmitted in step 140 from the server device 10. If it is determined that the target item for the allocation request has been received (in the case of affirmative determination), the process proceeds to step 142, and if it is determined that the target item for the allocation request has not been received (in the case of a negative determination), the process waits in step 141. It becomes.

In step 142, the CPU of the confirmer terminal device 50 determines whether or not the hold flag is given to the target item received in step 141. If it is determined that the hold flag is not given (in the case of a negative determination), the process proceeds to step 143, and if it is determined that the hold flag is given (in the case of an affirmative determination), the process proceeds to step 144.

In step 143, the CPU of the confirmer terminal device 50 displays the item image and the recognition result on the UI screen for each target item, and the confirmer U performs the confirmation work. The target item here is, for example, at least one of an item whose certainty is less than the threshold value, an item which does not include a plurality of options, and an item in which a number is not entered. However, even if it is an option, if scrolling is required at the time of confirmation work, an item including a plurality of options may be targeted.

On the other hand, in step 144, the CPU of the confirmer terminal device 50 controls to display that the correction is pending by another terminal, and the process proceeds to step 145.

In step 145, the CPU of the confirmer terminal device 50 controls to transmit the confirmation result, which is the result of the confirmation work performed in step 143, to the server device 10, and ends a series of processes by the confirmation work application. ..

Next, with reference to FIG. 13, a specific example of the UI screen when a general-purpose PC is applied to the confirmer terminal device 50 will be described.

FIG. 13 is a front view showing an example of still another confirmation work screen 36 of the confirmer terminal device 50 according to the present embodiment.

The confirmation work screen 36 shown in FIG. 13 is a screen displayed on the confirmer terminal device 50 when the confirmation function of the above-mentioned confirmation work application is executed. The example of FIG. 13 shows an item image in which the certainty of the recognition result is less than the threshold value.

The item image and the recognition result thereof are displayed side by side on the confirmation work screen 36. Further, on the confirmation work screen 36, a registration button capable of touch operation is displayed. If the recognition result is incorrect and needs to be corrected, the confirmer U directly corrects the recognition result and taps the registration button. When the registration button is tapped, the confirmation result including the correction result is transmitted to the server device 10.

As described above, according to the present embodiment, appropriate target items for the confirmation work are assigned according to the specifications of the terminal used for the confirmation work. Therefore, even when the confirmation work is performed using the mobile terminal that performs the touch operation, it is not necessary to input the troublesome characters, and the burden on the person in charge of the confirmation work is reduced.

In each of the above embodiments, the processor refers to a processor in a broad sense, and is a general-purpose processor (for example, CPU: Central Processing Unit, etc.) or a dedicated processor (for example, GPU: Graphics Processing Unit, ASIC: Application). Specific Integrated Circuit, FPGA: Field Programmable Gate Array, programmable logic device, etc.).

Further, the operation of the processor in each of the above embodiments may be performed not only by one processor but also by a plurality of processors existing at physically separated positions in cooperation with each other. Further, the order of each operation of the processor is not limited to the order described in each of the above embodiments, and may be changed as appropriate.

The server device has been described above as an example of the information processing device according to the embodiment. The embodiment may be in the form of a program for causing a computer to execute the functions of each part included in the server device. The embodiment may be in the form of a non-temporary storage medium that can be read by a computer that stores these programs.

In addition, the configuration of the server device described in the above embodiment is an example, and may be changed depending on the situation within a range that does not deviate from the gist.

Further, the processing flow of the program described in the above embodiment is also an example, and even if unnecessary steps are deleted, new steps are added, or the processing order is changed within a range that does not deviate from the purpose. Good.

Further, in the above-described embodiment, the case where the processing according to the embodiment is realized by the software configuration by using the computer by executing the program has been described, but the present invention is not limited to this. The embodiment may be realized by, for example, a hardware configuration or a combination of a hardware configuration and a software configuration.

10 Server device 11 Control unit 11A CPU
11B ROM
11C RAM
11D I / O
12 Storage unit 12A Information processing program 13 Display unit 14 Operation unit 15 Communication unit 20 Judgment unit 21 Extraction unit 22 Recognition unit 23 Selection unit 24 Transmission control unit 50, 50A, 50B Confirmer terminal device 60 Image reader 70 For administrator Terminal device 90 form business system

Claims (7)

Equipped with a processor
The processor
Acquire information indicating the specifications of the terminal used for the confirmation work, which is the work of recognizing the form image and confirming whether the recognition result obtained is correct.
An information processing device that controls transmission of the target item of the confirmation work of the form image to the terminal according to the information indicating the acquired specifications. The information processing according to claim 1, wherein the processor selects a target item to be transmitted to the terminal from a plurality of items included in the form image when the specifications of the terminal satisfy a predetermined condition. apparatus. The predetermined condition is that the keyboard is not provided and the touch panel is provided.
The selected target item is described in claim 2, which is at least one item having a certainty level indicating the certainty of the recognition result equal to or higher than a threshold value, an item including a plurality of options, and an item in which a number is entered. Information processing device. The predetermined condition is that the keyboard is provided.
The selected target item is at least one item in which the certainty level indicating the certainty of the recognition result is less than the threshold value, an item not including a plurality of options, and an item in which a number is not entered. The information processing device described in. When the recognition result of the target item transmitted to the terminal is erroneous by the confirmation work, the processor receives a notification from the terminal to suspend the correction of the recognition result of the target item.
The information processing device according to claim 1 or 2, which controls transmission of the target item to another terminal capable of correcting the recognition result of the target item in response to the received notification. The processor receives the correction result obtained by correcting the recognition result of the target item from the terminal when the recognition result of the target item transmitted to the terminal is found to be an error by the confirmation operation. The information processing device according to claim 2. Acquire information indicating the specifications of the terminal used for the confirmation work, which is the work of recognizing the form image and confirming whether the recognition result obtained is correct.
An information processing program for causing a computer to control transmission of a target item of the confirmation work of the form image to the terminal according to the information indicating the acquired specifications.