JP6634764B2 - Information identification program, information identification method, and image reading device - Google Patents

Description

  The present invention relates to an information identification program, an information identification method, and an image reading device.

  2. Description of the Related Art Conventionally, there has been known a program for collecting data of a paper form. The program disclosed in Patent Literature 1 includes a step of identifying, from image information of a plurality of forms, fixed characters written in the form in advance and characters entered in the form by the user. The discrimination between the fixed character and the input character is based on a comparison result of comparing character strings extracted from the same position over a plurality of forms of the same type, a learning result storing information for evaluating the fixed character and the input character, And based on supplementary data and the like input by the operator. The method further includes a step of identifying a non-entry area based on the fixed character and an entry area based on the entered character according to the identification result of the fixed character and the entered character. In addition, the method includes a step of generating a form template in which the form is converted into electronic data in accordance with the result of identifying the non-entry area and the entry area.

JP-A-2015-5100

  However, some forms include, in addition to the area where characters are always written by the user, an area where characters may or may not be written by the user. Regarding such a form having an area to be filled in arbitrarily by the user, there is a possibility that the type of the area cannot be accurately identified even by using the above program.

  An object of the present invention is to provide an information identification program, an information identification method, and an image reading device that can appropriately identify the type of an area provided in a form and execute processing according to the type of the area.

An information identification program according to a first aspect exemplified in the present specification is an information identification program executed by a computer constituting an information identification device, and is a form in which characters including handwritten characters are written on the computer. A first acquisition step of acquiring read data indicating an image obtained by reading an entry form; and a form image showing an image of the form without a handwritten character, the form corresponding to the entry form based on the read data. A second obtaining step of obtaining data, a first area specifying step of specifying a first area surrounded by a contour corresponding to a first pixel value in the read data, and a first area showing an image of the first area A third obtaining step of obtaining data from the read data; and specifying a form first area corresponding to the first area in the form image data. A form first area specifying step, a fourth obtaining step of obtaining form first data indicating an image of the form first area from the form image data, the first area data and the form first data are different A first determination step of determining whether the first area data is different from the form first data, and character string data indicating a character string including at least a first character string included in the first area Is acquired based on the character recognition processing, and if it is determined that the first area data is not different from the form first data, a first execution step of not acquiring the character string data is executed.

According to the information identification program according to the first aspect exemplified in this specification, form image data corresponding to a form type determined based on read data is obtained. Further, a first area surrounded by an outline corresponding to the first pixel value is specified from the read data, and first area data is obtained. If the first area data is different from the form first data corresponding to the first area in the form image data, character string data including the first character string data corresponding to the first area data is obtained from the read data. You. On the other hand, if the first area data does not differ from the form first data, the character string data is not obtained, and an instruction to display the first area data is output. For example, when an area that is required to be filled out in a form is applied to the first area according to the present invention, handwritten characters or the like are written in the first area, and the first area data and the form first data are different. Acquires character string data including first character string data from the read data. On the other hand, if no handwritten characters or the like are written in the first area and the first area data and the form first data are not different, character string data is not obtained from the read data. Therefore, the information identification program according to the first aspect of the present invention can appropriately identify the type of the area provided in the form, and execute a process according to the type of the area.

The information identification method according to the second aspect exemplified in this specification is a method that can be executed by a computer constituting the information identification device, and is an image obtained by reading an entry form, which is a form in which characters including handwritten characters are entered. A first acquisition step of acquiring read data indicating a form, and a second form of acquiring form image data indicating an image of a form in which a handwritten character is not entered, the form corresponding to the entry form based on the read data. An obtaining step, a first area specifying step of specifying a first area surrounded by a contour corresponding to a first pixel value in the read data, and a first area data indicating an image of the first area from the read data. A third obtaining step of obtaining, a form first area specifying step of specifying a form first area corresponding to the first area in the form image data, A fourth acquisition step of acquiring form first data indicating an image from the form image data; a first determination step of determining whether the first area data is different from the first form data; and the first area When it is determined that the data and the form first data are different, while obtaining character string data indicating a character string including at least the first character string included in the first area based on a character recognition process, A first execution step of not acquiring the character string data when it is determined that the area data and the form first data are not different.

By following the information identification method according to the second aspect exemplified in the present specification, the computer of the information identification device identifies information, thereby achieving the same effect as in the first aspect.

An image reading device according to a second aspect exemplified in the present specification reads a reading section that reads an image of a form and an entry form that is a form filled with characters including handwritten characters, which is read by the reading section. First obtaining means for obtaining read data indicating an image, and second obtaining means for obtaining form image data indicating an image of a form in which handwritten characters are not entered, the form corresponding to the entry form based on the read data. Two obtaining means, first area specifying means for specifying a first area surrounded by a contour corresponding to a first pixel value in the read data, and first area data indicating an image of the first area in the read data. A first obtaining means for obtaining a form first area corresponding to the first area in the form image data, and a first form indicating an image of the first form area. Fourth acquisition means for acquiring data from the form image data, first area data, first determination means for determining whether the form first data is different, and the first area data and the form When it is determined that the first data is different from the first data, the character string data indicating a character string including at least the first character string included in the first area is obtained based on a character recognition process, while the first area data and the form A first execution unit that does not acquire the character string data when it is determined that the character string data is not different from the first data.

By using the image reading device according to the third embodiment exemplified in the present specification, the same effect as in the first embodiment can be obtained.

1 is an overall structural diagram of an information identification system 4. FIG. This is a specific example of an unfilled form 100. It is a specific example of an entry form 101. It is a figure which shows the data structure of the registration form DB60 for medical insurances in a registration form DB. FIG. 6 is a diagram showing a data configuration of a medical insurance setting table 70 in the setting table. It is a flowchart which shows an information identification process. It is a flowchart which shows a report type determination process. It is a flowchart which shows a user determination process. It is a flowchart which shows a pre-entry area determination process. It is a flowchart which shows a required entry area. It is a flowchart which shows an arbitrary entry area. It is a flowchart which shows an area determination process. It is a specific example of the error display 81 without a corresponding type. It is a specific example of the entry form reading error display 82. It is a specific example of the reading result display 200. 7 is a specific example of a reading result display 300.

  An embodiment of the present invention will be described with reference to the drawings. First, the system configuration of the information identification system 4 will be described with reference to FIG. The information identification system 4 includes an information identification device 1, an image reading device (hereinafter, referred to as “scanner”) 2, and a management server 3. The information identification device 1 can transmit and receive data and commands to and from the management server 3 via a network 9 including the Internet, a LAN, and other dedicated lines.

  The configuration of the information identification device 1 will be described. Image data corresponding to the content described in a form in which characters including handwritten characters are entered is input to the information identification device 1. The information identification device 1 identifies the types of various entry fields provided in the form from the input image data. The information identification device 1 executes a process according to the identification result. The form is, for example, a paper medium, and includes various insurance contract application forms, mobile telephone contract application forms, various application forms in administrative procedures, and the like. In the present embodiment, the forms are various insurance contract application forms. The information identification device 1 may be a device dedicated to information identification, or a device in which a dedicated application is installed in a general-purpose device such as a so-called personal computer (PC). In the present embodiment, an information identification device 1 using a general-purpose PC will be exemplified. As shown in FIG. 1, the information identification device 1 includes a CPU 10 that is a controller that controls the information identification device 1. The CPU 10 is electrically connected to a ROM 11, a RAM 12, a hard disk drive (hereinafter, referred to as "HDD") 13, and an input / output interface (hereinafter, referred to as "input / output I / F") 14 via a data bus. . The ROM 11 stores a program such as a BIOS for operating the information identification device 1 and initial values. The RAM 12 temporarily stores various data such as a calculation result obtained by a calculation process by the CPU 10.

  The HDD 13 is a nonvolatile storage device. In the present embodiment, the HDD 13 stores a program that causes the CPU 10 to execute an information identification process (see FIG. 6) described later. The HDD 13 is an example of a non-transitory storage medium. The non-transitory storage medium may be any storage medium that can store information regardless of the period in which the information is stored. Non-transitory storage media may not include temporary storage media (eg, transmitted signals). The storage device in the present embodiment is the HDD 13, but the storage device is configured by another non-temporary storage medium, such as a flash memory or a RAM, which can hold data regardless of the length of time for storing information. May be done.

  The input / output I / F 14 mediates data transfer. The input / output I / F 14 includes an external communication interface (hereinafter referred to as “external communication I / F”) 15, a display unit 16 for displaying an image, an operation unit 17 such as a keyboard and a mouse, and a general-purpose image reading unit. The scanner 2 as an apparatus is electrically connected. The external communication I / F 15 connects the information identification device 1 to the network 9. The external communication I / F 15 is, for example, an interface circuit conforming to a standard such as Ethernet (registered trademark). Note that an external display unit 19 that displays an image outside the information identification device 1 can be connected to the external communication I / F 15. The external display unit 19 may be a monitor connectable via the network 9 or a display of a smartphone or a tablet PC connected to the information identification device 1 via the network 9 and the external communication I / F 15. Is also good.

  The information recognition process (see FIG. 6) is based on the read data read from the various insurance applications and, based on the type of entry area provided in the application, data of a character string written in the application. Is part of the software processing that manages The input / output I / F 14 is an interface element conforming to a predetermined standard (for example, Universal Serial Bus (USB)) for connecting the information identification device 1 and an external device such as the scanner 2. The CPU 10 transmits and receives data to and from an external device such as the scanner 2 via the input / output I / F 14.

  The configuration of the scanner 2 will be described. The scanner 2 is a sheet feed scanner or a flatbed scanner. The scanner 2 performs a reading operation of capturing an image of an entry form 101 and the like described later, forms image data, and transmits the image data to the information identification device 1. The scanner 2 may be a read-only scanner for the entry form 101 or a general-purpose scanner.

  The scanner 2 includes a CPU 20 which is a controller that controls the scanner 2. The CPU 20 is electrically connected to a ROM 21, a RAM 22, an input / output interface (hereinafter, referred to as “input / output I / F”) 24, a reading unit 26, a display unit 27, and an operation unit 28 via a data bus. The ROM 21 stores a program such as an OS for operating the scanner 2, an initial value, and the like. The RAM 22 temporarily stores various data such as a calculation result obtained by a calculation process by the CPU 20. In particular, the RAM 22 secures at least a storage area for storing image data of the image of the entry form 101. The input / output I / F 24 mediates data transfer. An external communication I / F 25 is electrically connected to the input / output I / F 24. The external communication I / F 25 connects the scanner 2 to the network 9. The scanner 2 may be connected to the information identification device 1 via the network 9 and the external communication I / F 25. Note that an external display unit 29 that displays an image outside the scanner 2 can be connected to the external communication I / F 25. The external display unit 29 is, for example, a display of a smartphone or a tablet PC connected to the scanner 2 via the network 9 and the external communication I / F 25.

  The reading unit 26 includes a well-known contact-type image sensor. The reading unit 26 reads an image of the entry form 101. The reading unit 26 converts the read analog image into digital image data. The image data is transferred to the information identification device 1 via the input / output I / F 24 or the external communication I / F 25 according to the transfer command of the information identification device 1. The display unit 27 is a display screen that displays an image provided on the scanner 2. The operation unit 28 includes operation buttons for performing various operations of the scanner 2. The scanner 2 performs an operation of reading the image of the entry form 101 via the operation unit 28 or in response to an instruction to read the image of the entry form 101 being input from the information identification device 1.

  The configuration of the management server 3 will be described. The management server 3 may be a general-purpose server as hardware. The management server 3 includes a CPU 30 that controls the management server 3. The CPU 30 is electrically connected to the ROM 31, the RAM 32, the HDD 33, and the input / output I / F 34 via a data bus. The ROM 11 stores programs such as BIOS for operating the management server 3 and initial values. The RAM 32 temporarily stores various data such as a calculation result obtained by the calculation processing by the CPU 30. In the present embodiment, the HDD 33 stores a registration form DB and a form type setting table as a database (hereinafter, referred to as “DB”) for managing various information. The registration form DB is, for example, a medical insurance registration form DB 60 described later (see FIG. 4). The form type setting table is, for example, a medical insurance setting table 70 (see FIG. 5) described later. An external communication I / F 35 is connected to the input / output I / F 34. The external communication I / F 35 connects the management server 3 to the network 9. The external communication I / F 35 is, for example, an interface circuit conforming to a standard such as Ethernet (registered trademark).

  The blank form 100 and the filled form 101 will be described with reference to FIGS. The blank form 100 is an application form for various insurance contracts distributed from an insurance company or the like to an insurance contract applicant (hereinafter, referred to as a user). The blank form 100 has not yet been filled with handwritten characters or the like by the user. The filled-out form 101 is a form in a state after the user has filled in the required form on the unfilled form 100. In the case where the blank form 100 and the completed form 101 are not particularly distinguished or are collectively referred to, they are simply referred to as “forms”.

  The form mainly includes a form type display section 110, a date entry section 120, a user ID section 130, a pre-entry section 140, a first optional entry section 150, and a second optional entry section 160. The form may include various entry fields other than these, but the description is omitted in the present embodiment. The form type display column 110 is a column in which a character string is described in advance by printing or the like. The character string described in advance indicates which type of insurance contract is to be applied for among the various insurance contract application forms. For example, the types of insurance contracts include medical insurance, car insurance, fire insurance, earthquake insurance, and the like. The form type for each insurance contract type is hereinafter referred to as a form type. That is, the form type display field 110 is a field indicating which form type the form is. In the form type display field 110 of the blank form 100 shown in FIG. 3, “Medical insurance contract application form” indicating that it is a medical insurance contract application form is printed as a form type. The form type display field 110 is provided at the upper left of the form. In the present embodiment, the position where the form type display column 110 is provided in the form is the same position regardless of the form type.

  The date entry field 120 is provided below the form type display field 110 in the form. The date entry column 120 is a column where the user enters an application date when applying for an insurance contract. As shown in FIG. 2, the date is not entered in the date entry column 120 in the blank form 100, and is blank. In the present embodiment, if the date of application is not entered in the date entry field 120, the insurance contract is not concluded even if the entry is made in other fields of the form. That is, the date entry column 120 is a column that the user must enter in the form. For this reason, hereinafter, the date entry field 120 is also referred to as an “essential entry field”. As shown in FIG. 3, the date entry field 120 of the entry form 101 is handwritten by the user as "2015", "8" month, "2" day. The outer periphery of the date entry field 120 is bordered by a thick red line, so that a red rectangle indicating the outline of the date entry field 120 is formed on the form. This rectangle is called a first rectangle 121.

  The user ID column 130 is provided to the right of the date entry column 120 in the form. The user ID column 130 is a column in which the user ID is printed by a printer or the like used by a manager of a form such as an insurance company. The user ID is a contractor code or the like indicating a user who intends to make an insurance contract. In the present embodiment, the user ID is a character string assigned to each user in order to identify the user of the form. In one example of the present embodiment, the user ID is "AABBCC1234" shown in FIGS.

  The preliminary entry field 140 is provided below the date entry field 120 and the user ID field 130 in the form. The pre-entry column 140 is a column for the administrator to enter information known by the administrator among the user-specific information before the form is distributed to the user. In the blank form 100 at the time of distribution to the user, the user's own personal information has already been filled in the pre-filled column 140. In the example of the present embodiment, the user “Taro Yamada” is registered in the medical insurance registration form DB in advance in association with the user ID of “AABBCC1234”. The administrator creates an unfilled form 100 in which the information of the user registered in the medical insurance registration form DB 60 is pre-printed in the pre-filled column 140 by a printer or the like used by the administrator. The administrator distributes the created blank form 100 to the user. Specifically, as shown in FIG. 2, “Yamada Taro”, “Taro Yamada”, which indicates the name of the user, which is information of the user registered in the medical insurance registration form DB 60, in the pre-entry field 140, A blank form 100 on which the user's gender, date of birth, address and telephone number are printed in advance is distributed to the user. A green rectangle indicating the outline of the pre-entry column 140 is formed on the form by bordering the outer peripheral portion of the pre-entry column 140 with a thick green straight line. This rectangle is called a second rectangle 141.

  In the pre-filled column 140, an area for stamping an application seal required for applying for a contract, a check box area for entering a check when an address and a telephone number are changed, and an address after the change And an area for entering a telephone number. The user seals these areas of the distributed blank form 100 and fills in the necessary items. In the entry form 101 shown in FIG. 3, an application seal is stamped in the pre-entry column 140, a check is made in the check box area assuming that the address previously printed in the pre-entry column 140 has been changed, and the post-change address is checked. Indicates that the user has filled in the information by hand.

  The first optional entry column 150 is provided below the pre-entry column 140 in the form. The first optional entry column 150 is provided for entering information such as the name of the user's spouse. For example, if the user has a spouse and the insurance contract is to be made for the spouse using the same form, the user writes the spouse information necessary for the contract in the first optional entry column 150 by hand. On the other hand, when the user has no spouse, or when there is a spouse but does not apply for insurance for the spouse, the user does not need to fill out the first optional entry field 150. Thus, the first optional entry field 150 may or may not be filled with handwritten characters as required by the user. For this reason, as shown in FIG. 2, in the blank form 100, the first optional entry column 150 is left blank. FIG. 3 shows an entry form 101 in which a user's spouse's spouse's name, gender box, and date of birth are filled in by hand and an application seal is stamped. The outer periphery of the first optional entry column 150 is bordered by a thick blue straight line, so that a blue rectangle indicating the outline of the first optional entry column 150 is formed on the form. This rectangle is referred to as a third rectangle 151.

  The second optional entry field 160 is provided below the first optional entry field 150 in the form. The second optional entry field 160 is provided for entering information such as the name of the user's child. For example, when the user has a child and makes an insurance contract using the same form for the child, the user writes the child information necessary for the contract in the second optional entry field 160 by hand. On the other hand, when the user does not have a child, or when the user has a child but does not apply for an insurance contract for the child, the user need not fill in the second optional entry field 160. As described above, similarly to the first optional entry column 150, the second optional entry column 160 may or may not include a handwritten character as required by the user. For this reason, as shown in FIG. 2, in the blank form 100, the second optional entry field 160 is left blank. FIG. 3 shows the entry form 101 in which no insurance contract is made for the child of the user, and no information about the child is entered and the second optional entry column 160 is blank. The outer periphery of the second optional entry field 160 is bordered by a bold light blue (light blue) straight line, so that a light blue rectangle indicating the outline of the second optional entry field 160 is formed on the form. This rectangle is called a fourth rectangle 161. In the following, when the first optional entry column 150 and the second optional entry column 160 are collectively referred to, they are also simply referred to as “optional entry columns”.

  As described above, in various forms, there is a case where the user must fill in the form, such as an essential form of the present embodiment, and a case where the form is not filled in by the user, such as an optional form. There are cases where the entry column is mixed. Further, there may be a case where a form to be distributed to the user includes a pre-filled item, such as a pre-filled column 140 of the present embodiment. In a form including a plurality of types of entry fields with different necessity of entry, by enclosing the outline of the entry field with a rectangle using a different color for each type of entry field, the necessity of the form of entry in the form is different. It becomes easier for the user to visually recognize that a plurality of entry fields are included.

  The registration form DB stored in the HDD 33 will be described. In the registration form DB, information such as the name, gender, address, telephone number, etc., which is the personal information of a plurality of contract applicants, is associated with the user ID assigned to each of the contract applicants, It is registered for each.

  FIG. 4 shows a DB that manages information on a contract applicant for a medical insurance form type and information on a form that is a contract application form among various types of insurance contracts registered in the registration form DB. is there. FIG. 4 illustrates the minimum unit data registered in association with the user ID “AABBCC1234” in the entire medical insurance registration form DB 60.

  The medical insurance registration form DB 60 manages information by classifying registration items into columns of a “form management information” column, a “identity information” column, a “spouse information” column, and a “child information” column. The form management information column includes registration items of “user ID”, “registration date”, “application date”, and “registered form image data”. In the “registration date”, the date at which the administrator has registered the user ID and the information associated with the user ID in the medical insurance registration form DB 60 is registered. In the “application date”, when a character string indicating the date entered in the date entry field 120 of the entry form 101 is acquired by executing the information identification process described later, the date based on the acquired character string is “ Application date. " In the “registered form image data”, image data indicating an image of the entire blank form 100 corresponding to the user ID is registered. In the present embodiment, the image data is in the JPEG format, but the format of the image data may be another format such as a GIF format.

  In each registration item included in the principal information column, information indicating the name, gender, address, and telephone number of the contract applicant is registered in advance in association with the user ID. The registered contents in the personal information column are contents to be printed in advance in the pre-filled column 140 of the blank form 100.

  Each of the registration items included in the spouse information column is acquired when a character string or the like indicating the content entered in the first optional entry column 150 of the entry form 101 is acquired by executing the information identification process described later. Each content based on the entered character string is registered. In the child information column, when a character string or the like indicating the content entered in the second optional entry column 160 of the entry form 101 is acquired by executing the information identification process described later, each character string based on the acquired character string and the like is displayed. The contents are registered. Therefore, the spouse information section and the child information section have no registration contents at the registration date of the medical insurance registration form DB 60 and at the time when the blank form 100 is created based on the medical insurance registration form DB 60. So it is blank. In FIG. 4, "-" indicates that there is no registered content corresponding to the registered item.

  The medical insurance setting table 70 stored in the HDD 33 will be described with reference to FIG. The medical insurance setting table 70 stores setting information on a medical insurance contract application form among forms corresponding to a plurality of types of insurance contract applications handled by the administrator. Although not shown, the HDD 33 stores a plurality of setting tables for storing form setting information corresponding to various form types other than the medical insurance setting table 70. The setting information is information indicating the arrangement of each of the form type display section 110, date entry section 120, pre-entry section 140, first optional entry section 150, and second optional entry section 160 in the form.

  The medical insurance setting table 70 includes a “type area” field, an “ID area” field, a “pre-fill area” field, a “required data area” field, a “first optional area” field, and a “second optional area”. In the column, the setting information is classified and stored. The type area column stores information on “coordinate position”, “area range”, and “type area data” for the form type display field 110 in the form. The coordinate position (x0, y0) is a position where the upper left portion of the form type display column 110 is arranged in the form in the read data obtained by reading the form, the position of the upper left corner of the form is the origin of the xy coordinates. The coordinates are displayed as (0, 0). The area range is information used for extracting image data corresponding to the form type display column 110 from the read data in a form type determination process (see FIG. 7) described later. The region range indicates the width and height of the extraction region with the origin at (x0, y0) in terms of the number of dots (number of pixels). The area range “25 × 80” based on the coordinate position (x0, y0) is set to be slightly larger than the position and area occupied by the form type display field 110 in the form. The registration type area data stores, as a template for pattern matching, image data indicating the form type display field 110 in the form before the content corresponding to the pre-filled field 140 is printed on the blank form 100. The data format of the registration type area data may be any format that allows pattern matching, including the JPEG format. FIG. 5 shows one piece of image data having a file name of “iryohoken.jpg” as the registration type area data. “Iryohoken.jpg” is image data associated with a form type indicating a medical insurance contract application form. The registration type area data also includes image data indicating a form type display column 110 corresponding to various form types. In each of the setting tables for the other form types, a column similar to the “type region” column is provided.

  The “ID area” field stores information on “coordinate position” and “area range” for the user ID field 130 in the form. The coordinate position (x1, y1) indicates the position where the upper left portion of the user ID column 130 in the read data is arranged in the form with respect to the origin (0, 0). The area range is information used for determining a user ID from read data in a user ID determination process (see FIG. 8) described later. The area range indicates the height and width of the area with the origin at (x1, y1) in terms of the number of dots.

  The pre-filled area field stores information on “coordinate position”, “area range”, “first pixel value”, and “first threshold” for the pre-filled area 140 in the form. The coordinate position (x2, y2) indicates the position where the upper left portion of the pre-entry field 140 in the read data is arranged in the form with respect to the origin (0, 0). The area range is information used for specifying the second rectangle 141 corresponding to the pre-entry column 140 from the read data in the area determination process (see FIG. 12) described later. The area range is obtained by displaying the height and width of the area with the origin at (x2, y2) by the number of dots. The area range “100 × 200” based on the coordinate position (x2, y2) is set to be slightly larger than the position and area occupied by the second rectangle 141 in the form. The first pixel value is a value indicating the green color of the second rectangle 141 provided in the form in the RGB format with 256 gradations for each color. The first threshold value defines a range to be regarded as a first pixel value when the second rectangle 141 is specified in the area determination processing. In the present embodiment, the first threshold “± 5” is the same as the color of the pixel value included in the range of five steps before and after the pixel value defined as the first pixel value. Defines what to consider as color.

  The mandatory entry area column stores information on “coordinate position”, “area range”, “second pixel value”, and “second threshold” for the date entry field 120 in the form, similarly to the pre-entry area field. ing. The area range “30 × 130” based on the coordinate position (x3, y3) is set to be slightly larger than the position and area occupied by the first rectangle 121 in the form. The second pixel value is a value indicating the red color of the first rectangle 121 provided on the form in the RGB format of 256 gradations for each color.

  Similarly, the first arbitrary area column stores information on “coordinate position”, “area range”, “third pixel value”, and “third threshold” for the first arbitrary entry field 150 in the form. Similarly, the second arbitrary area column stores information on “coordinate position”, “area range”, “fourth pixel value”, and “fourth threshold” for the second arbitrary entry field 160 in the form. The area range “50 × 200” based on the coordinate position (x4, y4) is set to be slightly larger than the position and area occupied by the third rectangle 151 in the form. The area range “150 × 200” based on the coordinate position (x5, y5) is set to be slightly larger than the position and area occupied by the fourth rectangle 161 in the form. Note that the third pixel value is a pixel value indicating a color different from the first pixel value and the second pixel value, and the value indicating blue of the third rectangle 151 provided on the form is RGB gradation of 256 gradations for each color. It is shown in the format. The fourth pixel value is a pixel value indicating a color different from the first pixel value, the second pixel value, and the third pixel value. The value indicating the light blue color of the fourth rectangle 161 provided in the form is 256 floors for each color It is shown in RGB format. Similarly to the first threshold value, the second threshold value, the third threshold value, and the fourth threshold value also define that the color of the pixel value included in the range of five steps before and after the corresponding pixel value is regarded as the same color. Note that the first pixel value, the second pixel value, the third pixel value, and the fourth pixel value are expressed in a color space other than the RGB format (for example, a YCbCr format using luminance and color difference, a hue, HSV format).

  The information identification processing according to the present embodiment will be described with reference to FIGS. The information identification process is a process of identifying each area provided in the form based on the read data obtained by reading the image of the entry form 101 by the scanner 2, and acquiring the read result data according to the identification result.

  Prior to the start of the information identification process, the administrator prepares a registration form DB including the medical insurance registration form DB 60 for each type of insurance contract. Further, the administrator associates the user ID with the personal information and registers it in the registration form DB corresponding to the type of insurance contract for which the user desires the contract. Then, based on the registration contents registered in the registration form DB, the administrator creates an unfilled form 100 in which the user ID is printed in the user ID column 130 and the personal information is printed in the pre-entry column 140, respectively. The blank form 100 is not limited to be created by being printed on a paper medium or the like by a printer or the like. For example, an unfilled form 100 may be generated as an image file by outputting the registered contents registered in the registration form DB to a file. The administrator obtains image data representing the image of the created blank form 100 by using the scanner 2 or the like, associates the obtained image data with the form type and the user ID, and registers the registered form image in the registration form DB. Register as data. In the following, it is assumed that the administrator has distributed the blank form 100 to a user who desires a medical insurance contract. It is assumed that the user has submitted a filled-out form 101 in which necessary items are filled in the distributed blank form 100 to the administrator. It is assumed that a process related to the entry form 101 is performed in the information identification process.

  As shown in FIG. 6, when the information identification process is started, the CPU 10 transmits an instruction to read the image of the entry form 101 to the scanner 2 via the input / output I / F 14 (S11). The scanner 2 that has received the instruction reads the entry form 101 in the reading unit 26, generates read data that is data of the read image, and transmits the read data to the information identification device 1. The CPU 10 acquires the read data transmitted from the scanner 2 via the input / output I / F 14 (S12). If the blank form 100 is generated as an image file, the CPU 10 does not need to perform the process of S11. In this case, the CPU 10 may acquire an image file based on the blank form 100 in the process of S12. Thereafter, the CPU 10 sequentially executes a form type determination process (S13), a user determination process (S14), a pre-filled area determination process (S15), a required entry area determination process (S16), and an optional entry area determination process (S18).

  The form type determination process (S13, see FIG. 6) will be described with reference to FIG. The form type determination process is a process for determining the form type of the entry form 101 based on the read data. When the form type determination process is started, the CPU 10 determines whether the read data is color image data (S31). For this determination, a known determination method using the magnitude and distribution of the saturation indicated by the read image data may be used. In the present embodiment, the regular form distributed to the user by the administrator is a date entry box 120 surrounded by a red rectangle, a pre-entry box 140 surrounded by a green rectangle, and a first box surrounded by a blue rectangle. An optional entry field 150 and a second optional entry field 160 surrounded by a light blue rectangle are included. If the read image data is not color image data, the user may use a form other than the form normally distributed by the administrator, and the process of S31 is provided to eliminate this.

  If the read data is color image data (S31: YES), the CPU 10 extracts form type area data from the read data (S32). The form type area data is image data of a portion corresponding to the form type display field 110 of the entry form 101 in the read data. In the present embodiment, in a form handled by the administrator, the position and area range where the form type display column 110 is provided in the form are the same through the form type. The CPU 10 refers to one of the setting tables including the medical insurance setting table 70 stored in the HDD 33. The CPU 10 extracts, from the read data, image data of a portion corresponding to a coordinate position and a coordinate range defined in the type area column of the referred setting table as form type area data.

  The CPU 10 compares the extracted form type area data with the registration type area data stored in the above-described setting table type area column (S33). In this process, the CPU 10 acquires the registration type area data with reference to the setting table stored in the HDD 33, and performs template matching of the extracted form type area data on the acquired registration type area data.

  The CPU 10 determines whether there is any registered type area data that matches the form type area data (S34). If there is any registered type area data that matches the form type area data (S34: YES), the CPU 10 determines the form type associated with the matched registered type area data as the form type of the entry form 101. (S35). The CPU 10 stores the determination result of the form type in the RAM 12. In the example of the present embodiment, it is assumed that the determination that the form type is “for medical insurance” is stored in the RAM 12. The CPU 10 returns the processing to the information identification processing (see FIG. 6).

  On the other hand, if the read data is not color image data (S31: NO), or if there is no registration type area data that matches the form type area data (S34: NO), the CPU 10 displays the corresponding typeless error display 81 (FIG. 13) is transmitted to the display unit 16 via the input / output I / F 14 (S36). The error display 81 with no corresponding type indicates that the entry form 101 is not a regular form, and that the form type indicated in the form type display column 110 provided in the entry form 101 does not correspond to the information identification processing. Is an image displayed to be shown in FIG. The image data indicating the error display 81 without the corresponding type is stored in the HDD 33. The display unit 16 displays the no-type error display 81 in accordance with the instruction in the processing of S36. The CPU 10 shifts the processing to the determination of S29 (see FIG. 6).

  The user determination processing (S14, see FIG. 6) will be described with reference to FIG. The user determination process is a process for determining the user of the entry form 101 based on the read data. When the user determination process is started, the CPU 10 extracts user ID area data from the read data (S41). The user ID area data is image data of a portion corresponding to the user ID column 130 of the entry form 101 in the read data. In this process, the CPU 10 refers to the determination result of the form type stored in the RAM 12 and acquires information indicating that the form type of the read data is “for medical insurance”. The CPU 10 refers to the medical insurance setting table corresponding to the acquired form type among the setting tables stored in the HDD 33. The CPU 10 extracts, from the read data, image data of a portion corresponding to the coordinate position and the coordinate range defined in the ID area column of the medical insurance setting table 70 as user ID area data. The CPU 10 stores the extracted user ID area data in the RAM 12.

  The CPU 10 performs a character recognition process on the extracted user ID area data (S42). In the present embodiment, as a character recognition process, a known OCR process for extracting a feature corresponding to a contour of a character from an image and comparing the extracted feature with a standard pattern of the character is employed. The CPU 10 extracts characters from the user ID area data stored in the RAM 12 by executing the OCR process. In the OCR process, a known library including a feature extraction step such as a known edge detection technique and a matching step of comparing the extracted feature with a character template can be used. The CPU 10 analyzes the extracted characters and specifies the characters printed in the user ID column 130. The CPU 10 generates ID character string data that is character string data indicating a character string printed in the specified user ID column 130 and stores the ID character string data in the RAM 12.

  The CPU 10 refers to the registered form DB of the form type determined in the process of S35 (see FIG. 7) among the registered form DBs stored in the HDD 33 (S43). In the example of the present embodiment, since the form of “for medical insurance” is stored in the RAM 12, it is assumed that the CPU 10 refers to the medical insurance registration form DB 60 accordingly. The CPU 10 compares the registered user ID, which is a plurality of user IDs registered in the referred registration form DB, with ID character string data stored in the RAM 12 (S45).

  The CPU 10 determines whether the registered user ID has a character string that matches the character string indicated by the ID character string data (S46). If there is no character string that matches the character string indicated by the ID character string data in the registered user ID (S46: NO), the CPU 10 determines that there is no registered user ID corresponding to the character string indicated by the ID character string data. An instruction to output a no-error display (not shown) is transmitted to the display unit 16 via the input / output I / F 14 (S47). The error display without the corresponding ID is, for example, an image indicating a message such as “the corresponding registered user ID does not exist”. The display unit 16 displays an error display without a corresponding ID according to the instruction in S47.

  The CPU 10 transmits an instruction to output a direct input display (not shown) to the display unit 16 via the input / output I / F 14 (S48). The direct input display is, for example, a screen for urging a worker to input a user ID described in the user ID column 130 of the entry form 101 using the operation unit 17. This process is performed to acquire ID character string data when ID character string data is not correctly generated from read data, for example, when the print density of the user ID printed on the entry form 101 is low. The display unit 16 displays a direct input display according to the instruction in S48.

  The CPU 10 acquires the ID character string data input via the operation unit 17 (S49). Thereafter, the CPU 10 repeats the processing from S43 to S47 until it is determined that the registered user ID has a character string that matches the character string indicated by the ID character string data (S46: YES). When the processing from S43 to S47 is repeated a predetermined number of times or more, the CPU 10 may shift the processing to the determination at S29 (see FIG. 6).

  If the registered user ID includes a character string that matches the character string indicated by the ID character string data (S46: YES), the CPU 10 assigns the registered user ID that matches the character string indicated by the ID character string data to the read data. The user ID is obtained as the user ID (S50). The CPU 10 stores data indicating the acquired user ID in the RAM 12. The CPU 10 returns the processing to the information identification processing (see FIG. 6). In the example of the present embodiment, it is assumed that the user ID indicating the character string “AABBCC1234” printed in the user ID column 130 of the entry form 101 is stored in the RAM 12.

  The pre-entry determination process (S15, see FIG. 6) will be described with reference to FIG. In the pre-entry determination process, it is determined whether the read data includes the first area corresponding to the pre-entry column 140. If the read data includes the first area, first area data indicating an image of the first area is acquired, and a process is performed according to the content of the acquired first area data. As shown in FIG. 9, when the pre-entry area determination processing is started, the CPU 10 refers to the setting table of the form type determined in the processing of S35 (see FIG. 7) among the setting tables stored in the HDD 33. (S51). In the example of the present embodiment, since the form type is “for medical insurance” is stored in the RAM 12 by the processing of S35, it is assumed that the CPU 10 refers to the medical insurance setting table 70 accordingly. The CPU 10 acquires the first pixel value and the first threshold value from the pre-filled area column of the setting table (S52). The first pixel value and the first threshold acquired here are also referred to as a set pixel value and a set threshold in the pre-filled area determination processing.

  The CPU 10 executes an area determination process (S53). The area determination process (S53, see FIG. 9) will be described with reference to FIG. The region determination process is a process of determining whether the read data includes a region surrounded by a color corresponding to the set pixel value, based on the set pixel value and the set threshold in the pre-filled region determination process. Note that the area determination processing is also executed in an essential entry area determination processing (see FIG. 10) and an optional entry area determination processing (see FIG. 11) described later. In this case, based on the set pixel value and the set threshold in the essential entry area determination processing, or the set pixel value and the set threshold in the optional entry area determination processing, whether an area surrounded by the color corresponding to the set pixel value is included. Is determined.

  As shown in FIG. 12, when the area determination process is started, the CPU 10 sets a search area range (S111). As described above, the search area range is an area range in which the coordinate position of a pixel having a pixel value corresponding to the set pixel value is searched in the read data. Specifically, the CPU 10 refers to the setting table of the form type determined in the process of S35 (see FIG. 7) among the setting tables stored in the HDD 33, and determines the coordinate position and the area range corresponding to the set pixel value. To get. In the example of the present embodiment, the medical insurance setting table 70 is referred to, and the coordinate position (x2, y2) associated with the first pixel value that is the set pixel value in the pre-filled area field of the medical insurance setting table 70 is referred to. ), And an area range “100 × 200” with the coordinate position as the origin is assumed to be acquired. The CPU 10 sets an area range based on the acquired coordinate position as a search area range.

  The CPU 10 determines whether each of the pixels indicating the coordinate positions in the search area range in the read data has a pixel value corresponding to the set pixel value. The pixel value corresponding to the set pixel value is a pixel value within a set threshold value range for the set pixel value. Here, the pixel values within the respective ranges of 0 ≦ R ≦ 5, 250 ≦ G ≦ 255, and 0 ≦ B ≦ 5 correspond to the set pixel values. In the present embodiment, it is repeatedly determined whether or not each of the pixels indicating the coordinate position in the search area range in the read data has a pixel value within the range of the first threshold with respect to the first pixel value. Then, for the pixel determined to have the pixel value corresponding to the set pixel value, the CPU 10 acquires the coordinate position of each pixel (S112). The CPU 10 stores the acquired coordinate position in the RAM 12.

  The CPU 10 calculates an approximate straight line by approximating the plurality of coordinate positions acquired in the process of S112 using a known linear approximation method such as a least squares method (S113). In the example of the present embodiment, an approximate straight line corresponding to each side of the green second rectangle 141 bordering the pre-entry column 140 provided in the entry form 101 is calculated in the range of the read data search area. In this process, for example, the CPU 10 assigns each of the pixels acquired in S112 to a cluster using the K-means method. Since the calculation of approximate straight lines corresponding to the four sides of the rectangle is assumed, the number of clusters is set to “4”. By approximating each cluster using the straight line approximation method, an approximate straight line corresponding to each side of the second rectangle 141 is calculated. Note that the number of clusters to be set may be appropriately adjusted according to the number of pre-filled areas.

  The CPU 10 acquires the registered form image data corresponding to the form type and the user ID from the registered form DB stored in the HDD 33 (S115). Specifically, the CPU 10 refers to the registered form DB of the form type determined in the process of S35 (see FIG. 7) among the registered form DBs stored in the HDD 33, and from the registered form DB of the referred type, The registration form image data corresponding to the user ID obtained in the process of S50 (see FIG. 8) is obtained. In the example of the present embodiment, the form of “medical insurance” is stored in the RAM 12 by the processing of S35, and the user ID indicating the character string of “AABBCC1234” is stored in the RAM 12 by the processing of S50. . Therefore, it is assumed that the medical insurance registration form DB 60 shown in FIG. 4 in the registration form DB is referred to, and the registration form image data “AABBCC1234 — 0.jpg” associated with the user ID “AABBCC1234” is obtained.

  The CPU 10 determines the shape of the approximate straight line calculated in the processing of S113 and the rectangular shape formed by the pixels having the pixel values corresponding to the set pixel values in the registered form image data acquired in the processing of S115. A comparison is made (S116). When the area determination processing is performed in the pre-fill area determination processing (see FIG. 9), the set pixel value is the first pixel value defined in the pre-fill area of the setting table. In the present embodiment, the first pixel value defined in the pre-filled area of the medical insurance setting table 70 is a pixel value indicating green corresponding to the color indicated by the second rectangle 141 provided in the entry form 101. is there. The CPU 10 specifies the shape of the graphic indicated by the set of pixels having the first pixel value, which is the set pixel value, included in the registered form image data. In specifying the shape of the graphic represented by the set of pixels having the first pixel value, the CPU 10 sets a predetermined search area in the registered form image data in the same manner as in the process of S111. As in the process of S112, the CPU 10 obtains the coordinate position of each pixel for a pixel determined to have a pixel value corresponding to the set pixel value in the search area. Then, similarly to the processing of S113, the CPU 10 calculates an approximate straight line based on the acquired plurality of coordinate positions. In this case, the shape of the second rectangle 141 included in the registered form image data is specified. Then, the CPU 10 compares the shape of the specified second rectangle 141 with the shape formed by the approximate straight line based on the read data.

  The CPU 10 determines whether or not the shape of the specified second rectangle 141 and the shape formed by the approximate straight line based on the read data are within a predetermined same range (S117). If the shape of the specified second rectangle 141 and the shape formed by the approximate straight line based on the read data are not within the same predetermined range (S117: NO), the CPU 10 executes the pre-entry area determination processing (see FIG. 9). Return to On the other hand, when the shape of the specified second rectangle 141 and the shape of the approximate straight line based on the read data are within a predetermined same range (S117: YES), the CPU 10 determines the shape of the approximate straight line based on the read data. The region surrounded by is specified as a region corresponding to the set pixel value (S118). In this case, an area in which the set pixel value is specified as the first pixel value is hereinafter referred to as a first area. The CPU 10 stores information such as coordinate values indicating the position and size of the first area in the read data in the RAM 12. The CPU 10 returns the processing to the pre-entry area determination processing (see FIG. 9). If the area determination processing has been executed in the required entry area determination processing or the optional entry area determination processing, the CPU 10 returns the processing to the essential entry area determination processing or the optional entry area determination processing.

  Returning to the description of FIG. The CPU 10 determines whether the first region corresponding to the first pixel value has been specified in the region determination processing (S54). In this process, the CPU 10 determines that the first area is specified in the area determination processing when information such as coordinate values indicating the position and size of the first area in the read data is stored in the RAM 12. . If the first area is not specified in the area determination processing (S54: NO), the CPU 10 returns the processing to the information identification processing (see FIG. 6). This process takes into account that the form may not have the pre-filled column 140 and the first area may not be specified.

  If the first area is specified in the area determination processing (S54: YES), the CPU 10 stores the first area data indicating the image of the first area in the information such as the coordinate values of the first area stored in the RAM 12. (S55). The first area data corresponds to the image of the pre-entry field 140 in the entry form 101.

  The CPU 10 specifies the position and the size of the area surrounded by the graphic indicated by the set of pixels of the first pixel value that is the set pixel value in the registered form image data (S56). In this case, the CPU 10 stores in the RAM 12 information such as coordinate values indicating the position and size of the area surrounded by the second rectangle 141 corresponding to the first pixel value in the registered form image data. The CPU 10 acquires the registered first area data indicating the image of the area surrounded by the second rectangle 141 from the registered form image data based on information such as coordinate values stored in the RAM 12 (S58). The registered first area data corresponds to the image of the pre-filled column 140 in the blank form 100.

  The CPU 10 compares the first area data with the registered first area data (S59). In this comparison, the CPU 10 analyzes, for example, color elements (gradations and hues) for each pixel constituting the first area data. Then, the CPU 10 obtains a histogram having the color element of the first area data as a horizontal axis, which is a result of analyzing each pixel. The CPU 10 also obtains a histogram having the color element of the registered first area data as the horizontal axis, for the registered first area data. The CPU 10 compares the obtained histograms. The histogram of the first area data corresponds to the content printed and printed in the pre-filled column 140 of the blank form 100. The histogram of the registered first area data includes, in addition to the contents printed and printed in the pre-entry field 140 of the entry form 101, the contents of the entered handwritten characters and the like when the user has entered handwritten characters and the like. Corresponds to the content in which.

  The CPU 10 determines whether there is a difference between the first area data and the registered first area data (S61). This determination is made, for example, by comparing the histogram of the first area data with the histogram of the registered first area data and determining whether there is a difference between the histograms. That is, by the process of S61, it is determined whether the user has entered handwritten characters or the like in the pre-entry column 140 of the entry form 101 with respect to the pre-entry column 140 of the non-entry form 100. In the example of the present embodiment, the pre-entry field 140 of the unfilled form 100 shown in FIG. 2 corresponds to the content registered in advance by the administrator in association with the user ID “AABBCC1234” in the medical insurance registration form DB 60. The printed content is shown. In the pre-entry column 140 of the entry form 101 shown in FIG. 3, in addition to the content pre-printed in the pre-entry column 140, the address change content is entered by hand, and the user's application seal is stamped. In this case, a difference occurs between the histogram of the first area data and the histogram of the registered first area data.

  When there is a difference between the first area data and the registered first area data (S61: YES), the CPU 10 sets the first area data as an execution target of the character recognition processing in the processing of S21 (see FIG. 6) described later. It is determined (S62). The CPU 10 stores in the RAM 12 that the first area data is to be subjected to the character recognition processing. The CPU 10 returns the processing to the information identification processing (see FIG. 6).

  On the other hand, when there is no difference between the first area data and the registered first area data (S61: NO), the CPU 10 determines the first area as the brightness change display target (S63). The CPU 10 acquires, from the first area data, the average value of the luminance values indicated by the entire first area data. The CPU 10 stores the average value of the acquired luminance values in the RAM 12 in association with the fact that the first area has been determined as the luminance change display target. The CPU 10 returns the processing to the information identification processing (see FIG. 6).

  The required entry determination process (S16, see FIG. 6) will be described with reference to FIG. In the required entry determination processing, it is determined whether the read data includes the second area corresponding to the date entry field 120. If the second area is included in the read data, second area data indicating an image of the second area is acquired, and a process according to the content of the acquired second area data is performed. As shown in FIG. 10, when the essential entry area determination processing is started, the CPU 10 refers to the setting table of the form type determined in the processing of S35 (see FIG. 7) among the setting tables stored in the HDD 33. (S71). The CPU 10 acquires the second pixel value and the second threshold from the required entry area column of the setting table (S72). In the example of the present embodiment, it is assumed that the second pixel value indicating red and the second threshold value have been acquired according to the reference to the medical insurance setting table 70. The second pixel value and the second threshold acquired here are also referred to as a set pixel value and a set threshold in the essential entry area determination processing.

  The CPU 10 executes the above-described area determination processing (see FIG. 12) based on the set pixel value and the set threshold in the essential entry area determination processing (S73). In the area determination processing, a search area range for searching the coordinate position of a pixel having a pixel value corresponding to the second pixel value in the read data is set based on the setting table (S111). Then, the coordinate position of the pixel having the pixel value corresponding to the second pixel value in the search area range is obtained (S112). An approximate straight line is calculated from the acquired coordinate positions (S113). Registered form image data corresponding to the form type and user ID is acquired from the registered form DB (S115). A shape formed by the approximate straight line is compared with a rectangular shape formed by pixels having a pixel value corresponding to the second pixel value in the registered form image data (S116). A rectangle formed by pixels having a pixel value corresponding to the second pixel value in the registered form image data corresponds to the shape of the first rectangle 121 provided in the form. It is determined whether the shape of the second rectangle 141 in the registered form image data and the shape formed by the approximate straight line based on the read data are within a predetermined same range (S117). When the shape of the second rectangle 141 in the registered form image data and the shape of the approximate straight line based on the read data are within a predetermined same range (S117: YES), the shape is surrounded by the shape of the approximate straight line. The region is specified as a second region corresponding to the second pixel value (S118).

  The CPU 10 determines whether the second area has been specified in the area determination processing (S74). The CPU 10 determines that the second area is specified when information such as a coordinate value indicating the position and size of the second area in the read data is stored in the RAM 12.

  If the area corresponding to the second pixel value has not been specified in the area determination processing (S74: NO), the CPU 10 sends an instruction to output the entry form reading error display 82 (see FIG. 14) to the input / output I / F 14 It is transmitted to the display unit 16 via the display (S84). Since the date entry field 120 is a mandatory entry field in the form, it is assumed that the date entry field 120 always exists in the form. However, the second area corresponding to the date entry field 120 may not be specified in the area determination processing because the read data has not been properly acquired. The entry form reading error display 82 is an image displayed to prompt the operator to read the entry form 101 again in the reading unit 26 and newly acquire read data. In the example of the present embodiment, the form reading error display 82 prompts the operator to read the form 101 by displaying a message “Please scan the form again”. Image data indicating the form reading error display 82 is stored in the HDD 33. The display unit 16 displays the no-type error display 81 according to the instruction in the processing of S74.

  The CPU 10 determines whether an instruction to read the entry form 101 in the reading unit 26 has been input via the operation unit 17 (S85). When an instruction to read the entry form 101 in the reading unit 26 is input (S85: YES), the CPU 10 returns the processing to S11 (see FIG. 6). When an instruction to read the entry form 101 in the reading unit 26 is not input (S85: NO), the CPU 10 shifts the processing to the determination of S29 (see FIG. 6).

  If the area corresponding to the second pixel value has been specified in the area determination process (S74: YES), the CPU 10 stores the second area data indicating the image of the second area in the second area stored in the RAM 12. It is obtained from the read data based on information such as coordinate values (S75). The second area data corresponds to the image of the date entry field 120 in the entry form 101.

  The CPU 10 specifies the position and the size of the area surrounded by the graphic indicated by the set of pixels of the second pixel value that is the set pixel value in the registered form image data (S76). In this case, the CPU 10 stores information such as coordinate values indicating the position and size of the area surrounded by the first rectangle 121 in the registered form image data in the registered form image data. The CPU 10 acquires registered second area data indicating an image of an area surrounded by the first rectangle 121 from the registered form image data based on information such as coordinate values stored in the RAM 12 (S78). The registered first area data corresponds to the image of the date entry field 120 in the blank form 100.

  The CPU 10 compares the second area data with the registered second area data (S79). In this process, the CPU 10 acquires, for example, histograms on the color elements of the second area data and the registered second area data, respectively. The CPU 10 compares each histogram.

  The CPU 10 determines whether there is a difference between the first area data and the registered first area data (S81). This determination is made, for example, based on whether there is a difference between the histograms. That is, by the process of S81, it is determined whether the user has entered handwritten characters or the like in the date entry field 120 of the entry form 101 with respect to the date entry field 120 of the blank entry form 100. In the example of the present embodiment, the date entry field 120 of the blank form 100 shown in FIG. 2 is blank, but the date entry field 120 of the entry form 101 shown in FIG. 3 contains “2015”, “8”, and “2”. Dates based on numbers are entered by hand. In this case, a difference occurs between the histogram of the second area data and the histogram of the registered second area data.

  When there is a difference between the second area data and the registered second area data (S81: YES), the CPU 10 sets the second area data as an execution target of a character recognition process in a process of S21 (see FIG. 6) described later. It is determined (S82). The CPU 10 stores in the RAM 12 that the second area data is to be subjected to the character recognition processing. The CPU 10 returns the processing to the information identification processing (see FIG. 6).

  On the other hand, when there is no difference between the second area data and the registered second area data (S81: NO), the CPU 10 stores in the RAM 12 an instruction to output the error display 83 (see FIG. 16) in the required entry field. (S83). The error display 83 in the mandatory entry column blank field indicates that there is no difference between the second area data and the registered second area data in the read result display described later, that is, the necessary entry is not made in the date entry box 120. Is an image displayed for indicating to the operator in association with the second area. The CPU 10 returns the processing to the information identification processing (see FIG. 6).

  The optional entry determination process (S18, see FIG. 6) will be described with reference to FIG. In the optional entry determination process, it is determined whether the read data includes an area corresponding to the optional entry column. If the read data includes an area corresponding to the optional entry field, corresponding area data indicating an image of the area corresponding to the optional entry field is acquired, and a process corresponding to the content of the acquired corresponding area data is performed. Is As shown in FIG. 11, when the arbitrary entry area determination processing is started, the CPU 10 refers to the setting table of the form type determined in the processing of S35 (see FIG. 7) among the setting tables stored in the HDD 33. (S91). The CPU 10 sets a third pixel as a setting pixel value and a setting threshold from a first arbitrary area column set in a higher-order column of the first arbitrary area column and the second arbitrary area column corresponding to the arbitrary entry column of the setting table. The pixel value and the third threshold are obtained (S92). In the example of the present embodiment, it is assumed that the third pixel value and the third threshold value indicating blue have been acquired according to the reference to the medical insurance setting table 70.

  The CPU 10 executes the above-described region determination processing (see FIG. 12) based on the set pixel value and the set threshold (S93). In the area determination processing, a search area range for searching for the coordinate position of a pixel having a pixel value corresponding to the third pixel value in the read data is set based on the setting table (S111). Then, a coordinate position of a pixel having a pixel value corresponding to the third pixel value in the search area range is obtained (S112). An approximate straight line is calculated from the acquired coordinate positions (S113). Registered form image data corresponding to the form type and user ID is acquired from the registered form DB (S115). The shape formed by the approximate straight line is compared with the rectangular shape formed by pixels having a pixel value corresponding to the third pixel value in the registered form image data (S116). A rectangle formed by pixels having a pixel value corresponding to the third pixel value in the registered form image data corresponds to the shape of the third rectangle 151 provided in the form. It is determined whether the shape of the third rectangle 151 in the registered form image data and the shape formed by the approximate straight line based on the read data are within the same predetermined range (S117). When the shape of the third rectangle 151 in the registered form image data and the shape formed by the approximate straight line based on the read data are within a predetermined same range (S117: YES), it is surrounded by the shape formed by the approximate straight line. The region is specified as a third region corresponding to the third pixel value (S118).

  The CPU 10 determines whether the third region has been specified in the region determination process (S94). The CPU 10 determines that the third area is specified when information such as a coordinate value indicating the position and size of the third area in the read data is stored in the RAM 12. If the area corresponding to the third pixel value has not been specified in the area determination processing (S94: NO), the CPU 10 returns the processing to the information identification processing (see FIG. 6). This process takes into account that an optional entry is not provided in the form and the third area may not be specified.

  If the area corresponding to the third pixel value has been specified in the area determination processing (S94: YES), the CPU 10 stores the third area data indicating the image of the third area in the third area stored in the RAM 12. It is obtained from the read data based on information such as coordinate values (S95). The third area data corresponds to the image of the first optional entry column 150 in the entry form 101.

  Based on the third pixel value, the CPU 10 specifies the position and the size of the area surrounded by the graphic indicated by the set of pixels of the third pixel value that is the set pixel value in the registered form image data (S96). ). In this case, the CPU 10 stores information such as coordinate values indicating the position and size of the area surrounded by the third rectangle 151 corresponding to the third pixel value in the registered form image data in the RAM 12. The CPU 10 acquires registered third area data indicating an image of an area surrounded by the third rectangle 151 from the registered form image data based on information such as coordinate values stored in the RAM 12 (S98). The registered third area data corresponds to the image of the first optional entry column 150 in the blank form 100.

  The CPU 10 compares the third area data with the registered third area data (S99). In this process, the CPU 10 acquires, for example, histograms on the color elements of the third area data and the registered third area data, respectively. The CPU 10 compares each histogram.

  The CPU 10 determines whether there is a difference between the third area data and the registered third area data (S101). This determination is made, for example, based on whether there is a difference between the histograms. That is, by the process of S101, it is determined whether the user has entered handwritten characters or the like in the first optional entry field 150 of the filled-out form 101 with respect to the first optional entry field 150 of the unfilled form 100. In the example of the present embodiment, the first optional entry column 150 of the blank form 100 shown in FIG. 2 is blank, but the first optional entry column 150 of the entry form 101 shown in FIG. Is written in handwriting. In this case, a difference occurs between the histogram of the third area data and the histogram of the registered third area data.

  When there is a difference between the third area data and the registered third area data (S101: YES), the CPU 10 sets the third area data as an execution target of a character recognition process in a process of S21 (see FIG. 6) described later. It is determined (S102). The CPU 10 stores in the RAM 12 that the third area data is to be subjected to the character recognition processing. On the other hand, when there is no difference between the third area data and the registered third area data (S101: NO), the CPU 10 determines the third area as a luminance change display target (S103). The CPU 10 acquires, from the third area data, the average value of the luminance values indicated by the entire third area data. The CPU 10 stores the average value of the acquired luminance values in the RAM 12 in association with the fact that the third area has been determined as the luminance change display target.

  In the present embodiment, there are two columns included in the optional entry column of the form, a first optional entry column 150 and a second optional entry column 160 having different outline colors in the report. There are two types of setting pixel values and setting thresholds to be handled. The CPU 10 determines whether there is another set pixel value for which the area determination processing (S93) has not been performed yet (S104). The CPU 10 refers to the column corresponding to the arbitrary entry column of the setting table stored in the HDD 33, and if there is a column set in a column lower than the column corresponding to the third pixel value and the third threshold, It is determined that there is another set pixel value for which the area determination processing has not been performed yet. In the example of the present embodiment, since the second optional area column is set below the first optional area column in the medical insurance setting table 70, if there is another set pixel value for which the area determination processing has not been performed yet. Assume that it is determined.

  When it is determined that there is another set pixel value for which the area determination process has not been performed yet (S104: YES), the CPU 10 acquires another set pixel value and another set threshold from the setting table (S105). In the example of the present embodiment, a fourth pixel value and a fourth threshold are acquired as the set pixel value and the set threshold from the second arbitrary area column of the medical insurance setting table 70. Thereafter, the CPU 10 executes the processing from S93 to S104 based on the fourth pixel value and the fourth threshold value. In the example of the present embodiment, both the second optional entry field 160 of the unfilled form 100 shown in FIG. 2 and the second optional entry field 160 of the entry form 101 shown in FIG. As a result, it is assumed that the fourth area corresponding to the fourth pixel value is determined as the luminance change display target.

  Thereafter, when it is determined that there is another set pixel value for which the area determination processing has not been performed yet (S104: NO), the CPU 10 returns the processing to the information identification processing (see FIG. 6).

  Returning to the description of FIG. The CPU 10 determines whether or not a required entry column of the entry form 101 is not entered (S19). In the present embodiment, when an instruction to output the error display 83 (see FIG. 16) in the required entry field is not stored in the RAM 12 by the process of S83 (see FIG. 10), the date entry field 120 is not entered. Is determined. If the required entry field is not blank (S19: YES), the CPU 10 is set as a character recognition processing execution target in each of S62 (see FIG. 9), S82 (see FIG. 10), and S102 (see FIG. 11). Character recognition processing is executed for each of the first area data, the second area data, and the third area data (S21). In the present embodiment, the character recognition processing is the above-described OCR processing. The CPU 10 converts the first character string data, the second character string data, and the third character, which are the execution results of the character recognition processing, from the first area data, the second area data, and the third area data for which the character recognition processing is performed. Column data is acquired (S22). These character string data are acquired for registration in the registration form DB in the processing of S26 described later. For this reason, these character string data are also referred to as registered character string data. Since the processing of S22 is performed according to the fact that the required entry field is not blank, the registered character string data includes at least the second character string data. Each of the first character string data, the second character string data, and the third character string data is a character string indicating a character string included in each of the pre-entry column 140, the date entry column 120, and the optional entry column of the entry form 101. Equivalent to data. CPU 10 stores the acquired registered character string data in RAM 12.

  The CPU 10 generates read result data indicating a read result display, which indicates a result of reading the entry form 101 by the reading unit 26 of the scanner 2 (S23). The reading result display is an image displayed on the display unit 16 to allow the operator to confirm whether the entry form 101 has been correctly read by the reading unit 26 of the scanner 2. The read result data is generated based on the read data acquired in S12.

  The first area corresponding to the pre-entry field 140 and the third area and the fourth area corresponding to the optional entry field in the read data are subjected to the brightness change display target by the processing of S63 (see FIG. 9) and S103 (see FIG. 11). May have been determined. The CPU 10 refers to information stored in the RAM 12 when generating read result data. If information indicating that any area is determined to be the luminance change display target is stored in the RAM 12, the CPU 10 determines that the area determined to be the luminance change display target is determined to be the luminance change display target. The read data is processed so as to be displayed at a luminance value lower than the luminance value associated with the information indicating the fact. As a result, for example, a gray-out display of a region determined to be a luminance change target is displayed in gray in the read result display. In the example of the present embodiment, it is assumed that the fourth area is determined as a luminance change target. The first area, the third area, and the fourth area are determined as the brightness change targets because the first area, the third area, and the fourth area correspond to the first area, the third area, and the fourth area. This is the case where no characters or the like have been entered. In such a case, by making it difficult for the operator to visually recognize the area determined as the luminance change target by gray-out display, it is indicated to the worker that it is not necessary to pay attention to the gray-out display area. . In addition, the CPU 10 generates read result data with a display 202 (see FIG. 15) for urging confirmation of the read result display.

  The CPU 10 transmits an instruction to output a reading result display based on the reading result data generated in the process of S23 to the display unit 16 via the input / output I / F 14 (S24). FIG. 15 shows a read result display 200 according to the example of the present embodiment. The reading result display 200 includes a result display 201 in which an image based on the read data is displayed, and the above-described display 202. In the result display 201, the operator can visually recognize the read result in the pre-entry column 140, the date entry column 120, and the first optional entry column 150 corresponding to the first, second, and third regions of the read data. It is displayed in a manner. In the result display 201, the second arbitrary entry field 160 corresponding to the fourth area of the read data is determined to be a luminance change target, so that the luminance is reduced and grayed out.

  The operator who has confirmed the reading result display on the display unit 16 can input an instruction to the CPU 10 via the operation unit 17. The CPU 10 determines whether an instruction to register each of the first character string data, the second character string data, and the third character string data acquired in the process of S22 in the registration form DB has been input through the operation unit 17. (S25).

  When a predetermined instruction to register in the registration form DB is input (S25: YES), the CPU 10 determines the registration character string data acquired in the processing of S22 in the processing of S13 in the registration form DB. A registration is made in the registration form DB corresponding to the form type in association with the user ID determined in the processing of S14 (S26). In the example of the present embodiment, the first character string data is registered in each item of the personal information column of the medical insurance registration form DB 70. The second character string data is registered as an application date item in the form management information column of the medical insurance registration form DB 70. The third character string data is registered in each item of spouse information in the medical insurance registration form DB 70. At this time, if the first character string data includes character string data corresponding to a character string indicating a post-change address or the like added by handwritten characters, the information registered in the personal information column is added. The character string data corresponding to the character string may be updated and registered. The CPU 10 shifts the processing to the determination of S29.

  On the other hand, when the required entry column is not entered (S19: NO), the CPU 10 generates read result data (S27). The read result data generated in this process is generated based on the read data and as a display 202 as in the case of the read result data generated in the process of S23. If there is an area determined to be a luminance change display target, the CPU 10 determines that the area determined to be a luminance change display target is a luminance value associated with information indicating that the area is determined to be a luminance change display target. The read data is processed so as to be displayed with a lower luminance value. Further, the CPU 10 further refers to the information stored in the RAM 12 when generating the reading result data. If the RAM 12 stores an instruction to output the required entry field blank entry error display 83 (see FIG. 16), the read result data is displayed so that the required entry field blank entry error display 83 is attached. Generate.

  The CPU 10 transmits an instruction to output a reading result display based on the reading result data generated in the process of S27 to the display unit 16 via the input / output I / F 14 (S28). FIG. 16 shows a read result display 300 to which an error display 83 for an incomplete entry column not yet entered is added. The reading result display 300 includes a result display 301 in which an image based on the read data is displayed, and the above-described display 202. In the present embodiment, such a read result display 300 is displayed on the display unit 16 when the date entry field 120 of the entry form 101 shown in FIG. In the present embodiment, a required message is displayed in a figure frame having a balloon drawn from the date entry field 120, and a predetermined message is written in the required entry field unfilled error display 83. It is provided as a display. As a result, the required entry column non-entry error display 83 can easily indicate to the operator that the necessary entry has not been made in the date entry column 120.

  In this case, since the necessary items are not entered in the date entry field 120, the character recognition processing as in S21 is not performed, and the registration processing of the character string data in the registration voting DB as in S26 is not performed. The CPU 10 shifts the processing to the determination of S29.

  The CPU 10 determines whether to end the information identification processing (S29). For example, when an instruction to end the information identification processing is input via the operation unit 17, the CPU 10 determines that the information identification processing is to be ended (S29: YES), and ends the information identification processing. For example, when an instruction to execute the information identification process for the next form is input via the operation unit 17 via the operation unit 17, the CPU 10 does not end the information identification process (S29: NO). The process returns to S11.

As described above, the CPU 10 determines the form type of the entry form based on the read data obtained by reading the image of the entry form 101 in the processing of S11 (S13). The CPU 10 acquires the registered form image data corresponding to the user ID from the registered form DB corresponding to the form type determined by the processing of S13 (S115). In the area determination processing (S73) executed in the essential entry area determination processing (S16), the CPU 10 determines the shape of the approximate straight line based on the coordinate position of the pixel having the pixel value corresponding to the second pixel value in the read data. The area enclosed by is specified as the second area corresponding to the date entry field 120 (S118). The CPU 10 acquires the second area data indicating the image of the second area from the read data (S75). The second area data corresponds to the image of the date entry field 120 in the entry form 101. The CPU 10 determines the position and size of the area enclosed by the first rectangle 121 in the registered form image data based on the second pixel value corresponding to the color of the first rectangle 121 indicating the outline of the date entry field 120. It is specified (S76). The CPU 10 acquires the registered second area data indicating the image of the specified area from the registered form image data (S78). The registered first area data corresponds to the image of the date entry field 120 in the blank form 100. The CPU 10 compares the second area data with the registered second area data (S79), and if there is a difference between the second area data and the registered second area data (S81: YES), character recognition for the second area data is performed. The registered character string data including the second character string data as the execution result of the processing is acquired (S22). On the other hand, if there is no difference between the second area data and the registered second area data (S81: NO), the CPU generates the read result data without performing the character recognition process (S27), and based on the generated read result data. An instruction to output a reading result display is transmitted to the display unit 16 (S28). That is, in the entry form 101, when the date entry field 120, which is a required entry field, is entered with handwritten characters or the like, at least the second character string data corresponding to the character string entered in the date entry field 120 is included. The registered character string data is obtained. On the other hand, if there is no entry in the date entry field 120, the registered character string data is not obtained. For example, a configuration is conceivable in which the position of the date entry field 120 is stored in advance in association with the registered form image data, so that the registered character string data is acquired without specifying the first rectangle 121 based on the color. In this case, for example, in order to specify the position of the date entry field 120 from the read data, it is necessary to specify a reference position such as an edge or a corner of the document. However, for example, when the background color of the document is similar to the color of the background member provided in the reading unit 26, the detection accuracy of the edge or corner of the document may be reduced. In the present embodiment, by specifying the first rectangle 121 based on the color, the registered character string data can be acquired with high accuracy without being affected by the background color of the document or the color of the background member. As described above, the CPU 10 can identify the types of the plurality of entry columns provided in the form, and execute a process according to the type of the entry columns.

  When the registered character string data including the second character string data is obtained in the processing of S22, the CPU 10 generates read result data (S23). The CPU 10 transmits an instruction to output a reading result display based on the generated reading result data to the display unit 16 (S24). Therefore, the operator can confirm whether the entry form 101 has been correctly read by the reading unit 26 of the scanner 2 by displaying the reading result. If the instruction to register in the registration form DB is input via the operation unit 17 in response to the reading result display being displayed on the display unit 16 (S25: YES), the CPU 10 acquires the instruction in the processing of S22. The registered character string data is registered in the registration form DB corresponding to the form type determined in the process of S13 in the registration form DB (S26). Thereby, management of the registered character string data is appropriately performed in the registered form DB.

  If there is no difference between the second area data and the registered second area data (S81: NO), the CPU 10 stores an instruction to output the error display 83 for the required entry field blank entry in the RAM 12 (S83). In response to the storage of this instruction, the CPU 10 generates read result data indicating a read result display with an error display 83 indicating that the required entry field has not been entered (S27). The CPU 10 transmits to the display unit 16 an instruction to output a reading result display with the required entry field unfilled error display 83 (S28). Accordingly, by displaying the reading result display with the error display 83 indicating that the required entry field has not been entered on the display unit 16, it is evident to the operator that handwritten characters are not entered in the mandatory entry field of the entry form 101. Is done.

  In the area determination processing (S93) executed in the optional entry area determination processing (S18), the CPU 10 surrounds the read data with a shape formed by an approximate straight line based on the coordinate position of the pixel having the pixel value corresponding to the third pixel value. The specified area is specified as a third area corresponding to the optional entry column (S118). The CPU 10 acquires third area data indicating an image of the third area from the read data (S95). The third area data corresponds to the image of the first optional entry column 150 in the entry form 101. The CPU 10 determines the position and size of the area enclosed by the third rectangle 151 in the registered form image data based on the third pixel value corresponding to the color of the third rectangle 151 indicating the outline of the first arbitrary entry field 150. Is determined (S96). The CPU 10 acquires the registered third area data indicating the image of the specified area from the registered form image data (S98). The registered third area data corresponds to the image of the first optional entry column 150 in the blank form 100. The CPU 10 compares the third area data with the registered third area data (S99). If there is a difference between the third area data and the registered third area data (S101: YES), character recognition for the third area data is performed. The registered character string data including the third character string data, which is the execution result of the process, is acquired (S22). On the other hand, when there is no difference between the third area data and the registered third area data (S101: NO), the CPU 10 determines the third area as a luminance change display target (S103). That is, when handwritten characters or the like are entered in the optional entry column in the entry form 101, registered character string data including character string data corresponding to the character string entered in the optional entry column is obtained. On the other hand, when there is no entry in the optional entry column, an instruction to output a read result display based on the read result data generated so that the area corresponding to the optional entry column is grayed out is transmitted to the display unit 16. . In this case, if the area corresponding to the optional entry field is grayed out, the operator is informed that no handwritten characters or the like are entered in the optional entry field, and that detailed confirmation in the reading result display is unnecessary. Is shown. As described above, the CPU 10 can identify the types of the plurality of entry columns provided in the form, and execute a process according to the type of the entry columns.

  The CPU 10 extracts the user ID area data corresponding to the user ID column 130 of the entry form 101 from the read data (S41). The CPU 10 generates ID character string data from the user ID area data, and compares the ID character string data with a registered user ID registered in the registration form DB (S45). The CPU 10 acquires a registered user ID that matches the character string indicated by the ID character string data as a user ID corresponding to the read data (S50). The CPU 10 registers the registered character string data in the registration form DB corresponding to the form type in association with the user ID thus obtained (S26). Therefore, the registered character string data is appropriately managed in association with the form type and the user ID.

  When the area corresponding to the second pixel value has not been specified in the area determination processing (S74: NO), the CPU 10 transmits an instruction to output the entry form reading error display 82 to the display unit 16 (S84). In this case, the entry form reading error display 82 is displayed on the display unit 16, and the operator is notified that the second area corresponding to the date entry field 120 has not been specified in the area determination processing.

  In the above embodiment, the process of S12 corresponds to the “first acquisition step” of the present invention. The process of S115 corresponds to a “second acquisition step” of the present invention. The processing of S118 in the area determination processing executed in the essential entry area determination processing corresponds to the “first area specifying step” of the present invention. The process of S75 corresponds to a “third acquisition step” of the present invention. The process of S76 corresponds to the “form first area specifying step” of the present invention. The process of S78 corresponds to a “fourth acquisition step” of the present invention. The process of S81 corresponds to a “first determination step” of the present invention. The processing of S22 and S28 corresponds to the “first execution step” of the present invention.

  The processing of S23 and S27 corresponds to the “generation step” of the present invention. The process of S24 corresponds to a “first output step” of the present invention. The process of S26 corresponds to a “storage step” of the present invention. The HDD 33 corresponds to a “storage unit” of the present invention. The processing of S83 and S28 corresponds to the “second output step” of the present invention. The processing of S118 in the area determination processing executed in the arbitrary entry area determination processing corresponds to a “second area specifying step” of the present invention. The process of S95 corresponds to a “fifth acquisition step” of the present invention. The process of S96 corresponds to the “form second area specifying step” of the present invention. The process of S98 corresponds to a “sixth acquisition step” of the present invention. The process of S101 corresponds to a “second determination acquisition step” of the present invention. The processing of S11, S24, S28 and S103 corresponds to the "second execution step" of the present invention. The process of S46 corresponds to a “determination step” of the present invention. The process of S50 corresponds to a “seventh acquisition step” of the present invention. The process of S84 corresponds to the “third output step” of the present invention.

  The reading unit 26 corresponds to the “reading unit” of the present invention. The CPU 10 executing the processing in S12 functions as the “first acquisition unit” of the present invention. The CPU 10 executing the process in S35 functions as the “first determination unit” of the present invention. The CPU 10 that executes the process of S115 functions as a “second acquisition unit” of the present invention. The CPU 10 executing the processing of S118 in the area determination processing executed in the essential entry area determination processing functions as “first area specifying means” of the present invention. The CPU 10 executing the processing in S75 functions as the “third acquisition unit” of the present invention. The CPU 10 executing the processing in S76 functions as the “form first area specifying unit” of the present invention. The CPU 10 executing the process of S78 functions as the “fourth obtaining unit” of the present invention. The CPU 10 executing the process of S81 functions as the “first determining unit” of the present invention. The CPU 10 executing the processes of S22 and S28 functions as the “first execution unit” of the present invention.

  Note that the present invention is not limited to the above embodiment, and various modifications are possible. In the above embodiment, in each process of S24, S28, S36, S47, S48, S83, and S84, the CPU 10 transmits to the display unit 16 an instruction to output an image such as a display based on data according to each process. I have. The CPU 10 may transmit some or all of these output instructions to the external display unit 19. Further, some or all of these output instructions transmitted by the CPU 10 may be transmitted to the scanner 2. In this case, the CPU 20 of the scanner 2 that has received the output instruction transmits an instruction to output an image such as a display based on data corresponding to each process to the display unit 27 or the external display unit 29 via the input / output I / F 24. May be.

  Further, the scanner 2 may function as the information identification device 1 and the CPU 20 of the scanner 2 may execute the information identification process. In this case, the output instruction in each processing of S24, S28, S36, S47, S48, S83, and S84 may be transmitted by the CPU 20 to the display unit 27 or the external display unit 29 via the external communication I / F 25. In this case, the scanner 2 corresponds to the “image reading device” of the present invention. The CPU 10 that executes the processes of S23 and S27 functions as the “generation unit” of the present invention. The external communication I / F 25 corresponds to a “communication unit” of the present invention. In addition, the management server 3 may function as the information identification device 1.

  For each of the regions determined to be the luminance change target in the processes of S63 and S103, the read result data is generated in the processes of S23 and S27 so as to be displayed at a luminance lower than the luminance at the time of acquisition of each region data. However, it is not limited to this. For example, the read result data may be generated such that each area determined to be a brightness change target is displayed with a higher brightness than the brightness at the time of obtaining each area data. Even in this case, it becomes difficult for the operator to visually recognize the area determined as the luminance change target, and the operator is informed that it is not necessary to watch the corresponding area.

  When the process of S84 is performed, there are various reasons why the read data has not been properly acquired. The entry form reading error display 82 may have a display content such as “The date entry column cannot be recognized” that simply indicates that the area corresponding to the date entry column 120 has not been specified. In addition, the form reading error display 82 is used to specifically notify the operator of the reason why the read data has not been properly acquired. "Form scanning error", "Check the connection status between the scanner and the PC" , Etc. may be displayed. As described above, the entry form reading error display 82 may include various message displays notifying that the area corresponding to the date entry column 120 has not been specified.

  In the above-described embodiment, the error display 83 without the required entry field is configured by a predetermined pop-up display, but is not limited thereto. The required entry blank error display 83 is displayed in the reading result display 300 in association with the second area corresponding to the mandatory entry, and informs the operator that the necessary entry is not entered. May be displayed.

  In the above embodiment, the character recognition processing is executed in the processing of S21 and S42, but the character recognition processing does not necessarily have to be performed in the information identification device 1. For example, in the management server 3 and other external devices connected to the information identification device 1 via a network, a character recognition process is executed for a character recognition target, and the information identification device 1 receives a character recognition result, A configuration for performing an identification process may be used.

  The CPU 10 functions as a processor that executes information identification processing by expanding the program stored in the HDD 13 on the RAM 12. A general-purpose processor may be used as the CPU 10. A microcomputer, ASIC, FPGA, or the like may be used as the processor instead of the CPU 10. When the scanner 2 functions as the information identification device 1, the CPU 20 functions as a processor that executes information identification processing by expanding a program stored in the ROM 21 on the RAM 22. When the management server 3 functions as the information identification device 1, the CPU 30 functions as a processor that executes information identification processing by expanding a program stored in the HDD 33 on the RAM 32. As described above, a microcomputer, an ASIC, an FPGA, or the like may be used as a processor instead of the CPU 30.

  The information specifying process may be distributed by a plurality of electronic devices (that is, a plurality of CPUs). For example, a part of the information specifying process may be executed by another server such as the management server 3 connected to the network 9. The program may be downloaded from another server such as the management server 3 connected to the network 9 and stored in the HDD 13 of the information identification device 1.

DESCRIPTION OF SYMBOLS 1 Information identification device 2 Scanner 3 Management server 9 Network 10, 20, 30 CPU
13,33 HDD
16, 27 display unit 19, 29 external display unit 21 ROM
26 Reading unit 82 Filled form read error display 83 Required form blank error display 101 Filled forms 200, 300 Read result display

Claims (11)

An information identification program executed by a computer constituting the information identification device,
On the computer,
A first acquisition step of acquiring read data indicating an image obtained by reading an entry form, which is a form filled with characters including handwritten characters,
A second acquisition step of acquiring a form image data indicating an image of a form in which the form based on the read data is not filled with handwritten characters based on the read form,
A first area specifying step of specifying a first area surrounded by a contour corresponding to a first pixel value in the read data;
A third acquisition step of acquiring first area data indicating an image of the first area from the read data,
A form first area specifying step of specifying a form first area corresponding to the first area in the form image data,
A fourth acquisition step of acquiring form first data indicating an image of the form first region from the form image data,
The first area data, a first determination step of determining whether the form first data is different,
When it is determined that the first area data and the form first data are different, the character string data indicating a character string including at least the first character string included in the first area is obtained based on a character recognition process. If it is determined that the first area data and the form first data are not different, a first execution step of not acquiring the character string data ,
A second area specifying step of specifying a second area surrounded by a contour corresponding to a second pixel value different from the first pixel value in the read data,
A fifth acquisition step of acquiring second area data indicating an image of the second area from the read data,
A form second area specifying step of specifying a form second area corresponding to the second area in the form image data,
A sixth acquisition step of acquiring form second data indicating an image of the form second area from the form image data,
The second area data, a second determination step of determining whether the form second data is different,
When it is determined that the second area data is different from the form second data, the character string data indicating a character string including at least a second character string included in the second area is obtained based on a character recognition process. On the other hand, if it is determined that the second area data and the form second data are not different, the second area data with a brightness different from the brightness indicated by the second area data obtained in the fifth obtaining step And a second execution step of outputting an instruction to display the information. On the computer,
A generation step of generating read result data that is data indicating a read result of the entry form and includes at least the first area data;
When the character string data is obtained in the first execution step, a first output step of outputting an instruction to display the read result data,
And a storage step of storing the character string data in a storage unit when a predetermined instruction is received in response to an instruction to display the read result data being output. Information identification program. The generating step includes:
When it is determined that the first area data is not different from the form first data, generating the read result data in which information for performing a predetermined notification regarding the first area is associated with the first area data. The information identification program according to claim 2 , wherein: On the computer,
A determination step of determining a user of the entry form based on the read data;
A seventh acquisition step of acquiring user identification information for identifying a user according to the determination result in the determination step is executed,
The storing step includes:
The information identification program according to claim 2 , wherein the character string data is stored in the storage unit in association with the user identification information. On the computer,
If the first area is not specified in the first area specifying step, a third output step of outputting an instruction to execute notification based on the fact that the first area is not specified is executed. The information identification program according to any one of 1 to 4 . An information identification program executed by a computer constituting the information identification device,
On the computer,
A read data obtaining step of obtaining read data indicating an image obtained by reading an entry form, which is a form filled with characters including handwritten characters,
A form image data acquisition step of acquiring form image data indicating an image of a form in which the form is not filled in with handwritten characters, based on the read data,
A specific area specifying step of specifying a specific area surrounded by an outline corresponding to a specific pixel value that is a specific pixel value in the read data;
A specific area data obtaining step of obtaining specific area data indicating an image of the specific area from the read data,
A form specific area specifying step of specifying a form specific area corresponding to the specific area in the form image data;
A form identification data acquisition step of acquiring form identification data indicating an image of the form identification area from the form image data;
A determination step of determining whether the specific area data is different from the form specification data;
When it is determined that the specific area data and the form specific data are different, while obtaining character string data indicating a character string including at least a specific character string included in the specific area based on a character recognition process, When it is determined that the area data and the form identification data are not different, execution of outputting an instruction to display the specific area data in a mode different from the mode indicated by the specific area data obtained in the specific area data obtaining step And an information identifying program for executing the steps .   The execution step outputs an instruction to display the specific area data in a mode different from the mode indicated by the specific area data by using information obtained by processing color space definition information defining a color space indicated by the specific area data. The information identification program according to claim 6, wherein: A computer-executable method for configuring an information identification device,
A first acquisition step of acquiring read data indicating an image obtained by reading an entry form, which is a form filled with characters including handwritten characters,
A second acquisition step of acquiring a form image data indicating an image of a form in which the form based on the read data is not filled with handwritten characters based on the read form,
A first area specifying step of specifying a first area surrounded by a contour corresponding to a first pixel value in the read data;
A third acquisition step of acquiring first area data indicating an image of the first area from the read data,
A form first area specifying step of specifying a form first area corresponding to the first area in the form image data,
A fourth acquisition step of acquiring form first data indicating an image of the form first region from the form image data,
The first area data, a first determination step of determining whether the form first data is different,
When it is determined that the first area data and the form first data are different, the character string data indicating a character string including at least the first character string included in the first area is obtained based on a character recognition process. If it is determined that the first area data and the form first data are not different, a first execution step of not acquiring the character string data ,
A second area specifying step of specifying a second area surrounded by a contour corresponding to a second pixel value different from the first pixel value in the read data,
A fifth acquisition step of acquiring second area data indicating an image of the second area from the read data,
A form second area specifying step of specifying a form second area corresponding to the second area in the form image data,
A sixth acquisition step of acquiring form second data indicating an image of the form second area from the form image data,
The second area data, a second determination step of determining whether the form second data is different,
When it is determined that the second area data is different from the form second data, the character string data indicating a character string including at least a second character string included in the second area is obtained based on a character recognition process. On the other hand, if it is determined that the second area data and the form second data are not different, the second area data with a brightness different from the brightness indicated by the second area data obtained in the fifth obtaining step And a second execution step of outputting an instruction to display the information.   A computer-executable method for configuring an information identification device,
  A read data acquisition step of acquiring read data indicating an image obtained by reading an entry form, which is a form in which characters including handwritten characters have been entered,
  A form image data acquisition step of acquiring form image data indicating an image of a form in which handwritten characters are not entered, which is a form corresponding to the filled-in form based on the read data,
  A specific area specifying step of specifying a specific area surrounded by an outline corresponding to a specific pixel value that is a specific pixel value in the read data;
  A specific area data obtaining step of obtaining specific area data indicating an image of the specific area from the read data,
  A form specific area specifying step of specifying a form specific area corresponding to the specific area in the form image data;
  A form identification data acquisition step of acquiring form identification data indicating an image of the form identification area from the form image data;
  A determination step of determining whether the specific area data is different from the form specification data;
  When it is determined that the specific area data is different from the form specific data, the character string data indicating a character string including at least the specific character string included in the specific area is obtained based on a character recognition process, When it is determined that the area data and the form identification data are not different, execution of outputting an instruction to display the specific area data in a mode different from the mode indicated by the specific area data acquired in the specific area data obtaining step Steps and
  An information identification method, comprising: A reading unit that reads an image of a form,
First acquisition means for acquiring read data indicating an image obtained by reading an entry form, which is a form filled with characters including handwritten characters, read by the reading unit,
A second acquisition unit that acquires form image data indicating an image of a form in which a form corresponding to the entry form based on the read data and in which handwritten characters have not been entered,
First area specifying means for specifying a first area surrounded by a contour corresponding to a first pixel value in the read data,
Third acquisition means for acquiring first area data indicating the image of the first area from the read data,
A form first area specifying means for specifying a form first area corresponding to the first area in the form image data,
Fourth acquisition means for acquiring form first data indicating an image of the form first region from the form image data,
The first area data, the first determination means to determine whether the form first data is different,
When it is determined that the first area data and the form first data are different, the character string data indicating a character string including at least the first character string included in the first area is obtained based on a character recognition process. If it is determined that the first area data and the form first data are not different, first execution means that does not acquire the character string data ,
A second area specifying means for specifying a second area surrounded by a contour corresponding to a second pixel value different from the first pixel value in the read data,
Fifth acquisition means for acquiring second area data indicating the image of the second area from the read data,
A form second area specifying means for specifying a form second area corresponding to the second area in the form image data,
Sixth acquisition means for acquiring form second data indicating an image of the form second area from the form image data,
The second area data, a second determination means for determining whether the form second data is different,
When it is determined that the second area data is different from the form second data, the character string data indicating a character string including at least a second character string included in the second area is obtained based on a character recognition process. On the other hand, when it is determined that the second area data is not different from the form second data, the second area data is displayed at a brightness different from the brightness indicated by the second area data acquired by the fifth acquisition unit. An image reading apparatus comprising: a second execution unit that outputs an instruction to display a message . A reading unit that reads an image of a form,
Read data acquisition means for acquiring read data indicating an image obtained by reading an entry form, which is a form filled with characters including handwritten characters, read by the reading unit,
A form corresponding to the form based on the read data, a form image data acquisition means for acquiring form image data indicating an image of the form in which handwritten characters are not entered,
A specific area specifying unit that specifies a specific area surrounded by an outline corresponding to a specific pixel value that is a specific pixel value in the read data;
A specific area data acquisition unit that acquires specific area data indicating the image of the specific area from the read data;
A form specific area specifying means for specifying a form specific area corresponding to the specific area in the form image data;
Form specification data acquisition means for obtaining form specification data indicating an image of the form specification area from the form image data,
Determining means for determining whether the specific area data is different from the form specific data,
When it is determined that the specific area data and the form specific data are different, while obtaining character string data indicating a character string including at least a specific character string included in the specific area based on a character recognition process, When it is determined that the area data and the form identification data are not different, execution of outputting an instruction to display the specific area data in a mode different from the mode indicated by the specific area data obtained by the specific area data obtaining means image reading apparatus characterized by comprising a means.