JP2020021469A - Information processing apparatus, information processing method, and information processing program - Google Patents

Abstract

To make available text data with higher accuracy.SOLUTION: An information processing apparatus comprises: an acquisition unit that acquires a file including first text data; and a processing unit that determines, on the basis of the file acquired by the acquisition unit, whether to perform predetermined processing by using second text data generated by performing character recognition on an image included in the file acquired by the acquisition unit, or perform the predetermined processing by using the first text data.SELECTED DRAWING: Figure 12

Description

  The present invention relates to an information processing device, an information processing method, and an information processing program.

  2. Description of the Related Art Conventionally, there is known a technology for optically reading various documents printed on paper or the like with a scanner to generate a file such as a Portable Document Format (PDF) and recognizing characters from an image included in the generated file such as a PDF. Have been.

  Conventionally, a technique of recognizing characters from an image of a document such as a form and extracting a character string of each item is known (for example, see Patent Document 1).

  Conventionally, for example, when characters in an image included in a file such as PDF are erroneously recognized, correct text data may not be used in some cases.

  Therefore, an object of the present invention is to make text data with higher accuracy available.

  The information processing device performs a predetermined process using an acquisition unit that acquires a file including first text data, and second text data that is generated by character recognition of an image included in the file acquired by the acquisition unit. A processing unit that determines whether to perform the predetermined process using the first text data based on a file acquired by the acquisition unit.

  Text data with higher accuracy can be used.

FIG. 1 is a diagram illustrating an example of a system configuration of an information processing system according to an embodiment. FIG. 3 is a diagram illustrating an example of a hardware configuration of a server device according to the embodiment. FIG. 3 is a diagram illustrating an example of a type determination database according to the first embodiment. FIG. 6 is a diagram illustrating types of form definition information stored in a form definition database according to the first embodiment. FIG. 4 is a diagram illustrating an example of general definition information according to the first embodiment. It is a figure showing an example of individual company definition information concerning a 1st embodiment. FIG. 4 is a diagram illustrating an example of specific definition information according to the first embodiment. FIG. 3 is a diagram illustrating functions of the server device according to the first embodiment. FIG. 4 is a sequence diagram illustrating an example (one) of a process of the information processing system according to the first embodiment. FIG. 9 is a sequence diagram illustrating an example (part 2) of the process of the information processing system according to the first embodiment. FIG. 6 is a diagram illustrating an example of a job list according to the first embodiment. 5 is a flowchart illustrating processing of a processing unit according to the first embodiment. 5 is a flowchart illustrating processing of a processing unit according to the first embodiment. 9 is a flowchart illustrating an example of text data use determination processing according to the embodiment. 5 is a flowchart illustrating a process of an item extracting unit according to the first embodiment. FIG. 4 is a diagram illustrating an example of text data to be processed according to the embodiment. FIG. 4 is a diagram illustrating an example of read result information according to the first embodiment. It is a figure showing an example of a recognition result confirmation screen concerning a 1st embodiment. FIG. 4 is a diagram illustrating an example of recognition result data according to the first embodiment. 9 is a flowchart illustrating processing of a processing unit according to the second embodiment. 9 is a flowchart illustrating an example of text data use determination processing according to the embodiment. FIG. 5 is a diagram illustrating an example of a setting screen of the terminal device according to the embodiment.

[First Embodiment]
In the first embodiment, an example will be described in which the server apparatus 200 extracts data of each item from a form file received from the image forming apparatus 300 and the terminal apparatus 400. In the first embodiment, for example, when the received file is not a file including text data whose file format has been converted, the server device 200 uses text data generated by character recognition of the received file. . In addition, for example, when the received file is a file including text data whose file format has been converted, the server device 200 uses the text data. The file including the text data whose file format has been converted is, for example, a file having a predetermined file format such as a document, a table, or a slide, which has been converted to a file format such as PDF (Portable Document Format). A PDF file or the like. This makes it possible to use more accurate text data. Hereinafter, an example will be described in which a PDF file is to be processed. However, the disclosed technology can also be applied to a system in which a file having a file format other than PDF is to be processed.

  Hereinafter, embodiments will be described with reference to the drawings. FIG. 1 is a diagram illustrating an example of a system configuration of an information processing system according to an embodiment.

  The information processing system 100 according to the embodiment includes a server device 200, an image forming device 300, and a terminal device 400. In the information processing system 100 according to the embodiment, the server device 200, the image forming device 300, and the terminal device 400 are connected via a network.

  Further, the terminal device 400 according to the embodiment is connected to the core system 500 via a network, for example. The core system 500 is, for example, a system that performs a specific process using a result of recognizing a form in the information processing system 100 according to the embodiment. Specifically, for example, the core system 500 may be an accounting system, an estimate creation system, or the like.

  In the information processing system 100 according to the embodiment, the server device 200 receives from the image forming apparatus 300 a PDF file including an image of a form read by the scanner function of the image forming apparatus 300. In addition, the server device 200 receives, from the terminal device 400, a PDF file containing text data in which the file format has been converted. Then, the server device 200 extracts the items included in the form and the values of the items from the received PDF file, and converts the extracted items into text data in which the items are associated with the values of the items.

  In the following description, a form image read by the scanner function of the image forming apparatus 300 is referred to as a form image.

  In the following description, extracting an item included in a form and a value of the item, converting the item and the value of the item into text data and associating the data with each other is called form recognition.

  The server device 200 according to the embodiment includes a storage unit 210 and a control unit 220. The storage unit 210 includes a PDF file database 230, a type determination database 240, a form definition database 250, and a recognition result database 260.

  The PDF file database 230 stores PDF files. The type determination database 240 stores information referred to when determining the type of a form. The form definition database 250 stores form definition information that is referred to when the control unit 220 performs form recognition. The recognition result database 260 stores information indicating the result of form recognition by the control unit 220.

  The control unit 220 according to the embodiment acquires the PDF file stored in the PDF file database 230, determines the type of the form by referring to the type determination database 240, and specifies the form definition information to be referred to. Then, the control unit 220 performs form recognition in the form definition database 250 using the specified form definition information, and stores the result in the recognition result database 260. The form definition information includes information indicating a description position of an item name included in the form, and information indicating a positional relationship between the item name and the value of the item.

  Here, the control unit 220 according to the embodiment refers to the general definition information and the individual company definition information stored in the form definition database 250 when performing the form recognition.

  The general definition information according to the embodiment is form definition information that defines a general form layout, and the individual company definition information is a form that defines a user-specific form layout that uses the information processing system 100. Definition information. Details of the type determination database 240 and the form definition database 250 will be described later.

  In this embodiment, as described above, when two types of form definition information are used at the time of form recognition, a user-specific form can be recognized in addition to a general-purpose form. Accuracy can be improved.

  In the information processing system 100 according to the embodiment, the image forming apparatus 300 is a multifunction peripheral having a scanner function. The image forming apparatus 300 is provided with applications for realizing a copy function, a FAX function, a scanner function, and the like. These functions are realized by selecting an application corresponding to each function.

  The terminal device 400 according to the embodiment is used by a user who uses the information processing system 100. Further, the result of the form recognition by the server device 200 may be displayed on the terminal device 400.

  The user in the present embodiment is, for example, a company or the like. More specifically, for example, the user is a business establishment, a company, an organization, or the like that has concluded a contract for using a service provided by the information processing system 100.

  In the example of FIG. 1, the server device 200 has a configuration in which the storage unit 210 has four databases, but is not limited thereto. Some of the databases may be provided in an external device of the server device 200, or all of the databases may be provided in the external device.

  Further, in the example of FIG. 1, the server device 200 realizes the control unit 220, but is not limited thereto. The control unit 220 may be realized by a plurality of information processing devices.

  Further, in the example of FIG. 1, the information processing system 100 includes one image forming apparatus 300 and one terminal apparatus 400. However, the number of the image forming apparatuses 300 and the terminal apparatus 400 included in the information processing system 100 May be any number.

  Next, a hardware configuration of the server device 200 according to the embodiment will be described with reference to FIG. FIG. 2 is a diagram illustrating an example of a hardware configuration of the server device according to the embodiment.

  The server device 200 according to the embodiment includes an input device 21, an output device 22, a drive device 23, an auxiliary storage device 24, a memory device 25, an arithmetic processing device 26, and an interface device 27, which are mutually connected by a bus B. It is an information processing device.

  The input device 21 is a device for inputting various types of information, and may be, for example, a keyboard, a pointing device, or the like. The output device 22 is for outputting various types of information, and may be, for example, a display. The interface device 27 includes a LAN card and the like, and is used for connecting to a network.

  The information processing program is at least a part of various programs that control the server device 200. The information processing program is provided by, for example, distribution of the storage medium 28 or download from a network. The storage medium 28 on which the information processing program is recorded is a storage medium for recording information optically, electrically or magnetically, such as a CD-ROM, a flexible disk, a magneto-optical disk, or the like, or information, such as a ROM or a flash memory. Various types of storage media can be used, such as a semiconductor memory that electrically records data.

  When the storage medium 28 storing the information processing program is set in the drive device 23, the information processing program is installed from the storage medium 28 to the auxiliary storage device 24 via the drive device 23. The information processing program downloaded from the network is installed in the auxiliary storage device 24 via the interface device 27.

  The auxiliary storage device 24 stores the installed information processing program and also stores necessary files and data. The memory device 25 reads and stores the information processing program from the auxiliary storage device 24 when the server device 200 is started. Then, the arithmetic processing device 26 realizes various processes described below according to the information processing program stored in the memory device 25.

  Since the hardware configuration of the terminal device 400 according to the embodiment is the same as that of the server device 200, the description is omitted. Note that the terminal device 400 may be, for example, a tablet-type terminal device or a smartphone, and has a display operation device realized by a touch panel or the like instead of the input device 21 and the output device 22. Is also good.

  Next, the type determination database 240 and the form definition database 250 of the server device 200 according to the embodiment will be described.

  FIG. 3 is a diagram illustrating an example of the type determination database according to the first embodiment. The type determination database 240 according to the embodiment has a definition ID, a definition type, a document type, and an identification character string as information items. In the type determination database 240, the item “definition ID” is associated with other items, and information including the value of the item “definition ID” and the values of other items is referred to as type determination information.

  The value of the item “definition ID” indicates an identifier for specifying the form definition information.

  The value of the item “definition type” indicates the type of the form definition information. In the present embodiment, the type of the form definition information includes specific definition information in addition to the general definition information and the individual company definition information. The specific definition information is form definition information that defines a specific form issued by a specific business entity or the like. Specifically, the specific form is, for example, a slip of a generally used courier company.

  The value of the item “document type” indicates the type of the form. The form type is, for example, an invoice, a quote, an order form, and the like. The value of the item “identification character string” indicates a character string for specifying the form type. Specifically, for example, in a form including a character string of “invoice” or “billing”, the type of the form indicated by the item “document type” is “invoice”. Also, in the form image including both the character strings “R Company” and “Billing”, the form type indicated by the item “Document Type” is “R Company Bill”.

  In the example of FIG. 3, for example, the type of the form definition information of the definition ID “H01” is general definition information, and the general definition information of the definition ID “H01” is information defining the layout of “invoice”. It is referred to when a character string “billing” or “billing statement” is extracted from the PDF file.

  Next, a form definition database 250 according to the embodiment will be described with reference to FIGS. FIG. 4 is a diagram showing types of form definition information stored in the form definition database according to the first embodiment.

  The form definition database 250 according to the embodiment stores general definition information 251, individual company definition information 252, and specific definition information 253.

  The general definition information 251 according to the embodiment is form definition information of a form having a highly versatile layout used by a plurality of users among forms. The general-purpose definition information 251 is the form definition information having the lowest priority among the three form definition information.

  The individual company definition information 252 according to the embodiment is form definition information of a form of a layout uniquely designed by a user among forms, and is form definition information dedicated to the user. The individual company definition information 252 is the definition to be respected most among the three form definition information, and is the form definition information having the highest priority.

  The specific definition information 253 according to the embodiment is form definition information indicating a layout of a form generally used among forms. The priority of the specific definition information 253 is intermediate between the three form definition information.

  The control unit 220 according to the embodiment recognizes the PDF file with reference to the three form definition information. Therefore, in the present embodiment, for example, even when the PDF file is a form in which the layout is not defined in the individual company definition information 252, if the PDF file is defined in the general definition information 251 or the specific definition information 253, This PDF file can be recognized.

  FIG. 5 is a diagram illustrating an example of the general definition information according to the first embodiment. The general definition information 251 is generated for each definition ID, and includes items of information such as an item ID, an item name, a direction, a distance, and the like. That is, the general definition information 251 according to the embodiment is associated with the item “definition ID” and other items, and includes the value of the item “definition ID” and the values of other items.

  The value of the item “item ID” is an identifier for specifying an item included in the form. The value of the item “item name” indicates the name of the item.

  Items such as “direction” and “distance” indicate a range in which a character string is extracted. For example, when the value of the item “direction” is “RD” and the value of the item “distance” is “20 mm”, the coordinates of the rectangle circumscribing the character string serving as the item name are shifted downward from the lower right coordinate. Indicates that a character string is extracted from a range within 20 mm.

  That is, the items “direction”, “distance”, and the like according to the embodiment are conditions indicating a range in which a character string is extracted, and these conditions are associated with the item names. In the example of FIG. 5, the items “direction” and “distance” are given as the conditions indicating the range in which the character string is extracted. However, the condition may include other items.

  Therefore, for example, a character string extracted from a range within 20 mm downward from the lower right coordinate of the circumscribed rectangle with the character string of the item name “total” of the item ID “2” is referred to as the item name “total”. Recognized as the value of the corresponding item.

  Note that the general definition information 251 includes information on a plurality of items that may be included in the form.

  FIG. 6 is a diagram illustrating an example of the individual company definition information according to the first embodiment. The individual company definition information 252 according to the embodiment is registered for each user, and includes information items such as a user ID, a definition ID, an item name, a direction, and a distance.

  The value of the item “user ID” is an identifier for identifying the user. In this embodiment, the definition ID, the item name, the direction, the distance, and the like are the same as those of the general definition information 251, and thus the description is omitted.

  In the present embodiment, the definition ID of the form definition information whose definition type is the individual company definition information may include the user ID.

  In the individual company definition information 252, information on an item in which a user registers an item name and a condition indicating a range in which the value of the item is described is stored. Therefore, the item ID included in the individual company definition information 252 may be a part of the item ID included in the general definition information 251.

  In the example of FIG. 6, the individual company definition information 252 registered by the user ID “A” is shown. The individual company definition information 252 has the definition ID “A01” and the document type “R company”. Invoice ".

  FIG. 7 is a diagram illustrating an example of the specific definition information according to the first embodiment. The specific definition information 253 according to the embodiment is registered for each specific form, and includes information items such as a definition ID, an item name, a direction, and a distance. In the embodiment of FIG. 7, the definition ID, the item name, the direction, the distance, and the like are the same as those of the general-purpose definition information 251;

  Note that the specific definition information 253 according to the embodiment may be provided for each specific business entity. In this case, the specific definition information 253 may include a company ID as an information item.

  Next, a function of the server device 200 according to the embodiment will be described with reference to FIG. FIG. 8 is a diagram illustrating functions of the server device according to the first embodiment.

  In the server device 200 according to the embodiment, for example, the arithmetic processing device 26 reads and executes an information processing program stored in the memory device 25, the auxiliary storage device 24, or the like, thereby realizing the function of each unit described below.

  The server device 200 according to the embodiment includes a control unit 220. The control unit 220 includes an input receiving unit 221, an authentication processing unit 222, and a processing unit 270.

  The input receiving unit 221 receives various inputs to the server device 200. Specifically, the input receiving unit 221 receives input of authentication information for logging in to the information processing system 100. The authentication information is, for example, a user ID and a password. The input receiving unit 221 receives, for example, an input of a PDF file transmitted from the image forming apparatus 300 and the terminal apparatus 400.

  The authentication processing unit 222 performs authentication based on the authentication information received by the input receiving unit 221. Note that the authentication processing unit 222 may, for example, transmit the input authentication information to an authentication server provided outside the server device 200 and acquire the result of the authentication by the authentication server. When the user is authenticated, the authentication processing unit 222 may pass the PDF file received by the input receiving unit 221 to the processing unit 270.

  For example, when the input receiving unit 221 obtains a PDF file including the first text data, the processing unit 270 performs predetermined processing using the second text data generated by performing character recognition on an image included in the PDF file. Whether to perform the process or to perform the predetermined process using the first text data is determined based on the PDF file.

  The processing unit 270 includes a data storage unit 271, a job list generation unit 272, a preprocessing unit 274, a character recognition unit 275, a definition specification unit 276, an item extraction unit 277, a display screen generation unit 278, and an output unit 279.

  Upon receiving the PDF file from the image forming apparatus 300, the data storage unit 271 stores the PDF file in the PDF file database 230.

  When the input receiving unit 221 receives the input of the image data, the job list generating unit 272 registers the job in the job list and manages the job list. Details of the job list will be described later.

  The preprocessing unit 274 performs preprocessing for performing the form recognition on the PDF file acquired from the PDF file database 230.

  The character recognizing unit 275 extracts a character string and information indicating a position where the character string is arranged from the PDF file, and holds the information as recognition result information. Details of the recognition result information will be described later.

  The definition specifying unit 276 specifies the definition ID corresponding to the character string included in the recognition result information with reference to the type determination database 240. In other words, the definition specifying unit 276 specifies the form definition information to be referred to at the time of form recognition based on the character string extracted from the form image data, and acquires the specified form definition information from the form definition database 250. It is.

  The item extracting unit 277 extracts items included in the form image data and the values of the items based on the form definition information specified by the definition specifying unit 276 and the recognition result information, and associates the extracted items with the items. Recognition result data in which an item ID is associated with an item value is generated. Note that an XML format file (eXtensible Markup Language) may be generated as the recognition result data. Further, the item extracting unit 277 extracts the description position of the item in the form and the positional relationship between the item and the value of the item.

  The display screen generation unit 278 generates a recognition result confirmation screen using the recognition result data stored in the recognition result database 260. The item names displayed on the recognition result confirmation screen are registered in advance in association with the item IDs, and when generating the recognition result confirmation screen, the item names corresponding to the item IDs included in the recognition result data are specified. And display it on the recognition result confirmation screen.

  The output unit 279 outputs the recognition result confirmation screen generated by the display screen generation unit 278. In other words, the output unit 279 displays the recognition result confirmation screen generated by the display screen generation unit 278 on the web browser of the terminal device 400.

  Hereinafter, an example of processing of the information processing system 100 according to the first embodiment will be described with reference to FIG. 9A. FIG. 9A is a sequence diagram illustrating an example (one) of a process of the information processing system according to the first embodiment. Hereinafter, an example in which the server device 200 processes a PDF file received from the image forming device 300 will be described.

  In the information processing system 100, when the image forming apparatus 300 receives an activation request of an application for performing form recognition from a user (step S901), the image forming apparatus 300 activates the application (step S902).

  Subsequently, when receiving the input of the authentication information from the user (step S903), the image forming apparatus 300 transmits the authentication information to the server apparatus 200 and makes an authentication request (step S904).

  Upon receiving the authentication request, the server device 200 performs authentication by the authentication processing unit 222, and notifies the image forming apparatus 300 of the result (step S905). Here, the processing when the user is authenticated is shown.

  Next, the image forming apparatus 300 receives a form scan instruction (step S906), scans the form, and generates a PDF file containing the scanned image (step S907). Subsequently, the image forming apparatus 300 transmits the generated PDF file to the server apparatus 200 (Step S908).

  In the server device 200, when the input receiving unit 221 receives the input of the PDF file, the authentication processing unit 222 passes this PDF file to the processing unit 270 (step S909). The server device 200 may pass the PDF file from the input receiving unit 221 to the processing unit 270 without passing through the authentication processing unit 222.

  When the processing unit 270 of the server device 200 receives the PDF file, the job list generation unit 272 registers the job in the job list (step S910). Subsequently, the processing unit 270 causes the data storage unit 271 to store the PDF file in the PDF file database 230 (Step S911).

  Subsequently, the processing unit 270 acquires a PDF file to be recognized from the PDF file database 230 (step S912), and executes a process of recognizing a form (step S913). Details of the processing in step S912 will be described later.

  Subsequently, the processing unit 270 stores the recognition result data generated by the item extracting unit 277 in the recognition result database 260 (Step S914).

  In the information processing system 100, upon receiving the input of the browser display instruction from the user (step S915), the terminal device 400 requests the server device 200 to display the browser for displaying the recognition result data (step S916). ).

  Further, the terminal device 400 accepts the input of the authentication information from the user (Step S917), and transmits the authentication information to the server device 200 (Step S918).

  The server device 200 authenticates the user by the authentication processing unit 222 (step S919), and notifies the result to the terminal device 400 (step S920). Here, a process when the user is authenticated is shown.

  Subsequently, when receiving an input of a browse instruction of the recognition result of the form image from the user (step S921), the terminal device 400 issues a browse request to the server device 200 (step S922).

  Upon receiving the browsing request, the server device 200 acquires the recognition result data stored in the recognition result database 260 (step S923), displays the data on the browser of the terminal device 400 (step S924), and ends the process.

  Hereinafter, an example of processing of the information processing system 100 according to the first embodiment will be described with reference to FIG. 9B. FIG. 9B is a sequence diagram (part 2) illustrating an example of processing of the information processing system according to the first embodiment. Hereinafter, an example in which the server device 200 processes the PDF file received from the terminal device 400 will be described.

  In the information processing system 100, when the terminal device 400 receives an activation request for an application for performing form recognition from a user (step S951), the terminal device 400 activates the application (step S952).

  Subsequently, when receiving the input of the authentication information from the user (step S953), the terminal device 400 transmits the authentication information to the server device 200 and makes an authentication request (step S954).

  The server device 200 receives the authentication request, performs authentication by the authentication processing unit 222, and notifies the terminal device 400 of the result (step S955). Here, the processing when the user is authenticated is shown.

  Subsequently, the terminal device 400 receives the form upload instruction (step S956), and transmits a PDF file stored in advance to the server device 200 (step S958). The PDF file may be a file in which a file of a predetermined file format such as a document, a table, and a slide is converted (exported) to a file format such as PDF (Portable Document Format) in another terminal device 400. . Note that the following processing from step S959 to step S974 may be the same as the processing from step S919 to step S924 in FIG. 9A described above.

  In the server device 200, when the input receiving unit 221 receives the input of the PDF file, the authentication processing unit 222 passes this PDF file to the processing unit 270 (step S959). The server device 200 may pass the PDF file from the input receiving unit 221 to the processing unit 270 without passing through the authentication processing unit 222.

  When the processing unit 270 of the server device 200 receives the PDF file, the job list generation unit 272 registers the job in the job list (step S960). Subsequently, the processing unit 270 causes the data storage unit 271 to store the PDF file in the PDF file database 230 (Step S961).

  Subsequently, the processing unit 270 acquires a PDF file to be recognized from the PDF file database 230 (step S962), and executes a process of recognizing a form (step S963).

  Subsequently, the processing unit 270 stores the recognition result data generated by the display screen generating unit 278 in the recognition result database 260 (Step S964).

  In the information processing system 100, when receiving the input of the browser display instruction from the user (step S965), the terminal device 400 requests the server device 200 to display the browser for displaying the recognition result data (step S966). ).

  Further, the terminal device 400 receives the input of the authentication information from the user (Step S967), and transmits the authentication information to the server device 200 (Step S968).

  The server device 200 authenticates the user by the authentication processing unit 222 (step S969), and notifies the result to the terminal device 400 (step S970). Here, a process when the user is authenticated is shown.

  Subsequently, upon receiving an input of a browse instruction for a recognition result of the form image from the user (step S971), the terminal device 400 issues a browse request to the server device 200 (step S972).

  Upon receiving the browsing request, the server device 200 acquires the recognition result data stored in the recognition result database 260 (step S923), generates a recognition result confirmation screen, and displays the screen on the browser of the terminal device 400 (step S923). (S924) The user is prompted to confirm the recognition result on the displayed recognition result confirmation screen, and the process ends.

  Here, a job list generated by the job list generation unit 272 according to the first embodiment will be described with reference to FIG. FIG. 10 is a diagram illustrating an example of the job list.

  In the server device 200 according to the embodiment, when a PDF file is input from the image forming apparatus 300, the job list generation unit 272 holds the PDF file and a job ID as a job list in which the PDF file is associated with the job ID.

  The job list 101 according to the embodiment has, as information items, a job ID, a user ID, a form image file path, a recognition result file path, a status, and a definition ID.

  The value of the item “job ID” is an identifier for specifying the job. In other words, the value of the item “job ID” is an identifier for specifying the PDF file received from the image forming apparatus 300.

  The value of the item “user ID” is an identifier for specifying a user who has logged in to the information processing system 100.

  The value of the item “image file path” is information indicating the location where the PDF file is stored. The value of the item “recognition result file path” is information indicating a location where recognition result data of a result of recognizing the form image is stored.

  The value of the item “status” indicates the progress of the recognition of the form image. The value of the item “definition ID” indicates the definition ID of the form definition information referred to when recognizing the PDF file stored in the location indicated by the value of the item “image file path”.

  When the server apparatus 200 according to the embodiment receives the PDF file from the image forming apparatus 300, the job list generation unit 272 assigns a job ID, associates the user ID acquired as the authentication information, and associates the job ID with the job list 101. Add records. Then, when the PDF file is stored in the PDF file database 230, the job list generation unit 272 adds information indicating the storage destination as a value of the item “image file path”.

  Further, when the form definition information to be referred to is identified in the recognition of the form image, the job list generation unit 272 adds the definition ID as a value of the item “definition ID”. When the recognition result data is stored in the recognition result database 260 after the completion of the process, the job list generation unit 272 adds information indicating the storage destination as a value of the item “recognition result file path”, and Complete the value of "Status".

  Next, the processing of the processing unit 270 according to the first embodiment will be described with reference to FIGS. 11A and 11B. FIGS. 11A and 11B are flowcharts illustrating the processing of the processing unit 270 according to the first embodiment. 11A and 11B show details of the processing in step S913 in FIG. 9A and step S963 in FIG. 9B. FIGS. 11A and 11B show processing when a plurality of PDF files are received.

  The processing unit 270 acquires a PDF file from the PDF file database 230 (Step S1101). If the user of the terminal device 400 has set to use the text data included in the PDF file, the processing unit 270 proceeds to the process of step S1102, and the user of the terminal device 400 If it is set not to use the text data included in the file, the process may proceed to step S1105. Subsequently, the processing unit 270 determines whether the acquired PDF file includes text data (step S1102). Here, the PDF file received from the image forming apparatus 300 and the terminal device 400 includes, for example, text data in the following cases (1) and (2).

  (1) In another terminal device 400 or the like, a printed matter of a form is scanned (optically read) and an image of a created PDF file is subjected to character recognition, and text data (“first text”) as a result of character recognition is obtained. Data) is added to the PDF. (2) When a file including text data such as a document, a table, or a slide is converted to a PDF file in another terminal device 400 or the like.

  If text data is not included (NO in step S1102), the process advances to step S1105.

  If text data is included (YES in step S1102), it is determined whether to use the text data (step S1103). Here, in the case where the acquired PDF file is a PDF file that has been converted into a file format or includes text data as in (2) described above, it may be determined that the text data is to be used. . This processing will be described later.

  If the text data is to be used (YES in step S1103), the processing unit 270 holds the text data as text data to be processed (an example of “first text data”) (step S1104), and performs steps to be described later. The process proceeds to S1110. FIG. 14A is a diagram illustrating an example of text data to be processed according to the embodiment. In the example of FIG. 14A, coordinates X, coordinates Y, character width, character height, certainty factor, and characters are stored in association with the ID. The ID is the ID of each character. The coordinates X and the coordinates Y are the coordinates of the horizontal and vertical positions of the character associated with the ID, respectively. The width of the character and the height of the character are the width and the height of the character related to the ID, respectively. The certainty factor is the accuracy of image recognition of the character associated with the ID. Note that the confidence is not essential.

  If the text data is not used (NO in step S1103), the processing unit 270 causes the preprocessing unit 274 to convert the PDF file into an image in a png or jpeg format (step S1105).

  Subsequently, the preprocessing unit 274 selects an image for one page (step S1106) and performs preprocessing (step S1107). The preprocessing is, for example, a correction process for aligning the orientation of an image, for example.

  Subsequently, the processing unit 270 causes the character recognition unit 275 to cut out an area in which characters are formed (hereinafter, a character field) from the form image (step S1108). Subsequently, the processing unit 270 cuts out the characters in the cut-out character field by the character recognition unit 275, performs character recognition, and processes the result of the character recognition as text data to be processed (an example of “second text data”. ) (Step S1109). At this time, the character recognition unit 275 also acquires coordinates indicating the position of the cut-out character.

  Subsequently, the processing unit 270 generates read result information based on the positional relationship of each character included in the text data to be processed (step S1110). Specifically, the processing unit 270 recognizes, as one character string, characters whose distance is within a predetermined threshold based on the recognized coordinates of each character, and forms a character string and a character string. Then, read result information is generated in association with information such as coordinates indicating the position of the selected area. Details of the reading result information will be described later.

  Subsequently, the processing unit 270 extracts items and item values by the item extracting unit 277 using the individual company definition information 252 specified based on the read result information and the type determination database 240 (step S1111).

  Subsequently, the processing unit 270 extracts items and item values using the item definition unit 277 using the specific definition information 253 specified based on the read result information and the type determination database 240 (step S1112).

  Subsequently, the processing unit 270 uses the item extraction unit 277 to extract items and item values using the general-purpose definition information 251 specified based on the read result information and the type determination database 240 (step S1113).

  Subsequently, the processing unit 270 determines whether the extraction of the item and the value of the item is successful (step S1114). Specifically, when the item extracted by the item extracting unit 277 and the value of the item exist between steps S1111 and S1113, the processing unit 270 extracts the item and the value of the item. You may determine that it was successful.

  If the extraction of the item and the value of the item fails in step S1114, the processing unit 270 notifies the terminal device 400 or the image forming apparatus 300 of an error (step S1115), and proceeds to step S1118 described later.

  If the extraction of the item and the value of the item is successful in step S1114, the processing unit 270 generates recognition result data in which the extracted item and the value of the item are merged in association with each other by the item extracting unit 277 (step S1114). S1116). Details of the merging process will be described later.

  Subsequently, the processing unit 270 registers, in the job list 101, the definition ID of the form definition information used for generating the recognition result data and the storage destination of the recognition result data by the job list generation unit 272 (step S1117). ).

  Subsequently, the processing unit 270 determines whether the processing has been performed up to the last page (step S1118). If the processing has not been executed up to the last page in step S1117, the processing unit 270 returns to step S1106.

  If the processing has been executed up to the last page in step S1118, the processing unit 270 causes the display screen generation unit 278 to display the recognition result confirmation screen generated using the recognition result data on the terminal device 400 (step S1119). , And the process ends.

  Note that, in the examples of FIGS. 11A and 11B, the processing up to the display of the recognition result data has been described, but the present invention is not limited to this. The processing unit 270 may display the recognition result data after receiving the browsing request for the recognition result data from the terminal device 400.

利用 Usage judgment processing of text data≫
Next, an example of text data use determination processing in step S1102 of FIG. 11A will be described with reference to FIG. FIG. 12 is a flowchart illustrating an example of text data use determination processing according to the embodiment.

  In step S101, the processing unit 270 determines whether the acquired PDF file satisfies a predetermined condition. Here, for example, when the extended area of the acquired PDF file includes information indicating that the character has been recognized by the functions of the application and the service provided by the predetermined company, the processing unit 270 determines that the predetermined area It may be determined that the condition is satisfied. For example, when the predetermined company and the company providing the server device 200 are the same, for example, the accuracy of the result of character recognition added in advance to the acquired PDF file and the character This is because the accuracy of the recognition result is considered to be equivalent. Thereby, for example, the processing load of character recognition in the server device 200 can be reduced. The information of the extension area may be set by, for example, a character recognition module of the image forming apparatus 300.

  Further, for example, when the extension area of the acquired PDF file includes the predetermined information set by the user of the terminal device 400, the processing unit 270 may determine that the predetermined condition is satisfied. Thus, the user can specify whether to use the text data included in the PDF file or to use the result of character recognition of the image included in the PDF file by the server device 200.

  If the predetermined condition is satisfied (YES in step S101), it is determined that the text data included in the file is to be used (step S102), and the process ends.

  If the predetermined condition is not satisfied (NO in step S101), processing unit 270 determines whether or not the acquired PDF file is a file that has been converted from a file format and includes text data (step S103). . Here, the processing unit 270 may perform this determination using, for example, one or more of the following conditions. That is, the processing unit 270 may make this determination by combining a plurality of conditions among the following conditions.

  The processing unit 270 may, for example, include a case where the acquired PDF file does not include image data of a predetermined display size or more (ie, does not include image data or includes only image data of a predetermined display size or less). In this case, the format of the file may be determined to be a file containing text data. Note that the processing unit 270 may determine the predetermined display size according to the display size of each page of the PDF file. In this case, the processing unit 270 may set the predetermined display size to, for example, 80% of the display size of each page of the PDF file. For example, in the case of a PDF file generated by scanning an A4-size printed matter, all areas other than the margins among the areas of each page of the A4-size are display areas of an image generated by scanning. It is because it is considered.

  In addition, when the acquired PDF file is a file acquired from the image forming apparatus 300, the processing unit 270 may determine that the file format is not a file that has been converted and includes text data. In this case, for example, when the acquired file is received at a communication port of a predetermined communication protocol for receiving PDF from the image forming apparatus 300, the processing unit 270 determines that the acquired file is The file may be determined to be a file acquired from the file 300.

  If the acquired PDF file is a file including text data in which a character is recognized from an image such as one created by reading a printout optically, the processing unit 270 converts the file format into a text file. It may be determined that the file is not a file containing data. In this case, for example, if the extended area of the acquired PDF file includes information indicating that the character has been recognized, the processing unit 270 determines that the file includes text data and the like whose characters have been recognized from the image. May be. The information of the extension area may be set by, for example, a character recognition module of the image forming apparatus 300.

  If the file is a file containing text data whose format has been converted (YES in step S103), the process proceeds to step S102. In the process of converting to a PDF file, the text data included in the original file is retained, so the text data included in the converted PDF file is correct text data that has not been subjected to character recognition processing. For this reason, for example, when a file such as a document is converted to PDF by this processing, the same text data as the original text data included in the document or the like can be used.

  If the format of the file is not a file containing text data that has been converted (NO in step S103), it is determined that the text data included in the file is not used (step S104), and the process ends. Accordingly, when the accuracy of character recognition of text data included in the PDF file cannot be ensured, the text data recognized by the server device 200 can be used without using the text data.

  Next, with reference to FIG. 13, a process of the item extracting unit 277 according to the first embodiment will be described. FIG. 13 is a flowchart illustrating a process of the item extraction unit according to the first embodiment. FIG. 13 shows details of the process of step S1110 in FIG. 11B.

  When the reading result information is held, the processing unit 270 according to the embodiment extracts the definition ID corresponding to the identification character string included in the reading result information from the type determination database 240 by the definition specifying unit 276 (step S1201). ).

  Next, the definition specifying unit 276 determines whether a definition ID whose definition type is individual company definition information exists in the extracted definition IDs (step S1202). That is, here, it is determined whether or not the individual company definition information 252 has been registered for the form of the type indicated by the identification character string included in the read result information.

  If there is no corresponding definition ID in step S1202, since the individual company definition information 252 defining the user-specific layout is not registered in this type of form, the item extraction unit 277 ends the processing. Then, the process proceeds to step S1109 in FIG. 11A.

  If a corresponding definition ID exists in step S1202, the definition specifying unit 276 refers to the form definition database 250 and specifies individual company definition information 252 including the definition ID (step S1203). The case where the corresponding definition ID exists is a case where this form has a layout unique to the user.

  Subsequently, the item extracting unit 277 extracts an item and a value of the item from the read result information based on the specified individual company definition information, and associates the item with the item value (step S1204).

  The item and item value extraction processing using the specific definition information in step S1109 and the item and item value extraction processing using the general definition information 251 in step S1110 are the same as those in step S1108. The description is omitted because it is the same except that it becomes the specific definition information or the general definition information.

  Here, generation of recognition result data according to the first embodiment will be described. FIG. 14B is a diagram illustrating an example of the reading result information according to the first embodiment.

  The read result information 130 shown in FIG. 14B is, for example, extracted from a result of cutting out a character field from a PDF file of a certain bill, recognizing a character in the character field, and coordinates indicating the position of the character. .

  The read result information 130 includes character strings “invoice”, “R company”, “total”, and “12,960”. Here, the definition specifying unit 276 refers to the type determination database 240 and extracts the definition ID in which the character string included in the read result information 130 is the identification character string. In this case, the definition IDs “H01” and “A01” are extracted (see FIG. 3).

  Next, the definition specifying unit 276 specifies a definition ID whose corresponding definition type is individual company definition information among the extracted definition IDs. Here, the definition ID “A01” is specified. That is, it is understood that the form from which the read result information 130 is extracted is a form in which the individual company definition information of the definition ID “A01” is set.

  Next, the item extracting unit 277 refers to the company definition information 252 of the definition ID “A01” in the form definition database 250 (see FIG. 6).

  In the individual company definition information 252, it is defined that the character string in the area below the item “Total” of the item ID “2”, which is the item indicating the billing amount, is the value of the item name “Total”. Therefore, the item extracting unit 277 sets the character string “total” included in the read result information 130 as the item name “total”, and replaces the character string “12,960” in the area below the character string “total” with the item name. Extract as the value of "Total".

  The item extracting unit 277 extracts a character string corresponding to each item name defined in the individual company definition information 252 and a character string serving as an item value from the read result information 130 in this manner.

  When the item extraction unit 277 completes the extraction of the item name and the item value defined in the individual company definition information 252, the definition specifying unit 276 next sets the corresponding definition type in the extracted definition ID. Determines whether there is a definition ID that is the specific definition information.

  Here, there is no corresponding definition ID. That is, it is understood that the specific definition information is not defined for the form from which the read result information 130 is extracted.

  Next, the definition specifying unit 276 determines whether the corresponding definition type among the extracted definition IDs has a definition ID that is general-purpose definition information. In this case, the definition ID “A01” is specified. That is, it is understood that the form from which the read result information 130 is extracted is also defined by the general definition information of the definition ID “H01”.

  Here, the item extracting unit 277 refers to the general definition information 251 of the definition ID “A01” (see FIG. 5). Then, the item extracting unit 277 extracts the item name and the item value defined in the general definition information 251 in the same manner as when referring to the individual company definition information 252.

  In the general definition information 251, since all item names and item values included in the document of the document type “invoice” are defined, when the general definition information 251 is referred to, it is defined in the individual company definition information 252. The item name and the item value that have not been set are extracted.

  Also, unlike the individual company definition information 252, in the general definition information 251, the character string in the lower right area of the item “total” of the item ID “2”, which is the item indicating the billing amount, is the item name “total” Is defined. Here, since the read result information 130 does not include the character string “total”, the item extracting unit 277 determines that the value of the item whose item ID is “2” is “empty”.

  If the read result information 130 includes the character string “total”, the item extracting unit 277 sets the character string “total” included in the read result information 130 to the item name “total”, and The character string in the lower right area of “total” is extracted as the value of the item name “total”.

  As described above, in the present embodiment, item names and item values are extracted based on different types of form definition information with reference to different types of form definition information.

  Hereinafter, the merging process performed by the item extracting unit 277 will be described. In the display screen generation unit 278 according to the embodiment, when the item name and the item value are extracted from each of the different types of form definition information for the same item ID, the items are extracted from the high-priority type form definition information. The recognition result data is generated by using the item names and the item values thus set.

  In the present embodiment, of the general definition information, individual company definition information, and specific definition information, the individual company definition information has the highest priority. This is because the individual company definition information is a definition uniquely set by the user, and is a definition to be referred to with the highest priority.

  Further, in the present embodiment, the priority of the specific definition information is set high next to the individual company definition information, and the priority of the general definition information is set lowest.

  Therefore, for example, when an item name and an item value are extracted from each of the three types of form definition information, the item name and the item value extracted based on the individual company definition information are adopted.

  Specifically, for example, the item of item ID “2” is defined in each of the general definition information 251 and the individual company definition information 252.

  Therefore, in the present embodiment, for the item of item ID “2”, the item name and item value extracted according to the general definition information 251 and the item name and item value extracted according to the individual company definition information 252 are Exists.

  In this case, for the item with the item ID “2”, the item extracting unit 277 uses the item name and the item value extracted according to the individual company definition information 252 to generate recognition result data. Specifically, the character string “12,960” is extracted as an item value according to the individual company definition information 252, and the item value is determined to be “empty” according to the general definition information 251. “12,960” extracted from the individual company definition information 252 having a high degree is used for generating recognition result data.

  In general, in the invoice, “total” is used as the item name of the item indicating the amount to be charged, so the item “total” is set in the general definition information 251. On the other hand, since the invoice from Company R for user A uses “total” instead of “total” as an item name, the invoice amount of such an invoice is reduced using the general-purpose definition information 251. I can't recognize. Therefore, in order to extract the bill from the bill for the user A from the company R, the individual company definition information 252 unique to the user A in which the item “total” is set is required.

  Furthermore, in comparison with a general invoice, in the invoice from Company R for user A, “Total” is used as the item name of the item indicating the amount charged, but the position where the item value is described is If different, the item values such as the direction and distance of the item “total” in the individual company definition information 252 unique to the user A may be set to be different from the general definition information 251.

  The item with the item ID “10” defined in the general definition information 251 is not defined in the individual company definition information 252. Therefore, for the item with the item ID “10”, only the item name and the item value according to the general definition information 251 are extracted. Therefore, for the item having the item ID “10”, the display screen generating unit 278 uses the item name and the item value extracted according to the general definition information 251 to generate the recognition result data.

  As described above, in the present embodiment, priorities are given to a plurality of types of form definition information, and among the item names and item values extracted according to each form definition information, the form definition information having the highest priority is set. Using the item names and the item values extracted according to the above, recognition result data which is a recognition result of the form image is generated.

  FIG. 15A is a diagram illustrating an example of a recognition result confirmation screen according to the first embodiment. A screen 140 illustrated in FIG. 15A is an example of a screen displayed on the terminal device 400, in which a recognition result generated as a result of recognizing a form is displayed.

  The screen 140 displays a form image 141 read by the image forming apparatus 300 and information 142 that associates items extracted by the processing unit 270 with item values. In addition, a registration button 143 is displayed on the screen 140. The user refers to the form image 141, checks the displayed items and the values of the items, and corrects the values of the items as necessary. Then, when the registration button 143 is selected, the value of the item after correction is registered in the recognition result data.

  In the present embodiment, for example, when the registration button 143 is selected, the image data indicating the form image 141 and the information 142 may be stored in the core system 500 or the like. In addition, the user may download the registered recognition result data via the recognition result confirmation screen and register it in the backbone system via the operation screen of the backbone system 500.

  Further, on the screen 140, information 144 indicating the form definition information referred to when recognizing the form image 141 may be displayed. In the present embodiment, by displaying this information 144, it is possible to notify the user of what type of form definition information the form image 141 has been recognized using.

  Hereinafter, an example of the recognition result data of the present embodiment is shown. FIG. 15B is a diagram illustrating an example of the recognition result data.

  In the recognition result data 151 shown in FIG. 15B, the items included in the form image data and the item values are extracted and associated with each other, and the result of associating the item IDs of the items with the item values is XML. It is described in the format.

  In the present embodiment, when the recognition result data 151 is generated and stored in the recognition result database 260, the storage destination is set to the value of the item “recognition result file path” of the job list 101.

  In the second embodiment, an example will be described in which the server apparatus 200 generates, from a file received from the image forming apparatus 300 and the terminal apparatus 400, text data in which the content of the file is translated. Note that the second embodiment is the same as the first embodiment except for a part, and thus the description will be appropriately omitted. In the following, description of parts common to the first embodiment will be omitted, and only different parts will be described.

  Next, with reference to FIG. 16, the processing of the processing unit 270 according to the second embodiment will be described. FIG. 16 is a flowchart illustrating the processing of the processing unit 270 according to the second embodiment.

  The processing unit 270 acquires a PDF file from the PDF file database 230 (step S1601), and determines whether the acquired PDF file includes text data (step S1602).

  If text data is not included (NO in step S1602), the process advances to step S1605.

  If text data is included (YES in step S1602), it is determined whether to use the text data (step S1603).

  If the text data is to be used (YES in step S1603), the processing unit 270 holds the text data as text data to be processed (an example of “first text data”) (step S1604), and a process to be described later. The process proceeds to S1610. If the text data is not used (NO in step S1603), the processing unit 270 causes the preprocessing unit 274 to convert the PDF file into an image in a png or jpeg format (step S1605).

  Subsequently, the preprocessing unit 274 selects an image for one page (step S1606), and performs preprocessing (step S1607).

  Next, the processing unit 270 causes the character recognition unit 275 to cut out an area in which characters are formed (hereinafter, a character field) from the image (step S1608). Subsequently, the processing unit 270 cuts out the characters in the cut-out character field by the character recognition unit 275, performs character recognition, and processes the result of the character recognition as text data to be processed (an example of “second text data”. ) (Step S1609).

  Subsequently, the processing unit 270 generates read result information based on the positional relationship of each character included in the text data to be processed (step S1610).

  Note that the processing from step S1601 to step S1610 may be the same as the processing from step S1101 to step S1110 in FIGS. 11A and 11B.

  Subsequently, the processing unit 270 translates the read result information (step S1611), and outputs the translation result to the terminal device 400 (step S1612). Thus, for example, when a user uploads a PDF file of a paper in English or the like obtained from a predetermined Web site or the like to the server device 200, the user can obtain data in which the paper is translated into Japanese or the like.

利用 Usage judgment processing of text data≫
Next, an example of the text data use determination processing in step S1102 of FIG. 11A will be described with reference to FIGS. FIG. 17 is a flowchart illustrating an example of text data use determination processing according to the embodiment. FIG. 18 is a diagram illustrating an example of a setting screen of the terminal device 400 according to the embodiment. Note that the processing unit 270 may execute the processing in FIG. 17 in combination with the processing in FIG.

  In step S1701, the processing unit 270 creates, for example, original data that is data in a format other than PDF and that is data to be converted from the acquired PDF file, from the attribute information (metadata) of the acquired PDF file. Information indicating the first tool (application program) thus obtained and information indicating the second tool obtained by converting the original data into a PDF file are acquired.

  In the PDF data structure defined by the ISO 32000-1 standard, the PDF file includes information of a header, a body, a cross reference table, and a trailer. Further, the trailer of the PDF file includes metadata of a document information (Document Information) dictionary in an “Info” item.

  The processing unit 270, for example, when converting from a format other than PDF associated with the "Creator" item among the metadata included in the document information dictionary, the original creation tool (the first file of the first file) (A tool that created the first file when the format is a PDF file generated by conversion)) may be acquired as information indicating the first tool.

  Further, for example, when converting from a format other than PDF associated with the “Producer” item among the metadata included in the document information dictionary, the processing unit 270 may use the conversion tool (for the third file). (A tool that converts the third file into a PDF file when the format is a PDF file generated by conversion)) may be acquired as information indicating the second tool.

  Subsequently, the processing unit 270 converts information indicating a third tool permitted as a tool for creating text data included in the PDF file and information indicating a fourth tool permitted as a conversion tool for the text data. It is acquired (step S1702). Here, the third tool and the fourth tool may be set in advance. Further, the third tool and the fourth tool may be set in advance by a user of the terminal device 400. Further, a keyword indicating the third tool and a condition for determining whether the keyword matches information indicating the first tool may be set. As a condition for determining a match, for example, a partial match, a perfect match, a front match, a back match, or the like may be set. Similarly, a keyword indicating the fourth tool and a condition for determining whether the keyword matches information indicating the second tool may be set.

  In the example of FIG. 18, the terminal device 400 displays on the display screen 1801 a condition setting 1802 relating to a creation tool, a condition setting 1803 relating to a conversion tool, and a “OK” button 1804. In the example of FIG. 18, “Excel” and “Word” are specified by the user as keywords indicating the third tool in the condition setting 1802 for the creation tool, and it is determined whether each keyword matches the information indicating the first tool. "Partial match" is specified as a condition.

  Similarly, in the condition setting 1803 relating to the conversion tool, “Excel” and “Word” are specified by the user as keywords indicating the fourth tool, and a condition for determining whether each keyword matches information indicating the second tool is determined. "Partial match" is specified. When the “OK” button 1804 is pressed, the terminal device 400 transmits to the server device 200 information on the condition setting 1802 relating to the creation tool and the condition setting 1803 relating to the conversion tool designated by the user. Then, the server device 200 stores the setting information specified by the user.

  Subsequently, the processing unit 270 determines whether the creation tool is permitted (step S1703). Here, when the first tool acquired in step S1701 matches the third tool acquired in step S1702, processing unit 270 determines that the creation tool is permitted.

  In this case, for example, the processing unit 270 determines that the information indicating the first tool is “Microsoft Word 2016 Professional”, the information indicating the third tool is “Excel” and “Word”, and the specified condition is “ If "partial match", it may be determined that the first tool matches the third tool.

  If the creation tool is permitted (YES in step S1703), processing unit 270 determines to use the text data included in the file (step S1704), and ends the process.

  On the other hand, if the creation tool is not permitted (NO in step S1703), the processing unit 270 determines whether the conversion tool is permitted (step S1705). Here, when the second tool acquired in step S1701 matches the fourth tool acquired in step S1702, processing unit 270 determines that the conversion tool is permitted.

  In this case, for example, the processing unit 270 determines that the information indicating the second tool is “Microsoft Word 2016 Professional”, the information indicating the fourth tool is “Excel” and “Word”, and the designated condition is “ If "partial match", it may be determined that the second tool matches the fourth tool. Further, the processing unit 270 determines that the information indicating the second tool is “PDF Easy Parse”, the information indicating the fourth tool is “Excel” and “Word”, and the designated condition is “partial match”. , It may be determined that the second tool does not match the fourth tool.

  If the conversion tool is permitted (YES in step S1705), processing unit 270 proceeds to the process in step S1704. On the other hand, if the conversion tool is not permitted (NO in step S1705), processing unit 270 determines that text data included in the file is not used (step S1706), and ends the process. As a result, when the original data creation tool and the conversion tool that cannot guarantee the accuracy of the text data added to the converted PDF file are used, the server apparatus 200 recognizes characters without using the text data. Text data can be used.

<Modification>
Each functional unit of the server device 200 may be realized by, for example, cloud computing including one or more computers. Further, the server device 200 and the terminal device 400 may be integrated. Further, the server device 200 may have at least a part of the functions of the terminal device 400 and the image forming device 300.

<Summary of Embodiment>
Conventionally, for example, a paper document on which a bill transmitted by facsimile is printed is digitized (for example, converted to PDF), and character recognition and form recognition are performed. 2. Description of the Related Art In recent years, invoices created by document creation software or the like have been converted to PDF and sent by e-mail instead of FAX.

  On the other hand, in the conventional form recognition method, for example, the recognition rate may be low depending on characters (for example, half-width kana).

  For example, when an invoice created by document creation software or the like is converted to PDF, it can be said that the text data included in the converted PDF file is 100% accurate. According to each of the above-described embodiments, when the file to be processed is a file including text data in which the format of the file has been converted, the server device 200 performs form recognition or the like using the text data included in the file. Is performed. This makes it possible to use more accurate text data. In addition, when the file to be processed is, for example, a file including first text data in which characters are recognized from an image created by reading a printed matter optically, the server 200 performs character recognition on the file. The second text data is generated, and processing such as form recognition is performed using the second text data.

  As described above, the present invention has been described based on the embodiments. However, the present invention is not limited to the requirements described in the above embodiments. Regarding these points, the gist of the present invention can be changed within a range that does not impair the gist, and can be appropriately determined according to the application form.

REFERENCE SIGNS LIST 100 information processing system 200 server device 210 storage unit 220 control unit 221 input reception unit (an example of “acquisition unit”)
230 PDF file database 240 Type judgment database 250 Form definition database 260 Recognition result database 270 Processing unit 271 Data storage unit 272 Job list generation unit 274 Preprocessing unit 275 Character recognition unit 276 Definition specifying unit 277 Item extraction unit 278 Display screen generation unit 279 Output unit 300 Image forming device 400 Terminal device 500 Core system

JP-A-2006-051339

Claims (13)

An acquisition unit for acquiring a file including the first text data;
Whether to perform predetermined processing using second text data generated by character recognition of an image included in a file acquired by the acquisition unit or to perform the predetermined processing using the first text data. An information processing apparatus comprising: a processing unit that determines based on a file acquired by the acquisition unit. The file acquired by the acquisition unit is PDF (Portable Document Format) data.
The information processing device according to claim 1. The processing unit performs the predetermined process using the first text data when the file acquired by the acquisition unit is a file generated by converting a format of a file including text data.
The information processing apparatus according to claim 1. The processing unit performs the predetermined process using the first text data when the file acquired by the acquisition unit does not include image data of a predetermined display size or more,
The information processing device according to claim 1. The processing unit performs the predetermined process using the second text data when information indicating that the first text data is character-recognized from an image is included in a file acquired by the acquisition unit.
The information processing device according to claim 1. The processing unit, when a file is obtained from the image forming apparatus by the obtaining unit, performs the predetermined process using the second text data,
The information processing apparatus according to claim 1. The processing unit performs the predetermined process using the first text data when information indicating that a character is recognized by a function provided by a predetermined company is included in a file obtained by the obtaining unit. ,
The information processing device according to claim 1. The acquisition unit acquires a form file, and the predetermined process is a process of extracting data of a predetermined item from the form.
The information processing apparatus according to claim 1. The processing unit performs the predetermined process using the second text data or performs the predetermined process using the first text data based on the attribute information of the file acquired by the acquisition unit To decide,
An information processing apparatus according to claim 1. A processing unit that, when included in the attribute information of the file acquired by the acquisition unit, creates the first file when the file is a second file generated by converting the format of the first file; Based on the information indicating, determines whether to perform the predetermined process using the second text data, or to perform the predetermined process using the first text data,
The information processing device according to claim 9. The processing unit may include, in the attribute information of the file acquired by the acquisition unit, the third file in a case where the file is a fourth file generated by converting a format of the third file, by the fourth file. Based on the information indicating the tool converted to a file, determine whether to perform the predetermined process using the second text data or to perform the predetermined process using the first text data,
The information processing device according to claim 9. The information processing device is
A process of obtaining a file containing the first text data;
Whether to perform a predetermined process using second text data generated by character recognition of an image included in a file obtained by the obtaining process or to perform the predetermined process using the first text data Determining based on the file acquired by the acquiring process. For information processing equipment,
A process of obtaining a file containing the first text data;
Whether to perform a predetermined process using second text data generated by character recognition of an image included in a file obtained by the obtaining process or to perform the predetermined process using the first text data Determining based on the file acquired by the acquiring process.

Images