JP2023129001A - Information processing device and information processing program - Google Patents

Abstract

To register a key character string with fluctuations allowed thereto when the key character string can have a problem with being translated into another language.SOLUTION: An information processing device 10 includes a CPU 11. The CPU 11 sets, as a key character string, a character string of a first language to which a character string specified from an image is made to correspond; translates the key character string into a plurality of different second languages other than the first language; retranslates into the first language, each of a plurality of translated character strings that are obtained by translating the plurality of different second languages; and registers, when a character string that does not match the key character string is included in the plurality of retranslated character strings that are obtained by retranslation into the first language, the character string of the first language that has a similar meaning as the key character string, as a similar word.SELECTED DRAWING: Figure 3

Description

The present invention relates to an information processing device and an information processing program.

For example, Patent Document 1 describes an image processing device that suppresses disturbances in the relationship between regions in which translated sentences exist when recognizing and translating characters in an image. This image processing device includes a region extraction means for extracting a character region within an image, a character recognition means for recognizing characters in the character region extracted by the region extraction means, and a translation means for translating the recognition result by the character recognition means. and the direction of the characters in the character region extracted by the region extraction means and the direction of the characters in the language translated by the translation means are different, and the direction of the characters in the character region is rotated or reversed. Based on the relationship between the direction of the characters in the case and the direction of the characters in the translated language, the composition of the image, including the character region extracted by the region extraction means, is rotated or reversed. and a changing means for changing. The character direction is the direction of a character string within a line, the direction of a line, or a combination thereof.

Further, Patent Document 2 describes an information processing device that provides character string extraction results corresponding to each individual user using a character string extraction technique that utilizes key-value relationships. This information processing device includes a processor, the processor identifies one or more keys corresponding to user information of a user using the electronic document, and selects a first character string corresponding to the one or more keys from the electronic document. A second character string corresponding to the first character string is extracted from the electronic document.

Japanese Patent Application Publication No. 2010-231812 Japanese Patent Application Publication No. 2021-064209

By the way, a read image of a form or the like is subjected to OCR (Optical Character Recognition) to identify a key character string (hereinafter referred to as "key character string"), and to identify characters located around the key character string. There is a technique (hereinafter referred to as "key-value extraction") for extracting a string as a value (hereinafter referred to as "value character string"). Key-value extraction is used to check and correct documents, etc., and by having a plurality of registered key strings, it is possible to extract value strings of various documents. For example, if only the key string "Name" is registered, it will not be possible to handle a form that includes the item "Name", so the key string will be made to fluctuate and "Name" and "First Name" will be registered. It is desirable that

In key-value extraction, for example, a key character string registered in English or the like may be translated into another language such as Japanese and used. However, if the translated word of the key string is not the intended translated word, an incorrect value string may be extracted.

For this reason, it is desirable to register as many similar words as possible for key character strings that are likely to have translation problems, and to create fluctuations in the key character strings.

The present disclosure provides an information processing device and an information processing program that can register key character strings that are likely to have translation problems with fluctuations when the key character strings are translated into another language and used. With the goal.

In order to achieve the above object, an information processing apparatus according to a first aspect includes a processor, and the processor sets a character string in a first language to correspond to a character string identified from an image as a key character string, and A key string is translated into a plurality of different second languages other than the first language, and each of the plurality of translated strings obtained by the translation into the plurality of different second languages is translated into the first language. If a plurality of retranslated character strings obtained by translating and retranslating into the first language includes a character string that does not match the key character string, Similar character strings in the first language are registered as similar words.

Further, in an information processing apparatus according to a second aspect, in the information processing apparatus according to the first aspect, the second language is a language written in the image.

Further, in the information processing device according to a third aspect, in the information processing device according to the first aspect or the second aspect, the processor displays a character string in the first language that is similar in meaning to the key character string on the screen. The character string selected by the user among the displayed character strings is registered as the similar word.

Further, in the information processing apparatus according to a fourth aspect, in the information processing apparatus according to the third aspect, the screen displays the plurality of retranslated character strings, and a display form of a character string that does not match the key character string is provided. is different from the display form of the character string that matches the key character string.

Furthermore, in the information processing apparatus according to the first aspect or the second aspect, the processor selects a character string in the first language that is similar in meaning to the key character string. A character string whose index value indicating the closeness of meaning with the key character string is equal to or greater than a threshold value is registered as the similar word.

Further, in the information processing apparatus according to a sixth aspect, in the information processing apparatus according to any one of the first to fifth aspects, when the processor performs confirmation correction on the image, When identifying a character string corresponding to the key character string, the key character string is translated into the second language to generate a plurality of translation candidates, and the character string in the first language is registered as the similar word. is used to select a translated word for the key character string from among the plurality of translation candidates.

Further, in the information processing device according to a seventh aspect, in the information processing device according to the sixth aspect, the processor translates the character string in the first language registered as the similar word into the second language. Generate translated similar words, calculate an index value indicating the closeness of meaning between each of the plurality of translation candidates and the translated similar word, and select the index value from among the plurality of translation candidates. The highest translation candidate is selected as the translated word for the key string.

Further, in the information processing apparatus according to an eighth aspect, in the information processing apparatus according to the seventh aspect, the processor uses the selected translated word to identify a character string corresponding to the translated word from the image. , character strings located around the identified character string are extracted as value character strings.

Further, in the information processing device according to a ninth aspect, in the information processing device according to the eighth aspect, if the selected translated word is not appropriate, the processor corrects the translated word after extracting the value character string. The character string is retranslated into the first language, and the character string obtained by the retranslation into the first language is registered as the similar word.

Furthermore, in order to achieve the above object, the information processing program according to the tenth aspect sets a key string in a first language to correspond to a string identified from an image, and sets the key string in a language other than the first language. into a plurality of different second languages, retranslate each of the plurality of translated character strings obtained by translating into the plurality of different second languages into the first language, and retranslate them into the first language. If a plurality of retranslated character strings obtained by translation include a character string that does not match the key character string, a character in the first language that is similar in meaning to the key character string. Causes the computer to register columns as synonyms.

According to the first aspect and the tenth aspect, when a key character string is translated into another language and used, a key character string that is likely to have a problem in translation can be registered with fluctuations. have

According to the second aspect, when a key character string is translated into a language written in an image and used, key character strings that are likely to have translation problems can be registered with fluctuations. have

According to the third aspect, there is an effect that the character string intended by the user can be registered as a similar word.

According to the fourth aspect, there is an effect that the user can grasp character strings that do not match the key character string at a glance.

According to the fifth aspect, there is an effect that a character string having a similar meaning to a key character string can be automatically registered as a similar word.

According to the sixth aspect, when performing confirmation and correction, it is possible to obtain an appropriate translated word for the key string compared to the case where the first language string registered as a similar word is not considered. have an effect.

According to the seventh aspect, it is possible to automatically select the translation candidate whose meaning is closest to the translated similar word from among the plurality of translation candidates as the translated word of the key character string.

According to the eighth aspect, when performing confirmation and correction, it is possible to perform appropriate key-value extraction compared to the case where a translated word whose meaning is different from the translated similar word is used.

According to the ninth aspect, there is an effect that the accuracy of similar words can be improved compared to the case where a character string obtained by correcting an inappropriate translated word is not considered as a similar word.

1 is a diagram illustrating an example of the configuration of an information processing system according to an embodiment. FIG. 1 is a block diagram illustrating an example of an electrical configuration of an information processing device according to an embodiment. FIG. 1 is a block diagram illustrating an example of a functional configuration of an information processing device according to an embodiment. FIG. 3 is a front view showing an example of a key setting screen according to the embodiment. It is a front view showing an example of a key setting screen on which a translation confirmation list according to an embodiment is displayed as a pop-up. FIG. 3 is a front view showing an example of a key setting screen on which a synonym list according to the embodiment is displayed as a pop-up. FIG. 3 is a front view showing an example of a synonym list from which similar words are selected according to the embodiment. It is a front view showing an example of the synonym list when the synonym registration button according to the embodiment is pressed. It is a flow chart which shows an example of the flow of key character string setting processing by an information processing program concerning an embodiment. FIG. 7 is a front view showing a confirmation/correction screen according to a comparative example. FIG. 2 is a block diagram illustrating another example of the functional configuration of the information processing device according to the embodiment. It is a figure showing an example of a key translation candidate generation result concerning an embodiment. It is a front view showing an example of a confirmation correction screen concerning an embodiment. FIG. 7 is a front view showing another example of the confirmation/correction screen according to the embodiment. It is a flow chart which shows an example of the flow of key value extraction processing by an information processing program concerning an embodiment.

Hereinafter, an example of a form for implementing the technology of the present disclosure will be described in detail with reference to the drawings. Note that components and processes that have the same operations, functions, and functions are given the same reference numerals throughout the drawings, and overlapping explanations may be omitted as appropriate. The drawings are only schematically illustrated to provide a thorough understanding of the technology of the disclosure. Therefore, the technology of the present disclosure is not limited to the illustrated example. Further, in this embodiment, descriptions of configurations that are not directly related to the technology of the present disclosure or well-known configurations may be omitted.

FIG. 1 is a diagram showing an example of the configuration of an information processing system 100 according to the present embodiment.

As shown in FIG. 1, the information processing system 100 according to the present embodiment includes an information processing device 10, a reading device 30, an administrator terminal 40A, and a worker terminal 40B. The information processing device 10 according to the present embodiment is, for example, a general-purpose computer device such as a server computer or a personal computer (PC). However, the information processing device 10 may be an image forming device that executes image-related functions (scanner function, copy function, print function, etc.) according to user instructions. In this case, the reading device 30 becomes unnecessary.

The information processing apparatus 10 according to the present embodiment performs OCR processing on an image such as a form (hereinafter referred to as a "form image"), identifies a key character string, and converts character strings located around the key character string into values. It has a function (key-value extraction) to extract it as a character string (value). Note that in this embodiment, a form image will be shown and described as an example of the image, but the image is not limited to a form image.

The information processing device 10 is connected to each of the reading device 30, the administrator terminal 40A, and the worker terminal 40B via a network N. Note that the Internet, LAN (Local Area Network), WAN (Wide Area Network), etc. are applied to the network N. There are no restrictions on the connection form of the network N, and it may be wired, wireless, or a combination of wired and wireless.

The reading device 30 is a reading device such as a scanner, and inputs a document image obtained by optically reading a document document into the information processing device 10 . The administrator terminal 40A is a terminal device used by a business manager who manages document business. The worker terminal 40B is a terminal device used by a worker who confirms and corrects the results obtained by key-value extraction. For example, a general-purpose computer device such as a PC is applied to the administrator terminal 40A and the worker terminal 40B.

As shown in FIG. 1, the reading device 30 reads a certain form document D and inputs the obtained form image to the information processing device 10. The information processing device 10 performs OCR processing on the form image input from the reading device 30. In this OCR process, for example, a key definition file containing "call number" as a key (attribute) is registered in advance for a form image containing the description "call number 12345." Then, the form image is subjected to OCR processing, the key "call number" is specified, and "12345" located around the specified "call number" is extracted as a value.

FIG. 2 is a block diagram showing an example of the electrical configuration of the information processing device 10 according to the present embodiment.

As shown in FIG. 2, the information processing device 10 according to the present embodiment includes a CPU (Central Processing Unit) 11, a ROM (Read Only Memory) 12, a RAM (Random Access Memory) 13, and an input/output interface (I). /O) 14, a storage section 15, a display section 16, an operation section 17, and a communication section 18.

The CPU 11, ROM 12, RAM 13, and I/O 14 are each connected via a bus. Each functional section including a storage section 15, a display section 16, an operation section 17, and a communication section 18 is connected to the I/O 14. Each of these functional units can communicate with the CPU 11 via the I/O 14.

A control unit is configured by the CPU 11, ROM 12, RAM 13, and I/O 14. The control unit may be configured as a sub-control unit that controls a part of the operation of the information processing device 10, or may be configured as a part of a main control unit that controls the entire operation of the information processing device 10. . For example, an integrated circuit such as an LSI (Large Scale Integration) or an IC chipset is used for a part or all of each block of the control section. Individual circuits may be used for each of the above blocks, or a part or all of them may be integrated. Each of the blocks described above may be provided integrally, or some blocks may be provided separately. Moreover, in each of the above-mentioned blocks, a part thereof may be provided separately. The integration of the control section is not limited to LSI, but a dedicated circuit or a general-purpose processor may also be used.

As the storage unit 15, for example, a HDD (Hard Disk Drive), an SSD (Solid State Drive), a flash memory, etc. are used. The storage unit 15 stores an information processing program 15A for executing key-value extraction according to this embodiment. Note that this information processing program 15A may be stored in the ROM 12.

The information processing program 15A may be installed in the information processing device 10 in advance, for example. The information processing program 15A may be realized by being stored in a nonvolatile storage medium, or distributed via a network, and installed in the information processing device 10 as appropriate. Note that examples of nonvolatile storage media include CD-ROM (Compact Disc Read Only Memory), magneto-optical disk, HDD, DVD-ROM (Digital Versatile Disc Read Only Memory), flash memory, memory card, etc. Ru.

For example, a liquid crystal display (LCD), an organic EL (electroluminescence) display, or the like is used for the display unit 16. The display unit 16 may integrally include a touch panel. The operation unit 17 is provided with an operation input device such as a keyboard and a mouse. The display unit 16 and the operation unit 17 receive various instructions from the user of the information processing device 10. The display unit 16 displays various information such as the results of processing executed in response to instructions received from the user and notifications regarding the processing.

The communication unit 18 is connected to a network N such as the Internet, LAN, WAN, etc., and communicates with each of the reading device 30, the administrator terminal 40A, and the worker terminal 40B via the network N. It is considered possible.

By the way, as described above, in key-value extraction, for example, a key character string registered in English or the like may be translated into another language such as Japanese and used. However, if the translated word of the key string is not the intended translated word, an incorrect value string may be extracted. For this reason, it is desirable to register as many similar words as possible for key character strings that are likely to have translation problems, and to create fluctuations in the key character strings.

The information processing device 10 according to the present embodiment sets a key character string in a first language to correspond to a character string specified from a form image, and sets the key character string in the first language to a plurality of different second language characters other than the first language. language, each of the plurality of translated strings in the second language is retranslated into the first language, and a string that does not match the key string is found in the plurality of retranslated strings in the first language. is included, a character string in the first language that is similar in meaning to the key character string is registered as a similar word.

Specifically, the CPU 11 of the information processing device 10 according to the present embodiment functions as each unit shown in FIG. 3 by writing the information processing program 15A stored in the storage unit 15 into the RAM 13 and executing it. Note that the CPU 11 is an example of a processor.

FIG. 3 is a block diagram showing an example of the functional configuration of the information processing device 10 according to the present embodiment. Note that the configuration example in FIG. 3 shows the configuration at the time of key character string setting processing.

As shown in FIG. 3, the CPU 11 of the information processing device 10 according to the present embodiment functions as a key setting section 11A, a translation processing section 11B, a translation result presentation section 11C, and a similar term registration section 11D.

A setting DB (Data Base) 151 is stored in the storage unit 15 . A key definition file is registered in the setting DB 151 for each form image. In the key definition file, combinations of key character strings included in the form image and their similar words (synonym 1, synonym 2) are defined.

The key setting unit 11A sets a character string in the first language that corresponds to a character string specified from the form image as a key character string. Specifically, as an example, the key setting screen shown in FIG. 4 is displayed on the administrator terminal 40A, and input of key settings by the business manager is accepted.

FIG. 4 is a front view showing an example of the key setting screen 50 according to the present embodiment.

The key setting screen 50 shown in FIG. 4 is displayed on the administrator terminal 40A, and is a screen that accepts input of key settings by the business manager. The key setting screen 50 is a screen for setting key character strings in association with languages when performing key value extraction. In the example of FIG. 4, the type of document is "delivery note", and a key character string can be set according to "delivery note". The key setting screen 50 includes a language setting field 50A, a key character string setting field 50B, and translation confirmation buttons 51A to 51C. The language setting field 50A is a field for setting the language of a key character string, and the key character string setting field 50B is a field for setting one or more key character strings.

As shown in FIG. 4, "English" is set in the language setting column 50A as an example of the setting language. "English", that is, English, is an example of a first language. Further, in the key character string setting field 50B, "Address", "Name", and "Title" are set as examples of key character strings. Translation confirmation buttons 51A, 51B, and 51C are associated with each of these "Address," "Name," and "Title." Each of the translation confirmation buttons 51A, 51B, and 51C is a button for pop-up displaying a translation confirmation list (described later) corresponding to each key character string.

The translation processing unit 11B translates the key string into a plurality of different second languages other than the first language, and translates each of the plurality of translated strings obtained by translating into the plurality of different second languages into the first language. Retranslate into language. Specifically, as an example, when the first language is English, the second language is Japanese, Chinese, French, Spanish, etc. It is desirable that the second language includes the language written in the form image targeted for key-value extraction (for example, Japanese). For example, an existing translation engine is used for the translation process. For example, if the key string is "Title", it is translated into "Title" in Japanese, and then retranslated into "Position" in English.

The translation result presentation unit 11C displays a plurality of retranslated character strings obtained by retranslating into the first language (for example, English). Specifically, as an example, a translation confirmation list shown in FIG. 5 is displayed as a pop-up.

FIG. 5 is a front view showing an example of the key setting screen 50 on which the translation confirmation list 53 according to the present embodiment is displayed as a pop-up.

On the key setting screen 50 shown in FIG. 5, a translation confirmation list 53 is pop-up displayed in response to pressing the translation confirmation button 51C with the cursor 52. The translation confirmation list 53 is a list that includes translation results for each second language and retranslation results into the first language, corresponding to a key character string (for example, "Title") in the first language. In the example of FIG. 5, the first language is English, and the second languages are French, Japanese, Spanish, Russian, Chinese (simplified), and Vietnamese. For example, the combination of the first language and the second language can be set as appropriate by the business manager.

Here, among the retranslated character strings included in the translation confirmation list 53, it is desirable that the display form of character strings that do not match the key character string be different from the display form of character strings that match the key character string. In the example of FIG. 5, character strings that do not match the key character string are displayed surrounded by a rectangle. However, the color of character strings that do not match the key character string may be changed, the character strings may be underlined, the character strings may be italicized, and the display form is particularly limited. isn't it. This allows the business manager to grasp character strings and languages that do not match the key character string at first glance. The translation confirmation list 53 also includes a synonym candidate button 54. The synonym candidate button 54 is a button for pop-up displaying a synonym list (described later), which is a list of similar words corresponding to the key character string, when there is a problem with the retranslation result. Here, if the re-translation results in the translation confirmation list 53 include a character string that does not match the key character string, the person in charge of the business determines that there is a problem with the translation of the key character string.

When a plurality of retranslated character strings obtained by retranslating into the first language (for example, English) include a character string that does not match the key character string, the similar word registration unit 11D A character string in the first language that is similar in meaning to the key character string is registered as a similar word. For example, the similar word registration unit 11D displays character strings in the first language that are similar in meaning to the key character string, and selects a character string selected by the user (for example, a business manager) from among the displayed character strings. Register a string as a similar word. Character strings similar in meaning to the key character string may be estimated using, for example, a dictionary of similar words prepared in advance, or a learned model trained in advance by machine learning. Specifically, as an example, a synonym list shown in FIG. 6 is displayed as a pop-up.

FIG. 6 is a front view showing an example of the key setting screen 50 on which a synonym list 55 according to the present embodiment is pop-up displayed.

On the key setting screen 50 shown in FIG. 6, a synonym list 55 pops up in response to a press of the synonym candidate button 54 with the cursor 52. The synonym list 55 is a list that includes words similar to the key character string (for example, "Title") in the first language. In other words, similar words of the key character string are estimated by the similar word registration section 11D and displayed as a synonym list 55. In the example of FIG. 6, "heading," "position," and "theme" are displayed as similar words having similar meanings to the key character string "Title." Note that the retranslation results displayed in the translation confirmation list 53 and the similar words displayed in the synonym list 55 do not have to match. The synonym list 55 also includes a synonym registration button 56 for registering the selected similar word.

FIG. 7 is a front view showing an example of the synonym list 55 from which similar words are selected according to the present embodiment.

The synonym list 55 shown in FIG. 7 shows a state in which similar words have been selected according to the selection operation using the cursor 52. In the example of FIG. 7, "heading" and "theme" in the synonym list 55 are selected. Note that the number of selectable similar words may be one or more, and may be one or more.

FIG. 8 is a front view showing an example of the synonym list 55 when the synonym registration button 56 according to the present embodiment is pressed.

The synonym list 55 shown in FIG. 8 shows a state in which the synonym registration button 56 is pressed by the cursor 52. In this case, the selected similar word is registered in the setting DB 151. Specifically, in the example of FIG. 8, a key definition file including "heading" and "theme" as similar words is registered in the setting DB 151 in association with a key character string (for example, "Title").

Here, in the above example, the synonym list 55 containing the similar words of the key character string is displayed on the screen, and the similar word list 55 selected by the user (for example, the person in charge of business) is registered. Registration may be performed automatically. Specifically, the similar word registration unit 11D selects a key character string (e.g., "Title") that matches a key character string (e.g., "Title") among a plurality of retranslated character strings obtained by retranslating into the first language (e.g., English). Among the character strings in the first language that are similar in meaning to the key character string, the character string for which the index value indicating the closeness of meaning between the key character string and the key character string is greater than or equal to the threshold value Register as a similar word. Note that the index value here is derived using, for example, natural language processing. For natural language processing, for example, a method of quantifying the meaning of a character string as a "semantic vector", such as "Word2vec", is applied. Note that the threshold value is set to an appropriate value by the user.

Next, with reference to FIG. 9, the operation when the information processing apparatus 10 according to the present embodiment executes the key character string setting process will be described.

FIG. 9 is a flowchart showing an example of the flow of key character string setting processing by the information processing program 15A according to the present embodiment.

First, when the information processing device 10 is instructed to execute a key character string setting process, the information processing program 15A is activated by the CPU 11 and executes the following steps.

In step S101 of FIG. 9, the CPU 11 causes the administrator terminal 40A to display the key setting screen 50 shown in FIG. 4, as an example.

In step S102, the CPU 11 uses the key setting screen 50 displayed on the administrator terminal 40A to select the first language (for example, English) by the user (for example, a business manager) for a certain form image (for example, a delivery note). Accepts the setting of a key character string (for example, "Title").

In step S103, the CPU 11 determines whether the translation confirmation button (for example, the translation confirmation button 51C) on the key setting screen 50 displayed on the administrator terminal 40A has been pressed by the user (for example, a business person). If it is determined that the translation confirmation button 51C has been pressed by the person in charge of business (in the case of an affirmative determination), the process moves to step S104, and if it is determined that the translation confirmation button 51C has not been pressed by the person in charge of business (in the case of negative determination), The process goes on standby in step S103.

In step S104, the CPU 11 causes the administrator terminal 40A to pop-up display the translation confirmation list 53 shown in FIG. 5, as an example. In this case, if a character string that does not match the key string is included in the multiple retranslated character strings included in the translation confirmation list 53, the user (for example, a business person) It is determined that there is a problem with the translation and a similar word is registered.

In step S105, the CPU 11 determines whether or not the synonym candidate button 54 of the translation confirmation list 53 pop-up displayed on the administrator terminal 40A has been pressed by the user (for example, a business person). If it is determined that the synonym candidate button 54 has been pressed by the business person (in the case of an affirmative determination), the process moves to step S106, and if it is determined that the synonym candidate button 54 has not been pressed by the business person (in the case of a negative determination), The process goes on standby in step S105.

In step S106, the CPU 11 causes the above-described synonym list 55 shown in FIG. 6 to be displayed as a pop-up on the administrator terminal 40A, as an example. Then, as an example, as shown in FIG. 7 described above, selection of one or more similar words from the synonym list 55 is accepted.

In step S107, the CPU 11 determines, for example, whether or not the user (for example, a business person) has pressed the synonym registration button 56 of the synonym list 55 pop-up displayed on the administrator terminal 40A, as shown in FIG. 8 described above. Determine whether If it is determined that the synonym registration button 56 has been pressed by the person in charge of business (in the case of an affirmative determination), the process moves to step S108, and if it is determined that the synonym registration button 56 has not been pressed by the person in charge of business (in the case of negative determination), The process goes on standby in step S107.

In step S108, the CPU 11 registers the similar words selected from the synonym list 55 in the setting DB 151, and ends the key character string setting process by the information processing program 15A. Specifically, in the example of FIG. 8, a key definition file in which a combination of a key character string (for example, "Title") and similar words "heading" and "theme" is defined is registered in the setting DB 151. .

Here, in the above example, the synonym list 55 containing the similar words of the key character string is displayed on the screen, and the similar word list 55 selected by the user (for example, the person in charge of business) is registered. Registration may be performed automatically. Specifically, if a character string that does not match the key character string (e.g. "Title") is included in the multiple retranslated character strings obtained by retranslating into the first language (e.g. English), If so, among character strings in the first language that are similar in meaning to the key character string, character strings for which an index value indicating the closeness of meaning between the key character string and the key character string is equal to or higher than a threshold value are registered as similar words.

As described above, according to the present embodiment, when a key string used for key value extraction is translated into another language and used, one or more similar words are registered for the key string that is likely to have a problem in translation. It is possible to do so.

Next, a configuration of the information processing device 10 that performs key-value extraction using similar words registered in the above-mentioned setting DB 151 will be described.

First, with reference to FIG. 10, a comparative example in which key-value extraction is performed without using similar words will be described.

FIG. 10 is a front view showing a confirmation/correction screen 60 according to a comparative example. The confirmation/correction screen 60 is a screen displayed on the operator terminal 40B for confirming/correcting the extraction results obtained by key-value extraction.

The confirmation/correction screen 60 shown in FIG. 10 includes a form image 61, a key value extraction result 62, and a correction button 63. In the comparative example of FIG. 10, the key character string is English, and the language written in the form image is Japanese. Therefore, English key strings are translated into Japanese key strings. For example, the English key string "Name" is translated into the Japanese key string "Name." As a result, "Fujitaro" is extracted as the value character string. Similarly, the English key string "Address" is translated into the Japanese key string "Address." As a result, "1-1, Chiyoda-ku, Tokyo" is extracted as the value character string. However, the English key character string "Title" is translated into the Japanese key character string "Title", and as a result, "Manager" is extracted as the value character string. In other words, "Title" is translated as "title" and we expected "delivery note" to be extracted as the value string, but because it was translated as "title" which was not intended, the wrong value string was extracted. It will be done.

FIG. 11 is a block diagram showing another example of the functional configuration of the information processing device 10 according to this embodiment. Note that the configuration example in FIG. 11 shows the configuration at the time of key-value extraction processing.

As shown in FIG. 11, the CPU 11 of the information processing device 10 according to the present embodiment includes an image registration section 11E, a language determination section 11F, a translation candidate generation section 11G, a translated word selection section 11H, a key value extraction section 11J, and a confirmation section 11E. It functions as a correction processing section 11K.

The storage unit 15 stores a setting DB 151 and an extraction result DB 152. The setting DB 151 registers a key definition file in which combinations of key character strings and similar words obtained by the above-described key character string setting process are defined. In the extraction result DB 152, the extraction results obtained by extracting key values from the form image are registered.

The image registration unit 11E registers, for example, a form image obtained by reading a form document with the reading device 30 in the storage unit 15 as a target to be checked and corrected. The form image is, for example, an image written in Japanese, as shown in FIG. 10 described above.

The language determination unit 11F determines the language type of the form image registered by the image registration unit 11E. The type of language may be determined by a user (for example, a worker), or may be automatically determined using an existing language determination algorithm.

When specifying a character string corresponding to a key character string (for example, "Title") from a form image, the translation candidate generation unit 11G translates the key character string into a second language (for example, Japanese) and converts it into multiple languages. Generate translation candidates.

The translation word selection unit 11H selects a translation word for the key character string from among a plurality of translation candidates using the first language character string registered as a similar word to the key character string. Note that the selection of a translation word may be performed by a user (for example, a worker) by displaying a plurality of translation candidates on the worker terminal 40B, or may be selected automatically. When selecting automatically, the string in the first language registered as a similar word of the key string is translated into the second language to generate translated similar words, and each of the multiple translation candidates is matched with the translated similar word. An index value indicating the similarity of meaning between the words and the word is calculated, and the translation candidate with the highest index value is selected from among the plurality of translation candidates as the translated word of the key character string. Specifically, as an example, as shown in FIG. 12, key translation candidates are generated, and a translated word for the key character string is selected from the generated key translation candidates.

FIG. 12 is a diagram illustrating an example of key translation candidate generation results according to this embodiment. In the example of FIG. 12, when the key character string is "Title", "title", "title", and "title" are generated as key translation candidates.

In the example of FIG. 12, the first language character strings registered as similar words to the key character string (for example, "Title") are, for example, "heading" and "theme" as shown in FIG. 8 above. It is said that Then, these character strings in the first language are translated into the second language to generate translated similar words. For example, "heading" is translated to "title" and "theme" is translated to "subject." Furthermore, an index value indicating the similarity in meaning between each of the plurality of translation candidates and the translated similar word is calculated. The index value is calculated using natural language processing, for example, as described above. For natural language processing, for example, a method of quantifying the meaning of a character string as a "semantic vector", such as "Word2vec", is applied. In the example of FIG. 12, in the case of the key translation candidate "title", the index values (approximate values) between the translated similar words "title" and "subject" are "9.3" and "9.1," respectively. ”, and their average value is calculated as “9.2”. In addition, in the case of the key translation candidate "title", the index values (approximate values) between the translated similar words "title" and "subject" are calculated as "5.6" and "4.2", respectively. , the average value of these is calculated as "4.9". In addition, in the case of the key translation candidate "title", the index values (approximate values) between the translated similar words "title" and "subject" are calculated as "3.3" and "4.5", respectively. , the average value of these is calculated as "3.9".

Among the plurality of key translation candidates, the key translation candidate with the highest index value (approximate value) is selected as the translated word of the key character string (for example, "Title"). In the example of FIG. 12, the key translation candidate "Title" with the highest average value of index values (approximate values) is selected as the translated word of the key character string (for example, "Title"). Note that the number of translated similar words may be one or more, and if there is one translated similar word, the index value (approximate value) itself may be compared instead of the average value.

The key value extraction unit 11J uses the translated word selected by the translated word selection unit 11H to identify a character string corresponding to the translated word from the form image, and extracts character strings located around the identified character string. Extract as a value string.

For example, as shown in FIG. 13, the confirmation/correction processing unit 11K displays a confirmation/correction screen including the key value extraction results on the worker terminal 40B, receives confirmation/correction from the user (for example, a worker), and accepts the confirmation/correction. The key value extraction result reflecting the confirmation and correction is registered in the extraction result DB 152.

FIG. 13 is a front view showing an example of the confirmation/correction screen 60 according to this embodiment. The confirmation/correction screen 60 is a screen displayed on the operator terminal 40B for confirming/correcting the extraction results obtained by key-value extraction.

The confirmation/correction screen 60 shown in FIG. 13 includes a form image 61, a key value extraction result 62, and a correction button 63. In the example of FIG. 13, the key character string is English, and the language written in the form image is Japanese. Therefore, English key strings are translated into Japanese key strings. For example, the English key string "Name" is translated into the Japanese key string "Name." As a result, "Fujitaro" is extracted as the value character string. Similarly, the English key string "Address" is translated into the Japanese key string "Address." As a result, "1-1, Chiyoda-ku, Tokyo" is extracted as the value character string. The English key string "Title" is translated into the Japanese key string "Title", and as a result, "Delivery note" is extracted as the value string.

In the example of FIG. 13, a character string in the first language (e.g., "heading", [theme]) registered in advance as a similar word to a key character string (e.g., "Title") is translated into the second language. Indicates the closeness in meaning between the translated similar word (e.g., "title", "subject") and each of the multiple translation candidates (e.g., "title", "title", "designation") The index value is calculated, and the translation candidate with the highest index value is selected from among the plurality of translation candidates as the translated word of the key character string. In the example of FIG. 13, the intended "title" is the translated word for the key string, so the correct value string "delivery note" is extracted.

For example, as shown in FIG. 14, if the translation word selected by the translation word selection section 11H is not appropriate, the confirmation correction processing section 11K generates a character string that corrects the translated word after extracting the value character string. may be re-translated into the first language, and the character string obtained by the re-translation into the first language may be registered in the setting DB 151 as a similar word.

FIG. 14 is a front view showing another example of the confirmation/correction screen 60 according to this embodiment. The confirmation/correction screen 60 is a screen displayed on the operator terminal 40B for confirming/correcting the extraction results obtained by key-value extraction.

The confirmation/correction screen 60 shown in FIG. 14 includes a form image 61, a key value extraction result 62, and a correction button 63. In the example of FIG. 14, the English key string "Title" is translated into the unintended Japanese key string "Title", and as a result, "Manager" is erroneously extracted as the value string. At this time, when the correction button 63 is pressed by the user (for example, the person in charge of the work), the correction by the user (for example, the person in charge of the work) is accepted. In the example of FIG. 14, "Title" is modified to "Title" and "Manager" is modified to "Delivery Note." In this case, "heading" obtained by retranslating the corrected "title" into the first language is registered in the setting DB 151 as a similar word to the key character string. If "heading" has already been registered, you can simply overwrite it, or display a message such as "This has already been registered as a similar word" and let the user (for example, the person in charge of the work) may be notified.

Next, with reference to FIG. 15, the operation when the information processing apparatus 10 according to the present embodiment executes the key-value extraction process will be described.

FIG. 15 is a flowchart showing an example of the flow of key-value extraction processing by the information processing program 15A according to the present embodiment.

First, when the information processing device 10 is instructed to execute a key value extraction process, the information processing program 15A is activated by the CPU 11 and executes the following steps.

In step S111 in FIG. 15, the CPU 11 registers the form image obtained by reading the form document with the reading device 30 in the storage unit 15 as a subject to be checked and corrected. The form image is, for example, an image written in Japanese, as shown in FIG. 13 described above.

In step S112, the CPU 11 determines the language type of the form image registered in step S111. The type of language may be determined by a user (for example, a worker), or may be automatically determined using an existing language determination algorithm.

In step S113, the CPU 11 translates the key string into a second language (e.g. Japanese) and converts it into a plurality of languages in order to identify a string corresponding to the key string (e.g. "Title") from the form image. Generate translation candidates.

In step S114, the CPU 11 selects a translation word for the key string from among a plurality of translation candidates, using a first language string registered in advance as a similar word to the key string. Note that the selection of a translation word may be performed by a user (for example, a worker) by displaying a plurality of translation candidates on the worker terminal 40B, or may be selected automatically. When selecting automatically, the string in the first language registered as a similar word of the key string is translated into the second language to generate translated similar words, and each of the multiple translation candidates is matched with the translated similar word. An index value indicating the similarity of meaning between the words and the word is calculated, and the translation candidate with the highest index value is selected from among the plurality of translation candidates as the translated word of the key character string. Specifically, as an example, as shown in FIG. 12 described above, key translation candidates are generated, and a translated word of the key character string is selected from the generated key translation candidates.

In step S115, the CPU 11 performs key-value extraction on the form image using the translated word selected in step S114.

In step S116, the CPU 11 causes the operator terminal 40B to display a confirmation/correction screen 60 including the key value extraction results, as shown in FIG. 13 described above, for example.

In step S117, the CPU 11 determines whether the translated word included in the confirmation/correction screen 60 displayed on the worker terminal 40B is appropriate, that is, whether the correction button 63 on the confirmation/correction screen 60 has been pressed. If it is determined that the translated word is appropriate, that is, the correction button 63 has not been pressed (in the case of an affirmative determination), the process moves to step S118, and if it is determined that the translated word is not appropriate, that is, the correction button 63 has been pressed (in the case of a negative determination), the process moves to step S118. (in the case of determination), the process moves to step S119.

In step S118, the CPU 11 registers the key value extraction result that has been confirmed and corrected on the confirmation/correction screen 60 displayed on the worker terminal 40B in the extraction result DB 152, and ends the key value extraction process by the information processing program 15A. .

On the other hand, in step S119, the CPU 11, for example, as shown in FIG. Accepts corrections.

In step S120, the CPU 11 retranslates the translated word corrected in step S119 into the first language.

In step S121, the CPU 11 registers the character string retranslated in step S120 in the setting DB 151 as a similar word to the key character string, and proceeds to step S118. As an example, as shown in FIG. 14 above, "Title" is modified to "Title" and "Manager" is modified to "Delivery Note." In this case, "heading" obtained by retranslating the corrected "title" into the first language is registered in the setting DB 151 as a similar word to the key character string. If "heading" has already been registered, you can either overwrite it, or display a message such as "This has already been registered as a similar word" and let the user (for example, the person in charge of the work) may be notified.

As described above, according to the present embodiment, by registering similar words of the key string in advance and using them to specify the translated word of the key string, the intended translated word can be obtained and the correct value string can be obtained. It is possible to extract

Note that in each of the above embodiments, a processor refers to a processor in a broad sense, and includes a general-purpose processor (e.g., CPU: Central Processing Unit, etc.) and a dedicated processor (e.g., GPU: Graphics Processing Unit, ASIC: Application). (Specific Integrated Circuit, FPGA: Field Programmable Gate Array, Programmable Logic Device, etc.).

Further, the operation of the processor in each of the above embodiments may be performed not only by one processor, but also by a plurality of processors located at physically separate locations. Further, the order of each operation of the processor is not limited to the order described in each of the above embodiments, and may be changed as appropriate.

The information processing apparatus according to the embodiment has been described above as an example. The embodiment may be in the form of a program for causing a computer to execute the functions of each unit included in the information processing device. Embodiments may take the form of a computer readable non-transitory storage medium having these programs stored thereon.

In addition, the configuration of the information processing apparatus described in the above embodiments is merely an example, and may be changed according to the situation without departing from the spirit of the invention.

Furthermore, the process flow of the program described in the above embodiment is only an example, and unnecessary steps may be deleted, new steps may be added, or the processing order may be changed without departing from the main purpose. good.

Further, in the above embodiment, a case has been described in which the processing according to the embodiment is realized by a software configuration using a computer by executing a program, but the present invention is not limited to this. The embodiments may be realized by, for example, a hardware configuration or a combination of a hardware configuration and a software configuration.

10 Information processing device 11 CPU
11A Key setting section 11B Translation processing section 11C Translation result presentation section 11D Similar word registration section 11E Image registration section 11F Language determination section 11G Translation candidate generation section 11H Translation word selection section 11J Key value extraction section 11K Confirmation correction processing section 12 ROM
13 RAM
14 I/O
15 Storage unit 15A Information processing program 16 Display unit 17 Operation unit 18 Communication unit 30 Reading device 40A Administrator terminal 40B Operator terminal 50 Key setting screen 60 Confirmation/correction screen 100 Information processing system 151 Setting DB
152 Extraction result DB

Claims (10)

Equipped with a processor,
The processor includes:
Set a character string in the first language that corresponds to the character string specified from the image as a key character string,
translating the key string into a plurality of different second languages other than the first language;
retranslating each of the plurality of translated character strings obtained by translating into the plurality of different second languages into the first language,
If a plurality of retranslated character strings obtained by retranslating into the first language include a character string that does not match the key character string, the meaning is similar to the key character string. An information processing device that registers character strings in the first language as similar words. The information processing device according to claim 1, wherein the second language is a language written in the image. The processor displays character strings in the first language that are similar in meaning to the key character strings on the screen, and registers a character string selected by the user from among the displayed character strings as the similar word. The information processing device according to claim 1 or claim 2. The screen displays the plurality of retranslated character strings,
The information processing apparatus according to claim 3, wherein a display form of a character string that does not match the key character string is different from a display form of a character string that matches the key character string. The processor selects, among character strings in the first language that are similar in meaning to the key character string, character strings for which an index value indicating the closeness of meaning between the key character string and the key character string is equal to or greater than a threshold, as the similar word. The information processing device according to claim 1 or 2, wherein the information processing device is registered as: When identifying a character string corresponding to the key character string from the image when confirming and correcting the image, the processor translates the key character string into the second language and performs multiple translations. generate candidates,
A translated word for the key character string is selected from among the plurality of translation candidates using the character string in the first language registered as the similar word. The information processing device described. The processor translates the character string in the first language registered as the similar word into the second language to generate a translated similar word,
calculating an index value indicating the closeness of meaning between each of the plurality of translation candidates and the translated similar word;
The information processing device according to claim 6, wherein a translation candidate with the highest index value is selected as a translated word of the key character string from among the plurality of translation candidates. 7. The processor uses the selected translated word to identify a character string corresponding to the translated word from the image, and extracts character strings located around the identified character string as a value character string. The information processing device described in . If the selected translated word is not appropriate, the processor re-translates a character string in which the translated word is corrected into the first language after extracting the value character string, and obtains a result by re-translating the translated word into the first language. The information processing device according to claim 8, wherein the character string that has been entered is registered as the similar word. Set the key string of the first language that corresponds to the string specified from the image,
translating the key string into a plurality of different second languages other than the first language;
retranslating each of the plurality of translated character strings obtained by translating into the plurality of different second languages into the first language,
If a plurality of retranslated character strings obtained by retranslating into the first language include a character string that does not match the key character string, the meaning is similar to the key character string. Registering the character string in the first language as a similar word,
An information processing program that is executed by a computer.