JP2023157040A - Information processing system, information processing device, information processing method, and program - Google Patents

Abstract

To reduce the workload of inputting a document.SOLUTION: An information processing system includes: a selection acceptance unit that accepts selection of two or more first templates from among a plurality of the first templates related to a document including one or more items; an extraction unit that extracts an item included in a document related to each of the selected first templates; and a generation unit that generates a second template including the extracted item.SELECTED DRAWING: Figure 3

Description

The present invention relates to an information processing system, an information processing device, an information processing method, and a program.

Conventionally, various techniques have been studied to support form input work.

For example, Patent Document 1 discloses transferring the contents of a handwritten form to another form.

On the other hand, even if the purpose of the form is the same, the structure of the form (items making up the form, etc.) may differ depending on the destination (for example, local government, etc.). In this case, the person performing the form input work needs to input data into different forms for each submission destination.

With the technology disclosed in Patent Document 1, it is difficult to reduce such a workload.

The present invention has been made in view of the above points, and an object of the present invention is to reduce the workload of document input work.

Therefore, in order to solve the above problem, an information processing system includes a selection reception unit that accepts selection of two or more first templates from among a plurality of first templates regarding a document including one or more items; and a generating section that generates a second template that includes the extracted items.

The workload of document input work can be reduced.

1 is a diagram showing a configuration example of an information processing system 1 according to an embodiment of the present invention. 1 is a diagram showing an example of a hardware configuration of a form management server 10 in an embodiment of the present invention. 1 is a diagram showing an example of a functional configuration of an information processing system 1 according to an embodiment of the present invention. FIG. 2 is a sequence diagram for explaining an example of a processing procedure executed in the information processing system 1. FIG. FIG. 6 is a diagram illustrating a display example of a template generation screen. FIG. 6 is a diagram illustrating a display example of a template generation screen in a state where a template name has been input and a template has been selected. It is a figure which shows an example of a new template display screen. 12 is a flowchart for explaining an example of a processing procedure of a new template generation process. It is a figure which shows an example of the extraction result of item information. It is a figure which shows an example of the integration result of item information.

Embodiments of the present invention will be described below based on the drawings. FIG. 1 is a diagram showing a configuration example of an information processing system 1 according to an embodiment of the present invention. In FIG. 1, an information processing system 1 includes a form management server 10 and one or more user terminals 20. Each user terminal 20 is connected to the form management server 10 via a network such as a LAN (Local Area Network) or the Internet.

The form management server 10 is one or more computers that support generation of a form template that includes a plurality of existing forms. A form is a document that includes one or more items (input items, etc.). A form template is data that allows the user to understand the structure information of a form (information indicating what kind of items the form includes). Therefore, the form template may be data in any format as long as the structure of the form can be understood. In this embodiment, it is assumed that the form template is data in PDF format. The structure of a form can be extracted from PDF format data by character recognition (OCR (Optical Character Recognition)). Hereinafter, a form template will be simply referred to as a "template." The form management server 10 accepts registration of multiple types of templates in advance, and accepts selection of a template to be used for generating a new template (hereinafter referred to as "new template") from among the multiple types of templates. The form management server 10 generates a template that covers all items included in each selected template. By performing input using the generated new template, the user can perform input work on each form without being aware of the differences between the forms covered by the template. That is, by using the input results for the new template, each form covered by the new template can be generated.

The user terminal 20 is a terminal such as a PC (Personal Computer), a tablet terminal, or a smartphone, which is used for operations related to template registration in the form management server 10 and template generation. Note that the user who registers the template and the user who instructs generation of the template may be different.

FIG. 2 is a diagram showing an example of the hardware configuration of the form management server 10 in the embodiment of the present invention. The form management server 10 in FIG. 2 includes a drive device 100, an auxiliary storage device 102, a memory device 103, a CPU 104, an interface device 105, etc., which are connected to each other via a bus B.

A program that implements processing in the form management server 10 is provided by a recording medium 101 such as a CD-ROM. When the recording medium 101 storing the program is set in the drive device 100, the program is installed from the recording medium 101 to the auxiliary storage device 102 via the drive device 100. However, the program does not necessarily need to be installed from the recording medium 101, and may be downloaded from another computer via a network. The auxiliary storage device 102 stores installed programs as well as necessary files, data, and the like.

The memory device 103 reads the program from the auxiliary storage device 102 and stores it therein when there is an instruction to start the program. The CPU 104 executes functions related to the form management server 10 according to programs stored in the memory device 103. The interface device 105 is used as an interface for connecting to a network.

Note that the user terminal 20 may also have a hardware configuration as shown in FIG. 2.

FIG. 3 is a diagram showing an example of the functional configuration of the information processing system 1 according to the embodiment of the present invention. In FIG. 3 , the user terminal 20 includes an operation control section 21 . The operation control unit 21 is realized by a process that causes the CPU of the user terminal 20 to execute one or more programs (for example, a program as a web browser) installed on the user terminal 20 .

The operation control unit 21 displays information (screens, etc.) for interaction with the user, and receives input from the user. The operation control unit 21 transmits a request (template registration request or template generation request) to the form management server 10 in accordance with the input by the user.

The form management server 10 includes a registration section 11, a selection reception section 12, an extraction section 13, and a generation section 14. Each of these units is realized by one or more programs installed in the form management server 10 causing the CPU 104 to execute the process. The form management server 10 also uses the template storage section 15. The template storage unit 15 can be realized using, for example, the auxiliary storage device 102 or a storage device connectable to the form management server 10 via a network.

In response to a template registration request from the user terminal 20, the registration unit 11 stores (registers) the template included in the registration request in the template storage unit 15.

The template storage unit 15 stores a plurality of registered templates.

The selection accepting unit 12 executes a process for accepting the selection of two or more templates from which a new template will be generated from among the plurality of templates stored in the template storage unit 15.

The extraction unit 13 extracts items from each of the two or more selected templates.

The generation unit 14 generates a new template including the items extracted by the extraction unit 13.

The processing procedure executed in the information processing system 1 will be described below. FIG. 4 is a sequence diagram for explaining an example of a processing procedure executed in the information processing system 1.

In step S101, the operation control unit 21 of the user terminal 20 transmits a template registration request to the form management server 10 in response to the user's operation. The registration request includes a template to be registered. Upon receiving the registration request, the registration unit 11 of the form management server 10 registers (saves) the template included in the registration request in the template storage unit 15 (S102). The template storage unit 15 stores each registered template in association with identification information (hereinafter referred to as "template ID"). The template ID may be the file name of the file that stores the template.

Note that steps S101 and S102 are executed multiple times before step S103 and subsequent steps are executed, and steps S103 and subsequent steps are executed at an arbitrary timing thereafter. The user terminal 20 related to step S103 and subsequent steps and the user terminal 20 related to step S101 may be the same or different.

In step S103, the operation control unit 21 of the user terminal 20 transmits a template generation screen acquisition request to the form management server 10 in response to the user's operation. In response to the acquisition request, the selection reception unit 12 of the form management server 10 can input a new template generation instruction by selecting one of the templates from the list of templates stored in the template storage unit 15. Screen data for a screen (hereinafter referred to as "template generation screen") is generated. The selection reception unit 12 transmits the screen data to the user terminal 20 (S104). Upon receiving the screen data, the operation control unit 21 of the user terminal 20 displays a template generation screen based on the screen data (S105).

FIG. 5 is a diagram showing a display example of the template generation screen. In FIG. 5, a template generation screen 510 includes an area 511 and an area 512.

The area 511 is an area for receiving input of the name of a new template (template name). For example, when area 511 is clicked, operation control unit 21 displays a screen for accepting input of a template name. When a template name is input to the screen, the operation control unit 21 displays the input template name in the area 511.

Area 512 is an area for accepting selection of a template from which a new template will be generated. That is, in the area 512, a check box is arranged next to the template name for each existing template stored in the template storage unit 15. Note that when any template name in the area 512 is selected, the operation control unit 21 may display the template related to the template name.

FIG. 6 is a diagram illustrating a display example of a template generation screen in a state where a template name has been input and a template has been selected. FIG. 6 shows a state in which "accident report" is input as the template name in area 511 and two templates are selected in area 512. When the input necessary to generate a new template is performed, a template generation button 513 is displayed.

When the user presses the template generation button 513, the operation control unit 21 transmits a template generation request to the form management server 10 (S106). The generation request includes the template name input in area 511 of template generation screen 510 and the template ID of each template selected in area 512 (hereinafter referred to as "selected template").

Upon receiving the generation request, the form management server 10 executes a new template generation process (S107). As a result, a new template that includes the plurality of selected templates (covers the items of the plurality of templates) is generated.

Subsequently, the form management server 10 generates screen data for a screen that displays the generated new template (hereinafter referred to as "new template display screen"), and transmits the screen data to the user terminal 20 (S108).

Upon receiving the screen data, the operation control unit 21 of the user terminal 20 displays a new template display screen based on the screen data (S109).

FIG. 7 is a diagram showing an example of a new template display screen. The new template display screen 530 in FIG. 7 includes an area 531, an area 532, and the like. In area 531, the template name of the new template is displayed. In area 532, each item of the new template is displayed. Note that in the area 532 of FIG. 7, only the upper part of the new template is shown for convenience.

Next, details of step S107 will be explained. FIG. 8 is a flowchart illustrating an example of a procedure for generating a new template.

In step S201, the extraction unit 13 acquires a plurality of selected templates related to a plurality of template IDs included in the new template generation request from the template storage unit 15.

Next, the extraction unit 13 performs OCR processing on each of the plurality of selection templates, and extracts information regarding each item (hereinafter referred to as "item information") included in each selection template into each selection template. (S202).

FIG. 9 is a diagram illustrating an example of the extraction results of item information. In FIG. 9, (1) and (2) each show an example of item information extracted from one selection template. As shown in FIG. 9, the item information of each item includes parameters such as id, name, type, and option.

The id is identification information for each item within one template, and is assigned to each item when item information is extracted. name is a character string indicating the name of the item (item name), and is extracted by OCR for the template. The type is the data type of the input value for the item (hereinafter referred to as "item type"). That is, type is a parameter indicating what type of item is input. The value of type is one of textInput, date, spinner, and addPicture. textInput indicates a text type. Text type means that any text (character string) is used as an input value. date is indicated as date type. Date type means that the input value is a character string in date format. spinner indicates a selection type. The selection type means that one of a plurality of options prepared in advance is used as an input value. addPicture indicates a photo addition type. The photo addition type means an area where photos are added (attached).

Option is option information extracted for an item whose type is spinner or addPicture. The option of the item whose type is spinner is a list (enumeration) of character strings corresponding to the options. The option of the item whose type is addPicture indicates the number of photos to be added.

Next, the extraction unit 13 determines whether there is an item that is duplicated across a plurality of selected templates (hereinafter referred to as "overlapping item") based on each item information extracted from each selected template. (S203). In the example of FIG. 9, it is determined whether there is a duplicate item between (1) and (2). Whether or not there are duplicates is determined based on, for example, whether there is item information with the same name and type. In the example of FIG. 9, the item whose id is "item ID_2" in (1) and the item whose id is "item ID_2" in (2) overlap. That is, an item whose name is "item name (b)" and whose type is "spinner" is a duplicate item.

If there are no duplicate items (No in S203), the process advances to step S207. If there are one or more duplicate items (Yes in S203), the extraction unit 13 determines whether there is a selection type (type=spinner) item among the one or more duplicate items (S204). If there is no selection type item among the one or more duplicate items (No in S204), the process advances to step S206. If there is a selection type item among the one or more duplicate items (Yes in S204), the extraction unit 13 selects an option that satisfies the AND condition from among the options of each selection type item that has an overlapping relationship. It is extracted as an option (S205). Extracting each item as an option means, in FIG. 9, rewriting the option value of two items of item information that have an overlapping relationship with the extracted option. Further, an option that satisfies the AND condition refers to an option that is common to all items that have an overlapping relationship. In the example of FIG. 9, the options for the duplicate item in (1) are option (x), option (y), and option (z), and the options for the duplicate item in (2) are option (x). ), option (y). Therefore, in this case, option (x) and option (y) are extracted, and option (z) is discarded. If there is an option to be discarded (an option that does not satisfy the AND condition), the extraction unit 13 adds "Others" as an option for the duplicate item. As a result, in the example of FIG. 9, the option of the duplicate item in (1) and the option of the duplicate item in (2) are respectively rewritten to {choice (x), choice (y), others}.

Note that by extracting only the options that satisfy the AND condition, when outputting a form related to any of the selected templates that are the generation source of the new template from the input results for the new template, there is no option corresponding to the form. This situation can be avoided. For example, if option (z) is included in a new template and option (z) is selected in the input to the new template, if you try to output the form in Figure 9 (2) from the input result, the corresponding Since the option (z) does not exist in the form, the form cannot be output correctly. However, for example, if the new template is not used for this purpose, options that satisfy the OR condition may be extracted. Satisfying the OR condition means that at least one of the overlapping items is an option.

Following step S205, the process advances to step S206.

In step S206, the extraction unit 13 eliminates duplication of items (S206). Removal of item duplication means that among all the extracted item information, for duplicate items, only one item information is left and the other item information is deleted. In the example of FIG. 9, for example, item information of the duplicate item in (2) is deleted while (1) is left as is. However, the item information of the duplicate item in (1) may be deleted while leaving (2) as is.

Following step 206, the process advances to step S207.

In step S207, the extraction unit 13 integrates all item information remaining at the present time. Here, for the item information updated in step S205 or S206, the updated item information is integrated.

FIG. 10 is a diagram illustrating an example of the result of integrating item information. As shown in FIG. 10, the integration result includes items extracted from at least one selection template and has no duplicate items.

Subsequently, the generation unit 14 generates a template including items related to all the item information after integration as a new template, and registers the new template in the template storage unit 15 (S208). Therefore, a new template is generated such that it includes the item extracted from at least one selection template (that is, the items of all selection templates are covered), and there is no duplication of items. By doing so, when outputting a form related to one of the selected templates from which the new template is generated based on the input results for the new template, you can avoid situations where values are not entered for the items included in the form. can do.

As described above, according to this embodiment, a new template is generated from items of a plurality of existing templates. By using the new template, the user can input information into the plurality of existing templates. As a result, the purpose is to reduce the workload of document input work.

Note that this embodiment may be applied to documents that are not called "forms" in the real world. That is, the present embodiment may be applied to a document having input items.

Note that the form management server 10 includes, for example, a PJ (Projector), an IWB (Interactive White Board: a white board with an electronic blackboard function that allows mutual communication), an output device such as a digital signage, and a HUD (Head Up Display). ) equipment, industrial machinery, imaging devices, sound collection devices, medical equipment, network home appliances, notebook PCs (Personal Computers), mobile phones, smartphones, tablet terminals, game consoles, PDAs (Personal Digital Assistants), digital cameras, wearable PCs, or It may be a desktop PC or the like.

Additionally, the devices described in the Examples are merely illustrative of one of multiple computing environments for implementing the embodiments disclosed herein.

In some embodiments, form management server 10 includes multiple computing devices, such as a server cluster. The plurality of computing devices are configured to communicate with each other via any type of communication link, including a network, shared memory, etc., to perform the processes disclosed herein. Similarly, user terminal 20 may include multiple computing devices configured to communicate with each other.

Further, each element of the form management server 10 and the user terminal 20 may be combined into one server device, or may be divided into multiple devices.

Moreover, each function of the embodiment described above can be realized by one or more processing circuits. Here, the term "processing circuit" as used herein refers to a processor programmed to execute each function by software, such as a processor implemented by an electronic circuit, or a processor designed to execute each function explained above. This includes devices such as ASICs (Application Specific Integrated Circuits), DSPs (digital signal processors), FPGAs (field programmable gate arrays), and conventional circuit modules.

Further, the integration result illustrated in FIG. 10 of this embodiment may be generated by the learning effect of machine learning. In this case, a model may be generated using machine learning that inputs the extraction results of item information as exemplified in FIG. 9 and outputs the integrated results.

Here, machine learning is a technology that allows computers to acquire human-like learning abilities, and computers autonomously generate algorithms necessary for judgments such as data identification from learning data that has been captured in advance. It refers to a technology that applies this to new data to make predictions. The learning method for machine learning may be supervised learning, unsupervised learning, semi-supervised learning, reinforcement learning, or deep learning, or it may be a learning method that combines these learning methods. It doesn't matter what learning method you use.

Note that in this embodiment, the form management server 10 is an example of an information processing device.

Although the embodiments of the present invention have been described in detail above, the present invention is not limited to these specific embodiments, and various modifications may be made within the scope of the gist of the present invention as described in the claims. It is possible to transform and change.

1 Information processing system 10 Form management server 11 Registration unit 12 Selection reception unit 13 Extraction unit 14 Generation unit 15 Template storage unit 20 User terminal 21 Operation control unit 100 Drive device 101 Recording medium 102 Auxiliary storage device 103 Memory device 104 CPU
105 Interface device B bus

JP 2021-051723 Publication

Claims (8)

a selection reception unit that accepts selection of two or more first templates from among a plurality of first templates regarding documents including one or more items;
an extraction unit that extracts items included in the document related to the selected first template;
a generation unit that generates a second template including the extracted items;
An information processing system comprising: The extraction unit extracts items included in the document according to the selected first template by character recognition for the selected first template.
The information processing system according to claim 1, characterized in that: The extraction unit eliminates duplication when any of the extracted items is duplicated.
The information processing system according to claim 1 or 2, characterized in that: The extraction unit also extracts information indicating whether the item is an item for inputting text, options, or dates;
The information processing system according to claim 1, characterized in that: The extraction unit extracts a common option among all the duplicated items, when the items for inputting options are duplicated in two or more of the selected first templates.
5. The information processing system according to claim 4. a selection reception unit that accepts selection of two or more first templates from among a plurality of first templates regarding documents including one or more items;
an extraction unit that extracts items included in the document related to the selected first template;
a generation unit that generates a second template including the extracted items;
An information processing device comprising: a selection acceptance procedure for accepting selection of two or more first templates from among a plurality of first templates regarding documents including one or more items;
an extraction procedure for extracting items included in a document related to the selected first template;
a generation procedure for generating a second template including the extracted item;
An information processing method characterized by being executed by a computer. a selection acceptance procedure for accepting selection of two or more first templates from among a plurality of first templates regarding documents including one or more items;
an extraction procedure for extracting items included in a document related to the selected first template;
a generation procedure for generating a second template including the extracted item;
A program that causes a computer to execute.

Images