JP2020204959A - Information processing system, information processing method, and information processing apparatus - Google Patents

Abstract

To provide an information processing apparatus that easily registers or changes a rule as to what type of processing is executed depending on the presence or absence of marks.SOLUTION: An information processing system 100 has an information processing apparatus 20 that determines the presence or absence of marks in check columns arranged in document data and compares a result of determination with a rule to execute processing, and a terminal device 40 that communicates with the information processing apparatus. The information processing apparatus has an image processing unit 27 that generates area information on the positions of the check columns from a template image of document data transmitted from a device, and a communication unit 22 that transmits, to the terminal device, the template image in which the check columns are presented based on the area information generated by the image processing unit. The terminal device has a display control unit 42 that displays the template image received from the information processing apparatus and displays entry fields for identification information on the check columns, entry fields for the presence or absence of marks, and entry fields for processing.SELECTED DRAWING: Figure 2

Description

The present invention relates to an information processing system, an information processing method, and an information processing device.

An OMR (optical mark reader) technique for detecting the presence or absence of a mark on a check frame of a document read by a scanning device such as a scanner is known. In addition, using this OMR technology, the information processing system automatically determines which check frame of a document such as a form is marked, and determines the subsequent processing of the document according to the marked check frame. Are known.

For example, a technique for automating the processing when a form related to an order is received has been devised (see, for example, Patent Document 1). Patent Document 1 discloses a system that automatically generates purchase order data from supplier data associated with input purchase order data in order to automatically generate purchase orders.

However, in the conventional technique, there is a problem that it is not easy to register or change the rule of what kind of processing is executed depending on the presence or absence of the mark. That is, in an information processing system using OMR technology, it is necessary to have a rule (rule) on what kind of processing is executed when a check frame is marked or not, but conventionally, only those who have skills such as customer engineers are required. The rule could not be registered or changed. As a customer, the rules could not be easily customized, and the labor cost of the customer engineer increased.

In view of the above problems, an object of the present invention is to provide an information processing system in which it is easy to register or change a rule as to what kind of processing is executed depending on the presence or absence of a mark.

In view of the above problems, the present invention communicates with an information processing device that determines the presence or absence of a mark on a check frame arranged in document data, compares the determination result with a rule, and executes processing, and the information processing device. An information processing system that has a terminal device
The information processing device has an image processing unit that generates area information regarding the position of the check frame from a template image of the document data transmitted from the device, and the check frame based on the area information generated by the image processing unit. Has a communication unit that transmits the template image presented to the terminal device.
The terminal device displays the template image received from the information processing device, and displays an input field for identification information of the check frame, an input field for presence / absence of a mark, and an input field for processing. It is characterized by having an input field for identification information of the check frame, an input field for the presence or absence of a mark, and an operation reception unit that accepts input to the input field for processing as the rule.

It is possible to provide an information processing system in which it is easy to register or change a rule as to what kind of processing is executed depending on the presence or absence of a mark.

It is a figure explaining the rule of what kind of processing is executed with respect to the presence / absence of a check frame mark in a form. This is an example of a system configuration diagram of an information processing system. This is an example of a hardware configuration diagram of an information processing device. This is an example of a hardware configuration diagram of a device. This is an example of a functional block diagram showing the functions of the device, the information processing device, and the terminal device in a block shape. It is a figure which shows typically the registration method of a template. This is an example of a sequence diagram showing a procedure in which an information processing system registers a template. It is a figure which shows an example of the screen which is displayed on the display of a terminal apparatus at the time of registration of the rule of OMR document processing. This is an example of a sequence diagram showing the procedure of the registration method by the selection formula of the rules of OMR document processing. This is an example of a template image with a recognition result displayed on the display of the terminal device when the rule of OMR document processing is registered. It is a figure which shows an example of the rule registration screen of OMR document processing. It is an example of a sequence diagram showing the procedure of the registration method by the template image of the rule of OMR document processing + the selection formula. This is an example of the spreadsheet rule registration screen displayed on the display of the terminal device when the rule of OMR document processing using the spreadsheet file formula is registered. This is an example of a sequence diagram showing a procedure of a registration method using a spreadsheet file formula of rules for OMR document processing. This is an example of a sequence diagram showing the processing performed by the information processing system in which the document data is input. It is an example of the block diagram of CNN. It is a figure explaining the input data and the teacher signal when a learning part learns a parameter of CNN.

Hereinafter, as an example of the embodiment for carrying out the present invention, the information processing system and the information processing method performed by the information processing system will be described with reference to the drawings.

<Example of rules>
First, the rules for registration or change by the administrator will be described with reference to FIG. FIG. 1 is a diagram for explaining a rule of what kind of processing is executed for the presence or absence of a check frame mark in a form. FIG. 1A shows a part of document data such as a form received by the device by FAX, and shows that there are four check frames 9 that can be marked. The numbers (1 to 4) of the check frame 9 are for explanation purposes only and are not described in the document data. The information processing system can detect the presence or absence of a mark for each check frame 9.

1 (b) and 1 (c) show an example of a rule. A rule is a combination of conditions and processing. The rule of FIG. 1B is as follows.
Condition: FAX sender is company A & NG is marked in all check boxes 9 Process: Email to XXX (correct the candidate date and place a reorder)
The rule of FIG. 1 (c) is as follows.
Condition: FAX source is company A & one or more check frames 9 of OK are processed: Determined by the date and time of the first item, information is registered in the production management system, and a formal order request is made to the sender company. The form can facilitate the registration or modification of such rules. Specifically, as will be described later, since a user interface for registering or changing rules is provided, the customer administrator can easily register or change rules. In the following, such a rule will be referred to as an "OMR document processing rule".

<Terminology>
A mark is a mark indicating that a selection has been made, and marking means giving a mark. The method of marking the check frame 9 may vary depending on the user. The color of the mark is generally black, but any color may be used. The shape of the mark may be, for example, a shape in which the check frame 9 is filled in, a handwritten check mark, a circle, or a cross.

The check frame 9 is a frame formed so that the user can easily mark it. The check frame 9 may be called a check box, a frame, a frame, a mark column, or the like.

Rule registration means that the administrator registers a new rule. If only one rule can be registered, the rule registration is a change of the already registered rule. In addition, registering or changing rules on the customer side may be called customization.

A rule is information that defines what kind of processing should be performed under what conditions. It may be called a rule or rule.

The administrator is a system administrator who manages the information processing system on the customer side, and the user is a general user who uses the information processing system. However, the user may also serve as the administrator.

A template is a pattern, format, format, etc. for which a format has been set, and refers to standard data before individual values are input.

Presenting a check frame means showing at least in a form that shows where the check frame is. Further, identification information may be described.

<System configuration example>
FIG. 2 is an example of a system configuration diagram of the information processing system 100. The information processing system 100 includes one or more devices 10, an information processing device 20, and a terminal device 40 that are communicably connected via a communication network N.

The communication network N may include a LAN (Local Area Network) of the facility where the device 10 is arranged, a WAN connected by a wide area Ethernet (registered trademark), a VPN (Virtual Private Network), the Internet, and the like. In addition, a communication network N can be configured as long as it is a communicable mechanism.

The device 10 is a device that accepts input of document data having a check frame 9, and is a device used for registering a template of document data. The document data is image data that is optically read. The document data template is a document that serves as a template to be read by the device 10 because the administrator registers the check frame 9 in the information processing device 20 in the document data.

As a method of accepting the input of the document data by the device 10, there are a method of receiving the document data from the outside and a method of generating the document data by reading the document by the device 10. Therefore, the device 10 may be a fax machine or a scanner device that reads a document. When receiving document data, it is not limited to FAX, and may be received via a communication network.

Therefore, the device 10 may be a multifunction device having a fax function and a scanner function, or may exist as separate devices for the fax device and the scanner device. A multifunction device is a device having a plurality of functions such as a printing function, a fax function, a scanner function, and a copying function. The multifunction device is sometimes called an MFP (Multi-Function Peripheral). The device 10 transmits the input document data and the image data of the template to the information processing device 20 via the communication network N.

When the rule is registered or changed, the information processing device 20 receives the template from the device 10 and transmits the image data of the template to the terminal device 40 by e-mail or the like. A check frame is specified in this template, and the administrator can register or change the rule while checking the check frame of the template.

Further, when the rule is executed, the information processing device 20 acquires document data from at least one device 10. The information processing apparatus 20 detects the check frame 9 from the document data using the template, and determines whether or not each check frame 9 is marked. Further, the information processing apparatus 20 compares the presence / absence of the mark for each check frame 9 with the rule, and determines the process to be executed.

The information processing device 20 is a computer system such as a server device, a PC (Personal Computer), and a workstation. Further, the information processing device 20 may be compatible with cloud computing. Cloud computing refers to a usage pattern in which resources on a communication network are used without being aware of specific hardware resources.

Although there is only one information processing device 20 in FIG. 2, a plurality of information processing devices 20 may exist. For example, it may be divided into an information processing device 20 on the customer side, an information processing device 20 that recognizes a check frame using OMR, and an information processing device 20 that executes processing. Alternatively, a plurality of these information processing devices 20 may exist. As described above, the information processing device 20 is often composed of one or more information processing devices 20. Note that there are a plurality of processes registered in the rule, and executing the series of processes in order is called a workflow, and a system that executes the workflow is called a workflow system. Therefore, the information processing device 20 may have a workflow system or may cooperate with the workflow system.

The terminal device 40 is used for the administrator to register or change the rules in the information processing device 20 when the administrator operates and communicates with the information processing device 20. The browser software operates on the terminal device 40 and displays a screen (user interface) based on the screen information received from the information processing device 20. The screen information is described by, for example, HTML, XML, JSON, JavaScript (registered trademark), CSS (Cascade Style Sheet), etc. If it is a general browser software, the screen information is analyzed and a Web page is displayed. it can. This web page is the user interface. A script language is included in the Web page, and by executing this script language, various processes can be performed on the browser, and communication with the information processing device 20 and the processing result by the information processing device 20 are used. The mechanism for doing this is called a web application.

The terminal device 40 may be a computer on which the browser software operates. For example, PCs, smartphones, tablet terminals, PDAs (Personal Digital Assistants), wearable PCs, mobile phones, game machines, and the like. Further, the device 10 may also serve as the terminal device 40. An application for an information processing system may operate instead of browser software.

<Hardware configuration example>
<< Information processing device, terminal device >>
FIG. 3 is a hardware configuration diagram of the information processing device 20. As shown in FIG. 3, the information processing apparatus 20 is constructed by a computer, and as shown in FIG. 3, the CPU 501, ROM 502, RAM 503, HD 504, HDD (Hard Disk Drive) controller 505, It is equipped with a display 506, an external device connection I / F (Interface) 508, a network I / F 509, a data bus 510, a keyboard 511, a pointing device 512, a DVD-RW (Digital Versatile Disk Rewritable) drive 514, and a media I / F 516. ..

Of these, the CPU 501 controls the operation of the entire information processing device 20. The ROM 502 stores a program used to drive the CPU 501 such as an IPL. The RAM 503 is used as a work area of the CPU 501. The HD504 stores various data such as programs. The HDD controller 505 controls reading or writing of various data to the HD 504 according to the control of the CPU 501. The display 506 displays various information such as cursors, menus, windows, characters, or images. The external device connection I / F 508 is an interface for connecting various external devices. The external device in this case is, for example, a USB (Universal Serial Bus) memory, a printer, or the like. The network I / F 509 is an interface for performing data communication using a communication network. The data bus 510 is an address bus, a data bus, or the like for electrically connecting each component such as the CPU 501 shown in FIG.

Further, the keyboard 511 is a kind of input means including a plurality of keys for inputting characters, numerical values, various instructions and the like. The pointing device 512 is a kind of input means for selecting and executing various instructions, selecting a processing target, moving a cursor, and the like. The DVD-RW drive 514 controls reading or writing of various data to the DVD-RW 513 as an example of the removable recording medium. In addition, it is not limited to DVD-RW, and may be DVD-R or the like. The media I / F 516 controls reading or writing (storage) of data to a recording medium 515 such as a flash memory.

The hardware configuration of the terminal device 40 is the same as that of the information processing device 20, but even if there is a difference, there is no problem in the description of the present embodiment.

<< Equipment >>
FIG. 4 is a hardware configuration diagram of the device 10. As shown in FIG. 4, the device 10 includes a controller 910, a short-range communication circuit 920, an engine control unit 930, an operation panel 940, and a network I / F 950.

Of these, the controller 910 is a CPU 901, a system memory (MEM-P) 902, a north bridge (NB) 903, a south bridge (SB) 904, an ASIC (Application Specific Integrated Circuit) 906, and a storage unit, which are the main parts of the computer. It has a local memory (MEM-C) 907, an HDD controller 908, and a storage unit HD909, and has a configuration in which the NB 903 and the ASIC 906 are connected by an AGP (Accelerated Graphics Port) bus 921.

Of these, the CPU 901 is a control unit that controls the entire device 10. The NB903 is a bridge for connecting the CPU 901, the MEM-P902, the SB904, and the AGP bus 921, and includes a memory controller that controls reading and writing to the MEM-P902, a PCI (Peripheral Component Interconnect) master, and an AGP target. Has.

The MEM-P902 includes a ROM 902a that is a memory for storing programs and data that realizes each function of the controller 910, and a RAM 902b that is used as a memory for developing programs and data and for drawing in memory printing. The program stored in the RAM 902b is configured to be provided by recording a file in an installable format or an executable format on a computer-readable recording medium such as a CD-ROM, CD-R, or DVD. You may.

The SB904 is a bridge for connecting the NB903 to a PCI device and peripheral devices. The ASIC 906 is an IC (Integrated Circuit) for image processing applications having hardware elements for image processing, and has a role of a bridge connecting the AGP bus 921, the PCI bus 922, the HDD 908, and the MEM-C907, respectively. The ASIC906 is a PCI target and an AGP master, an arbiter (ARB) that forms the core of the ASIC906, a memory controller that controls the MEM-C907, and a plurality of DMACs (Direct Memory Access Controllers) that rotate image data by hardware logic. , And a PCI unit that transfers data between the scanner unit 931 and the printer unit 932 via the PCI bus 922. A USB (Universal Serial Bus) interface or an IEEE 1394 (Institute of Electrical and Electronics Engineers 1394) interface may be connected to the ASIC 906.

The MEM-C907 is a local memory used as a copy image buffer and a code buffer. The HD909 is a storage for accumulating image data, accumulating font data used at the time of printing, and accumulating forms. The HD909 controls reading or writing of data to the HD909 according to the control of the CPU 901. The AGP bus 921 is a bus interface for a graphics accelerator card proposed to speed up graphics processing, and the graphics accelerator card can be speeded up by directly accessing the MEM-P902 with high throughput. ..

Further, the short-range communication circuit 920 is provided with an antenna 920a of the short-range communication circuit. The short-range communication circuit 920 is a communication circuit such as NFC or Bluetooth (registered trademark).

Further, the engine control unit 930 is composed of a scanner unit 931 and a printer unit 932. Further, the operation panel 940 displays the current setting value, the selection screen, and the like, and displays the panel display unit 940a such as a touch panel that receives the input from the operator, and the setting value of the image formation condition such as the density setting condition. It is provided with an operation panel 940 including a numeric keypad for receiving and a start key for receiving a copy start instruction. The controller 910 controls the entire device 10, for example, drawing, communication, input from the operation panel 940, and the like. The scanner unit 931 or the printer unit 932 includes an image processing unit 27 minutes such as error diffusion and gamma conversion.

The device 10 can be selected by sequentially switching the document box function, the copy function, the printer function, and the FAX function by using the application switching key on the operation panel 940. When the document box function is selected, the document box mode is set, when the copy function is selected, the copy mode is set, when the printer function is selected, the printer mode is set, and when the fax mode is selected, the fax mode is set.

Further, the network I / F950 is an interface for performing data communication using a communication network. The short-range communication circuit 920 and the network I / F 950 are electrically connected to the ASIC 906 via the PCI bus 922.

<About functions>
FIG. 5 is an example of a functional block diagram showing the functions of the device 10, the information processing device 20, and the terminal device 40 in a block shape.

<< Equipment >>
The device 10 includes a document data receiving unit 11, a communication unit 12, a display control unit 13, an operation receiving unit 14, and a reading unit 15. These functions possessed by the device 10 are functions or means realized by the CPU 901 of the device 10 shown in FIG. 4 executing a program developed from the HD 909 to the RAM 902 b and controlling the hardware of the device 10.

The document data receiving unit 11 receives document data from a fax line or the like. It is assumed that a check frame 9 marked by the user is arranged for each item in this document data. The device 10 can also acquire the document data generated by the reading unit 15 reading the document.

The communication unit 12 transmits and receives various information to and from the information processing device 20 via the communication network N. In the present embodiment, the document data and the image data of the template are transmitted to the information processing device 20.

The display control unit 13 displays various screens on the operation panel 940. For example, a screen for registering a template is displayed, or a general setting screen such as copy setting and scan setting is displayed. It also displays a GUI (Graphical User Interface) for accepting workflow execution.

The operation reception unit 14 receives an operation input from the administrator. The operation reception unit 14 receives inputs from the touch panel and various operation buttons as an example.

The operation reception unit 14 and the display control unit 13 may be realized by browser software. In this case, the information processing device 20 generates screen information of the Web page and provides it to the device 10.

The scanning unit 15 reads a document set in a contact glass or an ADF (Auto Document Feeder) and generates image data. In this embodiment, template image data is generated.

<< Information processing device >>
The information processing device 20 includes an authentication unit 21, a communication unit 22, a device management unit 23, an email notification unit 24, a screen information generation unit 25, a rule control unit 26, an image processing unit 27, a learning unit 28, a determination unit 29, and the like. It has a data storage unit 30. These functions of the information processing device 20 are realized by the CPU 501 of the information processing device 20 shown in FIG. 3 executing a program expanded from the HD 504 to the RAM 503 and controlling the hardware of the information processing device 20. A function or means.

The authentication unit 21 authenticates the administrator and returns an authentication result (authentication success, authentication failure). There is a method for authentication based on whether or not a combination of a user name and a password transmitted from the device 10 or the terminal device 40 is registered in the information processing device 20. In addition, there is a method based on whether or not the card number of the IC card, biometric authentication information, and the like are registered. Information for authentication such as user name and password is called authentication information. The information processing device 20 does not have to have the authentication unit 21, and may request authentication from an external server.

In addition, the authentication unit 21 authenticates the device 10. For example, in the authentication of the device 10, whether or not the identification information unique to the device 10 is exchanged and held in advance between the information processing device 20 and the device 10 and the identification information transmitted by the device 10 matches the one held. There is a method based on information processing. The method of authenticating the device 10 is not limited to this, and any method may be adopted.

The communication unit 22 transmits and receives various information to and from the device 10 and the terminal device 40. In the present embodiment, the document data and the image data of the template are received from the device 10, and the screen information is transmitted to the terminal device 40. In addition, the registration or change of the rule is received from the terminal device 40.

The device management unit 23 manages information about the device. The device 10 is an example of this device. The device management unit holds customer information such as a customer ID in association with the identification information of the device 10. In cloud services, customers are referred to as tenants. Therefore, when the identification information of the device 10 is specified by the authentication unit 21, the device management unit 23 can refer to the information regarding the tenant.

The mail notification unit 24 specifies a destination with an mail address and requests the mail server to send an e-mail. In the present embodiment, the image data of the template is attached to an e-mail and transmitted to the administrator who registers or changes the rules of OMR document processing.

The screen information generation unit 25 has a function of a Web server that generates screen information of a screen to be displayed by browser software. With this screen information, the administrator can register or change the rules of OMR document processing from the screen. In the present embodiment, for convenience of explanation, the rule control unit 26 generates screen information, but the rule control unit 26 calls the screen information generation unit 25 to generate various screen information.

The rule control unit 26 performs processing related to registration or change of rules for OMR document processing. Further, the rule control unit 26 holds the rules for OMR document processing, and determines the processing to be executed according to the determination result of the check frame by the determination unit 29. It also controls the execution of this process. The series of functions of the rule control unit 26 are provided by the OMR application, but the relationship between the functions and the application is only an example.

The image processing unit 27 detects the check frame from the image data of the template and generates area information indicating the position of the check frame 9. In addition, the image processing unit 27 trims the position of the check frame 9 from the document data based on the area information.

The learning unit 28 learns the correspondence between the shape of the mark and whether or not it is marked, based on the marks of various shapes with respect to the check frame 9 and the teacher signal of whether or not the check frame 9 is marked. Various machine learning should be used for learning. A classification model is generated by the learning unit 28, and when the image data of the check frame 9 is input to this classification model, with or without a mark is output. In this classification model, the determination unit 29 outputs with or without a mark for each check frame 9. An example of the learning method of the classification model will be described with reference to FIGS. 16 and 17.

The data storage unit 30 stores template image data, document data, area information, and the like. The data storage unit 30 does not have to be included in the information processing device 20, and may be on a communication network that the information processing device 20 can access.

<< Terminal equipment >>
The terminal device 40 has a communication unit 41, a display control unit 42, and an operation reception unit 43. These functions possessed by the terminal device 40 are functions or means realized by the CPU 501 of the terminal device 40 shown in FIG. 3 executing a program expanded from the HD 504 to the RAM 503 and controlling the hardware of the terminal device 40. Is.

The communication unit 41 transmits and receives various information to and from the information processing device 20 via the communication network N. In the present embodiment, screen information is received from the information processing device 20, and rules for OMR document processing are transmitted to the information processing device 20.

The display control unit 42 displays various screens on the display 506. For example, a screen for registering or changing the rules of OMR document processing is displayed. The screen may be a Web page or may be displayed by a predetermined application software.

The operation reception unit 43 receives an operation input from the administrator. As an example, the operation reception unit 43 receives operation input using a mouse, a keyboard, a touch panel, or the like.

The operation reception unit 43 and the display control unit 42 may be realized by browser software. In this case, the information processing device 20 generates screen information of the Web page and provides it to the device 10.

<Registration of template>
Next, the registration of the template will be described with reference to FIG. FIG. 6 is a diagram schematically showing a template registration method.

(1) As shown in FIG. 6, the template 401 may be a black-and-white image in which the check frame 9 is filled in red. As a result, the information processing apparatus 20 can easily detect that the red region is the check frame 9. The reading unit 15 of the device 10 reads the template 401 and generates the image data 402 of the template. The check frame 9 may be filled with a chromatic color other than red.

(2) The image processing unit 27 of the information processing apparatus 20 detects a red area from the image data 402 of the template and records the area information 403 for each check frame 9. Since the colors other than the check frame 9 are achromatic white or black, the check frame 9 can be easily detected. The area information 403 is the identification information 405 of each check frame 9 and the position information (coordinates) of each check frame 9. The identification information 405 is given in order so that the position of the check frame 9 increases from the upper left to the lower right. The area information 403 is recorded in JSON, XML, or the like.

(3) The mail notification unit 24 of the information processing device 20 transmits the image data of the template in which the identification information 405 is described for each check frame 9 by mail. The destination is an administrator who registers or changes the rules for OMR document processing.

In FIG. 6, the identification information 405 of 1 to 4 is described in the check frame 9. The position where the identification information 405 is described does not have to be in the check frame 9, and may be, for example, around the check frame 9. Alternatively, the image data of the template that clearly indicates where the check frame 9 is located is sent by e-mail without describing the identification information. However, in this case as well, the area information is attached to the image data 402 of the template. As described above, the image data 402 of the template in which the identification information is described in the check frame 9 or the area information is attached is referred to as "template image 404 with recognition result". The template image 404 with the recognition result may be presented so that the position of the check frame 9 can be known.

FIG. 7 is an example of a sequence diagram showing a procedure in which the information processing system 100 registers a template.

S1: The administrator logs in to the device 10 and inputs the authentication information. The operation reception unit 14 of the device 10 accepts the authentication information and the login operation. The communication unit 12 of the device 10 transmits a login request and authentication information to the information processing device 20.

S1.1: The communication unit 22 of the information processing device 20 receives the login request and the authentication information, and the authentication unit 21 authenticates the administrator. Here, it is assumed that the authentication is successful. The authentication unit 21 transmits the user authentication ticket to the device 10. The user authentication ticket is a combination of arbitrary numbers and alphabets, and is associated with the user name of the administrator. Therefore, the administrator can be identified by the user authentication ticket.

S2: The logged-in administrator launches the template registration application. The operation reception unit 14 of the device 10 accepts this operation.

S2.1: The communication unit 12 of the device 10 requests the information processing device 20 for the screen information of the TOP page of the template registration application together with the user authentication ticket.

S2.1.1: The communication unit 22 of the information processing device 20 receives the request for the screen information of the TOP page, and the rule control unit 26 displays the TOP page on which the menu is arranged based on the authority of the logged-in user (administrator). Generate. The screen information of the TOP page is transmitted to the device 10, and the display control unit 13 of the device 10 displays the TOP page on the operation panel 940.

S3: The administrator presses the menu for registering the template. The operation reception unit 14 of the device 10 accepts this operation.

S3.1: The communication unit 12 of the device 10 requests the information processing device 20 for screen information of the template registration screen together with the user authentication ticket.

S3.1.1: The communication unit 22 of the information processing device 20 receives the request for the screen information of the template registration screen, and the rule control unit 26 receives the request for the screen information of the template registration screen based on the authority of the logged-in user (administrator) and the like. Generate information. The screen information of the template registration screen is transmitted to the device 10, and the display control unit 13 of the device 10 displays the template registration screen on the operation panel 940.

S4: The administrator causes the device 10 to read the template according to the instructions on the registration screen. The reading unit 15 reads the template and generates image data of the template.

S4.1: The communication unit 12 of the device 10 transmits the image data of the template to the information processing device 20.

S4.1.1: The communication unit 22 of the information processing device 20 receives the image data of the template, and the rule control unit 26 stores the image data of the template in the data storage unit 30. The rule control unit 26 obtains the file path 1 of the image data of the template.

S4.1.2: The rule control unit 26 specifies the file path 1 and requests the image processing unit 27 to extract the area information. As a result, the image processing unit 27 extracts the area information from the image data of the template and returns it to the rule control unit 26.

S4.1.3: The rule control unit 26 stores the area information in the data storage unit 30.

S4.1.4: Step S4.1.4 is executed when "registering rules in tabular format" described later. The rule control unit 26 stores the empty spreadsheet file in the data storage unit 30.

S4.1.5: The rule control unit 26 starts the process of notifying the result of template registration.

S4.1.5.1: First, the rule control unit 26 requests the image processing unit 27 to specify the file path 1 and the area information and set the area information in the image data of the template.

S4.1.5.1.1: The image processing unit 27 reads the template image data from the data storage unit 30 based on the file path 1, and adds the identification information of the check frame 9 to the template image data based on the area information. Here, the number is directly described. As described with reference to FIG. 6, it may be attached inside the check frame 9 or around it. Further, in the case of the "template image + selection formula" described later, if the area information is attached, it is not necessary to directly describe the number in the image data of the template. The image data (template image with recognition result) of this template is stored in the data storage unit 30, and the image processing unit 27 obtains the file path 2. The image processing unit 27 returns the file path 2 to the rule control unit 26.

S4.1.5.2: The rule control unit 26 reads the template image with the recognition result from the data storage unit 30 based on the file path 2.

S4.1.5.3: The rule control unit 26 attaches the template image with the recognition result to the e-mail addressed to the administrator's e-mail address and sends it. The administrator's email address is specified by successful authentication.

As described above, since the administrator has obtained the template image 404 with the recognition result in which the identification information is described in the check frame 9 or the area information is attached, the rule of OMR document processing can be registered or changed based on the template image 404.

<How to register rules for OMR document processing>
In the following, a method of registering rules for OMR document processing will be described by three methods.

<Registration method 1 of OMR document processing rules>
First, a method of registering rules for OMR document processing by a selection formula will be described with reference to FIG. FIG. 8 is an example of a screen displayed on the display 506 of the terminal device 40 when the rule of OMR document processing is registered. Such a screen may be called a user interface. First, as shown in FIG. 8A, the administrator can see the template image 404 with the recognition result in which the identification information is described in the check frame 9. Preferably, the screen of FIG. 8B is displayed at the same time as the template image 404 with the recognition result of FIG. 8A.

FIG. 8B is a rule registration screen 400 for OMR document processing. The conditions are divided into a target 421 and a state 422. The target 421 is a check frame 9, and has an input field 411 for identification information of the check frame 9 and a designation method setting field 412. The state 422 means whether or not it is marked, and has a state setting field 413.

In addition, one or more processes 423 can be set, and each process 423 has a process target setting column 414 and a process content column 415. Further, the storage location setting column 416 appears according to the setting of the processing content column 415.

The administrator can input an arbitrary value as the identification information of the check frame 9 in the input field 411 of the identification information of the check frame 9. The administrator inputs the identification information of the check frame 9 described in the template image into the input field 411 of the identification information of the check frame.

Since it is a select box except for the identification information input field 411 of the check frame 9 (a value can be selected from the pull-down menu), the administrator can easily set each setting field. Therefore, the administrator can set the target 421, the state 422, and the process 423 while referring to the identification information of the check frame 9 in FIG. 8A.

FIG. 9 is an example of a sequence diagram showing the procedure of the registration method by the selection formula of the rules of OMR document processing.

S11: The administrator logs in to the terminal device 40 and inputs the authentication information. The operation reception unit 43 of the terminal device 40 receives the authentication information and the login operation. The communication unit 41 of the terminal device 40 transmits a login request and authentication information to the information processing device 20.

S12: The communication unit 22 of the information processing device 20 receives the login request and the authentication information, and the authentication unit 21 authenticates the administrator. Here, it is assumed that the authentication is successful. The authentication unit 21 transmits the user authentication ticket to the terminal device 40. The user authentication ticket is any combination of numbers and alphabets associated with this administrator's user name.

S13: The communication unit 41 of the terminal device 40 requests the information processing device 20 for a TOP page having some menus due to successful authentication.

S14: The communication unit 22 of the information processing device 20 receives the TOP page request, and the rule control unit 26 generates a TOP page in which the menu is arranged based on the authority of the logged-in user (administrator) (this process). Is called rendering). The screen information of the TOP page is transmitted to the terminal device 40, and the display control unit 42 of the terminal device 40 displays the TOP page on the display 506.

S15: The administrator presses the rule registration menu on the TOP page. The operation reception unit 43 of the terminal device 40 accepts this operation. The communication unit 41 of the terminal device 40 requests the information processing device 20 for the rule registration screen. The communication unit 22 of the information processing device 20 receives the request of the rule registration screen, the rule control unit 26 generates screen information of the rule registration screen, and transmits the screen information to the terminal device 40 via the communication unit 22. An example of the rule registration screen 400 is shown in FIG. 8 (b).

S16: The administrator inputs a rule (condition and processing) on the rule registration screen 400. The operation reception unit 43 of the terminal device 40 receives the input of the rule. The communication unit 41 of the terminal device 40 transmits the input rule to the information processing device 20.

S17: When the administrator finishes setting the rules (conditions and processing) on the rule registration screen 400, the administrator requests the information processing apparatus 20 to register the rules. The operation reception unit 43 of the terminal device 40 accepts this operation. The communication unit 41 of the terminal device 40 requests the information processing device 20 to register the rules.

S18: The communication unit 22 of the information processing device 20 receives the rule registration request, and the rule control unit 26 stores the rule information related to the rule in the data storage unit 30. The rule information is information such as the target 421, the state 422, and the process 423 set by the administrator on the rule registration screen 400 of FIG. 8B.

<Registration method 2 of OMR document processing rules>
Next, a method of registering a template image + selection-type OMR document processing rule will be described with reference to FIG. FIG. 10 is an example of a template image 404 with a recognition result displayed on the display 506 of the terminal device 40 when the rules for OMR document processing are registered.

As described above, in the "template image + selection formula", the template image 404 with the recognition result is used. The check frame 9 of the template image 404 with the recognition result is highlighted and displayed by being colored based on the area information. Although the identification information of 1 to 4 is not given, the area information is attached to the template image 404 with the recognition result (the position of the check frame 9 and the identification number can be known).

The administrator selects an arbitrary check frame 9 from the highlighted check frames 9. In FIG. 10, the check frames 9 of the identification information 1 and 3 are selected, and the check mark 406 is displayed. When the administrator presses the "add rule button" 407, the terminal device 40 transmits the identification information of the check frame 9 on which the check mark 406 is displayed to the information processing device 20. On the rule registration screen 400, the information processing device 20 displays the rule registration screen 400 on the rule registration screen 400 with the identification information of the check frame 9 in which the administrator has displayed a check mark entered in the identification information input field 411 of the check frame 9. Can be sent to 40.

FIG. 11 is a rule registration screen 400 for OMR document processing. In the description of FIG. 11, the items described in FIG. 8B may be designated by the same reference numerals and the description thereof may be omitted. In the rule registration screen 400 of FIG. 11, the rule registration screen 400 is popped up on the template image 404 with the recognition result of FIG.

The rule registration screen 400 of FIG. 11 has the same configuration as that of FIG. 8 (b), but the identification selected in FIG. 10 is identified in the identification information input field 411 of the check frame 9 even if the administrator does not set anything. Information 1 and 3 are already displayed in the identification information input field 411 of the check frame 9. In addition, values are also set in the designation method setting field 412 and the state setting field 413. In the designation method setting field 412, "any" is the initial value. Since the check frame 9 is checked in the state setting field 413, "checked" is set.

Therefore, the administrator can intuitively register or change the rule because he / she may select the check frame 9 while looking at the actual document (template image 404 with recognition result) and select the remaining conditions and processes.

The rule registration screen of FIG. 11 has a rule creation button 430 and a return button 440. The rule creation button 430 is a button for requesting registration of the rule, and the back button 440 is a button for returning to the template image 404 with the recognition result.

FIG. 12 is an example of a sequence diagram showing a procedure of a registration method using a template image of an OMR document processing rule and a selection formula. In the description of FIG. 12, the difference from FIG. 9 will be mainly described. First, steps S21 to S25 in FIG. 12 may be the same as steps S11 to S15 in FIG. However, the rule registration screen is not displayed in step S25.

S26: The administrator inputs an operation for displaying the template image 404 with the recognition result to the terminal device 40. The operation reception unit 43 of the terminal device 40 accepts this operation. The communication unit 41 of the terminal device 40 transmits the request of the template image 404 with the recognition result to the information processing device 20.

S27: The communication unit 22 of the information processing device 20 receives the request for the template image 404 with the recognition result, and the rule control unit 26 reads the template image with the recognition result from the data storage unit 30.

S28: Next, the rule control unit 26 reads the area information of the template image with the recognition result from the data storage unit 30.

S29: The rule control unit 26 generates screen information of the template image 404 with the recognition result that accepts the selection of the check frame 9 in the template image 404 with the recognition result based on the area information. That is, when the check frame 9 is clicked, the identification information of the check frame 9 is specified and the screen information of the template image 404 with the recognition result that can be transmitted to the information processing device 20 by the terminal device 40 is generated. The screen information of the template image 404 with the recognition result is transmitted to the terminal device 40.

S30: The communication unit 41 of the terminal device 40 receives the screen information of the template image 404 with the recognition result, and the display control unit 42 displays the template image 404 with the recognition result on the display 506. The administrator selects the check frame 9 in the template image 404 with the recognition result. The operation reception unit 43 of the terminal device 40 accepts this operation. The communication unit 41 of the terminal device 40 requests the information processing device 20 for the identification information of the selected check frame 9. The communication unit 22 of the information processing device 20 receives the identification information of the check frame 9, and the rule control unit 26 displays the screen information of the template image 404 with the recognition result displaying the check mark 406 in the selected check frame 9 as the terminal device 40. Send to. The check mark 406 may be displayed on the terminal device 40 side.

S31: The administrator presses the "add rule button" 407 of the template image 404 with the recognition result. The operation reception unit 43 of the terminal device 40 accepts this operation. The communication unit 41 of the terminal device 40 transmits the identification information of the check frame 9 to the information processing device 20 together with the request of the rule registration screen 400.

The processing of steps S32 to S34 may be the same as that of steps S16 to S18 of FIG.

The communication unit 22 of the information processing device 20 receives the request of the rule registration screen 400 and the identification information of the check frame 9, and the rule control unit 26 generates the rule registration screen 400. That is, the rule registration screen 400 in which the identification information of the check frame 9 transmitted from the terminal device 40 is described in the input field 411 of the identification information of the check frame 9 is generated. The screen information of the rule registration screen 400 is transmitted to the terminal device 40.

Subsequent processes in steps S32 to S34 may be the same as in steps S16 to S18 in FIG.

<Registration method 3 of OMR document processing rules>
Next, a method of registering rules for OMR document processing of spreadsheet file formulas will be described with reference to FIG. FIG. 13 is an example of the spreadsheet rule registration screen 450 displayed on the display 506 of the terminal device 40 when the rules for OMR document processing using the spreadsheet file formula are registered. Such a screen may be called a user interface.

FIG. 13 (a) is the same as FIG. 8 (a). FIG. 13B is a screen example of a spreadsheet file. In the "spreadsheet file formula", a spreadsheet application is used. The spreadsheet rule registration screen 450 allows the administrator to enter values in cells specified by row numbers and column numbers, similar to the screens of general spreadsheet applications. As shown in FIG. 13B, conditions and processing are specified in column A 451 and column B 452, column C 453, and column D 454.
Column A: Identification information of check frame 9 (corresponding to input field 411 of identification information of check frame 9)
Column B: Whether it is marked (corresponds to the status setting field 413)
Column C: Delivery destination (corresponding to processing 423)
Column D: Folder (corresponding to processing 423)
As described above, in the spreadsheet file formula, detailed setting is difficult as compared with the rule registration screen 400, but if it is a simple rule, the administrator can easily set it. The relationship between the table and the column in FIG. 13B may be reversed.

FIG. 14 is an example of a sequence diagram showing a procedure of a registration method using a spreadsheet file formula for rules of OMR document processing. In the description of FIG. 14, the difference from FIG. 9 will be mainly described. First, steps S41 to S45 in FIG. 14 may be the same as steps S11 to S15 in FIG. However, the rule registration screen is not displayed in step S45.

S46: The administrator inputs the operation of downloading the spreadsheet file to the terminal device 40. The operation reception unit 43 of the terminal device 40 accepts this operation. The communication unit 41 of the terminal device 40 transmits the request for the spreadsheet file to the information processing device 20.

S47: The communication unit 22 of the information processing device 20 receives the request for the spreadsheet file, and the rule control unit 26 reads the spreadsheet file from the data storage unit 30 by designating the file path 3 of the spreadsheet file. The file path 3 is obtained when the spreadsheet file is saved in step S4.1.4 of FIG. The communication unit 22 of the information processing device 20 transmits the spreadsheet file to the terminal device 40.

S48: The communication unit 41 of the terminal device 40 receives the spreadsheet file, and the terminal device 40 activates the spreadsheet application. As a result, the spreadsheet rule registration screen 450 of FIG. 13 is displayed on the display 506 of the terminal device 40. The administrator inputs conditions and processes in columns A 451 and B 452, C column 453, and D column 454 of the spreadsheet file. The operation reception unit 43 of the terminal device 40 accepts this operation.

S49: The administrator performs an operation of uploading the spreadsheet file to the information processing device 20. The operation reception unit 43 of the terminal device 40 accepts this operation. The communication unit 41 of the terminal device 40 transmits the spreadsheet file to the information processing device 20.

S50: The communication unit 22 of the information processing device 20 receives the spreadsheet file, and the rule control unit 26 stores the rule information extracted from each column of the spreadsheet file in the data storage unit 30.

<Processing when document data is input>
Subsequently, the procedure for the information processing system 100 to process the document data based on the registered or changed rule will be described with reference to FIG. FIG. 15 is an example of a sequence diagram showing the processing performed by the information processing system 100 in which the document data is input.

S51: The fax machine of the other party transmits the document data to the device 10. The document data receiving unit 11 of the device 10 receives the document data.

S52: The communication unit 12 of the device 10 requests the authentication unit 21 for device authentication. The authentication unit 21 authenticates the device 10. Here, it is assumed that the authentication is successful. The authentication unit 21 transmits the device authentication ticket to the device 10. The device authentication ticket serves as identification information of the device 10 that identifies the device 10.

S53: When the communication unit 12 of the device 10 receives the device authentication ticket, it transmits the document data and the device authentication ticket to the information processing device 20.

S54: The communication unit 22 of the information processing device 20 receives the document data and the device authentication ticket, and the rule control unit 26 specifies the device authentication ticket and acquires tenant information from the device management unit 23. As a result, tenant information such as the tenant ID of the tenant associated with the device authentication ticket can be specified.

S55: The rule control unit 26 specifies the storage location of the document data using the tenant ID. It is assumed that the storage location of document data is determined for each tenant.

S56: The rule control unit 26 stores the document data in the storage location specified by the data storage unit 30. The rule control unit 26 obtains the file path 4 of the document data.

S57: Next, the rule control unit 26 acquires the area information and the rule from the data storage unit 30. If the area information and rules corresponding to the tenant are stored, specify the tenant and read the area information and rules.

S58: The rule control unit 26 specifies the file path 4 and requests the image processing unit 27 to correct the position of the document data. Since the document data transmitted by FAX has margins or edges are missing, the position is corrected based on the area information. The rule control unit 26 performs pattern matching on document data with a template image, for example, and identifies a region having the highest degree of matching. The template image is stored in the data storage unit 30.

S59: Further, the rule control unit 26 specifies the area information and requests the image processing unit 27 to cut out the check frame 9. The check frame 9 designated by the area information is cut out from the document data starting from the end of the area having the highest degree of matching (corresponding to the outer edge of the document data). In consideration of the fact that the mark protrudes from the check frame 9, it is advisable to cut it slightly larger. The image processing unit returns the file path 5 of the image data of the cut-out check frame 9 to the rule control unit 26.

S60: The rule control unit 26 requests the determination unit 29 to determine the presence or absence of the mark together with the file path 5 (the storage location of the image data in the check frame 9) acquired from the image processing unit 27. The determination unit 29 determines the presence / absence of a mark for each check frame 9, and returns the determination result (presence / absence of a mark) to the rule control unit 26 in association with the identification information of the check frame 9 for each check frame 9.

S61: The rule control unit 26 compares the rule with the presence / absence of the mark of each check frame 9 and determines the processing for the document data.

<About learning of the learning department and judgment of the judgment department>
A machine learning method used for constructing the determination unit 29 for determining whether or not there is a mark in the check frame 9 of the document data will be described. Machine learning is a technology for making a computer acquire learning ability like a human being, and the computer autonomously generates an algorithm necessary for judgment such as data identification from learning data that is taken in advance, and a new one. A technology that applies this to data to make predictions. The learning method for machine learning may be any of supervised learning, unsupervised learning, semi-supervised learning, intensive learning, and deep learning, and may be a learning method that combines these learning methods. Machine learning It doesn't matter how you learn for. Machine learning methods include perceptron, deep learning, support vector machine, logistic regression, naive Bayes, decision tree, and random forest. In the following, CNN (Convolutional Neural Network) will be described as an example of a form of deep learning.

FIG. 16 is an example of a configuration diagram of CNN. The CNN has an input layer 301, an intermediate layer 302, and an output layer 303. Each pixel of the image data is input to the input layer 301 as input data, and the output layer 303 outputs a degree (a numerical value of 0 to 1) that is estimated to have a mark as output data. In CNN, the intermediate layer 302 has a structure in which the convolution layer 304 (convolution) and the pooling layer 305 are alternately repeated, and is finally connected to the fully connected layer 306.

The convolution layer 304 is one by calculating the sum of the products of each element of the grid-like numerical data called the kernel (or filter) and the numerical data of the partial image (called a window) having the same size as the kernel. The process of converting to a numerical value. This conversion process is converted into small grid-like numerical data (that is, a tensor) by shifting the window little by little. The pooling layer 305 is a process of creating one numerical value from the numerical data of the window. For example, there are maximum value pooling that selects the maximum value in the window and mean value pooling that selects the average value in the window. The convolution layer 304 extracts the features of the image data, and the pooling layer 305 blurs the position rigor.

The fully connected layer 306 collectively transmits the grid-like numerical data of the final pooling layer 305 to the output layer 303. There may be a process by an activation function described later between the fully connected layer 306 and the output layer 303.

In CNN, regression model and classification model can be constructed by the number of nodes in the output layer and the activation function. In this embodiment, it is sufficient to know whether or not the check frame 9 is marked, so a two-class classification model is constructed. Therefore, the number of nodes in the output layer is 1, and the activation functions are ReLU, tanh, sigmoid, and so on.

FIG. 17 is a diagram illustrating input data and a teacher signal when the learning unit 28 learns CNN parameters. The CNN parameters are the elements of the filter, the weight that binds the pooling layer 305 and the fully connected layer 306, and the weight that binds the fully connected layer 306 and the output layer 303.

As shown in FIG. 17, images of marks having various shapes are input as input data. The teacher signal for these input data is 1 (marked). Since the above activation function outputs a value of 0 to 1, the learning unit 28 learns by inputting the teacher signal and the output to the loss function and back-propagating them to the CNN parameters, as shown in FIG. The output layer outputs a value close to 1 with respect to the input data. Therefore, by using the classification model after learning as the determination unit 29 and the determination unit 29 comparing the output and the threshold value, the presence or absence of the mark can be determined for each check frame 9.

<Summary>
As described above, the information processing system 100 of the present embodiment is provided with a user interface for registering or changing rules, so that the customer administrator can easily register or change the rules.

<Other application examples>
The best mode for carrying out the present invention has been described above with reference to Examples, but the present invention is not limited to these Examples, and various modifications are made without departing from the gist of the present invention. And substitutions can be made.

For example, the shape of the check frame 9 is not limited to a square shape, and may be a circle, an ellipse, a triangle, a polygon, an indeterminate shape, or the like. Further, the outer edge of the check frame 9 may be chipped like a parenthesis (the check frame 9 may not be closed).

Further, in the present embodiment, the form has been described as an example of the document data, but the document data may have a check frame 9.

Further, the configuration example shown in FIG. 5 and the like is divided according to the main functions in order to facilitate understanding of the processing by the device 10, the information processing device 20, and the terminal device 40. The present invention is not limited by the method of dividing the processing unit or the name. The processing of the device 10, the information processing device 20, and the terminal device 40 can be divided into more processing units according to the processing content. Further, one processing unit can be divided so as to include more processing. Each database does not have to be in each device, it may be in a location accessible on the network.

Further, the functions of the information processing device 20 may be distributed and arranged in a plurality of devices to realize the function of one information processing device 20, or a plurality of information processing devices 20 may exist.

Further, each function of the embodiment described above can be realized by one or a plurality of processing circuits. Here, the "processing circuit" in the present specification is a processor programmed to execute each function by software such as a processor implemented by an electronic circuit, or a processor designed to execute each function described above. It shall include devices such as ASIC (Application Specific Integrated Circuit), DSP (digital signal processor), FPGA (field programmable gate array) and conventional circuit modules.

9 Check frame 10 Equipment 20 Information processing device 40 Terminal device 100 Information processing system

Japanese Unexamined Patent Publication No. 2010-049360

Claims (9)

An information processing system having an information processing device that determines the presence or absence of a mark on a check frame arranged in document data, compares the determination result with a rule, and executes processing, and a terminal device that communicates with the information processing device. There,
The information processing device
An image processing unit that generates area information regarding the position of the check frame from a template image of the document data transmitted from the device, and an image processing unit.
It has a communication unit that transmits the template image in which the check frame is presented to the terminal device based on the area information generated by the image processing unit.
The terminal device is
A display control unit that displays the template image received from the information processing device and displays an input field for identification information of the check frame, an input field for the presence or absence of a mark, and an input field for processing.
An operation reception unit that accepts input to the identification information input field of the check frame, the presence / absence of a mark input field, and the processing input field as the rule.
An information processing system characterized by having. The image processing unit associates the identification information of the check frame with the check frame and describes it in the template image.
When requested by the terminal device, the communication unit transmits the template image in which the identification information of the check frame is described in association with the check frame to the terminal device.
The operation receiving unit of the terminal device is characterized in that it receives input of the identification information of the check frame described in the template image received from the information processing device into the input field of the identification information of the check frame. The information processing system according to claim 1. It has a control unit that generates the template image having screen information for displaying a check mark in the selected check frame when the check frame is selected.
When requested by the terminal device, the communication unit transmits the screen information for displaying a check mark in the selected check frame and the template image to the terminal device.
When the operation receiving unit of the terminal device accepts the selection of the check frame, the display control unit displays a check mark in the selected check frame.
Further, the display control unit inputs the identification information input field of the check frame and the presence / absence of a mark in a state where the identification information of the check frame received by the operation reception unit is input in the identification information input field. The information processing system according to claim 1, wherein a field and an input field for processing are displayed. Claim 1 is characterized in that an arbitrary value can be input in the identification information input field of the check frame, and a predetermined value can be selected in the mark presence / absence input field and the processing input field. The information processing system according to any one of 3 to 3. When there is a request from the terminal device, the communication unit transmits a spreadsheet file used in the spreadsheet application to the terminal device.
The display control unit indicates that the predetermined column or row of the spreadsheet file received from the information processing device is an input field for identification information of the check frame, an input field for the presence or absence of a mark, and Display that it is an input field for processing,
The operation receiving unit accepts the input of the identification information of the check frame to the cell corresponding to the input field of the identification information of the check frame, and inputs the presence / absence of the mark to the cell corresponding to the input field of the presence / absence of the mark. The information processing system according to claim 1, wherein the information processing system receives the input of the process to the cell corresponding to the input field of the process. In the template image of the document data transmitted from the device, the check frame is filled with a predetermined color.
The information processing system according to any one of claims 1 to 5, wherein the image processing unit generates the area information regarding the position of the check frame from the template image of the document data based on the color. .. The information processing device
It has a document data receiving unit that receives the document data transmitted from the outside, and has a document data receiving unit.
The image processing unit cuts out the check frame specified by the area information from the document data received by the document data receiving unit.
A determination unit that determines whether or not the cut out check frame is marked, and
The information processing system according to any one of claims 1 to 6, further comprising a control unit that determines the process by comparing the rule with the presence or absence of a mark of each check frame. An information processing system having an information processing device that determines the presence or absence of a mark on a check frame arranged in document data, compares the determination result with a rule, and executes processing, and a terminal device that communicates with the information processing device. Information processing method to be performed
The information processing device
A step in which the image processing unit generates area information regarding the position of the check frame from the template image of the document data transmitted from the device, and
The communication unit has a step of transmitting the template image in which the check frame is presented to the terminal device based on the area information generated by the image processing unit.
The terminal device is
A step in which the display control unit displays the template image received from the information processing device and displays an input field for identification information of the check frame, an input field for presence / absence of a mark, and an input field for processing.
A step in which the operation reception unit accepts input in the identification information input field of the check frame, the presence / absence of a mark input field, and the processing input field as the rule.
An information processing method characterized by having. An information processing device that determines whether or not there is a mark on the check frame placed in the document data, compares the determination result with the rules, and executes the process.
An image processing unit that generates area information regarding the position of the check frame from a template image of the document data transmitted from the device, and an image processing unit.
It has a communication unit that transmits the template image in which the check frame is presented to the terminal device based on the area information generated by the image processing unit.
For the terminal device
An information processing device characterized in that the template image received from the information processing device is displayed, and an input field for identification information of the check frame, an input field for presence / absence of a mark, and an input field for processing are displayed.

Images