JP2019036137A - Information processing device, information processing system, and information processing program - Google Patents

Abstract

To enable, in an information processing device receiving presentations of documents, restraining from receiving the presentation of a document using an unauthorized personal identification material.SOLUTION: An information processing device comprises: reception means for receiving the image of a document on which an information image is printed, and the image of a certificate certifying a person; extraction means for extracting, using the information image, area information indicating an area in which a character string that identifies the person within the image of the certificate is described; character recognition means for performing character recognition for the area using the area information; and association means for associating the character recognition result with the image of the document.SELECTED DRAWING: Figure 1

Description

  The present invention relates to an information processing apparatus, an information processing system, and an information processing program.

  In Patent Document 1, it is an object to accurately and efficiently determine the authenticity of the identity verification material from the identity verification material or the image data of the copy, and the image analysis unit is responsible for the identity verification material scanned by the scanning system or a copy thereof. The character recognition engine analyzes the character string and image layout in the image data, the character recognition engine recognizes the character string and the image, and the authenticity determination processing unit stores the analysis result, the recognition result, and the authenticity determination logic template storage unit. It is disclosed that the authenticity of the identity verification material is determined by collating it with the authenticity determination logic template relating to the layout of characters and images described in the stored identity verification material.

  Patent Document 2 has an object of performing identity verification with an image optically read from an identity verification document in a manner that requires less burden on the applicant. The server includes a reception unit, a character recognition unit, a determination unit, and a notification unit. The receiving unit has a different receiving e-mail address for each type of procedure related to a predetermined contract, receives an e-mail at the address for each type of procedure, and the character recognizing unit receives the received e-mail address. A character string is obtained by performing a character recognition process on the image of the document attached to the e-mail, and the determination unit confirms the character string obtained by the character recognition unit and the identity verification registered in advance in the server. A character string candidate for each document is compared to determine the type of the image as an identity verification document, and the image is verified based on the type of the identity verification document and information on the contract registered in the server in advance. Of determining whether appropriate or not as an image, wherein the notification unit is disclosed to be notified of the determination result of the image to the portable terminal.

  In Patent Document 3, personal information described in a medium for personal authentication possessed by a user is photographed, and the written data is accurately extracted from the image data by optical character recognition. Even if there is no clear separation (blank), etc., it is an object to provide an information input device that can accurately distinguish first name and last name with easy operation without choosing a place, and a public possessed by the user Appropriately correct the image data obtained by photographing the ID card to improve the recognition rate by optical character recognition, to accurately extract the written data, and to predict and display the last name and first name separation positions Allows the user to suggest how to separate first and last names, and also makes it easy to verify the age on the spot by recognizing the date of birth from a public ID. Door has been disclosed.

JP 2011-178075 A JP 2012-098823 A Japanese Patent Laid-Open No. 2006-173710

For example, a report may be submitted as an assignment for a class at a university or the like. It is not possible to prevent unauthorized report submission such as impersonation simply by registering the image of the report in the system. It is also possible to use a student ID, which is a certificate that certifies the person, but the specifications of the electronic card as the student ID vary from university to university, making it difficult to handle all of them. On the other hand, the student ID generally contains a character string (such as a student ID number) for identifying the student.
According to the present invention, in an information processing apparatus or information processing system that accepts document submission, it is possible to suppress acceptance of document submission using an unauthorized identity verification material.

The gist of the present invention for achieving the object lies in the inventions of the following items.
According to the first aspect of the present invention, a receiving unit that receives an image of a document on which an information image is printed and an image of a certificate that proves the identity of the user, and a person in the image of the certificate is specified using the information image. Extraction means for extracting area information indicating an area in which the character string is described, character recognition means for recognizing the area using the area information, and association means for associating the character recognition result with the image of the document Is an information processing apparatus.

  According to a second aspect of the present invention, the extraction unit further includes a storage unit that extracts a storage destination using the information image and stores the associated character recognition result and the document image in the storage destination. An information processing apparatus according to claim 1.

  According to a third aspect of the present invention, the extraction means further extracts a lecture name area and an assignment name area using the information image, and the character recognition means recognizes the lecture name area and the assignment name area as characters. The information processing apparatus according to claim 2, wherein the lecture name and the assignment name are acquired, and the storage unit stores the character recognition result, the image of the document, the lecture name, and the assignment name in the storage destination. It is.

  According to a fourth aspect of the present invention, the extraction means extracts second region information indicating a second region in which a character string for identifying the person in the image of the document is described using the information image. The character recognition means recognizes the second area using the second area information, and the association means performs association when two recognition results match. The information processing apparatus according to 1.

  According to a fifth aspect of the present invention, when the two recognition results do not match, the associating means does not perform associating, and the associating means does not associate with the image processing apparatus that has transmitted the document image and the certificate image. The information processing apparatus according to claim 4, further comprising a transmission unit configured to transmit a warning indicating that it cannot be performed.

  According to a sixth aspect of the present invention, the extraction means uses the information image to obtain a first character string for identifying the organization to which the principal belongs, and a character string for identifying the organization to which the principal belongs. The third region described is extracted, the character recognition means recognizes the third region, and the association means determines whether the recognition result of the first character string and the third region is The information processing apparatus according to claim 1, wherein matching is performed when they match.

  According to a seventh aspect of the present invention, the association means does not perform an association when the recognition result of the first character string and the third region do not match, and does not associate the image of the document and the image of the certificate. The information processing apparatus according to claim 6, further comprising a transmission unit configured to transmit a warning indicating that the association cannot be performed to the transmitted image processing apparatus.

  The invention according to claim 8 is the information processing apparatus according to claim 1, further comprising a storage unit that stores at least the date and time received by the receiving unit, the certificate image, and the document image as a history.

  The invention according to claim 9 is the information processing apparatus according to claim 1, a reading unit that reads an image of a document on which an information image is printed, an image of a certificate that certifies the person, an image of the document, An information processing system having an image processing apparatus including a transmission unit that transmits an image of a certificate to the information processing apparatus and a printing unit that prints a document proving that the certificate is transmitted by the transmission unit.

  A tenth aspect of the present invention is the information processing system according to the ninth aspect, wherein the printing unit prints a reduced image of the image of the document at least on a transmission date and time on the document.

  According to the eleventh aspect of the present invention, there is provided a computer for receiving an image of a document on which an information image is printed and an image of a certificate for certifying the person, and using the information image to identify the person in the image of the certificate. Extraction means for extracting area information indicating an area in which a character string for specifying is described; character recognition means for recognizing the area using the area information; and associating a character recognition result with an image of the document It is an information processing program for functioning as an association means.

  According to the information processing apparatus of the first aspect, in the information processing apparatus that accepts the submission of the document, it is possible to suppress accepting the submission of the document using the unauthorized personal identification material.

  According to the information processing apparatus of the second aspect, the associated character recognition result and the document image can be stored in the storage destination.

  According to the information processing apparatus of the third aspect, the character recognition result, the document image, the lecture name, and the assignment name can be stored in the storage destination.

  According to the information processing apparatus of the fourth aspect, the association can be performed when the recognition result of the character string for identifying the person in the certificate and the document matches.

  According to the information processing apparatus of the fifth aspect, when the two recognition results do not match, a warning indicating that the association cannot be performed can be transmitted to the image processing apparatus.

  According to the information processing apparatus of the sixth aspect, the association can be performed when the recognition results of the first character string and the third region match.

  According to the information processing apparatus of the seventh aspect, when the recognition result of the first character string and the third region does not match, a warning indicating that the association cannot be performed can be transmitted to the image processing apparatus.

  According to the information processing apparatus of the eighth aspect, the received date and time, the certificate image, and the document image can be stored as a history.

  According to the information processing system of the ninth aspect, it is possible to print a document proving that it has been transmitted.

  According to the information processing system of the tenth aspect, at least the transmission date and time and the reduced image of the document image can be printed on the document.

  According to the information processing program of the eleventh aspect, it is possible to suppress the acceptance of the document submission and the acceptance of the document submission using the unauthorized identity verification material.

It is explanatory drawing which shows the system configuration example using this Embodiment. It is a conceptual module block diagram about the structural example of information processing apparatus. It is explanatory drawing which shows the data structure example of report paper DB. It is explanatory drawing which shows the example of a data structure of report paper layout information (character recognition object position). It is explanatory drawing which shows the example of a data structure of student ID layout information (character recognition object position). It is a conceptual module block diagram about the structural example of a document management apparatus. It is explanatory drawing which shows the data structure example of student DB. It is explanatory drawing which shows the example of a data structure of lecture DB. It is a conceptual module block diagram about the structural example of an image processing apparatus. It is explanatory drawing which shows the process example by this Embodiment. It is explanatory drawing which shows the example of a process target by this Embodiment. It is a flowchart which shows the process example by this Embodiment. It is a flowchart which shows the process example by this Embodiment. It is a flowchart which shows the process example by this Embodiment. It is a flowchart which shows the process example by this Embodiment. It is a flowchart which shows the process example by this Embodiment. It is a flowchart which shows the process example by this Embodiment. It is a flowchart which shows the process example by this Embodiment. It is a block diagram which shows the hardware structural example of the computer which implement | achieves this Embodiment.

Hereinafter, an example of a preferred embodiment for realizing the present invention will be described with reference to the drawings.
The module generally refers to components such as software (computer program) and hardware that can be logically separated. Therefore, the module in the present embodiment indicates not only a module in a computer program but also a module in a hardware configuration. Therefore, the present embodiment is a computer program for causing these modules to function (a program for causing a computer to execute each procedure, a program for causing a computer to function as each means, and a function for each computer. This also serves as an explanation of the program and system and method for realizing the above. However, for the sake of explanation, the words “store”, “store”, and equivalents thereof are used. However, when the embodiment is a computer program, these words are stored in a storage device or stored in memory. This means that control is performed so as to be stored in the apparatus. Modules may correspond to functions one-to-one, but in mounting, one module may be configured by one program, or a plurality of modules may be configured by one program, and conversely, one module May be composed of a plurality of programs. The plurality of modules may be executed by one computer, or one module may be executed by a plurality of computers in a distributed or parallel environment. Note that one module may include other modules. Hereinafter, “connection” is used not only for physical connection but also for logical connection (data exchange, instruction, reference relationship between data, etc.). “Predetermined” means that the process is determined before the target process, and not only before the process according to this embodiment starts but also after the process according to this embodiment starts. Also, if it is before the target processing, it is used in accordance with the situation / status at that time or with the intention to be decided according to the status / status up to that point. When there are a plurality of “predetermined values”, they may be different values, or two or more values (of course, including all values) may be the same. In addition, the description of “do B when A” is used to mean “determine whether or not A and do B when A”. However, the case where it is not necessary to determine whether or not A is excluded. In addition, when enumerating things such as “A, B, C”, etc., it is an enumerated list unless otherwise specified, and includes cases where only one of them is selected (for example, only A).
In addition, the system or device is configured by connecting a plurality of computers, hardware, devices, and the like by communication means such as a network (including one-to-one correspondence communication connection), etc., and one computer, hardware, device. The case where it implement | achieves by etc. is included. “Apparatus” and “system” are used as synonymous terms. Of course, the “system” does not include a social “mechanism” (social system) that is an artificial arrangement.
In addition, when performing a plurality of processes in each module or in each module, the target information is read from the storage device for each process, and the processing result is written to the storage device after performing the processing. is there. Therefore, description of reading from the storage device before processing and writing to the storage device after processing may be omitted. Here, the storage device may include a hard disk, a RAM (Random Access Memory), an external storage medium, a storage device via a communication line, a register in a CPU (Central Processing Unit), and the like.

  In this embodiment, when an image of a document such as a report is submitted as a class at a university or the like, a character string for identifying the person described in the certificate can be associated with the image of the document. And it becomes possible to suppress accepting the submission of a document using an unauthorized identity verification material.

FIG. 1 is an explanatory diagram illustrating an example of a system configuration using the present embodiment.
The example of FIG. 1A shows a system configuration example showing the relationship between the document management apparatus 110, the information processing apparatus 100, and the image processing apparatus 120. Note that three document management apparatuses 110 and three image processing apparatuses 120 are illustrated, but one or more document management apparatuses 110 and image processing apparatuses 120 may be used. In general, there are a plurality of each.
The information processing apparatus 100 is connected to the A university document management apparatus 110A, the B university document management apparatus 110B, the C university document management apparatus 110C, the a store image processing apparatus 120A, the b store image processing apparatus 120B, and the c store image processing apparatus 120C. Connected through.
University A document management apparatus 110A, University B document management apparatus 110B, and University C document management apparatus 110C are each connected to information processing apparatus 100 via a communication line. The document management apparatus 110 is used by a person who requests submission of a document (for example, a teacher, a leader, etc.). Instruct and collect documents such as reports. In addition, although it has described as a university, it is an illustration, Comprising: A high school, a technical school, an English conversation school, a seminar, etc., a general company etc. may be sufficient.
The a-store image processing device 120A, the b-store image processing device 120B, and the c-store image processing device 120C are each connected to the information processing device 100 via a communication line. For example, a scanner or a multi-function machine (an image processing apparatus having two or more functions such as a scanner, a printer, a copier, and a fax machine) installed in a convenience store or the like is applicable. Used by those who submit documents (for example, students, students, students, etc.). In addition, although described as a store (store), it may be anywhere as long as it is an example and the image processing apparatus 120 is installed.

The example of FIG. 1B shows a more specific system configuration example.
A store image processing apparatus 120A is installed in the store 130A. In the store 130B, a b store image processing device 120B is installed. In store 130C, c store image processing device 120C is installed.
The A university document management apparatus 110A, the teacher user terminal 112A, and the image processing apparatus 114A are connected. The B university document management apparatus 110B, the teacher user terminal 112B, and the image processing apparatus 114B are connected. The C university document management apparatus 110C, the teacher user terminal 112C, and the image processing apparatus 114C are connected.
Information processing device 100, University A document management device 110A, University B document management device 110B, University C document management device 110C, Store a image processing device 120A in store 130A, Store b image processing device 120B in store 130B, Store 130C The c store image processing apparatuses 120C are connected to each other via a communication line 190. The communication line 190 may be wireless, wired, or a combination thereof, and may be, for example, the Internet or an intranet as a communication infrastructure. Further, the function of the information processing apparatus 100 may be realized as a cloud service.

Each image processing apparatus 120 reads an image of a document on which an information image is printed and an image of a certificate that certifies the person. Specifically, it has a function as a scanner.
Then, the document image and the certificate image are transmitted to the information processing apparatus 100. Specifically, it has a function as a communication device.
Further, a document that proves the transmission is printed. Specifically, it has a function as a printer. This document serves as a voucher indicating that the document image and certificate have been transmitted.
Then, a reduced image of the document image may be printed on the document at least at the transmission date and time. This printed document has a function as a voucher.

For example, a faculty member at University A creates a lesson task (which may be a test or the like) using the teacher user terminal 112A. Then, a report sheet for the problem is printed using the image processing apparatus 114A. An information image to be described later is printed on this report sheet. Such information is managed by the A university document management apparatus 110A. For example, students are managed, lectures are managed (whether reports are submitted for the lectures, etc.).
The student writes on the report sheet distributed by the teacher, reads (scans) the described report sheet with the a-store image processing apparatus 120A, and transmits it to the information processing apparatus 100. However, the student ID is read by the a-store image processing apparatus 120A and transmitted to the information processing apparatus 100 in order to prevent an unauthorized person (who is not the person who wrote the report form) from submitting.
The information processing apparatus 100 recognizes characters in the area where the student ID number is written in the student ID, reads the character recognition result (such as a student ID number as a personal ID) and a report paper image (read by the a-store image processing apparatus 120A). The report paper image) is associated and transmitted to the A university document management apparatus 110A. That is, the submitter (who has a student ID card) and the report paper image are associated with each other.
The A university document management apparatus 110A receives the personal ID and the report paper image from the information processing apparatus 100, and stores the received information in association with each other.

In particular, when the image processing apparatus 120 is installed outside the school, it can be operated by an arbitrary visitor, so that the risk of an unauthorized person submitting the report is higher than in the school.
Therefore, it is possible to authenticate with a student ID. However, the authentication means (magnetism, contact IC, non-contact IC, etc.) possessed by the student ID is diverse and varies from school to school. Therefore, in this system shared by a plurality of schools, it is necessary for a plurality of image processing apparatuses 120 to correspond to a plurality of authentication means, which increases the installation cost. There may also be a student ID (so-called paper student ID) that does not have an authentication means.

The following description is intended to facilitate understanding of the present embodiment.
The information processing apparatus 100 identifies the layout information of the student ID card from the information image printed on the report sheet. According to this layout information, a student ID number is obtained by character recognition of a predetermined position of the image of the student ID card.
With this system, the teacher using the document management apparatus 110 can reduce the trouble of collecting paper reports from students. And it is not necessary to install many image processing apparatuses required for report submission in a school. In addition, it is possible to obtain high-quality report images rather than having students shoot and submit reports with a digital camera attached to a smartphone or the like.
The student using the image processing apparatus 120 can submit a report without bringing it to school as compared to submitting a paper report. The operation is simpler than the case of scanning with a scanner and registering an image file in the document management apparatus 110 from a PC or mobile terminal. In addition, there is no risk of submitting a report to a third party illegally, compared to a case in which no identity verification is performed. Compared with a password input to the document management apparatus 110, the operation is simple.
In the document management apparatus 110, only the report image reception processing unit (plug-in) needs to be developed, and the introduction of this system is facilitated.

FIG. 2 is a conceptual module configuration diagram of a configuration example of the present embodiment.
The information processing apparatus 100 according to the present embodiment associates a character string for identifying a person described in a certificate with an image of a document. As shown in the example of FIG. A report paper ID acquisition module 220, a report paper DB 230, an extraction module 240, a character recognition module 250, and a correspondence module 260.

  The communication interface module 210 is connected to the report paper ID acquisition module 220, the character recognition module 250, and the association module 260. The communication interface module 210 receives an image from the image processing apparatus 120. That is, the communication interface module 210 accepts an image of a document on which an information image is printed (hereinafter also referred to as a document image) and an image of a certificate that proves the identity (hereinafter also referred to as a certificate image). Then, the document image is passed to the report paper ID acquisition module 220 and the certificate image is passed to the character recognition module 250. Here, the information image refers to an image code systematically created to represent electronic data in a machine-readable manner. Specifically, a one-dimensional bar code, a two-dimensional code (for example, a QR code (Quick) Response code (registered trademark)), MISTCODE (Micro-dot Iterated and Superimposed Tag CODE, mist code: registered trademark) and the like. Note that MISTCODE is a low visibility code that can embed information by drawing minimal dots (code information) so as not to stand out in the background of a document output on paper.

The report paper ID acquisition module 220 is connected to the communication interface module 210 and the extraction module 240 and receives a document image from the communication interface module 210. The report paper ID acquisition module 220 decodes the information image printed (superimposed) on the document image. The decryption result includes, for example, area information (area information indicating an area in which a character string for identifying the person in the certificate image is described), a report sheet ID, and the like.
The report paper DB 230 is connected to the extraction module 240. The report sheet DB 230 stores the report sheet ID, the address of the document management apparatus 110 to which the document image is to be transmitted, an area where a character string for identifying the person is described (the personal ID description position of the certificate), and the like. doing. A detailed data structure example will be described later with reference to FIG.

The extraction module 240 is connected to the report paper ID acquisition module 220, the report paper DB 230, and the character recognition module 250. The extraction module 240 extracts area information indicating an area in which a character string for identifying the person in the certificate image is described using the information image.
The extraction by the extraction module 240 may extract region information directly from the information image, or may extract a character string by searching another database from the information in the information image. As an example of the former, a case where region information is embedded in an information image is applicable. Further, as an example of the latter, a report paper ID is embedded in the information image, and a student ID layout (including position information of an area in which a character string for identifying the person is written) from the report paper ID. May be extracted.

The character recognition module 250 is connected to the communication interface module 210, the extraction module 240, and the association module 260 and receives a certificate image from the communication interface module 210. The character recognition module 250 uses the region information extracted by the extraction module 240 to recognize the region indicated by the region information. An existing technology may be used as the character recognition technology. Compared to the case where the entire certificate image is recognized and the character string for specifying the person is specified, the area is specified by the area information, so that the area for character recognition can be reduced.
The association module 260 is connected to the communication interface module 210 and the character recognition module 250. The association module 260 associates the character recognition result obtained by the character recognition module 250 with the document image.

Further, the extraction module 240 may extract the storage destination using the information image.
The communication interface module 210 may store the character recognition result associated with the association module 260 and the document image in the storage destination extracted by the extraction module 240.
Further, the extraction module 240 may further extract the lecture name and the assignment name using the information image.
The communication interface module 210 may store the character recognition result, the document image, the lecture name, and the assignment name in the storage destination.
However, it is necessary to create and print a report paper print file in which different information images are embedded for each task.

Further, the extraction module 240 may acquire the lecture name area and the assignment name area using the information image. Then, the character recognition module 250 may perform character recognition on each of the regions (lecture name region and assignment name region) of the document image to acquire the lecture name and assignment name.
The communication interface module 210 may store the character recognition result (character string for identifying the person in the certificate image), the document image, the lecture name, and the assignment name in the storage destination.

Further, the extraction module 240 may extract second region information indicating a second region in which a character string for specifying the person in the document image is described using the information image.
Then, the character recognition module 250 may use the second region information to perform character recognition on the second region in the document image indicated by the second region information.
The association module 260 may perform association when two recognition results match. Here, “two recognition results” are (1) the result of character recognition of an area in which a character string for specifying the certificate image is specified, and (2) the document image is specified. This is a result of character recognition of an area in which a character string is written. Specifically, the student ID number written on the certificate and the student ID number written on the report.

Further, the association module 260 may not perform association when the two recognition results do not match.
Then, the communication interface module 210 may transmit a warning indicating that the association cannot be performed to the image processing apparatus 120 that has transmitted the document image and the certificate image. Here, the “warning” may include that the character string for specifying the person in the document image is different from the character string for specifying the person in the certificate image. In this case, the user can realize that the student ID number described in the report is incorrect or that the written characters must be written carefully.

The extraction module 240 uses the information image to obtain a first character string for identifying the organization to which the principal belongs, and a character string for identifying the organization to which the principal belongs in the certificate image. You may extract the 3rd area | region currently described.
Then, the character recognition module 250 may perform character recognition on the third area in the certificate image.
The association module 260 may perform association when the recognition results of the first character string and the third region match.

Further, the associating module 260 may not perform associating when the recognition results of the first character string and the third region do not match.
Then, the communication interface module 210 may transmit a warning indicating that the association cannot be performed to the image processing apparatus 120 that has transmitted the document image and the certificate image.
Also, the association module 260 stores at least the date / time received by the communication interface module 210 (the date / time when the communication interface module 210 received the certificate image and the document image), the certificate image, and the document image as a history. You may make it do.

FIG. 3 is an explanatory diagram illustrating an example of a data structure in the report sheet DB 230 of the information processing apparatus 100.
The report sheet DB 230 stores records 310 (generally a plurality of records 310).
The record 310 includes report sheet ID 315, school name 320, connected document management apparatus address 325, report sheet layout information (character recognition target position) 330, and student ID layout information (character recognition target position) 335. Yes. That is, in correspondence with the report paper ID 315, information on the school name 320, the address 325 of the connected document management apparatus, the report paper layout information (character recognition target position) 330, and the student ID layout information (character recognition target position) 335 is stored. doing.
As described above, when the report sheet ID is stored in the information image (when the area information is not stored in the information image), the report sheet ID 315, the connection is set as the record 310 in the report sheet DB 230. It only needs to have at least the address 325 of the previous document management device and the student ID layout information (character recognition target position) 335.
The report sheet ID 315 is identification information for uniquely identifying a document (here, a report sheet) in the present embodiment. In the present embodiment, as long as the area information indicating the area in which the character string for identifying the person is described (specifically, the position information in the column in which the student ID number is described) is the same. The report paper ID 315 may be the same. In general, since the student ID card has the same layout in the school, in this case, the report sheet ID 315 may be identification information for specifying a school name or the like.

The school name 320 is a school name (a kind of organization name) that uses (or issues) the report.
The address 325 of the connected document management apparatus is an address of the document management apparatus 110 used by the school, and may be, for example, an IP address or a URL (Uniform Resource Locator) for storing a document image. Etc.
Report paper layout information (character recognition target position) 330 stores report paper layout information. The character recognition module 250 uses this to recognize characters in the document image. Details will be described later using the example of FIG.
The student ID layout information (character recognition target position) 335 stores student ID layout information. The character recognition module 250 uses this to recognize characters in the certificate image. Details will be described later using the example of FIG.

FIG. 4 is an explanatory diagram showing an example of the data structure of the report paper layout information (character recognition target position) 330.
The report paper layout information (character recognition target position) 330 has a student ID number field 402, a name area field 412, a lecture name area field 422, an assignment name area field 432, and a report area field 442. The student ID number field 402 has an X field 404, a Y field 406, a W field 408, and an H field 410, and the name field field 412 has an X field 414, a Y field 416, a W field 418, and an H field 420. The lecture name area column 422 includes an X column 424, a Y column 426, a W column 428, and an H column 430. The assignment name region column 432 includes an X column 434, a Y column 436, and a W column. The report area column 442 includes an X column 444, a Y column 446, a W column 448, and an H column 450. The report sheet layout information (character recognition target position) 330 without the report area column 442 may be used.
The student ID number field 402 stores a student ID number area (for example, rectangular, hereinafter the same as an area). The X column 404 stores the X coordinate at the upper left of the student ID number area. The Y column 406 stores the upper left Y coordinate of the student ID number area. The W column 408 stores the width of the student ID number area. The H column 410 stores the height of the student ID number area.
The name area column 412 stores a name area. The X column 414 stores the upper left X coordinate of the name area. The Y column 416 stores the upper left Y coordinate of the name area. The W column 418 stores the width of the name area. The H column 420 stores the height of the name area.
The lecture name area column 422 stores a lecture name area. The X column 424 stores the X coordinate at the upper left of the lecture name area. The Y column 426 stores the Y coordinate at the upper left of the lecture name area. The W column 428 stores the width of the lecture name area. The H column 430 stores the height of the lecture name area.
The assignment name area column 432 stores an assignment name area. The X column 434 stores the X coordinate at the upper left of the task name area. The Y column 436 stores the upper left Y coordinate of the assignment name area. The W column 438 stores the width of the assignment name area. The H column 440 stores the height of the task name area.
The report area column 442 stores a report area. The X column 444 stores the X coordinate at the upper left of the report area. The Y column 446 stores the Y coordinate at the upper left of the report area. The W column 448 stores the width of the report area. The H column 450 stores the height of the report area.

FIG. 5 is an explanatory diagram showing an example of the data structure of the student ID layout information (character recognition target position) 335.
The student ID layout information (character recognition target position) 335 includes a student ID number field 502, a name area field 512, a school name area field 522, an undergraduate department name area 532, and an expiration date area field 542. The student ID number field 502 includes an X field 504, a Y field 506, a W field 508, and an H field 510, and the name field field 512 includes an X field 514, a Y field 516, a W field 518, and an H field 520. The school name area column 522 has an X column 524, a Y column 526, a W column 528, and an H column 530. The undergraduate department name region column 532 has an X column 534, a Y column 536, and a W column. A field 538 and an H field 540 are included, and an expiration date area field 542 includes an X field 544, a Y field 546, a W field 548, and an H field 550.
The student ID number field 502 stores a student ID number area. The X column 504 stores the upper left X coordinate of the student ID number area. The Y column 506 stores the upper left Y coordinate of the student ID number area. The W column 508 stores the width of the student ID number area. The H column 510 stores the height of the student ID number area.
The name area column 512 stores a name area. The X column 514 stores the X coordinate at the upper left of the name area. The Y column 516 stores the Y coordinate at the upper left of the name area. The W column 518 stores the width of the name area. The H column 520 stores the height of the name area.
The school name area column 522 stores a school name area. The X column 524 stores the X coordinate at the upper left of the school name area. The Y column 526 stores the upper left Y coordinate of the school name area. The W column 528 stores the width of the school name area. The H column 530 stores the height of the school name area.
The department name field 532 stores the department name area. The X column 534 stores the X coordinate at the upper left of the department name area. The Y column 536 stores the Y coordinate at the upper left of the department name area. The W column 538 stores the width of the department name area. The H column 540 stores the height of the department name area. Note that the student ID layout information (character recognition target position) 335 without the department name field 532 may be used.
The expiration date area column 542 stores an expiration date area. The X column 544 stores the X coordinate at the upper left of the expiration date area. The Y column 546 stores the upper left Y coordinate of the expiration date area. The W column 548 stores the width of the expiration date area. The H column 550 stores the height of the expiration date area. The student ID layout information (character recognition target position) 335 without the expiration date area column 542 may be used.

FIG. 6 is a conceptual module configuration diagram of a configuration example of the document management apparatus 110.
The document management apparatus 110 includes a student DB 610, a lecture DB 620, a report reception processing unit (plug-in) 630, and a communication IF 640.
The student DB 610 manages information related to students (persons who submit reports). Details will be described later using the example of FIG.
The lecture DB 620 manages information related to lectures. Details will be described later using the example of FIG.
The report reception processing unit (plug-in) 630 receives the document image (document image associated with the character string for identifying the person) transmitted from the communication interface module 210 of the information processing apparatus 100 via the communication IF 640. Accept.
The communication IF 640 is an interface for communicating with the information processing apparatus 100, the teacher user terminal 112, the image processing apparatus 114, and the like.

FIG. 7 is an explanatory diagram showing an example of the data structure of the student DB 610.
The student DB 610 stores records 710 (generally a plurality of records 710).
The record 710 has a student ID number 715, a name 720, and a lecture name (list) 725 being taken.
The student ID number 715 is identification information for uniquely identifying a student in the present embodiment. Of course, the student ID number 715 is also written on the student ID card.
The name 720 is the name of the student.
The lecture name (list) 725 being attended is the name of the lecture that the student has taken (may be identification information that uniquely identifies the lecture) (generally a plurality of lecture names).

FIG. 8 is an explanatory diagram showing an example of the data structure of the lecture DB 620.
The lecture DB 620 stores records 810 (generally a plurality of records 810).
The record 810 has a lecture name 815 and an assignment (list) 820.
The assignment (list) 820 stores records 825 (generally a plurality of records 825). Note that there are a plurality of records 825 in the assignment (list) 820.
The record 825 includes an assignment name 830, whether or not a report has been received 835, and an image 840 of a received report.
The assignment name 830 is the assignment name in the lecture (may be identification information that uniquely identifies the assignment).
The presence / absence of report reception 835 is information indicating whether or not to accept a report on the subject. Of course, when the report acceptance / absence 835 is information indicating that a report is accepted, the processing according to the present embodiment is performed.
The accepted report image 840 is a report (document image associated with a student ID number) received from the information processing apparatus 100 in the subject. Of course, when a plurality of students have submitted, a plurality of received report images 840 are stored in the record 825.

FIG. 9 is a conceptual module configuration diagram of a configuration example of the image processing apparatus 120.
The image processing apparatus 120 includes a user interface panel 910, a scanner 915, a printer 920, and a communication IF 925.
The user interface panel 910 receives an operation for reading a written report form and student ID by a user (student). For example, the user interface panel 910 controls a liquid crystal display that also serves as a touch panel, receives a user operation, and presents a message or the like to the user. In addition, user operations using a mouse, keyboard, camera, microphone, etc. (including line of sight, gestures, voices, etc.) may be accepted, and the user may be able to receive voice output using a speaker or tactile sensation using a tactile device. You may make it show the message to.
For example, the scanner 915 reads a written report sheet and a student ID.
For example, the printer 920 prints a document serving as a voucher indicating that the described report sheet has been transmitted.
The communication IF 925 is an interface for performing communication with the information processing apparatus 100 and the like.

FIG. 10 is an explanatory diagram showing a processing example according to the present embodiment.
FIG. 10A shows an example of a report sheet 1000. The report sheet 1000 is created by a teacher operation on the teacher user terminal 112 and printed by the image processing apparatus 114.
The report sheet 1000 has a student ID number area 1005, a name area 1010, a lecture name area 1015, an assignment name area 1020, and a report area 1025. The student ID number area 1005, the name area 1010, the lecture name area 1015, and the assignment name area 1020 are blank at the time of creation, and are filled in by the student by handwriting. However, the student ID number area 1005, the name area 1010, the lecture name area 1015, and the assignment name area 1020 may already be printed at the time of creation. Of course, the report area 1025 is blank when it is created, and there is some description by the student when it is read by the image processing apparatus 120.
The student ID number area 1005 is specified by the student ID number field 402 of the report paper layout information (character recognition target position) 330, and the name area 1010 is specified by the name area field 412 of the report paper layout information (character recognition target position) 330. The lecture name area 1015 is specified by the lecture name area column 422 of the report paper layout information (character recognition target position) 330, and the assignment name area 1020 is the assignment name area of the report paper layout information (character recognition target position) 330. The report area 1025 is specified by the column 432, and the report area 1025 is specified by the report area column 442 of the report sheet layout information (character recognition target position) 330. The report sheet 1000 without the report area 1025 may be used. In this case, as described above, the report sheet layout information (character recognition target position) 330 without the report area column 442 may be used.
FIG. 10B is an example in which the same report sheet 1000 is shown, but the information image 1050 is shown darkly. As described above, the information image 1050 includes the report paper ID (or area information indicating the area where the student ID number in the student card is described). Then, the information processing apparatus 100 decodes the information image 1050 and extracts the information.

FIG. 11 is an explanatory diagram illustrating an example of a processing target according to the present embodiment.
The student ID card 1100 has a school name area 1105, an undergraduate department area 1110, a student ID number area 1115, a name area 1120, and an expiration date area 1125. The student has and is read by the image processing device 120. Note that the student ID 1100 without the undergraduate department area 1110 and the expiration date area 1125 may be used.
The school name area 1105 is specified by the school name area column 522 of the student ID layout information (character recognition target position) 335, and the undergraduate department area 1110 is the undergraduate department area column 532 of the student ID layout information (character recognition target position) 335. The student ID number area 1115 is specified by the student ID number area column 502 of the student ID layout information (character recognition target position) 335, and the name area 1120 is the name area of the student ID layout information (character recognition target position) 335. The expiration date area 1125 specified by the column 512 is specified by the expiration date area column 542 of the student ID layout information (character recognition target position) 335.

FIG. 12 is a flowchart illustrating a processing example according to the present exemplary embodiment.
In step S <b> 1202, the teacher user terminal 112 acquires a report paper print file from the document management apparatus 110. For example, by the teacher's operation, the Web browser of the teacher user terminal 112 connects to the document management apparatus 110 and acquires a predetermined report paper print file for each school. An information image in which the report paper ID is encoded is superimposed on the report paper print file.
In step S1204, the image processing apparatus 114 prints a report paper print file. The report paper print file acquired in step S1202 is printed by the teacher's operation. And teachers distribute to students. For example, as a paper distribution, the student ID number area, name area, lecture name area, assignment name area, and report area are not filled in (blank).
In step S1206, the document management apparatus 110 sets the report image to be acceptable. By the teacher's operation, the document management apparatus 110 of the school is set to accept the report of the target task (see the report acceptance / absence 835 in the lecture DB 620 shown in the example of FIG. 6).

FIG. 13 is a flowchart illustrating a processing example according to the present exemplary embodiment.
In step S1302, the “student report submission” menu of the image processing apparatus 120 is selected in accordance with a user operation. For example, the user (student) selects the “student report submission” menu on the image processing apparatus 120 installed in the store 130.
In step S <b> 1304, the user sets the report and student ID in the image processing apparatus 120. For example, the user sets a report created using a distributed report sheet and a student ID card in the reading unit of the image processing apparatus 120 and instructs scanning.

In step S1306, the user instructs the image processing apparatus 120 to perform scanning.
In step S1308, the image processing apparatus 120 scans the report and student ID. There may be one scan that reads the report and student ID at the same time, or two scans that read the report and student ID separately. In the former, a report and a student ID are included in one image, and in the latter, an image of a report and an image of a student ID are included. In the former case, the communication interface module 210 may separate a single image into a report image and a student ID image.

In step S <b> 1310, the image processing apparatus 120 transmits the scanned image to the information processing apparatus 100. The information processing apparatus 100 receives images (for example, a report image and a student ID image) transmitted by the image processing apparatus 120.
In step S1312, the information processing apparatus 100 decodes the information image of the report image and acquires the report paper ID.

In step S1314, the information processing apparatus 100 acquires the school name 320 corresponding to the report sheet ID, the address 325 of the connected document management apparatus, and the student ID layout information (character recognition target position) 335 from the report sheet DB 230. Note that the report paper layout information (character recognition target position) 330 may also be acquired.
In step S1316, the information processing apparatus 100 recognizes characters in the student ID image based on the student ID layout information (character recognition target position) 335 and acquires a student ID number.

In step S <b> 1318, the information processing apparatus 100 receives from the connected document management apparatus 110 the name of the lecture 815 that the student with the student ID number is attending and the assignment that is accepting the report (the assignment name 830 that has the report acceptance / absence 835). ) To get.
In step S1320, the information processing apparatus 100 transmits the lecture name 815 and the assignment name 830 to the image processing apparatus 120.

In step S1322, the image processing apparatus 120 displays the received lecture name and assignment name.
In step S <b> 1324, the user selects a report submission destination lecture name and assignment name from the list displayed on the image processing apparatus 120.

In step S1326, the image processing apparatus 120 transmits the selected lecture name and assignment name to the information processing apparatus 100.
In step S1328, the information processing apparatus 100 transmits a report submission instruction to the document management apparatus 110 together with the student ID number, lecture name, assignment name, and report image.

In step S1330, the document management apparatus 110 registers a report image for the received student ID number, lecture name, and assignment name.
In step S1332, the document management apparatus 110 notifies the information processing apparatus 100 of the completion of submission.
In step S1334, the information processing apparatus 100 notifies the image processing apparatus 120 of completion of submission.

The flowchart shown in the example of FIGS. 14 to 18 is a modification of the flowchart shown in the example of FIG.
FIG. 14 is a flowchart illustrating a processing example according to the present exemplary embodiment.
In the example of FIG. 14A, this processing is added between step S1314 and step S1316.
In step S1416 subsequent to step S1314, the information processing apparatus 100 acquires report sheet layout information.
In step S1418, the information processing apparatus 100 character-recognizes the student ID number area in the report image based on the acquired layout information, and acquires the student ID number. Then, the process proceeds to step S1316.

In the example of FIG. 14B, this processing is added between step S1316 and step S1318.
In step S1420 following step S1316, the information processing apparatus 100 compares the student ID number acquired in step S1418 with the student ID number acquired in step S1316.
In step S1422, it is determined whether or not the student ID number acquired in step S1418 matches the student ID number acquired in step S1316. If they match, the process proceeds to step S1318. Otherwise, the process proceeds to step S1424.
In step S1424, an error is notified to the image processing apparatus 120, and the process ends (step S1499).

FIG. 15 is a flowchart illustrating an example of processing according to the present embodiment.
In the next step S1518 in the case of “Yes” in step S1316 or step S1422, the information processing apparatus 100 character-recognizes the school name area in the student card image and acquires the school name.
In step S1520, the information processing apparatus 100 compares the school name acquired in step S1314 with the school name acquired in step S1518.
In step S1522, it is determined whether or not the school name acquired in step S1314 matches the school name acquired in step S1518. If they match, the process proceeds to step S1318. Otherwise, the process proceeds to step S1524.
In step S1524, an error is notified to the image processing apparatus 120, and the process ends (step S1599).

FIG. 16 is a flowchart showing an example of processing according to this embodiment.
In the next step S <b> 1618 in the case of “Yes” in step S <b> 1316 or step S <b> 1422 or “Yes” in step S <b> 1522, the information processing apparatus 100 sets the school name acquired in step S <b> 1314 and the student ID number acquired in step S <b> 1316 to 120.
In step S1620, the image processing apparatus 120 receives the school name and student ID number transmitted in step S1618 and displays them.
In step S1622, the information processing apparatus 100 acquires the student name corresponding to the acquired student ID from the connection destination document management apparatus 110 acquired in step S1314, and transmits the student name to the image processing apparatus 120.
In step S1624, the image processing apparatus 120 receives the student name transmitted in step S1622, and displays it.
In step S1626, the user confirms the school name, student ID number, and student name displayed on the image processing apparatus 120, and presses a confirmation button.
In step S1628, the image processing apparatus 120 notifies the information processing apparatus 100 of “confirmation OK”. Then, the process proceeds to step S1318.

FIG. 17 is a flowchart showing an example of processing according to this embodiment.
In step S1716 following step S1334, the image processing apparatus 120 prints a report receipt. The date and time of submission (transmission date and time), school name, student ID number, lecture name, assignment name, and thumbnail image of the report are output to the report receipt. Then, the process proceeds to step S1399.

FIG. 18 is a flowchart illustrating an example of processing according to the present embodiment.
In step S1836 following step S1334 or step S1716, the information processing apparatus 100 stores the student ID image transmitted from the image processing apparatus 120 in step S1310 together with information corresponding to the report receipt as a job log. Then, the process proceeds to step S1399.

  Note that the hardware configuration of the computer on which the program according to the present embodiment is executed is a general computer as illustrated in FIG. 19, specifically, a personal computer, a computer that can be a server, or the like. That is, as a specific example, the CPU 1901 is used as a processing unit (calculation unit), and the RAM 1902, the ROM 1903, and the HD 1904 are used as storage devices. As the HD 1904, for example, a hard disk or an SSD (Solid State Drive) may be used. CPU 1901 for executing programs such as the communication interface module 210, report paper ID acquisition module 220, extraction module 240, character recognition module 250, association module 260, RAM 1902 for storing the programs and data, and for starting up the computer ROM 1903 storing the above program, etc., HD 1904 as an auxiliary storage device (may be a flash memory or the like) having a function as report sheet DB 230, keyboard, mouse, touch screen, microphone, camera (line of sight) A reception device 1906 that receives data based on user operations (including motion, voice, line of sight, etc.), an output device 1905 such as a CRT, a liquid crystal display, and a speaker, Communication line interface 1907 for connecting to a communication network such as a work interface card, and, and a bus 1908 for exchanging data by connecting them. A plurality of these computers may be connected to each other via a network.

Among the above-described embodiments, the computer program is a computer program that reads the computer program, which is software, in the hardware configuration system, and the software and hardware resources cooperate with each other. Is realized.
Note that the hardware configuration illustrated in FIG. 19 illustrates one configuration example, and the present embodiment is not limited to the configuration illustrated in FIG. 19, and is a configuration capable of executing the modules described in the present embodiment. I just need it. For example, some modules may be configured with dedicated hardware (for example, Application Specific Integrated Circuit (ASIC), etc.), and some modules are in an external system and connected via a communication line In addition, a plurality of systems shown in FIG. 19 may be connected to each other through communication lines so as to cooperate with each other. In particular, in addition to personal computers, mobile information communication devices (including mobile phones, smartphones, mobile devices, wearable computers, etc.), information appliances, robots, copiers, fax machines, scanners, printers, multifunction devices, etc. May be.

The program described above may be provided by being stored in a recording medium, or the program may be provided by communication means. In that case, for example, the above-described program may be regarded as an invention of a “computer-readable recording medium recording the program”.
The “computer-readable recording medium on which a program is recorded” refers to a computer-readable recording medium on which a program is recorded, which is used for program installation, execution, program distribution, and the like.
The recording medium is, for example, a digital versatile disc (DVD), which is a standard established by the DVD Forum, such as “DVD-R, DVD-RW, DVD-RAM,” and DVD + RW. Standard “DVD + R, DVD + RW, etc.”, compact disc (CD), read-only memory (CD-ROM), CD recordable (CD-R), CD rewritable (CD-RW), Blu-ray disc ( Blu-ray (registered trademark) Disc), magneto-optical disk (MO), flexible disk (FD), magnetic tape, hard disk, read-only memory (ROM), electrically erasable and rewritable read-only memory (EEPROM (registered trademark)) )), Flash memory, Random access memory (RAM) SD (Secure Digital) memory card and the like.
Then, the whole or a part of the program may be recorded on the recording medium for storage or distribution. Also, by communication, for example, a local area network (LAN), a metropolitan area network (MAN), a wide area network (WAN), a wired network used for the Internet, an intranet, an extranet, or a wireless communication It may be transmitted using a transmission medium such as a network or a combination of these, or may be carried on a carrier wave.
Furthermore, the program may be a part or all of another program, or may be recorded on a recording medium together with a separate program. Moreover, it may be divided and recorded on a plurality of recording media. Further, it may be recorded in any manner as long as it can be restored, such as compression or encryption.

DESCRIPTION OF SYMBOLS 100 ... Information processing apparatus 110 ... Document management apparatus 112 ... Teacher user terminal 114 ... Image processing apparatus 120 ... Image processing apparatus 130 ... Store 190 ... Communication line 210 ... Communication interface module 220 ... Report paper ID acquisition module 230 ... Report paper DB
240 ... Extraction module 250 ... Character recognition module 260 ... Corresponding module 610 ... Student DB
620 ... Lecture DB
630 ... Report reception processing part (plug-in)
640 ... Communication IF
910 ... User interface panel 915 ... Scanner 920 ... Printer 925 ... Communication IF

Claims (11)

Receiving means for receiving an image of a document on which an information image is printed and an image of a certificate proving the identity;
Extraction means for extracting area information indicating an area in which a character string for identifying the person in the image of the certificate is described using the information image;
Character recognition means for recognizing the region using the region information;
An information processing apparatus having association means for associating a character recognition result with an image of the document. The extraction means extracts a storage location using the information image,
The information processing apparatus according to claim 1, further comprising a storage unit that stores the associated character recognition result and the document image in the storage destination. The extraction means further extracts a lecture name area and an assignment name area using the information image,
The character recognition means character recognizes the lecture name area and the assignment name area, acquires a lecture name and assignment name,
The storage means stores the character recognition result, the image of the document, the lecture name, and the assignment name in the storage destination.
The information processing apparatus according to claim 2. The extraction means extracts second region information indicating a second region in which a character string for identifying the person in the image of the document is described using the information image,
The character recognition means recognizes the second area using the second area information,
The association means performs association when two recognition results match.
The information processing apparatus according to claim 1. If the two recognition results do not match, the association means does not perform the association,
The information processing apparatus according to claim 4, further comprising a transmission unit configured to transmit a warning indicating that the image cannot be associated with the image processing apparatus that has transmitted the document image and the certificate image. The extraction means uses the information image to describe a first character string for identifying the organization to which the principal belongs, and a character string for identifying the organization to which the principal belongs. Extract the region,
The character recognition means recognizes the character in the third area;
The association means performs association when the recognition result of the first character string matches the recognition result of the third region.
The information processing apparatus according to claim 1. The association means does not perform association when the recognition result of the first character string and the third region do not match,
The information processing apparatus according to claim 6, further comprising: a transmitting unit configured to transmit a warning indicating that the image cannot be associated with the image processing apparatus that has transmitted the document image and the certificate image. The information processing apparatus according to claim 1, further comprising: a storage unit that stores at least the date and time received by the receiving unit, the certificate image, and the document image as a history. The information processing apparatus according to claim 1;
Reading means for reading an image of a document on which an information image is printed and an image of a certificate proving the identity;
Transmitting means for transmitting the image of the document and the image of the certificate to the information processing apparatus;
An information processing system comprising: an image processing apparatus having a printing unit that prints a document proving that the transmission unit has transmitted the document. The printing means prints a reduced image of the document image at least on the document on the transmission date,
The information processing system according to claim 9. Computer
Receiving means for receiving an image of a document on which an information image is printed and an image of a certificate proving the identity;
Extraction means for extracting area information indicating an area in which a character string for identifying the person in the image of the certificate is described using the information image;
Character recognition means for recognizing the region using the region information;
An information processing program for causing a character recognition result and an image of the document to function as an associating unit.

Images