JP2007233888A - Image processor and image processing program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To allow a user to easily confirm whether a grading result, a totaling result, or a recognition result about entry contents by handwriting is correct or not, or a part having an error. <P>SOLUTION: In an automatic grading system, when displaying an image of a read answer sheet on a display screen, a superposing position determination part 43 determines a vicinity of a score column or an answerer information column that is a handwriting entry area of the answer sheet, superposition part 44 superposes a processing result (a grading result) of automatic grading processing and an acquisition result from the answer sheet in a determined superposing position, and a display part 45 displays it. The user confirming display contents thereof can compare the entry information actually handwritten on the answer sheet, and the acquisition result and the grading result from the image of the answer sheet. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to an image processing apparatus and an image processing program.

  In general, in educational institutions such as schools and cram schools, educational materials such as test answer sheets and practice question sheets are often used. And, it is widely used that the teaching material including the question and the answer column is used to make the student fill in the answer on the educational material (paper), and the teacher grades the written answer. Has been done.

  By the way, for educational materials, there is a strong demand for labor saving in scoring. In order to respond to this requirement, for example, to save labor in scoring processing, for example, a scoring stand and a scoring pen are connected to a personal computer (hereinafter simply referred to as “PC”), and an educational tool is provided at a predetermined position on the scoring stand. By placing XX with a scoring pen with the teaching material placed, it is possible to input the position information of the answer written on the educational teaching material and its correctness information to the PC. There has been proposed a system configured to perform automatic scoring of answers on educational materials (see, for example, Patent Document 1).

JP-A-6-266278

  However, in the above-mentioned conventional technology, dedicated scoring equipment such as a scoring table and a scoring pen is required for scoring processing of educational materials, which causes a complicated system configuration and high costs. It is not preferable. In addition, the necessity of dedicated component devices limits the educational materials that can be supported, which may limit the versatility of the educational materials.

  On the other hand, the graded answer sheet is read by an image reading device such as a scanner in order to ensure sufficient versatility for educational materials without requiring dedicated component equipment for the scoring process. The scanned image is compared with the original (answer paper before scoring) image, and based on the comparison result, entry information, that is, scoring symbols such as “○” and “×” are extracted from the scoring answer paper. An automatic scoring system configured to perform scoring processing based on the results can be considered.

  By the way, as described above, in addition to the method of using the scoring process on behalf of the grader such as a teacher as a method of using this type of automatic scoring system, the answer rate for which question was high, low, or which It is also possible to use such methods as taking statistics such as which field the students are good at and not good at and then reflecting them in the subsequent educational policy. In the latter method of use, the main purpose is to collect statistics. Therefore, the actual scoring process may be performed by a grader such as a teacher as usual.

  Also, in the latter usage, for example, a process of collecting statistics for each student is performed, so that the student also recognizes the written contents such as the name and attendance number written by hand, and the recognition result and the total result Are stored in the database unit in association with each other. At this time, in the process of recognizing the entry contents such as the name and attendance number written by the student by hand, the recognition result is generally not 100% correct. The same is true for scoring results.

  Therefore, it is conceivable that the user (scorer such as a teacher) is at a loss as to whether the recognition result or the scoring result can be trusted as it is. Further, if it is not known whether the recognition result or the scoring result is correct or wrong, or in which part there is an error, the user cannot correct the recognition result or the scoring result even if there is an error.

  Here, in the conventional scoring system for educational materials, an example of performing image processing for extracting scoring symbols based on the comparison result of each image of the answer sheet before scoring and the answer sheet after scoring is taken as an example. However, the present invention is not limited to automatic scoring of educational materials, but the same can be said for the counting process in a questionnaire sheet counting process system, for example.

  That is, for example, in a questionnaire processing system, image processing for extracting check symbols such as “O” and “X” from the answered questionnaire sheet based on the comparison result between the questionnaire sheet before answering and the answered questionnaire sheet Even when conducting surveys, the survey respondents will recognize the contents of gender, residence, etc. written by hand, and will collect statistics for each gender and region. A similar problem will occur.

  The present invention has been made in view of the above problems, and the purpose of the present invention is to determine whether a scoring result, a totaling result, or a recognition result of handwritten entry contents is correct or wrong, or in which part An object of the present invention is to provide an image processing apparatus and an image processing program that allow a user to easily check whether there is an error.

  In order to achieve the above object, the present invention adopts the following configuration. That is, the position information of the handwritten entry area to be handwritten on the original document is stored, while the completed document is handwritten in the handwritten entry area and additionally written in the area other than the handwritten entry area. The image of the completed document is read, and the entry information in the handwritten entry area is obtained from the image of the entered document that has been read, and the additional information added to the completed document is compared with the image comparison result between the entered document and the original document. Based on the extracted information, the extracted additional information is subjected to a predetermined process. Then, an image of the read completed document is displayed and, based on the position information, in the vicinity of the handwritten entry area, a processing result of a predetermined process and an acquisition result from the completed document image (entry information in the handwritten entry area) ) And.

  When displaying an image of a read completed document on the display screen, information about the handwritten entry area acquired from the processing result of the predetermined process and the image of the completed document in the vicinity of the handwritten entry area of the completed document By displaying, the user who confirms the display contents can compare the entry information actually written in the handwritten entry area of the completed document with the acquisition result from the image of the completed document. it can. Further, when the processing result corresponding to the predetermined processing is handwritten in the handwritten input area as the input information, the handwritten input information and the processing result of the predetermined processing can be compared on the display screen. . By comparing these, the user can easily confirm whether the acquisition result from the image of the completed document, the processing result of the predetermined process is correct or incorrect, or in which part there is an error. . If there is an error, the user corrects the error.

  According to the present invention, the user can easily determine whether a processing result of a predetermined process such as a scoring result or a totaling result, or an acquisition result of handwritten entry information is correct or incorrect, or in which part there is an error. Since it can be confirmed, if there is a mistake, the corresponding part can be surely corrected.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

[Application example]
FIG. 1 is a system configuration diagram showing an example of a basic configuration of an image processing apparatus to which the present invention is applied. Here, a teaching material processing apparatus that handles teaching materials used in educational institutions (hereinafter referred to as “educational teaching materials”) will be described as an example of the image processing apparatus.

  As shown in FIG. 1, a teaching material processing apparatus that is an image processing apparatus according to this application example includes a database unit 1, an image reading unit 2, an image data analysis unit 3, a teaching material determination unit 4, and a distortion correction unit 5. The difference extraction unit 6, the answerer extraction unit 7, the correctness / error determination extraction unit 8, the discontinuity correction unit 9, the figure shape recognition unit 10, the entry position calculation unit 11, the scoring calculation unit 12, and the counting result The output unit 13, the database device 14, and the confirmation / correction unit 15 are included.

  In such teaching material processing apparatus, the database unit 1 includes handwritten entry of answers to questions by answerers such as students, and scoring symbols (for example, “○”, “x”, etc.) for correct / incorrect determination of answers by graders such as teachers. The image data (original image data) of the educational teaching material (original document data) and the electronic data about the educational teaching material before the additional writing of the graphic) is held and accumulated.

  Here, the educational material will be briefly described. FIG. 2 is an explanatory diagram showing a specific example of educational materials. As shown in FIG. 2, the educational material 20 is a test answer sheet, a practice question sheet, or the like used in an educational institution, and has a question and its answer column 21. However, the educational material 20 only needs to have at least the answer column 21, and the question sentence is not necessarily described. As a matter of course, in the answer column 21, the answer is handwritten by an answer entry person such as a student.

  The educational material 20 includes an identification information field 22 in which information for identifying and specifying the educational material 20 is described, and an answerer information field in which information about an answer entry person in the answer field 21 is described. 23 and a score column 24 for entering a score as a scoring result is provided. In the identification information column 22, for example, information such as a subject, a title, and an applicable grade of the educational material 20 is described in advance.

  On the other hand, in the answerer information column 23, the class, attendance number, name, etc. are handwritten by the answerer such as the student, and the score can be handwritten by the grader such as the teacher in the score column 24. It has become. That is, in the educational material that is the original document, the answer column 21, the answerer information column 23, the score column 24, and the like correspond to the handwritten entry area in the claims.

  With regard to such electronic data about the educational material 20, the layout (position on the paper) of the answer column 21, the identification information column 22, the answerer information column 23, the score column 24, etc. on the educational material 20 is specified. Any data format can be used as long as it includes position information that can be stored and can be stored and accumulated in the database unit 1. For example, it may be image data or application document data created by document creation software.

  However, it is assumed that the electronic data of the educational material 20 includes scoring information for each answer column 21 in the educational material 20. The scoring information is information for specifying the number of points to be assigned to the answer column 21 at which position for each answer column 21 on the educational material 20. The score may be different for each answer column 21 or may be uniform.

  Returning to FIG. The image reading unit 2 includes handwritten entry of answers in the answer column 21 by the answerer, handwritten entry of the name and the like in the answerer information field 23, and additional information in the answer column 21 by the grader for the answer, specifically Is a known optical image reading technique for the educational teaching material 20 which is a completed document in which a scoring symbol for correct / incorrect determination (for example, a figure such as “O”, “x”, etc.) is additionally written (filled). Is read, and image data is obtained from the educational material 20 and input into the educational material processing apparatus.

  The image data analysis unit 3 performs an analysis process on the image data input from the image reading unit 2. Examples of the analysis processing include layout analysis, character / graphic separation, character recognition, code information recognition, graphic processing, color component recognition, etc., all of which can be realized using known image processing techniques. Then, the detailed description is abbreviate | omitted.

  The teaching material discrimination unit 4 is configured by at least one of the title analysis unit 41 and the code information analysis unit 42, and as a result of the analysis processing in the image data analysis unit 3, particularly the title analysis by the title analysis unit 41 for the identification information column 22 Alternatively, the educational teaching material 20 that is the basis of the image data obtained by the image reading unit 2 is identified and specified based on at least one analysis result of the code analysis by the code information analysis unit 42.

  At this time, the learning material discriminating unit 4 compares the electronic data of the educational material 20 held and accumulated in the database unit 1 and if the corresponding electronic data is not held and accumulated in the database unit 1, Judgment is made as an identification specific error. That is, the teaching material determination unit 4 specifies electronic data to be compared with the image data obtained by the image reading unit 2 based on the analysis result of the image data analysis unit 3.

  The distortion correction unit 5 performs image distortion correction on the image data obtained by the image reading unit 2. Examples of image distortion correction include tilt correction and enlargement / reduction correction in the main scanning direction or sub-scanning direction. Since these distortion corrections may be realized by using a known image processing technique, detailed description thereof is omitted here. Alternatively, the image data obtained by the image reading unit 2 and the electronic data in the database unit 1 to be compared may be compared and collated to correct the image distortion (inclination, scaling, etc.).

  The difference extraction unit 6 is input from the image reading unit 2 and read image data after distortion correction processing in the distortion correction unit 5 and a comparison target specified by the identification result of the educational material 20 in the learning material determination unit 4. The original image data in the database unit 1 is compared and the difference between them is extracted. Note that the difference extraction processing method itself may be realized by using a known image processing technique, and a detailed description thereof will be omitted here.

  The answerer extraction unit 7 is composed of at least one of the attendance number image cutout unit 71 and the handwritten OCR (Optical Character Reader) unit 72, preferably both, and based on the result of the analysis processing in the image data analysis unit 3 Of the differences extracted by the difference extraction unit 6, the difference in the answerer information field 23 is extracted through image information extraction by the attendance number image cutout unit 71 from the difference and character recognition processing by the handwritten OCR unit 72. The handwritten information handwritten in the educational teaching material read by the image reading unit 2 is extracted.

  As handwritten information, information handwritten in the handwritten entry area on the educational material by the answer writer or grader, specifically, a class handwritten in the answerer information column 23 by the answer writer such as a student, Information indicating the answer entry person such as attendance number, name, etc., and information indicating the score result such as a score handwritten in the score column 24 by a grader such as a teacher.

  The correctness determination extraction unit 8 further extracts the correctness determination entry contents from the difference extracted by the difference extraction unit 6 based on the result of the analysis processing in the image data analysis unit 3. What is necessary is just to extract the content regarding a predetermined color component through the color component recognition process with respect to the extraction result in the difference extraction part 6, for example, extraction of the entry content of correct / incorrect determination. This is because the grader's entry of correct / incorrect determination is generally performed in red.

  The discontinuity correction unit 9 performs discontinuity correction processing on the extraction result from the correctness / error determination extraction unit 8. Here, the interruption correction process is a process for connecting the extracted line segments and eliminating the interruption between the extracted line segments.

  The figure shape recognizing unit 10 recognizes the entry contents of the correct / incorrect determination by performing shape recognition on the entry contents of the correct / incorrect determination extracted by the correctness / error determination extracting unit 8 and corrected by the discontinuity correcting unit 9. . The shape recognition may be performed by pattern matching with a scoring symbol for correct / incorrect determination, for example, a graphic shape such as “◯” or “×”. In other words, the graphic shape recognition unit 10 recognizes whether the content of the correct / incorrect determination entry is “correct answer (◯)” or “incorrect answer (×)”. Alternatively, the feature amount of the recognition target figure may be calculated and the shape may be recognized from the feature amount. Examples of the feature amount include the number of holes and the area ratio of the target graphic occupying the circumscribed rectangle.

  The entry position calculation unit 11 calculates the entry position on the educational material 20 for the entry contents of the correct / incorrect determination whose shape has been recognized by the figure shape recognition unit 10. The entry position may be calculated by, for example, coordinate analysis on the educational material 20.

  The scoring and summing unit 12 recognizes the content of the correct / incorrect determination by the graphic shape recognition unit 10, the calculation result of the correct / incorrect determination by the input position calculation unit 11, and the teaching material stored and accumulated in the database unit 1. On the basis of the scoring information about each answer column 21 of the educational material 20 included in the electronic data 20, the educational material 20 for scoring after the image reading unit 2 has read the image. The score for correct / incorrect judgment entered in 20 is counted.

  When this score totaling is performed, the score totaling unit 12 performs a process of associating correctness determination symbols (scoring symbols) such as “◯” and “x” with each answer column 21 of the educational material 20. The totaling result output unit 13 outputs the result of scoring totaling by the scoring totaling unit 12 in association with the answerer information extracted by the answerer extracting unit 7.

  The database device 14 stores the image data of the educational material after scoring, which is a completed document read by the image reading unit 2, and stores the scoring and counting result output from the counting result output unit 13.

  The confirmation / correction unit 15 includes a display unit and a correction input unit, and can be confirmed by the user by appropriately displaying the saved contents of the database device 14, that is, the automatic scoring result on the display unit, and automatically by the user's operation. The content of scoring results can be modified as appropriate. The automatic scoring result confirmation / correction processing in the confirmation / correction unit 15 is a feature of the present invention, and details thereof will be described later.

  Of the constituent elements described above, that is, the database unit 1 to the confirmation / correction unit 15, the image reading unit 2 is realized by using a copier, a multifunction peripheral, or a scanner device having a function as an image reading device. It is possible to do. In this case, when an automatic document feeder (ADF) is attached to the image reading unit 2, it is possible to continuously read images for a plurality of educational materials.

  Further, other components other than the image reading unit 2, that is, the database unit 1, the image data analysis unit 3 to the confirmation / correction unit 15, are information by executing a predetermined program like a PC (personal computer), for example. It can be realized by using a computer device that realizes a storage processing function, an image processing function, an arithmetic processing function, and the like.

  In that case, it is conceivable that predetermined programs necessary for realizing the functions of the database unit 1, the image data analysis unit 3 to the confirmation correction unit 15 are installed in the PC in advance. However, it may be provided by being stored in a computer-readable storage medium instead of being installed in advance, or distributed via wired or wireless communication means. .

(Educational material processing procedure)
Next, an example of the procedure of the automatic scoring process in the teaching material processing apparatus according to this application example configured as described above will be described with reference to the explanatory diagram of FIG.

  When using the teaching material processing apparatus, first, students enter information such as names in the answerer information field 23 and answers in the answer field 21 by students, and further fill in each answer field 21 by a teacher or the like. The image reading unit 2 reads the image of the educational material 20 in which the correctness / incorrectness scoring symbol such as “O” or “×” is written for the answer, and obtains image data from the educational material 20. (Step S101).

  At this time, if ADF is used, for example, a plurality of educational teaching materials 20 to be processed in one group such as the same class are read in a batch, and images are continuously acquired from the educational teaching materials 20. Data can be obtained. The image data obtained by reading the image is once stored in a memory or the like used as a work area.

  Thereafter, the following automatic scoring process is sequentially performed on each image data obtained from each educational material 20 (step S102).

  That is, the image data analysis unit 3 performs an analysis process on image data obtained from a single educational material 20, and the educational material determination unit 4 identifies and specifies the educational material 20 based on the result of the analysis process. Do. This identification and specification may be performed through title analysis such as “science”, “five years”, “1. change in weather and temperature” or code analysis of code information embedded in the identification information column 22. Through this identification specification, the teaching material determination unit 4 can specify electronic data to be compared with the image data obtained by the image reading unit 2.

  This identification and identification may be performed sequentially for each of the plurality of educational materials 20 from which the image reading unit 2 has read the image, but all the educational materials 20 that are generally processed in one group are all included. Since they are the same, it is only necessary to perform the educational material 20 that is processed first during the batch processing.

  When the teaching material discriminating unit 4 specifies the electronic data, the database unit 1 takes out the corresponding electronic data from the stored and stored according to the specifying result, and transfers it to the difference extracting unit 6.

  For image data obtained from a single educational material 20, the distortion correction unit 5 corrects image distortion in the image data. This image distortion correction is performed in order to correct image distortion that may occur when the image reading unit 2 reads an image for the purpose of improving accuracy such as comparison with electronic data and subsequent difference extraction. Is called.

  The difference extraction unit 6 compares the electronic data delivered from the database unit 1 with the image data obtained by the image reading unit 2 and corrected for image distortion by the distortion correction unit 5, respectively. The difference is extracted. By this difference extraction, the contents entered in the answerer information field 23 and each answer field 21 and the contents entered for correct / incorrect determination for each answer field 21 are extracted.

  When the difference extraction unit 6 extracts the difference, the answerer extraction unit 7 thereafter extracts the answerer information in the educational material read by the image reading unit 2 through character recognition processing or the like for the difference. As a result, it is possible to specify the class, attendance number, name, etc. of the person who entered the answer in one educational material 20 for education.

  Further, for the difference extraction result by the difference extraction unit 6, in order to extract the contents of correct / incorrect determination entry in each answer column 21, the correct / incorrect determination extraction unit 8 further extracts a result for the predetermined color component from the difference extraction result. Specifically, for example, a red component is extracted. The extraction of the predetermined color component can be performed by paying attention to the color component data constituting the pixel data, for example, when the difference extraction result is composed of pixel data.

  However, in general, the correctness / incorrectness graphic entry such as “O” and “X” on the educational material 20 is used for the question sentence, the frame for identifying each answer column 21, the contents of the answer entry in each answer column 21, etc. Often done in layers. Therefore, the extraction result of the predetermined color component by the correctness / error determination extraction unit 8 may be a result of removing the overlapped portion, that is, a discontinuous portion in a figure such as “◯” or “×”. Therefore, the interruption correction unit 9 performs the interruption correction process on the extraction result of the predetermined color component by the correctness / error determination extraction unit 8.

  The above is the description of the basic configuration and processing of the teaching material processing apparatus to which the present invention is applied.

[Embodiment]
Next, a specific configuration and operation of the confirmation / correction unit 15 that performs image processing according to the present invention, for example, image processing for confirmation / correction of automatic scoring results in the teaching material processing apparatus will be described. FIG. 4 is a block diagram illustrating a schematic configuration example of the confirmation correction unit 15 in the teaching material processing apparatus as the image processing apparatus according to the embodiment of the present invention.

  As shown in FIG. 4, the confirmation / correction unit 15 according to the present embodiment includes a correction / confirmation start instruction unit 41, a target answer determination unit 42, a superposition position determination unit 43, a superposition unit 44, a display unit 45, and a correction input unit 46. It has composition which has.

  In FIG. 4, an answer information storage unit 51 corresponds to the storage unit of the database unit 1 of FIG. 1, and answer information about educational materials (hereinafter referred to as “answers”), for example, the class shown in FIG. Coordinate information (position information) such as an answerer information field 23 in which a name and the like are handwritten and a score field 24 in which a score of a scoring result is handwritten is stored.

  The scoring result storage unit 52 and the image data storage unit 53 correspond to the storage unit of the database device 14 of FIG. Then, the scoring result storage unit 52 outputs the scoring result by the scoring summing part 12 associated with the answerer information extracted by the solver extracting part 7 in FIG. The score totaling result output from the unit 13 is stored and saved. The image data storage unit 53 stores and saves the image data of the answer after the grading, which is a completed document read by the image reading unit 2.

  The correction / confirmation start instruction unit 41 performs an automatic scoring result confirmation / correction start instruction by a user operation. In response to the confirmation / correction start instruction from the correction / confirmation start instruction unit 41, the target answer determination unit 42 determines the answer to be subjected to the automatic scoring result confirmation / correction as an answer information storage unit 51 and a scoring result storage unit 52. And is specified to the image data storage unit 53.

  By specifying the answer to be confirmed / corrected, the answer information storage unit 51 outputs answer information about the specified answer to the superposition position determination unit 43, and the scoring result storage unit 52 scores the result of the specified answer Is output to the superimposing unit 44, and the image data storage unit 53 outputs image data for the designated answer to the superimposing unit 44.

  Based on the answer information given from the answer information storage unit 51, the superimposition position determination unit 43 displays the answerer information such as class, name, score, and score information given from the scoring result storage unit 52 on the display screen. A coordinate position to be superimposed on the answer image (data) given from the storage unit 53 is determined. Specifically, the position near the handwritten information handwritten on the answer image, that is, the position near the answerer information field 23 or the score field 24 shown in FIG.

  The superimposing unit 44 determines the answerer information such as the class, name, score, etc. given from the scoring result storage unit 52 to the coordinate position of the answer image given from the image data storage unit 53 determined by the superposition position determining unit 43. Superimpose information. At this time, as shown in FIG. 5A, in the case of superimposing images, the answerer information and the score information given from the scoring result storage unit 52 are rasterized, and the answerer information and the score information are converted into the answerer information. The positions in the vicinity of the column 23 and the score column 24 may be superimposed. As a result, it is possible to compare the answerer information handwritten in the answerer information field 23 with the answerer information acquired by the automatic scoring process.

  In addition, when superimposing on an image, in addition to automatic scoring, a scoring person such as a teacher performs scoring processing, and the scoring result is compared with the scoring column 24 as shown in FIG. May be handwritten with a red pen. In this case, in addition to the comparison between the answerer information handwritten in the answerer information field 23 and the answerer information acquired in the automatic scoring process, the score information handwritten in the score field 24 and the automatic scoring Comparison with the score information acquired by the processing becomes possible.

  In addition to the method of superimposing with an image, it is also possible to adopt a method of converting answerer information and score information given from the scoring result storage unit 52 into an electronic sticky note and superimposing it on the answer image as shown in FIG. It is. Furthermore, as shown in FIG. 6B, a method of displaying the answerer information and the score information given from the scoring result storage unit 52 in a region different from the region of the answer image given from the image data storage unit 53. It is also possible to take.

  The display unit 45 displays the answer image superimposed by the superimposing unit 44 and the answerer information and score information on the screen. This display allows the user to display the answerer information and score information handwritten in the answer image by the answerer such as students and the grader such as the teacher, and the answerer information and score information written in handwriting. The answerer information and the score information acquired by the extraction by the answerer extraction unit 1 of 1 are compared, and the acquisition result of the answerer information (recognition result in the handwritten OCR unit 72 in FIG. 1) and the automatic scoring result are incorrect. It can be confirmed whether or not there is.

  The correction input unit 46, when confirming the automatic scoring result by the user on the display screen of the display unit 45, if there is an error in the acquisition result of the answerer information or the automatic scoring result, the error is caused by the operation by the user. Input the correct part. The correction result is stored and saved in the scoring result storage unit 52.

  At the time of correction by the correction input unit 46, a predetermined display area is corrected, or information that is converted into an electronic tag is corrected. In correcting the paired information, when one information is corrected, the other information is corrected in conjunction with the correction of the one information. For example, since the attendance number and the name are in a pair relationship, when the attendance number (or name) is corrected, the name (or attendance number) is also corrected in conjunction with it. Alternatively, since individual questions (questions) and their scoring are in a pair relationship, if the correctness of individual questions is corrected, the total points (scores) are also corrected.

  About each component of the confirmation correction part 15 demonstrated above, ie, the correction / confirmation start instruction | indication part 41, the target answer determination part 42, the superimposition position determination part 43, the superimposition part 44, the display part 45, and the correction input part 46, it is a personal computer. It may be realized by a software configuration using a computer device that executes functions such as information storage processing, image processing, and arithmetic processing by executing a predetermined program, such as (PC). However, the present invention is not limited to the implementation by software configuration, and can also be implemented by a hardware configuration or a combined configuration of hardware and software.

  When realized by a software configuration, a program that causes a computer to function as the target answer determination unit 42, the superimposition position determination unit 43, and the superposition unit 44 is an image processing program according to the present invention. In this case, the correction / confirmation start instruction unit 41 corresponds to an input unit such as a mouse, the display unit 45 corresponds to a display, and the correction input unit 46 corresponds to an input unit such as a keyboard.

  It can also be said that the program for executing the processing of each processing step in the processing sequence of the automatic scoring result confirmation / correction processing described below is an image processing program according to the present invention. These image processing programs may be installed in the computer in advance. However, it may be provided by being stored in a computer-readable storage medium instead of being installed in advance, or distributed via wired or wireless communication means. .

  Next, an example of the procedure of the automatic scoring result confirmation / correction processing, which is image processing according to the present invention, will be described using the flowchart of FIG. A series of processing described below is executed under the control of a computer processor.

  In the automatic scoring result confirmation / correction process, the correction / confirmation start instruction unit 41 shown in FIG. 4 issues a confirmation / correction start instruction by a user operation. When the confirmation / correction start instruction is given, an answer to be confirmed / corrected is first designated (step S11). The process of step S11 corresponds to the process of the target answer determination unit 42 in FIG. In this answer designation, for example, when checking and correcting the answers of all students in a certain school year and a certain group, for example, a process of designating sequentially from the answer of the student with attendance number “1” is performed.

  Next, coordinate information (position) such as answer information about the designated answer, for example, the answerer information field 23 in which the class and name shown in FIG. 2 are handwritten and the score field 24 in which the score of the scoring result is handwritten. Information) from the answer information storage unit 51 (step S12), and then, based on the obtained answer information, answerer information such as class, name, score, etc. and scoring results such as score information are displayed on the display screen. A coordinate position to be superimposed on the image is determined (step S13). The process of step S13 corresponds to the process of the overlapping position determination unit 43 in FIG.

  Next, scoring results such as answerer information and score information are superimposed on the determined coordinate position on the answer image (step S14), and the superimposed information is output to a display (corresponding to the display unit 45 in FIG. 4) ( Step S15). The processes in steps S14 and S15 correspond to the process of the superimposing unit 44 in FIG. As a result of this processing, for example, as shown in FIG. 5 (A), the scoring result is displayed in the vicinity of the answerer information and scoring information handwritten in the answer image by the answerer such as the student or the grader such as the teacher. (Answerer information and score information extracted by the answerer extraction unit 7 in FIG. 1) is displayed.

  In this display state, the user displays the answerer information and score information handwritten in the answer image by the answerer such as students and the grader such as teacher, and the answerer information and score information written in handwriting. The answerer information and score information acquired by extraction by the answerer extraction unit 7 in FIG. 1 are compared with each other to obtain the answerer information acquisition result (recognition result in the handwritten OCR unit 72 in FIG. 1) and the automatic scoring result. Check if there are any errors.

  At the time of this confirmation, it is determined whether or not there is a correction input by the user (step S16). If there is a correction input, the correction portion is corrected according to the correction input (step S17). Next, it is determined whether or not the information to be corrected is a pair of information (step S18). If the information to be corrected is one of the paired information, the other information is corrected to the one information. It is corrected in conjunction with (step S19). And the correction result is memorize | stored and preserve | saved at the scoring result memory | storage part 52 which is a database part (step S20).

  As described above, for example, in an automatic scoring system in a teaching material processing apparatus, when displaying an image of a read answer (completed document) on a display screen, an answerer information column 23 which is a handwritten entry area of the answer In the vicinity of the score column 24, a processing result (scoring result) of a predetermined process (automatic scoring process in the present embodiment) and an acquisition result from the answer image (answerer information extracted by the answerer extraction unit 7 in FIG. 1) By displaying “”, the user who confirms the display content can compare the entry information actually written in the answer with the acquisition result and the scoring result from the image of the answer.

  Further, as shown in FIG. 5B, when the score information of the scoring result is handwritten by the grader such as a teacher in the score column 24 of the answer as entry information, the user can enter the handwritten entry information. The score information and the scoring result by the automatic scoring process can also be compared on the display screen.

  In this way, the user can compare the entry information actually written in handwriting with the acquisition result and scoring result from the image of the answer displayed in the vicinity thereof, so that the user can obtain the acquisition result from the answer image (handwriting in FIG. 1). (Recognition result by the OCR unit 72) and the automatic scoring result is correct or wrong, or in which part there is an error, so if there is an error, the corresponding part Can be reliably corrected. Therefore, the user (scorer such as a teacher) does not get confused as to whether or not the result obtained from the answer image (recognition result) and the scoring result can be trusted as they are.

  In the above embodiment, the case where the present invention is applied to the automatic scoring result confirmation / correction processing in the automatic scoring system in the teaching material processing apparatus has been described as an example. However, the present invention is not limited to this application example, and handwriting is performed. For image processing in general, which extracts entry information from the completed document based on the comparison result between the original document and the completed document that has been handwritten in the entry area and additional information added to the area other than the handwritten entry area. It is applicable to.

  As another application example, for example, based on the comparison result between a blank questionnaire sheet and a completed questionnaire sheet, a check symbol such as “○” or “×” is extracted from the completed questionnaire sheet, and the extraction result Checking / correcting the counting results in a questionnaire counting system that performs counting processing based on this.

1 is a system configuration diagram illustrating an example of a basic configuration of an image processing apparatus to which the present invention is applied. It is explanatory drawing which shows a specific example of the educational material. It is explanatory drawing about an example of the procedure of the automatic scoring process in the teaching material processing apparatus which concerns on this application example. It is a block diagram which shows the example of schematic structure of the confirmation correction part in the teaching material processing apparatus which concerns on one Embodiment of this invention. It is FIG. (1) which shows the example of a display which displays answerer information and score information superimposed on an answer image. It is FIG. (2) which shows the example of a display which displays answerer information and score information superimposed on an answer image. It is a flowchart which shows an example of the procedure of the confirmation / correction process of an automatic scoring result.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1 ... Database part, 2 ... Image reading part, 3 ... Image data analysis part, 4 ... Teaching material discrimination | determination part, 5 ... Distortion correction part, 6 ... Difference extraction part, 7 ... Answerer extraction part, 8 ... Correct / error determination extraction part, DESCRIPTION OF SYMBOLS 9 ... Discontinuation correction | amendment part, 10 ... Graphic shape recognition part, 11 ... Entry position calculation part, 12 ... Score totaling part, 13 ... Counting result output part, 14 ... Database apparatus, 15 ... Confirmation correction part, 20 ... Educational teaching material, DESCRIPTION OF SYMBOLS 21 ... Answer column, 22 ... Identification information column, 23 ... Answerer information column, 24 ... Score column, 41 ... Correction / confirmation start instruction part, 42 ... Target answer determination part, 43 ... Superimposition position determination part, 44 ... Superimposition part 45 ... display unit, 46 ... correction input unit

Claims (6)

Storage means for storing position information of a handwritten entry area to be handwritten on the original document;
Reading means for reading an image of a completed document that is handwritten in the handwritten entry area and in which additional information is additionally written in an area other than the handwritten entry area;
Obtaining means for obtaining entry information of the handwritten entry area from an image of the completed document read by the reading means;
Extraction means for extracting the additional information added to the completed document based on a comparison result of the images of the completed document and the original document;
Processing means for performing predetermined processing on the additional information extracted by the extraction means;
The image of the completed document read by the reading means is displayed, and the processing result by the processing means and the acquisition means are in the vicinity of the handwritten entry area based on the position information stored in the storage means. An image processing apparatus comprising: display means for displaying an acquisition result. 2. The image processing apparatus according to claim 1, wherein the display unit displays the processing result by the processing unit and the acquisition result by the acquisition unit as images. 2. The image processing apparatus according to claim 1, wherein the display unit displays the processing result by the processing unit and the acquisition result by the acquisition unit as electronic sticky notes. 2. The image processing apparatus according to claim 1, wherein the display unit displays the processing result by the processing unit and the acquisition result by the acquisition unit in a region different from the region of the image of the completed document. A correction unit for correcting the processing result by the processing unit and the acquisition result by the acquisition unit;
2. The image according to claim 1, wherein when correcting one piece of information, the correction unit corrects the other information in conjunction with the correction of the one information when correcting the paired information. Processing equipment. A storage step for storing position information of a handwritten entry area to be handwritten on the original document;
A reading step of reading an image of a completed document in which handwritten information is written in the handwritten writing area and additional information is additionally written in an area other than the handwritten writing area;
An obtaining step of obtaining entry information of the handwritten entry area from an image of the completed document read in the reading step;
An extraction step of extracting the additional information added to the completed document based on a comparison result of the images of the completed document and the original document;
A processing step of performing a predetermined process on the additional information extracted in the extraction step;
The image of the completed document read in the reading step is displayed, and the processing result in the processing step and the acquisition in the acquisition step in the vicinity of the handwritten writing area based on the position information stored in the storage step An image processing program causing a computer to execute each process of a display step for displaying a result.

Images