JP2008003739A - Input correction method, postscript information processing method, postscript information processor, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To securely and easily enhance recognition efficiency of handwritten input information in a system for automatic data processing on the basis of the handwritten input information. <P>SOLUTION: An input correction method presents not only ideal reference information corresponding to the handwritten input information as an improvement method but also presents a concrete correction method, by which a writer may determine how to write the handwritten input information so as to enhance recognition performance in recognition processing, as improvement aspect information. For instance, the correction method presents handwritten information and an image deformation result in recognition processing side-by-side. As for the ideal reference information and difficult-to-recognize information, the correction method obtains a reliability of recognition processing to the reference information from a combination of a feature quantity, and arranges and presents the difficult-to-recognize information at the positions of the corresponding distances by associating the levels of the reliability with distances from the reference information. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to an input correction method, a write-once information processing method, a write-once information processing apparatus, and a program to which the input correction method is applied. More specifically, for example, it is used when additional information (also referred to as additional information or annotation) additionally written in a document by handwriting is separated from the document body and used for various information processing related to the document body. This relates to a mechanism for correcting input additional information.

  In today's remarkable progress in information processing technology, there is a mechanism for automatically processing various processes related to documents. For example, additional additional information is additionally written by hand on a document original in which predetermined information is written in advance, and the additional document with the additional information added is processed, based on the additional information added by handwriting. There is a mechanism for automatically executing predetermined data processing.

  For example, there is an automatic form processing mechanism (see, for example, Patent Documents 1 and 2), a date and a schedule entry field in which information is entered by handwriting on a standard form (so-called form) and the entered information is processed. There is also a mechanism for personal information management (particularly referred to as schedule management) (see Patent Document 3) in which a schedule is written by hand in a prepared notebook, memo or the like, and the entered schedule is converted into electronic data.

  Also, in schools, school cram schools, etc., automatic scoring and summarization processing is performed on papers (educational teaching materials) that result from scoring on answer sheets filled with answers by students and examinees. A mechanism is also considered (see Patent Document 4).

JP-A-5-342239 JP-A-6-274156 JP-A-5-216932 Japanese Patent Laid-Open No. 11-31046

  For example, in Patent Document 1, an identification mark for designating the type of table, the position in the row direction and the position in the column direction of each data in the table is added, and the table data is printed as a data table form with an identification mark. By reading the recognition mark attached to the data table form with the mark reading unit, the form is identified from the identification data and the corresponding table data is displayed on the display unit, and the corresponding part is corrected. A mechanism has been proposed in which data can be corrected and collated efficiently with a small amount of work by displaying in a possible state.

  Japanese Patent Application Laid-Open No. 2004-228561 converts an output document into image data, displays the converted image data, indicates form specified position coordinates on the displayed image, and based on the instructed form specified position coordinates. Form graphic data can be derived and the form can be overlaid on the image data displayed on the display unit based on the derived form graphic data so that a form for a desired output document can be created easily. A mechanism has been proposed.

  Further, in Patent Document 3, as a mechanism for managing personal information, paper such as a written notebook is input from a scanner, characters and frame lines are detected by a known method, and the detected characters and frame lines are detected. There has been proposed a mechanism for collating the layout with knowledge of a notebook format stored in advance and generating data representing the attributes of each description item.

  Information handwritten in a notebook or memo (in this example, the written description of a schedule entered in the notebook in handwriting) is automatically converted to electronic data, and each written item is switched in correspondence with the generated attribute. When the user requests output of a certain format, the contents of the database are printed at a location corresponding to each content on the paper by referring to the output format stored in advance. It can be useful.

  Further, in Patent Document 4, a handwritten entry field on an answer sheet is defined as an input area on the tablet, and format data that defines the input area to be aggregated is stored in a storage device, and the answer is stored in the tablet. Key entry after scoring, etc., by entering the information entered in the handwritten entry field as written data entered in the tablet input area and recognizing characters with the sheets superimposed A mechanism has been proposed to save labor in data input by.

  On the other hand, when executing data processing based on additional information input by handwriting, the problem is how to recognize the input handwritten information (characters and figures), and automatic recognition of such handwritten information. Various mechanisms are considered.

  For example, as a mechanism for recognizing handwritten characters, first, input character information representing the characteristics of characters input by handwriting is extracted, and the input character information is compared with reference character information provided in advance to input reference character information. A mechanism for creating candidate character strings in descending order of similarity to character information is conceivable.

  In addition, as a mechanism for recognizing handwritten characters, a mechanism in which a character (operator) learns character shapes and the like to improve the character recognition rate is also considered (see, for example, Patent Document 5). ).

JP-A-9-223191

  In the mechanism described in Patent Document 5, when another character is selected when the first candidate character is not a desired character, the candidate character detailed information of the selected character is superposed on, for example, a handwritten input character. A mechanism for displaying on a predetermined display surface under a preset condition such as displaying on a first display surface has been proposed. The writer can learn an accurate character shape and the like by comparing the handwritten input character with the selected character.

  However, in the mechanism described in Patent Document 5, only an accurate character and an input character are compared and displayed, and the writer confirms each display of the handwritten input character and the selected character. Therefore, it is difficult for the writer to appropriately determine a specific improvement method. In contrast to the input characters that have been filled out, it shows the ideal selected characters (standard information) as an improvement method, but with this alone, the writer himself will determine where to improve and how to improve, It just asks the writer for a complete entry.

  In other words, it only informs the writer of the characteristics of the correct character, that is, it only instructs to write in the correct character. It cannot be easily determined how much the character recognition accuracy is improved if the correction is made.

  As a result, the accuracy of character recognition is not necessarily improved just because a certain part is corrected and entered in the next character input. There may be other corrections that can be used to further improve the character recognition rate.

  In other words, with the mechanism described in Patent Document 5, it is difficult to reliably and easily achieve improved character recognition accuracy because it is left to the writer to determine the specific improvement method and complete entry is required. is there.

  The present invention has been made in view of the above circumstances, and an object thereof is to provide a mechanism capable of improving the recognition efficiency of handwritten input information more reliably and easily.

  In the mechanism according to the present invention, information other than the reference information corresponding to the additional information inputted additionally is provided, and improvement mode information indicating how the additional performance improves the recognition performance during the recognition process is presented. I did it. In addition, “reference information” may be presented together with “improvement mode information”, or “improvement mode information” may be configured and presented as a whole including “reference information”.

  Instead of presenting only perfect (ideal) reference information corresponding to handwritten input information as an improvement method, a more specific correction method for improving recognition performance is presented as improvement mode information. . Rather than relying on the writer to decide on a specific improvement method, the improvement mode information is such that it is possible to determine how much the recognition rate will improve if it is modified and entered. It is shown in

  The mechanism according to the present invention can be realized by software using an electronic computer (computer), and a program for this purpose and a recording medium storing this program can also be extracted as an invention. The program may be provided by being stored in a computer-readable storage medium, or may be provided by distribution via wired or wireless communication means.

  According to the present invention, since the improvement mode information indicating how the additional information input additionally written is corrected and entered can improve the recognition performance during the recognition process, the writer is ideal. Even if the reference information does not completely match, it is possible to easily determine how and how much the recognition rate is improved by correcting where and how to correct it.

  Therefore, it is possible to easily and reliably improve the recognition rate by prompting the entry of additional information suitable for recognition. That is, the recognition performance can be achieved more reliably by performing the next entry in accordance with the presented improvement mode information. Moreover, it is possible not only to present perfect (ideal) reference information but also to provide a correction method that can improve recognition performance even a little, so that the recognition efficiency of handwritten input information is easily improved. It can also be done.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

<Example of processing target document>
FIG. 1 is a diagram showing an example of a document to be processed in an information processing system including an additional information processing apparatus according to the present invention.

  The document shown in FIG. 1 is an educational material 80 used as a paper medium in an educational setting, and typically has a question sentence 82 and an answer column 84 (part shown in parentheses in this example). FIG. 1 (A) shows the original document 8A, and FIG. 1 (B) schematically shows a state in which additional information has been entered (added document 8B). An example of registration information in the database is shown in (C).

  Specifically, the educational material 80 corresponds to a paper test or a practice question sheet used in an educational institution. The educational material 80 only needs to have at least an answer column 84. For example, an answer may be written in the answer column 84 for a question read by the grader, and the question sentence 82 is not necessarily described. Not necessary.

  As shown in FIG. 1 (A), the educational material 80 includes not only a question sentence 82 and an answer field 84 in which an answer, which is an example of the first type of additional information, but also a scoring field 83 (by question). An item score field 83a, a partial score field, and a total score field 83b), and an identification information field 85 for entering information for identifying and specifying the educational material 80 as an example of the first type of additional information; , Answerer information which is an example of the first type of additional information, and an answerer information column 86 in which information related to the answer entry person in the answer column 84 is entered. The answer field 84, the identification information field 85, and the answerer information field 86 are all examples of entry fields for entering the first type of additional information.

  In the identification information column 85, for example, the subject, title, or applicable grade of the educational material 80 is described in advance. However, in addition to these descriptions or separately from these descriptions, code information for identifying the educational material 80 may be embedded.

  The embedding of the code information may be realized by using a known technique. As one specific example, for example, a line screen or a dot screen as a gradation expression such as a so-called “iTone (registered trademark)” is used. It is conceivable to use a technique of embedding digital information in a halftone image by changing the form (position, shape, etc.) of the pixels constituting the image. On the other hand, in the answerer information column 86, the class 86a, attendance number 86b, name 86c, etc. of the answer entry person can be entered.

  In the scoring field 83 (particularly, the item scoring field 83a), scoring information for each answer field 84 is entered. Scoring information is information for identifying the number of points assigned to the answer column 84 at each position for each answer column 84 in the educational material 80. The points may be different for each answer column 84 or may be uniform.

  Such educational teaching material 80 can be obtained by printing out with a printing apparatus based on the electronic data of the corresponding original (teaching material original). The electronic data of the original teaching material can be generated using application software such as word processing software using an electronic computer such as a personal computer, and is stored in a predetermined database or the like in advance.

  The electronic data of the original teaching material can specify the layout of the answer column 84 and the identification information column 85 in the educational teaching material 80 and can be stored and accumulated in a predetermined database. Any data format is acceptable. For example, the application document data created by the document creation software is not limited to image data.

  At the educational site, educational teaching material 80, which is an example of the original document 8A shown in FIG. 1A, is distributed to students, examinees, etc. First, the names and answer fields 84 to the answerer information field 86 are assigned by the students. The first type additional information such as the answer to is entered in a predetermined column and collected. After this, a scoring symbol (correct / incorrect determination) for the answer entered in each answer field 84 by a scoring officer such as a teacher, as in the additional information filled teaching material 81 which is an example of the added document 8B shown in FIG. The second type of additional information such as a comment 88 indicated by a graphic) 87 or other graphic or text related to the scoring symbol 87 is entered. Note that since the additional information processing apparatus 10 performs automatic scoring processing, there is no entry in the scoring field 83C by the scoring officer at this time.

  In this case, the pen color usually used for the entry of the first type of additional information by the student is different from the pen color used for the entry of the second type of additional information by the grader or the like. The color used is different from the color pre-filled as the educational material 80.

  In addition, as the scoring symbol 87, for example, “O” indicating a correct answer and other figures (for example, an elliptical figure), “X” indicating an incorrect answer and other figures (for example, a check mark such as “R”), There are “△” indicating a correct answer and other figures.

  The comment 88 is information that does not have a direct relationship with the first data processing based on the scoring symbol 87, but supports (reinforces) the result of the first data processing or has no relationship at all. It is used for data processing.

  In the learning material automatic scoring system, predetermined data processing is performed for the additional information filled learning material 81 which is an example of the added document 8B. At this time, in addition to the second type of additional information (in this example, scoring symbol 87 and comment 88), individual data processing corresponding to each is performed. In this example, automatic scoring processing based on the scoring symbol 87 is performed as the first data processing. As this automatic scoring processing result, for example, scoring information to be entered in the scoring field 83C is acquired. Further, the second data processing different from the automatic scoring processing result based on the additionally written contents of the comment 88 is performed.

  As a second data process different from the automatic scoring process, for example, a process for classifying the additional contents of the comment 88 based on a predetermined condition, a classified comment (not only all the additional contents but also a part of the additional data) The content may be registered) and stored in the student guidance database in association with the scoring processing result for the corresponding answer column 84.

  In this way, as a use form of the second data processing different from the automatic scoring process, information can be taken out from the student guidance database and used for subsequent student guidance. For example, if all the scoring results and the corresponding comments are displayed, the scoring results can be confirmed together with the subcategories of evaluation such as excellent, excellent, average, inferior. In addition, if only comments with incorrect answers are displayed, it can be used to analyze the ability of students who have many mistakes in reading questions, many mistakes in writing answers, or many calculation errors. Alternatively, it may be used for student guidance based on a cautionary note or mistake correction indicated by the comment 88.

  In addition, when registering the educational material 80 (original image) for executing data processing for the scoring symbol 87 and the comment 88 in the database, it is usually necessary when processing the data for the scoring symbol 87. The entry field position area information 38 indicating the position information, the question number, the scoring information, etc. of the answer field 84 and the classification reference information necessary for data processing for the comment 88 are registered. It should be noted that the information of the educational material 80 itself is text data or document file data corresponding to the text data so that a character part (for example, a question sentence including a question number or a score) in the educational material 80 can be referred to as text information. It is preferable to preserve it.

  For example, as shown in FIG. 1C, the answer field position area information, which is an example of the entry field position area information 38, is replaced with the number of the problem existing on the educational material 80 (an example of first attribute information). , Points assigned to the answer of the question (an example of second attribute information), the xy coordinates of a predetermined point (for example, the upper left vertex) of the area treated as the answer field 84 for entering the answer of the question, and the circumscribed rectangle Information consisting of a width (W) and a height (h) is stored and accumulated in a predetermined storage area in a table format that associates them with each other.

  When the original teaching material 80 corresponding to the additional information filled teaching material 81 is not registered in the document management server, the blank teaching material 80 is read by the document input device, and the position of the question sentence and the answer column 84 are read. This is dealt with by specifying points and points.

  In addition, when executing automatic data processing for additional information, if additional information is classified into a plurality of types and individual data processing is to be performed for each classification, each additional information is assigned to the other It is necessary to identify and identify them separately. If the separation and recognition of both are not properly performed, the respective data processing cannot be properly performed.

  For example, in the case of the additional information-added teaching material 81 shown in FIG. 1, there are an automatic scoring process based on the scoring symbol 87 and a student guidance database construction process based on the comment 88, and such individual processing is realized. In this case, it is necessary to distinguish between the grading symbol 87 and the comment 88 and perform a recognition process or the like before performing a final data process.

  On the other hand, in scoring the answer, a comment 88 other than the scoring symbol 87 may be described with the same pen as that of the scoring symbol 87. For example, the pen color corresponds to the pen color through color component recognition processing on the extraction result in the difference extraction unit 132. By simply extracting the predetermined color component, it is not possible to recognize the two appropriately and specify the description. The scoring symbol 87 and the comment 88 cannot be properly separated, which adversely affects the automatic scoring process. In addition to the scoring symbol 87 for automatic scoring processing, the postscript information 81 after returning the additional information filled teaching material 81 to the student, although there is a comment 88 that can be used for student guidance etc. , It will be a situation where students can not use it other than confirming the description.

  In order to avoid such a situation, for example, a plurality of additional information existing in the additionally written document 8B is based on various features of additional information such as a description position, an image feature amount, or reliability during recognition processing. Thus, it is preferable to classify (separate) into a plurality of types. At this time, it is preferable to perform more accurate separation recognition by referring to a plurality of features as well as based on a single feature of the additional information. In addition, detailed description is omitted about these.

<System configuration>
FIG. 2 is a diagram illustrating a configuration example of an embodiment of an information processing system including the postscript information processing apparatus according to the present invention. Note that this information processing system is shown as an application example to a teaching material automatic scoring system that targets teaching materials 80 such as answer sheets.

  As shown in the figure, the automatic teaching material scoring system 1 includes a write-once information processing device 10 that forms the center of the system, and a document input device that digitizes and inputs additional information-filled learning material 81 that is a processing target document into the write-once information processing device 10. 20, a document management server 30 that stores electronic data of the template 6 corresponding to the additional information filled teaching material 81 that is the processing target document and the educational teaching material 80 (specifically, the original image), and information processing (automatic in this example). A processing result storage server 40 that stores results of scoring processing and the like is connected to the network using wired or wireless communication.

  The document input device 20 enters an answer in the answer field 84 in the educational material 80, fills in the name in the answerer information field 86, and a scoring symbol 87 by the grader for the answer entered in the answer field 84 (specifically, For example, the additional information filled teaching material 81 in which “○” or “×” is entered) is read using a known optical image reading technique, and the additional information filled teaching material 81 is read. Image data is obtained from the image data.

  The document input device 20 only needs to have a function of converting the additional information-filled teaching material 81, which is a processing target document, into electronic data. For example, a copying machine, a multifunction device, or It can be realized by using a scanner device. In that case, if an automatic document feeder (ADF) is attached, it is convenient that images can be read continuously for a plurality of educational materials.

  Note that the test using the educational material 80 is not limited to using a paper medium. For example, in the case where a test is performed using a tablet PC and the scoring is performed, the teaching material 81 in which the additional information has been entered can be obtained from the beginning in the form of electronic data. In this case, the document input device 20 is included in the system configuration. Is no longer necessary.

  The document management server 30 obtains the original image of the educational material 80 corresponding to the additional information-filled educational material 81, and identification information and identification codes such as subjects, titles, and applicable grades for specifying the original image. In association therewith, it is registered as a document original information database DB2 in a predetermined storage medium such as a hard disk device or an optical disk device.

  Further, the document management server 30 stores the original educational teaching material 80 (original image) corresponding to the additional information-added educational material 81, and also issues the problem number and the stipulation necessary for data processing for the grading symbol 87 and the comment 88. As shown in FIG. 1C, entry column position area information 38 indicating information and the like is held and accumulated as a document original information database DB2 in a predetermined storage area in a table format.

  The processing result storage server 40 may be any server that is connected to the appending information processing apparatus 10 through a network and can manage the automatic scoring and counting results for the additional information filled teaching material 81. For example, the processing result database apparatus or the processing Applicable to result file server devices.

  The postscript information processing apparatus 10 that forms the center of the teaching material automatic scoring system 1 includes a read image processing unit 110 that performs predetermined signal processing based on image data of the additional information filled teaching material 81 input from the document input device 20, and a reading A document original specifying unit 120 that identifies and specifies the original document 8A that is the basis of the read image input from the document input device 20 based on processing by the image processing unit 110 is provided. In the learning material automatic scoring system 1, the document original specifying unit 120 functions as a learning material specifying unit 122 that specifies an educational material 80 which is an example of the document original 8A.

  Further, the additional recording information processing apparatus 10 includes an additional recording information extraction unit 130 that extracts additional recording information (annotation) from the image data processed by the read image processing unit 110, and a data processing target extracted by the additional recording information extraction unit 130. The data processing target additional information specifying processing unit 150 for recognizing and specifying the description content and entry position based on the additional information, and data processing based on the description content of the additional information specified by the data processing target additional information specifying processing unit 150 And a data processing unit 170 to perform.

  Further, the postscript information processing apparatus 10 has a recognition performance improvement that presents to the user improvement mode information for improving the recognition performance of handwritten input information such as handwritten characters and figures as a component unique to the present embodiment. A technique presentation unit 180 is provided. The recognition performance improvement technique presentation unit 180 determines whether or not the handwritten input information (scoring symbol 87 or comment 88) handwritten on the educational material 80, which is an example of the original document 8A, is suitable for automatic recognition processing. , Improvement mode information is provided as support information so that the user can determine how the recognition rate should be improved.

  Here, the information indicating "how to improve the recognition rate" is information other than simply displaying the reference information corresponding to the additional information input additionally, Specifically, it means information that can determine the improvement method. For example, it presents information that can be used to determine how much of the additional information that has been added and how to correct and enter the additional information.

  Although not shown, the read image processing unit 110 performs well-known images such as layout analysis, character / graphic separation, character recognition, code information recognition, graphic processing, and color component recognition on the image data input from the document input device 20. An image data analysis unit that performs analysis processing using a processing technique (each detailed description is omitted), an inclination of image data input from the document input device 20, a scaling factor in the main scanning direction or the sub-scanning direction, and the like And a distortion correction unit that corrects image distortion.

  The distortion correction unit compares and collates the image data input from the document input device 20 with the corresponding original image in the document management server 30 to be compared, and corrects the image distortion (tilt, scaling, etc.). May be.

  The teaching material specifying unit 122 omits the illustration, but, for example, the identification that analyzes the identification information such as the subject, the title, or the applied grade that is entered in the identification information column 85 based on the data analysis result by the image data analysis unit An information analysis unit and a code information analysis unit that analyzes code information that identifies the educational material 80 embedded in the identification information field 85 are also included.

  The teaching material specifying unit 122 is identified based on the analysis result in the image data analysis unit, for example, identification information and identification codes such as subjects, titles, applied grades, and the like, and the teaching material 80 stored and stored in the document management server 30. If the corresponding original image is not stored and stored in the document management server 30 with reference to the information of the original image (for example, identification information or identification code such as subject, title, applied grade, etc.), it is obtained by the document input device 20. It is determined that the electronic data to be compared with the image data cannot be specified, and an identification specifying error signal is output.

  Note that the learning material specifying unit 122 only needs to be able to identify and specify the original educational material 80 corresponding to the image data input from the document input device 20 (corresponding to the additional information-filled learning material 81). The analysis unit only needs to be provided with an appropriate one corresponding to the format of the identification information described or embedded in the identification information column 85 of the additional information filled-in teaching material 81, and is not necessarily provided with both. .

  The postscript information extraction unit 130 includes image data whose image distortion has been corrected by the distortion correction unit, and image data specified by the teaching material specifying unit 122 and input from the document input device 20 (corresponding to the additional information filled teaching material 81). ) To the original image (corresponding to the educational material 80 for education) using a known image processing technique, and a difference extracting unit 132 for extracting a difference between them.

  Further, the additional information extraction unit 130 extracts answerer information (an example of the first type of additional information) in the additional information filled teaching material 81 to be read by the document input device 20 based on the extraction result by the difference extraction unit 132. The answerer extraction unit 134 that performs the same processing as that of the graded symbol 87 and the comment 88 in the additional information-filled teaching material 81 to be read by the document input device 20 based on the extraction result by the difference extraction unit 132. And a data processing additional information extraction processing unit 140 for extracting two types of additional information.

  Based on the extraction result by the difference extraction unit 132, the answerer extraction unit 134 obtains handwritten numbers and character images of answerers written in the class 88a, attendance number 88b, and name 88c fields of the answerer information column 86. Handwritten information extraction unit 136 that extracts the text information as it is, and handwritten information in the answerer information column 86 based on the extraction result by the difference extraction unit 132 (preferably about the handwritten information extracted by the handwriting information extraction unit 136) And a character recognition processing (OCR: Optical Character Reader) unit 138 that converts information into character data that can be processed and edited on the additional information processing apparatus 10.

  The answerer extraction unit 134 only needs to be able to extract the answerer information entered in the answerer information column 86 in the additional information-filled teaching material 81 to be read by the document input device 20. Any one of the character recognition processing units 138 may be provided. In addition, regarding the part of the comment 88 in which the character recognition processing unit 138 is not provided or the character recognition processing unit 138 cannot recognize the character, the extracted answerer information is handled as an image as it is.

  The additional write information extraction processing unit 140 for data processing refers to the additional write color information of interest and, based on the extraction result by the difference extraction unit 132, of the additional write information extracted by the additional write information extraction unit 130, the document input device 20. The data processing target additional information extracting unit 142 for extracting the data processing target additional information 9a (the scoring symbol 87 and the comment 88 in this example) in the additional written document 8B (in this example, the additional information-added teaching material 81) that has been read in (1). And an additional write information shaping unit 146 that shapes the additional write information of the data processing target extracted by the data processing target additional write information extraction unit 142 so as to withstand the data processing. In the present embodiment, the data processing target additional information extraction unit 142 includes functions of a scoring symbol extraction unit that extracts a scoring symbol 87 and a comment extraction unit that extracts a comment 88.

  The data processing target additional information extracting unit 142 only needs to be able to extract the data processing target additional information 9a, and may further classify the additional information using the color as an index. For example, through a color component recognition process on the extraction result in the difference extraction unit 132, the grader may extract a predetermined color component corresponding to the pen color used for entering the scoring symbol 87 and the comment 88. For example, the scoring symbol 87 and the comment 88 in the additional information-filled teaching material 81 are generally entered with a red pen (a red writing instrument). In this case, it is only necessary to perform an extraction focusing on the red component.

  However, even though the red pen is used, there are similar colors such as pink to orange, and the red pen is not always used for entering the scoring symbol 87 and the comment 88. The scoring symbol 87 and the comment 88 are not necessarily used. May be entered in a different pen color, so that the pen color information used for entering the scoring symbol 87 and the comment 88 is added to the data processing target additional information extracting unit 142 functioning as a scoring symbol extracting unit and a comment extracting unit. It is preferable to improve the extraction performance by configuring it to be settable.

  For this reason, the write-on color actually used is specified, and extraction with attention to the write-on color is performed with reference to the information on the specified write-on color. If the pen color actually used is specified, the data processing target additional information extracting unit 142 can narrow the extraction allowable range. Thereby, the grading symbol 87 and the comment 88 can be extracted with high accuracy and distinguished from other additional information.

  The additional write information shaping unit 146 performs correction processing on the additional write information of the data processing target extracted by the data processing target additional write information extracting unit 142 so that the line segments are connected to each other and the interruption between the extracted line segments is eliminated. It is preferable that the extraction line segment break correction unit 148 be included.

  In general, figure entry on the added document 8B, figure entry such as "double line", "wavy line", "Hanamaru", "arrow", etc., and comment sentences, etc., are repeated on the completed entry. Sometimes. For example, in the case of the additional information filled-in teaching material 81, the grades such as “○” and “x” are superimposed on the frame for identifying each question sentence 82 and each answer column 84 and the answer entry contents in each answer column 84. The symbol 87 may be entered, or the comment 88 may be additionally written with graphics or characters. For this reason, the extraction result of the predetermined color component by the data processing target additional information extracting unit 142 may result in the discontinuity of the graphic or character as a result of removing the overlapping portion.

  From this, the extraction line segmentation correction unit 148 performs thinning processing on the extraction result that should be a graphic or a character such as “◯”, “×”, “line”, and other marks (marks). End point extraction processing, end point connection processing (so-called connection processing), or linear approximation of a line figure is appropriately executed. Note that the thinning process, end point extraction process, end point connection process, straight line approximation of line figures, etc. performed at this time may be performed using known techniques, and therefore detailed description thereof is omitted here (for example, , "Image processing and recognition", Takeshi Aoiin, published by Shosodo).

  The data processing target additional information specifying processing unit 150 adds the additional information based on the difference extraction result by the difference extracting unit 132, specifically, based on the data processing target additional information 9a corrected by the extraction line segmentation correcting unit 148. The first data processing additional information recognition unit 154 for recognizing the entry contents of the first data processing additional information in the completed document 8B separately from the second data processing additional information, and the second data processing additional information. There is a second data processing additional information recognition unit 164 that recognizes the entry content of the additional information separately from the additional information for the first data processing.

  As the data processing target additional information specifying processing unit 150, the first data processing additional information recognition unit 154 recognizes the content of the scoring symbol 87 in the additional information-added teaching material 81 separately from the comment 88, and The two-data processing additional information recognition unit 164 recognizes the content of the comment 88 in the additional information-added teaching material 81 separately from the scoring symbol 87.

  Each of the data processing additional information recognition units 154 and 164 performs the shape recognition process on the data processing additional information that has been corrected by the extraction line segmentation correction unit, so that the data processing additional information is entered. Recognize the entry contents of the additional information for data processing by performing character recognition processing on the entry contents of the additional information for data processing corrected by the figure shape recognition sections 156 and 166 and the extraction line segmentation correction section. On the original document 8A (additional document 8B) of the entry contents of the additional information for data processing recognized by the character recognition units 157 and 167 and the figure shape recognition units 156 and 166 and the character recognition processing units 157 and 167. There are entry position recognition units 158 and 168 for recognizing the entry position. The figure shape recognition units 156 and 166 and the character recognition processing units 157 and 167 constitute a separation recognition processing unit 155 that recognizes the scoring symbol 87 and the comment 88 separately.

  The graphic shape recognition units 156 and 166 and the character recognition processing units 157 and 167 include a deformation processing unit that deforms (corrects) the image shape (aspect ratio and size) of additional information to be recognized before the recognition process. 156a, 166a, 157a, 167a. The deformation processing units 156a, 166a, 157a, and 167a generate transformed information to be used for graphic recognition processing and character recognition processing in the graphic shape recognition units 156 and 166 and the character recognition processing units 157 and 167.

  In the case where the character recognition processing units 157 and 167 are not provided or the data processing additional information portion that cannot be recognized by the character recognition processing units 157 and 167, the extracted additional information for data processing is handled as an image as it is. To do.

  As shown in the figure, each of the figure shape recognizing units 156 and 166, the character recognition processing units 157 and 167, and the entry position recognizing units 158 and 168 may be configured such that one function unit realizes both functions. However, they may be provided independently as individual functional units.

  For example, in the configuration in which the additional information filled-in teaching material 81 is a processing target, the first data processing additional information recognition unit 154 uses the scoring symbol 87 as additional information for the first data processing. It functions as a part. In this case, the figure shape recognizing unit 156 for the scoring symbol 87 determines whether the entry content of the scoring symbol 87 is “correct answer (◯)”, “incorrect answer (×)”, or “partially correct answer (Δ)”. It is only necessary to be able to recognize from the side of the figure. For example, shape recognition may be performed by pattern matching with the figure shapes of “◯”, “×”, and “Δ”. Alternatively, the feature amount of the recognition target figure may be calculated and the shape may be recognized from the feature amount. As the feature amount, for example, the number of holes, the area ratio of the target figure occupying the circumscribed rectangle, or the like can be used.

  The character recognition processing unit 157 for the scoring symbol 87 determines whether the contents of the scoring symbol 87 are “correct answer (◯)”, “incorrect answer (×)”, or “partially correct answer (Δ)”. It only needs to be recognized from the side. If the scoring symbol 87 is only a figure, the character recognition processing unit 157 can be omitted.

  Further, the entry position recognition unit 158 for the scoring symbol 87 may recognize the entry position of the entry contents of the scoring symbol 87 on the additional information-added teaching material 81 by, for example, coordinate analysis on the educational teaching material 80.

  Here, in the configuration of the present embodiment, the recognition performance improvement method presentation unit 180 is provided to determine whether the writer's handwritten input information is suitable for recognition, and how to add the recognition rate to improve the recognition rate. Since the improvement mode information that can be determined by the writer can be presented as support information, it is possible to prompt the user to enter handwritten input information suitable for recognition. As a result, each data processing additional information recognition unit The recognition rate at 154 and 164 can be improved.

  By referring to the presented improvement mode information, the writer can grasp an inappropriate part such as the shape of a handwritten input character and can learn an accurate figure or character shape. This enables the writer to input handwritten characters, figures, and line segments under appropriate conditions, etc., when entering the next handwritten input information, improving the recognition rate of figures and characters. Can be useful. The additional recording information processing apparatus 10 does not require a configuration in which the apparatus itself learns the writer's habits and the like, so that the configuration of the apparatus itself can be easily and miniaturized.

  Note that the figure shape recognizing unit 156, when recognizing the shape related to the scoring symbol 87, treats the continuous pixel group constituting the figure indicating the scoring symbol 87 such as “◯” and “x” collectively as one. In order to give an identifier to the continuous pixel group, a labeling process which is a general image processing technique is performed. Therefore, even when the position recognition by the entry position recognition unit 158 is performed, the result of the labeling process is used to select one continuous pixel group constituting the graphic indicating the scoring symbol 87 such as “◯” or “×”. Treat as a group of two.

  In addition, since the entry position recognition unit 158 generally recognizes the entry position of the scoring symbol 87, a plurality of scoring symbols 87 are generally entered on the additional information filled teaching material 81. For each of the symbols 87, the positions of the scoring symbols 87 detected in the predetermined scanning order are sequentially recognized.

  Position recognition regarding each scoring symbol 87 is performed, for example, by calculating circumscribing rectangle information of a figure (or character) indicating the scoring symbol 87 such as “◯” or “×”, and further calculating the center coordinates of the circumscribing rectangle. It is possible. Specifically, a circumscribed rectangle is extracted for a figure or character (a group of continuous pixels) to be recognized, and the xy coordinates of a predetermined point (for example, the upper left vertex) of the circumscribed rectangle, and the width of the circumscribed rectangle ( W) and height (h) are calculated. Then, from these calculation results, the center x coordinate = x + w / 2 and the center y coordinate = y + h / 2 are calculated, and the calculation result is used as the recognition result of the position of the continuous pixel group, that is, the entry position of the scoring symbol 87.

  On the other hand, the second data processing additional information recognition unit 164 functions as a comment recognition unit that uses the comment 88 as the second data processing additional information. In this case, the graphic shape recognition unit 166 for the comment 88 only needs to be able to recognize the additional content of the comment 88 from the side surface of the graphic. For example, “single line”, “double line”, “(single or double) The shape of the line may be recognized by pattern matching with a graphic shape indicating a line such as a “double wavy line”. Alternatively, the feature amount of the recognition target figure may be calculated, and the line shape may be recognized from the feature amount. As the feature amount, for example, the number of lines or the pixel density in the circumscribed rectangle can be used.

  In addition, the character recognition processing unit 167 only needs to be able to recognize the content of the comment 88 in the additional information filled teaching material 81 from the side of the character. In addition, the entry position recognition unit 168 for the comment 88 may recognize the entry position of the content to be added to the comment 88 on the additional information-added teaching material 81 by, for example, coordinate analysis on the educational material 80.

  Note that, when the shape recognition unit 166 recognizes the shape of the comment 88, the continuous shape pixel group constituting the graphic indicating the comment 88 such as “double line” and “flower circle” is handled as one. In addition, a labeling process, which is a general image processing technique, is performed to give an identifier to the continuous pixel group. Therefore, even when the position is recognized by the entry position recognizing unit 168, a group of continuous pixels constituting a figure indicating the comment 88 such as “double line” or “flower circle” is used by using the result of the labeling process. Are treated as one group.

  The entry position recognition unit 168 generally has a plurality of comments 88 written on the additional information filled teaching material 81 in the process of recognizing the entry position of the comment 88. The positions of the comments 88 detected sequentially in a predetermined scanning order are sequentially recognized.

  Position recognition for each comment 88 is performed by, for example, calculating circumscribing rectangle information of a comment sentence, characters and figures of the comment 88 such as “double line” and “Hanamaru”, and further calculating the center coordinates of the circumscribing rectangle. It is possible to do it. Specifically, a circumscribed rectangle is extracted from a character or figure (continuous pixel group) to be recognized, and the xy coordinates of a predetermined point (for example, the upper left vertex) of the circumscribed rectangle, and the width of the circumscribed rectangle ( W) and height (h) are calculated. Then, from these calculation results, the center x coordinate = x + w / 2 and the center y coordinate = y + h / 2 are calculated, and the calculation result is set as the recognition result of the position of the continuous pixel group, that is, the comment 88 entry position.

  Also, in this position recognition, each comment 88 is often written in the vicinity thereof in correspondence with the scoring mark 87 for the answer column 84 at a certain position. The process should be performed in cooperation with the position recognition for 87. By doing so, it becomes easy to associate the position information of each position information with each answer field 84, and as a result, to associate the scoring symbol 87 with the comment 88.

  The data processing unit 170 executes the first data processing related to the first data processing target additional information entered in the additional document 8B for the image data of the additional document 8B input from the document input device 20. 1 data processing part 170_1 and 2nd data processing part 170_2 which performs the 2nd data processing regarding 2nd data processing object additional record information.

  Each of the data processing units 170_1 and 170_2 sets the entry position of the additional information to be processed as data processing apparatuses (the document management server 30 functioning as the template information database DB1 and the document original information database DB2) that stores the position information of the entry field. ) To access the entry field position area information 38, entry field position area information 68, or template association information 69, and execute data processing while associating the entry position of the additional information with the additional information. To do.

  The first data processing unit 170_1 performs scoring and summarization on the image data of the additional information filled teaching material 81 which is an example of the added document 8B based on the scoring symbol 87 written in the additional information filled teaching material 81. Unit 172, and a totaling result output unit 174 that outputs the result of scoring totaling by scoring totaling unit 172 in association with the answerer information extracted by answerer extracting unit 134. A processing result in a state in which the scoring result and the answerer information are associated is particularly referred to as a scoring recognition result.

  The scoring tabulation unit 172 recognizes the result of the additional writing of the scoring symbol 87 by the graphic shape recognition unit 156 from the side of the graphic and the recognition result of the additional information of the scoring symbol 87 by the character recognition processing unit 157 from the side of the character information. The result of recognition of the entry position of the scoring symbol 87 by the entry position recognition unit 158 and the electronic data (original image) of the educational material 80 corresponding to the additional information filled educational material 81 held and accumulated in the document input device 20 are included. The additional information-added teaching material 81 read by the document input device 20 is added based on the scoring information defined in the scoring column 83 for each answer column 84 of the teaching material 80 (additional information-added teaching material 81). A scoring process and a summing process (collectively referred to as scoring summarization) regarding the scoring symbols 87 entered in the information-filled teaching material 81 are performed.

  The scoring symbol 87 is generally entered corresponding to each of the plurality of answer fields 84 on the educational material 80 and handwritten by a scoring officer such as a teacher. Is not necessarily uniquely defined. On the other hand, when scoring the scoring symbols 87, it is necessary to clarify the correspondence between the answer columns 84 and the entry positions of the scoring symbols 87. In the scoring for the scoring symbol 87, after clarifying the entry result of the scoring symbol 87 corresponding to each answer column 84, the contents of the scoring symbol 87 (whether the answer is correct, incorrect or partially correct) and each answer column 84 It is because it is performed based on the scoring about.

  From this, the scoring unit 172 performs scoring of the scoring symbols 87 in the following procedure. That is, the scoring totaling unit 172 obtains an overlapping area between the circumscribed rectangle of the scoring symbol 87 such as “◯” or “×” and the area to be the answer column 84 on the additional information-added teaching material 81, and calculates the area (the circumscribed area). Similarly, the scoring symbol 87 having the largest area ratio to the rectangle) and the answer column 84 are associated with each other, and the scoring symbol 87 is set as the determination result of the scoring symbol 87 entered in the answer column 84. However, when the ratio of the overlapping area to the circumscribed rectangle is less than the predetermined threshold, it is determined that the determination regarding the association is impossible because the overlapping portion is small.

  After the association, if the scoring symbol 87 is “◯”, the scoring point specified from the scoring information for the answer field 84 corresponding thereto is added, and the scoring symbol 87 is “×”. If there is, the score addition is not performed for the answer column 84 corresponding thereto, and such scoring is performed for all the answer columns 84 on the additional information filled teaching material 81.

  In addition, the area that becomes the answer column 84 on the additional information filled teaching material 81 is assigned to the document management server 30 corresponding to the additional information filled teaching material 81 as the score information for each answer column 84 or in the same manner as the score information. The entry field position area information 38 included in the registered original image is specified.

  The counting result output unit 174 associates the score totaling result totaled by the scoring totaling unit 172 with the answerer information extracted by the answerer extracting unit 134, and stores the processing result storage server 40 (processing result database device or processing result file server device). Etc.). Alternatively, the score of the scoring result is entered in the totaling field 83b of the additional information-added teaching material 81 and output on the paper as a return answer 81b so that it can be returned to the student.

  In addition, the second data processing unit 170_2 performs a classification process on the image data of the additional information filled teaching material 81, which is an example of the added document 8B, based on the comment 88 entered in the additional information filled teaching material 81. A classification processing unit 176 and a comment processing result output unit 178 that outputs the classification result by the comment classification processing unit 176 in association with the scoring recognition result output by the total result output unit 174 and each answer are provided.

  The comment classification processing unit 176 inputs the recognition result from the side of the figure of the additional content of the comment 88 by the graphic shape recognition unit 166 and the recognition result from the side of the character information of the additional content of the comment 88 by the character recognition processing unit 167. The additional information filled teaching material 81 read by the document input device 20 based on the recognition result of the position where the comment 88 is entered by the position recognizing unit 168 and the classification information defined in advance so as to correspond to the added content of the comment 88. The comment 88 entered in the additional information filled teaching material 81 is classified.

  The comment processing result output unit 178 associates the classification result by the comment classification processing unit 176 with the scoring recognition result output by each answer column or the total result output unit 174, and stores the processing result storage server 40 (processing result database device or processing result file). To the server device).

  Note that the scoring and summarizing process in the scoring and summarizing unit 172 and the classification process in the comment classification processing unit 176 may be complete automatic processing, but the CRT (Cathode Ray Tube) or LCD (Liquid Crystal Display) of the user terminal 171 may be used. ) Or the like may be displayed on the display unit configured so that the operator can appropriately correct the processing step or the processing result via an instruction input unit such as a keyboard or a mouse.

  The recognition performance improvement method presenting unit 180, which is a characteristic part of the present embodiment, collects the history of handwritten input information and stores / stores it in the processing result storage server 40 as a database; A difficult recognition additional record information extraction unit 184 that extracts difficult recognition information that was difficult to recognize than a certain degree, and a recognition performance information presentation unit 188 that presents improvement mode information on the user terminal 171 according to a predetermined display mode, have.

  The additional information recognition history holding unit 182 employs a history collection / storing method of any one of first to third described below or any combination thereof, collects the history of handwritten input information, and stores the collected handwritten input information. The history is stored in the processing result storage server 40.

  The difficult recognition additional record information extraction unit 184 employs a difficult recognition additional record information extraction method of any one of first to third described below or any combination thereof, and automatic recognition is difficult among various handwritten input information. Extract the food.

  The recognition performance information presentation unit 188 employs any one of the first to fifth recognition performance information presentation methods described later, and presents improvement mode information to the user on the user terminal 171.

<Overall procedure>
3 and 4 are diagrams for explaining the procedure of the processing operation of the teaching material processing method in the teaching material automatic scoring system 1 which is an embodiment of the information processing system. Here, FIG. 3 shows the overall outline in association with the system configuration diagram, and FIG. 4 is a flowchart showing the teaching material processing procedure.

  First, the educational material 80 is completed and registered in the original document information database DB2 (S104). In addition, when using the template 6 in the form in which no scoring is set in each entry field 6 a, scoring information is also set for the entry field 6 a set as the answer field 84.

  Thereafter, when the test is performed, the educational material 80 is read from the document original information database DB2, printed, and distributed to the students and examinees (S106). After the test, the grader adds a scoring symbol 87 and a comment 88 to the student's answer (S108).

  In the case of using the postscript information processing apparatus 10 (particularly corresponding to the teaching material processing apparatus in the teaching material automatic scoring system 1), first, a student enters a name in the answerer information column 86 and enters the answering column 84. Answer entry, i.e., the entry of the first type of additional information by the student, and a second such as a scoring symbol 87 such as “○” or “x” and a comment 88 for the answer entered in each answer column 84 by the teacher or the like With respect to the additional information filled teaching material 81 in which the additional information has been entered, the document input device 20 reads the additional information filled learning material 81 (S110) and adds image data representing the additional information filled learning material 81 as additional information. It inputs into the processing apparatus 10 (S112). The document input device 20 temporarily stores image data obtained by image reading by the document input device 20 in a memory or the like used as a work area.

  At this time, if the document input device 20 uses an ADF device, for example, a plurality of additional information-filled teaching materials 81 to be processed in one group such as the same class are collectively read (batch scan). The image data corresponding to each additional information filled teaching material 81 can be continuously input to the additional information processing apparatus 10.

  The additional recording information processing device 10 sequentially adds the following additional information extraction / separation processing, additional information identification processing, and automatic scoring processing to the image data of each additional information filled teaching material 81 captured from the document input device 20. In addition, additional information end processing such as automatic comment processing is executed.

  For example, prior to automatic scoring processing and automatic comment processing in the data processing unit 170, the image data analysis unit of the read image processing unit 110 performs analysis processing on image data obtained from a certain additional information-added teaching material 81. (S122) The learning material specifying unit 122 identifies and specifies the original educational material 80 corresponding to the additional information-added learning material 81 based on the result of the analysis processing (S124).

  This identification specification (S124) is, for example, a title analysis by an identification information analysis unit such as “science”, “5 years”, “1. change in weather and temperature” or a code information analysis unit for code information embedded in the identification information column 85 This can be done through code analysis. Through this identification and specification, the teaching material specifying unit 122 specifies the electronic data (original image) of the teaching material 80 to be compared with the image data of the additional information filled teaching material 81 obtained by the document input device 20. can do.

  This identification and identification may be performed sequentially for each of the plurality of additional information-filled teaching materials 81 from which the document input device 20 has read an image. However, in general, additional information that has been processed in one group is already entered. Since all the teaching materials 81 are the same, it is only necessary to perform the additional information-filled teaching material 81 that is processed first during the batch processing.

  When the teaching material specifying unit 122 completes the specification of the educational material 80 corresponding to each additional information-added teaching material 81, the document management server 30 follows the specified result and selects the corresponding educational material 80 from the stored and stored. The original image (electronic data) is taken out and transferred to the difference extraction unit 132 (S126).

  Further, the distortion correction unit corrects the distortion of the image data obtained from a certain additional information-added teaching material 81 (S128). This image distortion correction is performed in order to correct image distortion that may occur when the document input device 20 reads an image. After that, the difference extraction unit 132 performs comparison with the original image or difference extraction. This is to improve accuracy.

  The difference extraction unit 132 receives the original image (educational teaching material 80) delivered from the document management server 30 and the image data (additional information) input from the document input device 20 and corrected for image distortion by the distortion correction unit. The completed teaching material 81) is compared with each other, and the difference is extracted (S130). The difference extraction unit 132 passes the extracted difference information 9 to the answerer extraction unit 134 and the additional information extraction processing unit 140 for data processing.

  By the difference extraction by the difference extraction unit 132, for example, as shown in the center part in FIG. 3, the content of the first type additional information entered by the answerer in the answerer information column 86 and each answer column 84, and each answer column Difference information 9 represented only by the content of the second type additional information entered by the grader such as a grading symbol 87 and a comment 88 for 84 is extracted.

  The answerer extracting unit 134 extracts answerer information in the additional information-added teaching material 81 to be read by the document input device 20 through character recognition processing by the character recognition processing unit for the difference information 9 (S132). As a result, the class, attendance number, name, and the like of the answer entry person who wrote the answer in one additional information-filled teaching material 81 can be specified.

  In the data processing additional information extraction processing unit 140, the additional recording member specifying unit 141 first specifies an additional recording color that is a pen color used for entering the additional information to be processed (S141), and performs data processing. The target additional information extraction unit extracts additional information for data processing from the difference extraction result by the difference extraction unit 132 based on the additional recording color specified by the additional member specifying unit 141 (S142).

  In the case of this example, in order to extract the additional contents of the grading symbol 87 and the comment 88 in each answer column 84, the information about the predetermined color component, specifically, for example, the red component is extracted from the difference information 9 To do. For example, if the difference extraction result is composed of pixel data, the predetermined color component can be extracted by paying attention to the color component data constituting the pixel data.

  The extracted line segmentation correction unit appropriately executes additional information shaping processing such as thinning processing, end point extraction processing, end point connection processing, or linear approximation of line figures, on the extraction result of the data processing target additional information extraction unit. (S146). The extracted line segment break correction unit passes the extraction result of the scoring symbol 87 that has been subjected to the break correction process to the first data processing additional information recognition unit 154 that functions as the scoring symbol recognition unit, and also extracts the comment 88 that has undergone the break correction process. The result is passed to the second data processing additional information recognition unit 164 that functions as a comment recognition unit.

  The data processing target additional information specifying processing unit 150 is first stored in the document management server 30 in cooperation with the figure shape recognition units 156 and 166 and the character recognition processing units 157 and 167 constituting the separation recognition processing unit 155. The scoring symbol 87 and the comment 88 are separated by referring to the position information in the answer field 84 (S162), and thereafter, the specified content processing and the entry position are identified separately from the separated scoring symbol 87 and the comment 88. Execute the process.

  The graphic shape recognition unit 156 and the character recognition processing unit 157, regarding the scoring symbol 87 separated from the comment 88 (S163-scoring symbol), the content of the scoring symbol 87 by shape recognition or character recognition for the content of the scoring symbol 87. The scoring result of the scorer indicated by the scoring symbol 87 is specified, such as whether the answer is “correct” or “incorrect” (S164). At this time, a correction instruction from the user is accepted (S165). Subsequently, the entry position recognition unit 158 recognizes the entry position on the additional information entry teaching material 81 with respect to the entry contents of the scoring symbol 87 (S166).

  After the entry position recognizing unit 158 recognizes the entry position of the scoring symbol 87 in this way, the scoring totaling unit 172 recognizes the result of recognizing the entry contents of the scoring symbol 87 by the graphic shape recognizing unit 156 and the character recognition processing unit 157. And the recognition result of the entry position of the scoring symbol 87 by the entry position recognizing unit 158 and the education included in the original image (educational instruction material 80) corresponding to the additional information entry instruction material 81 held and accumulated in the document management server 30. Based on the scoring information for each answer field 84 of the teaching material 80, scoring and counting are performed (S168).

  The total result output unit 174 stores the scoring / total results in the processing result storage server 40 (S169). Alternatively, the score of the scoring result is entered in the totaling field 83b of the additional information filled teaching material 81 and returned to the student as a return answer 81b.

  As the file format of the scoring result (scoring result by problem) for each additional information filled teaching material 81, for example, as shown in FIG. 3, the number of the problem existing on the additional information filled teaching material 81 and the problem It is a table format that associates these with each other with information consisting of correct / incorrect determination on the answer and a score based on the correct / incorrect determination. In addition, as a file format of the counting result, for example, as shown in FIG. 3, information including an attendance number and answerer information and score information (item points and total points written in the counting field 83b) Is a table format for associating each other.

  The result of scoring for correct / incorrect judgment entered on each additional information-added teaching material 81 is output as a question-based scoring result, and the result of scoring-by-problem scoring is output as a file. In the server 40, it is possible to manage or use the score totaling result for the additional information filled teaching material 81 in a list form, for example.

  The graphic shape recognizing unit 166 and the character recognizing processing unit 167, regarding the comment 88 separated from the scoring symbol 87 (S163-comment), the comment 88 added by the grading officer by shape recognition or character recognition with respect to the entered content of the comment 88. The entry contents are specified (S170). At this time, a correction instruction from the user is accepted (S171). Subsequently, the entry position recognizing unit 168 recognizes the entry position on the additional information entry teaching material 81 with respect to the entry contents of the comment 88 (S172).

  After the entry position recognizing unit 168 recognizes the entry position of the comment 88 in this way, the comment classification processing unit 176 displays the recognition result of the entry contents of the comment 88 by the figure shape recognition unit 166 and the character recognition processing unit 167. The comment 88 is classified based on the recognition result of the entry position of the comment 88 by the entry position recognition unit 168 and the classification reference information 39 stored and accumulated in the document management server 30 (S174).

  The comment processing result output unit 178 associates each comment 88 classified by the comment classification processing unit 176 with the scoring result of the scoring symbol 87 having a close position (S178), and stores it in the processing result storage server 40 (S179). As the file format of the classification result for each comment 88, for example, as shown in FIG. 3, it is a table format that associates each comment with information including a scoring symbol 87 in the vicinity. In addition, it is not limited to actually storing in the table format, and each comment 88 may be stored in association with association information that associates both the comment 88 and the scoring result corresponding to the comment 88.

  Since the score summation result of the scoring symbol 87 written on each additional information filled teaching material 81 and the comment 88 are stored in correspondence with each other, the processing result storage server 40 scores the additional information filled teaching material 81. The counting results and the comments 88 can be managed or used, for example, in a list format, and the comments 88 can be used for student ability analysis and student guidance.

  As described above, in the teaching material automatic scoring system 1 shown as an embodiment of the information processing system, the image data read from the supplementary information-added teaching material 81 in which the scoring symbol 87 and the comment 88 are entered, and the supplementary information are already entered. The original educational material 80 for the educational material 81, that is, the first type of additional information by the student such as entering the answer in the answer column 84, and the second type of additional information such as a scoring symbol 87 and a comment 88 by the grader for the answer. Are compared with the data for those not filled in, and the written contents of the grading symbol 87 and the comment 88 are separated from each other's difference to identify the filled content, and the totaling and comment 88 for the grading symbol 87 are identified. The classification process is executed.

  Therefore, regarding the data processing related to the scoring symbol 87, the entry content of the comment 88 is excluded from the difference result extracted by the difference extraction unit 132, and only the scoring symbol 87 is separated to specify the entry content. So, even if both are added with the same pen, automatic scoring will not be adversely affected.

  In addition, since the scoring results can be automatically totaled, the scoring process for the additional information filled teaching material 81 is saved as a result. In the case where the additional information filled teaching material 81 is obtained as a paper medium, it may be based on image data obtained by reading the additional information filled teaching material 81 with the document input device 20, for example, a copying machine, a multifunction peripheral, a scanner device, or the like. System configuration can be easily realized with a scanning function realized by the computer and an information storage processing function, an image processing function, and an arithmetic processing function of a computer device such as a personal computer (PC). Is not required.

  Furthermore, in order to compare the image data of the additional information filled teaching material 81 with the electronic data held by the document management server 30, the electronic data of various educational teaching materials 80 can be held and accumulated in the document management server 30. Thus, the versatility of the additional information filled teaching material 81 that can be handled can be sufficiently secured. Furthermore, by storing and storing electronic data in the document management server 30 in advance, when comparing with image data captured from the document management server 30, it is possible to input the electronic data to be compared. As a result, a quick scoring process can be realized.

  In addition, regarding the data processing related to the comment 88, the entry content of the scoring symbol 87 is excluded from the difference result extracted by the difference extraction unit 132, and only the comment 88 is separated to specify the entry content. Even if both are added with the same pen, the classification process related to the comment 88 is not adversely affected. In addition, since each comment 88 is stored in the processing result storage server 40 in association with each scoring symbol 87, the scoring officer himself / herself is used for ability analysis and student guidance in addition to the purpose of confirming the comment 88 by the student. It can be utilized.

<< Recognition performance improvement mode information presentation process >>
5 to 10 show details of processing of the recognition performance improvement technique presentation unit 180, that is, a technique for taking a history of handwritten input information such as characters and figures written by handwriting, and improvement mode information for improving recognition performance. It is a figure explaining the method of showing to a user.

  In this embodiment, it is determined whether or not the handwritten input information entered in the original document 8A by handwriting is suitable for automatic recognition. Support information (improvement mode information) that allows the user to determine whether or not to improve is presented.

  Here, the improvement mode information may be any information that allows the user himself / herself to specifically and easily determine the correction method for improving the recognition performance, and can adopt various presentation modes. For example, it is possible to adopt a mode of presenting information that suggests where and how to correct it. By doing so, it is possible to easily determine how the description improves the recognition performance.

  Or the aspect which presents the recognition reliability of the past description can be taken. By doing so, it is possible to easily determine how much the recognition performance is to be described, and based on this, the user can make a description that improves the recognition performance.

  Whichever presentation mode is adopted, entry of handwritten input information suitable for recognition can be promoted, and as a result, the recognition rate can be improved.

  When presenting the improvement mode information of the handwritten input information to the user, first, the history of the handwritten input information is saved, and the degree of improvement is requested in order to improve the recognition performance with reference to the reliability at the time of recognition. The improvement mode information should be presented for strong ones. In other words, improvement mode information is presented only for handwritten input information (also referred to as difficult recognition information) that is more difficult to recognize than a certain degree. In this way, the recognition performance can be made higher than a certain level. The recognition performance only needs to be higher than a certain level, and it is not always necessary that the handwritten input information completely matches the ideal reference information.

  Since the handwritten input information is almost certainly misaligned with the standard information, the improvement mode information was presented for all handwritten input information entered in the past. However, it is possible to prevent unnecessary information presentation by narrowing the presentation range to the difficult recognition information range. By doing so, it is possible to prevent the possibility of correcting more than necessary.

  In general, since the entry habits differ depending on the user, the improvement mode to be presented also differs for each user. Therefore, when taking a history of handwritten input information, it is preferable to keep a history for each user.

<History collection>
5 to 8 are diagrams for explaining the details of the processing of the additional information recognition history holding unit 182, that is, a method of taking a history of handwritten input information such as handwritten characters and figures.

  Here, when the history of handwritten input information is collected and stored in the database, various history collection and storage methods can be employed depending on at what point the entry is kept as a history.

  For example, as shown in FIG. 5, it is conceivable to adopt a first history collection and storage method in which handwritten input information data recognized in the process of normal automatic data processing is accumulated and stored.

  When adopting the first history collection and storage method, it is conceivable that only handwritten input information is stored separately from the original document original 8A, or together with a predetermined range of image information including handwritten input information. In other words, it may be possible to save each surrounding image. When only the handwritten input information is stored, the amount of information can be suppressed, so that the storage cost can be reduced. In the case of saving for each surrounding image, it is possible to grasp the situation such as the question sentence, the answer column, and the student's answer that affects the handwritten input, so that it is possible to understand and correct the habit of entry including the situation.

  If the first history collection and storage method is adopted, the history can be collected and stored in a normal processing process, so that data such as the shape, position, and correction status can be used. Further, it is possible to check the entry mode such as the scoring method without taking any special effort, and also to reflect the correctness of recognition. However, since the history is small at the beginning and improvement of the input mode by the user cannot be expected, the recognition rate is low, and there is a possibility that it takes time and effort for correction.

  In addition, as shown in FIG. 6, it is not the normal process of automatic data processing, but before starting the processing, it is input to the original document 8A for practice such as a practice answer as shown in FIG. It is conceivable to adopt a second history collection and storage method for accumulating and storing information data. The part indicated by the solid line in the figure is a part that contributes to the second history collection / storing method in the teaching material automatic scoring system 1, and the student identification by the answerer extraction unit 134 and the data processing in each data processing unit 170_1, 170_2 Result output processing is not required.

  If this second history collection and storage method is adopted, entry information for practice can be designated, so that correction need not be considered. This is because, in the process of adding to the prepared practice answer and performing the normal automatic scoring process, the entry form is also specified. In addition, there is an advantage that a figure shape, a character shape, and a position can be determined, and the result can be presented including correct or incorrect recognition. In addition, you can practice writing methods such as scoring methods in advance, so you can confirm the correct shape and position, you can expect entry with good recognition performance, and as a result, during actual automatic data processing The advantage is that no modification is required. Further, since it is possible to fill in a blank portion, it is only necessary to save handwritten input information for the designated entry information, so that the storage capacity can be reduced.

  Further, as shown in FIG. 8, a third history collection and storage method is adopted in which data of input information in a past additionally written document 8B (for example, a past scoring answer) that has not been used for automatic data processing is accumulated and stored. It is possible. The part indicated by the solid line in the figure is a part that contributes to the third history collection / storing method in the teaching material automatic scoring system 1, and the original identification by the document original identification unit 120, the student identification by the answerer extraction unit 134, Further, it is not necessary to specify the entry position in the entry position recognition units 158 and 168, the automatic scoring process, the automatic comment classification process, and the output process of the data processing result in each data processing unit 170_1 and 170_2.

  Since automatic data processing is not performed, the difference is extracted by adding and reading the blank document original 8A, and only the handwritten input information is extracted. In addition, it is only necessary to perform shape recognition and character recognition without presenting the entire process of automatic data processing and present the result.

  By adopting this third history collection and storage method, past appended documents can be used, so even when automatic data processing is used for the first time, a correction method for improving recognition performance with respect to handwritten input information can be presented. In the actual automatic data processing, there is an advantage that less correction is required. Further, it is possible to save the trouble of creating the original document 8A for practice. However, since the correctness of the result is unknown, determination based on correctness cannot be made.

<Extracting difficult recognition information>
In addition, when presenting improvement mode information only for difficult recognition information that is more difficult to recognize than a certain degree, the separation recognition processing unit 155 performs normal recognition processing, and the difficult recognition additional record information extraction unit 184 It is conceivable to adopt a first method of extracting difficult recognition information based on the reliability at the time of recognition processing, in other words, the similarity to candidate information (exemplary information).

  If this first method is adopted, it is extracted from what automatic data processing is difficult to recognize instead of correct or incorrect recognition, so it is possible to grasp the figures that have been recognized so far but can be erroneously recognized. This has the effect of preventing misrecognition. This method can be applied to all the first to third history collection and storage methods.

  Here, the reliability and the similarity are, for example, the stroke order, the number of strokes, and the directionality of the line segment for each of the handwritten input information and a plurality of reference information (reference character information and reference graphic information) that are predetermined recognition targets. Or, in the feature quantity indicating the feature of each figure such as the positional relationship between line segments, roundness, size, inclination, presence / absence of a hole, it means the degree of similarity between the two.

  Further, after the normal recognition process in the separation recognition processing unit 155, the difficult recognition additional record information extracting unit 184 obtains the difficult recognition information based on the correction state (specifically, whether or not correction is performed) with respect to the recognition processing result by the writer. It is conceivable to adopt a second method of extraction. This is based on the fact that when the correction is made, it means that the automatic recognition process cannot correctly recognize (that is, there is a misrecognition).

  Adopting the second method has an effect of collecting accurate information because the correction result by the writer is used. On the other hand, in the first method, even if the reliability is high, it may actually be a false recognition. However, this second method can be applied only when the first history collection and storage method is adopted.

  In addition, as shown in FIG. 8, when using the original document 8A for practice, the entry shape such as “○”, “×”, “△” and other reference information to be entered are set as designated entry information. In addition, it is conceivable that the difficult recognition additional record information extraction unit 184 adopts a third method of extracting information that is out of the designated entry information, in other words, information that is recognized incorrectly as difficult recognition information. That is, the difficult-to-recognize additional information extracting unit 184 recognizes misrecognized information that has been misrecognized from the additional information corresponding to the reference information extracted from the original document 8A for practice in which the reference information to be entered is designated. It is extracted as.

  By adopting this third method, since the reference information is shown, there is an effect that accurate information can be collected. However, this third method can be applied only when the second history collection and storage method is adopted.

  Here, at the time of “extracting erroneous recognition” during the automatic recognition processing, it is only necessary to extract the reference information to be entered and the actual recognition result different.

<Improvement mode information presentation method>
FIG. 10 is a diagram for explaining a method in which the recognition performance information presentation unit 188 presents improvement mode information for improving recognition performance to the user.

  When the recognition performance information presentation unit 188 presents the improvement mode information to the user (filler), it is preferable to present the improvement mode information corresponding to each of the writers. In addition, as a presentation method at that time, for example, as shown in FIG. 10A, the recognition performance information presentation unit 188 includes handwritten input information such as an input figure and an input character, and shape recognition and character recognition. It is conceivable to adopt a first method in which the image transformation processing results are presented side by side.

  At the time of shape recognition or character recognition, the input information is not recognized as it is, but the deformation processing units 156a, 166a, 157a, 167a are based on the deformed information obtained by correcting the image shape such as the aspect ratio and size. Recognition process. This corresponds to a case where recognition processing is performed after the size and aspect ratio of the reference information entry portion are kept constant.

  For example, when shape recognition or character recognition is performed on additional information entered so as to represent “o” as reference information, when the added additional information is vertically long or horizontally long, Deformation information is generated by transforming (correcting) the ratio to 1: 1, rotating it when it is written obliquely (tilting), or modifying the overall size to a certain size. This is a case where the transformed information is recognized.

  Therefore, by visualizing how the entered handwritten input information is recognized after being transformed, it is possible to make an adverse effect on the input recognition that is corrected by generating the transformed information and the remaining recognition without being corrected. Since it is possible to distinguish the effect of entry, it is possible to obtain an effect of clarifying what should be noted with care.

  Also, as shown in FIG. 10B, the recognition performance information presenting unit 188 has difficulty with the ideal reference information corresponding to the handwritten input information (for example, the reference graphic for the scoring symbol 87 and the reference character used for the comment 88). For the recognition information, the reliability (similarity) of the recognition processing for the reference information is obtained from a combination of feature quantities such as stroke order, number of strokes, directionality of line segments, or positional relationship between line segments, and the degree of reliability is determined. It is conceivable to adopt a second method that replaces (corresponds to) the distance from the reference information and visually presents the difficult recognition information at the corresponding distance.

  By adopting this second method, ranking is made not from the appearance of the person but from the viewpoint of the data processing, so that it is possible to accurately select a shape suitable for recognition from among the shapes entered by the user.

  In addition, as shown in FIG. 10C, all handwritten input information saved by collecting history by the additional information recognition history holding unit 182 is easy to recognize for each character, figure, or line segment from those that are easy to recognize. In addition, it is conceivable to adopt a third method in which the trends are visualized and presented, that is, the degree of difficulty of recognition is displayed in order. Since the difficulty level of recognition may be considered to have a substantially constant correspondence with the reliability level of the reference information, the reliability levels of the difficulty recognition information with respect to the reference information are displayed in order.

  By adopting this third method, as in the second method, ranking is done from the viewpoint of data processing instead of human appearance, so the one that is suitable for recognition is selected accurately from among the shapes entered by me. There is an effect that can be done.

  In addition, as shown in FIG. 10D, when performing recognition processing based on the feature amount, in classifying and presenting the feature by type, the type of recognition error and the improvement method are set in advance, and at the time of recognition. It is conceivable to adopt a fourth method in which classification is made into types based on the tendency of the feature quantity and advice on improvement methods. Not only presenting the reason for misrecognition, but distinguishing what is the feature quantity that causes misrecognition, and presenting an improvement method thereof.

  If this fourth method is adopted, the improvement method is presented directly rather than indirectly by means of visualization such as ranking, so that it is easy for the writer to pay attention and the improvement effect is improved.

  Although not shown in the figure, when performing recognition processing based on feature quantities, when classifying and presenting features by type, ideal feature quantities are prescribed for each handwritten input information, and apart from that It is conceivable to adopt a fifth method for pointing out what is present.

  By adopting this fifth method, as with the fourth method, since the improvement method is presented directly rather than indirectly by visualizing ranking, etc., the writer can easily pay attention to the improvement effect. Has the effect of improving.

  In any presentation mode, if presentation is made by comparing a plurality of pieces of information, it is possible to reliably grasp an inappropriate part such as the shape of handwritten input information and to learn accurately the shape of a graphic or character. it can.

<Additional information processing device; computer configuration>
FIG. 11 is a block diagram illustrating another configuration example of the additional recording information processing apparatus 10. Here, a more realistic hardware configuration is shown that is constructed from a microprocessor or the like that executes additional write information processing by software using an electronic computer such as a personal computer.

  That is, in this embodiment, the mechanism for executing the data processing related to the additional information is not limited to the hardware processing circuit, and is software-based using a computer (computer) based on the program code that realizes the function. It can also be realized.

  Therefore, a program suitable for realizing the mechanism according to the present invention by software using an electronic computer (computer) or a computer-readable storage medium storing this program can be extracted as an invention. By adopting a mechanism that is executed by software, it is possible to enjoy the advantage that the processing procedure and the like can be easily changed without changing hardware.

  When the data processing function related to additional information is executed by software in an electronic computer, a program (such as a built-in microcomputer) in which a program constituting the software is incorporated in dedicated hardware or a CPU (Central Processing) Unit), logic circuit, storage device, etc. on a single chip to realize the desired system SOC (System On a Chip) or various programs by installing various programs It is installed from a recording medium in a general-purpose personal computer or the like capable of executing functions.

  The recording medium causes a state change of energy such as magnetism, light, electricity, etc. according to the description contents of the program to the reading device provided in the hardware resource of the computer, and in the form of a signal corresponding to the change. The program description can be transmitted to the reader.

  For example, a magnetic disk (including a flexible disk FD), an optical disk (CD-ROM (Compact Disc-Read Only Memory)), a DVD on which a program is recorded, which is distributed to provide a program to a user separately from a computer. (Including Digital Versatile Disc), magneto-optical disc (including MD (Mini Disc)), or package media (portable storage media) made of semiconductor memory, etc. It may be configured by a ROM, a hard disk, or the like in which a program is recorded, which is provided to the user in a state of being recorded.

  The program constituting the software is not limited to being provided via the recording medium without using the recording medium, and may be provided via a wired or wireless communication network.

  For example, a storage medium in which a program code of software that realizes a data processing function related to additional information is supplied to a system or apparatus, and a program code stored in the storage medium by a computer (or CPU or MPU) of the system or apparatus The same effect as in the case where the hardware processing circuit is used is also achieved by reading and executing. In this case, the program code itself read from the storage medium realizes a data processing function related to additional write information.

  In addition, by executing the program code read by the computer, not only a data processing function related to additional information is realized, but also an OS (Operating Systems; basic software) running on the computer based on an instruction of the program code Or the like may perform part or all of the actual processing, and the data processing function regarding the additional information may be realized by the processing.

  Further, after the program code read from the storage medium is written in a memory provided in a function expansion card inserted into the computer or a function expansion unit connected to the computer, the function expansion is performed based on the instruction of the program code. There may be a case where a CPU or the like provided in the card or the function expansion unit performs part or all of the actual processing, and the data processing function regarding the additional information is realized by the processing.

  Note that the program is provided as a file describing a program code that realizes a data processing function related to additional information, but in this case, the program is not limited to being provided as a batch program file, and the hardware of a system configured by a computer Depending on the configuration, it may be provided as an individual program module.

  For example, the computer system 900 reads and records data from a controller unit 901 and a predetermined storage medium such as a hard disk device, a flexible disk (FD) drive, a CD-ROM (Compact Disk ROM) drive, or a semiconductor memory controller. And a recording / reading control unit 902.

  The controller unit 901 includes a CPU (Central Processing Unit) 912, a ROM (Read Only Memory) 913 which is a read-only storage unit, and a RAM (Random Access) which can be written and read at any time and is an example of a volatile storage unit. Memory) 915 and RAM (described as NVRAM) 916 which is an example of a nonvolatile storage unit.

  In the above description, the “volatile storage unit” means a storage unit in which the stored contents are lost when the power of the apparatus is turned off. On the other hand, the “nonvolatile storage unit” means a storage unit in a form that keeps stored contents even when the main power supply of the apparatus is turned off. Any memory device can be used as long as it can retain the stored contents. The semiconductor memory device itself is not limited to a nonvolatile memory device, and a backup power supply is provided to make a volatile memory device “nonvolatile”. You may comprise as follows.

  Further, the present invention is not limited to a semiconductor memory element, and may be configured using a medium such as a magnetic disk or an optical disk. For example, a hard disk device can be used as a nonvolatile storage unit. In addition, it is possible to use as a nonvolatile storage unit by adopting a configuration for reading information from a recording medium such as a CD-ROM.

  Further, the computer system 900 includes an instruction input unit 903 as a functional unit that forms a user interface, a display output unit 904 that presents a user with predetermined information such as a guidance screen and a processing result, and each functional unit. And an interface unit (IF unit) 909 that performs an interface function between them.

  Note that an image forming unit 906 that outputs the processing result to a predetermined output medium (for example, printing paper) may be provided so that the data processing result is printed out and presented to the user.

  As the instruction input unit 903, for example, the operation key unit 985b of the user interface unit 985 can be used. Alternatively, a keyboard or mouse can be used.

  The display output unit 904 includes a display control unit 919 and a display device. As the display device, for example, the operation panel unit 985a of the user interface unit 985 can be used. Alternatively, other display units such as CRT (Cathode Ray Tube) or LCD (Liquid Crystal Display) can be used.

  For example, the display control unit 919 displays the guidance information, the entire image captured by the document input device 20, and the like on the operation panel unit 985a and the display unit. It is also used as a display device for notifying the user of various information. Note that an instruction input unit 903 for inputting predetermined information with a fingertip, a pen, or the like can be configured by using a display unit having a touch panel on the display surface.

  The interface unit 909 includes a system bus 991 that is a transfer path for processing data (including image data) and control data, a printer IF unit 996 that functions as an interface with the image forming unit 906 and other printers, and the like. A communication IF unit 999 is provided to mediate communication data exchange with the network.

  In such a configuration, the CPU 912 controls the entire system via the system bus 991. The ROM 913 stores a control program for the CPU 912 and the like. The RAM 915 is configured by SRAM (Static Random Access Memory) or the like, and stores program control variables, data for various processes, and the like. The RAM 915 includes an area for temporarily storing data obtained by calculation according to a predetermined application program, data obtained from the outside, and the like.

  For example, a program that causes a computer to execute a data processing function related to additional recording information is distributed through a recording medium such as a CD-ROM. Alternatively, this program may be stored in the FD instead of the CD-ROM. In addition, an MO drive may be provided to store the program in the MO, or the program may be stored in another recording medium such as a nonvolatile semiconductor memory card such as a flash memory. Furthermore, the program may be downloaded from another server or the like via a network such as the Internet, or may be updated or updated.

  As a recording medium for providing the program, in addition to FD and CD-ROM, optical recording medium such as DVD, magnetic recording medium such as MD, magneto-optical recording medium such as PD, tape medium, magnetic recording A semiconductor memory such as a medium, an IC card, or a miniature card can be used. A part or all of functions for realizing a data processing function related to additional write information can be stored in an FD or CD-ROM as an example of a recording medium.

  Further, the hard disk device includes an area for storing data for various processes by the control program, and temporarily storing a large amount of data acquired by the device itself or data acquired from the outside.

  With such a configuration, additional information is written to the RAM 915 from a readable recording medium such as a CD-ROM in which a program for executing the additional recording information processing method is stored in accordance with an instruction from the operator via the operation key unit 985b. The processing program is installed, and the additional information processing program is started by an instruction or automatic processing by the operator via the operation key unit 985b. For example, if the teaching material automatic scoring system 1 is to be realized, the teaching material processing program recognizes a difference extraction result of a predetermined color component, specifically, for example, a red component as the contents of the marking symbol 87 and the comment 88, And a program in which processing steps for separating both are described is started.

  The CPU 912 performs calculation processing according to the additional information processing method according to the additional information processing program, stores the processing result in a storage device such as the RAM 915 or a hard disk, and displays the operation panel unit 985a or a display such as a CRT or LCD as necessary. Output to the device. By using a recording medium recorded with a program for executing the additional recording information processing method, the additional recording information processing system can be constructed universally without changing the existing system.

  Not only the configuration using such a computer, but also a write-once information processing apparatus 10 that performs a data processing function related to write-once information by a combination of dedicated hardware that performs processing of each functional unit shown in FIG. It can also be configured.

  In addition, for example, a processing circuit 908 may be provided in which not all processing of each functional part for the data processing function related to the additional information is performed by software, but part of these functional parts is performed by dedicated hardware. . Although the mechanism performed by software can flexibly cope with parallel processing and continuous processing, the processing time becomes longer as the processing becomes complicated, so that a reduction in processing speed becomes a problem.

  On the other hand, it is possible to construct an accelerator system with a higher speed by using a hardware processing circuit. Even if the processing is complicated, the accelerator system can prevent a reduction in processing speed and can obtain a high throughput.

  For example, in the case of realizing a data processing function related to additional information, the processing circuit 908 includes a read image processing unit 908 a corresponding to the read image processing unit 110 shown in FIG. 2 and a document corresponding to the document original specifying unit 120. Data corresponding to the original data specifying unit 908b, the additional information extracting unit 908c corresponding to the additional information extracting unit 130, the data processing target additional information specifying unit 908d corresponding to the data processing target additional information specifying unit 150, or the data processing unit 170. The processing unit 908e and the like may be configured by hardware.

  As mentioned above, although this invention was demonstrated using embodiment, the technical scope of this invention is not limited to the range as described in the said embodiment. Various changes or improvements can be added to the above-described embodiment without departing from the gist of the invention, and embodiments to which such changes or improvements are added are also included in the technical scope of the present invention.

  Further, the above embodiments do not limit the invention according to the claims (claims), and all combinations of features described in the embodiments are not necessarily essential to the solution means of the invention. Absent. The embodiments described above include inventions at various stages, and various inventions can be extracted by appropriately combining a plurality of disclosed constituent elements. Even if some constituent requirements are deleted from all the constituent requirements shown in the embodiment, as long as an effect is obtained, a configuration from which these some constituent requirements are deleted can be extracted as an invention.

  For example, a distortion correction process and a break correction process are not necessarily essential. In addition, when associating each answer column 84 with the entry position of the scoring symbol 87 in the scoring of the scoring symbol 87, the circumscribed rectangle of the scoring symbol 87 and the region of the answer column 84 as described in this embodiment overlap. Instead of obtaining the area, it is conceivable that, for example, the association is performed from the distance of the respective center coordinates, or the association is simply performed depending on whether or not there is an overlapping portion between each.

  In addition, as an example of the additionally recorded document 8B to be processed, the additional information filled teaching material 81 used for the automatic scoring and summarizing processing mechanism has been described as an example. However, this is only an example, and the additionally recorded information to be processed. The type of the document is not limited as long as it includes (especially handwritten). For example, a completed form (see Japanese Patent Laid-Open Nos. 5-342239 and 6-274156) used for an automatic form processing mechanism and an addition used for a mechanism for personal information management (especially also called schedule management) An information-filled notebook (see JP-A-5-216932) may be used.

  Further, as described above, the post-recorded document 8B to be processed is not limited to using a paper medium, and even if the post-recorded document 8B is obtained in the form of electronic data from the beginning, The above-described mechanism can be similarly applied as long as additional information to be processed is included.

It is a figure which shows the educational teaching material which is an example of the document made into the process target in the postscript information processing which concerns on this invention. It is a figure which shows the structural example of one Embodiment of the information processing system provided with the postscript information processing apparatus which concerns on this invention. It is the figure which showed the whole outline | summary of the teaching material processing method in a teaching material automatic scoring system matched with the system block diagram. It is a flowchart which shows the whole process sequence in a teaching material automatic scoring system. It is a figure explaining the 1st history collection preservation | save method in an additional record information recognition log | history holding part. It is a figure explaining the 2nd history collection preservation | save method in an additional record information recognition log | history holding part. It is a figure which shows an example of the original document used by the 2nd log | history collection preservation | save method. It is a figure explaining the 3rd history collection preservation | save method in an additional record information recognition log | history holding part. It is a figure explaining the difficult recognition information extraction process in a difficult recognition additional record information extraction part. It is a figure explaining the improvement mode information presentation method in a recognition performance information presentation part. It is the figure which showed an example of the hardware constitutions in the case of constituting a postscript information processor using an electronic computer.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1 ... Teaching material automatic scoring system, 8A ... Original document, 8B ... Additional recorded document, 9 ... Difference information, 10 ... Additional information processing apparatus, 20 ... Document input device, 30 ... Document management server, 40 ... Processing result storage server, 80 ... Educational teaching materials 81 ... Additional information filled teaching materials 87 ... Scoring symbols 88 ... Comments 110 ... Reading image processing unit 120 ... Original document specifying unit 122 ... Teaching material specifying unit 130 ... Additional information extracting unit 132 ... difference extraction unit, 134 ... answerer extraction unit, 136 ... handwritten information extraction unit, 138 ... character recognition processing unit, 140 ... data processing additional information extraction processing unit, 142 ... data processing target additional information extraction unit, 146 ... Additional writing information shaping unit, 148... Extraction line segmentation correction unit, 150... Data processing target additional writing information specifying processing unit, 154... First data processing additional writing information recognition unit, 155. 6 ... Graphic shape recognition unit, 157 ... Character recognition processing unit, 158 ... Entry position recognition unit, 164 ... Additional data recognition unit for second data processing, 166 ... Graphic shape recognition unit, 167 ... Character recognition processing unit, 156a, 166a 157a, 167a ... deformation processing unit, 168 ... entry position recognition unit, 170 ... data processing unit, 170_1 ... first data processing unit, 170_2 ... second data processing unit, 171 ... user terminal, 172 ... scoring totaling unit, 174 ... Aggregation result output unit, 176 ... Comment classification processing unit, 178 ... Comment processing result output, 180 ... Recognition performance improvement method presentation unit, 182 ... Additional information recognition history holding unit, 184 ... Difficulty recognition additional information extraction unit, 188 ... Recognition Performance information presentation section

Claims (17)

An input correction method for correcting additional information that is additionally written and used for recognition processing,
An input correction method characterized by presenting improvement mode information indicating how to add to the recognition performance during the recognition process, except for reference information corresponding to the additional information inputted additionally. This is an additional information processing method for recognizing the content of the additional information added to the document with additional information added to the original document as a processing target, and performing predetermined data processing based on the recognized information. And
Additional information that is information other than the reference information corresponding to the additional information that has been additionally input and that indicates how to improve the recognition performance at the time of the recognition processing is presented. Information processing method. 3. The improvement mode information is presented as information that can be used to determine how much the additional information that has been additionally written is modified and added to determine how much the recognition performance is improved. Additional information processing method. The additional document with additional information added to the original document is processed, the additional information that has been added is extracted from the additional document, and the content thereof is recognized and processed based on the recognized information. A write-once information processing apparatus that performs processing,
An additional information specifying processing unit for recognizing the content of the additional information extracted from the additional document;
Information other than the reference information corresponding to the additional information that has been additionally input and presenting improvement mode information that indicates how the additional performance improves the recognition performance during the recognition process in the additional information specifying processing unit And a recognition performance improvement technique presentation unit. The recognition performance improvement method presenting unit presents information that can be used to determine how much the recognition performance is improved if the additional information that has been additionally written is modified and added as the improvement mode information. The postscript information processing apparatus according to claim 4. The recognition performance improvement method presenting unit has a write-once information recognition history holding unit that stores the additional information recognized and processed in the normal data processing process,
The postscript information processing apparatus according to claim 4 or 5, wherein the improvement mode information is presented with respect to the additional information stored in the postscript information recognition history holding unit. The said recognition performance improvement method presentation part presents the said improvement aspect information regarding the said additional information extracted from the said postscripted document which was not used for the said normal data processing. The claim 4 or 5 characterized by the above-mentioned. The postscript additional information processing apparatus. The additional information processing apparatus according to claim 4 or 5, wherein the recognition performance improvement technique presenting unit presents the improvement mode information regarding the additional information extracted from the sentence-added document for practice. . The recognition performance improvement method presenting unit has a difficult recognition additional record information extraction unit that extracts difficult recognition information whose recognition performance is less than a certain level among the various additional information extracted from the additional document.
The postscript information processing apparatus according to any one of claims 4 to 8, wherein the improvement mode information is presented for the hard recognition information extracted by the hard recognition additional write information extraction unit. The additional information processing apparatus according to claim 9, wherein the difficult recognition additional record information extraction unit extracts the difficult recognition information based on a reliability of the additional information with respect to the reference information in the recognition process. The postscript information processing apparatus according to claim 9, wherein the hard recognition additional write information extraction unit extracts the difficult recognition information based on a correction state with respect to a recognition processing result of the additional information. The difficult-to-recognize additional information extraction unit extracts erroneously recognized information among the additional information corresponding to the reference information extracted from the sentence-added document for practice in which the reference information to be entered is specified. The postscript information processing apparatus according to claim 9, wherein the additional information processing apparatus is extracted as the difficult recognition information. The additional recording information specifying processing unit includes a deformation processing unit that deforms an image shape of the additional information to be recognized and generates deformed information used for the recognition processing,
The recognition performance improvement method presenting unit presents, as the improvement mode information, the additional information before correction by the deformation processing unit and the modified information used by the additional information identifying process for the recognition processing. The postscript information processing apparatus according to claim 4, further comprising a recognition performance information presentation unit. The recognition performance improvement method presenting unit, as the improvement mode information, sets the difficulty recognition information at a distance from the reference information according to the reliability of the difficulty recognition information extracted by the difficulty recognition additional record information extraction unit with respect to the reference information. The postscript information processing apparatus according to any one of claims 9 to 12, further comprising a recognition performance information presenting unit that arranges and presents the information. The recognition performance improvement method presenting unit can easily recognize all the additional information stored in the additional information recognition history holding unit corresponding to the reference information for each common reference information as the improvement mode information. The postscript information processing apparatus according to claim 6, further comprising: a recognition performance information presentation unit that arranges and presents in order of sex. The recognition performance improvement method presentation unit classifies in advance the type of misrecognition and an improvement method for the misrecognition, determines which type of misrecognition of the additional information corresponds to the type, and the determination result The postscript information processing apparatus according to any one of claims 4 to 12, further comprising a recognition performance information presentation unit that presents an improvement method based on the information as the improvement mode information. The additional document with additional information added to the original document is processed, the additional information that has been added is extracted from the additional document, and the content thereof is recognized and processed based on the recognized information. A program for performing processing using a computer,
The computer,
An additional information specifying processing unit for recognizing the content of the additional information extracted from the additional document;
Information other than the reference information corresponding to the additional information that has been additionally input and presenting improvement mode information that indicates how the additional performance improves the recognition performance during the recognition process in the additional information specifying processing unit A program characterized by functioning as a recognition performance improvement technique presentation unit.

Images