JP4710707B2 - Additional recording information processing method, additional recording information processing apparatus, and program - Google Patents

Description

  The present invention relates to a write-once information processing method, a write-once information processing apparatus, and a program. More specifically, the present invention relates to a mechanism for separating additional information (also referred to as additional information or annotation) additionally written in a document from the document body and using it for various information processing related to the document body.

  In today's remarkable progress in information processing technology, there is a mechanism for automatically processing various processes related to documents. For example, additional additional information is additionally recorded on a document original in which predetermined information is written in advance, and predetermined data processing is performed based on the added additional information, with the additional document added with the additional information as a processing target. There is a mechanism to do.

  For example, if you enter information on a standard slip and make the entered information to be processed, enter the schedule by hand in a notebook or memo that has a date or schedule entry field in advance. There is also a mechanism for personal information management (especially also called schedule management) that converts a planned schedule into electronic data. There is also a mechanism for performing document editing processing such as image editing and character editing using proofreading symbols.

  Taking document editing processing as an example, for example, Patent Document 1 discloses a mechanism for editing character information according to the type of red image data after extracting character information and red image data. In this mechanism, the red image is separated from the other image planes (for example, black character information) by using a red image that matches the predefined “red”.

JP-A-5-108791

In the present invention, the first type of additional information and the second type of additional information including the first additional information and the second additional information are additionally written as further additional information in the original document in which the predetermined information is described. It is an object of the present invention to provide an additional information processing apparatus that performs predetermined data processing on each of the first additional information and the second additional information, using the additionally recorded document as a processing target .

The present invention relates to first additional information written in a first color as further additional information in the original document in which predetermined information is described, first additional information that is a scoring symbol, and the scoring symbol. the write-once already documents associated second type of additional information entered in a second color different from the a is the second write-once information unrealized said first color information is additionally written as a processing target, the additional information An additional information processing device that performs predetermined data processing based on the information, and extracts difference information including the first type additional information and the second type additional information from the difference between the original document and the additional written document A difference extraction unit, a data processing target additional information extraction unit that extracts the second type of additional information by extracting a color component of the second color from the extracted difference information, and the extracted For figures contained in the second type of additional information A figure shape recognizing unit that recognizes the shape of the figure and recognizes each of the first additional information and the second additional information, and recognizes a character included in the extracted second type additional information. The character recognizing unit for recognizing each of the first additional recording information and the second additional recording information, and the graphic shape recognizing unit and the character recognizing unit that are recognized and separated from the second additional recording information. A first data processing unit that performs a scoring process on the first additional information, and the second additional information that is recognized by the graphic shape recognition unit and the character recognition unit and separated from the first additional information is classified. And a second data processing unit that performs processing .
Preferably, a write-once member specifying unit for specifying the wavelength component of the write-on member of the write-once member used for filling in the second type of additional information made in the second color existing in the postscript-added document is provided. Further, the data processing target additional information extracting unit extracts the second type additional information with reference to the wavelength component specified by the additional member specifying unit.
Preferably, the second data processing unit performs a process of classifying the second additional write information based on predetermined classification information for the second additional write information.
In a preferred embodiment, the second data processing unit further displays the processing result by the first data processing and the processing result by the second data processing as the first additional information and the second additional information. Based on the postscript position, it is stored in association.

  The mechanism according to the present invention can be realized by software using an electronic computer (computer), and a program for this purpose and a recording medium storing this program can also be extracted as an invention. The program may be provided by being stored in a computer-readable storage medium, or may be provided by distribution via wired or wireless communication means.

According to the present invention , the second type additional information is extracted from the additionally recorded document in which the first type additional information and the second type additional information are added as additional information, and are included in the second type additional information. Predetermined data processing can be performed for each of the first additional write information and the second additional write information.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

<Example of processing target document>
1 to 3 are diagrams showing an example of a document to be processed in an information processing system including the additional information processing apparatus according to the present invention. In both cases, the original document 8A is shown in (A), and the added document 8B is shown in (B). An example of registration information in the database is shown in (C).

  First, the document of the first example shown in FIG. 1 is a document used for document editing processing, as in the mechanism described in Patent Document 1, and FIG. 1A shows the original document 8A. (B) schematically shows a state (additional document 8B) in which additional information for editing instruction is entered.

  For example, at a document editing processing site, an editing target document 70 that is an example of the original document 8A shown in FIG. 1A is processed, and a correction symbol 77 for editing instructions and a proof comment 78 are added to a portion requiring correction. I will add. In this case, the character image color used in the editing object document 70 and the pen color used for entering the proofreading symbol 77 and the proofreading comment 78 are usually different.

  For example, a proofreading symbol 77 indicating a proofreading pattern corresponding to correction / editing processing and a proofreading comment 78 describing the proofreading instruction content are written on a black character image editing target document 70 with a red writing tool. The proofreading information entry completed document 71 which is an example of the additionally recorded document 8B shown in (B) is obtained.

  Thereafter, the proofreading information filled document 71 is read, and the proofreading information filled document 71 is automatically corrected (the image is reconstructed) based on the added red additional information (the proofreading symbol 77 and the proofreading comment 78).

  It should be noted that the registration of the editing target document 70 (original image) for executing document editing processing as data processing based on the proofreading symbol 77 and the proofreading comment 78 is necessary at the time of proofreading work based on the proofreading symbol 77. Calibration symbol information 37 for specifying processing contents is registered. It is possible to register processing contents common to all documents, but by registering the proofreading symbol 77 and its processing contents separately from the editing target document 70, editing according to each proofreading information filled document 71 is possible. Since the work can be performed, it is possible to execute a special calibration work that cannot be realized with the common processing contents registered in advance.

  For example, as shown in FIG. 1C, information including each calibration symbol 77 and each processing content is stored and accumulated in a predetermined storage area in a table format in which these are associated with each other.

  The document of the second example shown in FIG. 2 is an educational material 80 used as a paper medium in an educational field. As a typical example, a question sentence 82 and an answer column 84 (in this example, shown in parentheses). 2 (A) shows the original document 8A, and FIG. 2 (B) schematically shows a state in which additional information has been entered (added document 8B).

  Specifically, the educational material 80 corresponds to a paper test or a practice question sheet used in an educational institution. The educational material 80 only needs to have at least an answer column 84. For example, an answer may be written in the answer column 84 for a question read by the grader, and the question sentence 82 is not necessarily described. Not necessary.

  As shown in FIG. 2 (A), the educational material 80 includes a scoring field 83 (by question) in addition to a question sentence 82 and an answer field 84 in which an answer, which is an example of the first type of additional information, is entered. An item score field 83a, a partial score field, and a total score field 83b), and an identification information field 85 for entering information for identifying and specifying the educational material 80 as an example of the first type of additional information; , Answerer information which is an example of the first type of additional information, and an answerer information column 86 in which information related to the answer entry person in the answer column 84 is entered. The answer field 84, the identification information field 85, and the answerer information field 86 are all examples of entry fields for entering the first type of additional information.

  In the identification information column 85, for example, the subject, title, or applicable grade of the educational material 80 is described in advance. However, in addition to these descriptions or separately from these descriptions, code information for identifying the educational material 80 may be embedded.

  The embedding of the code information may be realized by using a known technique. As one specific example, for example, a line screen or a dot screen as a gradation expression such as a so-called “iTone (registered trademark)” is used. It is conceivable to use a technique of embedding digital information in a halftone image by changing the form (position, shape, etc.) of the pixels constituting the image. On the other hand, in the answerer information column 86, the class 86a, attendance number 86b, name 86c, etc. of the answer entry person can be entered.

  In the scoring field 83 (particularly, the item scoring field 83a), scoring information for each answer field 84 is entered. Scoring information is information for identifying the number of points assigned to the answer column 84 at each position for each answer column 84 in the educational material 80. The points may be different for each answer column 84 or may be uniform. The scoring column 83 (particularly the totaling column 83b) and the answer column 84 can also be used as an extraction target designation column 8c described later.

  Such educational teaching material 80 can be obtained by printing out with a printing apparatus based on the electronic data of the corresponding original (teaching material original). The electronic data of the original teaching material can be generated using application software such as word processing software using an electronic computer such as a personal computer, and is stored in a predetermined database or the like in advance.

  The electronic data of the original teaching material can specify the layout of the answer column 84 and the identification information column 85 in the educational teaching material 80 and can be stored and accumulated in a predetermined database. Any data format is acceptable. For example, the application document data created by the document creation software is not limited to image data.

  At the educational site, an educational material 80, which is an example of the original document 8A shown in FIG. 2A, is distributed to students, examinees, etc. First, the names and answer fields 84 to the answerer information field 86 are assigned by the students. The first type additional information such as the answer to is entered in a predetermined column and collected. Thereafter, a scoring symbol (correct / incorrect determination) for the answer entered in each answer column 84 by a scoring officer such as a teacher, as in the additional information filled teaching material 81 as an example of the added document 8B shown in FIG. The second type of additional information such as a comment 88 indicated by a graphic) 87 or other graphic or text related to the scoring symbol 87 is entered. Note that since the additional information processing apparatus 10 performs automatic scoring processing, there is no entry in the scoring field 83C by the scoring officer at this time.

  In this case, the pen color usually used for the entry of the first type of additional information by the student is different from the pen color used for the entry of the second type of additional information by the grader or the like. The color used is different from the color pre-filled as the educational material 80.

  In addition, as the scoring symbol 87, for example, “O” indicating a correct answer and other figures (for example, an elliptical figure), “X” indicating an incorrect answer and other figures (for example, a check mark such as “R”), There are “△” indicating a correct answer and other figures.

  The comment 88 is information that does not have a direct relationship with the first data processing based on the scoring symbol 87, but supports (reinforces) the result of the first data processing or has no relationship at all. It is used for data processing.

  In the learning material automatic scoring system, predetermined data processing is performed for the additional information filled learning material 81 which is an example of the added document 8B. At this time, in addition to the second type of additional information (in this example, scoring symbol 87 and comment 88), individual data processing corresponding to each is performed. In this example, automatic scoring processing based on the scoring symbol 87 is performed as the first data processing. As this automatic scoring processing result, for example, scoring information to be entered in the scoring field 83C is acquired. Further, the second data processing different from the automatic scoring processing result based on the additionally written contents of the comment 88 is performed.

  As a second data process different from the automatic scoring process, for example, a process for classifying the additional contents of the comment 88 based on a predetermined condition, a classified comment (not only all the additional contents but also a part of the additional data) The content may be registered) and stored in the student guidance database in association with the scoring processing result for the corresponding answer column 84.

  In this way, as a use form of the second data processing different from the automatic scoring process, information can be taken out from the student guidance database and used for subsequent student guidance. For example, if all the scoring results and the corresponding comments are displayed, the scoring results can be confirmed together with the subcategories of evaluation such as excellent, excellent, average, inferior. In addition, if only comments with incorrect answers are displayed, it can be used to analyze the ability of students who have many mistakes in reading questions, many mistakes in writing answers, or many calculation errors. Alternatively, it may be used for student guidance based on a cautionary note or mistake correction indicated by the comment 88.

  In addition, when registering the educational material 80 (original image) for executing data processing for the scoring symbol 87 and the comment 88 in the database, the answer column 84 required for data processing for the scoring symbol 87 is used. The entry field position area information 38 indicating the position information, the problem number, the scoring information, and the like and the classification standard information necessary for data processing for the comment 88 are registered.

  For example, as shown in FIG. 2 (C), an answer column and scoring column position area information, which is an example of entry field position area information 38, is assigned to the number of the question existing on the educational material 80 and the answer to the question. The xy coordinates of a predetermined point (for example, the upper left vertex) of the area handled as the answer column 84 for entering the answer and the answer of the question, the width (W) and height (h) of the circumscribed rectangle, and the extraction target designation A table that associates the xy coordinates of a predetermined point (for example, the upper left vertex) of the area treated as the column 8c (totaling column 83b) and the width (W) and height (h) of the circumscribed rectangle with each other. In a format, it is stored and accumulated in a predetermined storage area.

  If the original educational material 80 corresponding to the additional information-filled educational material 81 is not registered in the document management server, the blank educational material 80 may be read by the document input device.

  The document of the third example shown in FIG. 3 is a business document used by a businessman or the like, and shows a schedule management notebook 90 as a typical example. A general notebook 90 has a date (year / month / day) column 92 and a schedule column 94 for entering a schedule 97 for each date. FIG. 3A shows the original document 8A, and FIG. B) schematically shows a state in which additional information has been entered (added document 8B). FIG. 3A shows an example in which the schedule column 94 for entering the schedule 97 is divided by date units, but there are also cases where the schedule column 94 is divided by time (time) units within each date. . The schedule column 94 is an example of an entry column for entering the first type of additional information. In the schedule column 94, for example, a schedule 97 to be executed at the corresponding date and time can be entered. In addition, you may provide the extraction object designation | designated column 8c (it mentions later for details) as needed.

  Such a notebook 90 can be purchased in the market, or can be obtained by printing out with a printing apparatus based on electronic data of a corresponding original (notebook original). The electronic data of the notebook original can be generated using application software such as word processing software using an electronic computer such as a personal computer, and is stored in a predetermined database in advance.

  The electronic data of the notebook original can be specified in the data format as long as it can specify the layout of the date column 92 and the schedule column 94 in the notebook 90 and can be stored and stored in a predetermined database. It doesn't matter. For example, the application document data created by the document creation software is not limited to image data.

  At the business site, a notebook 90 which is an example of the original document 8A shown in FIG. 3A is put close to the office. First, a schedule 97 (first type additional information) in the schedule column 94 is set by the owner of the corresponding date and time. It is entered in the schedule column 94. At this time, a classification symbol 99 (for example, for the schedule 97 entered in each schedule column 94 by the owner himself / herself, such as an additional information entry notebook 91 which is an example of the added document 8B shown in FIG. 2nd type additional information such as a comment 98 indicated by other figures and texts related to the schedule 97 is entered.

  At this time, the character color used in the notebook 90 is usually different from the pen color used for the entry of the schedule 97 and the comment 98.

  The classification symbol 99 includes, for example, “P” indicating private use and other characters / graphics (for example, ◇ mark). By attaching the classification symbol 99 only for private use, it is not necessary to attach the classification symbol 99 for business use.

  The comment 98 is information that does not have a direct relationship with the first data processing based on the schedule 97. However, the comment 98 supports (reinforces) the result of the first data processing or has no relationship at all. 2 is used for data processing.

  The comment 98 including the classification symbol 99 has a meaning as a proofreading symbol with respect to additional contents in a general business document (corresponding to the schedule 97 in the example of the additional information entry completed notebook 91), and this comment 98 is used. Thus, the schedule 97 can be edited based on a predetermined condition.

  For example, in the personal information management system, predetermined data processing is performed for the additional information filled-in notebook 91 that is an example of the additional-recorded document 8B. At this time, in addition to the second type of additional information (in this example, the type of the schedule 97 based on the comment 98), individual data processing corresponding to each is performed. In this example, an automatic schedule management process based on the contents of the schedule 97 (the conversion of the schedule 97 into electronic data) is performed as the first data process, and the automatic schedule management process itself based on the contents added to the comment 98 is Another second data processing is performed.

  As a second data process different from the automatic schedule management process itself, for example, the automatic schedule management process result as the first data process is used for company and private use according to the additional description of the comment 98 (including the classification symbol 99). For example, processing for classifying the schedule 97 (not limited to all the additional writing contents but also a part of the additional writing contents) in association with the corresponding date, and individually storing and accumulating them in the database. .

  By doing so, the company schedule and the private schedule can be separated and managed on the database. It becomes easy to use because it is possible to set each database public and private individually.

  In the mechanism described in Japanese Patent Laid-Open No. 5-216932, a single process is performed for all the contents entered in the schedule column 94. In this example, a single database is used for both work schedules and private schedules. Will be registered as For this reason, for example, when trying to publish / share a work schedule, it is greatly different from the inconvenience that even private schedules that are not desired to be made public are made public.

  In addition, when registering the notebook 90 (original image) for executing data processing for the schedule 97 and the comment 98 in the database, the position of the schedule column 94 required when processing the data for the schedule 97 and the comment 98 If the information and the extraction target designation column 8c are provided, the entry column position area information 38 indicating the position information of the extraction target designation column 8c and the classification standard information necessary for data processing for the comment 98 are registered. Keep it.

  For example, as shown in FIG. 3 (C), the schedule column position area information, which is an example of the entry field position area information 38, is converted into a date (year / month / day) existing on the notebook 90 and a time (time) in each date. ), The xy coordinates of a predetermined point (for example, the upper left vertex) of the area treated as the schedule column 94 for entering the schedule 97, and the width (W) and height (h) of the circumscribed rectangle. Are stored and stored in a predetermined storage area in a table format that associates them with each other.

<Additional information extraction processing; basic concept>
FIG. 4 is a diagram for explaining a postscript information extraction processing method for separating and extracting the postscript information added to the information already written in the original document 8A with the postscript added document 8B as a processing target. In the present embodiment, the extraction of postscript information from the original document 8A is performed by using information (red wavelength component) corresponding to the wavelength component (eg, red wavelength component) of the writing material of the postscript member (eg, writing instrument) used for the postscript. This is performed by detecting (information). This point is similar to the mechanism described in Patent Document 1 including a red area detection unit that detects a red data area in the processing target.

  However, in the mechanism described in Patent Document 1, the wavelength component to be extracted is limited to “red”, but the present embodiment is different in that the wavelength component can be arbitrarily set. That is, it is greatly different in that the wavelength component to be extracted can be matched with the wavelength component of the writing agent (for example, ink or pencil core) of the additional recording member actually used during the additional recording process. .

  For example, as other wavelength components in the visible light band, it is possible to extract focusing on “green” and “blue”, so that a green pen or a blue pen can be used as the additional recording member. In addition, wavelength components outside the visible light band can be set, and for example, extraction focusing on the wavelength region of “ultraviolet rays” and “infrared rays” can be performed. Therefore, so-called invisible pens can be used as additional recording members.

  In addition, there are various writing instruments used in the additional recording process, and the wavelength component of the writing agent is, as a general concept, for example, “red”, but its range (corresponding wavelength region) is wide, and pink or Although it is a wide range such as orange, even in this case, it is possible to specify the wavelength component of the writing agent of the additional member used for additional recording, and extract the information corresponding to the specified wavelength component, realizing high accuracy extraction processing it can. That is, by adding the wavelength component to be extracted to the pen color that is actually used in the additional recording process, additional information for data processing (for example, calibration symbol 77, calibration comment 78, scoring symbol 87, comment 88, schedule 97, The comment 98) can be extracted stably.

  For example, when extracting “red” information as a general concept, the most red color in the color space (for example, RGB color space) is selected. At this time, in order to extract “what seems to be red”, a red extraction allowable region is set in the color space, and a suitable pixel is extracted, that is, the pixels in the set extraction allowable region are pixels of the red component. Extract.

  At this time, as a general concept, when trying to deal with any “red” pen in a wide area such as pink or orange belonging to “red”, as shown in FIG. From the ideal “red”, it is necessary to set a relatively wide general-purpose area as an extraction allowable area as an extraction target. This is because, if the extraction allowable area is narrowed, it becomes impossible to deal with pink and orange pen colors that are far from the ideal “red”.

  For example, in the red area detection means, each color image data of R, G, and B is individually processed, and first, a pixel including only an R color image signal is detected in order to extract “ideal red”. Further, in order to make room, a difference between the R, G, and B color image signals is detected, and a pixel in which each of the other G and B color image signals is at a low level with respect to the R color image signal is detected.

  By doing this, the pixel data on the R axis and the range A in which the R component is stronger than the G and B components in the R axis direction are detected as the red region. To do so, as shown in FIG. 4A, a wide extraction allowable region (a rectangular parallelepiped region indicated by a dotted line in the drawing) must be set in the G-axis direction and the B-axis direction. In this case, even when the pen color actually used is at point a in FIG. 4A, pixel components such as pink and orange that exist in the color image are extracted as pen color components. End up.

  On the other hand, if the wavelength component of the writing agent of the additional recording member used for additional recording is specified, as shown in FIG. In addition, the R-axis direction can be set narrowly, and the entire extraction allowable region (a rectangular parallelepiped region indicated by a dotted line in the figure) can be made a narrow region (practical region) according to the actual situation.

  Thus, for example, when the pen color used for additional writing is at point b in FIG. 4B, the pixel components from pink to orange that exist in the color image and the pixel component at this point b (that is, The actual pen color component) can be accurately distinguished and extracted. It becomes possible to extract the postscript information entered with the postscript color of the specified postscript member with high accuracy.

  Thus, according to the mechanism of the present embodiment, when detecting pen color component data based on color-compatible image data, the pen color component can be separated by narrowing the extraction allowable range in accordance with the actual. It can be performed easily and reliably, and highly reliable additional information extraction can be realized. As a result, highly reliable data processing (for example, automatic scoring processing) can be realized.

<Additional information extraction process; identification method of wavelength component>
5 to 8 are diagrams for explaining various methods for specifying the wavelength component (additional recording color) of the writing agent of the additional recording member used for additional recording. Here, FIG. 5 is a diagram for explaining an example of the location of the additional information to be noted during the specific process. Moreover, FIGS. 6-8 is a figure explaining the specific example of an additional recording color specific process.

  In the automatic scoring process of the present embodiment, it is assumed that the teacher enters the total score in the total score column of the totaling column 83b. The purpose of the automatic scoring system is to record correctness and use it for later student guidance.

  In the present embodiment, first, the wavelength component (hereinafter also referred to as a specific color) of the writing agent of the write-on member used for filling in the write-once information to be processed by the data is specified, and this specified specific color (additional color) Extraction of additional information (also referred to as specific color extraction) is executed with attention, and various methods can be considered for specifying the specific color.

  For example, an area of the pen color used in the RGB color space is defined (hereinafter also referred to as a color area definition), and pixels that match the defined area are extracted. Is not compatible with signal processing variation, components that are close to the specified specific color are extracted. For example, when the additional information filled teaching material 81 is a processing target, the color of the red pen used for scoring is specified, and red close to it is extracted.

  Further, when specifying the wavelength component (for example, pen color used) of the writing agent of the write-once member to be extracted, for example, a first method of previously registering the write-once member to be used for each postscriptor can be considered. Alternatively, the wavelength distribution (equivalent to the color distribution) is analyzed for the difference information 9 obtained as a result of comparison (difference extraction processing) between the added document 8B and the original document 8A, and is actually used based on the analysis result. A second method for specifying the wavelength component of the writing agent is also conceivable.

  In addition, after specifying the specific color used to fill in the additional information to be processed by the data, only the information about the specific color is extracted from various additional write images, and the additional information to be processed by the data Differentiate from postscript information. At this time, extraction is performed for each pixel on the scanned image if the proximity to the specified additional recording color is within a certain range.

  Further, when specifying the wavelength component (for example, pen color used) of the writing agent of the additional recording member to be extracted, the additional information filling agent added by the additional recording member at a position based on a predetermined rule in the additional writing document to be processed. A third method for specifying the wavelength component of the second is also conceivable. For example, it is an example to extract a postscript portion by a relative position such as “top or bottom in a document”.

  Here, as a registration method in the first method for specifying the additional recording color, an extraction target designation column 8c is prepared in any part of the processing target document, and any additional recording information is added to the extraction target designation column 8c using the additional recording member. The method of filling in can be considered. By doing so, it is possible to extract pixels having the same color components as the additional information entered in the extraction target designation field 8c.

  In specifying the additional recording color, the identification accuracy can be improved by narrowing the analysis target range to the extraction target designation field 8c. For example, even if the additionally-recorded document 8B is a document having a color image, it is possible to specify the additionally-recorded color with high accuracy by providing the extraction target designation field 8c in a portion that is not affected by the color image.

  Here, the extraction target designation field 8c is blank so that no other information such as additional information to be subjected to data processing is described, and only additional information for specifying the additional color is entered. A dedicated special column may be prepared, or a column for entering other additional information such as additional information to be processed may be used.

  If the dedicated extraction target designation field 8c is used, only the additional information for specifying the additional writing color is entered there. Therefore, the accuracy of specifying the additional recording color is improved as compared with the mode also used for the other additional writing information input fields. Can be high.

  In the case of preparing the dedicated extraction target designation field 8c, for example, as shown in FIG. 5A, the extraction target designation field 8c may be prepared in the original document 8A (that is, the added document 8B). As shown in FIG. 5B, a face sheet (work instruction sheet) 8D for scanning is prepared separately from the original document 8A (added document 8B), and an extraction target designation field 8c is prepared on the face sheet 8D. You may do it.

  By using a paper different from the original document 8A corresponding to the post-recorded document 8B to be processed, such as the face sheet 8D, for example, when an additional target color is specified such as providing an extraction target designation field 8c on a blank paper, It becomes easy to avoid the influence of characters and images already written in the original document 8A (added document 8B). On the other hand, when the extraction target designation field 8c is provided in the original document 8A itself corresponding to the additional document 8B to be processed, there is an advantage that it is not necessary to use another sheet, but there is no influence of written characters and images. To do so, it is necessary to provide an extraction target designation field 8c by searching for a position where no character or image is described.

  On the other hand, in the case of sharing, for example, in the case of the educational material 80, as shown in FIG. 5C, the partial point column and the total point column of the totaling column 83b can be used as the extraction target specifying column 8c. Alternatively, as shown in FIG. 5D, the answer column 84 can be used as the extraction target designation column 8c. When the answer column 84 is used as the extraction target designation column 8c, pixels having the same color component as the pen color of the scoring symbol 87 are extracted instead of the pen color of the answer by the student added in the answer column 84. That's fine.

  In a mode in which a dedicated special column is prepared (FIGS. 5A and 5B) and a mode in which the total column 83b is also used, there are color components other than the pen color for the scoring symbol 87 and the comment 88 in that column. Therefore, high-precision extraction can be expected. In addition, the mode of preparing a special column can surely prompt the entry person to fill in, and in the mode of using the totaling column 83b, no space or extra work for the special column is required. May write the result of the summary out of the box. On the other hand, in the mode also used as the answer column 84, the pen color of the answer by the student is present in that column in addition to the pen color for the scoring symbol 87 and the comment 88, and therefore, a process for separating both of them is required.

  For example, in FIG. 6, all additional information (data processing target) is added with reference to the pen color (for example, red) written in the total score field of the totaling field 83b with the additional information filled teaching material 81 as a processing target. It is a figure explaining the specific example (the 1) of the additional recording color specific process which extracts the grading symbol 87 and the comment 88).

  First, for each additional information-added teaching material 81, the position of the total score entry field is registered in advance as shown in the entry field position area information 38 (FIG. 2C) (S10). When the student answer image as the first additional information entry teaching material 81 is input, statistical analysis is performed on the pixel values in the total score entry field (see FIG. 6A) (S12). Specifically, histogram analysis is performed on a processing target image in a predetermined color space such as an RGB color space or a Lab color space.

  Usually, the most frequent pixel value on the histogram is the background color of the additionally recorded document 8B (paper). Therefore, among the pixel values in the total score entry column, the most frequently used pixel value is added to all the additional information filled teaching materials 81 (student answer set) in a color other than the paper that exhibits the most frequent pixel value. The color is set (S14). That is, a wavelength component (equivalent to a color component in this example) that exhibits the most frequent pixel value other than the background component is set as the additional recording color. Then, after specifying the actually used additional writing color, the color area definition is performed by determining the extraction allowable range when extracting the scoring symbol 87 and the comment 88 based on the color (S16).

  Thereafter, only the pixel component belonging to the color region determined to be the additional recording color is extracted, so that the additional processing information and other additional recording information are extracted separately (S18).

  Here, by specifying the additional writing color used for entering the scoring symbol 87 and the comment 88 based on the analysis result of the first sheet, the remaining additional information filled teaching material 81 has the same additional writing color. However, the used pen color (additional writing color) may be specified for each additional information filled teaching material 81.

  Further, FIG. 7 uses the proofreading information filled document 71 as a processing target, further uses the editor list column 75 as the extraction target designation column 8c, and refers to the color of the check mark entered in the editor list column 75. FIG. 10 is a diagram for explaining a specific example (part 2) of the additional recording color specifying process for extracting all additional recording information (calibration symbols 77 and calibration comments 78) to be processed.

  Here, it is assumed that the proofreading information filled document 71 is obtained by performing the proofreading operation on the editing object document 70 with a proof pen of a different pen color for each proofreader (filler). Then, before reading the proofreading information entry document 71 with the proofreading symbol 77 and the proofreading comment 78, as shown in FIG. 7A, the proofreader (entrant) is displayed in the check field 75a of the editor list field 75. Each time, a check mark is attached next to his / her name with a proof pen used by each person (S20).

  Next, the histogram analysis of the processing target image is performed by obtaining the statistics of the pixel values (RGB data) in the check column 75a of the editor list column 75 as in step S12 described above (S22). Usually, on the histogram, the most frequently used pixel value is the paper color. Therefore, for each proofreader, among the pixel values in the editor list field 75, the most frequent pixel value in a color other than the paper exhibiting the most frequent pixel value is used as the proofreader's pen color ( S24).

  After specifying the pen color of all the writers, the color region definition for the proofreader is determined by determining the extraction allowable range when extracting the proofreading symbol 77 and the proofreading comment 78 of each proofreader. Perform (S26).

  Thereafter, by extracting only the pixel components belonging to the color region determined to be the additional recording color, the calibration symbol 77 and the calibration comment 78 by the proofreader (editor) of interest are separated and extracted (S28).

  Thus, by defining the color area for each proofreader, the proofreading symbol 77 and the proofreading comment 78 can be checked for each proofreader.

  FIG. 8 also shows the additional color by analyzing the color distribution of the difference information 9 obtained as a result of the difference extraction process between the added document 8B and the original document 8A in the second method of specifying the additional color. It is a figure explaining the specific example (the 3) of additional recording color specific processing.

  First, as shown in FIG. 8A, the original document 8A and the additionally recorded document 8B are compared, and the difference information 9 is obtained by taking the difference between the two (S30).

  Thereafter, in analyzing the color distribution of the difference information 9, first, statistical analysis of the pixel value of the difference information 9 is performed (S32). Specifically, histogram analysis is performed on the difference information 9 in a predetermined color space such as an RGB color space or a Lab color space.

  In the difference information 9, only information added to the original document 8 </ b> A is extracted. Therefore, unlike the case of FIGS. 6 and 7, the information on the paper color (background color) is already the difference information 9. It is excluded from. On the other hand, all the additional write information regardless of the type is included in the difference information 9.

  For example, if the additional information filled teaching material 81 is to be processed, in addition to the scoring symbol 87 and the comment 88 by the grader, the answer written in the answer column 84 by the student and the answerer information column 86 are entered. The information on the answerer is also included in the difference information 9. Even in this case, if the pen color used by the student is different from the pen color used by the grader, the two can be distinguished by performing a histogram analysis.

  In addition, if the proofreading information entry document 71 that has been proofread by a plurality of proofreaders using proofreading pens of different colors is to be processed, the proofreading symbol 77 and the proofreading comment 78 of each person are different. Information 9 is included. Even in this case, since the pen color used by each proofreader is different, each can be distinguished by performing a histogram analysis.

  Therefore, among the pixel values for the difference information 9, the wavelength component (color component) that is considered to be a noticeable pen color is determined as each additional color (S34). Then, after specifying a noteworthy additional note color (which is actually used), a color region is defined by determining an extraction allowable range for extracting the calibration symbol 77 and the calibration comment 78 based on the specified additional color. (S36).

  Thereafter, only the pixel components belonging to the color region determined to be the additional recording color are extracted, so that the calibration symbol 77 and the calibration comment 78 by the proofreader (editor) of interest are separated and extracted (S38).

  For example, if the writing instrument used by the student is a black pencil or a blue pen and the writing instrument used by the grader is a red pen, the pixel component belonging to the red area can be separated into a black area, a blue area, and a red area on the histogram. By extracting only the additional writing information of the data processing target of only the scoring symbol 87 and the comment 88 and other additional writing information can be extracted separately.

  If the writing instrument used by each proofreader is a black pencil, blue pen, or red pen, the histogram can be separated into a black area, a blue area, and a red area, and only the pixel components belonging to the red area are extracted. Then, the additional information of only the calibration symbol 77 and the calibration comment 78 added by the proofreader using the black pencil, the additional information of only the calibration symbol 77 and the calibration comment 78 added by the proofreader using the blue pen, The proofreading symbol 77 and the additional writing information of only the proofreading comment 78 added by the proofreader using the red pen can be extracted separately.

  If the proofreading information entry document 71 that has been proofread using a proof pen of a single color regardless of the proofreader is to be processed, the frequency is reduced to one point when the histogram analysis is performed. concentrate. In this case, the color component having a high frequency may be determined as the additional recording color (S34). Then, by extracting only the pixel components belonging to the area determined as the additional recording color, it is possible to separate and extract the additional recording information to be processed from the data and other additional recording information (S38).

  Further, in the case where the additional information filled-in notebook 91 is a processing target, when the schedule 97 and the comment 98 are filled in with various color pens, the schedule 97 and the comment 98 corresponding to the used pen color are the difference information. 9 and can be distinguished from each other by performing a histogram analysis.

  Therefore, if it is necessary to extract the pen color separately, the color component that is considered to be a noticeable pen color is determined as each additional color (S34). Then, by extracting only the pixel components belonging to the area determined as the additional recording color, the additional processing information to be processed and the other additional recording information are separated and extracted (S38). Further, if there is no need for special distinction, all may be determined as noteworthy additional colors. For example, if the company schedule 97 and the private schedule 97 are written in different pen colors, an automatic distinction can be made without using a comment 98 for classification (in this example, classification symbol 99). The scheduling process can be performed.

  In addition, when executing automatic data processing for additional information, if additional information is classified into a plurality of types and individual data processing is to be performed for each classification, each additional information is assigned to the other It is necessary to identify and identify them separately. If the separation and recognition of both are not properly performed, the respective data processing cannot be properly performed.

  For example, the additional information filled teaching material 81 shown in FIG. 2 includes an automatic scoring process based on the scoring symbol 87 and a student guidance database construction process based on the comment 88. In this case, it is necessary to distinguish between the grading symbol 87 and the comment 88 and perform a recognition process or the like before performing a final data process.

  On the other hand, in scoring the answer, a comment 88 other than the scoring symbol 87 may be described with the same pen as that of the scoring symbol 87. For example, the pen color corresponds to the pen color through color component recognition processing on the extraction result in the difference extraction unit 132. By simply extracting the predetermined color component, it is not possible to recognize the two appropriately and specify the description. The scoring symbol 87 and the comment 88 cannot be properly separated, which adversely affects the automatic scoring process. In addition to the scoring symbol 87 for automatic scoring processing, the postscript information 81 after returning the additional information filled teaching material 81 to the student, although there is a comment 88 that can be used for student guidance etc. , It will be a situation where students can not use it other than confirming the description.

  Further, in the case of the additional information entry notebook 91 shown in FIG. 3, an automatic schedule management process based on the schedule 97 (converting the schedule 97 into electronic data) and a company schedule based on the comment 98 (including the classification symbol 99). In order to realize such individual processing, the schedule 97 entered in the schedule column 94 and the comment 98 are distinguished and extracted, followed by recognition processing and the like. Data processing must be performed.

  On the other hand, in the digitization of the entered schedule and registration in the database, comments 98 other than the schedule 97 may be written with the same pen as the schedule 97, and the time when each schedule 97 is entered is different. In other words, the pen color used to fill in the schedule 97 varies, and the schedule 97 and the comment 98 are not separated and a different pen color is not always used. In this case, for example, by extracting only a predetermined color component corresponding to the pen color through a color component recognition process for the extraction result in the difference extraction unit 132, it is not possible to extract the two appropriately separated.

  In order to avoid such a situation, for example, a plurality of additional information existing in the additionally written document 8B is based on various features of additional information such as a description position, an image feature amount, or reliability during recognition processing. Thus, it is preferable to classify (separate) into a plurality of types. At this time, it is preferable to perform more accurate separation recognition by referring to a plurality of features as well as based on a single feature of the additional information. In addition, detailed description is omitted about these.

<System configuration>
FIG. 9 is a diagram illustrating a configuration example of an embodiment of an information processing system including the additional information processing apparatus according to the present invention. Note that this information processing system is shown as an application example to a teaching material automatic scoring system that targets teaching materials 80 such as answer sheets.

  As shown in the figure, the automatic teaching material scoring system 1 includes a write-once information processing device 10 that forms the center of the system, and a document input device that digitizes and inputs additional information-filled learning material 81 that is a processing target document into the write-once information processing device 10. 20, a document management server 30 that stores electronic data of an educational material 80 (specifically, the original image) corresponding to the additional information filled educational material 81 that is a processing target document, and information processing (in this example, automatic scoring processing) And a processing result storage server 40 that stores the result of () is connected to the network using wired or wireless.

  The document input device 20 enters an answer in the answer field 84 in the educational material 80, fills in the name in the answerer information field 86, and a scoring symbol 87 by the grader for the answer entered in the answer field 84 (specifically, For example, the additional information filled teaching material 81 in which “○” or “×” is entered) is read using a known optical image reading technique, and the additional information filled teaching material 81 is read. Image data is obtained from the image data.

  The document input device 20 only needs to have a function of converting the additional information-filled teaching material 81, which is a processing target document, into electronic data. For example, a copying machine, a multifunction device, or It can be realized by using a scanner device. In that case, if an automatic document feeder (ADF) is attached, it is convenient that images can be read continuously for a plurality of educational materials.

  Note that the test using the educational material 80 is not limited to using a paper medium. For example, in the case where a test is performed using a tablet PC and the scoring is performed, the teaching material 81 in which the additional information has been entered can be obtained from the beginning in the form of electronic data. In this case, the document input device 20 is included in the system configuration. Is no longer necessary.

  The document management server 30 obtains the original image of the educational material 80 corresponding to the additional information-filled educational material 81, and identification information and identification codes such as subjects, titles, and applicable grades for specifying the original image. In association therewith, it is registered in a predetermined storage medium such as a hard disk device or an optical disk device.

  In addition, the document management server 30 stores the original educational material 80 (original image) corresponding to the additional information-filled educational material 81 and the position of the answer column necessary for data processing regarding the scoring symbol 87 and the comment 88. As shown in FIG. 2 (C), entry field position area information 38 indicating information, problem number, scoring information, etc. is held and accumulated in a predetermined storage area in the form of a table.

  The processing result storage server 40 may be any server that is connected to the appending information processing apparatus 10 through a network and can manage the automatic scoring and counting results for the additional information filled teaching material 81. For example, the processing result database apparatus or the processing Applicable to result file server devices.

  The postscript information processing apparatus 10 that forms the center of the teaching material automatic scoring system 1 includes a read image processing unit 110 that performs predetermined signal processing based on image data of the additional information filled teaching material 81 input from the document input device 20, and a reading A document original specifying unit 120 that identifies and specifies the original document 8A that is the basis of the read image input from the document input device 20 based on processing by the image processing unit 110 is provided. In the learning material automatic scoring system 1, the document original specifying unit 120 functions as a learning material specifying unit 122 that specifies an educational material 80 which is an example of the document original 8A.

  Further, the additional recording information processing apparatus 10 includes an additional recording information extraction unit 130 that extracts additional recording information (annotation) from the image data processed by the read image processing unit 110, and a data processing target extracted by the additional recording information extraction unit 130. The data processing target additional information specifying processing unit 150 for recognizing and specifying the description content and entry position based on the additional information, and data processing based on the description content of the additional information specified by the data processing target additional information specifying processing unit 150 And a data processing unit 170 to perform.

  The read image processing unit 110 performs known image processing techniques (details of each) such as layout analysis, character / graphic separation, character recognition, code information recognition, graphic processing, and color component recognition on the image data input from the document input device 20. The image data analysis unit 112 that performs analysis processing using the description and the image distortion such as the inclination of the image data input from the document input device 20 and the enlargement / reduction ratio in the main scanning direction or the sub-scanning direction are corrected. And a distortion correction unit 114. The distortion correction unit 114 compares the image data input from the document input device 20 with the corresponding original image in the document management server 30 to be compared, and calculates the image distortion (tilt, scaling, etc.). It may be corrected.

  The teaching material specifying unit 122 includes, for example, an identification information analysis unit 123 that analyzes identification information such as a subject, a title, or an applied school year entered in the identification information column 85 based on a data analysis result by the image data analysis unit 112. Similarly, a code information analysis unit 124 that analyzes code information for specifying the educational material 80 embedded in the identification information column 85 is included.

  The teaching material specifying unit 122 is identified based on the analysis result of the image data analysis unit 112, for example, identification information and identification code such as a subject, a title, an applied school year, and the like, and an educational teaching material held and accumulated in the document management server 30 If the information on the 80 original images (for example, identification information and identification codes such as subjects, titles, applicable grades, etc.) is collated and the corresponding original image is not held and accumulated in the document management server 30, it is obtained by the document input device 20. It is determined that electronic data to be compared with the received image data cannot be specified, and an identification specifying error signal is output.

  Note that the learning material specifying unit 122 only needs to be able to identify and specify the original educational material 80 corresponding to the image data (corresponding to the additional information-filled learning material 81) input from the document input device 20, and the identification information analysis unit 123 and the code The information analysis unit 124 only needs to be provided with an appropriate one corresponding to the format of the identification information described or embedded in the identification information column 85 of the additional information filled-in teaching material 81, and is necessarily provided with both. There is no.

  The postscript information extraction unit 130 includes image data whose image distortion has been corrected by the distortion correction unit 114, and image data input from the document input device 20 specified by the teaching material specifying unit 122 (in the additional information filled teaching material 81). A difference extraction unit 132 that compares an original image (corresponding to the educational material 80) corresponding to the educational material 80 using a known image processing technique and extracts a difference therebetween.

  Further, the additional information extraction unit 130 extracts answerer information (an example of the first type of additional information) in the additional information filled teaching material 81 to be read by the document input device 20 based on the extraction result by the difference extraction unit 132. The answerer extraction unit 134 that performs the same processing as that of the graded symbol 87 and the comment 88 in the additional information-filled teaching material 81 to be read by the document input device 20 based on the extraction result by the difference extraction unit 132. And a data processing additional information extraction processing unit 140 for extracting two types of additional information.

  Based on the extraction result by the difference extraction unit 132, the answerer extraction unit 134 obtains handwritten numbers and character images of answerers written in the class 88a, attendance number 88b, and name 88c fields of the answerer information column 86. Handwritten information extraction unit 136 that extracts the text information as it is, and handwritten information in the answerer information column 86 based on the extraction result by the difference extraction unit 132 (preferably about the handwritten information extracted by the handwriting information extraction unit 136) And a character recognition processing (OCR: Optical Character Reader) unit 138 that converts information into character data that can be processed and edited on the additional information processing apparatus 10.

  The answerer extraction unit 134 only needs to be able to extract the answerer information entered in the answerer information column 86 in the additional information-filled teaching material 81 to be read by the document input device 20. Any one of the character recognition processing units 138 may be provided. In addition, regarding the part of the comment 88 in which the character recognition processing unit 138 is not provided or the character recognition processing unit 138 cannot recognize the character, the extracted answerer information is handled as an image as it is.

  The postscript information extraction processing unit 140 for data processing includes a postscript member specifying unit 141 that specifies the wavelength component of the writing agent of the postscript member used for entering the additional information to be processed in the postscripted document 8B. With reference to the additional color information specified by the member specifying unit 141, based on the extraction result by the difference extraction unit 132, the additional information extracted by the additional information extraction unit 130 becomes the reading target by the document input device 20. A data processing target additional information extraction unit 142 for extracting additional information (score symbol 87 and comment 88 in this example) that is a target of data processing in the additional written document 8B (in this example, additional information filled teaching material 81); A write-once information shaping unit 146 that shapes the post-write information of the data processing target extracted by the process target write-once information extraction unit 142 so as to withstand data processing. In the present embodiment, the data processing target additional information extraction unit 142 includes functions of a scoring symbol extraction unit that extracts a scoring symbol 87 and a comment extraction unit that extracts a comment 88.

  The data processing target additional writing information extraction unit 142 only needs to be able to extract additional processing information (in this example, a scoring symbol 87 and a comment 88) to be processed, and the additional processing information may be further classified using a color as an index. For example, through a color component recognition process on the extraction result in the difference extraction unit 132, the grader may extract a predetermined color component corresponding to the pen color used for entering the scoring symbol 87 and the comment 88. For example, the scoring symbol 87 and the comment 88 in the additional information-filled teaching material 81 are generally entered with a red pen (a red writing instrument). In this case, it is only necessary to perform an extraction focusing on the red component.

  However, even though the red pen is used, there are similar colors such as pink and orange, and the red pen is not always used for entering the scoring symbol 87 and the comment 88. The scoring symbol 87 and the comment 88 are not necessarily used. May be entered in a different pen color, so that the pen color information used for entering the scoring symbol 87 and the comment 88 is added to the data processing target additional information extracting unit 142 functioning as a scoring symbol extracting unit and a comment extracting unit. It is preferable to improve the extraction performance by configuring it to be settable.

  For this reason, in the present embodiment, the additional recording member specifying unit 141 first specifies the additional recording color actually used by applying the first, second, or third method for specifying the additional recording color described above. The data processing target additional recording information extraction unit 142 is notified of the specified additional recording color information. That is, the additional recording member specifying unit 141 functions as an additional recording color specifying unit that specifies the additional recording color that is a pen color used for entering the additional recording information to be subjected to data processing. The data processing target additional recording information extracting unit 142 refers to the additional recording color information notified from the additional recording member specifying unit 141 and performs extraction focusing on the additional recording color.

  At this time, since the pen color actually used is specified by the additional recording member specifying unit 141, the data processing target additional information extracting unit 142 may narrow the extraction allowable range as compared with the case of simply focusing on the red component. it can. Thereby, the grading symbol 87 and the comment 88 can be extracted with distinction from other additional information with high accuracy.

  The additional write information shaping unit 146 performs correction processing on the additional write information of the data processing target extracted by the data processing target additional write information extraction unit 142 so as to connect the line segments and eliminate the interruption between the extracted line segments. A line segment break correction unit 148 is provided.

  In general, figure entry on the added document 8B, figure entry such as "double line", "wavy line", "Hanamaru", "arrow", etc., and comment sentences, etc., are repeated on the completed entry. Sometimes. For example, in the case of the additional information filled-in teaching material 81, the grades such as “○” and “x” are superimposed on the frame for identifying each question sentence 82 and each answer column 84 and the answer entry contents in each answer column 84. The symbol 87 may be entered, or the comment 88 may be additionally written with graphics or characters. For this reason, the extraction result of the predetermined color component by the data processing target additional information extracting unit 142 may result in a discontinuity in the graphic or character as a result of removing the overlapping portion.

  From this, the extraction line segmentation correction unit 148 performs thinning processing on the extraction result that should be a graphic or a character such as “◯”, “×”, “line”, and other marks (marks). End point extraction processing, end point connection processing (so-called connection processing), or linear approximation of a line figure is appropriately executed. Note that the thinning process, end point extraction process, end point connection process, straight line approximation of line figures, etc. performed at this time may be performed using known techniques, and therefore detailed description thereof is omitted here (for example, , "Image processing and recognition", Takeshi Aoiin, published by Shosodo).

  The data processing target additional information specifying processing unit 150 has added the data based on the difference extraction result by the difference extracting unit 132, specifically, based on the data processing target additional information corrected by the extraction line segmentation correcting unit 148. The first data processing additional information recognition unit 154 that recognizes the entry content of the first data processing additional information in the document 8B separately from the second data processing additional information and the second data processing additional recording. A second data processing additional information recognizing unit 164 that recognizes the information entry content separately from the first additional information for data processing is provided.

  As the data processing target additional information specifying processing unit 150, the first data processing additional information recognition unit 154 recognizes the content of the scoring symbol 87 in the additional information-added teaching material 81 separately from the comment 88, and The two-data processing additional information recognition unit 164 recognizes the content of the comment 88 in the additional information-added teaching material 81 separately from the scoring symbol 87.

  The data processing additional information recognition units 154 and 164 perform the shape recognition process on the data processing additional information that has been corrected by the extraction line segmentation correction unit 148, thereby entering the data processing additional information. By performing character recognition processing on the entry contents of the data processing additional information corrected by the graphic shape recognition units 156 and 166 and the extraction line segmentation correction unit 148, the contents of the additional information for data processing are changed. Original document 8A (added document 8B) of the contents of the additional information for data processing recognized by the character recognition units 157 and 167 to be recognized, the graphic shape recognition units 156 and 166, and the character recognition processing units 157 and 167 There are entry position recognition units 158 and 168 for recognizing the entry position above. The figure shape recognition units 156 and 166 and the character recognition processing units 157 and 167 constitute a separation recognition processing unit 155 that recognizes the scoring symbol 87 and the comment 88 separately.

  In the case where the character recognition processing units 157 and 167 are not provided or the data processing additional information portion that cannot be recognized by the character recognition processing units 157 and 167, the extracted additional information for data processing is handled as an image as it is. To do.

  As shown in the figure, each of the figure shape recognizing units 156 and 166, the character recognition processing units 157 and 167, and the entry position recognizing units 158 and 168 may be configured such that one function unit realizes both functions. However, they may be provided independently as individual functional units.

  For example, in the configuration in which the additional information filled-in teaching material 81 is a processing target, the first data processing additional information recognition unit 154 uses the scoring symbol 87 as additional information for the first data processing. It functions as a part. In this case, the figure shape recognizing unit 156 for the scoring symbol 87 determines whether the entry content of the scoring symbol 87 is “correct answer (◯)”, “incorrect answer (×)”, or “partially correct answer (Δ)”. It is only necessary to be able to recognize from the side of the figure. For example, shape recognition may be performed by pattern matching with the figure shapes of “◯”, “×”, and “Δ”. Alternatively, the feature amount of the recognition target figure may be calculated and the shape may be recognized from the feature amount. As the feature amount, for example, the number of holes, the area ratio of the target figure occupying the circumscribed rectangle, or the like can be used.

  The character recognition processing unit 157 for the scoring symbol 87 determines whether the contents of the scoring symbol 87 are “correct answer (◯)”, “incorrect answer (×)”, or “partially correct answer (Δ)”. It only needs to be recognized from the side. If the scoring symbol 87 is only a figure, the character recognition processing unit 157 can be omitted.

  Further, the entry position recognition unit 158 for the scoring symbol 87 may recognize the entry position of the entry contents of the scoring symbol 87 on the additional information-added teaching material 81 by, for example, coordinate analysis on the educational teaching material 80.

  Note that the figure shape recognizing unit 156, when recognizing the shape related to the scoring symbol 87, treats the continuous pixel group constituting the figure indicating the scoring symbol 87 such as “◯” and “x” collectively as one. In order to give an identifier to the continuous pixel group, a labeling process which is a general image processing technique is performed. Therefore, even when the position recognition by the entry position recognition unit 158 is performed, the result of the labeling process is used to select one continuous pixel group constituting the graphic indicating the scoring symbol 87 such as “◯” or “×”. Treat as a group of two.

  In addition, since the entry position recognition unit 158 generally recognizes the entry position of the scoring symbol 87, a plurality of scoring symbols 87 are generally entered on the additional information filled teaching material 81. For each of the symbols 87, the positions of the scoring symbols 87 detected in the predetermined scanning order are sequentially recognized.

  Position recognition regarding each scoring symbol 87 is performed, for example, by calculating circumscribing rectangle information of a figure (or character) indicating the scoring symbol 87 such as “◯” or “×”, and further calculating the center coordinates of the circumscribing rectangle. It is possible. Specifically, a circumscribed rectangle is extracted for a figure or character (a group of continuous pixels) to be recognized, and the xy coordinates of a predetermined point (for example, the upper left vertex) of the circumscribed rectangle, and the width of the circumscribed rectangle ( W) and height (h) are calculated. Then, from these calculation results, the center x coordinate = x + w / 2 and the center y coordinate = y + h / 2 are calculated, and the calculation result is used as the recognition result of the position of the continuous pixel group, that is, the entry position of the scoring symbol 87.

  On the other hand, the second data processing additional information recognition unit 164 functions as a comment recognition unit that uses the comment 88 as the second data processing additional information. In this case, the graphic shape recognition unit 166 for the comment 88 only needs to be able to recognize the additional content of the comment 88 from the side surface of the graphic. For example, “single line”, “double line”, “(single or double) The shape of the line may be recognized by pattern matching with a graphic shape indicating a line such as a “double wavy line”. Alternatively, the feature amount of the recognition target figure may be calculated, and the line shape may be recognized from the feature amount. As the feature amount, for example, the number of lines or the pixel density in the circumscribed rectangle can be used.

  In addition, the character recognition processing unit 167 only needs to be able to recognize the content of the comment 88 in the additional information filled teaching material 81 from the side of the character. In addition, the entry position recognition unit 168 for the comment 88 may recognize the entry position of the content to be added to the comment 88 on the additional information-added teaching material 81 by, for example, coordinate analysis on the educational material 80.

  Note that, when the shape recognition unit 166 recognizes the shape of the comment 88, the continuous shape pixel group constituting the graphic indicating the comment 88 such as “double line” and “flower circle” is handled as one. In addition, a labeling process, which is a general image processing technique, is performed to give an identifier to the continuous pixel group. Therefore, even when the position is recognized by the entry position recognizing unit 168, a group of continuous pixels constituting a figure indicating the comment 88 such as “double line” or “flower circle” is used by using the result of the labeling process. Are treated as one group.

  The entry position recognition unit 168 generally has a plurality of comments 88 written on the additional information filled teaching material 81 in the process of recognizing the entry position of the comment 88. The positions of the comments 88 detected sequentially in a predetermined scanning order are sequentially recognized.

  Position recognition for each comment 88 is performed by, for example, calculating circumscribing rectangle information of a comment sentence, characters and figures of the comment 88 such as “double line” and “Hanamaru”, and further calculating the center coordinates of the circumscribing rectangle. It is possible to do it. Specifically, a circumscribed rectangle is extracted from a character or figure (continuous pixel group) to be recognized, and the xy coordinates of a predetermined point (for example, the upper left vertex) of the circumscribed rectangle, and the width of the circumscribed rectangle ( W) and height (h) are calculated. Then, from these calculation results, the center x coordinate = x + w / 2 and the center y coordinate = y + h / 2 are calculated, and the calculation result is set as the recognition result of the position of the continuous pixel group, that is, the comment 88 entry position.

  Also, in this position recognition, each comment 88 is often written in the vicinity thereof in correspondence with the scoring mark 87 for the answer column 84 at a certain position. The process should be performed in cooperation with the position recognition for 87. By doing so, it becomes easy to associate the position information of each position information with each answer field 84, and as a result, to associate the scoring symbol 87 with the comment 88.

  The data processing unit 170 executes the first data processing related to the first data processing target additional information entered in the additional document 8B for the image data of the additional document 8B input from the document input device 20. 1 data processing part 170_1 and 2nd data processing part 170_2 which performs the 2nd data processing regarding 2nd data processing object additional record information.

  The first data processing unit 170_1 performs scoring and summarization on the image data of the additional information filled teaching material 81 which is an example of the added document 8B based on the scoring symbol 87 written in the additional information filled teaching material 81. Unit 172, and a totaling result output unit 174 that outputs the result of scoring totaling by scoring totaling unit 172 in association with the answerer information extracted by answerer extracting unit 134. A processing result in a state in which the scoring result and the answerer information are associated is particularly referred to as a scoring recognition result.

  The scoring tabulation unit 172 recognizes the result of the additional writing of the scoring symbol 87 by the graphic shape recognition unit 156 from the side of the graphic and the recognition result of the additional information of the scoring symbol 87 by the character recognition processing unit 157 from the side of the character information. The result of recognition of the entry position of the scoring symbol 87 by the entry position recognition unit 158 and the electronic data (original image) of the educational material 80 corresponding to the additional information filled educational material 81 held and accumulated in the document input device 20 are included. The additional information-added teaching material 81 read by the document input device 20 is added based on the scoring information defined in the scoring column 83 for each answer column 84 of the teaching material 80 (additional information-added teaching material 81). A scoring process and a summing process (collectively referred to as scoring summarization) regarding the scoring symbols 87 entered in the information-filled teaching material 81 are performed.

  The scoring symbol 87 is generally entered corresponding to each of the plurality of answer fields 84 on the educational material 80 and handwritten by a scoring officer such as a teacher. Is not necessarily uniquely defined. On the other hand, when scoring the scoring symbols 87, it is necessary to clarify the correspondence between the answer columns 84 and the entry positions of the scoring symbols 87. In the scoring for the scoring symbol 87, after clarifying the entry result of the scoring symbol 87 corresponding to each answer column 84, the contents of the scoring symbol 87 (whether the answer is correct, incorrect or partially correct) and each answer column 84 It is because it is performed based on the scoring about.

  From this, the scoring unit 172 performs scoring of the scoring symbols 87 in the following procedure. That is, the scoring totaling unit 172 obtains an overlapping area between the circumscribed rectangle of the scoring symbol 87 such as “◯” or “×” and the area to be the answer column 84 on the additional information-added teaching material 81, and calculates the area (the circumscribed area). Similarly, the scoring symbol 87 having the largest area ratio to the rectangle) and the answer column 84 are associated with each other, and the scoring symbol 87 is set as the determination result of the scoring symbol 87 entered in the answer column 84. However, when the ratio of the overlapping area to the circumscribed rectangle is less than the predetermined threshold, it is determined that the determination regarding the association is impossible because the overlapping portion is small.

  After the association, if the scoring symbol 87 is “◯”, the scoring point specified from the scoring information for the answer field 84 corresponding thereto is added, and the scoring symbol 87 is “×”. If there is, the score addition is not performed for the answer column 84 corresponding thereto, and such scoring is performed for all the answer columns 84 on the additional information filled teaching material 81.

  In addition, the area that becomes the answer column 84 on the additional information filled teaching material 81 is assigned to the document management server 30 corresponding to the additional information filled teaching material 81 as the score information for each answer column 84 or in the same manner as the score information. The entry field position area information 38 included in the registered original image is specified.

  The counting result output unit 174 associates the score totaling result totaled by the scoring totaling unit 172 with the answerer information extracted by the answerer extracting unit 134, and stores the processing result storage server 40 (processing result database device or processing result file server device). Etc.). Alternatively, the score of the scoring result is entered in the totaling field 83b of the additional information-added teaching material 81 and output on the paper as a return answer 81b so that it can be returned to the student.

  In addition, the second data processing unit 170_2 performs a classification process on the image data of the additional information filled teaching material 81, which is an example of the added document 8B, based on the comment 88 entered in the additional information filled teaching material 81. A classification processing unit 176 and a comment processing result output unit 178 that outputs the classification result by the comment classification processing unit 176 in association with the scoring recognition result output by the total result output unit 174 and each answer are provided.

  The comment classification processing unit 176 inputs the recognition result from the side of the figure of the additional content of the comment 88 by the graphic shape recognition unit 166 and the recognition result from the side of the character information of the additional content of the comment 88 by the character recognition processing unit 167. The additional information filled teaching material 81 read by the document input device 20 based on the recognition result of the position where the comment 88 is entered by the position recognizing unit 168 and the classification information defined in advance so as to correspond to the added content of the comment 88. The comment 88 entered in the additional information filled teaching material 81 is classified.

  The comment processing result output unit 178 associates the classification result by the comment classification processing unit 176 with the scoring recognition result output by each answer column or the total result output unit 174, and stores the processing result storage server 40 (processing result database device or processing result file). To the server device).

  Note that the scoring and summarizing process in the scoring and summarizing unit 172 and the classification process in the comment classification processing unit 176 may be complete automatic processing, but the CRT (Cathode Ray Tube) or LCD (Liquid Crystal Display) of the user terminal 171 may be used. ) Or the like may be displayed on the display unit configured so that the operator can appropriately correct the processing step or the processing result via an instruction input unit such as a keyboard or a mouse.

<Overall procedure>
10 and 11 are diagrams for explaining the procedure of the processing operation of the teaching material processing method in the teaching material automatic scoring system 1 which is an embodiment of the information processing system. Here, FIG. 10 shows the overall outline in association with the system configuration diagram, and FIG. 11 is a flowchart showing the teaching material processing procedure.

  In the case of using the postscript information processing apparatus 10 (particularly corresponding to the teaching material processing apparatus in the teaching material automatic scoring system 1), first, a student enters a name in the answerer information column 86 and enters the answering column 84. Answer entry, i.e., the entry of the first type of additional information by the student, and a second such as a scoring symbol 87 such as “○” or “x” and a comment 88 for the answer entered in each answer column 84 by the teacher or the like With respect to the additional information filled teaching material 81 in which the additional information has been entered, the document input device 20 reads the additional information filled learning material 81 (S110) and adds image data representing the additional information filled learning material 81 as additional information. It inputs into the processing apparatus 10 (S112). The document input device 20 temporarily stores image data obtained by image reading by the document input device 20 in a memory or the like used as a work area.

  At this time, if the document input device 20 uses an ADF device, for example, a plurality of additional information-filled teaching materials 81 to be processed in one group such as the same class are collectively read (batch scan). The image data corresponding to each additional information filled teaching material 81 can be continuously input to the additional information processing apparatus 10.

  The additional recording information processing device 10 sequentially adds the following additional information extraction / separation processing, additional information identification processing, and automatic scoring processing to the image data of each additional information filled teaching material 81 captured from the document input device 20. In addition, additional information end processing such as automatic comment processing is executed.

  For example, prior to automatic scoring processing and automatic comment processing in the data processing unit 170, the image data analysis unit 112 of the read image processing unit 110 performs analysis processing on image data obtained from a certain additional information-added teaching material 81. In step S122, the learning material specifying unit 122 identifies and specifies the original educational material 80 corresponding to the additional information-filled learning material 81 based on the result of the analysis process (S124).

  This identification specification (S124) is performed by, for example, title analysis by the identification information analysis unit 123 such as “science”, “5 years”, “1. change in weather and temperature” or code information analysis on the code information embedded in the identification information column 85. This may be performed through code analysis by the unit 124. Through this identification and specification, the teaching material specifying unit 122 specifies the electronic data (original image) of the teaching material 80 to be compared with the image data of the additional information filled teaching material 81 obtained by the document input device 20. can do.

  This identification and identification may be performed sequentially for each of the plurality of additional information-filled teaching materials 81 from which the document input device 20 has read an image. However, in general, additional information that has been processed in one group is already entered. Since all the teaching materials 81 are the same, it is only necessary to perform the additional information-filled teaching material 81 that is processed first during the batch processing.

  When the teaching material specifying unit 122 completes the specification of the educational material 80 corresponding to each additional information-added teaching material 81, the document management server 30 follows the specified result and selects the corresponding educational material 80 from the stored and stored. The original image (electronic data) is taken out and transferred to the difference extraction unit 132 (S126).

  Further, the distortion correction unit 114 corrects the distortion of the image data obtained from a certain additional information-added teaching material 81 (S128). This image distortion correction is performed in order to correct image distortion that may occur when the document input device 20 reads an image. After that, the difference extraction unit 132 performs comparison with the original image or difference extraction. This is to improve accuracy.

  The difference extraction unit 132 receives the original image (educational teaching material 80) delivered from the document management server 30 and the image data (addition) after the image distortion is corrected by the distortion correction unit 114 and input from the document input device 20. The information-filled teaching material 81) is compared with each other, and the difference is extracted (S130). The difference extraction unit 132 passes the extracted difference information 9 to the answerer extraction unit 134 and the additional information extraction processing unit 140 for data processing.

  By the difference extraction by the difference extraction unit 132, for example, as shown in the center part in FIG. 10, the content of the first type additional information entered by the answerer in the answerer information column 86 and each answer column 84, and each answer column Difference information 9 represented only by the content of the second type additional information entered by the grader such as a grading symbol 87 and a comment 88 for 84 is extracted.

  The answerer extraction unit 134 extracts the answerer information in the additional information-filled teaching material 81 to be read by the document input device 20 through the character recognition processing by the character recognition processing unit 138 for the difference information 9 (S132). As a result, the class, attendance number, name, and the like of the answer entry person who wrote the answer in one additional information-filled teaching material 81 can be specified.

  In the data processing additional information extraction processing unit 140, the additional recording member specifying unit 141 first specifies an additional recording color that is a pen color used for entering the additional information to be processed (S141), and performs data processing. The target additional information extraction unit 142 extracts additional information for data processing from the difference extraction result by the difference extraction unit 132 based on the additional recording color specified by the additional recording member specifying unit 141 (S142).

  In the case of this example, in order to extract the additional contents of the grading symbol 87 and the comment 88 in each answer column 84, the information about the predetermined color component, specifically, for example, the red component is extracted from the difference information 9 To do. The extraction of the predetermined color component can be performed by paying attention to the color component data constituting the pixel data, for example, when the difference extraction result is composed of pixel data.

  The extracted line segment break correction unit 148 performs additional information shaping processing such as thinning processing, end point extraction processing, end point connection processing, or line figure linear approximation on the extraction result of the data processing target additional information extraction unit 142. It executes appropriately (S146). The extraction line segment break correction unit 148 passes the extraction result of the scoring symbol 87 that has been subjected to the break correction processing to the first data processing additional information recognition unit 154 that functions as the scoring symbol recognition unit, and also includes the comment 88 that has undergone the break correction processing. The extraction result is passed to the second data processing additional information recognition unit 164 that functions as a comment recognition unit.

  The data processing target additional information specifying processing unit 150 is first stored in the document management server 30 in cooperation with the figure shape recognition units 156 and 166 and the character recognition processing units 157 and 167 constituting the separation recognition processing unit 155. The scoring symbol 87 and the comment 88 are separated by referring to the position information in the answer field 84 (S162), and thereafter, the specified content processing and the entry position are identified separately from the separated scoring symbol 87 and the comment 88. Execute the process.

  The graphic shape recognition unit 156 and the character recognition processing unit 157, regarding the scoring symbol 87 separated from the comment 88 (S163-scoring symbol), the content of the scoring symbol 87 by shape recognition or character recognition for the content of the scoring symbol 87. The scoring result of the scorer indicated by the scoring symbol 87 is specified, such as whether the answer is “correct” or “incorrect” (S164). Subsequently, the entry position recognition unit 158 recognizes the entry position on the additional information entry teaching material 81 with respect to the entry contents of the scoring symbol 87 (S166).

  After the entry position recognizing unit 158 recognizes the entry position of the scoring symbol 87 in this way, the scoring totaling unit 172 recognizes the entry contents of the scoring symbol 87 by the graphic shape recognition unit 156 and the character recognition processing unit 157. And the recognition result of the entry position of the scoring symbol 87 by the entry position recognizing unit 158 and the education included in the original image (educational instruction material 80) corresponding to the additional information entry instruction material 81 held and accumulated in the document management server 30. Based on the scoring information for each answer field 84 of the teaching material 80, scoring and counting are performed (S168).

  The total result output unit 174 stores the scoring / total results in the processing result storage server 40 (S169). Alternatively, the score of the scoring result is entered in the totaling field 83b of the additional information filled teaching material 81 and returned to the student as a return answer 81b.

  As the file format of the scoring result (scoring result by problem) for each additional information filled teaching material 81, for example, as shown in FIG. 10, the number of the problem existing on the additional information filled teaching material 81 and the problem It is a table format that associates these with each other with information consisting of correct / incorrect determination on the answer and a score based on the correct / incorrect determination. Further, as a file format of the counting result, for example, as shown in FIG. 10, information including an attendance number and answerer information and score information (item points and total points written in the counting field 83b) Is a table format for associating each other with each other.

  The result of scoring for correct / incorrect judgment entered on each additional information-added teaching material 81 is output as a question-based scoring result, and the result of scoring-by-problem scoring is output as a file. In the server 40, it is possible to manage or use the score totaling result for the additional information filled teaching material 81 in a list form, for example.

  The graphic shape recognizing unit 166 and the character recognizing processing unit 167, regarding the comment 88 separated from the scoring symbol 87 (S163-comment), the comment 88 added by the grading officer by shape recognition or character recognition with respect to the entered content of the comment 88. The entry contents are specified (S170). Subsequently, the entry position recognizing unit 168 recognizes the entry position on the additional information entry teaching material 81 with respect to the entry contents of the comment 88 (S172).

  After the entry position recognizing unit 168 recognizes the entry position of the comment 88 in this way, the comment classification processing unit 176 displays the recognition result of the entry contents of the comment 88 by the figure shape recognition unit 166 and the character recognition processing unit 167. The comment 88 is classified based on the recognition result of the entry position of the comment 88 by the entry position recognizing unit 168 and the classification reference information stored and accumulated in the document management server 30 (S174).

  The comment processing result output unit 178 associates each comment 88 classified by the comment classification processing unit 176 with the scoring result of the scoring symbol 87 having a close position (S178), and stores it in the processing result storage server 40 (S179). As the file format of the classification result for each comment 88, for example, as shown in FIG. 10, it is a table format that associates each comment with information composed of each comment and a nearby scoring symbol 87. In addition, it is not limited to actually storing in the table format, and each comment 88 may be stored in association with association information that associates both the comment 88 and the scoring result corresponding to the comment 88.

  Since the score summation result of the scoring symbol 87 written on each additional information filled teaching material 81 and the comment 88 are stored in correspondence with each other, the processing result storage server 40 scores the additional information filled teaching material 81. The counting results and the comments 88 can be managed or used, for example, in a list format, and the comments 88 can be used for student ability analysis and student guidance.

  As described above, in the teaching material automatic scoring system 1 shown as an embodiment of the information processing system, the image data read from the supplementary information-added teaching material 81 in which the scoring symbol 87 and the comment 88 are entered, and the supplementary information are already entered. The original educational material 80 for the educational material 81, that is, the first type of additional information by the student such as entering the answer in the answer column 84, and the second type of additional information such as a scoring symbol 87 and a comment 88 by the grader for the answer. Are compared with the data for those not filled in, and the written contents of the scoring symbol 87 and the comment 88 are separated from each other's difference to identify the filled contents, and the scoring and commenting for the scoring sign 87 and the comment 88 are separated. The classification process is executed.

  Therefore, regarding the data processing related to the scoring symbol 87, the entry content of the comment 88 is excluded from the difference result extracted by the difference extraction unit 132, and only the scoring symbol 87 is separated to specify the entry content. So, even if both are added with the same pen, automatic scoring will not be adversely affected.

  In addition, since the scoring results can be automatically totaled, the scoring process for the additional information filled teaching material 81 is saved as a result. In the case where the additional information filled teaching material 81 is obtained as a paper medium, it may be based on image data obtained by reading the additional information filled teaching material 81 with the document input device 20, for example, a copying machine, a multifunction peripheral, a scanner device, or the like. System configuration can be easily realized with a scanning function realized by the computer and an information storage processing function, an image processing function, and an arithmetic processing function of a computer device such as a personal computer (PC). Is not required.

  Furthermore, in order to compare the image data of the additional information filled teaching material 81 with the electronic data held by the document management server 30, the electronic data of various educational teaching materials 80 can be held and accumulated in the document management server 30. Thus, the versatility of the additional information filled teaching material 81 that can be handled can be sufficiently secured. Furthermore, by storing and storing electronic data in the document management server 30 in advance, when comparing with image data captured from the document management server 30, it is possible to input the electronic data to be compared. As a result, a quick scoring process can be realized.

  In addition, regarding the data processing related to the comment 88, the entry content of the scoring symbol 87 is excluded from the difference result extracted by the difference extraction unit 132, and only the comment 88 is separated to specify the entry content. Even if both are added with the same pen, the classification process related to the comment 88 is not adversely affected. In addition, since each comment 88 is stored in the processing result storage server 40 in association with each scoring symbol 87, the scoring officer himself / herself is used for ability analysis and student guidance in addition to the purpose of confirming the comment 88 by the student. It can be utilized.

<Additional information processing device; computer configuration>
FIG. 12 is a block diagram illustrating another configuration example of the additional recording information processing apparatus 10. Here, a more realistic hardware configuration is shown that is constructed from a microprocessor or the like that executes additional write information processing using an electronic computer such as a personal computer.

  That is, in this embodiment, the mechanism for executing the data processing related to the additional information is not limited to the hardware processing circuit, and is software-based using a computer (computer) based on the program code that realizes the function. It can also be realized.

  Therefore, a program suitable for realizing the mechanism according to the present invention by software using an electronic computer (computer) or a computer-readable storage medium storing this program can be extracted as an invention. By adopting a mechanism that is executed by software, it is possible to enjoy the advantage that the processing procedure and the like can be easily changed without changing hardware.

  When the data processing function related to additional information is executed by software in an electronic computer, a program (such as a built-in microcomputer) in which a program constituting the software is incorporated in dedicated hardware or a CPU (Central Processing) Unit), logic circuit, storage device, etc. on a single chip to realize the desired system SOC (System On a Chip) or various programs by installing various programs It is installed from a recording medium in a general-purpose personal computer or the like capable of executing functions.

  The recording medium causes a state change of energy such as magnetism, light, electricity, etc. according to the description contents of the program to the reading device provided in the hardware resource of the computer, and in the form of a signal corresponding to the change. The program description can be transmitted to the reader.

  For example, a magnetic disk (including a flexible disk FD), an optical disk (CD-ROM (Compact Disc-Read Only Memory)), a DVD on which a program is recorded, which is distributed to provide a program to a user separately from a computer. (Including Digital Versatile Disc), magneto-optical disc (including MD (Mini Disc)), or package media (portable storage media) made of semiconductor memory, etc. It may be configured by a ROM, a hard disk, or the like in which a program is recorded, which is provided to the user in a state of being recorded.

  The program constituting the software is not limited to being provided via the recording medium without using the recording medium, and may be provided via a wired or wireless communication network.

  For example, a storage medium in which a program code of software that realizes a data processing function related to additional information is supplied to a system or apparatus, and a program code stored in the storage medium by a computer (or CPU or MPU) of the system or apparatus The same effect as in the case where the hardware processing circuit is used is also achieved by reading and executing. In this case, the program code itself read from the storage medium realizes a data processing function related to additional write information.

  In addition, by executing the program code read by the computer, not only a data processing function related to additional information is realized, but also an OS (Operating Systems; basic software) running on the computer based on an instruction of the program code Or the like may perform part or all of the actual processing, and the data processing function regarding the additional information may be realized by the processing.

  Further, after the program code read from the storage medium is written in a memory provided in a function expansion card inserted into the computer or a function expansion unit connected to the computer, the function expansion is performed based on the instruction of the program code. There may be a case where a CPU or the like provided in the card or the function expansion unit performs part or all of the actual processing, and the data processing function regarding the additional information is realized by the processing.

  Note that the program is provided as a file describing a program code that realizes a data processing function related to additional information, but in this case, the program is not limited to being provided as a batch program file, and the hardware of a system configured by a computer Depending on the configuration, it may be provided as an individual program module.

  For example, the computer system 900 reads and records data from a controller unit 901 and a predetermined storage medium such as a hard disk device, a flexible disk (FD) drive, a CD-ROM (Compact Disk ROM) drive, a semiconductor memory controller, or the like. And a recording / reading control unit 902.

  The controller unit 901 includes a CPU (Central Processing Unit) 912, a ROM (Read Only Memory) 913 which is a read-only storage unit, and a RAM (Random Access) which can be written and read at any time and is an example of a volatile storage unit. Memory) 915 and RAM (described as NVRAM) 916 which is an example of a nonvolatile storage unit.

  In the above description, the “volatile storage unit” means a storage unit in which the stored contents are lost when the power of the apparatus is turned off. On the other hand, the “nonvolatile storage unit” means a storage unit in a form that keeps stored contents even when the main power supply of the apparatus is turned off. Any memory device can be used as long as it can retain the stored contents. The semiconductor memory device itself is not limited to a nonvolatile memory device, and a backup power supply is provided to make a volatile memory device “nonvolatile”. You may comprise as follows.

  Further, the present invention is not limited to a semiconductor memory element, and may be configured using a medium such as a magnetic disk or an optical disk. For example, a hard disk device can be used as a nonvolatile storage unit. In addition, it is possible to use as a nonvolatile storage unit by adopting a configuration for reading information from a recording medium such as a CD-ROM.

  Further, the computer system 900 includes an instruction input unit 903 as a functional unit that forms a user interface, a display output unit 904 that presents a user with predetermined information such as a guidance screen and a processing result, and each functional unit. And an interface unit (IF unit) 909 that performs an interface function between them.

  Note that an image forming unit 906 that outputs the processing result to a predetermined output medium (for example, printing paper) may be provided so that the data processing result is printed out and presented to the user.

  As the instruction input unit 903, for example, the operation key unit 985b of the user interface unit 985 can be used. Alternatively, a keyboard or mouse can be used.

  The display output unit 904 includes a display control unit 919 and a display device. As the display device, for example, the operation panel unit 985a of the user interface unit 985 can be used. Alternatively, other display units such as CRT (Cathode Ray Tube) or LCD (Liquid Crystal Display) can be used.

  For example, the display control unit 919 displays the guidance information, the entire image captured by the document input device 20, and the like on the operation panel unit 985a and the display unit. It is also used as a display device for notifying the user of various information. Note that an instruction input unit 903 for inputting predetermined information with a fingertip, a pen, or the like can be configured by using a display unit having a touch panel on the display surface.

  The interface unit 909 includes a system bus 991 that is a transfer path for processing data (including image data) and control data, a printer IF unit 996 that functions as an interface with the image forming unit 906 and other printers, and the like. A communication IF unit 999 is provided to mediate communication data exchange with the network.

  In such a configuration, the CPU 912 controls the entire system via the system bus 991. The ROM 913 stores a control program for the CPU 912 and the like. The RAM 915 is configured by SRAM (Static Random Access Memory) or the like, and stores program control variables, data for various processes, and the like. The RAM 915 includes an area for temporarily storing data obtained by calculation according to a predetermined application program, data obtained from the outside, and the like.

  For example, a program that causes a computer to execute a data processing function related to additional recording information is distributed through a recording medium such as a CD-ROM. Alternatively, this program may be stored in the FD instead of the CD-ROM. In addition, an MO drive may be provided to store the program in the MO, or the program may be stored in another recording medium such as a nonvolatile semiconductor memory card such as a flash memory. Furthermore, the program may be downloaded from another server or the like via a network such as the Internet, or may be updated or updated.

  As a recording medium for providing the program, in addition to FD and CD-ROM, optical recording medium such as DVD, magnetic recording medium such as MD, magneto-optical recording medium such as PD, tape medium, and magnetic recording A semiconductor memory such as a medium, an IC card, or a miniature card can be used. A part or all of functions for realizing a data processing function related to additional write information can be stored in an FD or CD-ROM as an example of a recording medium.

  Further, the hard disk device includes an area for storing data for various processes by the control program, and temporarily storing a large amount of data acquired by the device itself or data acquired from the outside.

  With such a configuration, additional information is written in the RAM 915 from a readable recording medium such as a CD-ROM in which a program for executing the above-described additional information processing method is stored in response to an instruction from the operator via the operation key unit 985b. The processing program is installed, and the additional information processing program is started by an instruction or automatic processing by the operator via the operation key unit 985b. For example, if the teaching material automatic scoring system 1 is to be realized, the teaching material processing program recognizes a difference extraction result of a predetermined color component, specifically, for example, a red component as the contents of the marking symbol 87 and the comment 88, In addition, processing steps for separating both are described, and the program is started.

  The CPU 912 performs calculation processing according to the additional information processing method according to the additional information processing program, stores the processing result in a storage device such as the RAM 915 or a hard disk, and displays the operation panel unit 985a or a display such as a CRT or LCD as necessary. Output to the device. By using a recording medium recorded with a program for executing the additional recording information processing method, the additional recording information processing system can be constructed universally without changing the existing system.

  Not only the configuration using such a computer, but also a write-once information processing apparatus 10 that performs a data processing function related to write-once information by a combination of dedicated hardware that performs processing of each functional unit shown in FIG. It can also be configured.

  In addition, for example, a processing circuit 908 may be provided in which not all processing of each functional part for the data processing function related to the additional information is performed by software, but part of these functional parts is performed by dedicated hardware. . Although the mechanism performed by software can flexibly cope with parallel processing and continuous processing, the processing time becomes longer as the processing becomes complicated, so that a reduction in processing speed becomes a problem.

  On the other hand, it is possible to construct an accelerator system with a higher speed by using a hardware processing circuit. Even if the processing is complicated, the accelerator system can prevent a reduction in processing speed and can obtain a high throughput.

  For example, in the case of realizing a data processing function related to additional information, the processing circuit 908 includes a read image processing unit 908a corresponding to the read image processing unit 110 shown in FIG. 9 and a document corresponding to the document original specifying unit 120. Data corresponding to the original data specifying unit 908b, the additional information extracting unit 908c corresponding to the additional information extracting unit 130, the data processing target additional information specifying unit 908d corresponding to the data processing target additional information specifying unit 150, or the data processing unit 170. The processing unit 908e and the like may be configured by hardware.

  As mentioned above, although this invention was demonstrated using embodiment, the technical scope of this invention is not limited to the range as described in the said embodiment. Various changes or improvements can be added to the above-described embodiment without departing from the gist of the invention, and embodiments to which such changes or improvements are added are also included in the technical scope of the present invention.

  Further, the above embodiments do not limit the invention according to the claims (claims), and all combinations of features described in the embodiments are not necessarily essential to the solution means of the invention. Absent. The embodiments described above include inventions at various stages, and various inventions can be extracted by appropriately combining a plurality of disclosed constituent elements. Even if some constituent requirements are deleted from all the constituent requirements shown in the embodiment, as long as an effect is obtained, a configuration from which these some constituent requirements are deleted can be extracted as an invention.

  For example, a distortion correction process and a break correction process are not necessarily essential. In addition, when associating each answer column 84 with the entry position of the scoring symbol 87 in the scoring of the scoring symbol 87, the circumscribed rectangle of the scoring symbol 87 and the region of the answer column 84 as described in this embodiment overlap. Instead of obtaining the area, it is conceivable that, for example, the association is performed from the distance of the respective center coordinates, or the association is simply performed depending on whether or not there is an overlapping portion between each.

  Moreover, although the proofreading information entry document 71, the additional information entry teaching material 81, and the additional information entry notebook 91 have been described as examples of the additionally recorded document 8B to be processed, these are merely examples, and the data processing target The type of the document is not limited as long as it includes additional write information.

  Further, as described above, the post-recorded document 8B to be processed is not limited to using a paper medium, and even if the post-recorded document 8B is obtained in the form of electronic data from the beginning, The above-described mechanism can be similarly applied as long as additional information to be processed is included.

It is a figure which shows the edit object document which is an example of the document made into a process target in the postscript information processing which concerns on this invention. It is a figure which shows the educational teaching material which is an example of the document made into the process target in the postscript information processing which concerns on this invention. It is a figure which shows the notebook which is an example of the document made into a process target in the postscript information processing which concerns on this invention. It is a figure explaining the additional record information extraction processing method which isolate | separates and extracts the additional record information in an additional record completed document. It is a figure explaining an example of the description location of the postscript information noted when specifying the wavelength component which the filling agent of the postscript member has. It is a figure explaining the specific example (the 1) of additional recording color specific processing. It is a figure explaining the specific example (the 2) of additional recording color specific processing. It is a figure explaining the specific example (the 3) of additional recording color specific processing. It is a figure which shows the structural example (teaching material automatic scoring system) of one Embodiment of the information processing system provided with the postscript information processing apparatus which concerns on this invention. It is the figure which showed the whole outline | summary of the teaching material processing method in a teaching material automatic scoring system matched with the system block diagram. It is a flowchart which shows the process sequence in a teaching material automatic scoring system. It is the figure which showed an example of the hardware constitutions in the case of constituting a postscript information processor using an electronic computer.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1 ... Teaching material automatic scoring system, 8A ... Original document, 8B ... Additional written document, 8c ... Extraction object designation | designated column, 9 ... Difference information, 10 ... Additional write information processing apparatus, 20 ... Document input device, 30 ... Document management server, 40 ... processing result storage server 70 ... document to be edited 71 ... proofreading information filled document, 77 ... proofreading symbol, 78 ... proofreading comment, 80 ... educational material, 81 ... additional information filled material, 87 ... scoring symbol, 88 ... Comment, 90 ... Notebook, 91 ... Additional information filled notebook, 97 ... Schedule, 98 ... Comment, 99 ... Classification symbol, 110 ... Read image processing unit, 112 ... Image data analysis unit, 114 ... Distortion correction unit, 120 ... Document original identification unit 122 ... Teaching material identification unit 123 ... Identification information analysis unit 124 ... Code information analysis unit 130 ... Additional information extraction unit 132 ... Difference extraction unit 134 ... Answerer extraction unit 136 ... Writing information cutout section, 138... Character recognition processing section, 140... Additional processing information extraction processing section for data processing, 141... Additional recording member specifying section, 142... Data processing target additional recording information extraction section, 146. Extraction line segmentation correction unit, 150... Data processing target additional information identification processing unit, 154... First data processing additional information recognition unit, 155... Separation recognition processing unit, 156. 158 ... Entry position recognition unit, 164 ... Second data processing additional information recognition unit, 166 ... Graphic shape recognition unit, 167 ... Character recognition processing unit, 168 ... Entry position recognition unit, 170 ... Data processing unit, 170_1 ... No. 1 data processing unit, 170_2 ... second data processing unit, 171 ... user terminal, 172 ... score totaling unit, 174 ... total result output unit, 176 ... comment classification processing unit, 178 ... co Cement processing result output unit

Claims (5)

The first type additional information written in the first color as the additional information on the original document in which the predetermined information is described , the first additional information that is a scoring symbol, and information related to the scoring symbol as being a second second second type of additional information object handle recordable already documents appended filled out in a color different from the write-once information unrealized said first color, given on the basis of the additional information An additional information processing device that performs data processing of
A difference extraction unit that extracts difference information including the first type of additional information and the second type of additional information from the difference between the original document and the added document;
A data processing target additional information extracting unit that extracts the second type of additional information by extracting the color component of the second color from the extracted difference information ;
A graphic shape recognition unit for recognizing the shape of the graphic and recognizing each of the first additional information and the second additional information for the graphic included in the extracted additional information of the second type,
A character recognition unit for recognizing the character included in the extracted second type additional information and recognizing each of the first additional information and the second additional information;
A first data processing unit that performs a scoring process on the first additional recording information that is recognized by the graphic shape recognition unit and the character recognition unit and separated from the second additional recording information ;
A second data processing unit that performs a process of classifying the second additional recording information that is recognized by the graphic shape recognition unit and the character recognition unit and separated from the first additional recording information. Additional information processing device. A write-once member specifying unit for specifying the wavelength component of the write-on member of the write-once member used for filling in the additional information of the second type made in the second color existing in the postscript-added document;
The additional recording according to claim 1, wherein the data processing target additional information extracting unit extracts the second type of additional information with reference to the wavelength component specified by the additional member specifying unit. Information processing device. The second data processing unit, based on the classification information for said second additional information which is determined in advance, any one of claims 1 or 2, characterized by performing the process for classifying the second additional information The postscript information processing apparatus according to item 1. The second data processing unit further determines the processing result by the first data processing and the processing result by the second data processing based on the first additional information and the additional position of the second additional information. It is stored in association Te recordable information processing apparatus according to any one of claims 1 to 3, wherein. The first type additional information written in the first color as the additional information on the original document in which the predetermined information is described , the first additional information that is a scoring symbol, and information related to the scoring symbol as being a second second second type of additional information object handle recordable already documents appended filled out in a color different from the write-once information unrealized said first color, given on the basis of the additional information A program for performing data processing using a computer,
The computer,
A difference extraction unit that extracts difference information including the first type of additional information and the second type of additional information from the difference between the original document and the added document;
A data processing target additional information extracting unit that extracts the second type of additional information by extracting the color component of the second color from the extracted difference information ;
A graphic shape recognition unit for recognizing the shape of the graphic and recognizing each of the first additional information and the second additional information for the graphic included in the extracted additional information of the second type,
A character recognition unit for recognizing the character included in the extracted second type additional information and recognizing each of the first additional information and the second additional information;
A first data processing unit that performs a scoring process on the first additional recording information that is recognized by the graphic shape recognition unit and the character recognition unit and separated from the second additional recording information ;
A program that functions as a second data processing unit that performs processing for classifying the second additional write information recognized by the graphic shape recognition unit and the character recognition unit and separated from the first additional write information .

Images