JP2017157994A - Information processing apparatus and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To improve convenience for a user in an information processing apparatus and program that can create, from a document image including markings overlapped on character strings, a fill-in-the-blank question with the marked character strings as answers.SOLUTION: An information processing apparatus comprises: a marking extraction part that extracts, from a document image including markings overlapped on character strings, the markings; and a character string comparison part that extracts, from the document image, character strings not overlapped with the same markings as in the character strings overlapped with the markings.SELECTED DRAWING: Figure 3

Description

  The present invention relates to an information processing apparatus and program capable of creating a hole-filling problem using a marked character string as an answer from a document image including markings superimposed on the character string.

  Read the image of the manuscript with the character string that is the answer to the problem specified by handwritten marking, extract the marking image from the image data of the read manuscript, extract the character string at the marking position, and at the marking position A technique for creating a hole filling problem in which a character string is erased and an answer column is set in the erased portion of the character string is known (Patent Document 1, Abstract). As a specific example, a technique for setting two or more worm-eater portions as one worm-eater group and creating one worm-eaten problem for the worm-eater group is also known (Patent Document 2, Abstract).

JP 2007-4523 A JP 2010-101970 A

  In an information processing apparatus capable of creating a hole filling problem, it is desired that both the problem creator and the respondent are more user-friendly.

  In view of the circumstances as described above, an object of the present invention is to provide an information processing apparatus and program capable of creating a hole-filling problem using a marked character string as an answer from a document image including a marking superimposed on the character string. Therefore, it is to improve user convenience.

In order to achieve the above object, an information processing apparatus according to an aspect of the present invention provides:
A marking extraction unit for extracting the marking from the original image including the marking superimposed on the character string;
A character string comparison unit that extracts, from the document image, a character string that does not have the same marking as the character string on which the marking is superimposed.

Information processing device
A blank creation unit for creating a plurality of blank images to be superimposed on the character string on which the marking is superimposed and the extracted character string;
And an image composition unit for creating a composite image by combining the document image and the plurality of blank images.

  According to this embodiment, a character string that does not have the same marking as the character string on which the marking is superimposed is extracted from the document image, and the character string on which the marking is superimposed and a plurality of blank spaces that are respectively superimposed on the extracted character string Create an image. As a result, the same character string as an answer can be surely left blank. Therefore, there is no situation where the answer character string is displayed as a hint in the sentence, and the problem creator does not have to manually extract all the same character strings as the answer.

Information processing device
A character extraction unit for extracting a plurality of characters from the document image;
A character identifying unit that identifies a plurality of characters extracted by the character extracting unit, and that identifies a character string on which the marking is superimposed among the plurality of identified characters;
The character string comparison unit extracts, from a plurality of characters identified by the character identification unit, a character string that does not have the same marking as the character string superimposed with the marking identified by the character identification unit.

Information processing device
A marking determination unit that determines the position and shape of the marking extracted by the marking extraction unit in the document image;
The character identification unit identifies a character string on which the marking is superimposed based on the position, shape, and shape of the marking.

  The character identification unit identifies a plurality of characters extracted by the character extraction unit by optical character recognition.

  The character string comparison unit assigns the same code to the character string on which the marking is superimposed and the character string on which the same marking is not superimposed.

  As a result, since different codes are assigned to a plurality of blanks in which the same character string is to be answered, there is no possibility that the respondent will misunderstand that different words should be answered.

  The image composition unit creates a composite image by combining the document image, the plurality of blank images, and a code image that is an image of the assigned code.

  As a result, the problem creator does not have to manually assign the same code to a plurality of blanks to which the same character string should be answered, and there is no possibility of assigning an incorrect code.

In order to achieve the above object, a program according to an aspect of the present invention is provided.
Information processing device
A marking extraction unit for extracting the marking from the original image including the marking superimposed on the character string;
A character string that does not have the same marking as the character string on which the marking is superimposed is caused to function as a character string comparison unit that extracts from the document image.

  Advantageous Effects of Invention According to the present invention, in an information processing apparatus and program capable of creating a hole-filling problem using a marked character string as an answer from a manuscript image including markings superimposed on the character string, user convenience is improved. To do.

2 is a block diagram illustrating a hardware configuration of the image forming apparatus. FIG. 2 is a block diagram illustrating a functional configuration of the image forming apparatus. FIG. 3 is a flowchart illustrating an operation of the image forming apparatus. It is a figure for demonstrating operation | movement of an image forming apparatus.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

(1. Hardware configuration of image forming apparatus)
FIG. 1 is a block diagram showing a hardware configuration of an image forming apparatus according to an embodiment of the present invention.

  An information processing apparatus according to each embodiment of the present invention is an image forming apparatus (for example, MFP, Multifunction Peripheral), and is hereinafter referred to as an MFP.

  The MFP 1 includes a control unit 11. The control unit 11 includes a CPU (Central Processing Unit), a RAM (Random Access Memory), a ROM (Read Only Memory), a dedicated hardware circuit, and the like, and controls overall operation of the MFP 1. A computer program that causes the MFP 1 to function as each functional unit (described later) is stored in a non-transitory storage medium such as a ROM.

  The control unit 11 is connected to an image reading unit 12, an image processing unit 14, an image memory 15, an image forming unit 16, an operation unit 17, a storage unit 18, a network communication unit 13, and the like. The control unit 11 performs operation control of each of the above connected units and transmission / reception of signals or data to / from each unit.

  The control unit 11 operates for each function such as a scanner function, a print function, and a copy function function in accordance with a job execution instruction input from the user through the operation unit 17 or a personal computer (not shown) connected via a network. Controls the drive and processing of the mechanisms necessary to perform the control.

  The image reading unit 12 reads an image from a document.

  The image processing unit 14 performs image processing on the image data of the image read by the image reading unit 12 as necessary. For example, the image processing unit 14 performs image processing such as shading correction in order to improve the quality after the image read by the image reading unit 12 is formed.

  The image memory 15 has an area for temporarily storing document image data obtained by reading by the image reading unit 12 and temporarily storing data to be printed by the image forming unit 16.

  The image forming unit 16 forms an image of the image data read by the image reading unit 12.

  The operation unit 17 includes a touch panel unit and operation key units that receive instructions from the user regarding various operations and processes that can be executed by the MFP 1. The touch panel unit includes a display unit 17a such as an LCD (Liquid Crystal Display) provided with a touch panel.

  The network communication unit 13 is an interface for connecting to a network.

  The storage unit 18 is a large-capacity storage device such as an HDD (Hard Disk Drive) that stores a document image read by the image reading unit 12.

(2. Functional configuration of image forming apparatus)
FIG. 2 is a block diagram illustrating a functional configuration of the image forming apparatus.

  The MFP 1 functions as a marking extraction unit 101, a marking determination unit 102, a character extraction unit 103, a character identification unit 111, a character string comparison unit 113, a blank creation unit 105, and an image composition unit 106 by executing an information processing program. .

  The marking extraction unit 101 extracts the marking superimposed on the character string from the document image read by the image reading unit 12.

  The marking determination unit 102 determines the position and shape of the marking extracted by the marking extraction unit 101 in the document image.

  The character extraction unit 103 extracts a plurality of characters from the document image read by the image reading unit 12.

  The character identifying unit 111 refers to the OCR database 112 and identifies each of the plurality of characters extracted by the character extracting unit 103. Based on the marking position and shape determined by the marking determination unit 102, the character identification unit 111 identifies a character string on which the marking is superimposed by a combination of character codes.

  The character string comparison unit 113 extracts, from a plurality of characters identified by the character identification unit 111, a character string that does not have the same marking as the character string superimposed with the marking identified by the character identification unit 111.

  The blank creation unit 105 creates a blank image to be superimposed on each of the character string on which the marking extracted by the character string comparison unit 113 is not superimposed and the character string on which the marking is superimposed.

  The image composition unit 106 creates a composite image by combining the document image read by the image reading unit 12 and the blank image created by the blank creation unit 105.

(3. Operation of image forming apparatus)
FIG. 3 is a flowchart showing the operation of the image forming apparatus. FIG. 4 is a diagram for explaining the operation of the image forming apparatus.

  As a premise, a character string as text data is printed on an original (typically, paper). Alternatively, a character string image as image data is formed on the document (a document on which the character string is printed is copied). A plurality of partial character strings (jukugo, phrases, numerical values, etc.) of the entire character string are marked by hand using a fluorescent marker pen or the like by a problem creator as a user. The marked character string is a character string that becomes an answer in the hole filling problem.

  The image reading unit 12 optically scans the original and reads the original image (step S101, see FIG. 4). The “document image” is image data of a document document including a large number of character strings as a whole, and includes a plurality of markings (hatched portions shown in FIG. 4) superimposed on a plurality of character strings. The “character string” is a phrase (word, phrase, sentence, etc.), a numerical value, and the like, strictly speaking, an image thereof.

  The marking extraction unit 101 extracts the marking superimposed on the character string from the document image read by the image reading unit 12 (step S102). Specifically, the marking extraction unit 101 extracts a region having a specific shape and size (such as a strip-shaped rectangle having a specific width) that is different from the background (white or the like) in brightness and / or saturation and the like as a marking. .

  The marking determination unit 102 determines the position and shape of the marking extracted by the marking extraction unit 101 in the document image (step S103). Specifically, the marking determination unit 102 calculates the entire document image as the entire coordinate system and the marking position and shape as coordinates.

  On the other hand, in parallel with steps S102 and S103, the character extraction unit 103 extracts a plurality of characters from the document image read by the image reading unit 12 (step S104). Specifically, the character extraction unit 103 extracts all characters included in the document image by edge detection. In other words, the character extraction unit 103 decomposes the document image into one character per character by edge detection. That is, the “character” is one character per character included in the original image (may be one word per word depending on the language), and strictly speaking, the image.

  The character identifying unit 111 refers to the OCR database 112 and identifies each of the plurality of characters extracted by the character extracting unit 103 (step S105). Specifically, in the OCR database 112, character image patterns and character codes are associated and registered one by one. The character identifying unit 111 searches the OCR database 112 for an image pattern indicating the character extracted by the character extracting unit 103, and acquires a character code associated with the image pattern obtained by the search. The character identification unit 111 acquires character codes for all characters included in the document image.

  The character identifying unit 111 identifies the character string on which the marking is superimposed based on the marking position and shape determined by the marking determining unit 102. The character identifying unit 111 identifies the character string on which the marking is superimposed by combining the character codes of all the characters included in the character string on which the marking is superimposed (Step S106).

  The character string comparison unit 113 extracts, from the plurality of characters identified by the character identification unit 111, a character string that does not have the same marking as the character string superimposed with the marking identified by the character identification unit 111 (step S107). FIG. 4). Specifically, the character string comparison unit 113 compares the character code combination of the character string with the marking superimposed thereon with the character code of the character with no marking superimposed thereon. Then, the character string comparison unit 113 extracts a combination of consecutive character codes out of all the characters included in the document image on which the marking is not superimposed, which is the same as the character code combination of the character string on which the marking is superimposed. . In the example shown in FIG. 4, character strings “DEF” and “YZ” are extracted.

  When the character string comparison unit 113 extracts a character string that does not have the same marking as the character string with the marking superimposed (step S108, YES), the blank space creation unit 105 performs the marking extracted by the character string comparison unit 113. A blank image is created to be superimposed on each of the character string that is not superimposed (step S109) and the character string on which the marking is superimposed (step S110, see FIG. 4). On the other hand, if the character string comparison unit 113 does not extract a character string that does not have the same marking as the character string on which the marking is superimposed (step S108, NO), the blank creation unit 105 displays the marking superimposed. A blank image to be superimposed on the character string is created (step S110). Specifically, the blank creation unit 105 erases the character (step S104) extracted by the edge detection by the character extraction unit 103 and the marking edge that protrudes from the character when the marking is superimposed. A blank image having a shape and position (coordinates) to be embedded is created. The blank image may be a simple blank or may include a predetermined style (underline, rectangular frame, parentheses, etc.). In the example shown in FIG. 4, the blank image includes an underline.

  The image synthesizing unit 106 creates a synthesized image obtained by synthesizing the original image read by the image reading unit 12 (step S101) and the blank images created by the blank creating unit 105 (steps S109 and S110) (step S111, FIG. 4). Specifically, the image composition unit 106 arranges a blank image whose shape and position are defined by coordinates in the coordinate system of the document image. In the example shown in FIG. 4, the original image and the blank image including the underline are combined.

  The image forming unit 16 forms (prints out) the composite image created by the image composition unit 106 on a sheet (step S112).

(4. Modifications)
In the embodiment, the blank image is simply blank or the like, but a code (number, character, symbol, etc.) may be assigned to the blank image.

  That is, in one modification, the character string comparison unit 113 assigns the same code (number, character, symbol, etc.) to the character string on which the marking is superimposed and the character string on which the same marking is not superimposed. assign.

  The image composition unit 106 synthesizes a composite image obtained by combining the document image read by the image reading unit 12, the blank image created by the blank creation unit 105, and the code image that is the code image assigned by the character string comparison unit 113. create. Specifically, the image composition unit 106 arranges a code of a predetermined style (font, size, etc.) at a predetermined position (center, left end, etc.) of a blank image arranged in the document image. A composite image is created.

  In the embodiment, the image reading unit 12 reads a document image (step S101). Instead, the MFP 1 may receive a document image from an information processing apparatus (not shown) connected to the network through the network communication unit 13.

(5. Summary)
When creating a hole-filling problem using an original manuscript, a character string as an answer may appear many times in one sentence. In this case, if the character string that becomes the answer is displayed as a hint in the sentence, it is necessary to leave all the same character strings that become the answer blank. However, it is troublesome for the problem creator to manually extract all the same character strings that are the answers, and it is difficult to reliably extract all the same character strings.

  On the other hand, according to the embodiment, the MFP 1 extracts, from the document image, a character string that does not have the same marking as the character string on which the marking is superimposed (step S107), and the character string on which the marking is superimposed. A plurality of blank images to be superimposed on the extracted character strings are created (steps S109 and S110). As a result, the same character string as an answer can be surely left blank. Therefore, there is no situation where the answer character string is displayed as a hint in the sentence, and the problem creator does not have to manually extract all the same character strings as the answer.

  Moreover, if different codes are assigned to a plurality of blanks in which the same character string is to be answered, the respondent may misunderstand that different words / phrases should be answered. In order to prevent this situation, it is troublesome for the problem creator to manually assign the same code to a plurality of blanks to which the same character string should be answered. In particular, when the total number of blanks is large or when there are a plurality of sets of the same character string, if the problem creator manually assigns a code, there is a possibility that an incorrect code is assigned.

  On the other hand, according to the modification, the MFP 1 assigns the same code to the character string on which the marking is superimposed and the character string on which the same marking is not superimposed. As a result, since different codes are assigned to a plurality of blanks in which the same character string is to be answered, there is no possibility that the respondent will misunderstand that different words should be answered. In addition, there is no need for the problem creator to manually assign the same code to a plurality of blanks in which the same character string should be answered, and there is no possibility of assigning an incorrect code.

  In each embodiment, the processing when a character string having a plurality of characters is marked has been described. However, even when a character string consisting of one character is marked, the processing can be performed according to FIG. is there. In this case, in step S106 shown in FIG. 3, the character string identifying unit 111 does not need to combine the character codes of all the characters included in the character string, and identifies the character by one character code on which the marking is superimposed. do it. In addition, in step S107 shown in FIG. 3, the character string identification unit 111 compares the character code of one character on which the marking is superimposed with the character code of the character on which the marking is not superimposed. What is necessary is just to extract the character which is the same as the character code of a character, and in which all the markings contained in a manuscript image are not superimposed.

  Further, when one character (one word depending on the language) is marked, the execution of the process shown in FIG. 3 may be avoided. In general, the same character may be used differently in the same document. In such a case, it is possible to prevent one character unintended by the user from being left blank.

1 ... MFP
DESCRIPTION OF SYMBOLS 12 ... Image reading part 16 ... Image formation part 101 ... Marking extraction part 102 ... Marking determination part 103 ... Character extraction part 105 ... Blank creation part 106 ... Image composition part 111 ... Character identification part 112 ... OCR database 113 ... Character string comparison Part

Claims (8)

A marking extraction unit for extracting the marking from the original image including the marking superimposed on the character string;
An information processing apparatus comprising: a character string comparison unit that extracts, from the document image, a character string that does not have the same marking as the character string on which the marking is superimposed. The information processing apparatus according to claim 1,
A blank creation unit for creating a plurality of blank images to be superimposed on the character string on which the marking is superimposed and the extracted character string;
An information processing apparatus further comprising: an image composition unit that creates a composite image by combining the document image and the plurality of blank images. The information processing apparatus according to claim 1 or 2,
A character extraction unit for extracting a plurality of characters from the document image;
A character identifying unit that identifies a plurality of characters extracted by the character extracting unit, and that identifies a character string on which the marking is superimposed among the plurality of identified characters;
The character string comparison unit extracts, from a plurality of characters identified by the character identification unit, a character string that is not superimposed with the same marking as the character string superimposed with the marking identified by the character identification unit. Processing equipment. The information processing apparatus according to claim 3,
A marking determination unit that determines the position and shape of the marking extracted by the marking extraction unit in the document image;
The said character identification part identifies the character string with which the said marking was superimposed based on the position of the said marking, a shape, and a shape. Information processing apparatus. An information processing apparatus according to claim 3 or 4,
The information processing apparatus, wherein the character identification unit identifies a plurality of characters extracted by the character extraction unit by optical character recognition. An information processing apparatus according to any one of claims 1 to 5,
The information processing apparatus, wherein the character string comparison unit assigns the same code to a character string on which the marking is superimposed and a character string on which the same marking is not superimposed. An information processing apparatus according to any one of claims 2 to 6,
The image synthesizing unit creates a synthesized image by synthesizing the document image, the plurality of blank images, and a code image that is an image of the assigned code. Information processing device
A marking extraction unit for extracting the marking from the original image including the marking superimposed on the character string;
A program that functions as a character string comparison unit that extracts a character string that does not have the same marking as the character string on which the marking is superimposed from the document image.

Images