JP5673277B2 - Image processing apparatus and program - Google Patents

Description

  The present invention relates to an image processing apparatus and a program.

  A technique for recognizing characters in a document image read by an image reading unit such as a scanner and using the recognized character string has been developed.

  Japanese Patent Application Laid-Open No. 2004-151867 extracts a character string that is an element constituting a file name by generating a file name to be assigned to an image file and performing character recognition processing on the image file to which the file name is to be assigned. A file name generation system including a character string extraction unit that can be extracted as a character string is disclosed.

  Patent Document 2 discloses an electronic file device that searches a character string having a maximum character size from image data, extracts image data of a predetermined area including the searched character string having the maximum character size, and registers the image data as a document title. ing.

  Patent Document 3 discloses a binary image in which an imprint area in which a seal is stamped is detected, a binary image in which the imprint is erased from a color image in the imprint area is generated, and the imprint is erased in an input black and white binary image. A form reading apparatus that recognizes characters based on a synthesized binary image is disclosed.

JP 2010-165019 A JP-A-7-200265 JP 2005-92543 A

  It is an object of the present invention to provide an image processing apparatus and a program for acquiring a character string reflecting the writing from a document written by a user.

The image processing apparatus according to claim 1, wherein, in the image data of the first color component among the plurality of color components constituting the image data generated by reading the document, a character is applied to a predetermined first area. A character string extraction unit that performs a recognition process and extracts a character string, and another image that exists in the second region including the extracted character string in image data of another color component different from the first color component When the image of the color component and the extracted character string have a predetermined relationship, character recognition processing is performed on the second region in the image data of the other color component, and the other recognizing other colors character recognition unit character color components, and a correction unit that at least the other based on a relationship between an image and the extracted character string color components, modifying the extracted character strings, Is provided.

  The image processing apparatus according to claim 2, wherein, in the image processing apparatus according to claim 1, when the image of the other color component overlaps the extracted character string, the correction unit Of the characters included in the column, the character overlapping with the image of the other color component is deleted from the extracted character string.

  According to a third aspect of the present invention, in the image processing device according to the first or second aspect, the correction unit is configured to extract the extracted color string when the image of the other color component overlaps the extracted character string. Of the characters included in the character string, the character overlapping the image of the other color component is replaced with the character of the other color component recognized by the other color character recognition unit.

The image processing device according to claim 4 is the image processing device according to any one of claims 1 to 3, wherein in the image data of the other color component, a symbol predetermined in the second region. When there is a character, the correction unit inserts the character recognized by the other color character recognition unit into the extracted character string.

  The image processing device according to claim 5 is the image processing device according to any one of claims 1 to 4, wherein the dictionary storage unit stores a character string that has been used by a user, and the correction unit. Is not included in the dictionary storage unit, a character string similar to the character string corrected by the correction unit is detected from the character strings stored in the dictionary storage unit, And a character string determination unit that determines the extraction result of the character string included in one area.

According to a sixth aspect of the present invention, there is provided a program for a predetermined first region in image data of a first color component among a plurality of color components constituting image data generated by reading a document on a computer. A character string extraction step for performing character recognition processing and extracting a character string, and other existing in the second region including the extracted character string in image data of other color components different from the first color component When the image of the color component and the extracted character string have a predetermined relationship, character recognition processing is performed on the second region in the image data of the other color component, and the other a character other colors character recognition step recognizes the color components of the correction step in which at least the other based on a relationship between an image and the extracted character string color components, modifying the extracted character string , Run

  According to the image processing apparatus of the first aspect, a character string reflecting the writing is acquired from the original written by the user.

  According to the image processing apparatus of the second aspect, the character string reflecting the writing intended to be deleted performed by the user on the original document is acquired.

  According to the image processing apparatus of the third aspect, the character string reflecting the writing intended for replacement performed by the user on the original document is acquired.

  According to the image processing apparatus of the fourth aspect, the character string reflecting the writing intended to be inserted by the user on the original document is acquired.

  According to the image processing apparatus of the fifth aspect, the recognition accuracy of the character string presented as the extraction result is improved as compared with the case where the present configuration is not provided.

  According to the program of the sixth aspect, a character string reflecting the writing is acquired from the original written by the user.

1 is a diagram illustrating an example of a configuration of an image processing system including an image processing apparatus according to an embodiment. It is a figure which shows an example of the hardware constitutions of an image processing apparatus. It is a functional block diagram which shows an example of the function with which an image processing apparatus is provided. It is a figure which shows an example of the image data produced by the process of a color separation part. It is a figure for demonstrating the area | region which extracts the character string used as a file name candidate, and the area | region containing the character string used as a file name candidate. It is a figure which shows the example of the information stored in a symbol storage part. It is a figure which shows an example of the user dictionary stored in a dictionary storage part. It is a flowchart which shows an example of the file name determination process which an image processing apparatus performs. It is a flowchart which shows an example of the file name determination process which an image processing apparatus performs. FIG. 9 is a diagram for explaining a file name candidate 1 obtained when the processes of steps S11 to S47 in FIG. 8 are executed for each image data received from the image reading apparatus.

  Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings.

  First, an image processing apparatus according to an embodiment will be described. 1A and 1B are diagrams illustrating an example of a configuration of an image processing system including an image processing apparatus according to an embodiment.

  1A, an image processing system 100A includes an information processing apparatus 200 and an image forming apparatus 300. The information processing apparatus 200 and the image forming apparatus 300 are connected by a communication unit 400 and can communicate with each other. An example of the information processing apparatus 200 is a personal computer. As the image forming apparatus 300, for example, a so-called multi-function machine having any one of a copy function, a print function, a FAX transmission / reception function, and the like in addition to a copy machine, a printer, a facsimile (FAX) transmission / reception apparatus, and the like. It is done.

  The image forming apparatus 300 includes a communication device 10, an image processing device 20, an image reading device 30, and an image output device 40. The communication apparatus 10 transmits / receives data to / from another apparatus (for example, the information processing apparatus 200) connected to the image forming apparatus 300 via the communication unit 400. For example, the communication device 10 receives an image subjected to image processing from the image processing device 20 and transmits it to the information processing device 200. For example, the communication device 10 outputs the image data received from the information processing device 200 to the image processing device 20.

  The image reading device 30 is, for example, a scanner, reads a document placed on a document table, and outputs the read document image to the image processing device 30.

  The image processing device 20 converts the image data received from the communication device 10 into a data format that can be output by the image output device 40. Further, the image processing apparatus 20 receives the image data read by the image reading apparatus 30 from the image reading apparatus 30 and converts it into a data format that can be output by the image output apparatus 40. The image processing device 20 outputs the converted image data to the image output device 40.

  Further, the image processing device 20 automatically determines a file name given to the image data based on the image data read by the image reading device 30 and transmits the file name to the information processing device 200 via the communication device 10. To do.

  The image output device 40 receives image data to be output from the image processing device 20, forms an image based on the received image data on a sheet, and outputs the image.

  FIG. 1A illustrates an embodiment in which the image forming apparatus 300 includes the image processing apparatus 20. FIG. 1B illustrates an embodiment in which an information processing apparatus (for example, a personal computer) functions as an image processing apparatus. 1B, an image processing system 100B includes an information processing apparatus 500 that functions as an image processing apparatus, and an image reading apparatus 600. The information processing apparatus 500 and the image reading apparatus 600 are connected by the communication unit 400 and can communicate with each other. The image reading device 600 is a scanner, for example, and reads a document placed on the document table based on an instruction from the information processing device 500 and transmits the read document image to the information processing device 500.

  The information processing apparatus 500 instructs the image reading apparatus 600 to read a document, and receives a document image read by the image reading apparatus 600. The information processing apparatus 500 stores the received document image in a storage device included in the information processing apparatus 500. The information processing apparatus 500 determines a file name for storing the document image in the storage device based on the document image.

  Hereinafter, the image processing apparatus 20 included in the image forming apparatus 300 will be described. However, the information processing apparatus 500 in FIG. 1B may function as an image processing apparatus. In the following description, an example in which a character string in image data read by the image reading device 30 is recognized and the recognized character string is used as a file name will be described. Further, in the following description, a document before writing by the user is described as “original document (or original document)”, and a document after writing by the user is simply described as “document”. In this embodiment, the original document is printed in black and white, and writing by the user is performed using a color other than black.

  An example of the hardware configuration of the image processing apparatus 20 will be described. FIG. 2 is a diagram illustrating an example of a hardware configuration of the image processing apparatus 20.

  The image processing apparatus 20 includes an input / output unit 201, a ROM (Read Only Memory) 202, a CPU (Central Processing Unit) 203, a RAM (Random Access Memory) 204, and an HDD (Hard Disk Drive) 205.

  The input / output unit 201 transmits / receives data to / from the communication device 10, the image reading device 30, and the image output device 40. The ROM 202 stores a program for creating a file name from image data received from the image reading device 30 (details will be described later) and the like. The CPU 203 reads and executes a program stored in the ROM 202. The RAM 204 stores temporary data used when executing the program. The HDD 205 stores image data received from the image reading device 30, data relating to insertion system symbols used in a program for creating a file name from the image data (details will be described later), and the like.

  Next, an example of functions provided in the image processing apparatus 20 will be described. FIG. 3 is a functional block diagram illustrating an example of functions provided in the image processing apparatus 20. The image processing apparatus 20 includes a color separation unit 211, a character string extraction unit 212, a correction unit 213, a symbol storage unit 214, an other color character recognition unit 215, a file name determination unit 216, and a dictionary storage unit 217. The symbol storage unit 214 and the dictionary storage unit 217 are configured by the HDD 205, for example. The color separation unit 211, the character string extraction unit 212, the correction unit 213, the other color character recognition unit 215, and the file name determination unit 216 are realized by calculation by the CPU 203 of a program stored in the ROM 202. The file name determination unit 216 is an example of a character string determination unit.

  The color separation unit 211 receives image data for which a file name is to be created from the image reading device 30. Note that the color separation unit 211 may acquire the image data stored in the HDD 205 or the like as image data for which a file name is to be created.

  The color separation unit 211 separates the image data received from the image reading device 30 into image data of each color component of, for example, CMYK (C: cyan, M: magenta, Y: yellow, K: black). Alternatively, the color separation unit 211 may separate the image data into K-color image data and image data of color components other than the K color (hereinafter referred to as other color image data). For example, it is assumed that the color separation unit 211 receives the image data illustrated in FIG. Here, in FIG. 4A, characters after “standardization meeting minutes” and “■ date and time: 2010/10/15” are printed on the original document in advance, and other characters and graphics are used. (FIG. 4C) is written by the user. In addition, the color of characters after “standardization meeting minutes” and “■ date and time: 2010/10/15” is K color. In this case, the color separation unit 211 separates the image data received from the image reading device 30 into K-color image data (FIG. 4B) and other-color image data (FIG. 4C). .

  The color separation unit 211 outputs the image data of each color component to the character string extraction unit 212, the correction unit 213, and the other color character recognition unit 215.

  The character string extraction unit 212 receives image data of each color component from the color separation unit 211. The character string extraction unit 212 extracts, for example, a character string serving as a file name candidate (hereinafter referred to as a file name candidate character string) from the image data of K color from the image data of each color component. Specifically, the character string extraction unit 212 performs character recognition on a predetermined region (described as region A) in the K-color image data, and extracts a character string as a file name candidate. For example, assume that the first line included in the K-color image data is used as the file name. In this case, the area A is, for example, a rectangular area from the upper left origin of the K color image data to the previous line of the K color character string (■ date / time: 2010/10/15) on the second line (FIG. 5 ( A) is indicated by a broken line. Note that the method of determining the region A is not limited to this embodiment.

  The character string extraction unit 212 outputs the extracted character string to the correction unit 213. In the example of FIG. 5A, the character string extraction unit 212 extracts a character string of “standardized meeting minutes”. In this case, the “standardized standard meeting minutes” is the file name candidate character string. Further, the character string extraction unit 212 outputs coordinate information on the image where the extracted character string exists to the correction unit 213.

  The correction unit 213 receives image data of each color component from the color separation unit 211. Further, the correction unit 213 receives the file name candidate character string and the coordinate information on the image where the file name candidate character string exists from the character string extraction unit 212.

  The correcting unit 213 corrects the file name candidate character string based on the file name candidate character string existing in the K color image data and the image data of the color component other than the K color (CMY color). Specifically, the correction unit 213 uses the file name candidate character string based on graphics, symbols, and characters existing in an area including the file name candidate character string (described as region B) in the image data of other colors. To correct. In the present embodiment, as shown in FIG. 5B, the region B has a file name candidate character string when the upper left corner of the image data is the origin, the vertical direction is the Y axis, and the horizontal direction is the X axis. A region (indicated by a dashed line in the figure) including a predetermined number of pixels in the vertical direction centering on an existing Y coordinate (indicated by a dotted line in the figure). In the present embodiment, the area A and the area B are different in position and size, but the area A and the area B may be the same area.

  The correction unit 213 determines whether or not a graphic stored in a symbol storage unit 214 (to be described later) exists in the area B of the image data of other colors, and an image included in the image data of other colors is a file name candidate. It is determined whether or not it exists at a position overlapping the character string. When the graphic stored in the symbol storage unit 214 exists in the area B, or when the image included in the image data of the other color exists at a position overlapping the file name candidate character string, the correction unit 213 displays the other color. The other color character recognition unit 215 is instructed to perform character recognition processing on the image data. When the other color character recognition unit 215 recognizes the character, the correction unit 213 corrects the file name candidate character string using the recognized character. When the character is not recognized by the other color character recognition unit 215, the file name candidate character string is corrected based on the relationship between the file name candidate character string and the image included in the image data of the other color. Details of the file name candidate character string correction process will be described later with reference to a flowchart.

  The correcting unit 213 outputs the corrected file name candidate character string to the file name determining unit 216.

  The symbol storage unit 214 stores information related to a figure that means that correction to the character string is necessary. Here, information stored in the symbol storage unit 214 will be described with reference to FIG. FIG. 6A is a diagram illustrating an example of information stored in the symbol storage unit 214.

  As shown in FIG. 6A, the symbol storage unit 214 stores, for example, “No.”, “figure”, “relative position with respect to the K color character string”, “meaning”, and “position of the handwritten character”. To do. “No.” is a number for uniquely identifying each data.

  “Figure” represents a figure for which it is determined whether or not it exists in the area B including the file name candidate character string. The “relative position with respect to the K color character string” indicates whether the “figure” is positioned relatively above or below the file name candidate character string. “Meaning” represents a process to be executed for a file name candidate character string when “figure” exists at “relative position with respect to the K color character string”. In the example of FIG. 6A, the “meaning” represents at which position the character written on the original document by the user should be inserted. For example, “lower right insertion” means that a handwritten character is inserted at the position indicated by the lower right of the figure.

  “Handwritten character position” is the position where the handwritten character is inserted in the file candidate character string when the “graphic” is “relative to the K-colored character string”. Indicates whether to do. For example, “within the specified rectangle, upper left” is a predetermined region (region B) including the file candidate character string, and the handwritten character existing at the upper left with respect to the “graphic” is the file candidate character string. To insert.

  For example, it is assumed that the image data shown in FIG. 6B exists and only the “standard meeting minutes” is a K-color character string. In this case, since the graphic included in the image data of the other colors exists at a position relatively higher than the character string of K color, It corresponds to the figure of 2. In this case, the handwritten character of “Picture” existing at the upper right of the figure is inserted between “Plan” and “Meeting” indicated by the lower left of the figure.

  Further, for example, it is assumed that the image data shown in FIG. 6C exists and only the “standardized meeting minutes” is a character string of K color. In this case, the graphic included in the image data of the other color exists at a lower position relative to the character string of K color. This corresponds to 9 figures. In this case, the handwritten character of “Picture” existing below the figure is inserted at a position above the vertex of the figure (between “plan” and “meeting”).

  Further, for example, it is assumed that the image data shown in FIG. 6D exists and only the “standardized meeting minutes” is a K-color character string. In this case, the graphic included in the image data of the other color exists at a position relatively higher than the character string of K color. Corresponds to 10 figures. In this case, the handwritten character of “draw” existing on the figure is inserted at a position below the vertex of the figure (between “plan” and “meeting”).

  Returning to FIG. 3, the description will be continued. The other color character recognition unit 215 receives image data of each color component from the color separation unit 211. In addition, the other color character recognition unit 215 receives an instruction to perform character recognition processing for image data of other colors from the correction unit 213. The other color character recognition unit 215 performs character recognition processing on image data of color components other than the K color from which the character string has been extracted. The other color character recognition unit 215 outputs the recognized character to the correction unit 213.

  The dictionary storage unit 217 stores a user dictionary in which character strings used as file names in the past are registered. FIG. 7 is a diagram illustrating an example of a user dictionary. As shown in FIG. 7, the user dictionary has “character string” and “registration date” as items. The “character string” stores a character string that the user has used as a file name in the past. The date when the “character string” is registered is stored in the “registration date”. For example, the character string “minutes of standardization meeting” is registered on October 10, 2010.

  The file name determination unit 216 receives a file name candidate character string from the correction unit 213. The file name determination unit 216 determines whether the file name candidate character string exists in the user dictionary stored in the dictionary storage unit 217. When the file name candidate character string exists in the user dictionary stored in the dictionary storage unit 217, the file name determination unit 216 presents the file name candidate character string received from the correction unit 213 to the user. When the file name candidate character string presented by the user is approved, the correcting unit 213 determines the file name candidate character string as a file name and outputs the file name candidate character string to the communication device 10.

  When the file name candidate character string does not exist in the dictionary stored in the dictionary storage unit 217, the file name determination unit 216 selects the file name candidate from the character strings existing in the dictionary stored in the dictionary storage unit 217. Get a string with high similarity to the string. The file name determination unit 216 presents the acquired character string and the file name candidate character string to the user, and accepts selection of the file name. The file name determination unit 216 outputs the selected file name to the communication device 10. The communication device 10 attaches the file name determined by the file name determination unit 216 to the image data read by the image reading device 30 and transmits the image data to the information processing device 200. Note that the similarity between the file name candidate character string and the character string existing in the user dictionary is calculated using, for example, the technique described in Japanese Patent Application Laid-Open No. 2011-8553, etc., and the conventional technique. .

  Next, an example of a file name determination process executed by the image processing apparatus 20 will be described. 8 and 9 are flowcharts illustrating an example of processing executed by the image processing apparatus 20.

  First, the image processing apparatus 20 uses a file name determination method as to whether a user manually inputs a file name to be assigned to image data read by the image reading apparatus 30 or whether the image processing apparatus 20 determines automatically. Accept from the user (step S11). Specifically, the image processing apparatus 20 receives a file name determination method from the user via an operation screen displayed on a display device (not shown).

  Next, the color separation unit 211 determines whether or not automatic file name determination in which the image processing apparatus 20 automatically determines the file name is selected (step S13).

  If automatic determination of the file name is not selected (step S13 / NO), the file name determination unit 216 accepts input of the file name via the operation screen (step S47), and ends this process.

  When the automatic determination of the file name is selected (step S13 / YES), the color separation unit 211 separates the image received from the image reading device 30 into each color component of CMYK. Next, the color separation unit 211 performs binarization processing on the image separated into each color component, and generates a binarized image for each color component (step S17). This binarized image data becomes image data of each color component.

  Next, the character string extraction unit 212 selects K color image data as the image data from which the file name candidate character string is extracted (step S19). The character string extraction unit 212 performs character recognition processing on the area A of the K color image data, and extracts a file name candidate character string (step S21).

  Next, the correcting unit 213 determines a rectangular area B including the file name candidate character string (step S23). The correction unit 213 determines whether a CMY color image (graphic image, character image, or the like) exists in the rectangular area B in the image data of each CMY color component (step S25). When no CMY color image exists in the area B (step S25 / NO), the correcting unit 213 determines that there is no correction to the file name candidate character string (step S27). The correcting unit 213 stores the file name candidate character string extracted in step S21 as the file name candidate 1, for example, in the HDD 205 (step S45).

  When the CMY color image exists in the rectangular area B (step S25 / YES), the correction unit 213 overlaps the K color character string acquired in step S21 with the other color image (any one of the CMY colors). Whether or not (step S27).

  When the image of the other color (any one of CMY colors) overlaps with the K character string (step S27 / YES), the correction unit 213 determines that the K character that overlaps the image of the other color is a correction target ( Step S29).

  Next, the other color character recognizing unit 215 performs character recognition processing of the image data of the other color in the region C including the K color character overlapping with the image of the other color (step S31). Here, in the present embodiment, the region C including the K-color character overlapping with the image of the other color includes, for example, a predetermined number of pixels in the vertical direction from the Y coordinate where the K-color character overlapping with the image of the other color exists. Although it is an area, the area C can be set to an arbitrary area.

  The correcting unit 213 determines whether or not a character is recognized in the image data of other colors (step S33).

  When the character is not recognized in the image data of the other color (step S33 / NO), the correcting unit 213 deletes the K color character overlapping with the other color from the character string (step S35). When the character is recognized in the image data of the other color (step S33 / YES), the correction unit 213 replaces the K color character overlapping with the other color with the character of the other color recognized in step S31 (step S37).

  Next, the correcting unit 213 determines whether or not there is an insertion system symbol in the rectangular area B (step S39). Here, as shown in FIG. 4A, the insertion-type symbol refers to a symbol that is stored in the symbol storage unit 214 and represents insertion of another character between characters. In other words, the correction unit 213 determines whether or not the symbol stored in the symbol storage unit 214 exists in the rectangular area B.

  When an insertion symbol exists in the rectangular area B (step S39 / YES), the other color character recognition unit 215 performs character recognition processing in the area B of the image data of the other color to recognize the other color character ( Step S41). Then, the correcting unit 213 inserts the character existing at the “position of the handwritten character” in FIG. 6A among the other color characters recognized in step S41 between the characters of the K color character string indicated by the symbol. (Step S43).

  The file name determination unit 216 stores the character string obtained by the processes in steps S27 to S43 as the file name candidate 1 (step S47).

  Here, an example of the file name candidate 1 obtained by the processing in steps S11 to S47 will be described with reference to FIG. FIG. 10 is a diagram for explaining the file name candidate 1 obtained when the processing in steps S11 to S47 is executed for each image data received from the image reading device 30. FIG.

  In the example of FIG. 10A, it is assumed that only the characters of “standardized meeting minutes” in the original image data are K color. In this case, the file name candidate character string extracted in step S21 becomes “standardized standard meeting minutes”. In the example of A, since an image of another color exists in the region B (step S25 / YES), the correcting unit 213 determines whether or not the other color image overlaps with the K character string (step S27). In the example of A, the other color image (“X” graphic image representing deletion) overlaps “standard” in the K color character string (step S27). The overlapping K-color character “standard” is determined to be corrected (step S29). Then, the other color character recognition unit 215 performs a character recognition process on the region C including the K color character overlapping the other color image (step S31). In the example of A, the character recognition process is performed on the area C including “standard” in the image data of other colors, and the character “plan” is recognized as the other color characters (YES in step S33). The correcting unit 213 replaces the K color character (standard) overlapping the other color image with the other color character (plan) (step S37). In the example of A, since no insertion system symbol exists in the region B (step S39 / NO), the process of step S41 is not performed. As a result, the file name candidate 1 based on the original image data of A becomes “standardization planning meeting minutes”.

  Subsequently, in the example B, it is assumed that only the characters of “standardization planning meeting minutes” are K color in the original image data. In this case, the file name candidate character string extracted in step S 21 is “standardization planning meeting minutes”. In the example of B, since an image of another color exists in the region B (step S25 / YES), the correcting unit 213 determines whether or not the other color image overlaps the K character string (step S27). In the example of B, the other color image (“X” graphic image representing deletion) overlaps “standard” in the K color character string (step S27). The overlapping K-color character “standard” is determined to be corrected (step S29). Then, the other color character recognition unit 215 performs a character recognition process on the region C including the K color character overlapping the other color image (step S31). In the example of B, character recognition processing is performed on the area C including “standard” in the image data of other colors, but there is no other color character in the area C (step S31 / NO). Deletes the K color character (standard) overlapping the image of the other color from the character string (step S35). In the example of B, since there is no insertion system symbol in the region B (step S39 / NO), the process of step S41 is not performed. As a result, the file name candidate 1 based on the original image data of B becomes “standardized meeting minutes”.

  Further, in the example of C, it is assumed that only the characters of “standardized meeting minutes” are K color in the original image data. In this case, the file name candidate character string extracted in step S21 is “standardized meeting minutes”. In the example of C, since an image of another color exists in the region B (step S25 / YES), the correcting unit 213 determines whether or not the other color image overlaps the K character string (step S27). In the example of C, since the other color image (“X” graphic image representing deletion) overlaps “case” in the K color character string (step S27 / YES), the correcting unit 213 uses the other color. The K-color character “standard” overlapping the image is determined as a correction target (step S29). Then, the other color character recognition unit 215 performs a character recognition process on the region C including the K color character overlapping the other color image (step S31). In the example of C, character recognition is performed for the region C including “case” in the image data of other colors, and the character of “image” is recognized as the other color characters (step S33 / YES). The correcting unit 213 replaces the K color character (case) overlapping the other color image with the other color character (image) (step S37). The file name candidate character string after the process of step S37 becomes “standardized image meeting minutes”. In the example of C, since an insertion symbol exists in the area B (step S39 / YES), the other color character recognition unit 215 performs character recognition processing on the area B in the image data of other colors ( Step S41). As a result of the processing in step S41, the characters “plan” and “draw” are recognized as other color characters. The correcting unit 213 inserts the character of “plan” existing in the upper left of the insertion system symbol between “plan” and “draw” between “formation” and “case” indicated by the graphic (step S43). . As a result, the file name candidate 1 based on the original image data of C becomes “standardization planning meeting minutes”.

  Next, with reference to FIG. 6, the process after step S45 and S47 is demonstrated. The file name determination unit 216 compares the file name candidate 1 with the user dictionary stored in the dictionary storage unit 217 (step S51). The file name determination unit 216 determines whether the file name candidate 1 exists in the user dictionary (step S53).

  When the file name candidate 1 exists in the user dictionary (step S53 / YES), the file name determination unit 216 presents only the file name candidate 1 to the user (step S55). For example, the file name determination unit 216 displays the file name candidate 1 on the display device included in the image forming apparatus 300.

  Next, the file name candidate 1 determines whether or not the file name candidate 1 presented in step S55 has been approved as a file name by the user (step S57). When the file name candidate 1 is approved by the user as a file name (step S57 / YES), the file name determination unit 216 determines the file name candidate 1 as a file name (step S59) and ends the process.

  When the file name candidate 1 does not exist in the dictionary (step S53 / NO), the file name determination unit 216 searches the user dictionary for a word having a high similarity to the file name candidate 1 and sets it as the file name candidate 2 ( Step S61). Next, the file name determination unit 216 presents the file name candidate 1 and the file name candidate 2 to the user (step S63). For example, it is assumed that the file name candidate 1 is “standardized meeting minutes”. In this case, there is no “standardized meeting minutes” in the user dictionary shown in FIG. Therefore, the file name determination unit 216 sets the “standard meeting minutes” having a high similarity to the “standard meeting minutes” as the file name candidate 2. Then, the file name determination unit 216 presents “standardized meeting minutes” and “standard meeting minutes” to the user.

  Next, the file name determination unit 216 determines whether or not the file name candidate 1 has been selected by the user (step S65). When the file name candidate 1 is selected by the user (step S65), the file name determination unit 216 adds the file name candidate 1 to the user dictionary (step S67). Then, the file name determination unit 216 determines the file name candidate 1 as the file name (step S69), and ends the process.

  When the file name candidate 1 is not selected by the user (step S65 / NO), the file name determination unit 216 determines whether the file name candidate 2 is selected (step S71). When the file name candidate 2 is selected (step S71 / YES), the file name determination unit 216 determines the file name candidate 2 as the file name (step S73), and ends the process. Since the file name candidate 2 has already been registered in the user dictionary, the file name determination unit 216 does not register in the user dictionary.

  If the file name candidate 2 is not selected (step S71 / NO), or if the user does not approve the file name candidate 1 as a file name in step S57 (step S57 / NO), the file name determination unit 216 Accepts input of a file name from the user (step S75).

  The file name determination unit 216 adds the input file name to the user dictionary (step S77). Then, the file name determination unit 216 determines the input file name as a file name (step S79), and ends the process.

  As is clear from the above description, according to the above-described embodiment, the color separation unit 211 separates image data generated by reading a document written by the user into a plurality of color components, and a character string extraction unit. A character recognition process 212 is performed on a predetermined region A in the image data of the K color component, and a character string that becomes a file name candidate is extracted. As a result, even if the original document printed in the K color is written by the user using a color other than the K color (for example, red or blue), the character string that is the file name candidate is accurately determined. Be recognized. For example, when character recognition processing is performed on the original image shown in FIG. 4A that has not been color-separated, a “plan” character written in a color other than the K color or an “X” figure representing deletion Is also recognized as part of the character, the file name candidate character string cannot be recognized correctly. For example, in the example of FIG. 4A, if character recognition processing is performed on image data including characters of “standardized standard meeting minutes”, it is recognized as “standardized meeting minutes”. On the other hand, according to the present embodiment, since the character string extraction unit 212 performs character recognition processing on the color-separated K-color image data, the character string is not affected by the graphic or character written by the user. Recognition processing is executed. As a result, even when the user writes, the character string as the file name candidate is correctly recognized, so that the accuracy of the character recognition process is improved.

  And the other color character recognition unit 215, when the image of the other color existing in the region B including the file name candidate character string in the image data of the other color different from the K color component overlaps the file name candidate character string, or When there is a graphic image stored in the symbol storage unit 214 in the area B in the image data of the other color, the character recognition process is performed on the area B of the image data of the other color to recognize the other color character. The correction unit 213 corrects the file name candidate character string based on the relationship between the image of the other color and the file name candidate character string and at least one of the other color characters recognized by the other color character recognition unit 215. . Thereby, the file name candidate character string reflecting the writing performed by the user using a color other than the K color with respect to the K color character string is acquired.

  In the above-described embodiment, when the image of another color overlaps the file name candidate character string, the correction unit 213 converts the character overlapping the image of the other color among the characters included in the file name candidate character string. Delete from. As a result, a file name candidate character string reflecting a write intended for deletion performed by the user on the original document is acquired.

  In addition, when the image of another color overlaps the file candidate name character string, the correction unit 213 recognizes the character that overlaps the image of the other color among the characters included in the file name candidate character string by the other color character recognition unit 215. Replace with other color characters. As a result, a file name candidate character string reflecting the writing intended for replacement performed by the user on the original document is acquired.

  Further, when there is an insertion symbol in the region B in the image data of other colors, the correcting unit 213 inserts the other color characters recognized by the other color character recognizing unit 215 into the file name candidate character string. As a result, the file name candidate character string reflecting the writing that the user has performed on the original document and intended to insert the character is acquired.

  In addition, the dictionary storage unit 217 stores a user dictionary in which character strings that have been used by the user are registered, and the file name determination unit 216 stores the file name candidate character strings in the dictionary storage unit 217. A character string similar to the file name candidate character string is detected from the character strings stored in the dictionary storage unit 217 and presented to the user as a file name. When the file name candidate character string is not in the user dictionary, there is a high possibility that a character is erroneously detected in the character recognition processing executed by the character string extraction unit 212 and the other color character recognition unit 215. By using the user dictionary to determine whether the file name candidate character string is a character string that has been used as a file name in the past, the recognition accuracy of the file name is improved.

  The above-described embodiments are a part of the embodiments of the present invention. However, the present invention is not limited to this, and various modifications can be made without departing from the scope of the present invention.

  In the above-described embodiment, when the graphic stored in the symbol storage unit 214 exists in the region B, the other color character recognition unit 215 performs the character recognition process on the region B. However, the other-color character recognizing unit 215 may determine a region (for example, the region D) that includes the insertion system symbol and is different from the region B, and execute the character recognition process on the region D, for example.

  In the above-described embodiment, the process of using the character string included in the image data as the file name has been described. However, the present invention may be applied to an OCR (Optical Character Recognition) process performed on a document that has been written by the user with respect to the original document document.

  Note that the functions of the image processing apparatus 20 can be realized by a computer including a CPU, a ROM, a RAM, and the like. In that case, a program describing the processing contents of the functions that the image processing apparatus 20 should have is provided. By executing the program on a computer, the above processing functions are realized on the computer. The program describing the processing contents can be recorded on a computer-readable recording medium.

  When the program is distributed, for example, it is sold in the form of a portable recording medium such as a DVD (Digital Versatile Disc) or a CD-ROM (Compact Disc Read Only Memory) on which the program is recorded. It is also possible to store the program in a storage device of a server computer and transfer the program from the server computer to another computer via a network.

  The computer that executes the program stores, for example, the program recorded on the portable recording medium or the program transferred from the server computer in its own storage device. Then, the computer reads the program from its own storage device and executes processing according to the program. The computer can also read the program directly from the portable recording medium and execute processing according to the program. Further, each time the program is transferred from the server computer, the computer can sequentially execute processing according to the received program.

DESCRIPTION OF SYMBOLS 20 ... Image processing apparatus 30 ... Image reading apparatus 211 ... Color separation part 212 ... Character string extraction part 213 ... Correction part 214 ... Symbol storage part 215 ... Other color character recognition part 216 ... File name determination part 217 ... Dictionary storage part 500 ... Information processing apparatus 600... Image reading apparatus

Claims (6)

Characters for extracting a character string by performing character recognition processing on a predetermined first area in image data of a first color component among a plurality of color components constituting image data generated by reading an original A column extractor;
An image of another color component existing in the second area including the extracted character string in image data of another color component different from the first color component, and the extracted character string are predetermined. The image data of the other color component, a character recognition process is performed on the second area to recognize the character of the other color component;
At least the other based on a relationship between an image and the extracted character string color components, the correction unit for correcting the extracted character strings,
An image processing apparatus comprising:   When the image of the other color component overlaps the extracted character string, the correction unit extracts the character that overlaps the image of the other color component among the characters included in the extracted character string. The image processing apparatus according to claim 1, wherein the image processing apparatus is deleted from the processed character string.   In the case where the image of the other color component overlaps the extracted character string, the correction unit changes a character that overlaps the image of the other color component among the characters included in the extracted character string. The image processing apparatus according to claim 1, wherein the color character recognition unit replaces the character with the character of the other color component recognized. When a predetermined symbol exists in the second area in the image data of the other color component, the correction unit inserts the character recognized by the other color character recognition unit into the extracted character string. The image processing apparatus according to claim 1, wherein the image processing apparatus is an image processing apparatus. A dictionary storage for storing character strings that have been used by users;
When the character string corrected by the correction unit is not included in the dictionary storage unit, a character string similar to the character string corrected by the correction unit is detected from the character strings stored in the dictionary storage unit. A character string determination unit that determines the extraction result of the character string included in the first area;
The image processing apparatus according to claim 1, further comprising: On the computer,
Characters for extracting a character string by performing character recognition processing on a predetermined first area in image data of a first color component among a plurality of color components constituting image data generated by reading an original A column extraction step;
An image of another color component existing in the second area including the extracted character string in image data of another color component different from the first color component, and the extracted character string are predetermined. A character recognition process for recognizing the character of the other color component by performing character recognition processing on the second region in the image data of the other color component.
A correction step at least the other based on a relationship between an image and the extracted character string color components, modifying the extracted character strings,
A program characterized by having executed.

Images