JP2006133960A - Image processing device and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To extract an additionally written part specified by additional writing to a document original and to apply various processings to the additionally written part. <P>SOLUTION: A controller 11 extracts an additionally written image from an additionally written document indicated by image data inputted to an input unit 13 and specifies a region to be written additionally having a predetermined position relation to the additionally written image. Further, the controller 11 extracts the image data to be written additionally arranged in the specified region to be written additionally, and performs a processing specified by the color of the additional writing to the image to be written additionally. Accordingly, an additionally writing person merely perform the additionally writing in the part of the document by a pen of the color corresponding to the content of the processing. Thereby, the additionally writing person can perform the desired processing in the image processing apparatus 1. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to a technique for performing various kinds of processing on a portion to be added designated by additional writing made on a document original.

  Various comments may be written on the document, and an approver's signature or seal may be added to indicate that the content of the document has been approved. Conventionally, techniques for extracting only such additional portions have been proposed. For example, Patent Document 1 describes a technique in which only an added part is extracted by comparing and collating a document original and an additionally-written document added to the original. In Patent Document 2, if a certain document is a recordable document B of the document A that has already been registered in the database, the recordable document B and the document A are compared to extract image data of a recordable part and extract it. A mechanism for associating the processed image data with the document A has been proposed. In Patent Document 3, as described in Patent Document 2, after comparing the postscript document B and the document A and extracting the image data of the postscript portion, information on the image data of the postscript portion (for example, It is described that the user inputs a keyword and update date and that the input information is stored together with the image data of the additional portion.

By the way, while referring to articles such as newspapers and magazines, there are cases where it is desired to cut out and save articles of interest, or to mask unnecessary articles and paint them. In such a case, for example, it is very convenient if the above-described article extraction process or mask process can be performed only by designating the article (part to be added) by, for example, additional writing such as marking with a marker pen. . However, such a request cannot be met by the technology relating to additional writing as described in Patent Documents 1 to 3.
Japanese Patent Laid-Open No. 61-267177 JP-A-8-317155 JP 2000-148790 A

  The present invention has been made in view of such a background, and an object of the present invention is to extract a portion to be added designated by appending to the original document and perform various processes on the portion to be added. Is to provide.

  In order to achieve the above-described object, the present invention provides an input means for inputting image data and an additional image extraction for extracting an additional image specified according to a predetermined condition from an image represented by the input image data. Means for specifying an image area having a predetermined positional relationship with the extracted additional recording image as an additional recording area, and extracting an image arranged in the specified additional recording area as an additional recording image Provided is an image processing apparatus including a postscript image extraction unit and a processing unit that performs a specified process on the extracted postscript image. According to this image processing apparatus, an image area having a predetermined positional relationship with the additional recording image is specified as the additional recording area, and the specified process is performed on the additional recording image arranged in the specified additional recording area. Is possible.

  In a preferred aspect of the present invention, when the additional image extracted by the additional image extraction means represents a line, and there is a discontinuity in the line, a complement means for complementing the discontinuity with the line is provided. The region specifying unit specifies a region to be added having a predetermined positional relationship with the additional image supplemented by the complementing unit.

  When the additional image extracted by the additional image extraction unit is an image representing a closed loop, the region specifying unit specifies an image region surrounded by the loop represented by the additional image as the additional region. You may make it do.

  In a preferred aspect of the present invention, layout analysis is performed on an image represented by the input image data or an image obtained by removing the additional image from the image, and the image is converted into a plurality of layout units. Layout analysis means for dividing into regions, wherein the area specifying means has a predetermined positional relationship with the additional image extracted by the additional image extraction means among the layout unit areas divided by the layout analysis means. A unit area is specified as the additional recording area.

  For example, when the additional image extracted by the additional image extraction unit is an image representing a closed loop, the region specifying unit may determine the layout unit region substantially surrounded by the loop represented by the additional image. You may make it identify as said additional recording area. In addition, when the additional image extracted by the additional image extraction unit is an image representing a closed loop, the region specifying unit includes the loop represented by the additional image or all of the loops included in the loop. The layout unit area may be specified as the added area. In addition, the apparatus includes a circumscribed rectangle generating unit that generates a circumscribed rectangle circumscribing the additional image extracted by the additional image extracting unit, and the region specifying unit includes the layout unit region substantially surrounded by the circumscribed rectangle. It may be specified as a postscript area. In addition, a circumscribed rectangle generating unit that generates a circumscribed rectangle circumscribing the additional image extracted by the additional image extracting unit is provided, and the region specifying unit includes all of the circumscribed rectangle or whether it is included in the circumscribed rectangle. The layout unit area may be specified as the added area. The area specifying unit may specify the layout unit area in which almost the entire area of the additional image extracted by the additional image extraction unit exists as the additional recording area. The area specifying unit may specify all the layout unit areas in which at least a part of the additional image extracted by the additional image extraction unit exists as the additional area.

  Furthermore, the area specifying unit may specify a layout unit area adjacent to the layout unit area as the additional recording area in addition to the layout unit area having a predetermined positional relationship with the additional image. Further, character recognition means for performing character recognition on a character string included in the layout unit area, natural language analysis means for performing natural language analysis on a recognition result by the character recognition means, and analysis by the natural language analysis means Grouping means for grouping related layout unit areas based on the results, the area specifying means in addition to the layout unit area having a predetermined positional relationship with the additional image, the grouping means A layout unit area that belongs to the same group as the layout unit area may be specified as the additional recording area.

  The processing means performs extraction processing of the postscript image, deletion or mask processing, replacement processing with another image, character recognition processing, or translation processing for the result of the character recognition on the extracted postscript image. Of these, at least one of the processes may be performed.

  In addition, a color identification unit that identifies the color of the additional image, and a storage unit that stores the color of the additional image and the content of the processing in association with each other, and the processing unit adds the extracted additional image to the additional image. On the other hand, the content stored in the storage unit may be processed in association with the color of the additional image having a predetermined positional relationship with the additional image.

  Further, the image processing apparatus includes a shape identifying unit that identifies the shape of the additional image, and a storage unit that stores the shape of the additional image and the content of the process in association with each other, and the processing unit adds the extracted additional image to the additional image to be recorded. On the other hand, the content stored in the storage unit may be processed in association with the shape of the additional image having a predetermined positional relationship with the additional image.

  Further, the present invention provides a computer with a postscript image extraction function for extracting a postscript image specified according to a predetermined condition from an image represented by the input image data, and a predetermined positional relationship between the extracted postscript image and the computer. An area specifying function for specifying an image area having a postscript area, a postscript image extraction function for extracting an image arranged in the specified postscript area as a postscript image, and an extracted postscript image A program for realizing a processing function for performing a specified process is provided.

First, main terms used in the embodiment of the present invention are defined.
The “original document” means a document that has not been additionally written by an adder after an image is formed by an image forming apparatus such as a printer. “Original image data” is image data representing the contents of the original document.
On the other hand, the “additional document” means a document in a state where the original document is additionally written. In addition, “additional image” means an image of a postscript portion of the original document. For example, in the case of additional writing in which a certain character string is surrounded by a line, the line itself is the additional recording image. “Additional image data” is image data representing the contents of the additional image.
The “recorded image” means an image of a portion (added portion) designated by appending in the original document. For example, in the case of additional writing in which a certain character string is surrounded by a line, the character string is a postscript image. “Additional image data” is image data representing the contents of the added portion.

(1) First Embodiment FIG. 1 is a block diagram illustrating a configuration of an image processing apparatus 1 according to a first embodiment. The image processing apparatus 1 is a personal computer, for example, and includes a control unit 11, a nonvolatile storage unit 12, an input unit 13, a display unit 14, and an operation unit 15. An image reading device 2 such as a scanner is connected to the input unit 13 via a communication cable.

  The control unit 11 includes a CPU (Central Processing Unit) 111, a ROM (Read Only Memory) 112, and a RAM (Random Access Memory) 113. The control unit 11 converts image data input from the image reading device 2 through the input unit 13. On the other hand, various image processing is executed. The non-volatile storage unit 12 is, for example, a hard disk, and stores an image processing program PRG describing a procedure of image processing executed by the control unit 11. The operation unit 15 includes, for example, a keyboard and a mouse, receives an input operation by a user, and supplies a signal corresponding to the operation to the control unit 11. The display unit 14 is a liquid crystal display device, for example, and displays various images under the control of the control unit 11.

FIG. 2 is a flowchart showing a procedure described in the image processing program PRG.
The appender adds to the original document. Specifically, for a monochrome original document in which a black image is formed on a white background recording paper like a very general text document, the appender uses a pen to specify the document content to be cut out and saved, for example. Add a note that is enclosed in a line. The pen used here is, for example, a pen of a color such as red, yellow, or blue. In the first embodiment, as a rule for performing additional writing, it is predetermined that contents to be cut out and stored are surrounded by a red line, and contents to be deleted are surrounded by a blue line. Shall. The color to be used for such additional recording and the content of the processing are associated with each other and stored in advance in the nonvolatile storage unit 12.

  Here, the postscript document D1 of FIG. 3 shows an example of the postscript document that has been postscripted according to the above rules. In this example, part of the content of the document is surrounded by a blue line l1. The operator of the image processing apparatus 1 causes the image reading apparatus 2 to read the postscript document D1 as shown in FIG. The image reading device 2 inputs image data representing the read image to the input unit 13 of the image processing device 1.

  In FIG. 2, when image data is input to the input unit 13 (step S1), the control unit 11 specifies additional images from the image data according to predetermined conditions and extracts them (step S2). . As described above, since the color of additional recording is determined in advance, the control unit 11 may extract an image composed of pixels of that color from the image data as an additional recording image. In the example of FIG. 3, the blue line l1 is extracted as a postscript image.

  Next, the control unit 11 determines whether or not it is necessary to complement the additional image extracted in step S2. For example, even if an appender tries to fill in a closed loop, the loop may be interrupted without being a complete closed loop. As an example, it is a case where the blue line 12 does not form a complete closed loop as in the postscript document D2 of FIG. In such a case, the control unit 11 calculates the distance between one end and the other end of the postscript image (line 12), and determines that complementation is necessary when the distance is less than the threshold (step S3; Yes). ), One end and the other end are connected by a line l2 ′ to complement (step S4). By this complementing process, a complete closed loop is formed as shown in the document D2 '.

  Next, the control unit 11 identifies a postscript area having a predetermined positional relationship with the extracted postscript image (step S5). For example, when a closed loop is formed with a blue line l1 as in the additional record document D1 in FIG. 3, the image area a1 (shaded area in FIG. 3) surrounded by the closed loop is the postscript area. . Similarly, when the closed loop is formed by the complemented blue line l2 as in the document D2 ′ in FIG. 4, the image region a2 (shaded portion in FIG. 4) surrounded by the closed loop is covered. This is a postscript area.

  Next, the control part 11 extracts the image arrange | positioned at the specified to-be-recorded area as a to-be-recorded image (step S6). And the control part 11 performs the process corresponding to the color of additional recording with respect to the extracted additional recording image (step S7). Here, since the process corresponding to the blue additional recording is the deletion of the postscript image, the images of the postscript areas a1 and a2 are deleted as in the documents D1 ′ and D2 ″ shown in FIGS. Then, the control unit 11 stores the processing result (image data representing the documents D1 ′ and D2 ″) in the nonvolatile storage unit 12.

  According to the first embodiment, the control unit 11 extracts a postscript image from the postscript document represented by the image data input to the input unit 13, and specifies a postscript area having a predetermined positional relationship with the postscript image. . Further, the control unit 11 extracts the postscript image data arranged in the specified postscript area, and executes a process designated by the color of the postscript for these postscript images. Accordingly, the appender can cause the image processing apparatus 1 to execute the process desired by the appender only by performing the appending to the original document document with a color pen corresponding to the content of the process. Further, even if the additional writing is incomplete, such as when the line l2 is interrupted as shown in FIG. 4, the interrupted portion is supplemented by the image processing apparatus 1, so that the additional writing operation is easy for the additional writer. . In addition, when additional writing is performed on a black character with, for example, a blue line, when the additional recording image is extracted, the portion that overlaps the character is actually a black pixel instead of a blue pixel. All parts will be interrupted. Since complement processing is performed in the first embodiment, a postscript image can be appropriately extracted even in such a case.

The first embodiment can be modified as follows.
When extracting the postscript image, there are various methods besides the method of extracting based on the color of the postscript image as described above. For example, as described in Patent Documents 1 to 3 described above, a postscript portion is extracted by comparing a document original that has been stored in advance as electronic data with a postscript that has been added to the original document. This method may be adopted.

  There are also the following methods. The control unit 11 changes the color of each pixel included in the image data input to the image processing apparatus 1 to a so-called limited color (that is, converts it into several representative colors), and at least any two of these representative colors Is specified as the basic color. The basic color here is a color used to represent the contents of the original document. For example, when black characters are formed on white recording paper, white and black are the basic colors. It is. Then, the control unit 11 separates the image data converted into the representative color into original image data composed of basic color pixels and additional image data composed of representative color pixels other than the basic color. Here, since the original image data is image data represented by basic colors, it should represent the contents of the original document. On the other hand, the image data composed of pixels of representative colors other than the basic colors (other than black and white) should represent a postscript image.

  Note that the type of processing performed on the postscript image is not limited to the above-described clipping processing and deletion processing, and any processing can be applied. For example, a replacement process with another image may be performed.

  Further, the image processing apparatus 1 may be realized by a personal computer, or may be realized by a multifunction machine having the function of the image processing apparatus 1. Further, part of the functions of the image processing apparatus 1 may be realized by the image reading apparatus 2. In addition, the control unit 11 of the image processing apparatus 1 does not store the extracted additional image data to be stored in the nonvolatile storage unit 12 built in the image processing apparatus 1, but a floppy (registered trademark) disk or other recording medium. You may make it memorize. The image processing program PRG can be provided in a state of being recorded on various recording media such as a magnetic disk, a floppy (registered trademark) disk, a CD (Compact Disk), a DVD (Digital Versatile Disk), and a RAM. .

(2) Second Embodiment Next, a second embodiment of the present invention will be described. The second embodiment is different from the first embodiment in that a postscript image is extracted after layout analysis is performed on a postscript document. The configuration of the image processing apparatus according to the second embodiment is the same as that of the image processing apparatus 1 shown in FIG. 1 except for a part of the procedure described in the image processing program PRG. Omitted.

  FIG. 5 is a flowchart showing a procedure described in the image processing program PRG according to the second embodiment. 5 is different from the content of FIG. 2 in that a process (step S8) for performing layout analysis is inserted between step S2 and step S5. In FIG. 5, the supplemental image supplement processing (steps S3 and S4) is not shown in FIG. 5, but step S8 may be performed after the supplement processing.

Here, a specific method for specifying the postscript area after layout analysis will be described with reference to FIGS.
(2-1) Method for Specifying Layout Unit Area Surrounded by Closed Loop as Additional Recording Area A closed loop consisting of a red line l3 is additionally written in the additional writing document D3 shown in FIG. After extracting the closed loop (step S2), the control unit 11 removes the closed loop once and executes layout analysis (step S8), and divides the layout unit regions as shown by dotted lines in FIG. Then, the control unit 11 specifies the layout unit region a3 (shaded portion in FIG. 6) surrounded by the closed loop. Here, even if the entire layout unit region a3 is not completely surrounded by the closed loop, if the almost entire region of the layout unit region a3 is surrounded, the control unit 11 defines the layout unit region a3 as the additional recording region. It may be specified as

  Next, the control unit 11 extracts an image arranged in the specified layout unit area a3 (recorded area) as a recorded image (step S6). Here, since the color of the additional recording is red, the control unit 11 performs a process of cutting out the extracted additional recording image and storing it in the nonvolatile storage unit 12 (step S7). In FIG. 6, an arrow p indicates a procedure for performing layout analysis after once removing the postscript image. On the other hand, the arrow q indicates the procedure when layout analysis is performed without removing the additional image (the same applies to FIGS. 7 to 11 below). An appropriate one may be appropriately selected as to which procedure is used for layout analysis.

(2-2) Method for Specifying All Layout Unit Regions Existing or Enclosed by Closed Loop as Added Regions Next, FIG. 7 shows all layouts that exist or are enclosed by the closed loop. An example in which a unit area is specified as a postscript area is shown. The control unit 11 specifies all layout unit regions a4 (hatched portions in FIG. 7) that include the line 14 (red) indicating the closed loop of FIG. Thereafter, the control unit 11 extracts an image arranged in the specified layout unit region a4 as a postscript image (step S6). Here, since the color of the additional recording image is red, the control unit 11 performs a process of cutting out the extracted additional recording image and storing it in the nonvolatile storage unit 12 (step S7).

(2-3) Method of Specifying Layout Unit Area Surrounded by circumscribing Rectangle of Additional Recording Image as Additional Recording Area Next, FIG. 8 shows an example of specifying the additional recording area using the circumscribed rectangle of the additional recording image. Show. In the postscript document D5 shown in FIG. 8, a closed loop consisting of a red line l5 is added. After extracting the closed loop (step S2), the control unit 11 removes the closed loop and executes layout analysis (step S8), and divides the layout unit area as shown by the dotted line in FIG. Then, the control unit 11 generates a closed-loop circumscribed rectangle s5 and specifies a layout unit region a5 (shaded portion in FIG. 8) surrounded by the circumscribed rectangle s5. Here, even if the whole area of the layout unit area a5 is not completely surrounded by the circumscribed rectangle s5, if the whole area of the layout unit area a5 is surrounded, the control unit 11 adds the layout unit area to the target. What is necessary is just to specify as an area | region.

  Next, the control unit 11 extracts an image arranged in the specified layout unit area a5 (added recording area) as an added image (step S6). Here, since the color of the additional recording is red, the control unit 11 performs a process of cutting out the extracted additional recording image and storing it in the nonvolatile storage unit 12 (step S7).

(2-4) Method of specifying circumscribing rectangle of additional image or all layout unit regions included in circumscribed rectangle as additional recording region Next, FIG. Alternatively, an example is shown in which all layout unit areas included in the circumscribed rectangle are specified as a postscript area. The control unit 11 specifies all layout unit regions a6 (hatched portions in FIG. 9) where the circumscribed rectangle s6 of FIG. 9 exists or is encompassed by the circumscribed rectangle s6 as the additional recording region. Thereafter, the control unit 11 extracts an image arranged in the specified layout unit area a6 as a postscript image (step S6). Here, since the color of the additional recording image is red, the control unit 11 performs a process of cutting out the extracted additional recording image and storing it in the nonvolatile storage unit 12 (step S7).
In the second embodiment, the same modification as the modification described in the first embodiment is possible.

(3) Third Embodiment In the third embodiment, the process to be performed on the postscript image is specified by the shape of the postscript image. Specifically, the control unit 11 performs a process of cutting out and saving the postscript image specified by the additional writing when the shape of the additional writing is a closed loop, and when the shape of the additional writing is X, the additional writing is performed. A process for deleting the specified postscript image is performed. The shape of the additional image and the content of the process are associated with each other and stored in advance in the nonvolatile storage unit 12. Since the configuration of the image processing apparatus according to the third embodiment is the same as that of the image processing apparatus 1 shown in FIG. 1, detailed description thereof is omitted. The procedure described in the image processing program PRG is the same as the procedure shown in FIG. 5 except for the following points.

  FIG. 10 shows an example in which a cross mark is added to the original document. The control unit 11 extracts the additional image 17 with the x mark (step S2), removes the additional image 17 and executes layout analysis (step S8), and performs a layout unit as indicated by the dotted line in FIG. Divide into areas. Then, the control unit 11 specifies the layout unit region a7 (the hatched portion in FIG. 10) that includes the entire region or almost the entire region of the additional image 17 with the x mark. Next, the control unit 11 extracts an image arranged in the specified layout unit region a7 as a postscript image (step S6). The control part 11 performs the process which deletes the extracted postscript image (step S7).

Next, FIG. 11 shows an example in which all layout unit areas in which the additional recording image l8 marked with X is specified as the additional recording area. The control unit 11 identifies all layout unit areas a8 (hatched portions in FIG. 11) where the additional recording image l8 in FIG. 11 exists as the additional recording area. Thereafter, the control unit 11 extracts an image arranged in the specified layout unit region a8 as a postscript image (step S6). The control part 11 performs the process which deletes the extracted postscript image (step S7).
In the third embodiment, the same modification as the modification described in the first embodiment is possible.

(4) Fourth Embodiment In the image processing apparatus according to the fourth embodiment, in addition to the layout unit area having a predetermined positional relationship with the additional recording image, the layout unit area adjacent to the layout unit area is also set as the additional recording area. It has come to identify. In this way, even if the size of the postscript image is very large, the postscripter only needs to make a postscript near the center of the postscript image. The configuration of the image processing apparatus according to the fourth embodiment is the same as that of the image processing apparatus 1 shown in FIG. 1 except for a part of the procedure described in the image processing program PRG. Omitted.

  FIG. 12 is a flowchart showing a procedure described in the image processing program PRG according to the fourth embodiment. 12 is different from the content of FIG. 5 in that the processes of steps 9 and 10 are inserted between steps S5 and S6. Specifically, the processes in steps S9 and S10 are as follows.

FIG. 13 shows an example in the case where an x mark is added to the original document. The control unit 11 extracts the additional image l9 marked with x (step S2), removes the additional image 19 and executes layout analysis (step S8), and performs a layout unit as shown by the dotted line in FIG. Divide into areas. Then, the control unit 11 specifies the layout unit region a9 that includes the entire region or almost the entire region of the additional image l9 marked with a cross (step S5). Next, the control unit 11 determines whether there is a layout unit area adjacent to the specified layout unit area a9 (step S9). If there is an adjacent layout unit area (step S9; Yes), step S5 is performed. The layout unit area (in this case, the layout unit area a9 ′) adjacent to the layout unit area is added to the layout unit area a9 specified in (Step S10). And the control part 11 extracts the image arrange | positioned in these layout unit area | regions a9 and a9 'as a postscript image (step S6). The control part 11 performs the process which deletes the extracted postscript image (step S7).
The fourth embodiment can be modified in the same manner as in the first embodiment.

(5) Fifth Embodiment In the fourth embodiment, the layout unit areas that are close to each other are regarded as one added area. On the other hand, in the fifth embodiment, layout unit areas that are determined to have similar semantic contents by using natural language analysis are grouped together, and layout unit areas that belong to the same group are regarded as additional write areas. Is. In this way, it is possible to execute the same type of processing on a postscript image having a semantic content close to the content of the postscript image designated by the postscriptor. The configuration of the image processing apparatus according to the fifth embodiment is the same as that of the image processing apparatus 1 shown in FIG. 1 except for a part of the procedure described in the image processing program PRG. Omitted.

  FIG. 14 is a flowchart showing a procedure described in the image processing program PRG according to the fifth embodiment. 14 is different from the content of FIG. 5 in that steps 11 to S14 are inserted between steps S5 and S6. Specifically, the processes in steps S11 to S14 are as follows. 14, in step S5, the control unit 11 specifies a layout unit region a10 including the entire or almost entire closed loop l10 as shown in FIG. 15, and then performs character recognition (step S11). Natural language analysis is performed (step S12). In this natural language analysis process, the control unit 11 analyzes the contents of each layout unit area using various analysis methods (for example, syntax analysis, semantic analysis, context analysis, morphological analysis, etc.), and It is determined whether or not there is a layout unit area that is semantically related (step S13).

If there is a related layout unit area (step S13; Yes), the control unit 11 adds a layout unit area (here, a layout unit area) related to the layout unit area a10 to the layout unit area a10 specified in step S5. a10 ′) is added (step S14). And the control part 11 extracts the image arrange | positioned in these layout unit area | regions a10 and a10 'as a postscript image (step S6). The control part 11 performs the process which deletes the extracted postscript image (step S7).
The fifth embodiment can be modified in the same way as the first embodiment. In addition, when the image to be added is cut out and stored, the control unit 11 may further perform a translation process on the character recognition result of the image to be added.

1 is a block diagram illustrating a configuration of an image processing apparatus according to a first embodiment of the present invention. 4 is a flowchart illustrating a procedure executed by the image processing apparatus according to the embodiment. It is a figure explaining the process of the image processing which the image processing apparatus which concerns on the same embodiment performs. It is a figure explaining the process of the image processing which the image processing apparatus which concerns on the same embodiment performs. It is a flowchart which shows the procedure which the image processing apparatus which concerns on 2nd Embodiment of this invention performs. It is a figure explaining the process of the image processing which the image processing apparatus which concerns on the same embodiment performs. It is a figure explaining the process of the image processing which the image processing apparatus which concerns on the same embodiment performs. It is a figure explaining the process of the image processing which the image processing apparatus which concerns on the same embodiment performs. It is a figure explaining the process of the image processing which the image processing apparatus which concerns on the same embodiment performs. It is a figure explaining the process of the image processing which the image processing apparatus which concerns on 3rd Embodiment of this invention performs. It is a figure explaining the process of the image processing which the image processing apparatus which concerns on the same embodiment performs. It is a flowchart which shows the procedure which the image processing apparatus which concerns on 4th Embodiment of this invention performs. It is a figure explaining the process of the image processing which the image processing apparatus which concerns on the same embodiment performs. It is a flowchart which shows the procedure which the image processing apparatus which concerns on 5th Embodiment of this invention performs. It is a figure explaining the process of the image processing which the image processing apparatus which concerns on the same embodiment performs.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1, 1a ... Image processing apparatus, 2 ... Image reading apparatus, 11 ... Control part, 111 ... CPU, 112 ... ROM, 113 ... RAM, 12 ... Nonvolatile memory | storage part, 13 ... Input part, 14 ... Display part, 15 * ..Operation unit, PRG: Image processing program.

Claims (16)

An input means for inputting image data;
A recordable image extracting means for extracting a recordable image specified according to a predetermined condition from the image represented by the input image data;
Area specifying means for specifying an image area having a predetermined positional relationship with the extracted postscript image as a postscript area;
A postscript image extraction means for extracting an image arranged in the specified postscript area as a postscript image;
An image processing apparatus comprising: processing means for performing specified processing on the extracted postscript image. The additional image extracted by the additional image extraction means is an image representing a line, and if there is a discontinuity in the line, the supplement image includes a complement means for complementing the discontinuity with a line,
The image processing apparatus according to claim 1, wherein the region specifying unit specifies a postscript region having a predetermined positional relationship with the postscript image supplemented by the complementing unit.   When the additional image extracted by the additional image extraction unit is an image representing a closed loop, the region specifying unit specifies an image region surrounded by the loop represented by the additional image as the additional region. The image processing apparatus according to claim 1. Layout analysis means for performing layout analysis on an image represented by the input image data or an image obtained by removing the additional image from the image and dividing the image into a plurality of layout unit areas; Prepared,
The region specifying unit specifies a layout unit region having a predetermined positional relationship with the additional image extracted by the additional image extracting unit as the additional region, out of the layout unit regions divided by the layout analysis unit. The image processing apparatus according to claim 1.   When the additional image extracted by the additional image extraction unit is an image representing a closed loop, the area specifying unit includes the layout unit region substantially surrounded by the loop represented by the additional image. The image processing apparatus according to claim 4, wherein the image processing apparatus is specified as an additional recording area.   When the additional image extracted by the additional image extraction unit is an image representing a closed loop, the region specifying unit includes the loop represented by the additional image or all of the above-described loops included in the loop. The image processing apparatus according to claim 4, wherein a layout unit area is specified as the additional recording area. A circumscribed rectangle generating unit that generates a circumscribed rectangle circumscribing the additional image extracted by the additional image extracting unit;
The image processing apparatus according to claim 4, wherein the area specifying unit specifies the layout unit area surrounded almost entirely by the circumscribed rectangle as the area to be added. A circumscribed rectangle generating unit that generates a circumscribed rectangle circumscribing the additional image extracted by the additional image extracting unit;
The image processing apparatus according to claim 4, wherein the area specifying unit specifies all the layout unit areas that include the circumscribed rectangle or are included in the circumscribed rectangle as the additional recording area.   The image processing apparatus according to claim 4, wherein the area specifying unit specifies the layout unit area in which almost the entire area of the additional image extracted by the additional image extraction unit exists as the additional recording area.   The image processing apparatus according to claim 4, wherein the area specifying unit specifies all the layout unit areas in which at least a part of the additional image extracted by the additional image extraction unit exists as the additional area.   The area specifying unit specifies a layout unit area adjacent to the layout unit area as the additional recording area in addition to the layout unit area having a predetermined positional relationship with the additional recording image. The image processing apparatus according to item. Character recognition means for performing character recognition on a character string included in the layout unit region;
Natural language analysis means for performing natural language analysis on the recognition result by the character recognition means;
Grouping means for grouping related layout unit areas based on the analysis result by the natural language analysis means,
The area specifying unit specifies a layout unit area that belongs to the same group as the layout unit area by the grouping unit as the additional recording area in addition to the layout unit area having a predetermined positional relationship with the additional image. The image processing apparatus according to claim 5.   The processing means performs extraction processing of the postscript image, deletion or mask processing, replacement processing with another image, character recognition processing, or translation processing for the result of the character recognition on the extracted postscript image. The image processing apparatus according to claim 1, wherein at least one of the processes is performed. Color identifying means for identifying the color of the additional image;
Storage means for storing the color of the additional image and the content of the processing in association with each other,
The processing means performs processing of contents stored in the storage means in association with a color of the additional image having a predetermined positional relationship with the additional image, on the extracted additional image. The image processing apparatus according to 1. Shape identifying means for identifying the shape of the additional image;
Storage means for storing the shape of the additional image and the content of the processing in association with each other,
The processing means performs processing of the content stored in the storage means in association with the shape of the additional image having a predetermined positional relationship with the additional image on the extracted additional image. The image processing apparatus according to 1. On the computer,
A recordable image extraction function for extracting a recordable image specified according to a predetermined condition from an image represented by the input image data;
An area specifying function for specifying an image area having a predetermined positional relationship with the extracted postscript image as a postscript area;
A postscript image extraction function for extracting an image arranged in the specified postscript area as a postscript image;
A program for realizing a processing function for performing a specified process on the extracted postscript image.

Images