JP2017063292A - Image processing apparatus and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To shorten the processing time for discriminating a concealment region, compared with a case where the pixels are counted.SOLUTION: An image processing apparatus (PC) includes rectangular region derivation means (C5) deriving a minimum rectangle (26) surrounding the region of designation marks (6-8), for the designation marks (6-8) designating the specific regions of an image (1) given thereto, discrimination means (C8) for discriminating the region of concealment object specified by the designation marks (6-8), based on the minimum rectangle (26), and concealment means (C9) for concealing the region of a concealment object on the image (1) with a preset concealment image, based on the region of concealment object discriminated by the discrimination means (C8).SELECTED DRAWING: Figure 7

Description

  The present invention relates to an image processing apparatus and a program.

  For concealing characters or pictures on a manuscript, so-called masking, a technique for performing masking by recognizing a designation mark or so-called marker attached by a user to designate a masking area is disclosed in Patent Document 1 below. The described techniques are known.

  In Japanese Patent Laid-Open No. 2013-143594 as Patent Document 1, in order to specify a region to be concealed, a linear mark attached along a character string, a curved frame-shaped mark surrounding a region, and a region are included. A technique is described in which an enclosing polygon frame and a hatched self-other identification mark attached in the polygon frame are detected to conceal a designated area. Patent Document 1 describes a technique for counting pixels when specifying a marker location and specifying an aggregate of images that are continuous for a predetermined length or more as a marker location.

JP 2013-143594 A ("0044" to "0069" (especially "0046", "0051"), FIGS. 6 to 19)

  It is a technical object of the present invention to shorten the processing time for discriminating a concealment region compared to the case of counting pixels.

In order to solve the technical problem, an image processing apparatus according to claim 1 is provided.
Rectangle area deriving means for deriving a minimum rectangle surrounding the area of the designated mark for a designated mark that designates a specific area of the image given to the image;
Discrimination means for discriminating an area designated by the designation mark based on the minimum rectangle;
Image processing means for executing preset image processing on a specified area on the image based on the area determined by the determination means;
It is provided with.

The invention according to claim 2 is the image processing apparatus according to claim 1,
The discrimination means includes
When the inclination of the minimum rectangle with respect to the horizontal is within a preset range and the amount of the designated mark in the square area is smaller than a preset threshold in the square area of the central portion of the rectangle, A diagonal designation discriminating means for discriminating that a region is designated by a diagonal line connecting diagonals of the designated region,
In the image of the internal area surrounded by the designation mark, when there is no estimated text or what is estimated as a figure, the internal area surrounded by the designation mark is specified. A first region designation discriminating means for discriminating:
And after the determination by the diagonal designation determination means, the determination by the first area designation determination means,
It is characterized by that.

The invention according to claim 3 is the image processing apparatus according to claim 1 or 2,
The discrimination means includes
In the image of the internal area surrounded by the designation mark, when there is no estimated text or what is estimated as a figure, the internal area surrounded by the designation mark is specified. A first region designation discriminating means for discriminating:
A line designation for determining that a character string area for one line with the designation mark has been designated when there is an estimated character string for one line in the image of the area with the designation mark Discriminating means,
And after the determination by the first area designation determination means, the determination by the row designation determination means,
It is characterized by that.

A fourth aspect of the present invention is the image processing apparatus according to any one of the first to third aspects,
The discrimination means includes
A line designation for determining that a character string area for one line with the designation mark has been designated when there is an estimated character string for one line in the image of the area with the designation mark Discriminating means,
When the correlation coefficient between the ellipse inscribed in the smallest rectangle including the area of the designated mark and the outer shape of the designated mark is equal to or greater than a preset first threshold, or the correlation coefficient is the first When the correlation coefficient between the outer shape of the designated mark included in the square obtained by combining both ends of the rectangle and the circle inscribed in the square is equal to or greater than a second threshold set in advance. A second region designation discriminating unit for discriminating that the region up to the line end of the character string included in the region enclosed by the designation mark is designated;
And after the determination by the line designation determination means, the determination by the second area designation determination means,
It is characterized by that.

The invention according to claim 5 is the image processing apparatus according to any one of claims 1 to 4,
The discrimination means includes
When the inclination of the minimum rectangle with respect to the horizontal is within a preset range and the amount of the designated mark in the square area is smaller than a preset threshold in the square area of the central portion of the rectangle, A diagonal designation discriminating means for discriminating that a region is designated by a diagonal line connecting diagonals of the designated region,
In the image of the internal area surrounded by the designation mark, when there is no estimated text or what is estimated as a figure, the internal area surrounded by the designation mark is specified. A first region designation discriminating means for discriminating:
A line designation for determining that a character string area for one line with the designation mark has been designated when there is an estimated character string for one line in the image of the area with the designation mark Discriminating means,
When the correlation coefficient between the ellipse inscribed in the smallest rectangle including the area of the designated mark and the outer shape of the designated mark is equal to or greater than a preset first threshold, or the correlation coefficient is the first When the correlation coefficient between the outer shape of the designated mark included in the square obtained by combining both ends of the rectangle and the circle inscribed in the square is equal to or greater than a second threshold set in advance. A second region designation discriminating unit for discriminating that the region up to the line end of the character string included in the region enclosed by the designation mark is designated;
A means for determining an external shape that determines that an area along the external shape of the specified mark has been specified;
And after performing the determination by any one of the determination means of the diagonal specification, the determination means of the first area specification, the determination means of the row specification and the determination means of the second area specification, Discriminate by the discriminating means for specifying the outer shape,
It is characterized by that.

The invention according to claim 6 is the image processing apparatus according to claim 5,
It is determined in the order of the determination means for the diagonal line, the determination means for the first area specification, the determination means for the row designation, the determination means for the second area specification, the determination means for the outer shape specification,
It is characterized by that.

In order to solve the technical problem, the program of the invention according to claim 7 is:
Computer
A rectangular area deriving means for deriving a minimum rectangle surrounding the designated mark area with respect to a designated mark designating a specific area of the image given to the image;
A discriminating means for discriminating an area designated by the designation mark based on the minimum rectangle;
Image processing means for executing preset image processing on a specified area on the image based on the area determined by the determination means;
It is made to function as.

According to the first and seventh aspects of the present invention, the processing time for determining the designated area can be shortened compared to the case of counting pixels.
According to the second aspect of the present invention, compared with the case where the first area designation discriminating means is performed before the determination by the diagonal line designation discriminating means, the designation of the area having the designation mark as the diagonal line is performed. It is possible to prevent erroneous determination that the part itself is designated.
According to the third aspect of the present invention, the character string portion of one line inside the figure is compared with the case where the determination by the line designation determination unit is performed before the determination by the first region designation determination unit. It is possible to prevent erroneous determination as designation of only.

According to the fourth aspect of the present invention, even when both ends of the designation mark are rounded compared to the case where the discrimination by the second area designation discriminating means is performed before the discrimination by the row designation discriminating means. It can be discriminated from the line designation.
According to the fifth aspect of the present invention, the determination is performed by any one of the determination means of the diagonal specification, the determination means of the first area specification, the determination means of the row specification, and the determination means of the second area specification. Thereafter, the deviation from the user's intention can be reduced as compared with the case where the determination by the external shape specifying determination means is not performed.
According to the sixth aspect of the present invention, the determination is made in the order of the diagonal designation determination means, the first area specification determination means, the row specification determination means, the second area specification determination means, and the outer shape specification determination means. The processing time can be shortened as compared with the case where it is not performed.

FIG. 1 is an explanatory diagram of an image processing system according to a first embodiment of the present invention. FIG. 2 is a functional block diagram illustrating the functions provided in the control unit of the client personal computer according to the first embodiment. FIG. 3 is an explanatory diagram of an example of an image to be concealed. FIG. 4 is an explanatory diagram of the character recognition process of the first embodiment, FIG. 4A is an example of an image to which a marker is added, FIG. 4B is an explanatory diagram of a state in which the marker is removed from FIG. 4A, and FIG. FIG. 4D is a diagram showing a state where adaptive binarization processing is performed on the image of 4B, FIG. 4D is a diagram showing a state where it is determined whether or not the figure is based on the length of the long side of the bounding box from the diagram shown in FIG. Fig. 4D is a diagram showing a state in which it is determined whether the object is not a figure in Fig. 4D or not, and Fig. 4F is a state in which it is determined whether the object is a figure or a character in Fig. 4E. It is explanatory drawing of. FIG. 5 is an explanatory diagram of marker separation. FIG. 6 is an explanatory diagram of an XY monotone polygon, FIG. 6A is an explanatory diagram of an example of a graphic before processing into an XY monotone polygon, and FIG. 6B is a graphic after processing the graphic of FIG. 6A into an XY monotone polygon FIG. 6C is an explanatory diagram after processing the marker portion of FIG. 5 into an XY monotone polygon. FIG. 7 is an explanatory diagram of the smallest rectangular area. FIG. 8 is an explanatory diagram of the inclination in the determination of the diagonal line designation, FIG. 8A is an explanatory diagram of the hatched marker, FIG. 8B is an explanatory diagram of the curved diagonal marker, and FIG. 8C is an explanatory diagram of the frame marker. is there. 9A and 9B are explanatory diagrams of horizontal conversion and marker amount determination in the diagonal line designation determination. FIG. 9A is an explanatory diagram for the marker of FIG. 8A, FIG. 9B is an explanatory diagram for the marker of FIG. 8B, and FIG. It is explanatory drawing in the case of the marker of FIG. 8C. 10A and 10B are explanatory diagrams of the masking area when the diagonal line is specified, FIG. 10A is an explanatory diagram of the state of the diagonal line specified by the diagonal line, and FIG. 10B is an explanatory diagram of the masking area set based on the range of the diagonal line of FIG. FIG. 10C is an explanatory diagram of the masking area reset so as to shield partially overlapping characters from the masking area of FIG. 10B. FIG. 11 is an explanatory diagram of the first area designation of the first embodiment, FIG. 11A is an explanatory diagram of an example when no character is present in the area surrounded by the marker, and FIG. 11B is a figure in the area surrounded by the marker. FIG. 11C is an explanatory diagram of an example in the case where characters are present in the area surrounded by the markers but no line is formed. FIG. 12 is an explanatory diagram of a masking area at the time of designating the first area of the first embodiment, FIG. 12A is an explanatory diagram of an example of the masking area at the time of designating the first area, and FIG. It is explanatory drawing of an example in the case of having. FIG. 13 is an explanatory diagram of determination of row designation according to the first embodiment, FIG. 13A is an explanatory diagram when it is determined that the row is specified, and FIG. 13B is an explanatory diagram when it is not determined that the row is specified. FIG. 14 is an explanatory diagram of a masking area when a row is specified in the first embodiment. 15A and 15B are explanatory diagrams of second area designation according to the first embodiment. FIG. 15A is an explanatory diagram of an example of an inclination bounding box surrounding a marker. FIG. 15B is an example of an ellipse inscribed in the inclination bounding box of FIG. 15C is an explanatory diagram of a state in which the tilt bounding box of FIG. 15A is horizontally converted, FIG. 15D is an explanatory diagram of creating a square region from the tilt bounding box of FIG. 15C, and FIG. 15E is a square region created in FIG. FIG. 15F is an explanatory diagram of an inscribed circle of the square area created in FIG. 15D. FIG. 16 is an explanatory diagram of a masking area at the time of designating the second area in the first embodiment, FIG. 16A is an explanatory diagram of an example of a masking area at the time of designating the second area in the horizontally written text portion, and FIG. It is explanatory drawing of an example of the masking area | region at the time of the 2nd area | region designation | designated in a text part. FIG. 17 is an explanatory diagram when both ends of the mark are rounded in the case of line designation, FIG. 17A is an explanatory diagram of the mark, and FIG. 17B is an explanatory diagram of an XY monotone polygon of the silhouette image of the mark of FIG. 17A. . FIG. 18 is an explanatory diagram of an example of the external shape designation of the first embodiment, FIG. 18A is an explanatory diagram when surrounded by markers across a plurality of rows, and FIG. 18B is an explanatory diagram when surrounded by markers in a staircase pattern. FIG. 18C is an explanatory diagram in the case of being surrounded by a marker in a concave shape. FIG. 19 is a flowchart of the masking process of the masking process program according to the first embodiment of the present invention. FIG. 20 is a flowchart of the masking process according to the first embodiment of the present invention, and is a flowchart continued from FIG. FIG. 21 is a flowchart of the masking process according to the first embodiment of the present invention, and is a flowchart continued from FIG.

Next, specific examples of embodiments of the present invention (hereinafter referred to as examples) will be described with reference to the drawings, but the present invention is not limited to the following examples.
In the following description using the drawings, illustrations other than members necessary for the description are omitted as appropriate for easy understanding.

FIG. 1 is an explanatory diagram of an image processing system according to a first embodiment of the present invention.
In FIG. 1, an image processing system S according to the first embodiment includes a client personal computer PC as an example of an image processing apparatus. The client personal computer PC is connected to a multifunction device U as an example of an image forming apparatus via a network N as an example of a communication line. The multifunction device U according to the first exemplary embodiment is a known image forming apparatus that can use the functions of copying, a printer, a FAX, and a scanner.
The network N according to the first embodiment is configured by a so-called Internet line, but is not limited to the Internet line, and may be a LAN: Local Area Network. Further, the communication is not limited to wired communication, and wireless communication is also possible. The client personal computer PC according to the first embodiment includes a computer device as an example of an electronic computer.

  The client personal computer PC according to the first embodiment includes a computer main body H1 as an example of an apparatus main body. A display H2 as an example of a display device is connected to the computer main body H1. In addition, a keyboard H3 and a mouse H4 as examples of input devices are connected to the computer main body H1. The computer main body H1 includes an HD drive as an example of a storage device (not shown), that is, a hard disk drive, a CD drive as an example of a storage medium reading device, that is, a compact disk drive.

The multi-function device U according to the first embodiment includes a printer unit U1 as an example of an image recording unit. Under the printer unit U1, paper feed trays TR1 to TR4 as an example of a medium storage unit are supported. A paper discharge tray TRh as an example of a medium discharge unit is formed on the upper surface of the printer unit U1. The printer unit U1 forms an image on a recording sheet as an example of a medium stored in the paper feed trays TR1 to TR4, and discharges it to the paper discharge tray TRh.
A scanner unit U2 as an example of an image reading unit is disposed above the printer unit U1. A document feeder U3 as an example of a document conveying device is supported on the upper surface of the scanner unit U2. The scanner unit U2 according to the first embodiment reads a document placed on a document table (not shown) on the upper surface of the scanner unit U2 or a document conveyed by the document feeder U3. In the multifunction device U of the first embodiment, the scanner unit U2 is provided with a user interface U0 as an example of an operation unit.
Note that the multifunction device U according to the first embodiment is configured to be able to transmit image information of a document read by the scanner unit U2 to the client personal computer PC via the network N. Since the configuration for transmitting the image information of the document to the client personal computer PC is known in the art, a detailed description thereof will be omitted.

(Description of the control part of Example 1)
FIG. 2 is a functional block diagram illustrating the functions provided in the control unit of the client personal computer according to the first embodiment.
(Explanation of control part of client PC)
In FIG. 2, the computer main body H1 of the client personal computer PC has an I / O, that is, an input / output interface. The input / output interface performs input / output of signals with the outside, adjustment of input / output signal levels, and the like. The computer main body H1 has a ROM, that is, a read only memory. The read-only memory stores a program and data for performing necessary processing. The computer main body H1 has a RAM, that is, a random access memory. The random access memory temporarily stores necessary data. The computer main body H1 has a CPU, that is, Central Processing.
Unit: has a central processing unit. The central processing unit performs processing according to a program stored in a hard disk or the like. The computer main body H1 also has a clock oscillator and the like.

The client personal computer PC can realize various functions by executing a program stored in a hard disk, a ROM, or the like.
An operating system OS as basic software is stored in the hard disk of the client personal computer PC. The operating system OS controls basic operations of the computer device.
A masking processing program AP1 as an example of an application program is stored in the hard disk of the client personal computer PC.
The hard disk of the client personal computer PC stores word processor software as document creation software (not shown), application programs such as e-mail transmission / reception software, and the like.
Hereinafter, each function (control means) of the masking processing program AP1 excluding a conventionally known operating system OS and an application program (not shown) will be described.

(Masking processing program AP1)
The masking processing program AP1 has the following functional means C1 to C9.
FIG. 3 is an explanatory diagram of an example of an image to be concealed.
The marker extraction unit C1 as an example of the designation mark extraction unit extracts a marker attached to the image from characters and diagrams on the image. That is, a marker written with a highlighter pen or the like is extracted from the image. The marker extraction unit C1 according to the first embodiment processes the image read by the scanner unit U2 to extract the marker unit. As an example, in the case where the image 1 shown in FIG. 3 includes the drawing parts 2 and 4, the sentence part 3, and the marker parts 6 to 8 as an example of the designation mark, the marker extracting means C 1 includes the drawing parts 2 and 4. In addition, the marker portion 6 surrounded by a frame, the hatched marker portion 7, and the character-like marker portion 8 are extracted from the gradation difference and color discrimination from the text portion 3.

FIG. 4 is an explanatory diagram of the character recognition process of the first embodiment, FIG. 4A is an example of an image to which a marker is added, FIG. 4B is an explanatory diagram of a state in which the marker is removed from FIG. 4A, and FIG. FIG. 4D is a diagram showing a state where adaptive binarization processing is performed on the image of 4B, FIG. 4D is a diagram showing a state where it is determined whether or not the figure is based on the length of the long side of the bounding box from the diagram shown in FIG. Fig. 4D is a diagram showing a state in which it is determined whether the object is not a figure in Fig. 4D or not, and Fig. 4F is a state in which it is determined whether the object is a figure or a character in Fig. 4E. It is explanatory drawing of.
The character recognition means C2 recognizes characters on the image. In the image 1 shown in FIG. 3, the characters in the text portion 3 and the characters included in the drawing portion 4 are recognized (estimated). In the character recognition means C2 of the first embodiment, as shown in FIGS. 4A and 4B, first, the marker portion 10 extracted by the marker extraction means C1 is removed from the image 1.
Next, in FIGS. 4B and 4C, an adaptive binarization process for making the outline of the character 11 or the figure 12 stand out is executed to make the outlines 11a and 12a stand out.

Next, in FIGS. 4C and 4D, a bounding box 13 as an example of a rectangle surrounding the character 11 and the graphic 12 is formed based on the outlines 11a and 12a. If the length of the long side of the bounding box 13 is equal to or greater than a preset first threshold for character recognition, it is determined (estimated) as a figure area as shown in the lower side of FIG. If the length of the long side of the box 13 is less than a preset first threshold for character recognition, it is determined that the box 13 is not a figure as shown on the upper side of FIG. 4D.
Next, in FIG. 4D and FIG. 4E, in the bounding box 13 that is determined not to be a figure, if there is an overlapping part between the bounding boxes 13, the bounding box 14 that further surrounds the area where the bounding boxes 13 are combined is displayed. create. If the length of the long sides of the bounding boxes 13 and 14 is less than the preset second threshold value for character recognition, dust, dirt, dirt, etc. appear in the lower side of FIG. 4E. If the long side length of the bounding box 13 is equal to or greater than a preset second threshold value for character recognition, it is not dust or the like as shown on the upper side of FIG. 4E. Determine.

Next, in FIG. 4E and FIG. 4F, in the bounding boxes 13 and 14 that are determined not to be dust or the like, a portion where the bounding boxes 13 and 14 overlap each other is an area where the bounding boxes 13 and 14 are combined. Is created. If the length of the long sides of the bounding boxes 13 to 15 is equal to or greater than a preset first threshold value for character recognition, it is determined (estimated) as a figure area as shown on the lower side of FIG. 4F. If the length of the long sides of the bounding boxes 13 to 15 is less than a preset first threshold value for character recognition, it is determined as a character as shown in the upper side of FIG. 4F.
The marker extracting unit C1 and the character recognizing unit C2 are not limited to the above-described configuration, and a conventionally known OCR: optical character reader or optical character reading technology can also be adopted.

FIG. 5 is an explanatory diagram of marker separation.
The marker separation unit C3 as an example of the designated mark separation unit separates the marker units 6 to 8 individually based on the images of only the marker units 6 to 8 obtained by the marker extraction unit C1. In FIG. 5, the marker separation means C3 of the first embodiment uses each contour extraction based on the marker silhouette image 20 shown in FIG. 5 obtained by inverting the image of only the marker portions 6 to 8 obtained by marker division. Separated into marker parts 6-8 alone.

FIG. 6 is an explanatory diagram of an XY monotone polygon, FIG. 6A is an explanatory diagram of an example of a graphic before processing into an XY monotone polygon, and FIG. 6B is a graphic after processing the graphic of FIG. 6A into an XY monotone polygon FIG. 6C is an explanatory diagram after processing the marker portion of FIG. 5 into an XY monotone polygon.
An XY monotone polygon processing means C4 as an example of an outer envelope polygon processing means is different from the marker parts 6-8 separated by the marker separation means C3 in the outer shape of the marker parts 6-8. An XY monotonous polygon as an example of an outer envelope polygon in which a depression is filled is performed. In FIG. 6, in the XY monotone polygon processing means C4, as an example, when the outer shape of the marker portion 21 is as shown in FIG. 6A, the marker portion 21 is scanned in the X-axis direction and the Y-axis direction, respectively. Then, the depressions 21a and 21b are detected. Then, a figure in which the recesses 21a and 21b are filled with frame lines 22a and 22b along the X-axis direction or the Y-axis direction is output as an XY monotone polygon 22. Therefore, when the marker portions 6 to 8 separated in FIG. 5 are processed into the XY monotone polygon, as shown in FIG. 6C, the XY monotone polygons 6 ′ to 8 ′ from which the recessed portions are removed are obtained. .

FIG. 7 is an explanatory diagram of the smallest rectangular area.
The rectangular area deriving means C5 derives the minimum rectangle 26 surrounding the area of the marker parts 6 to 8 for the marker parts 6 to 8 that designate a specific area of the image 1 given to the image 1. . The rectangular area deriving means C5 according to the first embodiment derives an inclination bounding box 26 as an example of a minimum rectangular area surrounding the XY monotone polygons 6 'to 8' processed by the XY monotone polygon processing means C4. . Accordingly, the rectangular area deriving means C5 is, for example, a rectangle inscribed by the XY monotone polygons 6 'to 8': When the bounding box 26 is rotated with respect to the X axis, the bounding box C5 is bound each time the angle with respect to the X axis changes. The size of box 26 changes. Then, the smallest bounding box 26 is derived from those bounding boxes 26 having the smallest area. In addition, regarding the name of the tilt bounding box, the derived tilt bounding box 26 is mostly tilted with respect to the X axis, but as a result of deriving, the tilt bounding box 26 may not be tilted with respect to the X axis. Shall be included.

The character / figure extraction means C6 recognizes (estimates) characters and figures included inside the tilt bounding box 26 based on the image 1 and the tilt bounding box 26 derived from the marker units 6-8. Extract things.
The line identifying unit C7 determines whether or not the character extracted by the character / graphic extracting unit C6 forms a “line”. As an example, it is determined whether or not a line is formed by determining whether or not a plurality of characters are arranged on a line at a predetermined interval or less. As an example, when the graphic part 4 in FIG. 3 is surrounded by a marker, characters arranged in a discrete manner such as characters included in the drawing part 4 are not determined as “lines”. That is, a character is recognized as a line when it is arranged on a line at an interval (for example, 2 cm or less) that is normally used in a word or phrase.

  The discriminating means C8 includes a diagonal designation discriminating means C81, a first area designation discriminating means C82, a line designation discriminating means C83 as an example of a row designation discriminating means, and a second area designation discriminating means. As an example, a track designation discriminating means C84 and a polygon designation discriminating means C85 as an example of an outline designation discriminating means are used, and based on the tilt bounding box 26, the area to be concealed designated by the marker is displayed. An example masking region is determined.

  The diagonal line designation discriminating means C81 is an example of the amount of the marker in the square area 27 in the square area 27 in the central area of the inclination bounding box 26 in which the inclination θ1 with respect to the horizontal of the inclination bounding box 26 is within a preset range θa. When the marker thickness R1 is smaller than the preset threshold Ra, it is determined that the masking area is designated by a diagonal line connecting the diagonals of the masking area in the image 1. The diagonal line designation discriminating means C81 of the first embodiment includes an inclination calculating means C81a, an inclination threshold storage means C81b, an inclination discrimination means C81c, a horizontal conversion means C81d, a marker thickness detection means C81e, and a thickness threshold storage means. C81f, marker thickness determining means C81g, and masking area setting means C81h for designating a diagonal line.

FIG. 8 is an explanatory diagram of the inclination in the determination of the diagonal line designation, FIG. 8A is an explanatory diagram of the hatched marker, FIG. 8B is an explanatory diagram of the curved diagonal marker, and FIG. 8C is an explanatory diagram of the frame marker. is there.
The inclination calculation means C81a calculates the inclination θ1 of the inclination bounding box 26 with respect to the horizontal. 8A to 8C, in the first embodiment, the angle between the frame line of the tilt bounding box 26 and the horizontal line is calculated from 0 ° to 90 ° as the tilt θ1.
The inclination threshold value storage unit C81b stores an inclination threshold value θa as an example of a preset threshold value of the inclination θ1 for determining the diagonal line designation. In the first embodiment, as an example, the range determined as the diagonal designation is set to 10 ° to 80 °. That is, it is set to 45 ° ± 35 °, and 35 ° is stored as the inclination threshold θa.

  The inclination determination unit C81c determines whether the inclination θ1 of the inclination bounding box 26 is within a preset range. In the first embodiment, whether or not | θ1−45 ° | ≦ θa is determined to determine whether or not it is within a range of 10 ° to 80 °. If the slope θ1 is too small, the mark given along the horizontal text line may be erroneously determined as a diagonal line. If the slope θ1 is too large, the mark is given along the vertical text line. There is a risk of misjudging marks as diagonal lines. Therefore, in the first embodiment, the range of θ1 is set to 10 ° to 80 ° as an example in order to determine that it is a “slanting” line for indicating the intention of the user to mask.

9A and 9B are explanatory diagrams of horizontal conversion and marker amount determination in the diagonal line designation determination. FIG. 9A is an explanatory diagram for the marker of FIG. 8A, FIG. 9B is an explanatory diagram for the marker of FIG. 8B, and FIG. It is explanatory drawing in the case of the marker of FIG. 8C.
The horizontal conversion unit C81d converts the tilt bounding box 26 into a horizontal state with respect to the tilt bounding box 26 in which the tilt θ1 is determined to be within the range of the threshold θa in the tilt determination unit C81c. The horizontal conversion unit C81d according to the first embodiment rotates the tilt bounding box 26 by an angle of −θ1, as shown in FIG. 9, based on the tilt θ1 calculated by the tilt calculation unit C81a.

  The marker thickness detection means C81e detects the thickness R1 of the marker 28 in the square area 27 in the center portion of the tilt bounding box 26 converted into the horizontal. In FIG. 9, the marker thickness detection means C81e of the first embodiment first calculates the longitudinal center 27a from the longitudinal length L0 of the tilt bounding box 26. Then, the length L1 of the tilt bounding box 26 in the short direction is calculated. And the range L2 of the length L1 centering on the center 27a is calculated. Therefore, the square area 27 surrounded by the range L2 in the longitudinal direction and the length L1 in the short direction is calculated. Then, the maximum length in the short direction of the marker 28 in the square region 27 is calculated as the thickness R1. When the end of the tilt bounding box 26 is used, even in the case of the marker 28 surrounded by the frame shape shown in FIGS. 8C and 9C, the corner portion has a small thickness, as shown in FIGS. 9A and 9B. May be indistinguishable from the case of slashes. Therefore, in the first embodiment, the thickness R1 of the marker 28 is determined using the central square region 27 in the longitudinal direction.

The thickness threshold value storage unit C81f stores a thickness threshold value Ra as an example of a preset threshold value for determining the amount of the marker 28. In the first embodiment, the thickness threshold Ra has a margin of 6 mm, which is a general marker thickness, in order to determine that the marker 28 is not a frame-shaped region but a diagonal “line”. Ra is set to 1 cm.
The marker thickness determining means C81g determines whether or not the marker thickness R1 detected by the marker thickness detecting means C81e is equal to or smaller than the thickness threshold Ra. Therefore, the marker thickness determining means C81g of Example 1 determines that the marker 28 shown in FIGS. 9A and 9B corresponds to a diagonal designation marker, but the marker 28 shown in FIG. 9C corresponds to a diagonal designation marker. It is determined not to. Accordingly, the diagonal line designation discriminating means C81 of the first embodiment uses the diagonal designation marker C81c when the slope θ1 is within the range of the threshold θa and the marker thickness R1 is equal to or smaller than the thickness threshold Ra. It is determined that

10A and 10B are explanatory diagrams of the masking area when the diagonal line is specified, FIG. 10A is an explanatory diagram of the state of the diagonal line specified by the diagonal line, and FIG. 10B is an explanatory diagram of the masking area set based on the range of the diagonal line of FIG. FIG. 10C is an explanatory diagram of the masking area reset so as to shield partially overlapping characters from the masking area of FIG. 10B.
The masking area setting means C81h at the time of diagonal designation as an example of the means for setting the area to be shielded at the time of specifying the diagonal line has a detecting means C81h1 for partially overlapping characters, and sets the area of the shielding target designated by the diagonal line. As shown in FIGS. 10A and 10B, the masking area setting means C81h at the time of specifying the diagonal line of the first embodiment uses a rectangular area diagonally opposite to both ends of the diagonal-designated marker 28 as an example of the area to be shielded. The masking area 29 is set. When the partially overlapping character detection means C81h1 detects that the characters partially overlap in the set masking area 29, as shown in FIG. The masking area 29 is enlarged and reset to the adjusted masking area 29 '.

  Specifically, in FIG. 10B, at the upper end and the lower end of the masking area 29, a part of the character overlaps with the masking area 29 and expands upward and downward until it does not overlap. That is, when the character protrudes from the masking region 29, the masking region 29 is adjusted so as not to protrude. In FIG. 10B, at the left end of the masking region 29, when a plurality of characters partially overlap but expand to the left, the characters are expanded until a character that does not overlap first occurs. As an example, in FIG. 10B, since “well”, “picking”, and “of” do not overlap at the same time, the masking region 29 is expanded to that position. Also, at the right end of the masking area 29, as in the case of the left end, as an example, in FIG. 10B, “for” and “the” do not overlap at the same time, so the masking area 29 is expanded to that position. In the first embodiment, the masking region 29 'is not further enlarged even if a partially overlapping character is generated after being enlarged once. This is because if the masking area 29 ′ is continuously enlarged until no overlapping characters are generated, the masking area 29 ′ may become too large with respect to the range specified by the original marker 28. This is because an area not specified may be masked.

FIG. 11 is an explanatory diagram of the first area designation of the first embodiment, FIG. 11A is an explanatory diagram of an example when no character is present in the area surrounded by the marker, and FIG. 11B is a figure in the area surrounded by the marker. FIG. 11C is an explanatory diagram of an example in the case where characters are present in the area surrounded by the markers but no line is formed.
The first region designation discriminating means C82 uses the marker 31 when the image of the inner region surrounded by the marker 31 does not include what is estimated as a sentence or when there is what is estimated as a figure. It is determined that the enclosed inner area is designated as a masking area. The first area designation discriminating means C82 of the first embodiment includes a character presence / absence discriminating means C82a, a character string discriminating means C82b, a figure discriminating means C82c, and a masking area setting means C82d when the first area is designated. And have. It should be noted that the first region designation discriminating means C82 of the first embodiment performs discrimination on the object determined by the diagonal line designation discriminating means C81 as not being diagonally designated.

  The character presence / absence determining means C82a determines whether or not there is a character in the area surrounded by the markers 31. The character presence / absence discriminating means C82a according to the first embodiment discriminates whether or not a character exists in the area surrounded by the marker 31 based on the extraction result of the character / graphic extraction means C6. As an example, when a region where no character exists is surrounded by a marker 31 as shown in FIG. 11A, it is determined that there is no character, and as shown in FIG. If it is enclosed, it is determined that no character exists. As shown in FIG. 11B, when the drawing unit 2 is surrounded by the markers 31, it is determined that there is no character because there is nothing recognized as a character.

The character string discriminating means C82b discriminates whether or not the character is a character string, that is, a line when the character is present in the area surrounded by the marker 31. The character string discriminating means C82b according to the first embodiment discriminates whether or not the characters in the region surrounded by the marker 31 form a line based on the identification result obtained by the line identifying means C7. As an example, in the case shown in FIG. 11C, the character 4a exists, but is not arranged in a form that is recognized as a line, but is arranged discretely, and therefore, it is determined that no line is formed.
The figure discriminating means C82c discriminates whether or not a figure exists in the area surrounded by the markers 31. The graphic discrimination means C82c according to the first embodiment determines whether or not a graphic exists in the region surrounded by the markers 31 based on the extraction result of the character / graphic extraction means C6. As an example, as illustrated in FIG. 11B, when the drawing unit 2 is surrounded by the marker 31, it is determined that there is a graphic because there is an object recognized as the graphic 2 a. In the case of FIGS. 11A and 11C, it is determined that there is no figure.

  Accordingly, when the first region designation determining unit C82 of the first embodiment determines that there is no text estimated by the character presence / absence determining unit C82a in the image of the inner region surrounded by the marker 31. Alternatively, if the figure discriminating means C82c discriminates that an estimated figure exists, it is discriminated that the internal area surrounded by the marker 31 is designated as the masking area 32. Note that the first region designation discriminating means C82 of the first embodiment does not form a line even if a character exists, that is, when a character included in a graphic is recognized, or when a character is included as a graphic. If it is arranged, it is determined that the internal area surrounded by the marker 31 is designated as the masking area 32. In other words, the first area designation discriminating means C82 discriminates whether or not the figure and the area corresponding to the figure are designated by the marker 31.

FIG. 12 is an explanatory diagram of a masking area at the time of designating the first area of the first embodiment, FIG. 12A is an explanatory diagram of an example of the masking area at the time of designating the first area, and FIG. It is explanatory drawing of an example in the case of having.
The masking area setting means C82d at the time of specifying the first area sets the masking area 32 when it is determined that the area is specified by the first area specification determining means C82. In FIG. 12A, the masking area setting unit C 82 d at the time of designating the first area in Example 1 sets an XY monotone polygon area based on the area surrounded by the marker 31 as the masking area 32.

  In the first embodiment, after the determination by the diagonal designation determination unit C81 is performed, the determination by the first region designation determination unit C82 is performed. That is, the first region designation discriminating means C82 discriminates the marker that has been discriminated that is not the diagonal line designation. If the first area designation discriminating means C82 is discriminated before the diagonal line designation discriminating means C81 is discriminated, the marker 31 'as shown in FIG. 12B uses the first area designation discriminating means. According to the determination by C82, only the portion of the marker 31 'is masked, that is, only the portion of the marker 31' is masked, not the square region having the marker 31 'as a diagonal line. Therefore, in the first embodiment in which the determination by the first area specification determination means C82 is performed after the determination by the diagonal line specification determination means C81 is performed, the diagonal line specification is erroneously determined as the filling of the portion of the marker 31 '. Is prevented.

FIG. 13 is an explanatory diagram of determination of row designation according to the first embodiment, FIG. 13A is an explanatory diagram when it is determined that the row is specified, and FIG. 13B is an explanatory diagram when it is not determined that the row is specified.
The line designation discriminating means C83, which is an example of the line designation discriminating means, is used when the image in the area where the marker 36 is present is estimated to be the character string 3a for one line. It is determined that the area of the character string 3 a for one line is designated as the masking area 37. The line designation discriminating means C83 according to the first embodiment includes a row number discriminating means C83a and a masking area setting means C83b at the time of line designation. The line designation discriminating means C83 according to the first embodiment is determined by the diagonal designation discriminating means C81 that is not a diagonal designation, and the first area designation discriminating means C82 is determined not to designate a figure. Discriminate as a target.

  The line number determining means C83a determines the number of lines of the character string in the image included in the area to which the marker 36 is attached. The line number determination unit C83a according to the first embodiment determines whether or not the number of lines in the character string is one line from the identification result obtained by the line identification unit C7. Therefore, the line designation determining unit C83 according to the first embodiment determines that the line is specified when the line number determining unit C83a determines that the character string is one line. Therefore, when the marker 36 is attached to one line as shown in FIG. 13A, it is determined that the line is designated. However, when the marker 36 'is attached to two lines as shown in FIG. 13B, the line is designated. Is not determined. In the case of FIG. 13B, it is finally determined that the polygon is specified later.

FIG. 14 is an explanatory diagram of a masking area when a row is specified in the first embodiment.
The masking area setting means C83b at the time of line designation has a partial overlapping character detection means C83b1, and sets the masking area 37 when the line is designated. The masking area setting means C83b at the time of line designation in the first embodiment sets the area of the tilt bounding box 26 of the marker 36 determined to be line designated as the masking area 37. When the partially overlapping character detection means C83b1 detects that the characters are partially overlapped in the set masking area 37, as shown in FIG. The masking area 37 is enlarged, and in the case of vertical writing, the masking area 37 is enlarged in the horizontal direction and reset to the adjusted masking area 37 '.

  Specifically, in FIG. 14, when a part of the character overlaps the masking region 37, that is, when the character protrudes from the masking region 37, the character expands upward and downward until it does not overlap. Note that horizontal writing and vertical writing have already been discriminated by the line identification means C7. Further, in the first embodiment, when the masking area 37 is expanded in the horizontal direction in the case of horizontal writing, there is a possibility that an area not specified by the user may be masked.

  In the first embodiment, after the determination by the first region specifying determining unit C82 is performed, the determination by the line specifying determining unit C83 is performed. If the determination by the line specification determination unit C83 is performed before the determination by the first region specification determination unit C82, it is determined that the line is specified when one line of character string exists in the figure. There is a possibility that only the portion of the internal character string is masked. Therefore, in the first embodiment in which the determination by the line specification determination unit C83 is performed after the determination by the first region specification determination unit C82, it is reduced that only the character string portion inside the figure is masked. Is done.

  15A and 15B are explanatory diagrams of second area designation according to the first embodiment. FIG. 15A is an explanatory diagram of an example of an inclination bounding box surrounding a marker. FIG. 15B is an example of an ellipse inscribed in the inclination bounding box of FIG. 15C is an explanatory diagram of a state in which the tilt bounding box of FIG. 15A is horizontally converted, FIG. 15D is an explanatory diagram of creating a square region from the tilt bounding box of FIG. 15C, and FIG. 15E is a square region created in FIG. FIG. 15F is an explanatory diagram of an inscribed circle of the square area created in FIG. 15D.

  The track designation discriminating means C84 as an example of the second area designation discriminating means has a correlation coefficient K1 between the ellipse 42 inscribed in the tilt bounding box 26 including the marker 41 area and the outer shape 41 'of the marker 41. When the correlation coefficient K1 is less than the first correlation threshold value Ka and the both end portions 43 of the slope bounding box 26 are combined when the correlation threshold value K1 is equal to or higher than the first correlation threshold value Ka as an example of the first threshold value set in advance. When the correlation coefficient K2 between the outer shape 46 of the marker 41 included in the square 44 and the circle 47 inscribed in the square 44 is greater than or equal to a second correlation threshold Kb set in advance, the region surrounded by the marker 41 It is determined that the area up to the line end of the included character string is designated as the masking area 48. The track designation discriminating means C84 of the first embodiment includes an inscribed ellipse calculating means C84a, a first correlation coefficient calculating means C84b, a first correlation threshold storage means C84c, and a first correlation discriminating means C84d. The square area creating means C84e, the inscribed circle calculating means C84f, the combined figure creating means C84g, the second correlation coefficient calculating means C84h, the second correlation threshold value storing means C84i, and the second Correlation determining means C84j and masking area setting means C84k at the time of track designation are provided.

The inscribed ellipse calculating means C84a calculates the inscribed ellipse 42 that is inscribed in the tilt bounding box 26. 15B, in the first embodiment, the inscribed ellipse 42 is derived based on the size of the tilt bounding box 26 derived by the rectangular area deriving unit C5.
The first correlation coefficient calculation unit C84b calculates a first correlation coefficient K1 as an example of a correlation between the outer shape of the marker 41 and the inscribed ellipse 42 of the tilt bounding box 26.
The first correlation threshold value storage unit C84c stores a first correlation threshold value Ka as an example of a threshold value for determining whether or not the outer shape of the marker 41 is close to an ellipse forming a region. As an example, the first correlation threshold Ka of the first embodiment is set to 0.7.

The first correlation determination unit C84d determines whether or not the first correlation coefficient K1 is greater than or equal to the first correlation threshold Ka.
The square area creating means C84e creates a square area 44 in which both end portions 43 of the tilt bounding box 26 are joined. When the first correlation coefficient K1 is less than the first correlation threshold Ka, the square area creating means C84e according to the first embodiment, as shown in FIG. 15D, determines the length of the tilt bounding box 26 in the short direction. A square region 44 is created by connecting both end portions 43 in the range of L1 / 2 from both ends to L1.
The inscribed circle calculation means C84f calculates a circle 47 that is inscribed in the square area 44, as shown in FIG. 15F, based on the square area 44 created by the square area creation means C84e.

The combined figure creating means C84g creates the outer shape 46 of the marker 41 included in the square area 44. The combined figure creating means C84g according to the first embodiment combines the outlines of the markers 41 included in the areas of the both end portions 43 to create the outline shape 46 in the square area 44.
The second correlation coefficient calculating means C84h has a correlation between the outer shape 46 in the square area 44 created by the combined figure creating means C84g and the inscribed circle 47 created by the inscribed circle calculating means 84f. As an example, a second correlation coefficient K2 is calculated.
The second correlation threshold value storage unit C84i stores a second correlation threshold value Kb as an example of a threshold value for determining whether or not the outer shape 46 in the square region 44 is close to a circle. As an example, the second correlation threshold Kb in the first embodiment is set to 0.7. The first correlation threshold value Ka and the second correlation threshold value Kb are set to the same value in the first embodiment, but may be different values.

The second correlation determination unit C84j determines whether or not the second correlation coefficient K2 is greater than or equal to the second correlation threshold Kb.
Therefore, the track designation discriminating means C84 of the first embodiment determines that the first correlation discriminating means C84d determines that the first correlation coefficient K1 is greater than or equal to the first correlation threshold Ka, or the first When the correlation coefficient K1 is less than the first correlation threshold Ka and the second correlation determination unit C84j determines that the second correlation coefficient K2 is greater than or equal to the second correlation threshold Kb, the marker is surrounded by the outer shape 41 of the marker. It is determined that the specified area has been specified. In addition, if the range in which the user marks is elongated, the straight line portion of the track-shaped marker 41 becomes longer and the correlation coefficient K1 with the ellipse 42 may become smaller. Therefore, in the first embodiment, the first phase Even if the relationship number K1 is less than the first correlation threshold Ka, it is determined whether or not the track designation is made based on the square area 44 in which both end portions 43 are joined.

FIG. 16 is an explanatory diagram of a masking area at the time of designating the second area in the first embodiment, FIG. 16A is an explanatory diagram of an example of a masking area at the time of designating the second area in the horizontally written text portion, and FIG. It is explanatory drawing of an example of the masking area | region at the time of the 2nd area | region designation | designated in a text part.
The masking area setting means C84k at the time of track designation as an example of the means for setting the shielding target area at the time of specifying the second area has a line end extraction means C84k1, and the area is designated by the track designation determination means C84. If it is determined, a masking area 48 is set. In FIG. 16A, the masking area setting means C84k at the time of track designation in the first embodiment sets the XY monotone polygon area 41 based on the area surrounded by the markers as the masking area 48. Then, the line end extraction means C84k1 extracts the end of the character string in the set masking area 48, and if the masking area 48 is not set to the end of the character string, that is, the end of the line, the line end is extracted. The masking area 48 is enlarged and reset to the adjusted masking area 48.

  Specifically, in FIG. 16A, in the case of horizontal writing part 3, the masking area 48 is expanded to the end of the horizontal line, and in the case of vertical writing part 3, as shown in FIG. The masking area 48 is expanded to the end of the line. Note that vertical writing and horizontal writing have already been discriminated by the line identifying means C7. In the masking area setting means C84k at the time of track designation in the first embodiment, the masking area 48 can be enlarged only up to 1.5 times the masking area 48 set based on the outer shape 41 of the marker. It is set not to be enlarged. This is because if the masking area 48 is enlarged indefinitely, the masking area 48 may be too large with respect to the area 41 specified by the original marker, and an area not specified by the user can be masked. It is because there is sex.

FIG. 17 is an explanatory diagram when both ends of the mark are rounded in the case of line designation, FIG. 17A is an explanatory diagram of the mark, and FIG. 17B is an explanatory diagram of an XY monotone polygon of the silhouette image of the mark of FIG. 17A. .
In the first embodiment, the determination by the track designation determination unit C84 is performed after the determination by the line designation determination unit C83. If the track designation discriminating means C84 is discriminated before the line designation discriminating means C83 is discriminated, if the line designation marker 36 as shown in FIG. If it judges with the area | region 44, the correlation coefficient K2 with the inscribed circle 47 may become more than 2nd correlation threshold value Kb. Therefore, there is a possibility that the line designation is erroneously determined as the track designation. On the other hand, in the first embodiment in which the discrimination by the track designation discriminating means C84 is carried out after the discrimination by the line designation discriminating means C83, when both ends of the marker 36 are rounded, it is erroneously judged as the track designation. Is prevented.

FIG. 18 is an explanatory diagram of an example of the external shape designation of the first embodiment, FIG. 18A is an explanatory diagram when surrounded by markers across a plurality of rows, and FIG. 18B is an explanatory diagram when surrounded by markers in a staircase pattern. FIG. 18C is an explanatory diagram in the case of being surrounded by a marker in a concave shape.
The polygon designation discriminating means C85 as an example of the outer shape designation discriminating means discriminates that the area 51 along the outer shape of the marker is designated as the masking area 52. The polygon designation discriminating means C85 of the first embodiment has a masking area setting means C85a at the time of polygon designation. Note that the polygon designation determination unit C85 according to the first exemplary embodiment is an example of the external shape specification when each of the determination units C81 to C84 does not correspond to any of the diagonal designation, the first area designation, the line designation, and the track designation. It is determined that a polygon is designated as. That is, there are various shapes that the user designates with marks, and all shapes cannot be handled. Therefore, in the first embodiment, the area 51 of the outer shape of the marker is used as the masking area 52 when it does not conform to any of the four marker shapes in each of the discriminating means C81 to C84. Therefore, even if what is leaked by each of the discriminating means C81 to C84 is allowed as a large number, there is little deviation from the user's intention.

The masking area setting means C85a at the time of designating the polygon sets the area 51 along the outer shape of the marker as the masking area 52 when the polygon is designated. In the first embodiment, an XY monotone polygon region 51 derived based on the outer shape of the marker is set as the masking region 52. Therefore, in the stepped portion of FIG. 18B and the recessed portion of FIG. 18C, the region 51 filled when the XY monotone polygon processing is performed becomes the masking region 52.
A masking image creation means C9, which is an example of an image processing means, and is an example of a shielding means, a masking area on the image 1 is preliminarily concealed based on the masking areas determined by the determination means C81 to C85. The masking image as an example of the image is concealed. The masking image creating means C9 of the first embodiment uses the masking areas 29, 29 ', 32, 37, 37', 48, 52 set by the masking area setting means C81h, C82d, C83b, C84k, C85a as masking images. As an example, an image shielded by a filled image is created. Specifically, an image in which a filled image is arranged in a masking region and stacked on the original image 1 is created as an image after masking.

(Description of Flowchart of Example 1)
Next, the flow of processing of the masking processing program AP1 of the client personal computer PC according to the first embodiment will be described using a flowchart.
(Description of Flowchart of Masking Processing Program AP1 of Embodiment 1)
FIG. 19 is a flowchart of the masking process of the masking process program according to the first embodiment of the present invention.
FIG. 20 is a flowchart of the masking process according to the first embodiment of the present invention, and is a flowchart continued from FIG.
FIG. 21 is a flowchart of the masking process according to the first embodiment of the present invention, and is a flowchart continued from FIG.
The processing of each ST (step) in the flowcharts of FIGS. 19 to 21 is performed according to a program stored in the ROM or the like of the control unit. This process is executed in a multitasking manner in parallel with other various processes of the control unit.

The flowcharts shown in FIGS. 19 to 21 are started when a masking processing program is executed in the client personal computer PC.
In ST1 of FIG. 19, marker division processing and character recognition processing are executed, and the process proceeds to ST2.
In ST2, the marker portions 6 to 8 are separated from the marker silhouette image 20 into a single unit. Then, the process proceeds to ST3.
In ST3, each marker is converted into an XY monotone polygon. Then, the process proceeds to ST4.
In ST4, an inclination bounding box 26 is derived for each marker. Then, the process proceeds to ST5.
In ST5, the following processes (1) and (2) are executed, and the process proceeds to ST6.
(1) Characters and graphics included in each tilt bounding box 26 are extracted.
(2) Identify whether the character extracted in (1) forms a line.

In ST6, the inclination θ1 of the inclination bounding box 26 is calculated. Then, the process proceeds to ST7.
In ST7, it is determined whether or not | θ1-45 ° | ≦ θa. If yes (Y), the process proceeds to ST8, and, if no (N), the process proceeds to ST15 in FIG.
In ST8, the tilt bounding box 26 is rotated by -θ1 and converted to horizontal. Then, the process proceeds to ST9.
In ST9, the thickness R1 of the marker 28 included in the square area 27 at the center of the tilt bounding box 26 is detected. Then, the process proceeds to ST10.
In ST10, it is determined whether or not the thickness R1 of the marker 28 is equal to or larger than the thickness threshold Ra. If yes (Y), the process proceeds to ST11. If no (N), the process proceeds to ST15 in FIG.

In ST11, the target marker 28 is determined as a diagonal designation marker. Then, the process proceeds to ST12.
In ST12, a rectangular area having the marker 28 as a diagonal line is set as a masking area 29. Then, the process proceeds to ST13.
In ST13, it is determined whether or not there is a partially overlapping character in the masking area 29. If yes (Y), the process proceeds to ST14. If no (N), the process proceeds to ST30 in FIG.
In ST14, the masking area 29 is enlarged until no more characters are applied, and is reset to the enlarged masking area 29 '. Then, the process proceeds to ST30 in FIG.

In ST15 of FIG. 20, it is determined whether or not a character exists inside the marker 31. If yes (Y), the process proceeds to ST16, and, if no (N), the process proceeds to ST18.
In ST16, it is determined whether or not the character forms a line. If yes (Y), the process proceeds to ST17. If no (N), the process proceeds to ST18.
In ST17, it is determined whether or not a graphic exists inside the marker 31. If yes (Y), the process proceeds to ST18, and, if no (N), the process proceeds to ST19.
In ST18, a masking region 32 is set based on the XY monotone polygon of the marker 31. Then, the process proceeds to ST30 in FIG.

In ST19, it is determined whether or not the character string included in the marker 36 is one line. If yes (Y), the process proceeds to ST20. If no (N), the process proceeds to ST23 in FIG.
In ST20, the area of the marker 36 is set as the masking area 37. Then, the process proceeds to ST21.
In ST21, it is determined whether or not there is a partially overlapping character in the masking area 37. If yes (Y), the process proceeds to ST22. If no (N), the process proceeds to ST30 in FIG.
In ST22, in accordance with horizontal writing or vertical writing, the masking area 37 is enlarged until no character string is applied in the vertical direction or the horizontal direction, and is reset to the enlarged masking area 37 ′. Then, the process proceeds to ST30 in FIG.

In ST23 of FIG. 21, an ellipse 42 inscribed in the tilt bounding box 26 is calculated. Then, the process proceeds to ST24.
In ST24, a first correlation coefficient K1 that is a correlation between the outer shape 41 of the XY monotone polygon of the marker and the ellipse 42 is calculated. Then, the process proceeds to ST25.
In ST25, it is determined whether or not the first correlation coefficient K1 is greater than or equal to the first correlation threshold Ka. If no (N), the process proceeds to ST26, and if yes (Y), the process proceeds to ST28.

In ST26, a second correlation coefficient that is a correlation between the XY monotone polygon figure 46 included in the square region 44 joined by cutting both ends 43 of the tilt bounding box 26 and the inscribed circle 47 of the square region K2 is calculated. Then, the process proceeds to ST27.
In ST27, it is determined whether or not the second correlation coefficient K2 is greater than or equal to the second correlation threshold Kb. If yes (Y), the process proceeds to ST28, and, if no (N), the process proceeds to ST29.
In ST28, the line end of the character string included in the range of the marker 41 is extracted, and the area up to the line end is set as the masking area 48. Then, the process proceeds to ST30.
In ST29, the XY monotone polygon area 51 calculated from the marker is set as the masking area 52. Then, the process proceeds to ST30.
In ST30, the masking areas 29, 29 ', 32, 37, 37', 48, and 52 set in the respective processes ST12, ST14, ST18, ST20, ST22, ST28, and ST29 are set as masking images and are superimposed on the original image 1. A masked image is output. Then, the masking process ends.

(Operation of Example 1)
(Function of masking program AP1)
In the image processing system S according to the first embodiment having the above-described configuration, after the XY monotone polygon processing is performed on the marker portions 6 to 8 attached by the user in the image 1, the inclination is changed. A bounding box 26 is derived.
In the prior art described in Patent Document 1, when recognizing the size and shape of the marker, all the pixels of the marker image are counted to obtain the size and shape of the marker portion. Therefore, the technique described in Patent Document 1 has a problem in that the processing related to the marker is not possible unless the pixels are counted, and the counting takes time. In particular, when the marked area is wide, or when the marker is thick or filled, there is a problem that the time until the end of counting becomes long.

On the other hand, in the first embodiment, when the size and shape of the marker are acquired, only the tilt bounding box 26 circumscribing the marker portions 6 to 8 is derived. Therefore, the tilt bounding box 26 can be derived only from the outer shape of the marker portions 6 to 8, and the processing time is shortened compared to the case of counting the entire pixels of the marker portions 6 to 8.
In the first embodiment, on the basis of the tilt bounding box 26, the marker includes diagonal area designation, first area designation (graphic designation), line area designation, track shape area designation, polygon shape, and the like. It is determined whether the area is designated.

In the case of designating a region with a diagonal line, the hatched marker 28 attached by the user is determined, and masking with the marker 28 as a diagonal line is performed. In the first area designation, the enclosed area, mainly the figure area, is masked in accordance with the marker 31 attached so as to surround the figure. In the case of specifying a line-shaped region, one character string is masked according to the marker 36 attached by the user. Furthermore, in the track-shaped area designation, even if the designation is roughly surrounded by the marker 41, the area to the end of the line is masked. In other cases, it is determined that the polygonal area is designated, and masking is performed according to the outer shape 51 of the marker.
Therefore, in the masking processing program AP1 of the first embodiment, the masking processing corresponding to the shape of the marker is performed according to the markers 28, 31, 36, 41, 51 attached by the user.

As described above, in the first embodiment, after the determination by the diagonal designation determination unit C81 is performed, the determination by the first region designation determination unit C82 is performed. Accordingly, it is possible to prevent a diagonal designation such as the marker 31 ′ shown in FIG. 12B from being erroneously determined as filling the marker 31 ′.
Further, in the first embodiment, after the determination by the first region designation determination unit C82 is performed, the determination by the line designation determination unit C83 is performed. Therefore, even when a figure with a character string in one line is marked, the discrimination by the first area designation discriminating means C82 is performed first, and only the character string portion inside the figure is detected. Inadvertent masking is reduced.

Furthermore, in the first embodiment, after the determination by the line designation determination unit C83, the determination by the track designation determination unit C84 is performed. Therefore, even if both ends of the marker 36 are rounded, it is prevented that the line designation discriminating means C83 performs the discrimination first and erroneously discriminates the track designation.
Further, in the first embodiment, when none of the diagonal line designation, the first area designation, the line designation, and the track designation corresponds to each of the discrimination means C81 to C84, the polygon designation discrimination means C85 uses the outer shape of the marker. Masking is performed on the basis of the region 51. Therefore, even if what is leaked by each of the discriminating means C81 to C84 is allowed as a designation method using many other markers, there is little deviation from the user's intention.

  A configuration is also conceivable in which, for each marker, all the determinations by the determination means C81 to C85 are all performed, and when a plurality of areas are specified, another determination criterion is provided to specify the area specifying method. However, if all the determination means C81 to C85 are performed for each marker, the processing time becomes longer. On the other hand, in the first embodiment, determination is performed in the order of diagonal area designation, first area designation (graphic designation), line area designation, track shape area designation, and polygon shape area designation. ing. Therefore, the later determination is performed only for those that are not applicable in the determination made earlier. Therefore, the processing time is shortened as compared with the case where all of the discrimination by the discrimination means C81 to C85 drawn for each marker is performed.

Further, in Patent Document 1, when masking the inside of a frame, it is necessary not only to enclose the frame with a polygonal frame but also to attach a hatched self-other identification mark in the polygonal frame. That is, two marks, a polygonal frame and a diagonal line, are necessary. Therefore, in the technique described in Patent Document 1, the user may forget to attach the hatched self-other identification mark only by surrounding with a polygonal frame, and as a result, masking may not be performed.
On the other hand, in Example 1, even if there is no self-other identification mark as in Patent Document 1, only the polygon frame is used in the first area designation, the track-shaped area designation, and the polygon-shaped area designation. Can be distinguished from Therefore, the convenience for the user is improved as compared with the technique described in Patent Document 1 that requires the self-other identification mark.

(Example of change)
As mentioned above, although the Example of this invention was explained in full detail, this invention is not limited to the said Example, A various change is made in the range of the summary of this invention described in the claim. Is possible. Modification examples (H01) to (H07) of the present invention are exemplified below.
(H01) In the above embodiment, the specific numerical values illustrated are not limited to those illustrated, and can be changed to arbitrary values according to the design, specifications, and the like.
(H02) In the above-described embodiment, the order of determination by the determination means C81 to C85 is preferably performed in the order illustrated in the embodiment, but is not limited thereto. That is, if the order is changed or if there is a margin in processing speed, it is possible to execute all the determination processes for all the markers. In addition, it is possible not to execute some of the determination means or to add other determination means. For example, if the user does not specify the area with diagonal lines, it can be configured not to determine the diagonal line specification, or it can also be configured to determine the area specification with ■ marks instead of the diagonal line. is there. Even in this case, it is desirable that the determination by the polygon designation determination unit C85 is performed after the determination by any one, any plurality, or all of the other determination units C81 to C84. .

(H03) In the above-described embodiment, the configuration in which the masking area is enlarged and adjusted when characters protrude or the end of the line is not specified is illustrated, but the present invention is not limited to this. Even if characters do not protrude or reach the end of the line, it is possible to set a masking area without enlarging.
(H04) In the above-described embodiment, the configuration in which processing is performed using an XY monotone polygon is illustrated, but the present invention is not limited to this. For example, it is possible to use a configuration in which the shape of the marker is used as it is without processing the XY monotonous polygon, or a so-called convex hull in mathematics is processed. is there.

(H05) In the above-described embodiment, the configuration in which the determination using the square areas 27 and 44 is performed in the determination unit C81 for specifying a diagonal line and the determination unit C84 for specifying a track is exemplified, but the present invention is not limited thereto. It is also possible to make a determination using a rectangular area corresponding to the aspect ratio of the tilt bounding box 26 instead of a square, or using the entire area of the tilt bounding box 26.
(H06) In the above-described embodiment, the case where the image 1 read by the scanner unit U2 is the target is illustrated, but the present invention is not limited to this. For example, an arbitrary image such as an image with a marker created by document creation software or drafting software, or a FAX image can be used.
(H07) In the above-described embodiment, the processing for discriminating the region surrounded by the marker and hiding (masking) the target region is exemplified, but the present invention is not limited to this. For example, the area surrounded by the markers can be used when specifying a place to be cut out, or when specifying a place where a document color or a character color is to be changed. That is, in the first embodiment, the case where the masking process as an example of the preset image process is executed after the region surrounded by the marker is determined is illustrated, but the present invention is not limited to this, and the preset image process is performed. As an example, it is also possible to execute cutout processing and color change processing.

1 ... Image,
6-8, 28, 31, 36, 41, 51 ... designation mark,
26 ... the smallest rectangle,
27 ... a square area at the center of the rectangle,
29, 29 ', 32, 37, 37', 48, 52 ... the area to be concealed,
41, 51 ... the external shape of the designated mark,
42 ... an inscribed ellipse,
44: A square formed by joining both ends of a rectangle,
46 ... the external shape of the designated mark included in the square,
47 ... A circle inscribed in a square,
AP1 ... program,
C5 ... means for deriving a rectangular area,
C8 ... discrimination means,
C9: Image processing means,
C81 ... Diagonal designation discriminating means,
C82... First area designation discriminating means,
C83 ... line designation discriminating means,
C84: second region designation discriminating means,
C85: Discriminating means for specifying the outer shape,
K1, K2 ... correlation coefficient,
Ka: first threshold,
Kb ... second threshold,
PC: Image processing device, computer,
R1 ... amount of the designated mark,
Ra: a preset threshold for the amount of the designated mark,
θ1 ... the inclination of the smallest rectangle with respect to the horizontal,
θa: A preset range of inclination.

Claims (7)

Rectangle area deriving means for deriving a minimum rectangle surrounding the area of the designated mark for a designated mark that designates a specific area of the image given to the image;
Discrimination means for discriminating an area designated by the designation mark based on the minimum rectangle;
Image processing means for executing preset image processing on a specified area on the image based on the area determined by the determination means;
An image processing apparatus comprising: The discrimination means includes
When the inclination of the minimum rectangle with respect to the horizontal is within a preset range and the amount of the designated mark in the square area is smaller than a preset threshold in the square area of the central portion of the rectangle, A diagonal designation discriminating means for discriminating that a region is designated by a diagonal line connecting diagonals of the designated region,
In the image of the internal area surrounded by the designation mark, when there is no estimated text or what is estimated as a figure, the internal area surrounded by the designation mark is specified. A first region designation discriminating means for discriminating:
And after the determination by the diagonal designation determination means, the determination by the first area designation determination means,
The image processing apparatus according to claim 1. The discrimination means includes
In the image of the internal area surrounded by the designation mark, when there is no estimated text or what is estimated as a figure, the internal area surrounded by the designation mark is specified. A first region designation discriminating means for discriminating:
A line designation for determining that a character string area for one line with the designation mark has been designated when there is an estimated character string for one line in the image of the area with the designation mark Discriminating means, and
And after the determination by the first area designation determination means, the determination by the row designation determination means,
The image processing apparatus according to claim 1, wherein the image processing apparatus is an image processing apparatus. The discrimination means includes
A line designation for determining that a character string area for one line with the designation mark has been designated when there is an estimated character string for one line in the image of the area with the designation mark Discriminating means, and
When the correlation coefficient between the ellipse inscribed in the smallest rectangle including the area of the designated mark and the outer shape of the designated mark is equal to or greater than a preset first threshold, or the correlation coefficient is the first When the correlation coefficient between the outer shape of the designated mark included in the square obtained by combining both ends of the rectangle and the circle inscribed in the square is equal to or greater than a second threshold set in advance. A second region designation discriminating unit for discriminating that the region up to the line end of the character string included in the region enclosed by the designation mark is designated;
And after the determination by the line designation determination means, the determination by the second area designation determination means,
The image processing apparatus according to claim 1, wherein the image processing apparatus is an image processing apparatus. The discrimination means includes
When the inclination of the minimum rectangle with respect to the horizontal is within a preset range and the amount of the designated mark in the square area is smaller than a preset threshold in the square area of the central portion of the rectangle, A diagonal designation discriminating means for discriminating that a region is designated by a diagonal line connecting diagonals of the designated region,
In the image of the internal area surrounded by the designation mark, when there is no estimated text or what is estimated as a figure, the internal area surrounded by the designation mark is specified. A first region designation discriminating means for discriminating:
A line designation for determining that a character string area for one line with the designation mark has been designated when there is an estimated character string for one line in the image of the area with the designation mark Discriminating means, and
When the correlation coefficient between the ellipse inscribed in the smallest rectangle including the area of the designated mark and the outer shape of the designated mark is equal to or greater than a preset first threshold, or the correlation coefficient is the first When the correlation coefficient between the outer shape of the designated mark included in the square obtained by combining both ends of the rectangle and the circle inscribed in the square is equal to or greater than a second threshold set in advance. A second region designation discriminating unit for discriminating that the region up to the line end of the character string included in the region enclosed by the designation mark is designated;
A means for determining an external shape that determines that an area along the external shape of the specified mark has been specified;
And after performing the determination by any one of the determination means of the diagonal specification, the determination means of the first area specification, the determination means of the row specification and the determination means of the second area specification, Discriminate by the discriminating means for specifying the outer shape,
The image processing apparatus according to claim 1, wherein the image processing apparatus is an image processing apparatus. It is determined in the order of the determination means for the diagonal line, the determination means for the first area specification, the determination means for the row designation, the determination means for the second area specification, the determination means for the outer shape specification,
The image processing apparatus according to claim 5. Computer
A rectangular area deriving means for deriving a minimum rectangle surrounding the designated mark area with respect to a designated mark designating a specific area of the image given to the image;
A discriminating means for discriminating an area designated by the designation mark based on the minimum rectangle;
Image processing means for executing preset image processing on a specified area on the image based on the area determined by the determination means;
A program characterized by functioning as