JPH03294973A - Image processor - Google Patents

Abstract

PURPOSE:To cope flexibly with the variation of the use environment and need and to enhance the operability by extracting document/drawing images in a mark, based on a color characteristic of a mark on a document, and outputting them successively in accordance with an area output sequence being output information for forming a pair with its color characteristic. CONSTITUTION:The processor is constituted of an image input part 1, a mode switching part 2, a learning part 3, an image extracting part 4 and an image synthesizing part 5. In such a state, learning paper in which output information for forming a pair of a color characteristic of a mark added to document/ drawing and an area output sequence is mentioned is learned, registered as output information, and based on the color characteristic of the mark, an image in the area of the mark added to the document/drawing is extracted, and outputted successively in accordance with the area output sequence being the output information for forming a pair with its color characteristic. In such a way, the image processor having excellent operability which can cope flexibly with the variation of the use environment and need.

Description

DETAILED DESCRIPTION OF THE INVENTION [Field of Industrial Application] The present invention relates to an image processing device that extracts an image of an arbitrary region.

[Prior art]

Conventionally, as a technology in this kind of field, Japanese Patent Application Laid-Open No. 57-41
There was an image processing device that was fully disclosed in Publication No. 770.

This image processing device includes a two-color reading device that separately reads two-color images on an input sheet, and an output from the two-color reading device that determines whether the input sheet is designated as an area, an input image, or an output image. a type mark detector that determines whether the type mark is for an area specified by the type mark detector; and an input written in the first color on the input paper from the output of the two-color reading device for the input paper determined by the type mark detector to specify an area; A first detector detects information indicating a sampling area to be extracted from an image, and a second color is applied to the input paper from the output of the two-color reading device for the input paper that is determined to be an area specified by the type mark detector. a second detector that detects information indicating an insertion area to be inserted into the output image written in , and a second detector that detects information indicating an insertion area to be inserted into the output image written in . a third detector that detects information indicating a correspondence relationship between the extraction area and the insertion area written on the paper;
The image of the sampling area of the output of the first detector is selected from among the input paper images determined to be input image designated by the type mark detector to which the outputs of the three detectors are inputted, by the type mark detector. An image is created using an image changing device that inserts and outputs an image of the input paper that has been determined to be an output image designated into an insertion area that corresponds to the sampling area of the output of the second detector.

[Problem to be solved by the invention]

However, the image processing apparatus having the above configuration has the following problems.

(1) When extracting images from manuscripts in different formats or from arbitrary regions in the same format, sampling (extraction) is performed each time.
It is necessary to create a form for setting the area, and it takes a lot of time to create and register the form, and the operation becomes complicated.

(2) When extracting images from different areas of multiple documents, it is necessary to create a form for setting the extraction area for each document and operate the device configured as described above multiple times;
Not only does it take a lot of time to create forms and register, but the operations are complicated and there is a risk of erroneous operation.

The present invention has been made in view of the above-mentioned problems, and in order to eliminate the above-mentioned problems, a study sheet is learned and outputted in which output information is written as a pair of color characteristics of marks on a document and an area output order. The image is registered as information, the original image within the mark is extracted based on the color characteristics, and is output sequentially according to the area output order, which is a pair of output information with the color characteristics, making it flexible to changes in the usage environment and needs. An object of the present invention is to provide an image processing device with excellent operability that can handle the following situations.

[Means to solve the problem]

In order to solve the above-mentioned problems, the present invention provides an image processing device that extracts an image of an arbitrary area on a document. Alternatively, there is an image input section that outputs information corresponding to both modes, a mode switching section that switches between learning mode and original reading mode, and when the mode switching section is in learning mode, it learns the color characteristics of the marks on the learning paper, and a learning unit that registers output information that pairs the area output order determined based on the mark position above and the color characteristics; and a mark that matches the color sensitivity of the output information when the mode switching unit is in document reading mode. An image extracting unit is provided which extracts a document image within the document and sequentially outputs the image in accordance with the color characteristic and the output order of the pair of regions.

Further, the mode switching section is configured to switch based on the type of image in a predetermined area on the study paper and/or the manuscript.

[Effect]

As described above, the present invention learns a study paper in which output information is written as a pair of color characteristics of marks on a document and an area output order, and registers the results as output information. Since the original image is extracted and outputted sequentially according to the area output order, which is a pair of output information with the color characteristics, it is now possible to extract images from originals in different formats, or from arbitrary areas even in the same format, as in the past. If you need to create a separate sheet of paper to set the extraction area each time, or if you want to extract images from different areas of multiple documents, you may need to create a sheet of paper to set the extraction area for each document and install the device. The image processing device has excellent operability and can flexibly respond to changes in the usage environment and needs without the need for multiple operations.

〔Example〕

(− Embodiments of the present invention will be described below with reference to the drawings.

FIG. 1 is a block diagram showing the configuration of an image processing apparatus according to an embodiment of the present invention. As shown in the figure, the image processing device is
It is composed of an image input section 1, a mode switching section 2, a learning section 3, an image extraction section 4, and an image composition section 5.

The image input unit 1 receives sheets of paper as shown in FIGS. 3 and 4,
The main scanning is in the horizontal direction (XX), and the sub-scanning is in the vertical direction (Y).
Y), and the mark completely written on the paper and/or the color information corresponding to one or both of the shading and color of the document 1 drawing, such as a density multi-level signal or R (red), G
(green) and B (blue) multilevel signals are output to the mode switching unit 2 as color information.

The mode switching unit 2 sets a learning mode or a document reading mode using a switch (not shown) or the like. When the mode switching unit 2 is set to the learning mode, it outputs the output of the image input unit 1 to the learning unit 3, and also outputs a learning activation signal.

When the mode switching unit 2 is set to the original reading mode, it outputs the output of the image input unit 1 to the image extraction unit 4 and outputs an image extraction activation signal. The learning section 3 is started to operate by the learning activation signal, learns the color characteristics of the marks on the learning paper as shown in FIG. Register the output information as a pair.

The image extraction section 4 starts its operation in response to the image extraction activation signal, inputs the color information of the document paper that can be outputted from the image input section 1 via the mode switching section 2, and matches the color characteristics of the output information. Extract the original image within the marked area,
The image is output to the image composition unit 5 in accordance with the color characteristic and the region output order, which is a pair of output information.

The image composition section 5 composes the document images within the mark area outputted from the image extraction section 4, and displays the composite images on a CRT, printer, etc. (not shown).

FIG. 2 is an explanatory diagram of color characteristics showing the principle for classifying marks on a document by color; FIG. 2(a) is a chromaticity diagram showing the range of chromaticity coordinates of marks; b) is an explanatory diagram of the density range of the mark.

When using the principle shown in FIG. 2(a), the image input section 1 requires a color scanner capable of outputting, for example, an RGB density multilevel signal. Further, when using the principle shown in FIG. 2(b), the image input section 1 requires a monochrome scanner or the color scanner described above that can output a density multilevel signal.

The chromaticity diagram in Fig. 2(a) is a schematic diagram created by a known method, in which RGB density signals are converted to the XYZ system using coordinate conversion formula (1). , X = 2.7689R + 1.7517G + 1.130
2BY=R+4.5907G+0.0601B
(1) Z = 0.0565G +
5.5943B Based on the obtained X, Y, and Z, the formula (
2) Calculate the chromaticity coordinates x, y, x=X/(X+Y+Z) y=Y/(X+Y+Z) (2) Using orthogonal coordinates based on the calculated chromaticity coordinates x, y It is.

The above X + 3' represents hue and saturation, and Y
represents brightness.

The above-mentioned conversion formula from the RGB system to the XYZ system [Formula (1)] and the calculation formula for calculating x and y representing hue and saturation [Formula (2)]
] is converted using a ROM that inputs R, G, B and outputs x, y, z, and a ROM that inputs X, Y, Z and outputs X r 3' in integer format,
This eliminates the need for calculation time and speeds up the processing.

In the case of Figure 2(b), the second drawing of the document to be extracted is white;
A color that is expressed in black, the density level of the mark on the document is a density level that does not overlap with the density of the white and black, and the color of the mark has a density level that does not overlap with each other for each color. Color classification is possible by selection. Further, the brightness Y may be expressed similarly.

Figure 3 is an explanatory diagram of the learning paper, where (a) is an example of writing learning marks in a frame whose output order is predetermined, and (b) is an example of writing learning marks on a blank sheet of paper at the same time. This is an example.

In FIG. 3(a), m g , , m g ,
, m g8. ... is a rectangular entry frame with a size of (ΔX!, Δyy), and is located at the origin (0,
0) to a predetermined distance (X X r + 13' r )
Assume that the apex of the entry frame is at , and is printed in black in advance at a pitch of VVz. Furthermore, as shown in the figure, an article ("output order 1") for specifying the output order corresponds to the entry frames mgl, mg, , mgs, -"".

1 output order 2'', ``output order 1'', etc.) are printed.

In addition, the above article and entry frame m g1. m g t
, mgl, . . . colors, shapes, numbers, and positional relationships are not limited to those shown in FIG. 3(a).

FIG. 3(b) shows a form for filling in learning marks according to predetermined rules. The above rules are:
For example:

- Use paper with similar characteristics to the original from which the image is to be extracted.

■Learning marks should be written at a distance so that they do not touch each other.

■The original images within the additional mark area are output in the order of the colors written on the study paper (from top to bottom).

It should be noted that the desired color is written on the pre-study sheet prior to reading to match the mark on the manuscript. In the following explanation, the mark g+ written in red is g.

is green, and g is blue.

FIG. 2(a) schematically shows the position of the mark on the chromaticity diagram.

FIG. 4 is an explanatory diagram of the manuscript paper input to the image input unit 1, with patent public relations as an image example of the document 2 drawing, and the document 2
Mark m on the drawing according to the area output order on the study paper.
This is a manuscript with the following added: 1y mI* v mar p mat + mss. In the figure, mark m.

1, ml is a color additional mark indicating the area to be output first, and corresponds to mark g in the third stroke. The mark m□2m is a color additional mark indicating the area to be outputted second, and corresponds to the mark g in FIG. 3.

The mark m□ is a colored additional mark indicating the third output area, and corresponds to the mark g in FIG. Note that if two or more marks with the same color characteristics exist, images within the mark area are output in ascending order of the YY coordinates of the mark position, then the XX coordinates.

Next, the operation of the learning section 3 will be explained using FIGS. 2 and 3. It is assumed that the color, shape, number 2 positional relationship, and rules of the entry frame of the learning sheet used here are set in advance in the learning section 3.

Further, the color characteristics to be learned may be learned using any known color characteristics, but in the present invention, learning is performed using the chromaticity diagram of FIG. 2(a) described above, and the chromaticity coordinates described above x, y
It is assumed that a chromaticity diagram is constructed using a two-dimensional memory (color map) whose addresses are integer values X% and y% obtained by multiplying by 100, for example.

In the following description, the coordinate system of the paper plane will be expressed as XX1 for the main scanning or horizontal direction, and YY for the vertical direction to avoid confusion with x, y, and z, which represent color characteristics.

The coordinates on the paper and the coordinates during scanning usually do not match in many cases, but to simplify the explanation, we will use the upper left corner of the paper as the scanning start point [origin (0, 0)), and the lower right corner as the scanning end point ( x
It is assumed that the scanning is performed using a coordinate system of (end, yend).

Main scan in horizontal direction (XX), sub-scan in vertical direction (YY)
When the study paper shown in FIG. 3(a) is scanned, and if the scanning point is within the entry frame (writing frame judgment) and the color characteristics of the scanning point are chromatic, The RGB density signal that can be input from the image input unit 1 is expressed by the above equation (1).
, (2) to convert to chromaticity coordinate X + 3',
Furthermore, X% is converted into an integer.

Write area output order number i on the color map with address y%. Here, it is assumed that the color map is initialized to 0 prior to learning. Note that the determination as to whether the color is a chromatic color or not is performed using a known method, for example, by determining whether the density signal levels of R, G, and H are different from each other or are all at the same level. Further, the area output order number is obtained by comparing the coordinate values of the scanning point and the position of a preset entry frame. In the case of the study paper shown in FIG. 3(b), the process of determining the entry space is deleted and the process is performed in the same manner as described above. However, the area output order number i can be achieved by configuring the area to be counted by +1 when a chromatic color exists on the sub-scanning line of the previous row and no chromatic color exists on the sub-scanning line of the document. .

Note that the initial value of the area output order number is 1.

FIG. 2(a) shows the range of chromaticity coordinates and the output order of the marks learned and registered in the above explanation CI>, <2).

(3) is exemplified.

Next, the mark identification process and the image extraction process in the mark area by the image extraction section 4 will be explained using FIG. 2 and FIGS. 4 to 6.

Mark identification processing is performed as follows. Image input section 1
The RGB output is incorrect when scanning a document like the one shown in Figure 4.
Convert the density signal into the chromaticity coordinates X t V using the above equations (1) and (2), calculate the integer X% and y%, and create a color map using the X% and y% as addresses. If the output of is other than O, it is determined that the scanning point is on the mark.

The image extraction process within the mark area will be explained using FIGS. 5 and 6.

In FIG. 5, pixels with the color characteristics set in the output information are not detected in the sub-scanning YYI row, but in the YYZ row, a mark image with the output order j is identified by the mark identification process described above, and further In the YYS row, the image narrowed by the mark image (image between XWY3 and Xm'r3)
Therefore, the interposed image is selected as the image to be extracted, and is sequentially stored in the frame buffer corresponding to the output order j among the frame buffers shown in FIGS. 6(a), (b), and (C). do.

Extract the images sandwiched between the marked images one by one according to the above steps,
Although the data is accumulated, when the sub-scanning reaches row YYn-1, the image sandwiched between the mark images is not extracted. Sub-scan is Y
When Yn is reached, there are no more mark images, so the process of extracting mark images corresponding to output order j ends.

Note that when the extraction process for one mark area is completed, at least the address in the sub-scanning direction among the final addresses of the frame buffer corresponding to the mark is saved as the final storage address, and the extraction processing for the mark area with the same output order is saved again. When extracting an image, from the address next to the above address,
Accumulate the extracted images.

FIGS. 6(a), (b), and (c) are diagrams showing an example in which images extracted from the original shown in FIG. 4 are stored in a frame buffer.

The image synthesis unit 5 refers to the number of extracted regions and the final storage address of the frame buffer in which the extracted images are stored, and sequentially extracts images from the frame buffer of output order 1, and outputs the images to the output image memory and CRT.

Output to a printer, etc.

FIG. 7 is a diagram showing an example in which an image extracted from within a marked area is saved using one frame buffer FBu and area table Ta.

If the storage format shown in FIG. 7 is used, the image extraction unit 4
stores the images extracted from the document in the frame buffer FBu in the order in which they were extracted, and creates an area table containing data that includes a pair of the start address and the number representing the order in which marks are output at least for each extracted area when stored in the frame buffer FBu. Store in Ta.

As described above, the extracted images may be output by indicating the extraction order of the images using the area table Ta.

The image synthesis unit 5 extracts and outputs the image of the frame buffer FBu based on the output order and the start address stored in the area table.

FIG. 8 is a diagram showing an example of a composite image obtained by combining images extracted from the original shown in FIG. 4 through the above-described processing.

As is clear from the above description, in the image processing apparatus of the present invention, the image output order is defined by the color of the mark indicating the extraction area. can also be dealt with.

FIG. 9(b) shows a composite image obtained by extracting and synthesizing necessary areas from multiple originals, with the original shown in FIG. 4 as the first sheet and the original as shown in FIG. 9(a) as the second sheet. It is a diagram.

Note that the processing by the image extracting section 4 and the image synthesizing section 5 is not limited to the above-mentioned method.

For example, as shown in FIG. 10, the image extraction unit 4 may detect a circumscribed frame of a connected mark image and extract an image within the circumscribed frame. Alternatively, as shown in Fig. 11, a method of scanning the image in the horizontal and vertical directions and extracting the area between the mark images in both directions, or a method of detecting the outline of the mark image and filling in the connected image. There are various methods for extracting images within the mark.

Further, as a processing method of the image synthesizing section 5, as shown in FIG. 1, there is a method of outputting the extracted image to a preset area corresponding to output order 1, 2, 3, and the like.

Furthermore, although the above-described processing has been described only for mark images in a closed loop, the image extracting section 4 and the image synthesizing section 5 may be configured so as to be able to handle marks having a shape that can express an area, such as a filled mark.

In addition, a mark that can be used to distinguish whether it is a study paper or a manuscript, for example, a black line segment of a predetermined length and a predetermined width, is written in an area near the top of the paper. By adding this, it is also possible to automate switching between reading the study paper and reading the manuscript.

〔Effect of the invention〕

As explained above, according to the present invention, a study paper in which output information is written as a pair of color characteristics of marks on a document and an area output order is learned and registered as output information, and the color characteristics are registered as output information. The system extracts the original image within the mark based on the color characteristics and sequentially outputs it according to the area output order, which is a pair of output information. An excellent effect can be obtained in that an image processing device can be realized.

[Brief explanation of drawings]

FIG. 1 is a block diagram showing an embodiment of the present invention, and FIG. 2 is an explanatory diagram of color characteristics. FIG. An explanatory diagram of the density range, Figures 3 (a) and (b) are explanatory diagrams of the study paper, and Figure 4
The figure is an explanatory diagram of an input manuscript, FIG. 5 is an explanatory diagram of image extraction, and FIG. 6(a). (b) and (c) are diagrams showing an example of storage in a frame buffer, Figure 7 is a diagram showing an example of an extracted image using the frame buffer and area table, Figure 8 is a diagram showing an example of a composite image, and Figure 9 is a diagram showing an example of a composite image. These are diagrams for explaining image composition using two originals, in which (a) shows the second input original, (b) shows the composite image, and Fig. 10 shows the image extraction section. FIG. 11 is an explanatory diagram of other processing of the image extraction section.
FIG. 2 is an explanatory diagram of other processing of the image composition section. In the figure, 1... image input section, 2... mode switching section, 3... learning section, 4... image extraction section, 5...
・Image synthesis section.

Claims (2)

[Claims] (1) An image processing device that reads a document/drawing and a manuscript with marks written on it, performs extraction on the document/drawing according to the color characteristics of the mark, and creates a composite image. an image input section that outputs information according to one or both of the shading and color of the mark and/or image; a mode switching section that switches between a learning mode and a document reading mode; and when the mode switching section is in the learning mode. a learning unit that learns the color characteristics of the marks on the learning paper and registers output information that pairs the area output order determined based on the mark position on the learning paper and the color characteristics; and the mode switching unit. is in the document reading mode, extracts the document image within the mark that matches the color characteristics of the output information,
An image processing device comprising: an image extracting section that sequentially outputs images to an image synthesizing section according to the color characteristics and the output order of the pair of regions. (2) The image processing apparatus according to claim 1, wherein the mode switching section is configured to switch the mode based on the type of image in a predetermined area on one or both of the study paper and the manuscript.