JPH041864A - Image processor - Google Patents

Abstract

PURPOSE:To obtain an image processor which can flexibly deal with the changes of a working environment and the needs with high operability by providing an extracted area learning part and an image extracting part which extracts an image out of an original image based on the format information when a mode switch part is set in an original read mode and outputs the extracted image based on the output order. CONSTITUTION:When a mode switch part 2 is set in an original read mode, the output of an image input part 1 is sent to an image extracting part 5 and at the same time an image extraction start signal is outputted. A format learning part 4 starts its operation by a format learning start signal and extracts and registers a format setting area of a learning form and the position and the size of a color mark showing an extracting area on the learning format as the format information. The image extracting part 5 starts its operation by an image extraction start signal to extract an image out of an original image and outputs the extracted image based on the output order. Thus an image of a desired area is outputted. Thus it is possible to obtain an image processor which can flexibly deal with the changes of a working environment and the needs with high operability.

Description

[Detailed Description of the Invention] [Field of Industrial Application] The present invention relates to an image processing device that extracts an image of an arbitrary area from a document containing drawings, photographs, etc., and synthesizes the extracted images. It is.

[Prior art]

Conventionally, as a technology in this kind of field, for example, Japanese Patent Application Laid-open No. 57
There is an image processing device disclosed in Japanese Patent No. -41770.

This image processing device includes a two-color reading device that separately reads two-color images on an input sheet, and an output from the two-color reading device that determines whether the input sheet has an area designation, an input image designation, or an output image designation. a type mark detector that determines whether the input sheet is designated by the type mark detector; a first detector that detects information indicating a sampling area to be extracted from an input image; and a first detector that detects information indicating a sampling area to be extracted from an input image; a second detector for detecting information indicating an insertion area inset in an output image written in two colors; and an output of the two-color reading device for an input sheet that is determined to be an area designation by the type mark detector. A third detector detects information indicating the correspondence between the extraction area and the insertion area written on the input sheet, and the outputs of the three detectors are inputted, and the type mark detector specifies the input image. The image of the sampling area of the output of the first detector among the images of the input paper that has been successfully determined as the output image is the output of the second detector of the image of the input paper that has been determined as the output image by the type mark detector. A composite image is created by including a pixel replacement device that fits into and outputs an insertion area that corresponds to the above-mentioned extraction area.

[Problem to be solved by the invention]

However, the image processing apparatus with the conventional configuration described above has the following problems.

(1> When extracting a predetermined area of a document and relocating it to an arbitrary area in the compositing area, the area frame for extraction and the area frame for relocation may overlap, or there may be a connection line between the frames. are intertwined in a complicated manner, making it difficult to set up relocation.

This increases the number of paper creation and registration operations for compositing and compositing, which takes a long time.

The present invention has been made in view of the above-mentioned points, and the present invention has been made in view of the above-mentioned points. Learn as format information for output, extract an image of a desired area of the image based on the position and size of the mark from the format information, and extract an image of the desired area based on the color characteristics. The purpose of the present invention is to provide an image processing device with excellent operability that can flexibly respond to changes in the usage environment and needs.

[Means to solve the problem]

In order to solve the above problems, the present invention has configured an image extraction device for extracting an image of an arbitrary area on a document as described below.

an image input section that outputs information according to one or both of the shading and color of marks and/or images written on paper; a mode switching section that switches between a learning mode and a document reading mode; and a mode switching section. an output order learning unit that learns the color characteristics of the output order mark on the learning paper when the is in the learning mode, and registers output information as a pair of the output order and color characteristics determined based on the position of the output order mark; , an extraction area learning unit that extracts and registers the position and size of the area extraction mark as format information for each area extraction mark with color characteristics from the extraction area marks on the learning paper; and when the mode switching unit is in the document reading mode. The present invention is characterized by comprising an image extracting section that extracts an image within a document image based on format information and outputs the extracted image based on an output order.

Further, the mode switching section is characterized in that the mode switching section is configured to switch based on the type of image in a predetermined area on one or both of the study paper and the manuscript.

The order learning unit learns the color characteristics of the marks in the output order setting area of the learning sheet, and registers output information that pairs the output order and color characteristics determined based on the positions of the marks on the sheet.

The extraction area learning unit selects a color mark with color characteristics from the format setting area of the study paper or the color mark indicating the extraction area on the study paper, and extracts the position and thickness of the color mark as format information. register.

The image extraction section starts its operation in response to an image extraction activation signal, extracts an image within the document image based on the format information, and outputs the extracted image based on the output order.

Therefore, the color characteristics of the mark indicating the output order and the position and size of the mark for extracting the desired area of the image are learned as format information for area extraction and output, and among this format information, the position and size of the mark are learned. It extracts an image of a desired area from an image based on its size, and outputs an image of the desired area based on its color characteristics, making it highly operable and able to respond flexibly to changes in the usage environment and needs. Become.

〔Example〕

Embodiments of the present invention will be described below based on the drawings.

FIG. 1 is a block diagram showing the configuration of an image processing apparatus according to the present invention. As shown in the figure, the image processing device includes an image input section 1, a mode switching section 2, an output order learning section 3, and a format learning section 4.
, an image extraction section 5, and an image composition section 6.

The image input unit 1 inputs sheets of paper as shown in FIGS. 3 and 6,
Main scan in horizontal direction (XX), sub-scan in vertical direction (YY)
Marks written on the paper and/or document 9 Color information corresponding to one or both of the shading and color of the drawing, such as a density multi-level signal or R (red), G (green), B The (blue) multilevel signal is output to the mode switching section 2 as color information.

The mode switching unit 2 can set a learning mode or a document reading mode using a switch (not shown) or the like. When the mode switching unit 2 is set to the learning mode, it outputs the output of the image input unit 1 to the output order learning unit 3 and format learning unit 4, and outputs a learning activation signal.

Further, when the mode switching section 2 is set to the original reading mode, the output of the image input section 1 is outputted to the image extraction section 5, and an image extraction start signal is outputted.

The output order learning section 3 is started to operate by the learning start signal, learns the color characteristics of the marks in the output order setting area of the study paper as shown in FIG. At the same time, a format learning start signal is started to be output to the format learning section, and the formatting area of the learning sheet as shown in FIG. 3 is registered. Alternatively, a color mark having the above-mentioned color characteristics is selected from the color marks indicating the extraction area on the study paper shown in FIG. 4, and the position and size of the color mark are extracted and registered as format information.

The image extraction unit 5 starts operating in response to the image extraction activation signal, extracts an image within the document image based on the format information, and outputs the extracted image based on the output order.

The image composition section 6 composes the document images within the color mark area outputted from the image extraction section 5 and displays the composite images on a CRT, printer, etc. (not shown).

FIG. 2 is an explanatory diagram of color characteristics showing the principle for classifying marks on a document by color; FIG. 2(a) is a chromaticity diagram showing the range of chromaticity coordinates of marks; b) is an explanatory diagram of the density range of the mark.

When using the principle shown in FIG. 2(a), the image input section 1 requires a color scanner capable of outputting, for example, an RGB density multilevel signal.

Further, when using the principle shown in FIG. 2(b), a monochrome scanner or the above-mentioned color scanner that can output a density multilevel signal to the image input section 1 is required.

The chromaticity diagram in FIG. 2(a) was created by a known method and is schematically shown, in which the RGB density signal is converted to the XYZ system using the coordinate conversion formula (1), X -2,7689R+ 1.7517G + 1.1
302BY = R+ 4.5907 G+
0.0601 BZ-0,0565G+5.5943B
(1) Formula (2) based on the obtained X, Y, and Z
The chromaticity coordinates X, 7 are calculated using x=X/(X+Y+Z) y-Y/(X+y+z) (2) Orthogonal coordinates based on the obtained chromaticity coordinates x+F are used. The x and y represent hue and saturation, and Y represents lightness.

The above-mentioned conversion formula from the RGB system to the XYZ system [Formula (1)] and the calculation formula for calculating X and 7 representing hue and saturation [Formula (2)]
inputs R, G, and B, and outputs x, y, and z from a ROM and inputs x, y, and z! , y can be converted using a ROM that outputs them in integer format, thereby eliminating the need for calculation time and speeding up the processing.

In the case of FIG. 2(b), the document 0 drawing from which the region is to be extracted is expressed in white and black, and the density level of the mark on the document does not overlap with the density of the white and black. The colors can be classified by selecting colors of the marks that have density levels that overlap each other. Moreover, the above Y may be expressed similarly.

FIG. 3 is an explanatory diagram of the study paper, which is composed of two areas: a study paper output order setting area and a format setting area. The two areas are divided by a division mark mb, and the size of the format setting area is usually has the same size as the document 1 drawing to be processed, and the division mark mb corresponds to the upper side of the paper of the document 4 drawing.

m g I + m g * in the output order setting area
＋! n gl,... is a rectangular entry frame with a size of (ΔXX, Δyy), and is located at the origin of the study sheet (
0°O) to a predetermined distance (X X + + 3' V
Assume that the apex of the entry frame is at , ) and is printed in black in advance with a pitch of XX. In addition, as shown in the figure, an article (' I J s ' 2 J + ' 3 J *・
) is printed.

In addition, the above article and entry frame mg 1. m g z r
The colors, shapes, numbers, and positional relationships of m gl, . . . are not limited to those shown in FIG.

Alternatively, entries in the output order setting area may be deleted and learning marks may be entered in accordance with predetermined rules. Examples of this rule are as follows.

- Use paper with similar characteristics to the original from which the image is to be extracted.

■Learning marks should be written at a distance so that they do not touch each other.

■The order of colors written on the study paper (from left to right) is the output order.

In addition, in the output order setting area of the study paper, a desired color is written in accordance with the area extraction mark in the format setting area prior to reading. In the following explanation, the mark g is shown in red, GL is shown in green, and gs is shown in blue.

2nd rXJ(a) schematically shows the position of the mark on the chromaticity diagram.

The mark written in the formatting entry area in Figure 3 is Document 1
Mark mIhm indicates the area to be extracted from the drawing, and should be entered in a 1:1 positional relationship with the document 9 drawing.
1*, mate m1g, mH are entered in accordance with the output order shown in the output order setting area and correspond to the original shown in FIG.

In the figure, marks m, , m, are colored extraction area marks indicating the area to be output first, and correspond to g+ in the output order setting area. mark m.

1, m, . are color extraction area marks indicating the area to be output second, and correspond to gl in the output order setting area. ms is a color extraction area mark indicating the third output area, and corresponds to gs in the output order setting area.

Note that if two or more marks of the same color exist, images within the mark area are output in ascending order of the YY coordinates of the mark, then the XX coordinates of the mark.

Furthermore, if the output order setting area and the format setting area in FIG. 3 are made on separate sheets of paper, the output order and format setting can be set independently, increasing the degree of freedom in specification.

FIG. 4 is a diagram showing a paper showing the formatting area when formatting is set independently, and as shown in FIG. Alternatively, the postscript mark itself on the document may be used for formatting. In FIG. 4, mark m.

1, mjs, mar, man, mjs
has the same meaning as in Figure 3.

By doing as shown in FIG. 4, formatting can be done easily.

Next, the operation of the output order learning section 3 shown in FIG. 1 will be explained using FIGS. 2 and 3. Here, it is assumed that the color, shape, positional relationship, and rules of the entry frames of the learning sheet are set in advance in the output order learning section 3.

Further, the color characteristics to be learned may be learned using any known color characteristics, but in the present invention, learning is performed using the chromaticity diagram of FIG. 2(a) described above, and the chromaticity coordinates described above X +
It is assumed that a chromaticity diagram is constructed from a two-dimensional memory (color map) whose addresses are integer values X% and y% obtained by converting F into an integer, for example, 100 times it.

In the following description, to avoid confusion with X, Y, and Z representing color characteristics, the coordinate system of the paper plane will be expressed as XX for the main scanning or horizontal direction, and YY for the sub-scanning or vertical direction.

Also, the coordinates on the paper and the coordinates during scanning usually do not match, but for the sake of simplicity, here we will use the upper left corner of the paper as the scanning start point [origin (0°0)] and the lower right corner as the scanning end point. It is assumed that scanning is performed using a coordinate system with points (xend, yend).

Main scan in horizontal direction (XX), sub-scan in vertical direction (YY)
The study paper shown in FIG. 3 is scanned as shown in FIG. The RGB system density signal input from the chromaticity coordinate X is calculated using the above-mentioned equations (1) and (2).

The area output order number i is written on a color map whose addresses are X% and y%, which are converted into y and further converted into integers, and the color map is used as output information.

Here, it is assumed that the color map is initialized to 0 prior to learning.

Note that the determination as to whether the color is a chromatic color or not is performed using a known method, for example, R
, G, and B have different density signal levels.

Further, the area output order number is obtained by comparing the coordinate values of the scanning point and the position of a preset entry frame.

When the entry frame in the output order setting area described above is deleted, the processing for determining the entry space is deleted and the same operation as described above is performed. However, the area output order number i is
This is achieved by configuring the system to count +1 when a chromatic color break exists over a predetermined length on each main scanning line. However, the initial value of the area output order number is 1.

FIG. 2(a) illustrates the range and output order of the chromaticity coordinates of the colors of the marks learned and registered in the above explanation.

In addition, if you configure the configuration so that output order settings and format settings are learned independently on separate sheets, register the color characteristic numbers of the colors used in the procedure shown in the output order learning section in advance in the color characteristic map. put. When learning the output order setting area in the output order learning section 3, the characteristics of the colors described in the output order setting area are detected by referring to the color characteristic map, and the detected color characteristic number and the output order setting area are detected. An output order table is created in which the output order determined based on the position of is a pair of data, and the color characteristic map and the output order table are used as output information.

Next, mark identification processing and format extraction processing of the format learning section 4 will be explained using FIGS. 3 to 5.

Mark identification processing is performed as follows. Image input section 1
The RGB density signal outputted by scanning the study paper as shown in the format setting area of FIG. 3 is expressed by the above equation (1),
(2) is used to convert the chromaticity coordinates to x, y, and then calculate the integer X%, y%. If the output of the color map whose address is the X%, y% is other than 0, the scanning point is on the mark.

In addition, if the configuration is such that the output order setting and format setting are made into separate sheets and studied independently, the image input section 1 scans the study sheet as shown in FIG. 4 and outputs the RGB density signal. If the color characteristic map output whose addresses are X% and y% determined in the above-described procedure is other than 0, it is determined that the scanning point is on the mark. Therefore, format information is learned based on the color characteristic map independently of the output information described above.

The format extraction process is performed as follows. In FIG. 5, no mark image is detected up to the sub-scanning YYI line;
A mark image is detected in row YY2. When the mark image is detected, the coordinates (XX,
YY) is used to perform processing to find the corner points of the four corners of the mark image. For example, equation (3) is calculated based on the principle disclosed in detail in Japanese Patent Application No. 63-002028.

Upper left corner point - MIN (XX + YY) Lower left corner point - MIN (XX - YY) Upper right corner point - MAX (XX + YY) Lower right corner point - MAX (XX - YY) (3) Also, mark images are connected The determination as to whether or not this is the case is carried out using a known technique such as the following equation (4) as disclosed in detail in Japanese Patent Publication No. 60-55868.

X X < + -t)jb≦x x, 1vXX
<+-s>j-';:XXxb
(4) However, XX<+-I>sbr XX(t-tt3
The change point from the color characteristic 0 to the color characteristic of the previous scan line Y Y + -+ of the scan YY line and the color characteristic k to the color characteristic O
Indicates the X coordinate of the pair of change points to, X X + + −,
X X l1m respectively represent the X coordinates of the change point from the color characteristic 0 to the same color characteristic as the color characteristic and the pair of change points to the color characteristic 0 in the scanning row Y.

The above process is repeated until the sub-scan is YY.

Since the mark image disappears when it reaches the line, the coordinates of the four corner points and the number of the color characteristics obtained above are used as format information. The method described above can be applied not only to closed-loop figures but also to filled figures.

Scan the entire formatting area in Figure 3 or the study paper in Figure 4 using the method described above, and mark the marks mst 1m5z em, □
The coordinates of the corner points of the four corners and the number of the color characteristic are obtained for every 2 m □ 9 m and used as format information.

Note that the information representing the position and size of the format information may be the circumscribed frame of the mark image determined from the corner points of the four corners. In the above description, when learning the output order setting and format setting independently, the learning mode of the mode switching section 2 is further divided into a color map learning mode and a region output order learning mode.

Next, the processing of the image extraction section 5 will be explained. First, a case where output order settings and format settings are registered as integrated format information will be explained.

The image input unit 1 scans the document shown in FIG.
XX, YY) is in the area indicated by the format information, the output of the image input unit 1 is sequentially accumulated in the frame buffer corresponding to the color characteristic number of the format setting.

Subsequently, output ordering and formatting are done independently,
A case where the output order table and format information are registered as independent information will be explained.

The image input unit 1 scans the document shown in FIG.
XX, YY) is within the area indicated by the format information, it is determined whether the color characteristic number registered in the format information exists in the output order table, and if it exists, the color characteristic number is The output of the image input unit 1 is sequentially accumulated in the frame buffer corresponding to the output sequence number and the pair of output order numbers.

Note that when the image extraction process for the format information corresponding to one mark area is completed, at least the address in the sub-scanning direction of the final address of the frame buffer corresponding to the mark is saved as the final storage address, and then the image is extracted again. When extracting images within a mark area having the same output order, images extracted from the address next to the address are stored.

FIG. 7 is a diagram showing an example in which images extracted from the original shown in FIG. 6 are stored in a frame buffer.

The image synthesis unit 6 sequentially extracts images from the frame buffer 1 in the output order 1 by referring to the number of extracted areas, the number of frame buffers storing the extracted images, and the final storage address of the frame buffer, and outputs images from the output image memory, Output to CRT, printer, etc.

FIG. 8 is a diagram showing an example in which an image extracted from a marked area is saved using one frame buffer and an area table.

When using the storage format as shown in FIG. 8, the image extraction unit 5
stores the images extracted from the document in the frame buffer sequentially in the order in which they were extracted, and at least stores data in the area table that is a pair of the start address and the number representing the mark output order when storing in the frame buffer for each extracted area. do.

As described above, the extracted images may be output by indicating the extraction order of the images using a region table.

The image synthesis unit 6 extracts and outputs the images in the frame buffer based on the output order and the start address stored in the area table.

Note that the processing by the image extracting section 5 and the image synthesizing section 6 is not limited to the above-mentioned method.

In addition, we have added marks on the paper that can be used to determine if the lower manuscript study paper is a noodle, as well as marks that can be used to identify color characteristics study paper, area output order study paper, or format study paper, and have added a function to the mode switching section that allows you to determine the presence or absence of the marks. 2, the mode switching operation can be automated.

Note that the mark is, for example, a black line segment of a predetermined length, a predetermined width, and a predetermined number written in an area near the top side of the paper.

〔Effect of the invention〕

As explained in detail above, according to the present invention, the color characteristics of the mark indicating the output order and the position and size of the mark for extracting a desired region of the image are learned as format information for region extraction and output. However, the image of the desired area is extracted from the image based on the position and size of the mark in the format information, and the image of the desired area is output based on the color characteristics. An excellent effect can be obtained in that an image processing device with excellent operability that can flexibly respond to changes in needs can be provided.

[Brief explanation of drawings]

FIG. 1 is a block diagram showing the configuration of the image processing device of the present invention, FIG. 2 is an explanatory diagram of color characteristics, FIG. 3 is an explanatory diagram of a study paper, and FIG. 4 is an example of a paper showing a formatting area. Figure 5 is an explanatory diagram of extraction area mark detection, Figure 6 is a diagram showing an example of a document, Figure 7 is a diagram showing an example of storage in a frame buffer, and Figure 8 is an extracted image using a frame buffer and area table. FIG. 9 is a diagram showing an example of a composite image. In the figure, 1: image input section, 2: mode switching section, 3: output order learning section, 4: format learning section,
5... image extraction section, 6... image synthesis section. Patent applicant Oki Electric Industry Co., Ltd. Agent Patent attorney Takashi Kumagaya (1 other person) ta 410φ-5 example hill Ami 6
0 Fig. 4 Dell @ th411 Fig. 3 □ Main t (XX) Fig. 5 An example of foot 1 group Fig. 6 41 bed 7゛) Shikuku 2) Fu L-Mupa / Now 7 L- Munoku'-, 7 A7 411 N Chi 7 "J Shikoku? J
Tsukigami 1 Uta Shin 1 Yoshinu, 11 over figure 8 plywood 11 example

Claims (2)

[Claims] (1) An image processing device that reads a document/drawing and a manuscript with marks written on it, performs extraction on the document/drawing according to the color characteristics of the mark, and creates a composite image. an image input section that outputs information according to one or both of the shading and color of the mark and/or image; a mode switching section that switches between a learning mode and a document reading mode; when the mode switching section is in the learning mode; includes an output order learning unit that learns the color characteristics of the output order mark on the study paper and registers output information that pairs the output order determined based on the position of the output order mark and the color characteristics; an extraction area learning unit that extracts and registers the position and size of the area extraction mark as format information for each area extraction mark having the color characteristics from the extraction area mark of the image data; An image processing apparatus comprising: an image extraction section that extracts an image in a document image based on information and outputs the extracted image based on the output order. (2) The image processing apparatus according to claim 1, wherein the mode switching section is configured to switch the mode based on the type of image in a predetermined area on one or both of the study paper and the document.