JPH05328096A - Copying machine for picture relocation - Google Patents

Abstract

PURPOSE:To make the picture processing most suitable for each original by automatically selecting the 1st mode relocating the specific area according to its outside shape and automatically reshaping the contour at its output and the 2nd mode to be outputted as it is. CONSTITUTION:An image reader 200 resolves the original image into pixels at its reading. A means 242q1 discriminating the necessity of relocation discriminates the necessity of the relocation of the picture data. A relocation control means 242mp energizes a text line segmenting means 242b and a relocation executing means 242r2, segmenting a plurarity of texts in the rectangular shape having the same size with the text line from the read picture data when the discrimination is outputted, taking the 1st mode to be relocated by moving the segmented picture data. A discrimination means 242q1 prevents the relocation of pictures when no relocation is required, taking the 2nd mode outputting the original picture data. An image forming means 280 outputs any picture data.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION The present invention, when copying an article image having various outer shapes, automatically moves and rearranges a part of the image data according to the article contour shape.
The present invention relates to an image rearrangement copying machine that changes the arrangement of images and outputs the images.

[0002]

2. Description of the Related Art For example, Japanese Patent Laid-Open No. 62-159570 discloses a conventional copying machine for trimming an image. In the technology disclosed in this, the image reading means reads the surrounding mark of a predetermined density provided on the original image together with the original image, and the surrounding mark identifying means identifies the surrounding area,
Different image processing is performed inside and outside the box, for example, blanking processing is performed outside the box to extract the image. According to this, if a document is marked with a felt pen or the like, a copy image in which a desired area is freely extracted can be obtained.

When this type of copying machine is used to extract and copy an enclosed article such as an editorial section of a newspaper, for example, when the outer shape of the article is quadrangular and the aspect ratio thereof is close to the aspect ratio of the standard copy paper. Gives a visually good copy image. However, some articles may have a relatively complicated outer shape, and there are many irregularities in the outer shape of the copy image, it is difficult to read, a lot of useless blanks occur on the recording paper, and in an extreme case an engraved image can be created. There's a problem.

As a technique capable of solving these problems to some extent, the technique disclosed in Japanese Patent Laid-Open No. 1-256271 is known. In this case, it is possible to specify a plurality of rectangular areas by the tablet, trim them, and move and rearrange each rectangular area. However, in this technique, since the moving direction and the amount are uniquely determined and rearranged regardless of the image content, usable documents are naturally limited.

Further, Japanese Patent Publication No. 61-32712 discloses a technique of extracting a specific article from a plurality of articles and rearranging image data in the specific article. In this case, since the specific articles are extracted by recognizing the document structure and conversational input and the images are rearranged, it is unavoidable that the processing time becomes huge. On the other hand, it has the drawback of being inefficient.

[0006]

As described above, when the image of a specific area is extracted and copied by the conventional copying machine, uniform processing is fixed regardless of the content of the original. Therefore, there is an inconvenience that it is impossible to adaptively form an image for each document or wastes time depending on the document. Therefore, the object of the present invention is to eliminate this drawback,
The optimum image processing is adaptively performed according to each original.

[0007]

In order to solve the above problems, the image rearranging copying machine of the first invention is an image reading means (200) for reading an original image by dividing it into pixels; the read image Rearrangement necessity determination means (242q1) for determining the necessity of rearrangement of image data in the article from the data;
A body line cutout unit (242) that cuts out a plurality of body lines from the read image data in a rectangle congruent with the body line size.
b); a rearrangement executing unit (242r2) that moves and rearranges image data of at least one line of the cut out lines;
Image forming means (280) for forming and outputting image data on a recording medium as a visible image; and text line segmenting means and relocation execution when the relocation necessity determination means outputs a determination of relocation required. And a rearrangement control means (242mp) for automatically selecting a first mode for activating the means and a second mode for prohibiting rearrangement of the image when the determination of the rearrangement is output.

The image rearrangement copying machine of the second invention is
Further, a ruled line cutting means (242k) for detecting a ruled line and outputting this information; and a rearrangement necessity judging means (242q).
1) includes a surrounding article determination means (242q1e) for outputting a rearrangement rejection determination when there is no inter-stage ruled line,
It is configured to prohibit image rearrangement in the case of a boxed article or an article conforming to this.

The image rearrangement copying machine of the third invention is
The rearrangement necessity determining means (242q1) includes an enclave detecting means (242q1f) for detecting whether or not the image data is divided into a plurality of closed areas, and forms a rearranged image when there are a plurality of areas. Is configured as follows.

The image rearrangement copying machine of the fourth invention is
The rearrangement necessity determining means (242q1) includes a blank detecting means (242q1g) for detecting whether or not a blank area exists inside the closed area of the image data, and the blank area exists inside the closed area of the image data. In some cases, it is configured to form a rearranged image.

The image rearrangement copying machine of the fifth invention is
The rearrangement necessity determining means (242q1) is connected to the side number comparing means (2
42q1h) and the number of sides of the article contour polygon is greater than or equal to a specific number, a rearrangement image is formed.

The image rearrangement copying machine of the sixth invention is
The rearrangement necessity determining unit (242q1) includes a concave-convex degree detecting unit (242q1i), and when the ratio of the width and the length of the concave-convex portion with respect to the concave-convex portion of the article contour is a specific value or more, a rearrangement image is formed. To be configured.

The image rearrangement copying machine of the seventh invention is
The rearrangement necessity determining means (242q1) includes an image circumscribing rectangle aspect ratio detecting means (242q1j), and the rearrangement image is formed when the article image circumscribing rectangle aspect ratio is a specific value or more.

The image rearrangement copying machine of the eighth invention is
Image reading means for reading the original image by dividing it into pixels (2
00); Rearrangement necessity determination means (242q1) for determining whether or not the rearrangement of the image data in the specific article is necessary from the read image (242q1); The rearrangement is possible in accordance with a predetermined difficulty regarding the rearrangement of the image data, or Rearrangement availability determination means (242q2) for determining whether rearrangement is impossible; body line cutout means (242b) for cutting out a plurality of body lines from the read image data in a rectangle congruent with the body line size.
Rearrangement executing means (242r2) for moving and rearranging the image data of at least one line of the cut out text line; image forming means (280) for forming and outputting the image data as a visible image on a recording medium; And when the rearrangement necessity determination means outputs a rearrangement necessity judgment and the rearrangement possibility judgment means outputs a rearrangement possible judgment, the text line cutout means and the rearrangement execution means are activated. The first mode,
A rearrangement control unit (242) that automatically selects the second mode in which the rearrangement of the image is prohibited when the determination of the rearrangement is output.
mp) ;.

The image rearrangement copying machine of the ninth invention is
Further, between the image reading means (200) and the rearrangement necessity judging means (242q1), an image trimming means (241t) for extracting a specific portion of the image data read by the image reading means and substantially blanking the others. ) Is provided.

The symbols shown in the parentheses above are for reference only the reference numerals of the elements in the embodiments described later, which have a corresponding relationship with the respective constituent elements of the invention to which they are attached. It goes without saying that the respective constituent elements of (1) should not be limited to the specific configurations shown in the embodiments.

[0017]

In the first aspect of the invention, the image reading means decomposes and reads the original image into pixels, and the rearrangement necessity judging means judges whether or not the rearrangement of the image data is necessary.
When the rearrangement control means outputs the determination of necessity of rearrangement by the rearrangement necessity judgment means, the main body line cutout means and the rearrangement execution means are energized, and a plurality of rectangles congruent with the main body line size are read from the read image data. Of the text line, the cut-out image data is moved and rearranged, and when the determination means outputs a rearrangement failure, the rearrangement of the image is avoided, and the image forming means rearranges the image data or the original data. The image data of is recorded as a visible image and output.

That is, when copying an irregularly shaped article manuscript that is cut out with scissors, a specific area of the article image is appropriately rearranged according to the outer shape of the image, and the contour shape is automatically shaped to output an image. The first mode to be performed and, for example, in the case of an article having a very small outer shape, the second mode in which the article is directly output without being rearranged are automatically selected. In the second aspect of the invention, the ruled line cutting means detects the ruled line, and if the ruled line does not exist, the enclosed article determination means outputs the determination of the rearrangement as an enclosed article or an article equivalent thereto.

That is, in the case of a boxed article or a similar article, the outer shape is rectangular from the beginning, and there are few cases in which it is necessary to rearrange images, and the boxed article has irregular pitches between columns. In addition, rearranging the inside headline or the complicated photo may exceed the processing time that is practically acceptable as a copying machine. Therefore, in such a case, unnecessary image rearrangement is automatically avoided and the second mode is selected.

According to the third aspect of the invention, the enclave detecting means outputs the judgment of necessity of rearrangement when the number of closed areas of the polygon shape information output from the outer shape recognizing means is a specific number or more. Let Thus, for example, when the original image is divided into two or more regions, the plurality of regions are surely merged, the contour shape is automatically shaped, and the image is formed and output. In the fourth invention, the blank detecting means relates to the polygon shape information output from the outer shape recognizing means, and outputs a relocation necessity judgment when a blank area exists inside the closed area of the image data. do. Thus, for example, when there is a blank space caused by an advertisement or the like inside the original image, the blank space can be filled with an image to be erased, and the contour shape can be automatically shaped and image-formed and output.

In the fifth aspect of the invention, the number-of-sides comparing means outputs the determination of necessity of rearrangement when the number of sides of the polygon shape information output from the outer shape recognizing means is a specific number or more. do. By this, the number of constituent edges of the manuscript article outline consisting of orthogonal parallel lines is checked, and if the polygonal shape exceeds a predetermined value, the contour shape is automatically shaped to reduce the number of sides. Image formation can be output.

In the sixth aspect of the invention, the unevenness degree detecting means relates to the unevenness portion of the polygonal shape information output from the outer shape recognition means, when the ratio of the width and the length of the unevenness portion is a specific value or more. If so, the relocation necessity judgment is output. This allows
The sharpness of the irregularities of the manuscript article consisting of orthogonal parallel lines is checked, and if there are thin recesses or protrusions that exceed a predetermined standard, the contour shape is automatically shaped to eliminate the thin recesses or protrusions. Thus, the image formation can be output.

In the seventh aspect, in the case where the image circumscribing rectangle aspect ratio detecting means has a specific value or more with respect to the image circumscribing rectangle aspect ratio of the polygon shape information output from the outer shape recognizing means. Outputs whether or not relocation is required. From this, when the aspect ratio of the circumscribed rectangle surrounding the original image is significantly different from that of the standard size paper, the contour shape can be automatically shaped and the image formation output can be performed in a manner close to the aspect ratio of the standard size paper. ..

In the eighth aspect of the invention, the image reading means divides the original image into pixels and reads them, and the rearrangement necessity judgment means judges from this data whether or not the rearrangement is necessary, and further the rearrangement possibility judgment. The means determines whether or not the rearrangement is possible or impossible based on the predetermined difficulty level regarding the rearrangement of the image data in the specific article from the outer shape data,
When the rearrangement control unit outputs the determination that the rearrangement necessity is necessary for the rearrangement and the rearrangement possibility determination unit outputs the determination that the rearrangement is possible, the text line cutout unit and the rearrangement execution unit are provided. A plurality of text lines are cut out from the image data that has been urged and read in a rectangle that is congruent with the text line size.
The cut-out image data is moved and rearranged, and when at least one of the two determination means outputs the rearrangement failure, the rearrangement of the image is avoided and the image data is recorded and output as a visible image. As a result, even in the case where it is determined that the rearrangement based on the rearrangement standard based on the article outline is appropriate, if the rearrangement based on the content of the article is difficult or exceeds the practically allowable processing time. Is output as is, without relocation.

In the ninth invention, the image trimming means leaves one of the plurality of articles and blanks the other articles, and delivers the image data to the next series of rearrangement processing. This makes it possible to automatically extract a specific article with a box mark from multiple articles such as newspapers at a high speed, omitting scissor clipping work, and consistent with the automatic selection control in the first and second modes. It is possible to improve efficiency.

[0026]

EXAMPLES Examples of the present invention will be described in detail below. First, the outline of the referenced figures will be described. 1 mainly shows the mechanism of one type of digital copying machine suitable for carrying out the present invention, FIG. 2 shows the detailed construction of the image forming portion of the copying machine of FIG. 1, and FIG. 3 shows the copying machine of FIG. 4 shows the functional blocks of the system and the flow of signals, FIG. 4 shows the hardware configuration of the intelligent image processing means, and FIG. 5 shows when the trimming means 241t cuts out one article of a newspaper and forms a copy image on the recording paper. FIG. 6 shows a state, FIG. 6 shows a series of means and a signal flow relating to image formation of cutout relocation copy such as image cutout, peripheral clipping, inclination correction, relocation, and FIG. 8 shows a console screen for doing so, FIG. 8 shows a series of processing procedures for clipping rearrangement copy, FIG. 9 shows processing for recognizing ruled lines in the image of FIG. 5 by the ruled line cutting means 242k, and FIG. Image FIG. 11 shows the recognition-extracted ruled lines and the extra-article extraneous image. FIG. 11 shows a process in which the clip means 242cp erases the extra-article extraneous image in the image of FIG. 5, and FIG. FIG. 13 shows a state in which the image is output on the recording paper after the processing is performed. FIG. 13 shows inclination detection of the read image by the image inclination detection unit 242ag.
14 shows the inclination correction processing of the image inclination correcting means 242rt, FIG. 14 shows a state in which the inclination of the read image is corrected and the image is output on the recording paper, and FIG. 15 shows the rearrangement necessity judgment means 242q1 for the rearrangement necessity judgment means. 16 shows the procedure for cutting out the text and non-text from the text line cutout means 242b, and FIG. 17 shows the text line cutout means 24.
2b shows the process of estimating the text line size from the projected black pixel frequency for each step, and FIG.
2b shows the original image divided into rectangular units congruent to the text line size, and the row number and line number given to the cut-out rectangular division, FIG. 19 shows the data structure of the original arrangement data storage means 242do, and FIG. 20 shows the text. 2 shows a process in which the line segmentation unit 242b discriminates and separates the original image into a text region and a non-text region, and FIG. 21 shows a result in which the text segmentation unit 242b discriminates and separates the original image into a text region and a non-text region.
2 shows a state in which the text line cutout unit 242b distinguishes and separates the original image into a text region and a non-text region in a state of being superimposed on the original image, and FIG. 23 shows a procedure for calculating the image rearrangement of the rearrangement calculation unit 242r1. 24 shows the data structure of the reallocation data storage means 242dr, FIG. 25 shows the process of the reallocation calculation means 242r1 performing the reallocation calculation of the non-text area, and FIG. 26 shows the reallocation calculation means 242r1 of the text area. 27 shows the process of performing the relocation calculation of FIG. 27, FIG. 27 shows the result of the relocation calculation unit 242r1 performing the relocation calculation of all non-text and text regions, and FIG. 28 shows the relocation execution unit 242r2 relocating the image data. 29 shows the process in which the recording size calculation means 242s calculates the recording paper, and FIG. 30 shows the rearrangement execution means 242r2 rearranges the image data. Shows the result of re-draw a line, FIG. 31
Represents the final image that the rearrangement executing means 242r2 rearranges the image data, and the recording size calculating means 242s adds bibliographic items and outputs to the recording paper.

The symbols used in this embodiment are defined as follows.

R: red (red), G: green (green),
B: blue (blue), C: cyan, M: magenta, Y: yellow, K: black, LED: light emitting diode, LEDA:
Light emitting diode array, CCD: charge coupled device, SC:
Image reading means (also called scanner or scanner module), PR: image forming means (also called printer or printer module), MO: magneto-optical disk, MOD: magneto-optical disk drive, SCON: system control means (also called system controller) (Structure of Module) The copying machine shown in FIG. 1 is roughly divided into two parts (this is called a module) in view of its mechanism. One is a scanner module (symbol SC) 200 including image reading means, and the other is a printer module (symbol PR) 280 including image forming means. The rear end of the scanner module SC200 is rotatably coupled with a hinge 200h at the upper rear end of the printer module PR280.

(Functional Block Structure) FIG. 3 shows a structure obtained by dividing this copying machine in terms of functions. Referring to FIG.
The image reading means SC200 and the image forming means PR2
In addition to 80, basic image processing means 241, intelligent image processing means 242, external device connection systems 286N, 286, 287,
288, console 250, and system control means (symbol SCON) 285 are provided. The former two image processing means are inside the SC200, and the console is the SC200.
Is connected to the external device connection system 286N, 286,
287, 288 and SCON 280 are arranged inside the PR 280.

(Schematic Function and Signal Flow for Each Functional Block) In FIG. 3, arrows between the functional blocks represent the flow of image signals or control signals. System control means S
The CON 285 has a function of integrally controlling the entire copying machine system, and other subsystems constituting the present system, such as SC, PR, or intelligent image processing means 242.
Communication means SCONi represented by thick arrows for etc.
The system is controlled while sending and receiving commands and responses via n and SCONout. Further, when an optional module such as a document feeder and a sorter is added, it has a function of controlling the optional module as well.

The console 250 has a function of outputting a message to the operator of the copying machine and inputting various commands to the copying machine. Image reading means SC
Reference numeral 200 denotes a color original image reading function, and R (red), G (green), B (blue) is supplied through the original image reading circuit 207a.
The image signal is output to the basic image processing means 241 and the image memory means 243. The basic image processing means 241 uses the original image R
It has a function of performing image processing on the GB signal and converting it into a C (cyan), M (magenta), Y (yellow), K (black) image forming signal, and a CMYK signal is output to the printer module PR28.
0 or output to the image memory means 243. The printer module PR280 includes a recording interface circuit 212.
A visible image is formed on the transfer paper based on the CMYK image signal input to a.

External device connection system 286N, 286, 287
And 288 have a function of receiving an image signal or a character code signal from outside the copying machine, converting this signal into a CMYK recording signal and sending it to the PR 280. The mode of image reproduction in this manner is called a printer mode, and the mode of image reproduction of an original read by the SC200 is called a copy mode.

The image data storage means 243 has a function of storing RGB data for one original image or CMYK data for one copy. The intelligent image processing means 242
It has a function of performing advanced image processing on the image data in the image memory means 243. Here, the intelligent image processing means 242 and the image storage means 243 are shown in a slightly schematic form in order to facilitate understanding of the logical signal transfer relationship. The image file means 240 is specifically suitable for a magneto-optical disk device MOD, and has a function of storing image data and an intelligent image processing program in a removable magneto-optical disk MO.

(Detailed Configuration of Scanner Module SC200) The scanner module SC200 includes a scanner control circuit 200c, a platen glass 202, a first carriage 208, a second carriage 209, and an original illumination lamp 203.
a, 203b, first mirror 204a, second mirror 204
b, third mirror 204c, imaging lens 205, CCD color image pickup device 207, original image reading circuit 207a,
Magneto-optical disk drive 240, basic image processing means 24
1, intelligent image processing means 242, image data storage means 24
3, an original image scanning motor 210, a console device 250, an operation panel 251 including a transparent touch switch mounted on the console and liquid crystal display means.

(Image reading operation of the image reading means SC200) In the image reading SC200, the original image is sampled at a sampling density of 1/16 mm in both main scanning and sub-scanning, and the three RGB colors are quantized into 256 gradations and read. It has a function.

First, the original image is placed on the platen 202 with the copy surface facing down. The imaging lens 205 images the original image on the light receiving surface of the CCD 207 in a reduced size. CCD 20
Reference numeral 7 denotes a color imaging device, which is covered with a red filter and has an R imaging section in which 4752 pixels are one-dimensionally arranged, a G imaging section in which a green filter is covered with one-dimensionally arranged 4752 pixels and a blue filter is covered with a 4752 pixel. The B image pickup unit in which pixels are arranged one-dimensionally is arranged in parallel in three columns. In FIG. 1, 202ar, 202ag, and 202ab represent the positions of the R, G, and B image reading scanning lines on the platen 202 in a slightly exaggerated manner. In reality, the three scanning lines are almost close to each other. Specifically, it is equivalent to the interval being 3/16 mm. The CCD 207 is 16 pixels / m in terms of the original image for one main scanning line of each color projected by the lens 205.
It is decomposed into m, sampled and read. Illumination lamp 103a,
b and the first mirror 104a are mounted on the first carriage 208, and the second mirror 104b and the third mirror 104c are fixed to the second carriage 209. When reading an original image, the first carriage is scan-driven by the sub-scanning speed Vsub and the second carriage is driven by the original-image scanning motor 210 at a speed of Vsub / 2 while maintaining the optical conjugate relationship.
The CCD 207 outputs an analog voltage corresponding to the RGB reflected light in pixel units from the original image, and is quantized into an 8-bit digital signal, that is, 256 gradations by the reading circuit 207a. The reading circuit 207a also has a monochrome binarization mode for simply binarizing and outputting the monochrome density of the original image signal when receiving the monochrome binarization processing command from the SCON 285. This mode is mainly useful for efficient intelligent image processing of text images and the like. The image data thus quantized for each RGB is sent to the basic image processing means 241 and the image data storage means 243.

(Basic image processing operation) The original image RGB image information read as described above is converted into basic image processing means 241.
Entered in. The functions of the basic image processing means 241 are divided into two categories. The first category is a function for supporting the image operation instead of directly operating the image signal. For example, an image area separation process for distinguishing and separating a character region and a gradation image region, a document size detection process, a color document /
There is a black and white document identification process. In this category of processing, for example, all original image information on the platen 202 needs to be checked, such as document size detection, and some require so-called prescanning before copy image formation.

The second category is processing for manipulating image signals, such as scaling, image trimming, image movement, color correction,
Image processing such as gradation conversion. The processing in this is further the same as the processing content common to the image area, for example, scaling,
Those which are different in the image area, for example, are classified into gradation processing.

Most of the processing results of the first category are transmitted to the system control means SCON285. Upon receiving this, the SCON 285 issues a control command to other means based on this and advances the image forming process. For example, the image processing means 2
If 41 determines that the original is monochrome black and white, this is S
The SCON 285 is transmitted to the CON 285 and the image forming unit P
The control unit 280c of the R280 displays "K developing bias, CMY
Send the command "Stop development". Then, the printer control unit 280c energizes only the K developing device 220K to stop the development of other colors and efficiently form an image.

The image processing content of the second category may be automatically activated by the processing result of the first category, may be designated by the operator from the console 250, or may be a combination thereof. .. An image trimming process will be taken as an example of these processes. Image trimming is a process to remove the inside of the felt pen mark attached to the original image and blank the outside,
This is achieved by the image trimming means 241t included in the basic image processing circuit 241. Incidentally, this technique is disclosed in JP-A-62
The details are disclosed in Japanese Patent Publication No. 159570.

In any case, the RGB image signals input to the circuit 241 are finally converted into recording signals C (cyan), M (magenta), Y (yellow), K (black), It is input to the recording interface circuit 212a which is the input unit of the image forming means PR280. When the original is identified as a black and white original, 0 except for the K signal.
Is output.

(Hardware Configuration Related to Intelligent Image Processing) FIG. 4 shows in detail the hardware configurations of the intelligent image processing means 242 and the image data storage means 243. The reference numerals starting with 242 indicate the elements forming the intelligent image processing means.

In FIG. 4, 242 CPU is a 32-bit RISC or CISC type microprocessor unit (hereinafter CPU), 242bus is a 32-bit bus, 242 DMA is a direct memory access controller (hereinafter DMAC), and 242 SCONIF is SCON.
Interface means for connecting to the communication means SCONout, SCONin of FIG.
3a corresponds to an image signal interface unit for connecting to an image signal output unit of the scanner system SC, and 242PRIF corresponds to an image signal input unit of the printer system PR corresponding to 243b of FIG. 3 or a basic image processing unit 241 equivalent thereto. Image signal interface means 242 dc for connection with a magneto-optical disk controller, and 242 m memory means for storing programs and the like.

242 mem is further 242 m according to use
1,242m2,242m3,242m4 and 242m
It is divided into 5. 242m1 is a semiconductor ROM that stores programs, 242m2 is a ROM that stores fixed data, and 242m3 is a RAM with a backup power supply.
, Semi-fixed data is stored, 242m4 stores variable data in RAM, and 242m5 stores work data in RAM.

The image data storage means 243 is a semiconductor RA.
It is composed of M and is mapped to a part of a space capable of linear addressing of a bus 242bus of 242 CPU, and is placed on an equal footing with other memory 242m when viewed from the 242 CPU. The image input / output units 143a and 143b of the image data storage means 243 in FIG. 3 are not directly connected to the memory 243, but the interfaces 242SCIF and 242PRIF are connected to the bus 242bus as described above, and the image memory 243 is also connected to this. It is connected to the bus. 242 CPU between these two
The image data can be transferred by the data transfer command of No. 2, and the 242 DMA occupies the bus, and high-speed transfer that can follow the image reading speed and the recording speed is also possible. It is assumed that the two are connected under such a background, and it is simply expressed in FIG.

(Intelligent Image Processing Operation) Here, "intelligent image processing" refers to image processing for exhibiting advanced functions other than those conventionally provided in copying machines. When performing intelligent image processing, the reading circuit 107a for reading the original image information is read because it is not easy or rational to perform the function only by the proximity processing.
The data from is temporarily stored in the image data storage means 143,
Based on this information, the intelligent image processing means 142 performs image processing, converts it into recording information, sends the recording data to the laser recording control circuit 112a which is an input portion of image formation, and forms a visible image on the recording medium. To do it.

Therefore, when performing intelligent image processing, there is a slight time delay between the reading of the original image and the output of the copy image. Further, when performing intelligent image processing, the image data read by the SC 200 is temporarily stored in the image data storage means 143.
The image is stored in the intelligent image processing means 142 and is subjected to image processing by the intelligent image processing means 142. The two means are the basic image processing means 2 as shown in FIG.
41 in parallel and equal relationship. This is useful for allowing interruption of general copy processing during intelligent image processing that requires a relatively long processing time. This is called interrupt copy.

When performing intelligent image processing, it is possible to combine basic image processing. At this time, the input data of the image data storage means 143 is read by the reading circuit 1.
It is obtained from the output of the basic image processing circuit 141, not from the output of 07a.

(Structure of Printer Module PR280)
In the printer module PR280, 201 is a power switch, 285 is a system controller (symbol SCO
N), 286 is an external interface circuit, 286N is an external device connection connector, 287 is an interface memory,
288 is a bit map development circuit, 280c is a printer control circuit, 222a is a paper feed cassette, 222b is a paper feed tray, 223a and 223b are paper feed rolls, 224 is a register roll pair, 218 is a photoconductor drum, 219C, 21.
9M, 219Y and 219K are charged scorotrons, 21
2C, 212M, 212Y and 212K are light emitting diode arrays (abbreviated as LEDA), 212a is a recording interface circuit, 212b is a delay memory circuit, 212aC,
212aM, 212aY and 212aK are recording control circuits, 214C, 214M, 214Y and 214K are converging optical transmitter arrays, 220C, 220M, 220Y and 220K are cyan, yellow, magenta and black developing devices, respectively, and 229 is a transfer corotron. 221 is a cleaning device, 221t is a waste toner tank, 221c is a static eliminating corotron, 230 is a separation conveyance belt, 230c is a belt cleaner, 236 is a fixing roll, 237 is a fixing backup roll, 238b is a discharging roll, 238 is a discharging switching roll, 272. Is a double-sided tray, 273 is a double-sided feeding roll, 277a, 277b and 277c are pairs of transport rolls, and 273a is a stacking roll.

(Detailed Structure of Image Forming Section) Referring to FIG.
The photoconductor drum 218 and the internal configuration will be described in detail. The inner side 218g of the photoconductor drum 218 is LEDA212.
It is a glass tube having good transmissivity for emission wavelengths of c, m, y, k, for example, 720 nm. A transparent conductive layer and an organic photosensitive layer (OPC) are provided on the outer surface of the glass tube. The transparent conductive layer is grounded to 0 potential of the copying machine.

A fixed exposure module is arranged inside the rotating drum. This module is a thermal conductor 21
2s, heater 218h, heat pipe 218p, recording interface circuit 212a, delay memory circuit 212b,
Recording control circuit 212 dC, dM, dY, dK, LEDA
212C, M, Y, K, Focusing optical transmitter array 214
It consists of C, M, Y and K. LEDA212C, M,
Each of Y and K has a structure in which 14256 light emitting diodes are one-dimensionally arrayed in a direction perpendicular to the plane of the drawing, the light emitting point density is 48 dots / mm, and the light emitting shape is long in the array direction and orthogonal to this. It is a flat ellipse with a short direction. The present light emitter has a structure in which a plurality of divided semiconductor chips are mounted on a ceramic substrate.

The light emitting point P1 of the LEDA and the exposure point P2 of the photoconductor 218 are assembled by adjusting the position of the converging optical transmission body array 214 so as to maintain an optical conjugate relationship. The delay memory circuit 212b electrically includes a recording interface circuit 212a and recording control circuits 212dC and 212d.
It is a circuit arranged between M, dY, and dK and delays the MYK signal of the CMYK four-color image signals input to the circuit 212a by a predetermined amount with respect to the C signal. The delay amount is from the exposure position P2 of C to the exposure points P2m and P2 of M, Y, and K.
This is the time required to move each circumferential distance up to y and P3k.

(Image forming action of the image forming means PR280)
The image forming means PR280 is the recording interface circuit 2
Based on the recording data of 256 gradations with a pixel density of 1/16 mm for both main scanning and sub-scanning for each color of CMYK input to 12a, CMY for both main scanning and sub-scanning is performed on the transfer paper.
A full-color visible image composed of a dot pattern with a recording dot density of 1/48 mm for each color K is formed and output.

When the image forming cycle is started, first the photosensitive drum 218 is rotated counterclockwise by the drive motor 211. With the rotation, C latent image formation, C toner image formation, M latent image formation, M toner image formation, Y latent image formation, Y toner image formation, K latent image formation, and K toner image formation are performed, and finally. Toner images are formed on the photoconductor in the order of CMYK. First, C image formation is performed as follows. The charging corotron 219C uniformly charges the photoconductor drum 218 with negative charge to −700 V by corona discharge. Subsequently, the LEDA 212C performs raster exposure based on the C signal. The recording signal for image formation is supplied from the image processing means 241 in the general copy mode and from the image memory 243 in the special copy mode including the intelligent image processing.

The input recording signal is the recording interface circuit 1
12a, and the recording control circuit 212dC controls the light emission of the LEDA 212C for each input pixel based on the recording signal. As a more specific example, when the maximum C density pixel is used, the LEDs corresponding to 3 in the main scan and 3 in the sub scan emit full light, and in the case of a white pixel, no light is emitted. Light is emitted in proportion to the number of LEDs or the time. When the raster image is exposed in this way, the exposed portion of the photoconductor drum 218 that is initially uniformly charged loses the charge proportional to the amount of exposure light, and an electrostatic latent image is formed.

The toner in the developing device 220C is negatively charged by the doctor blade 212Cd, and the developing roller 212Cm of the developing device 220C has a negative DC potential with respect to the metal base layer of the photosensitive drum 218 by a power source means (not shown). And AC are biased to a superposed potential. By doing so, the toner does not adhere to the portion of the photoconductor 218 where the electric charge remains, and the C toner is adsorbed to the non-charged portion, that is, the exposed portion, and a C visible image similar to the latent image is formed. Will be formed. Note that such a developing method may be called a reversal developing method.

Next, M image formation is performed as follows. The charging corotron 219M negatively charges the drum 218 on which the C toner image is placed by -700 V by corona discharge.
Uniformly charged. The LEDA 212M performs raster exposure based on the M signal. The M recording signal for image formation is
Although the signal was input at the same time as the C signal at the time of input to the recording interface circuit 212a, the delay circuit 212b reached the recording control 212dC with a delay corresponding to the distance between the C exposure position and the M exposure position. Therefore, based on this delayed signal, LE
If the DA 212C is controlled to emit light, the C toner image formed by the single sample point data with the original image and the M image exposure position will exactly overlap. When the M raster image is exposed in this manner, the photosensitive drum 2 which is initially uniformly charged
In the exposed portion of 18, the electric charge proportional to the exposure light amount disappears and an electrostatic latent image is formed. M in the developing device 220M
The toner is negatively charged, and the developing roller 212Mm of the developing device is not in contact with the photosensitive drum 218, but is biased to the same potential as in the C developing. Therefore, the toner does not adhere to the portion of the photoconductor 218 where the electric charge remains, and the M toner flies and is attracted to the M exposed portion to form an M visible image similar to the electrostatic latent image. Becomes

Similarly, the Y image is on the CM toner image,
The K image is formed so as to be superimposed on each of the CMY images. The basic image processing circuit 241 is UCR (undercolor removal)
Since the processing is performed, there is little chance that one pixel is developed with toner of all four colors. In this way, the photoconductor 2
The full-color image formed on 18 is rotatably transferred to the transfer unit. On the other hand, at the time when image formation is started, the transfer sheet is fed by the feeding action of the feeding rolls 223a, 223b, 223c from any of the three feeding units, that is, the cassette 222a, the sheet feeding tray 222b or the double-sided tray 272, It is waiting at the nip of the register roll pair 224.
When the front end of the toner image on the photoconductor 218 reaches the transfer separation corotron 229, the register roll pair 224 should be positioned so that the front end of the transfer paper coincides with the front end of the image.
Is driven to perform registration registration between the paper and the image.

In this way, the transfer paper is superposed on the toner image on the photoconductor and passes under the transfer separation corotron 129 connected to the positive potential power source. At this time, the transfer paper is positively charged by the corona discharge current, and most of the toner image is transferred onto the transfer paper. Then, when passing through the separation belt 230 connected to the separation power source, an attractive force stronger than the attraction force between the photoconductor 218 and the transfer paper acts between the belt and the transfer paper,
The transfer paper is peeled off from the photoconductor 218 and transferred to the transfer belt 230.

The transfer paper on which the toner image is placed is the transfer belt 2
It is sent to the fixing roll 236 by 30. At this time, heat and pressure are applied to the heated nip portion between the fixing roll 236 and the backup roll 237, the toner is melted and the fibers of the transfer paper are trapped in the image, and the image is fixed. That is, the copy image is completed. The completed copy is then sent out of the main body by the discharge roll 238b and the switching roll 238. The ejected copy papers are stacked in a tray (not shown) in the order of pages and face down. Further, in the case of double-sided copying, it is possible to move the switching roll 238 to 238a indicated by a broken line to guide the transfer paper to the double-sided tray 272,
The transfer paper copied at this time is the transfer roll pair group 277.
After passing through a, b, and c, they are stacked on the double-sided tray 272 with the copy side up. There is an opening at the top of this double-sided tray so that the stacked paper sheets can be easily taken out in a normal operation posture. It can be used as a tray. A small amount of untransferred residual toner on the photoconductor 218 is cleaned by the cleaning device 221 in preparation for reuse of the photoconductor 218. The toner collected here is stored in the waste toner tank 221t via the collection pipe 221p.

(Problems of prior art cutout copying) This copying machine has a function called "cutout rearrangement copying function" as one of the intelligent image processing functions.

The image trimming means registered in the basic image processing means 241 uses the technology disclosed in Japanese Patent Laid-Open No. 62-159570, and the image obtained as a result of this processing is as shown in FIG. Here, 222p is a recording paper, item is a copy image of a specific article, medium-thick broken line item_box is a virtual line for indicating an image range of a specific article, and a thick broken line indicated by mark is an image extraction drawn with a felt pen or the like ( A frame showing a trimming range. This frame image can be deleted in the actual copy. The image item is a single newspaper article whose surroundings are filled with other articles and advertisements in the manuscript. The part indicated by noise in the figure is a surrounding image outside the desired copy article item, which is a noise image that is not originally desirable. The article image item is title
Heading indicated by e, halftone dot photo image indicated by photo, fi
It is composed of a line image indicated by g, a ruled line indicated by line, a body image indicated by string, and a blank indicated by space. In general, other constituent elements of a newspaper article include an abstract text and a headline. Dotted lines indicated by dpr1 and dpr2 are ranges overlaid on the document by the operator with a felt-tip pen of a specific color to extract the search word.

There are the following problems when viewing a copy image only by this conventional technique.

(1) Image te on the recording paper 222p
m is tilted. This is because the document used for trimming copy is generally large in size in many cases, and it is difficult to place the document.

(2) A noise image noise is formed around the image item to be extracted. This is a result of the fact that when pen is used to enclose an article, the psychology of avoiding the loss of the article image is widened and encircled, and it tends to occur frequently.

(3) A single article item is item (1
/ 2) and the item (2/2) are scattered in two places, which makes it difficult to read.

(4) The article image item has many irregularities and is hard to read.

(5) A single article item is item (1
/ 2) and the item (2/2), and since there are many irregularities, a recording paper of a size larger than necessary for the image area is required.

(6) The circumscribed shape of the article image item and the shape of the recording paper are remarkably different from each other, which gives an uncomfortable feeling to the eyes when the two are accustomed to general documents that are similar.

(7) The source of the article is not clear because there is no journal name or date.

Further, although it is not always clear only by the example of this figure, when many newspaper articles are examined, (8) unnecessary images such as advertisements are included in a single article, or blanks remain after deletion. I will end up.

The above problem occurs when an article is surrounded by a felt pen on the surface of a newspaper and is automatically cut out. In addition to this, there is also a method of cutting out the magazine surface with scissors like the pen locus and copying it, but the same problem occurs.

The copying machine also includes image file means 240.
It is possible to record and store a read image on a detachable magneto-optical disc, and reattach the disc at an arbitrary time to obtain a hard copy on a recording paper. Another C
The disc recording medium can be provided to a search system having an RT image display function.

In the prior art, even in such a usage environment, the same problem as in the copy image generation was involved. That is, when the cutout image is displayed on the CRT, various problems such as image inclination, unnecessary ambient noise images, enclaves, various image frame shapes, and useless blank portions occur. Since the number of display pixels of the image display means such as a CRT is much smaller than the number of pixels of hard copy, the above problem was more serious due to an extremely large number of scroll operations. For example, in a CRT, it is often difficult to display all article images at the same time due to the limitation on the total number of pixels.
The existence of the enclave is obvious on the recording paper, but the CRT also requires a search for the existence itself, which is a major obstacle to the search operation.

(Structure of Means Relating to Cutout Rearrangement Processing) In the copying machine of the present invention, in order to solve various problems that occur when an original is cut out and copied by the conventional automatic image trimming or scissors, It has a plurality of means shown in FIG. Each of these means is driven in accordance with the procedure shown in FIG. 8 to finally form and output the cut-out rearranged copy image shown in FIG. Alternatively, it is recorded in the recording medium MO of the image file means 240.

The following is a description of the overall outline and the detailed construction and operation of each means.

(Screen of Console 250) The operation panel 251 of the console means 250 is 640 dots × 400.
It has a structure in which a transparent 2D touch switch with 32 × 20 contacts is stacked on a dot liquid crystal display. There are a plurality of screens for each mode of copy contents, which are hierarchically switched and displayed. FIG. 7 is a mode setting screen for cutout rearrangement copy. Here, the buttons that can be input by being pressed by the operator are displayed in a rectangular shape, and the button for which the input has been accepted becomes darker in color.

A copy mode button 251e selects a mode in which a recorded image is read from the original on the platen 202 or the magneto-optical disk MO240 and an image is formed on the recording paper 222p. The original on the platen is selected when 251f remains white, that is, when 251e is valid and only 251e is valid. When 251f is valid together with 251e, MO2 is selected.
Image data is read from 40 and imaged.

251f is a file mode selection button. The action when this button is pressed together with 251e is described above. When this button 251f is individually selected, a mode in which the image of the original 202a on the platen 202 is cut out and rearranged and recorded on the MO 240 is activated.

251h1 to 251h6 are buttons for designating the magazine name or type of newspaper, and one of them, 251h2 in FIG. 7, is valid. Each of these buttons is associated with peculiar column rule information, which serves as a clue for ruled line cutout processing and text cutout processing described later. It is also referred to when the recording size calculation means 242s performs the magazine name insertion process.

251i and 251i3 are buttons that are alternatively effective and are used to specify the recording paper. When 251i3 automatic is selected, the optimum recording paper is selected and fed from the feeding means 222a and 222b according to the size of the rearranged image. When the provided paper size is inappropriate, a message "Please insert XX size paper" is displayed on 251d. 251i1 is used when designating the recording paper size, and the designated size is displayed on the upper part 251i2. The display is such that different sizes are sequentially displayed each time the button 251i is touched.

Numeral 251j is a copy magnification selection button, and it is possible to select a forced designation of a plurality of types of magnification and a mode in which an optimum magnification is automatically calculated from recording paper and paper size. The automatic button next to it is a button that automatically performs an appropriate scaling according to the paper size.

Numeral 251k is a button for selecting and inputting the direction of the vertically written text and the orientation of the recording paper in the same direction, and the automatic button next to it is automatically determined to the orientation of the recording paper in accordance with the text line direction. Button. With 251k, either portrait orientation or landscape orientation can be selected. If automatic is selected, one direction set as a default in advance is set. The factory setting is vertical orientation, but it can be changed according to the user's preference. When the default setting of fixed orientation or automatic is portrait orientation, the image is formed so that the direction of the text line and the longitudinal direction of the recording paper match, and when the orientation is vertical, the lateral direction of the recording paper matches. Form an image. Further, the image is rearranged and shaped so that the outer shape of the image is always approximately proportional to the aspect ratio of the recording paper. In other words, in the case of portrait orientation, hold the chart paper vertically when reading the copy image, look at the article with a vertically long frame outline, set it to landscape orientation, and set the chart paper horizontally when reading the copy image. It means reading flat articles in the horizontal direction.

A specific example will be shown here. In FIG. 5, the original image circumscribed rectangle is shorter in the text direction than in the orthogonal direction, that is, a horizontal original document here. Start button 25 with the settings in Figure 7
When 1c is pressed, the direction setting button 251k is in the active state of "automatic" and this default is set to portrait orientation.
A copy as shown in FIG. 31 is obtained. Here recording paper 2
The longitudinal direction of 22p coincides with the text direction.
It can be seen that the article frame shape surrounded by ne11 and line15 is rearranged and shaped almost in the aspect ratio of the recording paper. Conventionally, there is a method of determining the size and direction of the recording paper according to the size of the original paper and trimming image, but this copier can specify the direction of the text line and the direction of the recording paper, and it becomes a multi-page binding booklet. Sometimes I can continue reading the booklet without rotating it.

Reference numeral 251m is a selection button for inserting a magazine name on the copy. When 251 m3 OFF is selected, no journal title is inserted. 251 m1 switches between "registered image" and "standard character" each time it is touched. When the "standard character" is selected, an insertion character is formed from a character generator provided inside the copying machine. When the "registered image" is displayed, a 251g magazine name registration button which is not normally displayed is displayed. Further, 251e and 251f are in a disappeared state. If the same button is touched here, the copying machine is ready for magazine name registration. Next, if an image to be inserted is placed on the platen 202 and the start button 251c is touched, the SC200 reads this and is stored in the semi-fixed data storage means 242m3 as inserted image data associated with the magazine name 251h2 active at that time. It

Similarly, 251n is a date insertion button, and 251o is a button related to search word insertion selection. A button 251b is used to return the screen to the upper layer of the main sampling and reallocation copy mode screen. 251c is a start button, 251
The action changes depending on the states of e, 251f, and 251g. When only the copy button 251e is valid, the cut-out rearranged copy image of the original 202a on the platen 202 is formed on the recording paper 222p and output. When the copy button 251e and the file button 251f are valid, the image in the MO 240 is recorded and output. When only the file button 251f is valid, the cut-out rearranged image of the original 202a on the platen 202 is written to the MO 240. When the magazine name registration button 251g is effective, the original image 202a is the semi-fixed data storage means 24 as described above.
It is stored in 2m2.

(Relocation Control Means 242mp and Flow of Overall Processing) The relocation control means 242mp communicates information for performing relocation copying with the system control means 285 and organically attaches other various means. It has a function for controlling the power and is arranged in the program storage means 242m1. Further, the control data storage means 2 in which the data necessary for these controls are arranged in the work data storage means 242m5.
It is held at 42 dmp.

In this case, only the copy button 251e in FIG. 7 is effective, that is, the original 202 on the platen 202.
An example of forming and outputting the cut-out rearranged copy image of a on the recording paper 222p will be described. When the cut-out rearranged image of the original is recorded and output to the image file MO240, the rearrangement algorithm is the same as that for paper output, but the arrangement parameters such as the aspect ratio are rearranged in a format suitable for CRT display. It Further, in order to contribute to searching and re-editing at another time point, not only the image data but also the image type and arrangement information for each section and the search word information are added and recorded in the image file.

Please refer to FIG. 6 and FIG. After the start button 251c is touched, the reallocation control means 242m
First, p receives the rearrangement condition from the SCON 285 and stores it in the rearrangement condition storage means 242dc. The relocation condition is set by the operator in the cutout relocation copy setting screen 2 of FIG.
The condition is set by using 51. In addition, after the start button 251c is touched, the message 251d on the operation panel 251 changes to "copying, please wait for a while" until the copy is completed.

Next, the rearrangement control means 242mp is SCON
Send image acceptance signal to 285
Urges the image reading means SC200 to activate the original image 202a.
Read the entire image of. The read image data is image trimming means 241t in the basic image processing means 241.
When passing through, the trimming processing of the same means is performed, and the outside of the mark image mark as shown in FIG. 5 is blanked.

In the cut-out rearrangement copy mode, it is assumed that the target document is mainly a newspaper. Newspapers are mostly black and white monochrome images, with characters, line drawings and 7
As a result of experiments, it has been found that a beautiful copy reproduction is possible without using multi-value gradation processing, which is composed of coarse halftone dot photographs of about 5 lines / inch, and which is intended for faithful reproduction of grayscale images. Therefore, in order to simplify the subsequent processing and shorten the copy generation time, in the cut-out rearrangement copy mode, the gradation processing circuit of the basic image processing means 241 is simple in black and white, except for a separate processing relating to search word mark detection, which will be described later. The binary mode is activated.

The image data that has been trimmed in this way and binarized in a single color (black) is stored in the image data storage means 24.
Written in 3. The specific color extraction circuit 241c of the basic image processing means 241 also separately extracts the specific color. Therefore, the dpr1 and dpr2 regions in FIG. 5 which are colored by a specific color, for example, M for the operator to extract the search word, are written in the image data storage means 243 as rough bitmap color data. In this way, the black binarized image information lacks the light specific colors dpr1 and dpr2, complete original image information with a fear of noise is stored in the K area of the image data storage unit 243, and the specific color extraction circuit is also present. The specific color area is also completely extracted by the action of 241c and is separately stored in, for example, the M area of the image data storage unit 243.

Even when the original is cut out into a shape as shown in FIG. 5 using scissors and placed on the platen 202 to read an image, image data equivalent to the above is stored in the image data storage means 243. It That is, one of the features of this copying machine is that the subsequent image clipping, inclination correction, and rearrangement processing can be performed without any problems.

Next, the rearrangement control means 242mp activates the ruled line cutting means 242k, and the image data storage means 24
The image information of 3 is given to detect a field separator such as a ruled line or a column break space of a column. Information on the detected ruled lines and field separators is stored in the ruled line information storage unit 242dk. Then, the rearrangement control means 242mp activates the outer circumference clipping means 242cp. In the same means, together with the image information of the image data storage means 243, the ruled line information storage means 242dk formed in the previous stage.
Gives the ruled line information inside. Then, the outer peripheral clip means 242
cp is the ambient noise image no outside the specific article item in FIG.
The erase is erased and the image data in the image data storage unit 243 is updated.

Recording paper 22 is formed by forming an image of this image data.
When output to 2p, it becomes as shown in FIG. Compared to FIG. 5, it can be seen that the noise part around the article is completely removed. There is also a possibility that the recording paper size can be made smaller than the original size.

Next, the rearrangement control means 242mp activates the image inclination detection means 242ag, and the ruled line information storage means 24.
The ruled line information within 2dk is given. The same unit detects the tilt of the image and returns the tilt information to the rearrangement control unit 242mp. The rearrangement control unit 242mp which has obtained the image tilt information,
It is determined whether the inclination is within the allowable range. The permissible range is determined from a level that does not cause visual discomfort and a range that does not interfere with cutting out a text line described later. If the inclination is outside the allowable range, the rearrangement control means 242mp
Drives the image inclination correction means 242rt to rotate and correct the image data in the image data storage means 243. For example, the image in FIG. 5 is a case where the tilt exceeds the allowable range and is a target for correction. FIG. 14 shows an image formed by the image data in the image data storage unit 243 and output to the recording paper 222p at the stage where the inclination correction is completed. Compared to FIG. 5, the noise part is completely removed, and the article image i
It can be seen that the circumscribed side of the tem is parallel to the recording paper 222p.

Next, the rearrangement control means 242mp drives the outer shape recognition means 242s1. External shape recognition means 2
42s1 is a black pixel distribution state and ruled line information storage means 24.
The outer shape information is created by checking the ruled lines in 2dk, the number of closed image areas based on the field separator information, the shape of each area, and the presence of white space inside the image.

Next, the rearrangement control means 242mp drives the rearrangement necessity determining means 242q1. It is determined whether rearrangement of the outer image is necessary or not, and the determination information (rearrangement required flag) is returned to the rearrangement control unit 242mp. When it is determined that the rearrangement is unnecessary, the rearrangement necessity determining unit 242q1 determines whether or not the image that is further cut out, clipped on the outer periphery, and whose inclination is corrected enters the copy sheet, and the rearrangement control unit 242mp determines this information. Return to. If the rearrangement required flag is not returned to the rearrangement control means 242mp,
The rearrangement control unit 242mp skips a series of processing units for rearrangement and shifts the process to the recording size calculation.

When the rearrangement control means 242mp receives the rearrangement required flag, the text cutout means 242b is activated. The means 242b firstly cuts out and clips the outer circumference, and corrects the tilted image to the article text string.
Rectangle of the size of one line is divided by a grid mesh. Note that the cutout rectangle for one line of the text is also called a section. Secondly, the same means 242b recognizes the text or non-text (headings, abstracts, photographs, figures, etc.) for each divided rectangle, and stores the recognition information in the original arrangement data storage means 242do.

Next, the rearrangement control means 242mp activates the rearrangement availability determination means 242q2. The means checks the image type arrangement information of the original image stored in the original arrangement data storage means 242do. If it is determined that the original image has a structure that is not suitable for rearrangement, the series of processing means for rearrangement is skipped and the processing is shifted to recording size calculation. Also,
If it is determined that the original image has a structure suitable for rearrangement, the rearrangement calculation processing means 242r1 is activated. The activated rearrangement calculation processing means 242r1 checks the image type for each section of the original image stored in the original arrangement data storage means 242do and the connection condition, and generates rearrangement data according to a predetermined algorithm. The generated rearrangement data is stored in the rearrangement data storage unit 242dr.

Then, the rearrangement control means 242mp drives the rearrangement execution means 242r2. Reallocation execution means 242
r2 refers to the rearrangement data storage means 242dr and the original arrangement data storage means 242do, and refers to the image data storage means 2
The image data in 43 is moved and rearranged in units of divided rectangles to update the stored data in the image data storage means 243. If there is a ruled line to be inserted, ruled line data is created and added to the image data storage unit 243.

The rearranged image is quite different from the circumscribed shape originally read and trimmed by the SC200.
Further, even if the rearrangement is not performed, even if the original planned recording paper has a protrusion, it often fits in another size and image formation recording is possible in many cases. Then, the recording size calculating means 242s is driven to calculate an appropriate recording paper size. Further, the means 242s also performs a process of inserting a magazine name, a date, and a search word, and executes these additional processes in the image data storage unit 243. When the size calculated by the recording size calculation means 242s is returned to the rearrangement control means 242mp, it is determined whether or not the scaling process is required. When scaling is required, the image scaling processing means 242m is driven to scale the image data in the image data storage means 243.

Subsequently, the rearrangement control means 242mp sends the existence address of the image data of one article which has been processed so far and the image formation request signal to the SCON 285. Upon receiving this, the SCON 285 gates the image data of the address portion of the image data storage means 243 and sends it to the image forming means 280, and the image forming means 280 forms this as a visible image on the recording medium 222p and outputs it. .. FIG. 31 is an image output in this way. If you look at this,
It will be obvious that the intended purpose will be achieved.

Data read by the SC 200 at one time may include a plurality of articles. When there are multiple articles, this copier reproduces them on different recording sheets. Therefore, the rearrangement control unit 242mp executes a routine for determining whether or not the output of all articles has been completed. When all articles are not completed, another article different from the previous one is targeted for processing, and the process is repeated from the process of activating the outer shape recognition unit 242s1 again. When the output of all articles is completed, the end process is executed to return to the initial state. Further, the operation panel returns to the state shown in FIG.

Details of each means will be described below.

(Rule line cutting-out means 242k) The ruled line cutting-out means 242k is held in the program storage means 242m1 and has a function of cutting out field separators such as ruled lines and blank spaces between columns. The ruled line is cut out by a method in which black pixels having a predetermined width are connected in a straight line having a predetermined length or more, and a blank having a predetermined width is present around the black pixels, to detect the ruled line. When detecting the following, for example, during the ruled line tracking, the present means 242k recognizes the ruled line as a non-ruled line and stops the ruled line tracking process.

(1) When a black line segment in the middle of tracing is interrupted by a short length.

(2) When the thickness of the black line segment during tracing changes in the middle.

(3) When the black line segment in the middle of tracking is bent halfway.

(4) When black pixels in another direction connected to the black line segment in the course of tracing are detected.

(5) When a black pixel is detected in the immediate vicinity of a black line segment which is being traced.

(6) When it is determined that the ruled line that has already been detected is neither parallel nor perpendicular.

(7) When it is determined that the object is located at a position other than a distance that is an integral multiple of the expected step width from the already detected ruled line.

By the way, many newspaper articles do not have ruled lines between columns of the text. It is typically an editorial or boxed article, but rather has no ruled lines. Book ruled line cutting means 24
When 2k detects that there is no ruled line, it replaces it with a blank line (1 of the field separator).
Species). However, as a pre-process for directly tracking the blank line in the image data, the black pixel may be expanded once and a small isolated white pixel may be embedded. After this pre-processing, the inter-stage blank line cutout is detected by a method of tracking it as linear white pixels having a predetermined width and length. The width of the white line is considerably larger than that of the black ruled line described above. The means 242k recognizes a non-white line, for example, when the following is detected during the white line tracking, and stops the white line tracking processing.

(1) When the white line segment being traced is interrupted by a short length.

(2) When the thickness of the white line segment in the course of tracking changes in the middle and the long section does not return to the original thickness.

(3) When the white line segment in the middle of tracking is bent halfway.

(4) When it is found that it is not parallel or at right angle to the already detected inter-stage blank line.

(5) When it is determined that the vehicle is located at a position other than an integer multiple of the expected step width from the inter-step blank line that has already been detected.

A specific example will be described below. In FIG. 5, the processing result of the basic image processing means 241 is output to the recording paper 222p, but at the same time, image data equivalent to this is stored in the image data storage means 243. In the figure, s0, s1, s2, s3, ... Are ruled line cutting means 2
42k is a scanning line for finding the ruled line first.
For this reason, it is sufficient that the scanning interval is a very coarse interval of about 10 mm.

FIG. 9 is a diagram for explaining the operation of the main cutting means 242k for performing the cutting process.
The upper right part of m (2/2) is magnified 16 times. Here, the X and Y coordinate system is adopted as shown in the figure. I in the figure
mg1 is a noise image, img2 is a ruled line parallel to the text line,
img3 is a ruled line that makes 90 degrees with the text line. In addition, the image without a particular sign is a character or dot noise.

Since the processor 242 CPU of the present means has a 32-bit architecture, the basic processing unit is 32 pixels in a horizontal row and 1/16 mm × 2 mm units. Further, the code of the s scanning line number (relative X coordinate, relative Y coordinate) is used for this processing unit. The ruled line cutting-out means 242k starts scanning for ruled line search from s0 in FIG. However, since there is no black pixel of a predetermined width in s0, the process moves to the scanning of the second scanning line S1. In s1, the first division s1
When (0,0) is examined, all pixels are white, so the next division s
Move to 1 (1,0). Image s1 (1,0)
One continuous 7 black pixels are detected, and the surroundings are all white pixels, so that they are ruled line candidates. When a ruled line candidate image is detected, the upper, lower, left, and right sections adjacent to the detected section are examined. When a black pixel that is linearly connected to the original ruled-line candidate black pixel is detected in the adjacent section, the peripheral section of the section is further tracked. This tracking process is continued unless it is determined that the ruled line-like black line segment has lost the property of the ruled line.

The section s1 in which the ruled line candidate is detected
When this tracking processing is performed on (1,0), it is discovered that black pixels are immediately interrupted in the upward direction and interrupted from s1 (1,2) in the downward direction. Then, it is found that the continuous length of the black pixels is shorter than the specified length, and at least it is not a ruled line, and the tracking is stopped.

If no ruled line candidate is found in s1 (2,0) and s1 (3,0), and when approaching s1 (2,4), a ruled line candidate is found again here. Therefore, the tracking process of this line segment is executed. In the upward direction, s1 in FIG.
At least the property of ruled lines is maintained until (2, -14),
Actually, it is found that the ruled line property is maintained over the length of about 7 times outside the range shown in FIG. Also in the downward direction, the ruled line property is maintained up to the end point of s1 (5,3),
It becomes clear that the line segment ends with a ruled line property. If the two endpoints of the line passing through the center of the width of the ruled line found in this way are expressed in pixel units in the X and Y coordinate systems, the first endpoint of the img2 ruled line: x = 192, y = 176 img2 Second end point: x = 760, y = 284.

Regarding the scanning line s1, no ruled line candidate is found after s1 (6,0), and the scanning is completed. Then scan line s
2 is scanned, and first, a ruled line candidate is found at s2 (1,0). However, this candidate line is found to branch at s2 (1, -2), and tracking is stopped. Then s
In 2 (2,0), two ruled line candidates are found. However, the candidate line segment on the right side of the same segment is determined to be a non-ruled line because it is curved during tracking, and the line on the left side is s2 during tracking.
At (2, -6), it is found that the pixel intersects with another black pixel group, and the tracking is interrupted. One ruled line candidate is found at s2 (3,0), and tracking is started in the vertical direction. As a result, it becomes clear that it is a ruled line, and its coordinates are as follows. In this way, ruled lines are extracted one after another.

Img3 first end point of ruled line: x = 720, y = 320 second end point of img3 ruled line: x = 368, y = 2192 As described above, when the ruled line cannot be extracted because the ruled line does not exist. There is also. In such a case, a white line segment, which is a space between paragraphs, is extracted. In addition, an article consisting of only one column in a multi-column newspaper is cut out by the trimming unit 241t and stored in the image storage unit 243, and it is sometimes impossible to detect a ruled line or a white line segment between columns. In such a case, the blank portion on the outer periphery of the trimmed image or in the vicinity thereof is extracted as a white line segment. Although this white line segment may seem a little strange as a word in actual life, it is called a white ruled line because it is a logically equivalent concept in this clipping rearrangement process.

The extracted ruled lines and white ruled lines are sometimes incorrect. Therefore, whether the extracted ruled lines are true ruled lines is verified from the distance between the ruled lines and the positional relationship with the outer periphery of the cut out image, and if there is an error, the ruled line Alternatively, the white ruled line is deleted.
The ruled lines and white ruled lines extracted and verified in this way are illustrated as line 1 to line 10 in FIG.

(Rule Line Information Storage Means 242dk) The ruled line information storage means 242dk is a variable data storage means 242m4.
Provide inside. This means holds the ruled line information extracted by the ruled line cutting means in the following table format.

Ruled line number Black / white ruled line type 1st point x 1st point y 2nd point x 2nd point y 1 black ruled line 192 176 760 284 2 black ruled line 720 320 368 2192 ·· (outer peripheral clip means 242cp) outer peripheral clip Means 24
2cp is built in the program storage means 242m1 and has a function of removing an unnecessary noise image around the trimmed image. It also deletes unnecessary advertisement images that appear in the article images.

As the first processing, the outer circumference clipping means 242cp recognizes that the orthogonal polygon including the extracted ruled line group is one article range. Then, in the case of the automatic trimming image or the manually cutout image with scissors shown in FIG. 5, the orthogonal polygons item_box1 and the quadrilateral item_box showing the outermost ruled line group are referred to with reference to FIG.
Recognize 2 as an article frame. These article frames are set with a slight clearance C from the ruled line.

As the second processing, the outer circumference clipping means 242cp deletes the recognized image outside the article frame as noise. In this example, the hatched part noise of FIG. 10 is recognized as noise and deleted. FIG. 11 shows this unnecessary image noi
It is a figure explaining the process of deleting se, and is the figure which expanded the upper right part of the 2nd article frame item_box2 about 16 times. In the figure, a strip-shaped rectangle represented by white_pixel represents white data, and the outer circumference clip means 242
cp performs an operation of rewriting all the image information outside the article frame in the image data storage unit 243 with this white data. Therefore, the outside of the article frame is clipped, and when an image is formed based on this image data, it becomes as shown in FIG. The article frame information calculated here is written in the ruled line information storage means 242dk in a predetermined format in order to contribute to the recognition processing of the outer shape recognition means 242s1 described later and other processing.

(Image inclination detecting means 242ag) The image inclination detecting means 242ag is composed of the program storing means 242m1.
Incorporated in the ruled line information storage means 242dk, the inclination a of the image is detected from the information of the ruled line or the white ruled line. FIG. 13 is an enlarged view of the upper right part of the image of FIG. The inclination a of the image is calculated from the arctangent of the ruled line. For example, here, the information about the first ruled line line 1 has already been ruled line information storage means 24.
It is stored in 2dk. Therefore, the image inclination detecting means 24
2ag is detected as follows.

Image inclination a = arctan (dy / d
x) = arctan ((284-176) / (760-17)
6)) = 10.47 degrees (Image tilt correction means 242rt) Image tilt correction means 24
2rt is built in the program storage means 242m1 and rewrites the data in the image data storage means 243 so that the inclination a of the image is corrected to 0. Here, description will be given with reference to FIG. In the figure, image0 is the upper right portion of the tilted image in FIG. 5, and image1 is the main correction unit 242.
rt is an image after the original image is corrected for inclination. The correction means 242rt achieves a method of applying the operation of rotating the original image data at the arbitrary address p0 point of the image data storage means 243 by the angle a and moving to the p1 point to all the addresses. Original image address x0, y in X, Y coordinate system
The image data moving operation is performed so that 0 and the addresses x1 and y1 after the rotation operation satisfy the following relationship.

X1 = cos ax0 + sin ay0 y1 = −sin ax0 + cos ay0 Note that if other moving image data is written on the image data before the movement, the first image data is destroyed. The order of data operations is devised so that no problems occur. In addition, the ruled line information storage unit 2
The ruled line data and article frame data within 42dk are also corrected by the same method. In this way, the image data storage means 2
If the image data is formed after the rotation of the image data in at least the article frame 43 is completed, an output image as shown in FIG. 14 can be obtained.

(Outer Shape Recognizing Means 242s1) The outer shape recognizing means 242s1 is the program storing means 242m1.
It is built in to detect the number of closed areas that make up an article,
The number of sides and the length of each closed region are calculated, and the blanks in the closed region are detected and passed to the next rearrangement necessity determination means as outer shape information. These data are stored in the information storage means 24.
It is calculated from the article frame information within 2dk, and is used in the next stage for determining the presence or absence of an enclave, the presence or absence of blank space, and so on.

(Relocation Necessity Determining Means 242q1) This means is built in the program storage means 242m1 and executes the processing procedure of FIG. 15 with reference to the outer shape information and ruled line information created by the outer shape recognizing means. To do. The procedure will be described below.

Procedure 1 (242q1a): The directionality of the article text string in FIG. 5 after the image inclination correction is finished is examined. Directionality is determined based on the ruled line information in the ruled line information storage unit 242dk. The ruled line interval has a value determined according to the typesetting rule for each newspaper, but it has been found that any Japanese newspaper can be selected within a predetermined range. Therefore, it is determined that the text is between the ruled lines having this value in the direction orthogonal to the ruled lines. Further, when a newspaper magazine name of a proper name is input in FIG. 7, this is utilized to make a more accurate determination. In the example of the article item shown in FIG. 5, the text is determined to be the same as the main scan.

Step 2 (242q1b): When the recording paper direction is fixedly specified by the recording paper button 25i1 on the operation panel 251 of FIG. 7 and the text direction is specified by the image direction button 251k, this and the image data storage means 243. It is determined whether or not the determined text directions in the above match.
Since both are selected as automatic in the setting of FIG. 7, when the article item of FIG. 5 is applied, the processing is continued so that the text direction is the longitudinal direction of the recording paper.

Procedure 3 (242q1c): When it is determined that the determination in Procedure 2 is not in the same direction, the flag for rotating and processing the image data operation by 90 degrees is set. In the setting of FIG. 7, since this automatic is selected, it is not the processing target of this procedure.

Step 4 (242q1d article area detecting means): The area of the article image is calculated and compared with a predetermined threshold value, and when it is smaller than this, rearrangement is avoided. The threshold value is set to a small value of about 1/4 of the minimum copy paper area. In the example of the article item of FIG. 5, the area is larger than the threshold value and relocation avoidance is not performed. If the article is only in the upper right item (2/2) part, the area is 1400 (length 35 mm x width 40 mm), which is less than the threshold value 2600, and therefore it is a target for relocation avoidance, and the processing in this means ends. ..

Procedure 5 (Box article determining means 242q1
e): Check the data in the ruled line information storage means 242dk,
It is judged whether the article has a ruled line. If there is no ruled line, it is an enclosed article or an article based on this, so avoid rearrangement. 2
It branches to the processing of 42q1k. In the example of the article item of FIG. 5, since the ruled lines line 7, 8, and 9 are detected, they are not targets of relocation avoidance.

Step 6 (enclave detecting means 242q1f):
Find out if a single article is divided into two or more areas. If there is a separate enclave, it is determined that relocation is necessary. In the article example of FIG. 5, item (1/2) and it
It is divided into two areas of em (2/2), that is, it is detected that there is an enclave, and the process branches to the relocation required flag setting procedure 242q1m.

Step 7 (blank detecting means 242q1g): It is checked whether or not there is a blank in the article area. If there is a blank, it is determined that relocation is necessary. In the article example of FIG. 5, since it is already branched to 242q1m in step 6, the processing of this means is not actually received, but if the detection of this means is applied, there is no blank. The processing procedure is advanced to the next stage 242q1h.

Step 8 (side number comparing means 242q1h): 1
Check whether the number of sides of the orthogonal polygons that make up one article frame is within a specified number. When there are more than the specified number of sides, it is determined that the rearrangement is necessary. The specified number of sides of this copying machine is 6 at the time of factory shipment. However, it can be changed by the operator. In the article example of FIG.
Since it is branched to 2q1m, the processing of this means is not actually received, but if the detection of this means is applied, since the number of sides of the article outline is 12, it is relocated. To be judged. Note that the number of sides and the number of angles are the same in the orthogonal polygon.

Step 9 (concavity / convexity detecting means 242q1i):
Examine whether the degree of depression or the degree of protrusion of the convex portion of the orthogonal polygon forming the article frame is within the specified sharpness. Fine irregularities often cause discomfort to the person reading the copy, and are detected for the purpose of correction. If there are fine irregularities larger than the specified size, it is determined that the rearrangement is necessary. The unevenness determination is performed using the article frame information in the line information storage unit 242dk whose inclination has been corrected. The prescribed allowable convex range of this copying machine is equal to the vertical and horizontal dimensions, that is, a square, and the allowable concave range is zero, that is, a slight concave. If there is, it is targeted for relocation. However, it is also possible for the operator to change to a more strict or gentle regulation in order to shorten the processing time. In the article example of FIG. 5, 242q1 has already been obtained in step 6.
Since it is branched to m, it is not actually processed by this means, but if the detection of this means is applied, the convexity of the item (2/2) part is 1.82 ( Since the width is 64 mm / length 35 mm), which exceeds 1.0, it is determined to be a rearrangement target.

Procedure 10 (Image circumscribing rectangle aspect ratio detecting means 2
42q1j): Checks whether the aspect ratio of the circumscribed quadrilateral is within the specified range, including the article frame. The specified aspect ratio is the paper 222 fed from the feeding means 222a or 222b.
The upper and lower permissible ranges are set in consideration of the magazine name, the date, and the search word insertion option based on the aspect ratio of p (generally 1: 1.41). This determination is based on the copy paper 222.
For the purpose of effective use of p and improvement of readability and cohesion, determination is performed by using article frame information in the ruled line information storage unit 242dk whose inclination has been corrected. In the article example of FIG. 5, since it has already branched to 242q1m in step 6, the processing of this means is not actually received. However, if the detection of this means is applied, the item circumscribed rectangle ratio is vertical. 1
70 mm / width 194 mm = 0.87: 1.0,
Since it is significantly different from the reference value of 1: 1.41, it is determined to be a rearrangement target.

Procedure 11 (242q1k): For cases where rearrangement is not required, the article frame is included and circumscribed 4
Paper 222 whose side is fed from 222a or 222b
It is determined whether or not it can be accommodated in p.

Procedure 12 (242q1l): Regarding the case where rearrangement is not necessary, the paper 222p including the article frame and the circumscribed quadrilateral is fed from 222a or 222b.
If it doesn't fit in, set the flag.

Procedure 13 (242q1l): In any of Procedures 6 to 10, the rearrangement required flag is set in the case where it is judged that the rearrangement is required.

(Original Placement Data Storage Means 242do) The original arrangement data storage means 242do is secured in the work data storage means 242m5 for performing the subsequent processing of the articles for which the rearrangement required flag is set. FIG. 19 shows the data structure of this data, which is shown in the description format in C language within the ellipse, and is illustrated in the table format below. Read here
Is the name given to the original layout data, and org_xadd and org_yadd are x when the origin is the memory address of the quadrilateral image data storage means 243 circumscribing the article.
And y coordinate values, cell_size_x and cell_
size_y is the width and height of one line of the text, type [5]
[45] stores the type of 5 × 45 two-dimensional array division data. The array size needs at least the number of sections included in the minimum circumscribed quadrilateral of the article.

(Text cut-out means 242b) The text cut-out means 242b is built in the program storage means 242m1 and clips the noise image and corrects the inclination of the image data in the image data storage means. It has a function of discriminating between a body image and a non-body image and recording the identification information in the original arrangement data storage means 242do. The processing process of the present means 242b is shown in FIG. Details are given below.

Procedure 1 (242ba): First, inter-stage ruled lines in the ruled line information storage means 242dk are extracted, and the frequency of projected black pixels in the direction orthogonal to the ruled lines (this may be referred to as a peripheral distribution) is determined for each stage. Ask. However, if the position and size (division) of at least one text line are known, then the lines can be continuously cut out based on this, so it is not necessary to obtain the marginal distribution for all columns.

FIG. 17 is a diagram for explaining the article image item of FIG. 5 as an example. FIG. 17A shows a part of the first row,
(B) is a part of the second stage. The count in the same figure is a graph of the count result of the frequency. here,
In the text string part, you can observe the features that have a periodic distribution.

Procedure 2 (242bb): The frequency distribution is binarized with a predetermined threshold th. The threshold value th is determined according to the amount of noise such as dot-like ink spots between text lines. According to the experiment, there are overwhelmingly many black pixels in the text, so 3
Setting a relatively large value such as 0 is suitable for a document having a high background density.

When the frequency distribution curve is binarized in this way,
A spatial 1,0 pulse train is obtained. Referring to FIG. 17B, the marginal distribution of the text is t22 to t.
34 and their width and pitch are approximately w and p.
The value is close to. The threshold value th is set to a value larger than the distribution of stains and stains between lines. Then, in the text portion, a periodic pulse train having a width w period p is obtained. On the other hand, such a periodic pulse train does not occur in a portion other than the text, for example, in (a) t11 to t13 of FIG.

Procedure 3 (242bc): In this process, the width of the text line and the pitch between lines are specified from the pulse train obtained as described above. For this purpose, the period (pitch) p and the pulse w of the string portion of the text can be determined by a method such as autocorrelation analysis of the marginal distribution binary data.
The ruled line intervals above and below these text sections are calculated as the text line length lk.

Step 4 (242bd): In this step, the image data in the image data storage means 243 is divided by the pitch size p and the length lk of the text line obtained by the above procedure. In addition, a logical line for division is drawn just in the center of two adjacent text lines. FIG. 18 shows a state of being divided at equal intervals in this way. In the figure, the upper left corner circumscribing the image is the origin, the x coordinate is in the downward direction, and the y coordinate is in the right direction.
Assign the division address as a unit.

Step 5 (242be): Referring again to FIG. 19, these assigned addresses correspond to the element numbers of the two-dimensional array data type of the structure data read in the original arrangement data storage means 242do. That is rea
d. It is a type [division y address] [division x address]. The data stored here is 0, 1, 2,
There are 5 types of 3 and 4, and 0: classification in which image data does not exist.

1: A section which is the text.

2: Non-text (headings, abstracts, photographs, figures, etc.)

3: Decorative ruled line division.

4: A section in which it is uncertain whether it is a body section or a non-body section.

It is as follows.

In this process, the section identification memory read.
A process of storing these pieces of information in the type is performed. For example, since the origin part is a segment with no original image, read. ty
Since pe [0] [0] = 0, it is known that the y = 1 and x = 20 sections are the text, so read. type [1]
[20] = 1. Further, for example, division y = 1, x = 42
For unclear parts such as read. type [1] [4
2] = 3 is added. These unclear categories will be clarified later in the identification process.

Step 6 (242bf): In this process, a pattern matching template tp for segment type recognition
To form. FIG. 20A is a diagram for explaining this process. The lk × p rectangle is the partition shape used to partition the original image in step 5 above, and lc × w is the space between the lines of the text partition. It is the minimum circumscribed rectangle of only the character string excluding the space between columns. The latter dimension is a section that is known in advance as a body section, for example, read. type [1] [2
This is achieved by examining the marginal distribution of the segment such as [0].
Further, the inner rectangular area is named the first area tarea1, and the remaining area obtained by subtracting the inner rectangle from the outer rectangle is named the second area tarea2.

Step 7 (242bg): In this process, the segmented image data in the image data storage means 243 and the template tp are superposed. FIG. 20B shows a state in which templates t1 to t8 are overlaid on eight sections of image data.

Step 8 (242bh): In the overlapped sections, the first region of the template is inspected for all white pixels except point-like isolated black pixels (noise image). When all the pixels are white, it is determined to be a non-text section. In FIG. 20B, t2 is the original image classification [1] [1
9] in the template superimposed on the first area Tarea
Since all 1's are white pixels, it is judged as non-text division 1
Here is an example.

Step 9 (242bi): In the superposed sections, it is checked whether the second region of the template is all white pixels except the dot-like isolated black pixel (noise image). When all are not white pixels (there is an image), it is determined to be a non-text section. In FIG. 20B, t
1, t7 and t8 are original image classifications [1] [1
8], [0] [23], and [2] [23] are overlapped with the template, and the second area ta is set in any of the sections.
This is an example in which an image exists in rea2 and it is determined to be a non-text section. Further, at t3, t4, t5, and t6, as is apparent from the figure, there is an image in the area 1area1 and the area 2area
Since a2 is all white pixels, it is not determined to be a non-text by the procedure so far. In other words, at this stage, it can be said that the text candidate is classified.

Step 10 (242bj): It is checked whether the superposed section is the end section of the image data. That is, there are many cases in which it is easy to misinterpret the text, such as decorative ruled lines such as categories [4] and [7], so that more detailed collation is required for the text candidate segment at the edge. Therefore, here, it is checked whether it is a border. Whether or not it is an edge is determined by the type of the adjacent section of the section in the original arrangement data storage means 242do.
e It is understood by checking whether the data is 0 (outside the article).

Step 11 (242m): In this process, the first area Tarea1 is selected for the text candidate segment at the edge of the image data.
Judgment is made based on whether or not the black images inside are distributed at the expected character size and character spacing. For example, in the categories [4] and [7], there is no space between characters, and it is determined that the text is not the text.

Procedure 12 (242bo): x, y classification read.in the original arrangement data storage means 242do. type
Write [y] [x] = 1 (text).

Procedure 13 (242bn): x, y division read.in the original arrangement data storage means 242do. type
Write [y] [x] = 2 (non-text).

Procedure 14 (242bq): x, y classification read.in the original arrangement data storage means 242do. type
Write [y] [x] = 3 (decorative line mark).

Procedure 15 (242 bp): unconfirmed, that is, r
ead. Check if there are any remaining type [y] [x] = 4. When there are remaining sections to be inspected x,
When y is changed and the procedure jumps to step 10, the processing of the present means 242b is completed when there is no y. FIG. 21 illustrates the result of the determination made by the above procedure for all sections of the image data in the image data storage unit 243. See also FIG.
Reference numeral 1 denotes a hatched portion of the original image which is determined to be the text division. It will be clear that the main text and non-text parts are now correctly separated.

(Relocation Data Storage Means 242dr) The relocation data storage means 242dr is secured in the work data storage means 242m5 for performing the relocation processing.
FIG. 24 is a diagram expressing the data structure of this data.
It is shown in a description format in C language inside the ellipse, and illustrated below in a tabular format. Here, copy is the name given to the relocation data, and org_xadd and org_yadd are quadrilateral image data storage means 243 circumscribing the relocated article.
X and y coordinate values when the memory address of is the origin,
cell is the name of the structure data of the two-dimensional array that stores the data of the relocation section, and read_x and rea in it.
The address of the original arrangement section is stored in d_y.

(Relocation calculation means 242r1) The relocation calculation means 242r1 is built in the program storage means 242m1, performs logical relocation, and stores the processing result in the relocation data storage means 242dr. FIG. 23 shows this processing procedure. The steps are listed below.

Procedure 1 (242r1a): The directionality of the text characters is determined, and in a normal Japanese article, the origin is set at the upper right. At least the direction of the article (the direction of the text) is already known as a result of the processing of the means described so far,
Here, it suffices if the orientation, that is, the top and bottom can be determined. The top-bottom judgment uses a method of inferring from the arrangement of the text and non-text. For example, (1) The headline (comparative text) has an overwhelming probability of being at the upper right or above.

(2) There are few enclaves on the start side of the article and many on the end side.

(3) When there is a thin convex area, the area portion is highly likely to be downward.

There are some rules, etc. In this copying machine, these probabilistic rules are stored in the fixed data storage means 242m2 as a fuzzy rule base. The so-called fuzzy inference method is used for inference in this process, and the original arrangement storage means 242 is used.
The inference result is derived by comparing the original arrangement data in do with the fuzzy rule. It is determined that x = 0 and y = 0 are in the upper right of the article with respect to the input of FIG. 21, which is a diagrammatic representation of the original arrangement data of this embodiment.

Step 2 (242r1b): Processing is performed so that the isolated non-text section is deleted and regarded as blank. With reference to the original arrangement data of FIG. 21, divisions [0] [27], [1]
[41], [2] [41], [3] [26], [4]
In [7], there is no non-text next to it, and it is isolated. For these isolated non-text sections, the type data in the original arrangement data storage means is set to 0.
And the logical blanking process.

Procedure 3 (242r1c): The number of independent areas (called blocks) of the non-text area and the non-text division number c2 are counted. In this original picture, the number of blocks is one, and since 5 sections are already blank in step 1, the number of remaining sections is c2 = 39.

Step 4 (242r1d): Body section number c1
To count. In this original picture, c1 = 49.

Procedure 5 (242r1e): The number of stages ny and the number of rows nx after rearrangement are calculated. That is, the following simultaneous equations are solved to obtain ny and nx.

(Ny × l) / (nx × w) = R (Equation 1) ny × nx = c1 + c2 (Equation 2) where R is the expected aspect ratio of the circumscribed rectangle after rearrangement. This ratio is determined by the setting of the direction setting button 251 in FIG.
Vertical / horizontal = 1.4 if the button is portrait or automatic and the default is portrait, and 0.7 if landscape is enabled
Is selected. In the example here, the former 1.4 is selected.

L: Step width (length) of division section. Read. In the original arrangement data. It is stored in cell_size_y.

W: Width of division section. Re in the original arrangement data
ad. It is stored in cell_size_x.

In the original image of this embodiment, the segment length l = 34 m
m, width w = 4.54 mm, and 1.4 is set, which is close to the paper 222p to which R is fed. Therefore n
x = 21.69. However, since the number of rows nx must be an integer, it is rounded up to nx = 22, and the number of stages ny = 4 is obtained from this.

Step 6 (242r1f): It is checked whether there is a non-text block larger than ny or nx. It is not the original picture of this example.

Procedure 7 (242r1g): In the above procedure, if there is a large non-text block, ny and nx are corrected to be larger than the block size.

Step 8 (242r1h): The non-text block is moved to the origin side obtained in step 1. In this embodiment, the non-text blocks are allowed to move only in block units.

FIG. 25 is an illustration based on the rearrangement data copy of the rearrangement data storage means 242dr when this processing is finished.

Procedure 8 (242r1i): Initialize the original placement counters sx, sy and the reallocation counters dx, dy for the text relocation work to 0.

Procedure 9 (242r1j, 242r1k, 2
42r1m, 242r1n): In this embodiment, the main body is moved to a line, that is, a division unit. In this process, when moving and rearranging, an operation for finding a moving destination address of one section is performed. When calculating the move destination and move source, it is not just that there is no space and it is possible to fit them properly, but it is essential that the sentences are completely connected. As far as there is a blank division based on the origin, the destination is the top and the rightmost. However, it goes without saying that the range of columns and rows is the range of ny and nx obtained in step 5 or 7. For example, after the end of the non-text section rearrangement in FIG. 25, the first body rearrangement destination is y = 0, x = 12. A more detailed procedure will be apparent from the flow chart of FIG.

Procedure 10 (242r1o, 242r1p,
242r1q, 242r1r): In this process, when moving and relocating, the operation of finding the address of the moving source is performed. The source of movement is the topmost and rightmost segment as long as there is a text segment based on the origin. For example, the first move source after the end of the non-text section rearrangement in FIG. 25 is y = 0, x =
26.

Procedure 11 (242r1s): After the move destination and move source are determined as described above, in this process, the operation of rewriting the cell data of the relocation data copy in the relocation data storage means 242dr is performed. For example, the following is performed in the first body relocation loop.

Copy. cell [0] [12]. read_x = 2
5 copy. cell [0] [12]. read_y = 0 However, the array element number of the cell data is the destination address, and the stored data is the division address of the original arrangement.

Procedure 12 (242r1t): It is checked whether or not the rearrangement of all sections has been completed. If not completed, jump to step 9. Upon completion, the processing of this means 242r1 is ended. FIG. 26 illustrates a process in which the movement and rearrangement for the first three stages are performed. A thick arrow indicates a movement path, and numbers attached to the arrows indicate movement orders. Further, FIG. 27 shows an arrangement state when the whole process of the present processing means 242r1 is finished, and it can be seen that the outer shape of the article which originally had many enclaves and unevenness is shaped and the arrangement is improved. Needless to say, the correctness of the mochi dissertation structure is maintained.

(Relocation Execution Unit 242r2) The relocation execution unit 242r2 is built in the program storage unit 242m1 and performs the relocation and ruled line insertion of the image data itself. FIG. 28 shows the processing steps of this means.

Procedure 1 (242r2a): Referring to this figure, this means secures a memory area for rearrangement in the image data storage means 243. This area is a measure for preventing accidents where the image data is erased carelessly, and it does not matter even if it partially overlaps the original image area.

Procedure 2 (242r2b): Initialize counters required for image data movement processing.

Procedure 3 (242r2c to 242r2
h): Refer to the rearrangement data copy in the rearrangement data storage means 242dr, and move the image data in the image memory means 243. The movement is performed in units of segmented images.

Step 4 (242r2i): A ruled line is inserted. It may help to make up for some missing creases when repositioned. Referring to FIG. 30, in this means, line 11 and l are set to the entire width above and below the article frame.
ine15 is added, and line12, line13, and line15 are inserted in the middle portion so as to match the text section width.

(Recording size calculating means 242s) The recording size calculating means 242s is the program storage means 2
It is built in 42m1. It is noted that the directionality of the leading paper has already been determined by the setting of the direction setting button 251k in FIG. 7 and the directionality of the text line. In this example, since the button is automatic and its default is portrait, the subsequent paper size calculation is limited to the paper orientation in which the text line direction and the longitudinal direction of the recording paper match. FIG. 29 shows the processing steps of this means.

Reference numeral 242 sa is relocation data storage means 242.
The image area is calculated from the rearrangement information in dr. 242s
b is set to 242sc if it is automatic by setting the size setting button 251i in FIG. 7, and 242sd otherwise.
Branch to. 242sd checks whether the area calculated in 242sa fits on the designated recording paper. 242
For sc, the area calculated at 242 sa is the paper feed table 2
It is checked whether or not the larger paper 22a, 222b can be accommodated. For 242r2b, the smallest paper size in which the area calculated in 242sa is included is selected. 242se is arranged so that if the binding margin, the cornering, etc. are designated, the designation is performed, and if no designation is made, the image center is aligned with the paper center. Note that the corner alignment means that the upper right corner of the image, which is the start position of the article, is aligned near the upper right corner of the recording paper with a slight margin left. If there is a journal name, date, and search term insertion option, add this area. 242sg calculates the size of the recording paper 222p, calculates the optimum image position on the recording paper, inserts the magazine name, date, and search word image data itself. 242sf sets this identification flag when the image does not fit in the designated recording paper size.

(Image scaling means 242m) Image scaling means 2
42m is built in the program storage means 242m1 and performs image scaling processing. However, it is driven only when the recording size calculating means 242s sets an identification flag when the image does not fit in the designated recording paper size.
In this way, each of the above means functions and the rearrangement control means 2
42 mp organically controls each of these means to store the rearranged image data in the image data storage means 243.
When the system control unit 285 urges the image recording and forming unit 280 to form an image of this image data, a visible image is obtained on the recording paper 222p as shown in FIG. Here, name is the inserted magazine name, date is the date, dpr1,
dpr2 is a search word that is extracted from the manuscript and the arrangement direction of the character string is converted to horizontal writing.

[0207]

In the image rearrangement copying machine of the first invention, the image reading means reads the original image, the outer shape recognizing means forms outer shape data of the article, and the rearrangement necessity determining means uses this. When it is determined from the data whether or not the rearrangement of the image data in the specific article is necessary, and when the rearrangement control unit outputs the rearrangement necessity determination unit, the main text line cutout unit and the rearrangement execution unit are provided. At least one of the two determining means and a first mode for cutting out a plurality of text lines in a rectangle congruent to the text line size from the read image data by urging the read image data and moving and rearranging the cut image data. When one outputs rearrangement rejection, the second mode for avoiding rearrangement of images is selected, and the image forming unit records and outputs the rearranged image data as a visible image. That is, when copying an irregular-shaped article manuscript, according to the image outer shape, for example, in the case of an article image that does not fit on the recording paper as it is, a specific area is appropriately rearranged, the contour shape is automatically shaped, and image formation output is performed. If the outer shape of the image is small and it fits in the smallest size of recording paper, the image is not rearranged and output as it is. Even if the operator does not give a special instruction, either of these two modes is automatically selected according to the image, so that the operation is easy and a copy image with a well-formed shape is output. It is also possible to automatically avoid a situation in which it takes a long time to output an image.

In the image rearrangement copying machine according to the second aspect of the present invention, the boxed article determination means relates to the inter-stage ruled line information, and when it is zero, it is determined that the image data is the boxed article or an article equivalent thereto and the relocation determination is made. To output. Therefore, unnecessary rearrangement processing is avoided for articles such as editorials whose outer shape has been adjusted from the beginning, and efficient image formation is realized.

In the image rearrangement copying machine of the third invention, the enclave detecting means outputs a rearrangement necessity judgment when the number of closed areas is more than a specific number. Therefore, even when the original image is divided into two or more regions, it is possible to reliably fuse the plurality of regions, automatically shape the contour shape, and output the image.

In the image rearrangement copying machine according to the fourth aspect of the invention, the blank detecting means outputs the rearrangement necessity judgment when the blank area exists inside the closed area. Therefore, even if there is white space inside the original image due to advertisements, etc.
The blank can be filled with an image to be erased, and the contour shape can be automatically shaped and image-formed and output.

In the image rearrangement copying machine of the fifth aspect of the invention, the side number comparing means outputs the determination of rearrangement necessity when the number of sides is more than the specified number. Therefore, in the case of a polygon having a predetermined number of sides or more, since the contour shape is imaged and output so that the number of sides such as a quadrangle is reduced, an image with a regular shape can be output.

In the image rearrangement copying machine of the sixth aspect of the invention, the unevenness degree detecting means outputs the necessity of rearrangement when the ratio of the width and the length of the uneven portion of the document is a specific value or more. Therefore, if there are thin recesses or protrusions that exceed a predetermined standard in the outer shape of the manuscript article, the contour shape is automatically shaped and image formation is performed so that the thin recesses or protrusions are eliminated. It can output a neat image.

In the image rearrangement copying machine of the seventh invention, the image circumscribing rectangle aspect ratio detecting means outputs the relocation necessity judgment when the image circumscribing rectangle aspect ratio is a specific value or more. Therefore, if the aspect ratio of the circumscribed rectangle that surrounds the original image is significantly different from that of the standard size paper, the contour shape is automatically shaped and the image is output closer to the aspect ratio of the standard size paper. It is possible to output a well-arranged image suitable for.

In the image rearrangement copying machine of the eighth invention, the image reading means reads the original image, the outer shape recognizing means forms the outer shape data of the image, and the rearrangement necessity judging means uses this data. Whether or not the rearrangement of the image data in the specific article is necessary or not is determined, and further, the rearrangement possibility determining means determines whether or not the rearrangement of the image data in the specific article from the outer shape data is possible or rearrangeable in accordance with a predetermined difficulty level. When the rearrangement control means outputs the determination that the rearrangement necessity is necessary and the rearrangement availability determination means outputs the determination that the rearrangement is possible, the text line segmenting means And the rearrangement executing means is energized to cut out a text line, the cut out image data is moved and rearranged, and at least one of the two judging means outputs a rearrangement failure. To avoid relocation of the image, the image forming means is recorded output as a visible image. Therefore, the article image is rearranged as appropriate according to the outer shape and the content of the image in the article, and an image arranged in a practical processing time is output.

In the image rearrangement copying machine of the ninth invention, the image trimming means leaves one of a plurality of articles blank, and the other is blanked, and the image data is handed over to the next series of rearrangement processing. Even if multiple articles are mixed,
The scissors cutting operation can be omitted, and the first mode /
Together with the automatic selection control in the second mode, the efficiency of copy work can be improved.

[Brief description of drawings]

FIG. 1 is a front view mainly showing the mechanism of a digital copying machine of one type suitable for carrying out the present invention.

FIG. 2 is a front view showing a detailed configuration of an image forming unit of the copying machine shown in FIG.

3 is a block diagram showing functions and signal flows of the copying machine system of FIG.

FIG. 4 is a block diagram of a hardware configuration of an intelligent image processing unit.

FIG. 5 is a plan view showing a state in which a trimming means 241t forms a copy image of a newspaper article on a cutout recording paper.

FIG. 6 is a block diagram showing a series of means and signal flow related to cropping, rearranging copy image formation such as image cropping, peripheral clipping, straightening, and rearranging.

FIG. 7 is a plan view showing a console screen for instructing a selection condition for cutout rearrangement copy.

FIG. 8 is a flowchart showing a series of processing procedures for cutout rearrangement copy.

9 is a part of the image of FIG. 5 and a ruled line cutting means 24. FIG.
It is a top view which shows 2k ruled line recognition processing.

FIG. 10 is a plan view showing ruled lines recognized and extracted from the image of FIG. 5 and an extra-article unnecessary extra image.

FIG. 11 is a portion of the image of FIG. 5 and a clipping unit 242.
It is a top view which shows the image erasure | elimination unnecessary image protrusion process outside a cp article.

FIG. 12 is a plan view showing an image after an erasing process of an extra-article extraneous image is performed.

13 is a plan view showing a part of the image of FIG. 5, the inclination detection of the read image by the image inclination detection means 242ag, and the inclination correction processing of the image inclination correction means 242rt.

FIG. 14 is a plan view showing an image whose inclination has been corrected.

FIG. 15 is a flowchart showing a rearrangement necessity determination procedure of rearrangement necessity determination means 242q1.

FIG. 16 is a flow chart showing a text and non-text cutout processing procedure of the text line cutout unit 242b.

FIG. 17 is a plan view showing a part of the image of FIG. 5 and a process in which the text line cutout unit 242b estimates the text line size from the projected black pixel frequency for each stage.

FIG. 18 is a plan view showing an original image, a rectangular unit section processed by the text line segmenting means 242b, and a step number and a line number with each rectangle.

FIG. 19 is a map showing the data structure of the original arrangement data storage means 242do.

FIG. 20 is a plan view showing an original image, and a text area and a non-text area that are identified and separated by the text line cutout unit 242b.

FIG. 21 is a map showing a result of separating the original image by the text line segmentation unit 242b.

FIG. 22 is a map showing a result obtained by distinguishing and separating an original image into a text region and a non-text region by a text line cutout unit 242b and an original image.

FIG. 23 is a flowchart showing a procedure for calculating image rearrangement by rearrangement calculation means 242r1.

FIG. 24 is a map showing a data structure of rearrangement data storage means 242dr.

FIG. 25 is a map showing a process of identifying rearrangement of a non-text region by the rearrangement calculation means 242r1 for distinguishing between the body region and the non-text region.

FIG. 26 is a map showing a process of performing a rearrangement calculation of a body area and a non-main body area and a rearrangement calculation means 242r1.

FIG. 27 is a map showing identification classifications of a text area and a non-text area after the reallocation calculation means 242r1 has calculated the reallocation of all non-text areas.

FIG. 28 is a flowchart showing a process in which the rearrangement executing unit 242r2 rearranges image data.

FIG. 29 is a flowchart showing a process in which the recording size calculating unit 242s calculates recording paper.

FIG. 30 is a map showing the result of rearranging the image data and rearranging the ruled lines by the rearrangement executing means 242r2.

FIG. 31 is a plan view showing the final image that the rearrangement executing unit 242r2 rearranges the image data, and the recording size calculating unit 242s adds bibliographic items and outputs to the recording paper.

[Explanation of symbols]

102a: original document 200: image reading means (scanner module) 207: CCD color image pickup device 207a: reading circuit 212: light emitting diode array (LEDA) 212a: recording interface circuit 214: converging light transmitter array 218: photoconductor 219: charging Scorotron 220: Developing device 229: Transfer corotron 230: Separation belt 240: Image file means 241: Basic image processing means 241t: Trimming means 242: Intelligent image processing means 242ag: Image tilt detecting means 242b: Text line cutting means 242cp: Outer edge Clipping means 242dc: Rearrangement condition storage means 242dk: Ruled line information storage means 242dmp: Control data storage means 242do: Original arrangement data storage means 242dr: Rearrangement data storage means 242k: Line cutting-out means 242m: Image scaling means 242mp: Rearrangement control means 242q1: Rearrangement necessity judgment means 242q2: Rearrangement availability judgment means 242r1: Rearrangement calculation means 242r2: Rearrangement execution means 242rt: Image inclination correction means 242s: Recording size calculation means 242s1: External shape recognition means 243: Image data storage means 250: Console means 280: Image formation means 285: System control means 286: External device interface circuit 287: Interface memory

Claims (9)

[Claims] 1. An image reading means for reading an original image by dividing it into pixels; a rearrangement necessity determining means for determining necessity of rearrangement of image data in an article from the read image data; read image data Body text line cutting means for cutting out a plurality of text lines in a rectangle congruent to the text line size; a rearrangement executing means for moving and rearranging image data of at least one line of the cut out lines; image data on a recording medium Image forming means for forming and outputting as a visible image; and a first mode for energizing the text line cutout means and the rearrangement executing means when the rearrangement necessity judging means outputs the judgment of rearrangement necessity. And an image rearrangement copier that automatically selects a second mode in which image rearrangement is prohibited when the determination of rearrangement is output. 2. A ruled line cutting-out unit that detects a ruled line and outputs this information; and a boxed article that is provided in the relocation necessity determination unit and that outputs a relocation determination if there is no inter-stage ruled line. The image rearrangement copying machine according to claim 1, further comprising a determining means, wherein the image rearrangement is prohibited when the article is a boxed article or an article equivalent thereto. 3. The rearrangement necessity determining means includes an enclave detecting means for detecting whether or not the image data is divided into a plurality of closed areas, and the rearrangement image is detected when a plurality of areas exist. The image rearrangement copying machine according to claim 1, which is formed. 4. The relocation necessity determining means includes a blank detecting means for detecting whether or not a blank area exists inside the closed area of the image data; and a blank area exists inside the closed area of the image data. An image relocation copier according to claim 1, wherein a relocation image is formed if present. 5. A rearrangement image is formed when the rearrangement necessity determining unit includes a side number comparing unit; and when the number of sides of an article contour polygon is a specific number or more, a rearrangement image is formed. Image relocation copier described. 6. The rearrangement necessity determining unit includes a concave-convex degree detecting unit; and regarding the concave-convex portion of the article contour, if the ratio of the width and the length of the concave-convex portion is a specific value or more, a rearrangement image is The image rearrangement copying machine according to claim 1, which is formed. 7. The rearrangement necessity determining unit includes an image circumscribing rectangle aspect ratio detecting unit; and a rearrangement image is formed when an article image circumscribing rectangle aspect ratio is a specific value or more. 1. The image rearrangement copying machine described in 1. 8. An image reading unit for reading an original image by dividing it into pixels; a rearrangement necessity determining unit for determining whether or not the rearrangement of image data in a specific article is necessary from the read image; a rearrangement of image data Rearrangement availability determination means for determining whether or not rearrangement is possible or not according to a predetermined difficulty level regarding arrangement; body line cutting means for cutting out a plurality of body lines from the read image data in a rectangle congruent with the body line size. Rearrangement executing means for moving and rearranging the image data of at least one line of the cut out text line; image forming means for forming and outputting the image data as a visible image on a recording medium; and the rearrangement. When the necessity determination means outputs the determination that the rearrangement is necessary and the rearrangement possibility determination means outputs the determination that the rearrangement is possible, the text line segmenting means and the rearrangement executing means And a second mode for automatically selecting a second mode for prohibiting image rearrangement when the determination of rearrangement is output, and a rearrangement control unit;
Image rearrangement copier. 9. An image trimming means for extracting a specific portion of the image data read by the image reading means and substantially blanking the other portions between the image reading means and the rearrangement necessity determining means. The image rearrangement copying machine according to claim 1 or 7, further comprising: