JPH1093789A - Method for image processing and its device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a method for image processing and its a device therefor, capable of omitting unwanted processing by estimating a data amount to be generated at the time of compressing an image or obtaining featured values and immediately notifying the user the effect in the case where a sufficient storage area corresponding to a memory device does not remain. SOLUTION: Plural kinds of images are inputted from a scanner (S2801, S2802). Each compressed data amount when the inputted plural kinds of images are compressed is estimated by a compression method (JBIC, MMR, etc.), corresponding to each of the above plural kinds of images, and a total compressed data amount of the above estimated compressed data amounts is obtained (S2803, S2804, S2805). Then, if the obtained total compressed data amount is larger than the empty space capacity of an external recording device, a warning message is outputted (S2807).

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

[0001] The present invention relates to an image processing method and apparatus.

[0002]

2. Description of the Related Art Conventionally, a plurality of image data are input from the outside and stored in a temporary storage unit after being subjected to image compression encoding or the like as original image data, and later collectively processed. There is an image processing apparatus that performs the following processing and stores the processing result data in an external storage device.

[0003]

However, in the above-described conventional image processing apparatus, the number of image data temporarily stored in the temporary storage unit is large, while the remaining storable data amount in the external storage device is small. In this case, even if the image data can be stored in the temporary storage unit, a problem has occurred that the processing result data corresponding to the image data cannot be finally stored in the external storage device. .

Therefore, when such a problem occurs, the operator has to input image data again from the beginning. In particular, when such a problem occurs when performing image data processing that takes a very long time to process, the processing time that occurs may be greatly wasted.

In addition, the operator needs to start the operation in advance while considering whether or not a sufficient storage capacity remains in the external storage device, and this has caused the operation to be complicated. The present invention has been made in view of the above conventional example,
Estimates the amount of data that will be generated when images are compressed or features are acquired, so that if there is not enough storage space left in the storage device, the user is notified immediately. It is therefore an object of the present invention to provide an image processing method and an image processing method that eliminate unnecessary use of the image processing.

[0006]

In order to achieve the above object, an image processing method and apparatus according to the present invention have the following arrangement. That is, an input step of inputting a plurality of types of images,
A compression method corresponding to each of the plurality of types of images,
A total compressed data amount estimating step of estimating each compressed data amount when the plurality of types of images input in the input step are compressed and obtaining a total compressed data amount of the estimated compressed data amounts; An output step of outputting a warning message if the total compressed data amount obtained in the compressed data amount estimation step is larger than the free space of the predetermined storage means.

Another aspect of the present invention is an input step of inputting a plurality of types of images, and the plurality of types of images input in the input step are compressed by a compression method corresponding to each of the plurality of types of images. A total compressed data amount estimation step of estimating a total compressed data amount of each of the estimated compressed data amounts at the time, and a predetermined characteristic of a plurality of types of images input in the input step. A feature amount obtaining step of obtaining a feature amount; a total data amount calculating step of obtaining a total amount of the total compressed data amount obtained in the total compressed data amount estimation step and the characteristic amount obtained in the feature amount obtaining step; An output step of outputting a warning message if the total amount obtained in the total data amount calculation step is larger than the free space of the predetermined storage means.

Another aspect of the present invention is an inputting means for inputting a plurality of types of images, and estimating each compressed data amount when compressed by a compression method corresponding to each of the plurality of types of images. A total compressed data amount estimating means for obtaining a total compressed data amount of each compressed data amount obtained, and a warning message if the total compressed data amount obtained by the total compressed data amount estimating means is larger than the free space of the predetermined storage means. And output means for outputting

Another aspect of the present invention is an input unit for inputting a plurality of types of images, and an amount of each compressed data when each of the plurality of types of images is compressed, to obtain each of the estimated compressed data. Total compressed data amount estimating means for obtaining a total compressed data amount of the amount, feature amount obtaining means for obtaining a characteristic amount of a predetermined characteristic of the plurality of types of images, and total compression data obtained by the total compressed data amount estimating means. Total data amount calculating means for calculating the total amount of the data amount and the characteristic amount obtained by the characteristic amount obtaining means; and if the total amount obtained by the total data amount calculating means is larger than the free space of the predetermined storage means, Output means for outputting a warning message.

Another aspect of the present invention is a computer readable first program code unit for inputting a plurality of types of images, and a compression method corresponding to each of the plurality of types of images. Computer-readable second program code means for estimating each compressed data amount when compressing a plurality of types of images input in the step and obtaining a total compressed data amount of the estimated compressed data amounts; If the total amount of compressed data obtained by the second program code means is larger than the free space of the predetermined storage means, a computer-readable third program code means for outputting a warning message is provided.

Another aspect of the invention is a computer program product, comprising a computer usable medium having computer readable program code means, wherein the computer program product inputs a plurality of types of images. Estimating each compressed data amount when compressing a plurality of types of images input by the first program code by a readable first program code unit and a compression method corresponding to each of the plurality of types of images. Computer-readable second program code means for obtaining a total compressed data amount of each of the estimated compressed data amounts, and a characteristic amount of a predetermined characteristic of a plurality of types of images input by the first program code means Computer readable third program code means for determining Computer-readable third program code means for calculating the total amount of the total amount of compressed data obtained by the second program code means and the feature amount obtained by the third program code means; A computer-readable fourth program code unit that outputs a warning message if the obtained total compressed data amount is larger than the free space of the predetermined storage unit.

[0012]

DESCRIPTION OF THE PREFERRED EMBODIMENTS First, after summarizing the points of an image processing method and an image processing apparatus according to an embodiment of the present invention, a detailed description thereof will be given. The image processing method and the image processing apparatus according to the embodiment of the present invention provide a plurality of image processing results obtained by executing data processing before storing a plurality of image processing result data actually obtained by executing data processing in an external storage device. Predict the total amount of data. Then, a warning corresponding to the result of comparing the total amount of data with the amount of data that can be stored in the external storage device is notified to the operator.

Hereinafter, an image processing method and an image processing apparatus according to an embodiment of the present invention will be described in detail. FIG. 1 shows a hardware configuration of an embodiment according to the present invention. Hereinafter, the basic operation will be described. In FIG. 1, reference numeral 1 denotes an image input device (hereinafter, referred to as a reader) for converting a document into image data.

2 has a plurality of types of recording paper cassettes,
An image output device (hereinafter, referred to as a printer) that outputs image data as a visible image on recording paper in response to a print command. Reference numeral 3 denotes an external device that is electrically connected to the reader unit 1 and has various functions. The external device 3 includes a facsimile unit 4, a file unit 5, an external storage device 6 connected to the file unit, a computer interface unit 7 for connecting to a computer, and a device for converting information from the computer into a visible image. An image memory unit 9 for storing information from a reader unit of the formatter unit 8 or 1 or temporarily storing information sent from a computer, and a core unit 10 for controlling the above functions.

Hereinafter, the function of each unit will be described in detail. [Explanation of Reader Unit] FIGS. 2 and 3 show a detailed description of the reader 1.
This is performed using Documents stacked on the document feeder 101 are sequentially conveyed one by one onto a glass platen glass 102. When the document is conveyed, the lamp of the scanner unit 103 is turned on, and the scanner unit 104 moves to irradiate the document.

The reflected light of the original is reflected by mirrors 105, 106,
The light passes through a lens 108 via 107. Then, it is input to the CCD image sensor unit 109 (hereinafter, referred to as CCD). Next, image processing in the reader 1 will be described in detail with reference to FIG. The image information input to the CCD 109 is photoelectrically converted here and is converted into an electric signal. The color information from the CCD 109 is supplied to the next amplifiers 110R, 110G, and 110B, where the A / D converter 11 outputs the color information.
The signal is amplified according to one input signal level.

The output signal from the A / D converter 111 is input to a shading circuit 112, where the lamp 10
The light distribution unevenness of No. 3 and the sensitivity unevenness of the CCD are corrected. The signal from the shading circuit 112 is input to the Y signal / color detection circuit 113 and the external, I / F switching circuit 119. The Y signal generation / color detection circuit 113 calculates the signal from the shading circuit 112 according to the following equation,
Get the signal.

Y = 0.3R + 0.6G + 0.1B Further, there is provided a color detection circuit which separates R, G, B signals into seven colors and outputs signals for each color. An output signal from the Y signal generation / color detection circuit 113 is input to a scaling / repeat circuit 114.

The magnification in the sub-scanning direction is changed by the scaling / repeat circuit 114 according to the scanning speed of the scanner unit 104. In addition, a plurality of identical images can be output by the scaling / repeat circuit 114. The contour / edge emphasis circuit 115 obtains edge emphasis and contour information by emphasizing the high-frequency components of the signal from the scaling / repeat circuit 114.

The signal from the contour / edge enhancement circuit 115 is input to a marker area determination / contour generation circuit 116 and a patterning / thickening / masking / trimming circuit 117. A marker area determination / contour generation circuit 116 reads a portion of the document written with a marker pen of a designated color, generates contour information of the marker, and generates a next patterning / thickening / masking / trimming circuit 117. Thickness, masking, and trimming are performed from this contour information. Further, patterning is performed by a color detection signal from the Y signal generation / color detection circuit 113.

The output signal from the patterning / thickening / masking / trimming circuit 117 is input to a laser driver circuit 118 and converts various processed signals into signals for driving a laser. The laser driver signal is
2 and the image is formed as a visible image. Next, the external I / F switching circuit 119 that performs I / F with an external device will be described.

When outputting image information from the reader 1 to the external device 3, the external I / F switching circuit outputs image information from the patterning / thickening / masking / trimming circuit 117 to the connector 120. When the reader 1 inputs image information from the external device 3, the external switching circuit 119 inputs image information from the connector 120 to the Y signal generation / color detection circuit 113.

Each of the above image processing is performed according to an instruction from the CPU 122. Further, based on the value set by the CPU 122, the area generation circuit 121 generates various timing signals necessary for the image processing. Furthermore, CP
External device 3 using the communication function built in U122
Communication with the

The SUB CPU 123 controls the operation unit 124 and communicates with the external device 3 using a communication function built in the SUB CPU 123. The operation unit 124 has a touch panel for inputting an operator's instruction operation and a liquid crystal display unit for performing various displays. [Description of Printer Unit] The signal input to the printer 2 is
The light is converted into an optical signal by the exposure control unit 201 and irradiates the photoconductor 202 according to the image signal. The latent image formed on the photoconductor 202 by the irradiation light is developed by the developing device 203. The transfer paper is conveyed from the transfer paper stacking unit 204 or 205 in synchronization with the development and the timing, and the developed image is transferred in the transfer unit 206. The transferred image is fixed to the transfer sheet by the fixing unit 207, and then discharged from the sheet discharging unit 208 to the outside of the apparatus.

The transfer paper output from the paper discharge unit 208 is placed in each bin when the sort function is working in the sorter 220, or in the uppermost bin of the sorter when the sort function is not working. Is discharged. Next, a method of outputting sequentially read images on both sides of one output sheet will be described.

After the output sheet fixed by the fixing unit 207 is once conveyed to the sheet discharging unit 208, the direction of the sheet is reversed, and
The sheet is conveyed to the transfer sheet stacking section 210 for re-feeding via the conveyance direction switching member 209. When the next manuscript is prepared,
In the same manner as in the above process, the original image is read, but the transfer paper is fed from the re-feeding receiving paper stacking section 210, so that two original images are eventually printed on the front and back surfaces of the same output paper. Can be output. [Explanation of External Device] The external device 3 is connected to the reader 1 by a cable, and controls a signal and controls each function by a core unit in the external device 3.

In the external device 3, a facsimile unit 4 for performing facsimile transmission / reception, a file unit 5 for converting various types of document information into electric signals and storing them, a formatter unit 8 for expanding code information from the computer into image information, and a computer Accumulates information from the reader unit of the computer interface unit 7 or 1 which performs the interface of
An image memory unit 9 for temporarily storing information sent from a computer, and a core unit 10 for controlling the above functions are provided.

Hereinafter, the function of each unit will be described in detail. [Explanation of Core Section] The core section will be described with reference to FIG. The connector 1001 of the core unit 10 is connected to the connector 120 of the reader unit 1 by a cable.

The connector 1001 contains four types of signals, and the signal 1057 is an 8-bit multi-level video signal. The signal 1055 is a control signal for controlling a video signal. The signal 1051 corresponds to the CPU 1 in the reader 1
22. The signal 1052 indicates the SU in the reader 1
B. Communication with the CPU 123 is performed.

Signals 1051 and 1052 are used for communication I
In C1002, the communication protocol processing is performed, and the CPU bus 1
The communication information is transmitted to the CPU 1003 via 053. The signal 1057 is a bidirectional video signal line, and is capable of receiving information from the reader 1 at the core unit 10 and outputting information from the core unit 10 to the reader unit 1.

The signal 1057 is connected to a buffer 1010, where it is separated from bidirectional signals into unidirectional signals 1058 and 1070. The signal 1058 is an 8-bit multi-valued video signal from the reader 1, and the LUT 10
11 is input. The LUT 1011 converts the image information from the reader 1 into a desired value by using a look-up table.

Output signal 1059 from LUT 1011
Is input to the binarization circuit 1012 or the selector 1013. The binarization circuit 1012 includes a multi-level signal 10
A simple binarization function for binarizing 59 with a fixed slice level, a binarization function with a varying slice level in which the slice level varies from the value of the pixel around the pixel of interest, and
It has a binarization function by the error diffusion method.

The binarized information is converted into a multi-level signal of 00H at 0, FFH at 1 and a selector 101 at the next stage.
3 is input. The selector 1013 includes the LUT 1011
, Or the output signal of the binarization circuit 1012. Output signal 106 from selector 1013
0 is input to the selector 1014. Selector 1014
Outputs the video signals output from the facsimile unit 4, the file unit 5, the computer interface unit 7, the formatter unit 8, and the image memory unit 9 to the connector 100
5, 1006, 1007, 1008, 1009, the signal 1064 input to the core unit 10 and the selector 10
Thirteen output signals 1060 are selected by the instruction of the CPU 1003.

The output signal 1061 of the selector 1014 is
The signal is input to the rotation circuit 1015 or the selector 1016. The rotation circuit 1015 converts the input image signal into +90
It has a function of rotating by degrees, -90 degrees, and +180 degrees. The rotation circuit 1015 converts the information output from the reader 1 into a binary signal by the binarization circuit 1012,
15 stores the information from the reader.

Next, in response to an instruction from the CPU 1003, the rotating circuit 1015 rotates and reads the stored information.
The selector 1016 outputs the output signal 10 of the rotation circuit 1015.
62 and the input signal 1061 of the rotation circuit 1015 are selected, and as the signal 1063, the connector 1005 to the facsimile unit 4 and the connector 1005 to the file unit 5 are selected.
6. Connector 1 with computer interface unit 7
007, a connector 1008 with the formatter unit 8 and a connector 1009 with the image memory unit 9
Enter 17.

The signal 1063 is a synchronous 8-bit one-way video bus for transferring image information from the core unit 10 to the fax unit 4, file unit 5, computer unit 7, formatter unit 8, and image memory unit 9. . Signal 106
Reference numeral 4 denotes a synchronous 8-bit one-way video bus for transferring image information from the facsimile unit 4, file unit 5, computer interface unit 7, formatter unit 8, and image memory unit 9.

The video control circuit 1004 controls the synchronous bus for the signals 1063 and 1064.
And an output signal 105 from the video control circuit 1004.
6 controls. Connector 1005 to Connector 1
In addition, a signal 1054 is connected to 009. The signal 1054 is a bidirectional 16-bit CPU bus for asynchronously exchanging data and commands.

The transfer of information between the facsimile unit 4, the file unit 5, the computer interface unit 7, the formatter unit 8, the image memory unit 9 and the core unit 10 is performed by using the above two video buses 1063 and 1064 and the CPU bus 10.
54 is possible. Signals 1064 from the facsimile unit 4, file unit 5, computer interface unit 7, formatter unit 8, and image memory unit 9 are input to selectors 1014 and 1017. The selector 1016 outputs a signal 1064 according to an instruction from the CPU 1003.
Is input to the rotation circuit 1015 at the next stage.

The selector 1017 selects the signal 1063 and the signal 1064 according to an instruction from the CPU 1003. The output signal 1065 of the selector 1017 is input to the pattern matching 1018 and the selector 1019. The pattern matching 1018 performs a pattern matching of the input signal 1065 with a predetermined pattern, and when the pattern matches, a predetermined multi-valued signal is output to the signal line 1.
066.

If no match is found in the pattern matching, the input signal 1065 is output as a signal 1066. The selector 1019 converts the signals 1065 and 1066 into CP
Select according to the instruction of U1003. The output signal 1067 of the selector 1019 is input to the next-stage LUT 1020.

When outputting image information to the printer 2, the LUT 1020 adjusts the input signal 1 according to the characteristics of the printer.
067 is converted. The selector 1021 is connected to the LUT 102
Output signal 1068 and signal 1065 of CPU 1003
Select according to the instruction. The output signal of the selector 1021 is input to the enlargement circuit 1022 at the next stage.

The enlargement circuit 1022 can set the enlargement magnification independently in the X and Y directions according to an instruction from the CPU 1003. The enlargement method is a first-order linear interpolation method. The output signal 1070 of the enlargement circuit 1022 is input to the buffer 1010. The signal 1070 input to the buffer 1010 becomes a bidirectional signal 1057 in accordance with an instruction from the CPU 1003, is sent to the printer 2 via the connector 1001, and is printed out.

Hereinafter, the flow of signals in the core unit and each unit will be described. <Operation of Core Unit Based on Information of Fax Unit> A case where information is output to the fax unit 4 will be described. CPU1
003 is the CP of the reader 1 via the communication IC 1002.
It communicates with U122 and issues a document scan command.

The reader 1 outputs image information to the connector 120 when the scanner unit 104 scans the original according to the instruction. Reader 1 and external device 3
Are connected by a cable, and information from the reader 1 is input to the connector 1001 of the core unit 10. Image information input to the connector 1001 is input to the buffer 1010 through a multi-valued 8-bit signal line 1057. The buffer circuit 1010 converts the bidirectional signal 1057 into a one-way signal according to the instruction of the CPU, and
An input is made to the LUT 1011 via the terminal 58.

The LUT 1011 converts the image information from the reader 1 into a desired value using a look-up table. For example, it is possible to skip the background of a document.
The output signal 1059 of the LUT 1011 is input to the next-stage binarization circuit 1012. The binarization circuit 1012 has 8b
The it multi-level signal 1059 is converted into a binary signal. The binarization circuit 1012 outputs 00H when the binarized signal is 0,
In the case of 1, it is converted into FFH and two multi-level signals. The output signal of the binarization circuit 1012 is input to the rotation circuit 1015 or the selector 1016 via the selector 1013 and the selector 1014.

The output signal 1062 of the rotation circuit 1015 is also input to the selector 1016, and the selector 1016 selects either the signal 1016 or the signal 1062. The selection of the signal is determined by the CPU 1003 communicating with the facsimile unit 4 via the CPU bus 1054.
An output signal 1063 from the selector 1016 is sent to the facsimile unit 4 via the connector 1005.

Next, a case where information from the facsimile unit 4 is received will be described. The image information from the fax unit 4 is transmitted to the signal line 1064 via the connector 1005. The signal 1064 is input to the selector 1014 and the selector 1017. In the case where the image at the time of fax reception is rotated and output to the printer 2 according to an instruction from the CPU 1003, the signal 10 input to the selector 1014 is output.
64 is rotated by a rotation circuit 1015.

Output signal 1062 from rotation circuit 1015
Is input to the pattern matching 1018 via the selector 1016 and the selector 1017. Signal 1064
Is output to the signal 1065. When the image at the time of fax reception is output to the printer 2 as it is in accordance with the instruction of the CPU 1003, the signal 1
064 is input to the pattern matching 1018.

The pattern matching 1018 has a function of smoothing the backlash of an image when a fax is received. The signal subjected to pattern matching is supplied to the selector 10
19 to the LUT 1020. LUT102
0 indicates that the table of the LUT 1020 is set to C in order to output the received fax image to the printer 2 at a desired density.
It can be changed by PU1003. LUT1020
Is input to the enlargement circuit 1022 via the selector 1021.

The enlargement circuit 1022 has two values (00H,
FFH) is subjected to an enlarging process by a first-order linear interpolation method. An 8-bit multilevel signal having many values from the enlargement circuit 1022 is sent to the reader 1 via the buffer 1010 and the connector 1001. Reader 1
Is input to the external I / F switching circuit 119 via the connector 120.

The external I / F switching circuit 119 inputs a signal from the facsimile unit 4 to the Y signal generation / color detection circuit 113. The output signal from the Y signal generation / color detection circuit 113 is output to the printer 2 after the above-described processing, and an image is formed on output paper. <Operation of Core Unit Based on Information of File Unit> File Unit 5
The case where the information is output to is described.

The CPU 1003 communicates with the CPU 122 of the reader 1 via the communication IC 1002, and issues a document scan command. The reader 1 outputs image information to the connector 120 when the scanner unit 104 scans a document according to this command. The reader 1 and the external device 3 are connected by a cable, and information from the reader 1 is input to a connector 1001 of the core unit 10.

The image information input to the connector 1001 is converted by the buffer 1010 into a one-way signal 1058.
Becomes The signal 1058 which is a multi-valued 8-bit signal is LU
The signal is converted into a desired signal by T1011. LUT1
The output signal 1059 of 011 is transmitted to the connector 1 via the selector 1013, the selector 1014, and the selector 1016.
Enter 006. That is, the binarization circuit 1012, and
Without using the function of the rotation circuit 1015, the data is transferred to the file unit 5 as 8-bit multi-value data.

When filing a binarized signal by communication with the file unit 5 via the CPU bus 1054 of the CPU 1003, the functions of the binarizing circuit 1012 and the rotating circuit 1015 are used. The binarization processing and the rotation processing are the same as those in the case of the above-described facsimile, and thus description thereof is omitted.

Next, a case where information from the file section 5 is received will be described. Image information from the file unit 5 is input to the selector 1014 or the selector 1017 as a signal 1064 via the connector 1006. In the case of 8-bit multi-valued filing, the selector 1017 is used. In the case of binary filing, the selector 1014 or 1 is used.
017 can be input.

In the case of binary filing, the description of the same processing as that for facsimile is omitted. In the case of multi-level filing, the output signal 1065 from the selector 1017 is input to the LUT 1020 via the selector 1019. L
In the UT1020, according to the desired print density,
A look-up table is created according to an instruction from the CPU 1003.

Output signal 1068 from LUT 1020
Is input to the enlargement circuit 1022 via the selector 1021. The 8-bit multilevel signal 1070 enlarged to a desired enlargement ratio by the enlargement circuit 1022 is supplied to a buffer 1010,
It is sent to the reader 1 via the connector 1001. The information of the file portion sent to the reader 1 is output to the printer 2 and an image is formed on an output sheet, similarly to the above-described facsimile. <Operation of Core Unit Based on Information of Computer Interface Unit> The computer interface unit 7 interfaces with a computer connected to the external device 3. S as a computer interface
It has CSI, RS232C, and Centronics. The computer interface unit 7 has the above three types of interfaces, and information from each interface is:
Via the connector 1007 and the data bus 1054, the CP
It is sent to U1003. The CPU 1003 performs various controls based on the transmitted contents. <Operation of Core Unit Based on Information of Formatter Unit> The formatter unit 8 has a function of expanding command data such as a document file transmitted from the computer interface unit 7 into image data.

When the CPU 1003 determines that the data transmitted from the computer interface unit 7 via the data bus 1054 is data relating to the formatter unit, the CPU 1003 transfers the data to the formatter unit via the connector 1008. The formatter unit 8 develops a visible image from the transferred data in a memory. Next, a procedure for receiving information from the formatter unit 8 and forming an image on an output sheet will be described.

The image information from the formatter unit 8 is transmitted as a multi-level signal having two values (00H, FFH) to the signal line 1064 via the connector 1008. The signal 1064 is supplied to the selector 1014, the selector 10
17 is input. The selectors 1014 and 1017 are controlled by an instruction from the CPU 1003.

Thereafter, the description is omitted because it is the same as that of the above-described facsimile. <Operation of Core Unit Based on Information in Image Memory Unit 9> A case where information is output to the image memory unit 9 will be described. First, a case where image information read by the reader 1 is output to the image memory unit 8 will be described.

The CPU 1003 communicates with the CPU 122 of the reader 1 via the communication IC 1002, and issues a document scan command. The reader 1 outputs image information to the connector 120 when the scanner unit 104 scans a document according to this command. The reader 1 and the external device 3 are connected by a cable, and image information from the reader 1 is input to the connector 1001 of the core unit 10.

The image information input to the connector 1001 includes a multi-valued 8-bit signal line 1057 and a buffer 10.
10 to the LUT 1011. LUT10
The output signal 1059 of the eleventh is converted to a binarization circuit 1012 of the next stage.
To enter. The binarization circuit 1012 converts the 8-bit multilevel signal 1059 into a binary signal. Binarization circuit 10
Numeral 12 converts the binary signal to 00H when it is 0 and FFH when it is 1 to convert it into two multi-level signals.

The output signal of the binarizing circuit 1012 is passed through the selector 1013 and the selector 1014,
5, or input to the selector 1016. The output signal 1062 of the rotation circuit 1015 is also input to the selector 1016, and the selector 1016 outputs the signal 1061 or the signal 1
062 is selected. The selection of the signal
003 is determined by communicating with the fax unit 4 via the CPU bus 1054.

Output signal 1063 from selector 1016
Is connected to the image memory unit 9 via the connector 1009.
To transfer the binary image information. Next, a case where the image information from the fax unit 4 is output to the image memory unit 8 will be described. Image information from the fax unit 4 is transmitted as a multi-level signal having two values (00H, FFH) to the signal line 1064 via the connector 1005. The signal 1064 is input to the selector 1014.

The signal transmitted to selector 1014 is input to rotation circuit 1015 or selector 1016. The output signal 1062 of the rotation circuit 1015 is also input to the selector 1016.
1 or the signal 1062 is selected. The signal is selected by the CPU 1003 via the CPU bus 1054.
It is determined by communicating with the fax unit 4. The output signal 1063 from the selector 1016 is
09 to the image memory unit 9.

Next, the image information from the file section 5 is sent to the connector 1006 as a signal 1064 as a multi-valued 8 bi
In the case of a t image, it is input to the selector 1017. In the case of a binary image, two values (00H, FFH)
Is input to the selector 1014 as a multilevel signal having The multilevel signal input to the selector 1017 is subjected to pattern matching 1066 according to the selection of the selector 1019.
Is possible. The output signal 1067 of the selector 1017 is input to the selector 1021 after being converted into a desired signal by the LUT 1020. Selector 10
The signal of 21 is further expanded by the enlargement circuit 1022 and the LUT 10
11, a binarizing circuit 1012 according to the selector 1013
Through the selector 1014 and the rotation circuit 10
15 or input to the selector 1016.

Since the details of the binarization in the binarization circuit 1012 have been described in the facsimile, the description is omitted here. Output signal 1062 of rotation circuit 1015
Is also input to the selector 1016, and the selector 1016
Selects either the signal 1061 or the signal 1062.

The signal is selected by the CPU 1003
It is determined by communicating with the file unit 5 via the bus 1054. Output signal 10 from selector 1016
63 is transferred to the image memory unit 9 via the connector 1009. Next, a case where data of the computer interface unit 7 is output to the image memory unit 9 will be described.

Data from the computer interface unit 7 is supplied to the signal line 1 via the connector 1007.
064. Here, when the data is a multi-valued 8-bit image, the data is input to the selector 1017,
In the case of a value image, the value image is input to the selector 1014 as a multi-value signal having two values (00H, FFH).

If the data is data other than image data, it is input to the selector 1017. The multi-level image signal input to the selector 1017 is
After conversion to a desired signal by the selector 1021, the selector 1021
Is input to The signal of the selector 1021 further passes through the binarization circuit 1012 according to the enlargement circuit 1022, the LUT 1011 and the selector 1013, and is input after being subjected to the binarization processing.

Since the details of the binarization have been described in the facsimile, the description is omitted here. In the case of data other than image data, LUT 1020, LUT 10
The signal is input to the selector 1013 without performing the conversion at 11 or the binarization at the binarization circuit 1012.

The signal from the selector 1013 is further provided with an output signal 1063 from the selector 1016 by the connector 100
9 to the image memory unit 9. Next, a case where information from the image memory unit 9 is received will be described. First, a case where image information from the image memory unit 9 is output from the printer 2 will be described.

The image memory unit 9 includes a connector 1009
8bit multilevel signal 1064 via selector 101
4. Transmit to selector 1017. An output signal from the selector 1014 or the selector 1017 is
In accordance with the instruction of 03, the image is output to the printer unit 2 and the image is formed on the output sheet in the same manner as the above-mentioned file. Next, a case where image information from the image memory unit 9 is output from the facsimile unit 4 will be described.

The image memory unit 9 includes a connector 1009
, The binary image information is transmitted to the selector 1014. The binary image signal transmitted to the selector 1014 is input to the rotation circuit 1015 or the selector 1016. The output signal 1062 of the rotation circuit 1015 is also the selector 1
016, and the selector 1016 outputs the signal 1061
Or the signal 1062 is selected. The signal is selected by the CPU 1003 via the CPU bus 1054.
It is determined by communicating with the fax unit 4.

Output signal 1063 from selector 1016
Is sent to the fax unit 4 via the connector 1005. Next, a case where information from the image memory unit 9 is output to the file unit 5 will be described. The image memory unit 9 stores the binary image information or information other than the image information into two values (00H, FF) via the connector 1009.
H) is input to the selector 1014 as a multi-valued signal.

The multi-valued image signal input to the selector 1017 is input to the selector 1021 after being converted into a desired signal by the pattern matching 1018 and the LUT 1020. The signal of the selector 1021 is further converted into a desired signal via the enlargement circuit 1022 and the LUT 1011 and then input to the selector 1013.

Here, binarization processing can be performed by the selector 1013 via the binarization circuit 1012. Since the details of the binarization have been described in the facsimile, the description is omitted here. The signal of the selector 1013 is further supplied to the rotation circuit 101 via the selector 1014.
5, or input to the selector 1016.

The output signal 1062 of the rotation circuit 1015 is also
The signal is input to the selector 1016, and the selector 1016 selects either the signal 1061 or the signal 1062. The selection of the signal is determined by the CPU 1003 communicating with the file unit 5 via the CPU bus 1054. The output signal 1063 from the selector 1016 is connected to the connector 1
006 to the file section 5.

Next, a case where data from the image memory unit 9 is output from the computer interface unit 7 will be described. The image memory unit 9 includes the connector 1
In the case where the data is data other than image information, the data signal 1064 is input to the selector 1017 via 009,
In the case of a binary image, two values (00H, FFH)
Is input to the selector 1014 as a multilevel signal having

The multi-level signal input to the selector 1017 is input to the selector 1021 after being converted into a desired signal by the pattern matching 1018 and the LUT 1020. The signal of the selector 1021 is further converted to a desired signal via the enlargement circuit 1022 and the LUT 1011 and then input to the selector 1013. Here, binarization processing can be performed by the selector 1013 via the binarization circuit 1012.

Since the details of the binarization have been described in the case of facsimile, the description is omitted here. In the case of data other than image data, pattern matching 1018,
The conversion is not performed by the LUT 1020, the enlargement circuit 1022, and the LUT 1011, and is not input to the binarization circuit 1012, and is input to the selector 1013. The signal of the selector 1013 is further passed through the selector 1014 to the rotating circuit 101,
5 or input to the selector 1016.

The output signal 1062 of the rotation circuit 1015 is also input to the selector 1016. However, the multi-valued 8-bit image and data other than the image are output to the selector 1016 from the signal line 1061 without passing through the rotation circuit 105. The selector 1016 selects either the signal 1061 or the signal 1062. The signal selection is CP
The determination is made by U1003 communicating with the computer interface unit 7 via the CPU bus 1054.

Output signal 1063 from selector 1016
Is sent to the computer interface unit 7 via the connector 1007. The core unit 10 has a function of controlling the flow of various signals among the reader 1, the printer 2, the facsimile unit 4, the file unit 5, the computer interface unit, and the image memory unit 9 as described above. It has a function of controlling a series of data processing sequences of (1) signal input, (2) processing, (3) output, and storage by combining a plurality of signal flows. These are realized as functions of the CPU 1003 of the core unit 10. [Description of Fax Unit] A detailed description of the fax unit 4 will be given with reference to FIG.

The facsimile unit 4 is connected to the core unit 10 by a connector 400 and exchanges various signals. The binary information from the core unit 10 is stored in the memories A405 to D408.
, The signal 453 from the connector 400 is input to the memory controller 404,
Under the control of the memory controller, the data is stored in one of the memory A 405, the memory B 406, the memory C 407, and the memory D 408, or a cascade-connected two sets of memories.

The memory controller 404 is a CPU
According to the instruction 2, the following modes are provided. (1) Memory A 405, memory B 406, memory C 40
7. Mode for exchanging data with the memory D408 and the CPU bus 462 (2) Mode for exchanging data with the CODEC bus 463 of the CODEC 411 having an encoding / decoding function (3) Memory A405, memory B406, and memory C40
7. The contents of the memory D408 are stored in the DMA controller 402.
Mode in which data is exchanged with the bus 454 from the scaling circuit 403 under the control of (4) Binary video input data 454 is stored in the memories A405 to D40 under the control of the timing generation circuit 409.
(5) There are five modes: (5) a mode in which the memory contents are read out from any of the memories A405 to D408 and output to the signal line 452.

The memory A 405, the memory B 406, the memory C 407, and the memory D 408 are each 2 Mbytes.
And stores an image equivalent to A4 at a resolution of 400 dpi. The timing generation circuit 409 is connected to the connector 4
00 and a signal line 459, and the core 10
Control signals (HSYNC, HEN, VSYNC, V
EN) to generate signals to achieve the following two functions.

One is to store the image signal from the core unit 10 in one of the memories A405 to D408,
Alternatively, the function of storing in the two memories is a function of transmitting the read signal line 452 from any one of the memories A405 to D408. The dual port memory 410 is connected to a CPU 1003 of the core unit 10 via a signal line 461 and a CPU 412 of the facsimile unit 4 via a signal line 462.

Each CPU exchanges commands via the dual port memory 410. SCSI
The controller 413 interfaces with a hard disk connected to the fax unit 4 in FIG.
Stores data for fax transmission and fax reception.

The CODEC 411 reads out the image information stored in any of the memories A405 to D408, encodes the image information in a desired format of the MH, MR, and MMR systems, and then stores it in any of the memories A405 to D408. It is stored as encoded information. Also, the memory A4
05 to 408, read out the encoded information stored in the memory D408, perform decoding by a desired method of the MH, MR, and MMR methods, and then decode the decoded information, that is, the image information in one of the memories A405 to D408. To be stored.

The MODEM 414 is a CODEC 411,
Alternatively, a function of modulating the encoded information from the hard disk connected to the SCSI controller 413 for electric transmission on the telephone line, and demodulating the information sent from the NCU 415 and converting it into encoded information,
1, or the encoded information is transferred to a hard disk connected to the SCSI controller 413.

The NCU 415 exchanges information according to a predetermined procedure with an exchange installed directly at a telephone office or the like, which is directly connected to a telephone line. One embodiment of fax transmission will be described. The binary image signal from the reader 1 is
The signal is input from the connector 400 and reaches the memory controller 404 through the signal line 453.

The signal 453 is transmitted to the memory controller 405
In the memory A405. Memory A405
Is generated by the timing generation circuit 409 according to the timing signal 459 from the reader 1. The CPU 412 connects the memory A 405 and the memory B 406 of the memory controller 404 to the bus line 463 of the CODEC 411.

The CODEC 411 reads out the image information from the memory A 405 and writes the coded information to be coded by the MMR method into the memory B 406. When the codec 411 encodes A4 size image information, the CPU
412 is a memory B 406 of the memory controller 404
Is connected to the CPU path 462. The CPU 412 sequentially reads out the encoded information from the memory B 406,
Transfer to ODEM414. MODEM 414 modulates the encoded information and sends the fax information over the NCU over a telephone line.

Next, an embodiment of the facsimile reception will be described. Information sent from the telephone line is NC
Input to U415, and NCU 415 connects to the telephone line in a predetermined procedure. Information from NCU 415 is MODEM
414 and demodulated. The CPU 412 stores information from the MODEM 414 in the memory C 407 via the CPU bus 462.

When the information of one screen is stored in the memory C 407, the CPU 412 controls the memory controller 404 to control the data line 457 of the memory C 407.
To the line 463 of the CODEC 411. COD
The EC 411 sequentially reads out the encoded information of the memory C 407 and decodes it, that is, the memory D 40
8 is stored.

The CPU 412 has a dual port memory 4
Communication is performed with the CPU 1003 of the core unit 10 via the CPU 10, and settings are made to print out an image from the memory D 408 to the printer 2 through the core unit. When the setting is completed, the CPU 412 activates the timing generation circuit 409 and outputs a predetermined timing signal from the signal line 460 to the memory controller.

The memory controller 404 reads out image information from the memory D 408 in synchronization with a signal from the timing generation circuit 409, transmits the image information to the signal line 452, and outputs it to the connector 400. Until the output from the connector 400 to the printer 3 is described in the core section, the description is omitted. [Explanation of File Section] FIG.
This is performed using

The file section 5 is connected to the core section 10 by a connector 500 and exchanges various signals. The multi-level input signal 551 is input to the compression circuit 503, where the multi-level image information is converted from multi-level image information into compression information and output to the memory controller 510. The output signal 552 of the compression circuit 503 is stored in one of the memory A 506, the memory B 507, the memory C 508, and the memory D 509 or a cascade connection of two sets of memories under the control of the memory controller 510.

The memory controller 510 includes the CPU 51
According to the instruction of No. 6, the following modes are provided. (1) Memory A 506, memory B 507, memory C 50
8. Mode for exchanging data between the memory D509 and the CPU bus 560 (2) COD of CODEC 517 for encoding / decoding
Mode for exchanging data with EC bus 570 (3) Memory A 506, memory B 507, memory C 50
8. The contents of the memory D509 are stored in the DMA controller 508.
Mode in which data is exchanged with the bus 562 from the scaling circuit 511 under the control of (4) the signal 563 under the control of the timing generation circuit 514
(5) A mode in which memory contents are read from any of the memories A506 to D509 and output to the signal line 558.

The memory A 506, the memory B 507, the memory C 508, and the memory D 509 are each 2 Mbytes.
And stores an image equivalent to A4 at a resolution of 400 dpi. The timing generation circuit 514 is connected to the connector 5
00 and a signal line 553, and the core 10
Control signals (HSYNC, HEN, VSYNC, V
EN) to generate signals to achieve the following two functions.

One is to store the image signal from the core unit 10 in one of the memories A506 to D509,
Or the function of storing in two memories;
This is a function of transmitting from any one of 506 to the memory D509 to the read signal line 556. The dual port memory 515 is connected to the core unit 1 via a signal line 554.
The CPU 516 of the file unit 5 is connected to the CPU 1003 of the file unit 5 via a signal line 560.

Each CPU exchanges commands via the dual port memory 515. SCS
The I controller 519 interfaces with the external storage device 6 connected to the file unit 5 in FIG.
The external storage device 6 is specifically composed of a magneto-optical disk, and stores data such as image information.

The CODEC 517 reads out the image information stored in any of the memories A506 to D509, encodes the image information in a desired format of the MH, MR, and MMR systems, and then performs any one of the memories A506 to D509. Is stored as encoded information. Also, memory A
After reading the encoded information stored in the memory 506 to the memory D509 and performing decoding by a desired method of the MH, MR, and MMR, the decoded information, that is, image information is stored in any of the memory A506 to the memory D509. I do.

An embodiment for storing file information in the external storage device 6 will be described. An 8-bit multi-valued image signal from the reader 1 is input from the connector 500 and the signal line 5
The signal is input to the compression circuit 503 through the line 51. The signal 551 is
The data is input to a compression circuit 503 and converted into compression information 552 here. The compression information 552 is stored in the memory controller 51.
Enter 0.

The memory controller 510 includes the core unit 10
From the timing generation circuit 559
Generates a timing signal 559, and stores the compressed signal 552 in the memory A 506 according to this signal. CPU 51
Reference numeral 6 denotes a memory A 506 of the memory controller 510 and a memory B 507 which are connected to the bus line 5 of the CODEC 517.
Connect to 70.

The CODEC 517 reads out the compressed information from the memory A 506, performs encoding by the MMR method, and writes the encoded information to the memory B 507. CODE
When C517 completes the encoding, the CPU 516 transfers the memory B507 of the memory controller 510 to the CPU bus 5
Connect to 60. The CPU 516 sequentially reads the encoded information from the memory B 507 and transfers it to the SCSI controller 519. The SCSI controller 519 is
The encoded information 572 is stored in the external storage device 6.

Next, an embodiment for taking out information from the external storage device 6 and outputting it to the printer 2 will be described. Upon receiving the information search / print command, the CPU 516
Receives encoded information from the external storage device 6 via the SCSI controller 519, and transfers the encoded information to the memory C508. At this time, the memory controller 510 operates according to an instruction from the CPU
60 is connected to the bus 566 of the memory C508.

When the transfer of the encoded information to memory C 508 is completed, CPU 516 causes memory controller 510
By controlling the memory C508 and the memory D50.
9 is connected to the bus 570 of the CODEC 517. COD
The EC 517 reads the coded information from the memory C 508, sequentially decodes the coded information, and then transfers it to the memory D 509.

When scaling such as enlargement / reduction is required when outputting to the printer, the memory D509 is connected to the bus 562 of the scaling circuit 511, and the content of the memory D509 is scaled under the control of the DMA controller 518. . CPU 516
Communicates with the CPU 1003 of the core unit 10 via the dual port memory 515, and performs settings for printing out an image from the memory D509 to the printer 2 through the core unit 10.

When the setting is completed, the CPU 516 activates the timing generation circuit 514 and outputs a predetermined timing signal from the signal line 559 to the memory controller 510. The memory controller 510 reads the decoding information from the memory D509 in synchronization with the signal from the timing generation circuit 514, and transmits the decoding information to the signal line 556.

The signal line 556 is input to a decompression circuit 504, where the information is decompressed. The output signal 555 of the expansion circuit 504 is output to the core unit 10 via the connector 500. Until output from the connector 500 to the printer 3,
Since the explanation has been made in the core section 10, the explanation is omitted.

The file section 5 manages the file information size stored in the external storage device 6 and can notify the core section 10 how much information can be stored. is there. The notification of the storable amount information is performed by the CPU 1003 of the core unit 10 and the CP of the file unit 5.
This is done by communicating with U516. [Description of Computer Interface Unit 7] The computer interface unit 7 will be described with reference to FIG.

Connector A700 and Connector B70
Reference numeral 1 denotes a connector for a SCSI interface.
The connector C702 is a connector for a Centronics interface. Connector D703 is RS232C
Interface connector. Connector E707
Is a connector for connecting to the core unit 10.

The SCSI interface has two connectors (connector A700 and connector B701).
When connecting devices having a plurality of SCSI interfaces, cascade connection is performed using the connector A 700 and the connector B 701. When the external device 3 and the computer are connected on a one-to-one basis, the connector A700 and the computer are connected by a cable, the terminator is connected to the connector B701, or the connector B701 and the computer are connected by a cable. To the terminator.

The connector A700 or the connector B7
01 is input to the SCSI I / F-A 704 or the SCSI I / F-A 704 via the signal line 751.
Input to FB708. SCSI I / F-A70
4, or SCSI I / F-B708 is SCSI
, And outputs the data to the connector 707E via the signal line 754.

The connector E707 is connected to the CPU of the core unit 10.
The CPU 1 of the core unit 10 is connected to the bus 1054
003 is a SCSI I / F from the CPU bus 1054.
The information input to the connectors (connector A 700, connector B 701) is received. CPU 1003 of core unit 10
Data from the SCSI connector (connector A70
0, the output to the connector B 701) is performed in the reverse procedure.

The Centronics interface is connected to the connector C 702, and is input to the Centronics I / F 705 via the signal line 752. The Centronics I / F 705 receives data according to the procedure of the determined protocol, and outputs the data to the connector E707 via the signal line 754. The connector E707 is connected to the CPU bus 1054 of the core unit 10, and the CPU 1003 of the core unit 10 receives the information input to the Centronics I / F connector (connector C702) from the CPU bus 1054.

The RS232C interface is connected to the connector D703, and the RS232C interface
232C I / F 706. RS232C ・
The I / F 706 performs short reception according to the procedure of the determined protocol, and connects the connector E70 via the signal line 754.
7 is output. The connector E707 is connected to the CP of the core unit 10.
The CPU of the core unit 10 is connected to the U bus 1054
Reference numeral 1003 denotes an RS232C bus from the CPU bus 1054.
The information input to the I / F connector (connector D703) is received. Data from the CPU 1003 of the core unit 10 is transmitted to an RS232C / I / F connector (connector D70).
In the case of outputting to 3), the procedure is performed in the reverse order of the above. [Description of Formatter Unit 8] The formatter unit 8 will be described with reference to FIG.

The data from the computer interface unit 7 described above is discriminated by the core unit 10, and if the data is related to the formatter unit 8, the core unit 1
0 of the CPU 1003 is a connector 1008 of the core unit 10.
And transfers data from the computer to the dual port memory 803 via the connector 800 of the formatter unit 9.

The CPU 809 of the formatter unit 8 receives the code data sent from the computer from the dual port memory 803. The CPU 809 sequentially develops the code data into image data, develops the image data via the memory controller 808, and transfers the image data to the memory A 806 or the memory B 807 via the memory controller 808.

Each of the memory A 806 and the memory unit 807 has a capacity of 1 Mbytes and has one memory (memory A).
806 or the memory B 807) can support up to an A4 paper size at a resolution of 300 dpi. 300dp
When the resolution of i corresponds to A3 paper, the memory A
806 and the memory B 807 are cascaded to develop image data.

The above memory is controlled by the memory controller 808 in accordance with an instruction from the CPU 809. If the rotation of characters or graphics is required when developing the image data, the image data is rotated by the rotation circuit 804 and then transferred to the memory A 806 or the memory B 807.

Memory A 806 or memory B 807
Then, the data bus line 858 of the memory A 806 or the data bus line 859 of the memory B 807 is connected to the output line 855 of the memory controller 808. Next, the CPU 809 connects the CPU 1 of the core unit 10 via the dual port memory 803.
003 and a mode for outputting image information from the memory A 806 or the memory B 807 is set.

The CPU 1003 of the core unit 10
0 via the communication circuit 1002 in the CPU 1 of the reader unit 1
The CPU 122 is set to the print output mode by using the communication function built in the CPU 22. The CPU 1003 of the core unit 10 for setting the print output mode includes the connector 10
08 and the timing generation circuit 802 via the connector 800 of the formatter unit 8.

The timing generation circuit 802 includes the core unit 10
A timing signal for reading image information from the memory A 806 or the memory B 807 is generated in the memory controller 808 in accordance with the signal from the memory controller 808. Memory A80
6, or image information from the memory B 807 is input to the memory controller 808 via the signal line 858.

The output image information from the memory controller 808 is transferred to the core unit 10 via the signal line 851 and the connector 800. The output from the core unit 10 to the printer 2 has been described for the core unit 10 and will not be described. [Description of Image Memory Unit 9] The description of the image memory unit 9 will be described with reference to FIG.

The image memory unit 9 is connected to the core unit 10 by a connector 900 and exchanges various signals. The multi-level input signal 954 is stored in the memory 904 under the control of the memory controller 905. Memory controller 90
5 has the following modes according to an instruction from the CPU 906. That is, (1) a mode in which data is exchanged between the memory 904 and the CPU bus 957, and (2) a signal 95 under the control of the timing generation circuit 902.
(3) A mode in which the memory contents are read from the memory 904 and output to the signal line 955.

The memory 904 has a capacity of 8 Mbytes, and can store about two images of 400 dpi resolution and two A3 equivalents. The timing generation circuit 902 includes a connector 900 and a signal line 952.
And a control signal (HSY) from the core unit 10.
NC, HEN, YSYNC, VEN)
Generate signals to achieve the following two functions. 1
One is a function of storing information from the core unit 10 in the memory 904, and the other is a function of reading out the signal line 9 from the memory 904.
It is a function to transmit to 55.

The dual port memory 903 includes a CPU 1003 of the core unit 10 via a signal line 953, and a CPU 906 of the image memory unit 9 via a signal line 957.
Is connected. Each CPU exchanges commands via the dual port memory 903. An embodiment for storing image information input from the core unit 10 in the image memory unit 9 will be described.

Here, the image information input from the core unit 10 has been transferred from any of the reader 1, the facsimile unit 4, the file unit 4, and the computer interface unit 7. First, the CPU 906 controls the memory controller 905 and connects the CPU bus 954 to the memory 90.
4 bus.

The image signal of the core unit 10 transferred from one of the reader 1, the facsimile unit 4, the file unit 5, and the computer interface unit 7 is transmitted to the connector 900.
From the memory controller 905 via a signal line 954. Memory controller 905
Generates a timing signal 956 in the timing generation circuit 902 based on the signal 952 from the core unit 10 and stores the signal 954 in the memory 904 according to this signal.

Next, the memory 904 of the image memory unit 9
An embodiment for outputting the image information stored in the core unit 10 to the core unit 10 will be described. Here, the image information output to the core unit 10 includes a printer 2, a fax unit 4, a file unit 5,
The data is transferred to one of the computer interface units 7. First, the CPU 906 controls the memory controller 9
05 to control the data line of the memory 904 to the signal 95
Connect to 5.

The CPU 906 has a dual port memory 9
The communication with the CPU 1003 of the core unit 10 is performed through the memory unit 904 and the printer 2,
A setting for outputting image information to any one of the facsimile unit 4, file unit 5, and computer interface unit 7 is performed. When the setting is completed, the CPU 906 activates the timing generation circuit 902 and outputs a predetermined timing signal from the signal line 956 to the memory controller 905.

The memory controller 905 reads image information from the memory 904 in synchronization with a signal from the timing generation circuit 902, transmits the image information to the signal line 955, and outputs the signal to the connector 900. From connector 900 to printer 2, fax unit 4, file unit 5, computer
The description up to the output to the interface unit 7 is omitted because it has been described in the core unit 10.

The CPU 906 of the image memory unit 9
Classifies the image stored in the memory 904 into attributes of partial regions in the image, that is, any one of a character part, a title part, a frame part, a table part, a halftone figure part, a line figure part, and a line part. It has a function to perform block selection processing. Here, the image data to be subjected to the block selection processing may be data read from the reader 1 or image data transferred from the facsimile unit 4, the file unit 5, or the computer interface unit 7. You may. However, since the image data that can be subjected to the block selection processing is limited to binary image data, if the image data has been read by the reader 1, the fax unit 4, the file unit 5, or If the image data transferred from the computer interface unit 7 is multi-valued image data, it is necessary to binarize the image data via the binarization circuit 1012 and then store it in the memory 904. .

An embodiment of the block selection processing in the image memory unit 9 will be described in detail below.
FIG. 10 is a schematic flow of the block selection. If it is desired to increase the processing speed of the block selection, in step S1000, the image data is thinned out. When the image data is decimated, the block selection process is performed on the decimated image.

The image data is thinned by m × m pixels.
This is done by stating the connectivity of black pixels in the block. For example, if there are two connected black pixels in a 3 × 3 pixel block, the 3 × 3 pixel block is thinned out to one black pixel. Conversely, when two connected white pixels exist in the block, the block is thinned out to one white pixel.

In step S1001, the image of a pixel is analyzed to search for connectivity, and classified according to its size and its relative position with respect to other connected components. One connected component is a set of black pixels completely surrounded by white pixels. Therefore, one black pixel connected component is completely separated from other black pixel connected components by at least one white pixel.

The details of step S1001 will be described with reference to FIGS. 11A, 11B, and 11C. Roughly speaking, the search for connected components and the size information and some statistical information obtained from the connected components are performed. Classification of connected components is performed based on the classification. In the classification, first, each connected component is classified into a text unit or a non-text unit. The non-text units are then analyzed in more detail, and the data
Determined as halftone image, line drawing, table or other tabular text data. If it is unknown, no classification is performed as unknown. Then, a hierarchical tree structure is created for each connected component so as to provide the component data of the connected component and to facilitate reconstruction of the data.

In step S1002, adjacent connected components are grouped unless a gap line is interposed. The grouping here may be performed vertically or horizontally. This corresponds to whether the text unit to be grouped is written vertically or horizontally, and the distance between connected components adjacent in both directions is checked in advance in each of the horizontal and vertical directions, and the horizontal direction is determined. Are grouped in the horizontal direction when the distance is small, and in the vertical direction when the distance in the vertical direction is small. The tree structure generated in step S1001 is used to prevent text and non-text from being mixed inappropriately. Further, step S100
At 2, it is determined whether the text units are grouped into lines by detecting vertical or horizontal gaps between the lines and borders extending in the longitudinal direction of the non-text units. This row structure is maintained in the tree structure by appropriately updating the hierarchical tree structure.

At step S1003, step S100
If the rows grouped in 1002 have a narrow space in the direction opposite to the direction in which they were grouped first, they are grouped again in that direction to form a block. Non-text units, on the other hand, are used as boundaries for the image page. Text units between two non-text units are processed separately from other text line units.

Further, in step S1003, the non-text units that could not be classified in step S1001 are analyzed to determine whether or not the title is of a large font size. If they are determined to be titles, those units are given the appropriate attributes and the tree is updated. title is,
Helps reconstruct the page.

FIG. 11 is a detailed flowchart showing how connected pixels of pixel image data are detected and the connected pixels are classified. In step S1101, pixel image data is searched for by contour tracing. Contour tracking is performed by scanning the image, as shown in FIG. 12A. The scanning starts from the lower right as indicated by arrow A and proceeds upward until the right edge of the figure is encountered. This scan is done in other directions,
For example, you may go from upper left to lower right.

When a black pixel is hit, whether the adjacent pixel is a black pixel or not is checked in the order of the pattern direction indicated by 31. This search is called an eight-direction search because it is represented by a vector in eight directions viewed from the center. If there are adjacent black pixels, this process results in the outer contour of the figure. Thus, as shown in FIG. 12B, the scan in the direction of arrow A hits a point corresponding to the end of the character "Q" of 32. A search for adjacent pixels is performed with 31 patterns, and the outer contour of the letter "Q" is tracked. Parts inside the closed contour are not tracked.

The contour obtained by the eight-direction search, that is,
When one connected component is extracted, scanning proceeds until the next black pixel is encountered. Thus, for example, an object 34 that is considered to represent a complete black area is searched in eight directions. Similarly, the handwritten character “non-tex”
The non-text object 35, "t", is tracked, and the set of individual characters 36 forming the word "text" is tracked. The scan shown in FIG. 12A detects all connected components. Continue until

The flow advances to step S1102, and all connected components are cut out in a rectangle. In this case, the smallest possible rectangle covering the individual connected components will be drawn. Thus, rectangle 37 around object 32 in FIG.
9, a rectangle 40 is drawn around the object 35. Text objects 36a, 36b, 36c, 3
The same applies to rectangles 41a to 41d for 6d.

In step S1103, all the rectangles are positioned in the tree structure. In most cases, the tree structure obtained in step S1103 results directly from the root for each object. This is because only the outer contour of the connected component is tracked, and the inside of the closed region is not tracked. Thus, as shown in FIG. 12C, the rectangle 37 corresponding to the connected component 32 directly comes from the root of the page.

However, when the rectangle is completely included in another rectangle, such as the rectangle 40 surrounding the non-text object 35 and the rectangles 41a and 41b surrounding the text objects 36a and 36b, these connected components are included. Of the connected component (in this case, component 34). Further, each connected component having at least one child, such as component 34, makes the component itself a "primary child".

In the example of FIG. 12C, the component 39 includes itself as a main child along with other child components 40, 41a, and 41b. In step S1104, each connected component at the first level in the tree is classified as a text unit or a non-text unit. The classification process consists of two steps.

In the first step, the rectangle surrounding the connected component is compared with a predetermined size. If the height of the rectangle surrounding the connected component exceeds a predetermined value corresponding to the maximum value of the font size, or the width of the rectangle is determined by setting the page width to a certain value empirically determined (“5” is satisfactory). If the connected component is greater than the value divided by the given value, then the connected component is classified as a non-text unit and the "non-text" attribute is given to the unit.

In the second step, all the remaining units that have not been given attributes, that is, the units that have not been classified as non-text, are assigned a value determined based on the statistical size obtained from all the remaining connected components. Be compared.
In particular, the average height of all rectangles not considered non-text is calculated. An adaptive threshold is obtained by multiplying this average height by a certain value (2 in general). All units above this threshold are classified as non-text. On the other hand, a unit smaller than the threshold is regarded as text. Thus, each unit is classified and given an appropriate attribute.

As described above, the two classifications are shown in FIG. 11A, FIG.
It undergoes some further processing shown in FIG. 11C. This is described in more detail below. After all units in the first level of the tree have been classified as text or non-text, the children of the text unit are classified as text, including the main child (ie, themselves). The main non-text children are left as non-text, while the other children are classified as text.

At step S1105, the first unit is selected. In step S1106, if the unit is text, the process proceeds to step S1107,
The next unit is selected. Until a non-text unit is selected, the processing of steps S1106 to 1107 continues. When a non-text unit is selected, step S1 is executed.
Proceed to 108.

In step S1108, it is checked whether the non-text unit has children. For example,
In the example of FIG. 12C, the non-text unit 39 includes a main child 39 that is a non-text and texts 40, 41a,
He has a child 41b. In step S1108,
If the unit has children, step S110
Go to 9, where each unit is filtered for halftone (or grayscale). In halftone filtering, its children are examined and those that are smaller than the "noise" size are counted.

The “noise size” unit is
Its height is smaller than the minimum font size in the input image data. If the number of children smaller than the noise size is greater than half the total number of children, the unit is determined to be a halftone image. As a result, the process advances from step S1110 to step S1111 to give an attribute "halftone". And step S
At 1112, the text in the halftone image is examined. In other words, among the children of the halftone image, those of the text size are not the children of the halftone image, but at the same level as the halftone image,
Modify the tree structure.

If this procedure is appropriate, it is possible to recognize characters in a halftone image. The flow is step S
Returning to 1105, the next unit is selected and processed. In step S1109, if the result of the halftone filtering indicates that the unit is not halftone, the process proceeds from step S1110 to step S1113, where the main child of the unit is selected for further processing. Then, the flow proceeds to step S1114.

Next, in step S1108, if it is determined that the unit is a non-text unit and has no children, or if the main child is selected for subsequent processing in step S1113, the process proceeds to step S1114. , The unit undergoes frame filtering. Frame filtering refers to determining whether the unit is a frame. A frame means that there are parallel straight lines of almost the same length in width and height that make up a rectangle surrounding the unit.

In particular, in the unit of interest, the line width of the connected component in each row when viewed in pixel units is examined. In FIG. 13A, the non-text unit 42 includes a connected component 43 having a contour component such as 44. In this example, the line width of this connected component in row i is x, that is, the distance from the left end 45a to the right end 45b of the contour.

On the other hand, in line j, there are two line widths inside the connected component. 46a-46b and 47a-47b. The distance between 46a and 46b, which is the longest line width, is defined as the distance x. Non-text unit 42
The distance x is calculated at all rows n in, and whether the non-text unit is a frame is checked by the following inequality:

[0160] Here, as described above, Xk is the longest line width in the k-th row in the connected component, W is the width of the rectangle 42, N is the number of rows, and the threshold is that the frame is slightly inclined. Is a value calculated in advance so that it can be detected as a frame.

In order to allow a tilt of 1 °, a threshold value of sin (1 °) × L + (constant value) may be used. This constant value is determined in step S
The average height of the character calculated in 1104. When the above inequality is satisfied, the unit is determined to be frame data, and the flow proceeds from step S1115 to step S1115.
Proceeding to 1116, an attribute "frame" is added. Thus, for example, a determination such as “frame and table” or “frame and halftone” can be made on the frame.

After step S1116, the flow examines the possibility that the frame data includes a table or a table format. In step S1117, an inspection for obtaining a white contour in the connected component is performed. The white contour is basically the same as the (black) contour obtained in step S1101, but is obtained by examining a white pixel instead of a black pixel.

As shown in FIG. 14A, the inside of the non-text unit is searched in the direction of arrow B from the lower right to the upper left. When a white pixel is encountered for the first time, a search is performed on a white pixel near the point from the point, such as 51. At this time,
Note that in the outward search of 51, only directions 1 to 4 are required. As a result, the white contour tracking in the processing here is a four-way search.

This process is continued until all the white contours have been extracted. For example, the white contour tracking is performed by using the black line portion 52,
This is to extract a contour portion surrounded by 53, 54, and 55, and the same processing is performed on the inside of a black pixel such as 56. The above-described scan in the direction of arrow B is continued until all closed white contours in the non-text object are tracked.

In step S1118, the density of the non-text unit is calculated. The density is calculated by counting the number of black pixels in the connected component and dividing the number of black pixels by the total number of pixels surrounded by a rectangle. Step S
At 1119, the number of white contours in the found non-text unit is calculated. If the number is four or more, the non-text image may be a table or text blocks arranged in a table.
Then, in step S1120, the filling rate of the white contour is calculated.

The filling rate of the white outline indicates the ratio of the area surrounded by the white outline in the non-text image. In the example of FIG. 14A, there are white contours such as 57 and 59 that are completely composed of only white pixels, and there are also white contours such as 60 and 61 that include a black pixel area inside. If the fill factor is high, the non-text image is probably a table or text blocks arranged in a table. In order to make this estimation more reliable, it is checked whether the target white contour has a lattice-like internal structure in the horizontal and vertical directions. In particular, step S1122
Then, a white contour having a border line that does not cross at least two contour lines in the horizontal or vertical direction is regarded as not being in a grid shape and is rejoined.

For example, in the example of FIG. 14A, the left boundary 62 and the right boundary 63 of the white contour 59 extend vertically so as to coincide with the left boundary 64 and the right boundary 65 of another white pixel 60. Therefore, these white contours are determined to be arranged in a grid and are not reconnected. Similarly, the upper boundary 66 and the lower boundary 67 of the white contour 63 extend in the horizontal direction so as to coincide with the upper boundary 68 and the lower boundary 69 of another white pixel 70. As a result, it is determined that these white contours are also arranged in a lattice, and are not recombined.

FIGS. 14B to 14D are diagrams for explaining the case where white contours are combined. FIG. 14B shows an example of a non-text unit in which the non-text unit 71 includes units from a halftone image to a binary image. The non-text image 71 includes a black pixel region 72 and white pixel regions 74, 75, 76, 77, 78, 79.
Contains. Probably, since the filling rate of this white pixel area is sufficiently high, the flow proceeds to the recombination step S1122 in step S1121. First, as shown in FIG. 14C, first, the upper end and the lower end of the white outline 75 are compared with the upper end and the lower end of the white outline 77. Since these upper and lower ends do not coincide, 75 and 76 are combined into a new white contour 7.
6 'is created.

Next, in FIG. 14D, the left and right boundaries of the white outline 77 are compared with the left and right boundaries of the white outline 78. Since these boundaries do not coincide, 77 and 79 are recombined into a new white contour 77 '. This process is repeated horizontally and vertically until recombination no longer occurs.

As described above, the white contours of the table are hard to be combined, and those other than the table, for example, those other than the table, such as halftone images and line figures, are easily combined. Then, a recombination rate is calculated in step S1123. If the recombination rate is high or the number of white contours remaining after the recombination processing is less than 4, the flow proceeds to step S1.
Proceeding to 128, the non-text unit is determined to be a halftone image or line figure, as described in more detail below.

If the recombination rate is not high in step S1123, or if at least four or more white contours remain, the flow proceeds to step S1124, and it is determined that the table is a table. In step S1125, the inside of a table newly determined to be a table is examined, and a search and classification of connected components included therein are performed.

According to the new internally connected component, step S
At 1126, the tree structure is updated. In step S1127, the internally connected component is again classified as text or non-text, and an appropriate attribute is added. This process is the same as the flow from step S1102 to step S1104 described above. Then, the flow returns to step S1107, and the next text unit is selected.

Steps S1121 and S1123
If the filling rate is not high in step S1121 or the recombination rate is not high in step S1123, the non-text frame graphic is likely to be a halftone image or a line graphic. Whether the unit is a halftone image or a line figure is determined by the average of the horizontal run length of black pixels in the unit, the ratio of white pixels to black pixels, and the density. Generally, a very high order image is regarded as a halftone image, and a bright white image is determined as a line figure.

In particular, when the average run length of the white pixels is almost 0 (almost black, mottled, or pattern image), and when the density calculated in step S1118 is larger in black than in white (ie, If the density is greater than a threshold of about 0.5 (this is the first threshold), the frame unit is determined to be halftone. If the density is not greater than the first threshold, the unit is determined to be a line figure.

If the average run length of white pixels is almost zero and the average run length of white pixels is larger than the average run length of black pixels, the frame unit is determined to be a line figure. . However, if the average run length of the white pixels is not greater than the average run length of the black pixels (ie, also a black dominant image), more detailed testing is required.

In particular, when the number of black pixels is much smaller than the number of white pixels (ie, when the number of black pixels is smaller than twice the number of white pixels (this is used as a second threshold)), The unit is determined to be halftone. On the other hand, the value obtained by dividing the number of black pixels by the number of white pixels is not larger than the second threshold, but the density calculated in step S1118 is 1
If so, the frame unit is determined to be a halftone image. Otherwise, it is determined as a line figure.

If it is determined in step S1128 that the frame unit is a line figure, the flow proceeds to step S11.
Proceeding to S29, the attribute "line figure" is added, and all the children are removed in step S1130. In particular, once a unit is determined to be a line figure, no character recognition processing is performed on that unit anymore.
Thereafter, the flow returns to step S1107, and the next frame unit is selected.

If it is determined in step S1128 that the frame unit is not a line figure, the flow proceeds to step S1128.
The process proceeds to 131, where an attribute "halftone" is added, and in step S1132, the children of the text size among the children of the unit are removed. All children larger than the text size are allowed to remain as children of the frame halftone image.

Then, the flow returns to step S1107, and the next text unit is selected. Step S1
Return to 119. If the number of white contours is not larger than 4, it is determined that the frame unit is not a table. Then, the flow proceeds to step S1133, and the density calculated in step S1118 is compared with a certain threshold value (about 0.5). This threshold was chosen because text units and line figures in the frame should be less than half of all pixels. If the density is less than this threshold, flow proceeds to step S1134, where the internal structure of the frame unit is examined. This process is the same as the already described step S1101 for the internal structure of the frame unit.

At step S1133, if the density is not smaller than the predetermined threshold value, the flow proceeds to step S1133.
Proceeding to 1142, a determination is made whether the frame unit is to be classified as a line figure or a halftone image, or that the frame is unclassifiable (ie, the frame is "unknown"). It returns to step S1115. If no frame is detected in the non-text unit by the frame filtering in step S1114, the flow proceeds to step S1135, and it is determined whether the non-text unit includes a “line”. "Lines" can be useful non-text units to represent text boundaries. However, the text delimited (enclosed) by such a line is often very close to that line, and contact may have occurred. As a result, the line search needs to consider both the case where the text is touching and the case where the text is not touching.

For a line search when no contact occurs, a vertical histogram of a non-text unit is calculated. In the example of FIG. 13B, the line histogram 48 should be a uniform value with elementary height approximately equal to the line width.
The line width is approximately equal to the width of the text unit ("W"), but if there is a difference, it is due to the slope θs. The inclination is set when the original document is input. Then, to determine whether the non-text unit includes a line, the height 49 of each cell k in the histogram is compared with the width W. The mean square of the difference between these values is compared to a threshold value as follows:

[0182] This threshold is used to determine the amount of line twist in non-text,
It is calculated to allow the inclination θs. For 1 ° twist and tilt, Has been found to produce satisfactory results.

If a non-contact line drawing is not found due to the above inequality, a search is performed to determine whether a line drawing in which contact has occurred is not included. In order to check whether or not a non-text unit of interest includes a touching line drawing, it is sufficient to check whether or not a linear object exists near the line boundary of the unit. For example, FIG.
As in the example of C, suppose that a line drawing exists near the boundary of the rectangle surrounding the unit. In this case, 2 of processing from the boundary line
This can be determined by calculating the sum of the squares. That is, in this case, the following inequality is calculated.

[0184] If the left side is smaller than a predetermined threshold value, it can be understood that there is a contacting line. This threshold value may be the same value as that of a line in which no contact occurs.

If a line is detected in step S1135,
The flow proceeds from step S1136 to step S1137, where an attribute “line” is added to the non-text unit. Then, the flow proceeds to step S1107, and the next unit is selected. On the other hand, if step S1
If no line is detected at 135, the flow proceeds from step S1136 to step S1137, where
The size of the non-text unit is checked. if,
If the size is below a certain threshold, the classification of the non-text unit cannot be determined. The threshold is determined from the maximum font size. Specifically, a good result can be obtained by setting the value to half the maximum font size.

Then, the process proceeds to step S1138, where an “unknown” attribute is added. Then, step S110
Returning to 7, the next unit is selected. Step S11
At 37, if the size is greater than the predetermined threshold, the flow proceeds to step S1139, step S1140, step S1141, where a white contour search is performed in the internal area of the non-text unit, and steps S1117 to S117. The number of white contours is calculated as described in step S1119.

In step S1141, if the number of white contours is not four or more, the flow proceeds to step S1142, in which the size is calculated in order to confirm whether the line figure or the halftone image has a sufficient size. Is done. The size is determined based on the unit height and width of the text and the maximum length of the black pixel run length. In particular, if the height and width of the non-text unit are smaller than the maximum font size, the unit is considered not to be large enough to form a line figure or a halftone image, and the flow proceeds to step S1143. An “unknown” attribute is added.

The flow returns to step S1107, and a new unit is selected. In step S1142, the non-text unit is a line figure or
If it is large enough to form a halftone image, flow proceeds to step S1144,
An attribute called a line figure or a halftone image is added.

Steps S1144 to S114
In step 8, since the same processing as in steps S1128 to S1132 is performed, the description is omitted. FIG.
A, FIGS. 11B and 11C (step S1001 in FIG. 10).
When all connected components in the input image are examined and classified according to the flow described in (2), a tree structure as shown in FIG. 21 is obtained. As shown in the figure,
The route corresponds to the page of the input image.

The children of the root are text blocks or non-text blocks consisting of unknowns, frames, photographs (FIG.), And lines. The children of the frame are text blocks, "unknown" non-text data, tables containing text blocks,
It is a photograph (figure) line. FIG. 17 is a diagram showing a page 90 of pixel image data, including a text 91 having a large font size, for example, a table 92 including text data such as 93, text data 94, and a horizontal line 9.
5, another title 96, two-stage text data 97, a line figure 98 having a caption 99 and surrounded by a frame, starting with a title 100 and text data 101
, The second column, the halftone image 102 surrounded by the frame with the caption 103, and the text data 1
04, the horizontal line 105, and the last paragraph 106.

FIG. 18 shows the result of performing the process of step S1001 on the same image. As can be seen, the connected components in page 90 are cut out as rectangles,
The inside of it is from step S1115 to step S113.
The attribute is checked by the process shown in FIG. All text units obtained in step S1001 are stored in step S1002 at any position in the tree.
To group vertically or horizontally. This grouping operation is based on the unity of each text unit and its surrounding units.

Further, gaps (spaces) considered to represent columns are detected and held in both the vertical and horizontal directions. The detailed process of step S1102 is as follows:
This will be described below with reference to FIG. In step S1501, the boundary line of the non-text unit is extended in the vertical and horizontal directions, and is set as a gap line marker.

As shown in FIG. 18, the vertical gap line markers 109a and 109b are extended in the vertical direction until they intersect with the text or non-text unit (unit 95 in this example). Similarly, the gap line markers 109c and 109d are extended until they intersect with the unit 95. The same processing is performed for the gap line marker in the horizontal direction. The gap line marker is effective for detecting a gap (spatial space), whereby a column can be obtained.

In step S 1502, 1 in FIG.
Line combination of text units such as 07 is performed. In this connection, the distance between the connected components adjacent in both directions is checked in advance in the horizontal and vertical directions, and when the distance in the horizontal direction is small, the distance is horizontal, and when the distance in the vertical direction is small, the distance is vertical. This is done for directions. This combining method corresponds to whether the combination direction of the text units to be combined is vertical or horizontal.

Now, these text units are combined as one text line when the following conditions are satisfied. (1) The bond does not exceed the gap line marker. (2) The text unit is in contact with another text unit or is at a distance below a certain threshold. This threshold value may be obtained by multiplying the average length of the text obtained in step S1104 by the scale factor experimentally obtained (satisfactory results are obtained with 1.2).

However, before the connection, the gap between the text units is extended in the horizontal direction when the text units are in horizontal composition, and in the vertical direction when the text units are in vertical composition. Can be determined if any gaps exist. For example, in the example of FIG. 18, a gap 108 exists between two texts. A gap 108 exists between the two texts. The gap extends in the vertical direction over several lines. Therefore, in step S1502, even if the distance between the text units is equal to or smaller than the threshold, the gap is left as a gap.

In step S1503, step S15
For a set of text units not joined at 02, a combination is made when those units are overlapped by other text units that are close together and the join does not cross the gap line marker. This step is effective in eliminating anything that stems from space relationships in the text lines, rather than coming from the paragraph structure. In the example of FIG. 18, the gap 108 left in step S1502 is
It is erased in 1503. This is because it is overlapped by the character on the line immediately below and does not cross the gap line marker.

Then, in step S1504, the tree structure is updated. FIG. 19 is a schematic diagram illustrating a result of the grouping process described in step S1002, and FIG. 22 is a diagram illustrating how the tree structure is changed by the process in step S1002. As shown in FIG. 19, the combined text units are grouped and
A line of text such as 110 is created. In particular, text units are always combined into text lines anywhere in the tree structure. For example, 111 is below the frame table on the tree structure but is also joined. However, steps S1117 to S11
Note that regrouping beyond the white contour determined at 39 is not performed. This is to prevent the items in the table from being put into one line. The gap between the left and right columns is maintained. Also, non-text units are not regrouped. Therefore, they are not grouped even if they are at distances equal to or less than the threshold value like 112 and 113.

In FIG. 22, the tree structure reflects the new grouping. After the text units are combined into a text line in the process described in FIG. 15 (step S1002 in FIG. 10), step S1003
As shown by, the text lines are combined in a direction opposite to the combining direction at the time of forming the text lines to form a text block.

This process will be described in more detail with reference to FIG. The process of grouping depends on the unity of text line units and the position of non-text units. For example,
Non-text lines in between act as boundaries, preventing groups of text lines on opposite sides from grouping into a single block of text. All text lines between two consecutive non-text line units are processed simultaneously. In addition, in step S1003, some text units should be combined with non-text units (eg, text captions configured with non-text images), and some non-text units can be combined with other non-text units. What to do (eg, a line figure associated with a halftone image) is checked.

FIG. 16 is a flowchart showing how text lines are grouped into text blocks. In step S1601, a title block is formed from those classified as non-text units in step S1104. The criterion is that it is smaller than the maximum font size but larger than the average text size. A title block is formed by grouping all such non-text units that are close together of similar size.

Then, an attribute "title" is added to the block. All remaining non-text blocks that could not be grouped have an attribute called picture text. The tree structure is updated appropriately accordingly. Note that the title is useful for reconfiguring the page. In step S1602, non-text units between text lines are detected. These non-text units act as boundaries between text blocks, preventing text lines from becoming one text block.

In step S1603, the text lines are grouped in a direction opposite to the combining direction at the time of forming the text lines (hereinafter referred to as a "block combining method") into a text block by a process including two steps. In the first step, gaps between columns are searched. For this purpose, for example, a histogram of the pixel in the block joining direction is calculated. In the second step, if the distance between successive text lines in the block joining direction is smaller than the height of the text calculated in step S1104, these text lines are grouped in each column.

Step 1603 is effective for combining text lines belonging to the same paragraph, such as text line 114 in FIG. In step S1604, grouping is performed if the text blocks adjacent vertically or horizontally are not classified by a non-text unit and do not destroy any gaps found from the histogram obtained in step S903. Is done.

The grouping of text blocks is performed based on the state of separation between blocks that is smaller than a certain threshold calculated in accordance with the vertical height calculated in step S1104. In the example of FIG. 19, step S1604 is used to group text blocks formed from the text line of the paragraph 115 and the text line of the paragraph 116.
Is valid. However, it is not effective to combine 117 and 118. This is because these text blocks are separated by non-text blocks 119 (lines).

Step S1605 determines whether a certain text block should be combined with a non-text block or whether a certain non-text block should be combined with another non-text block. Text blocks are non-text title blocks, non-text halftone blocks,
And can be combined with non-text lines with attachments. These combinations are performed according to the following judgment.

(1-a) If a text block is close to the non-text title block in the horizontal direction and overlaps in the vertical direction, the text block is combined with the non-text title block ( However, both the text block and the title block are in horizontal composition.) (1-b) If a text block overlaps a non-text title block near the vertical direction and horizontally, the text block is combined with the non-text title block (provided that the text block is a non-text title block). The block and the title block are both in vertical composition.)

(2) A text block is smaller than a frame (both horizontally and vertically) having a frame size,
If the text block has no adjacent word-sized text block, the text block is placed inside a non-text halftone image block. (3) For a text block that overlaps a non-text line with an appendage, the line with the appendage is simply text because it is probably underlined text.

Also, some non-text blocks are combined with other non-text blocks according to the table of FIG. In the table of FIG. 34, the contents of Test are as follows. Test # 1: Merge if one block is completely contained in another block. Test # 2: Combine if the width of the picture text is smaller than the width of the word size block. Test # 3: If the blocks are close to each other, they are combined.

[0210] In step S1606, the attribute is corrected, and the tree structure is updated by the processing described above. FIG. 20 shows a block structure obtained by the processing of FIG. 16, and FIG. 23 shows an example of a tree structure. FIG.
The blocks in 0 include a title block 120, a text block 121, a halftone graphic / line graphic 12
There are two. As frame line data, there are a table type 123 and a table structure 124 having a text unit 125 therein. Non-text image 12
Reference numeral 7 denotes separators of various units in FIG.

According to the above algorithm, the block selection processing is performed in the image memory unit 9.
By this block selection processing, each unit based on a black pixel connected component in an image is identified as one of a character part, a title part, a frame part, a table part, a halftone figure part, a line figure part, and a line part. Block selection processing result information based on the attribute classification information obtained and area information indicating the coordinates and size of the smallest rectangle surrounding each unit on the image is obtained. Block selection processing result information is stored in the memory 9.
04 is temporarily recorded.

The CPU 906 of the image memory unit 8
Has a function of performing a character recognition process on the binary image information data stored in the memory 904. One embodiment of the character recognition processing in the image memory unit 9 will be described below. First, the document image data to be subjected to the character recognition processing is stored in the memory 904. The image data in this case may be data read from the reader 1 or may be image data transferred from the facsimile unit 4, the file unit 5, or the computer interface unit 7.

However, image data that can be subjected to the character recognition processing is limited to binary image data. Therefore, when the image data is read by the reader 1, the fax unit 4 and the file unit 5 Or when the image data transferred from the computer interface unit 7 is multi-valued image data,
The image data is binarized via the
4 must be stored.

Further, as the document image data to be subjected to the character recognition processing, the character recognition processing is performed only on the partial area determined to be the character part or the title part as a result of the block selection processing described above. It is also possible to control as follows. Thus, the character recognition process is performed on the image data stored in the memory 904. The algorithm of the character recognition process in the present embodiment will be described in detail with reference to the flowchart of FIG.

First, in step S2401, character cutout processing is performed on image data. The character cutout processing is performed by detecting an image area of one character unit in the image data and obtaining a circumscribed rectangular image as a character cutout image. Here, the image of one character unit is basically composed of connected pixel components. However, when the connected pixel component is considerably smaller than the size of the adjacent connected pixel component, other connected pixel components It is combined with the components to form a single character image or treated as a noise image.

On the other hand, if the connected pixel component is considerably larger than the size of the neighboring connected pixel component, a projection histogram in the vertical or horizontal direction is obtained, and if there is a portion where the value of the histogram is small, that portion is determined. As a boundary,
One connected pixel component is separated. FIG. 25 shows an example of a character cutout process by separating the connected pixel components.

The cut-out character image data obtained as described above is temporarily stored in the memory 904. Next, in step S2402, normalization processing is performed on the extracted character image data that has been subjected to the character extraction processing in step S2401. In the normalization process, first, the size of the cut-out character image is enlarged or reduced so as to have a certain reference rectangular size. Next, the inclination, the line width, the density, and the like of the cut-out character image are corrected to a state in which matching with a standard pattern in a prepared recognition dictionary is most easily achieved.

Next, in step S2403, recognition processing is performed on the character image subjected to the normalization processing in step S2402. In the recognition process, first, a feature vector is extracted based on a contour feature or the like. Then, matching is performed between the obtained feature vector and the standard pattern vectors of all the characters to be recognized in the previously prepared recognition dictionary, and a character code corresponding to the most probable standard pattern is set as a recognition result. To memorize.
At this time, the degree of certainty of the pattern matching in the character code as the recognition result (hereinafter, this is referred to as the degree of pattern matching) is also stored.

Further, the JPIG codec 907 of the image memory unit 9 has a function of performing image compression / decompression processing on the binary image information data stored in the memory 904.
The JBIG codec 904 is a JBIG codec of the CPU 906.
The image stored in the memory 904 is subjected to four-layer JBIG encoding in response to a compression processing start command, and is stored in the memory 904. In addition, in response to a JBIG decompression process start command from the CPU 906, the JBIG
JBIG decompression processing is performed on the IG compression code, and the resulting image data is stored in the memory 904.

Further, the image memory section 9 has a function of compressing and encoding a plurality of image data by using the JBIG codec 904 and storing it in the memory 904. Here, as shown in FIG. 26, the memory 904 has a memory capacity of 8 Mbytes, of which 4 Mbytes are used to temporarily store input binary image data of 400 dpi and a maximum A3 size, The remaining 4Mby
te is used to store JBIG compressed code data of the input binary image data.

The memory area for storing JBIG compressed code data in the memory 904 can temporarily store JBIG compressed code data corresponding to a plurality of image data as long as the memory capacity permits. 400 dpi, the maximum A3 size image data can be temporarily stored in the memory 904. Also,
The image memory unit 9 transfers the binary image data temporarily stored in the memory 904, the block selection processing result data and the character recognition processing result data obtained from the image data to the file unit 5, and stores the image data in the external storage device. 6 has a function of predicting in advance the amount of data to be stored in the storage unit 6. Hereinafter, an embodiment in which the amount of data to be stored in the external storage device 6 is predicted will be described in detail with reference to the flowchart of FIG.

In the present embodiment, data to be stored in the external storage device in correspondence with one image data is encoded image data by MMR compression, encoded image data by JBIG compression, and block selection processing result data. It is. First, in step S2701, the amount of coded data when the image data corresponding to the JBIG coded data is MMR coded by using the JBIG codec 907 input to the image memory unit 9 is predicted.

The predicted data amount is the size of the corresponding image,
A binarization method in the binarization circuit 1012 of the core unit 10,
By using three of the actual JBIG coded data amount as basic data, and measuring those values and actual values actually subjected to MMR coding in various cases in advance, a statistical value based on the correspondence is obtained. Is calculated from The predicted data amount of the MMR code calculated here is added to the total predicted data amount.

Subsequently, in step S2702, the actual JBIG encoded data amount of the target image data is added to the total predicted data amount. Here, the actual JBIG encoded data amount is determined by the JBIG codec 907 that is actually performed.
The data amount obtained from the result of the BIG encoding process is used as it is. Next, in step S2703, a block selection processing result data amount of image data corresponding to the JBIG encoded data is predicted by using the JBIG codec 907 input to the image memory unit 9.

The amount of predicted data is determined by the size of the corresponding image,
A binarization method in the binarization circuit 1012 of the core unit 10,
By using three of the actual JBIG coded data amounts as basic data, and by preliminarily measuring those values and actual values obtained by actually performing block selection processing in various cases, a statistical value based on the correspondence is obtained. Is calculated from The calculated data amount of the block selection processing result calculated here is added to the total predicted data amount. Next, in step S2704, the image data is input to the image
By using the IG codec 907, a character recognition processing result data amount of image data corresponding to JBIG encoded data is predicted. The amount of predicted data is based on three values: the size of the corresponding image, the binarization method in the binarization circuit 1012 of the core unit 10, and the actual amount of JBIG encoded data. Is measured in advance in various cases, and is calculated from a statistical value based on the correspondence. The predicted data amount of the character recognition processing result calculated here is added to the total predicted data amount.

In step S2705, if the next image data has been input to the image memory section 9, the flow branches to step S2701 and the flow from step S2701 to step S2704 is repeated again. Through the above processing, every time new image data is input to the image memory unit 9 and encoding processing is performed by the JBIG codec 907, the flow steps S2701 to S27 are performed.
04 is executed, and the total predicted data amount is updated.

The information on the estimated amount of data stored in the external storage device 6 obtained as described above can be notified to the core unit 10. The notification of the stored data prediction amount information is performed by communication between the CPU 1003 of the core unit 10 and the CPU 906 of the image memory unit 9. In the above-described image processing system, as described above, the function of the CPU 1003 of the core unit 10 combines (1) signal input,
A series of data processing sequences of (2) processing, (3) output and storage can be realized.

In the following, JBIG encoding processing, block selection processing, and character recognition processing are performed on the image data read by the reader 1 in the image memory section 9, and then the image data input to the image memory section 9 is stored in a file. The data is transferred to the compression unit 5 of the file unit 5
03, performs MMR encoding processing, stores the result in the external storage device 6, and further stores the JBIG encoded data, the block selection processing result data, and the character recognition processing result data obtained in the image memory section 9 in the file section 5. An embodiment of a series of data processing sequences in which the data is transferred to the external storage device 6 and stored in the external storage device 6 will be described in detail with reference to the flowcharts of FIGS.

First, referring to FIG. 28, a process of temporarily storing a document image in the image memory unit 9 will be described. First, in step S2801, the operator sets a document to be recorded in the external storage device 6 connected to the various processes and the file unit 5 on the document feeding device.

Next, in step S2802, the reader 1
Is operated to optically read the multi-value image data of the document stacked on the document feeder 101. One embodiment of image data reading will not be described because it has been described in detail above. The read image data is converted into an electric signal, and further converted into a binary signal by the binarization circuit 1012 of the core unit 10.
After being digitized, it is input to the external device 3 from the connector 119. The start of this process is instructed by communication between the CPU 1003 of the core unit 10 and the CPU 122 of the reader 1.

[0231] In step S2803, the binary image data input from the reader 1 is temporarily stored in the memory 904 of the image memory unit 9 in the external device 3. The binary image data input from the reader 1 is stored in an image memory 9
One embodiment for storing the data in the memory 904 has been described in detail above, and thus will not be described here. The start of this process is instructed by communication between the CPU 1003 of the core unit 10 and the CPU 906 of the image memory unit 9.

In step S 2804, JBIG encoding is performed on the binary image data temporarily stored in the memory 904 of the image memory unit 9 using the JBIG codec 907. Since the details of the JBIG encoding process have been described above, they are omitted here. Here, JBIG compressed code data as a result of performing the compression process is stored in the memory 9 again.
04 is temporarily stored. The start of this processing is performed by
The instruction is given by communication between the PU 1003 and the CPU 906 of the image memory unit 9.

Next, in step S2805, the memory 9
04, MMR encoded data and JBIG encoded data for the binary image data temporarily recorded, and further,
The block selection processing result data and the character recognition processing result data obtained from the image data are stored in the file unit 5.
Is calculated when the data is transferred to the external storage device 6 and stored in the external storage device 6.

For details of the data prediction amount calculation processing,
Since it has been described above using the flow of FIG. 27, the description is omitted here. Next, in step S2806, branching is performed based on whether or not there is a document loaded on the document feeder 101 and for which image data has not yet been input to the image memory unit 9. If there is a document that has not been input, the process returns to step S2802 to input the next image data. If not, the process of step S2807 is performed.

[0235] In step S2807, the previous step S2807 is executed.
According to the estimated amount of accumulated data calculated in 2805, whether the processing data relating to the image data temporarily stored in the image memory unit 9 can be stored in the external storage device 6 connected to the file unit 5, and further add a document To predict whether recording can be continued, and warns the operator corresponding to the prediction. This processing will be described later in detail.

Subsequently, in step S2808, a branch is made depending on whether or not recording is to be performed by further adding a document. Here, when a further original is to be added, the process returns to step S2801 to set the next original on the original transport device,
If not added, branch 1 and subsequent steps in the flow of FIG. 29 are executed, and data processing and transfer to the file unit 5 are performed on the temporarily stored JBIG compressed code data. The processing will be described in detail with reference to the flow in FIG.

First, in step S2901, the memory 90 of the image memory unit 9 in step S2803 of FIG.
4 is decoded. The decoding process of the JBIG encoded data has been described in detail above, and will not be described here. The decoded image data is temporarily stored in the memory 904 again.
The start of this process is instructed by communication between the CPU 1003 of the core unit 10 and the CPU 906 of the image memory unit 9.

Next, in step S2902, the decoded image data is transferred to the file section 5 via the core section 10. The process of transferring the image data in the memory 904 of the image memory unit 9 to the file unit 5 has been described in detail in the description of the core unit 10 and will not be described here.
This processing is executed by the CPU 1003 of the core unit 10, the CPU 516 of the file unit 5, and the CPU 9 of the image memory unit 9.
06 is instructed by communication.

Next, in step S2903, the image data transferred to the file section 5 is subjected to MMR encoding. MM
Since the R encoding process has been described in detail in the description of the file unit 5, it is omitted here. The MMR encoded code data is temporarily stored in any of the memories A506 to D509 of the file unit 5. Next, step S29
In step 04, the MMR encoded data temporarily stored in one of the memories A 506 to D 509 is stored in the external storage device 6. The process of storing the MMR encoded data in the external storage device 6 has been described in detail in the description of the file unit 5 and will not be described here.

Next, in step S2905, block selection processing is performed on the binary image data expanded in the memory 904 of the image memory unit 9. The block selection processing has been described in detail above and will not be described here. Also, block selection result data, which is attribute information of a partial area in the document image obtained as a result of the block selection processing, is temporarily stored in the memory 904 again. The start of this process is instructed by communication between the CPU 1003 of the core unit 10 and the CPU 906 of the image memory unit 9.

[0241] Next, in step S2906, the character part and the title part recognized in step S2905 are recognized.
Character recognition processing is performed on the value image partial area. Since the character recognition processing has been described in detail above, it will not be described here. The character recognition result data of the document image obtained as a result of the character recognition processing is temporarily stored in the memory 904 again.
The start of this process is instructed by communication between the CPU 1003 of the core unit 10 and the CPU 906 of the image memory unit 9.

Subsequently, in step S2907, the JBI
The three data of the G compression code / block selection result / character recognition result are transferred to the file unit 5. Where J
The BIG compression code data is stored in step S2803 in FIG.
And the block selection result data / character recognition result data are respectively generated in step S290.
5, generated in step S2906. These data are all stored in the memory 904 of the image memory unit 9.
Is stored temporarily. These data are stored in the core 1
0 to the file unit 5.

The case where the information from the image memory unit 9 is output to the file unit 5 has been described in detail above and will not be described here. The start of this processing is based on the CP of the core unit 10.
The instruction is given by communication between U1003 and the CPU 906 of the image memory unit 9 and the CPU 516 of the file unit 5. Next, in step S2908, the file unit 5
Is stored in the external storage device. The embodiment in which the file information is stored in the external storage device 6 has been described in detail above and will not be described here. This process is started by the CPU 1003 of the core unit 10 and the file unit 5
Is instructed by communication with the CPU 516.

In step S2909, at the time of execution so far, steps S2901 to S2901 are stored in the image memory unit 9.
A branch is performed depending on whether or not data for which a series of processing up to step S2908 has not been performed still exists. If it exists, the process returns to step S2901, and the following processing is performed again. If not, all the processes are terminated.

Next, the recordable state warning process for the operator according to the estimated amount of stored data in step S2807 of FIG. 28 will be described in detail with reference to the flow of FIG. First, in step S3001, the predicted amount of data stored in the external storage device 6 calculated in step S2805 in FIG. 28 is compared with the actual amount of data that can be stored in the external storage device 6. Here, the comparison process is performed by the CPU 100 of the core unit 10.
3 is performed. The CPU 100 of the core unit 10
The CPU 906 of the image memory unit 9 and the CPU 516 of the file unit 5 respectively provide information regarding the predicted amount of data stored in the external storage device 6 and the information regarding the amount of data that can be stored in the external storage device 6, which are necessary for performing the comparison processing in Step 3 Can be obtained by communicating with.

Next, in step S3002, the operator instructs whether to set a new document on the document stacking device and perform additional recording, or to terminate recording at that point. A screen as shown in FIG. 31 is displayed on the liquid crystal display unit of the operation unit 124 in order to allow the operator to perform the above instruction, and the operator performs additional recording according to the display screen or terminates recording. Make a selection.

Next, in step S3003, branching is performed according to the instruction given in step S3002. Here, if additional recording is instructed, the processing from step S3004 is performed, and if recording end is instructed, the processing from step S3006 is performed. In step S3004, a warning relating to the additional recording enabled state is issued to the operator only when additional recording is instructed in step S3003.
A screen as shown in FIG. 32 is displayed on the liquid crystal display unit of the operation unit 124 to notify the additional recordable state. Here, an approximate number of the number of documents that can be additionally recorded is calculated by the following arithmetic expression.

N = (B−C) / DB B: Remaining storable amount of external storage device C: Predicted amount of accumulated data to date D: Average value of data amount per image Note: Average value of tail data amount per image Is determined by the average value of the data amounts calculated for the data accumulated up to that point.

In step S3005, step S30
On the screen of FIG. 32 of FIG. 32, branching is performed according to whether or not the additional recording has been canceled. If not canceled, the process returns to step S2808 in FIG. 28, and a process is performed on the assumption that a recording document has been added. On the other hand, if it has been canceled, the processing from step S3006 on is performed.

In step S3006, a warning is given to the operator regarding the state of execution of the accumulation process in the external storage device according to the estimated amount of accumulated data, targeting the data accumulated in the memory 904 of the image memory unit 9 up to now. . A screen as shown in FIG. 33 is displayed on the liquid crystal display unit of the operation unit 124 in order to notify the state in which the accumulation process can be executed. Are compared, selection is made as to whether to continue recording as it is, to continue recording after exchanging the recording medium, or to stop recording.

At step S3007, at step S30
Branching according to the operator's instruction on the screen of FIG. Here, when the processing is interrupted, all the processing is interrupted and the processing ends. If continuation is specified, the process returns to step S2808 in FIG. 28, and a process is executed to determine that the recording document has not been added. If the exchange of the recording medium is designated, the flow branches to step S3008.

In step S3008, the recording medium is exchanged by the operator. After the medium is exchanged, the flow returns to step S2808 in FIG. 28, and thereafter, the processing is performed assuming that the recording original has not been added. . [Other Embodiments] In the present embodiment, the input device of the image data to be processed does not necessarily need to be the image data read by the reader 1, but the fax unit 4, the file unit 5, or the computer interface unit. 7 may be transferred.

In the present embodiment, when predicting the amount of encoded data when MMR encoding is performed when calculating the predicted amount of value locus data to an external storage device, the size of the corresponding image In the binarization circuit 1012
The basic method uses the three methods of the binarization method and the actual amount of JBIG encoded data, and those values and the actual values actually subjected to MMR encoding are measured in advance in various cases, and the statistical values based on the correspondence are measured. Calculated from the appropriate values.

However, it is also possible to predict the encoded data amount from a statistically corresponding amount based on the actual measured data amount other than the basic data. Further, it is also possible to perform the MMR encoding using the CPU 906 of the image memory unit 9 and calculate the accurate MMR encoded data amount from the result, thereby obtaining the data amount.

In this embodiment, the reading process for the original set on the original feeding device at step S28 is performed.
02 to step S2806, the operator is warned for the first time according to the estimated amount of stored data to the recordable state, but before the original set original is read, or It is also possible to give a warning about the recordable state during the recording.

In the present embodiment, a warning regarding the recording state is always executed when reading of a document set on the document feeder is completed, but the data temporarily stored in the memory 904 of the image memory unit 9 is not changed. The warning may be omitted depending on the comparison result between the estimated amount of stored data and the amount of data that can be stored in the external storage device 6.

Even if the present invention is applied to a system including a plurality of devices (for example, a host computer, an interface device, a reader, a printer, etc.), an apparatus (for example, a copying machine, a facsimile, etc.) Device). Further, an object of the present invention is to provide a storage medium storing a program code of software for realizing the functions of the above-described embodiments to a system or an apparatus, and a computer (or CPU or MPU) of the system or apparatus to store the storage medium. Needless to say, this can also be achieved by reading and executing the program code stored in the program.

In this case, the program code itself read from the storage medium implements the functions of the above-described embodiment, and the storage medium storing the program code constitutes the present invention. Examples of a storage medium for supplying the program code include a floppy disk, hard disk, optical disk, magneto-optical disk, and C
A D-ROM, a CD-R, a magnetic tape, a nonvolatile memory card, a ROM, and the like can be used.

When the computer executes the readout program code, not only the functions of the above-described embodiment are realized, but also the OS (Operating System) running on the computer based on the instruction of the program code. ) May perform some or all of the actual processing, and the processing may realize the functions of the above-described embodiments.

Further, after the program code read from the storage medium is written into a memory provided in a function expansion board inserted into the computer or a function expansion unit connected to the computer, based on the instruction of the program code, It goes without saying that the CPU included in the function expansion board or the function expansion unit performs part or all of the actual processing, and the processing realizes the functions of the above-described embodiments.

When the present invention is applied to the storage medium, the storage medium stores program codes corresponding to the above-described flowcharts. Each module shown will be stored in a storage medium. That is, at least an “image input module” that inputs a plurality of types of images and a “compressed data amount estimation module” that estimates the amount of compressed data when each of the plurality of types of input images is compressed by a compression method. A "characteristic data amount estimating module" for estimating characteristic data amounts of predetermined characteristics of a plurality of types of input images; a compressed data amount estimated by the compressed data amount estimating module and a feature data amount estimating module described above. Based on the "total module" for calculating the sum of the feature data amounts estimated in the above and the compressed data amount estimated by the above-described compressed data amount estimation module, or based on the total obtained by the above-described sum module, a predetermined Stores the program code of each module of the "warning message output module" that outputs a warning message on a storage medium It may be Re.

As described above, in the embodiment according to the present invention, a plurality of image data are stored in the temporary storage section in advance as original image data from the outside, or after being subjected to image compression encoding or the like. Then, data processing is collectively performed later, and the processing result data is stored in the external storage device.
Then, before storing a plurality of image processing result data actually obtained by executing the data processing in the external storage device,
The total amount of data of a plurality of image processing result data obtained by executing the data processing is predicted. Further, by notifying the operator of a warning corresponding to the result of comparing the total amount of data with the amount of data that can be stored in the external storage device, the number of image data temporarily stored in the temporary storage unit is large, on the other hand,
It is possible to prevent the problem that the processing result data corresponding to the image data cannot be finally stored in the external storage device because the remaining storable data amount in the external storage device is small.

[0263]

As described above, according to the present invention, by compressing an image or estimating the amount of data that will be generated when a feature amount is obtained, a sufficient storage amount corresponding to the storage device can be obtained. If no area remains, the user is immediately notified of that fact, so that unnecessary processing can be eliminated.

[Brief description of the drawings]

FIG. 1 is an overall view of an image forming apparatus.

FIG. 2 is a block diagram of a reader 1 and a printer 2.

FIG. 3 is a block diagram of an image processing unit in the reader 1.

FIG. 4 is a block diagram of a core unit 10;

FIG. 5 is a block diagram of the fax unit 4;

FIG. 6 is a block diagram of a file unit 5;

FIG. 7 is a block diagram of a computer interface unit 7;

FIG. 8 is a block diagram of the formatter unit 9;

FIG. 9 is a block diagram of an image memory unit 9;

FIG. 10 is a schematic flowchart of a block selection algorithm.

FIG. 11A is a detailed flowchart of step S1001.

FIG. 11B is a detailed flowchart of step S1001.

FIG. 11C is a detailed flowchart of step S1001.

FIG. 12A is a diagram illustrating step S1001.

FIG. 12B is a diagram illustrating step S1001.

FIG. 12C is a diagram illustrating step S1001.

FIG. 13A is a diagram illustrating step S1001.

FIG. 13B is a diagram illustrating step S1001.

FIG. 13C is a diagram illustrating step S1001.

FIG. 14A is a diagram illustrating step S1001.

FIG. 14B is a diagram illustrating step S1001.

FIG. 14C is a diagram illustrating step S1001.

FIG. 14D is a diagram illustrating step S1001.

FIG. 15 is a detailed flowchart of step S1002.

FIG. 16 is a detailed flowchart of step S1003.

FIG. 17 is a diagram illustrating an execution example using an algorithm.

FIG. 18 is a diagram illustrating an execution example using an algorithm.

FIG. 19 is a diagram illustrating an execution example using an algorithm.

FIG. 20 is a diagram illustrating an execution example using an algorithm.

FIG. 21 is a diagram illustrating an execution example using an algorithm.

FIG. 22 is a diagram illustrating an execution example using an algorithm.

FIG. 23 is a diagram illustrating an execution example using an algorithm.

FIG. 24 is a flowchart for explaining an algorithm of a character recognition process in detail.

FIG. 25 is a diagram illustrating a specific example of a character cutout process by separating connected pixel components.

FIG. 26 is a diagram for explaining a configuration of a memory 904 of the image memory unit 9;

FIG. 27 is a flowchart of a process of estimating the amount of data to be stored in the external storage device 6.

FIG. 28 is a flowchart of a temporary recording process of a document image in an image memory unit 9;

FIG. 29: JBIG temporarily stored in the image memory unit
FIG. 9 is a flowchart in a case where data processing and transfer to a file unit 5 are performed on compressed code data.

FIG. 30 is a detailed flowchart of step S2807.

FIG. 31 is a diagram showing a liquid crystal display unit screen display of the operation unit 124 in step S3002.

FIG. 32 is a diagram showing a liquid crystal display screen display of the operation unit 124 in step S3004.

FIG. 33 is a diagram showing a liquid crystal display unit screen display of the operation unit 124 in step S3006.

FIG. 34 is a diagram showing a joining rule between non-text blocks.

FIG. 35 is a diagram showing an example of a layout of each program module stored in a computer-readable recording medium.

[Explanation of symbols]

 4 Fax section 5 File section 6 External storage device 9 Image memory section 10 Core section

Claims (22)

[Claims] An input step of inputting a plurality of types of images; and a compression method corresponding to each of the plurality of types of images.
A total compressed data amount estimating step of estimating each compressed data amount when compressing a plurality of types of images input in the input step and obtaining a total compressed data amount of the estimated compressed data amounts; An output step of outputting a warning message if the total compressed data amount obtained in the compressed data amount estimating step is larger than the free space of the predetermined storage means. 2. The image processing method according to claim 1, wherein the compression method corresponding to each of the plurality of types of images includes a JBIG codec. 3. The image processing method according to claim 1, wherein the compression method corresponding to each of the plurality of types of images includes MMR coding. 4. The plurality of types of images include characters, frame lines,
The image processing method according to claim 1, wherein the image processing method includes at least one image of a table, a halftone graphic, and a line graphic. 5. An input step of inputting a plurality of types of images, and a compression method corresponding to each of the plurality of types of images,
A total compressed data amount estimating step of estimating each compressed data amount when compressing a plurality of types of images input in the input step and obtaining a total compressed data amount of each of the estimated compressed data amounts; A feature amount obtaining step of obtaining a feature amount of a predetermined feature of a plurality of types of images input in the step; a total compressed data amount obtained in the total compressed data amount estimating step; and a feature obtained in the feature amount obtaining step. A total data amount calculating step of obtaining a total amount of the amount, and an output step of outputting a warning message if the total amount obtained in the total data amount calculating step is larger than a free space of a predetermined storage means. Image processing method. 6. The image processing method according to claim 5, wherein the predetermined feature includes a contour feature of a graphic block of an image. 7. The image processing method according to claim 5, wherein the predetermined feature includes a character feature of a character included in an image. 8. The image processing method according to claim 5, wherein the compression method corresponding to each of the plurality of types of images includes a JBIG codec. 9. The image processing method according to claim 5, wherein the compression method corresponding to each of the plurality of types of images includes MMR coding. 10. The image processing method according to claim 5, wherein the plurality of types of images include at least one of a character, a frame, a table, a halftone graphic, and a line graphic. 11. An input means for inputting a plurality of types of images, and an estimated amount of each compressed data when compressed by a compression method corresponding to each of the plurality of types of images, to obtain the estimated compressed data. Total compressed data amount estimating means for obtaining the total compressed data amount of the amount; and output means for outputting a warning message if the total compressed data amount obtained by the total compressed data amount estimating means is larger than the free space of the predetermined storage means. An image processing method comprising: 12. The image processing method according to claim 11, wherein the compression method corresponding to each of the plurality of types of images includes a JBIG codec. 13. The image processing method according to claim 11, wherein the compression method corresponding to each of the plurality of types of images includes MMR coding. 14. The image processing method according to claim 11, wherein the plurality of types of images include at least one image of a character, a frame, a table, a halftone graphic, and a line graphic. 15. An input means for inputting a plurality of types of images, an estimated amount of compressed data when each of the plurality of types of images is compressed, and a total compressed data of the estimated amounts of compressed data. Total compressed data amount estimating means for obtaining an amount; feature amount obtaining means for obtaining a characteristic amount of a predetermined feature of the plurality of types of images; total compressed data amount and the characteristic obtained by the total compressed data amount estimating means A total data amount calculating means for calculating a total amount of the feature amounts obtained by the amount obtaining means; and outputting a warning message if the total amount obtained by the total data amount calculating means is larger than a free space of a predetermined storage means. An image processing apparatus comprising: an output unit. 16. The image processing apparatus according to claim 15, wherein the predetermined feature includes a contour feature of a graphic block of an image. 17. The image processing apparatus according to claim 15, wherein the predetermined feature includes a character feature of a character included in an image. 18. The image processing apparatus according to claim 15, wherein the compression device corresponding to each of the plurality of types of images includes a JBIG codec. 19. The image processing apparatus according to claim 15, wherein the compression device corresponding to each of the plurality of types of images includes MMR coding. 20. The image processing apparatus according to claim 15, wherein the plurality of types of images include at least one of a character, a frame, a table, a halftone graphic, and a line graphic. 21. A computer program product comprising a computer usable medium having computer readable program code means, said computer program product comprising: a first computer readable image inputting a plurality of types of images; Program code means, and a compression method corresponding to each of the plurality of types of images,
A computer-readable second method for estimating each compressed data amount when a plurality of types of images input by the first program code means are compressed and obtaining a total compressed data amount of each of the estimated compressed data amounts; Program code means; and computer-readable third program code means for outputting a warning message if the total amount of compressed data obtained by the second program code means is larger than the free space of a predetermined storage means. A computer program product characterized by: 22. A computer program product comprising a computer usable medium having computer readable program code means, said computer program product comprising: a computer readable first computer readable medium for inputting a plurality of types of images; Program code means, and a compression method corresponding to each of the plurality of types of images,
A computer-readable second method for estimating each compressed data amount when a plurality of types of images input by the first program code means are compressed and obtaining a total compressed data amount of each of the estimated compressed data amounts; Program code means; computer-readable third program code means for obtaining characteristic amounts of predetermined characteristics of a plurality of types of images input by the first program code means; Computer-readable third program code means for obtaining a total amount of the total compressed data amount and the feature amount obtained by the third program code means; and a predetermined compressed data amount obtained by the third program code means. Outputs a warning message if it is larger than the free space of Computer program product, characterized in that it comprises a capability of the fourth program code means.