JP3774502B2 - Image processing apparatus and method - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to an image processing apparatus and method, for example, it relates to determining the image processing the direction of the image.
[0002]
[Prior art]
In recent years, the copier has become more intelligent, has various functions such as laying out multiple originals on one sheet, copying on both sides, and automation and speeding up due to the enhancement of ADF (Automatic Document Feeder). Yes.
[0003]
In order to efficiently use such a high-function copying machine, it is important that the copying machine determines the orientation of the document. For example, when using ADF and laying out 20 originals by 4in1 with an image processing function called 4in1 and outputting them as 5 printouts as shown in Fig. 1, the orientation of the originals is automatically If the determination can be made, it is possible to save the user's trouble of arranging the originals upward or rearranging them in consideration of vertical writing and horizontal writing.
[0004]
The method for determining the orientation of an original can be broadly divided into a method using a layout and a method using OCR (optical character recognition).
[0005]
[Problems to be solved by the invention]
However, the above-described technique has the following problems. In other words, the method of determining the orientation of a document using a layout is not a problem for simple business documents, but the direction of a document having a complicated layout with an elaborate design cannot be determined.
[0006]
On the other hand, the method of determining the orientation of an original using OCR requires time for character extraction processing and OCR processing to extract a character area from a binarized image of the original image, and real-time matching the copying speed of the copier. Processing is difficult, and there is a drawback that it becomes a bottleneck of copying speed of a copying machine.
[0007]
An object of the present invention is to prevent a reduction in the speed of copying processing.
[0008]
[Means for Solving the Problems]
The present invention has the following configuration as one means for achieving the above object.
[0009]
The image processing apparatus according to the present invention extracts each character region from an input image, performs character recognition on each extracted character region, and determines the direction of each character region, thereby determining the input image. A processing means for outputting a direction determination result of the input image, and a control means for controlling the copying process of the input image using the direction determination result output by the processing means. If it does not end within the time, the processing means outputs the intermediate direction determination result obtained so far, and the control means is a preset user for the case where the determination of the direction of the input image does not end within the predetermined time. Based on the above instruction, the copying process of the input image is controlled using the intermediate direction determination result output by the output means .
[0010]
Image processing method according to the present invention, out extract each character area from the input image, by performing character recognition on each character region that is the extraction, by determining the direction of the each of the character areas, the a processing step of outputting a direction determination result towards the input image, using the processing direction determination result output by step, and a control step of controlling the copying process of the input image, direction towards the input image If the judgment does not end within a predetermined time, the processing step outputs an intermediate direction determination result obtained so far, the control step, if the determination of the direction towards the input image within the predetermined time has not completed The input image copying process is controlled using the intermediate direction determination result output in the processing step based on a user instruction set in advance .
[0011]
DETAILED DESCRIPTION OF THE INVENTION
Hereinafter, an image processing apparatus according to an embodiment of the present invention will be described in detail with reference to the drawings.
[0012]
[First Embodiment]
FIG. 2 is a block diagram showing an example of the configuration of the direction determining apparatus according to the present embodiment. Can be added.
[0013]
In the figure, the copying machine 201 has an image memory and various image processing functions, and can perform image processing such as 2in1 (processing for copying two original images on one sheet), 4in1, rotation, and mirror image. .
[0014]
The direction determination card 202 is an 8-bit multi-value image data from the copier 201, clock CLK, main scanning direction synchronization signal HSYNC, main scanning direction enable signal VE, page enable signal PE, 3-bit address ADDR, and 8-bit. Can receive signals such as data DATA. Then, as a result of determining the orientation of the document, a 2-bit signal indicating the direction (0 degrees, 90 degrees, 180 degrees, and 270 degrees), a 1-bit signal indicating the composition direction (vertical writing and horizontal writing), and 1 indicating the confidence level. Returns a bit signal. Note that the types of these signals and the number of bits are examples, and the present invention is not limited to these.
[0015]
With respect to the signals ADDR and DATA, eight types of data can be received from the copying machine 201 as long as the bit width is as described above. As eight types of data, for example, image size, image horizontal size, image vertical size, image horizontal zoom, image vertical zoom, etc. can be considered, but in the following description, the signal ADDR is not provided, and the processing is limited to the signal DATA. Suppose that 8 bits are sent indicating the time TLIMIT. That is, the direction determination card 202 receives a processing time limit (TLIMIT) suitable for the original size of the next page at the falling edge of the signal PE.
[0016]
A binarization circuit 2021 binarizes the multi-value image data received from the copying machine 201. The binary memory 2022 stores the image data binarized by the binarization circuit 2021. A character detection circuit 2023 detects a character area from the multivalued image data received from the copying machine 201, and outputs coordinate data representing the character area. The character area coordinate memory 2024 stores coordinate data representing the character area output by the character detection circuit 2023. Note that the image data passed from the copying machine 201 to the direction determination card 202 may be image data binarized by the copying machine 201.
[0017]
The CPU 2025 uses the RAM 2026 as a work memory, reads coordinate data from the character area coordinate memory 2024 according to a program stored in the ROM 2027 in advance, and reads binary image data from the binary memory 2022 according to the coordinate data. Perform various processes. In other words, the CPU 2025 performs the direction determination process by the character recognition program stored in the ROM 2027 and ends the direction determination, or ends the determination process by an interrupt signal from the timer 2028 described later, the result of the direction determination Is output.
[0018]
The timer 2028 receives the processing limit time (TLIMIT) from the copier 201 at the falling edge of the page enable signal (PE), for example, determines the elapse of the time specified by TLIMIT by counting down TLIMIT. When the specified time has elapsed, an interrupt signal is sent to the CPU 2025.
[0019]
FIG. 3 is a block diagram showing a second configuration example of the direction determination card 202, which is a configuration in the case where the processing for direction determination is performed by software. As the direction determination software, it is possible to use a character area determination and a direction determination using OCR, a layout analysis and a direction determination.
[0020]
FIG. 4 is a block diagram showing a third configuration example of the direction determination card 202, which is a configuration in the case where processing related to direction determination is performed by hardware (direction determination circuit 2029). As hardware processing, as in the case of software, it is possible to use a character area determination and a direction determination using OCR, a layout analysis and a direction determination.
[0021]
Of course, in the configuration shown in FIGS. 3 and 4, the direction determination card 202 can be provided with a binarization circuit 2021, and the multi-value image data input from the copying machine 201 can be binarized. Alternatively, the direction determination card 202 may be provided with a multi-value band memory (or page memory), and the direction determination may be performed from the multi-value image data input from the copying machine 201 by software.
[0022]
FIG. 5 is a block diagram showing a detailed configuration example of the direction determination card 202.
[0023]
In the same figure, a portion surrounded by a rectangle indicated by a symbol A is configured by one chip, and at least one of the binarization circuit 2021, the character detection circuit 2023, and the character coordinate area memory 2024 illustrated in FIG. It is included.
[0024]
The threshold value determination circuit 101 determines a binarization threshold value and a difference threshold value for detecting an edge from input multi-value pixel data. This binarization threshold is used for the binarization processing of the binarization circuit 2021. The edge detection circuit 102 performs high-frequency detection processing from input multilevel pixel data using a difference threshold in synchronization with the clock CLK. The edge coordinate storage unit 103 stores the coordinate data of the edges detected by the edge detection circuit 102. The area information storage unit 104 stores area information created as a result of combining the already detected edge coordinates.
[0025]
FIG. 6 is a diagram for explaining the processing of the combination processing circuit 105. The combination processing circuit 105 stores the coordinate data 701 to 704 and 712 stored in the edge coordinate storage unit 103 and the region information storage unit 104. After comparing the coordinate data 705 to 708 and 713 and combining the coordinate data determined to be combined, the combined coordinate data (the region indicated by the bold lines 709 to 715) is stored in the region information storage unit 104. .
[0026]
In other words, the input image data is binarized and stored in the binary memory 2022 by the configuration (character detection circuit 2023 and binarization circuit 2021) shown in FIG. Data is stored in the character area coordinate memory 2024.
[0027]
For example, when character detection processing is performed on image data of a document as shown in FIG. 7A, rectangular information as shown in FIG. 7B is obtained. Then, the CPU 2025 reads the image data from the binary memory 2022 according to the coordinate data stored in the character area coordinate memory 2024, and performs OCR processing. The CPU 2025 performs four-way OCR processing on the binary image data of each character area read from the binary memory 2025, and the direction in which the result closest to the character information stored as a dictionary in the ROM 2027 is obtained. The determination result is output as the direction of these character areas.
[0028]
FIG. 8 is a timing chart example of this system. Reference numeral 801 denotes image input from an image scanner (CCD), reference numeral 802 denotes binarization processing of multi-value image data input from the scanner, and reference numeral 803. Indicates a character extraction process, and reference numeral 804 indicates an OCR process. In other words, in synchronization with the input 801 from the scanner, character extraction processing 803 is performed in real time, four-way OCR processing 804 is performed on the extracted character area, and the orientation of the document image, vertical writing and horizontal writing, etc. are identified. .
[0029]
Here, the program stored in the ROM 2027 is designed with the aim of completing the direction determination processing by the OCR of the CPU 2025 within a predetermined time (TLIMIT). However, if the direction determination process is not completed within the predetermined time (interrupted from the timer 2028), the CPU 2025 determines the direction and set direction (intermediate result) obtained so far, and the degree of confidence “0”. Returns a judgment result consisting of (meaning without confidence). TLIMIT is set so as not to stop the document scanning operation of the copying machine 201.
[0030]
The copying machine 201 can control the copying process being executed according to the instruction set by the user according to the degree of confidence in the determination result sent from the direction determination card 202. For example, before starting the process, if the confidence level is '0', the copy process will be stopped if the process is instructed to stop the process, and if the confidence level is ignored, the copy process will be performed. continue.
[0031]
As described above, according to the present embodiment, since the orientation of the document is determined using OCR, it is possible to determine the orientation of the document with a complicated layout of elaborate design, and the copying speed of the copying machine can be determined. In addition, the orientation of the document can be determined in real time. If the process of determining the orientation of the document cannot be completed within a predetermined time, the determination result (intermediate result) obtained so far is output, so that the copying speed is not reduced. .
[0032]
Also, for example, when performing character extraction processing with the configuration shown in FIG. 3, by reducing the resolution of the image, for example, an image as shown in FIG. 9 is generated from the image shown in FIG. It is also possible to use a method of performing outline tracking by combining and determining a character when the obtained combined area has a large aspect ratio.
[0033]
Further, in the above-described embodiment, the example in which the direction determination card 202 is inserted into the copying machine 201 has been described. However, the present invention is not limited to this, and the system includes an image scanner, a printer, and a computer. In this case, the direction determination card 202 is inserted into the slot of the computer. Alternatively, the orientation of the document is determined by a program running on the computer.
[0034]
Furthermore, in a system constituted by an image scanner and a computer, the system may determine the orientation of an image read by the image scanner and store the image in a storage medium such as a hard disk connected to the computer based on the determination result. Further, a printer that determines the orientation of an image input from a computer and performs printout based on the determination result may be used.
[0035]
[Other Embodiments]
Note that the present invention can be applied to a system including a plurality of devices (for example, a host computer, an interface device, a reader, a printer, etc.), or a device (for example, a copier, a facsimile device, etc.) including a single device. You may apply to.
[0036]
Another object of the present invention is to supply a storage medium storing software program codes for realizing the functions of the above-described embodiments to a system or apparatus, and the computer (or CPU or MPU) of the system or apparatus stores the storage medium. Needless to say, this can also be achieved by reading and executing the program code stored in the. In this case, the program code itself read from the storage medium realizes the functions of the above-described embodiments, and the storage medium storing the program code constitutes the present invention. As a storage medium for supplying the program code, for example, a floppy disk, a hard disk, an optical disk, a magneto-optical disk, a CD-ROM, a CD-R, a magnetic tape, a nonvolatile memory card, a ROM, or the like can be used.
[0037]
Further, by executing the program code read by the computer, not only the functions of the above-described embodiments are realized, but also an OS (operating system) running on the computer based on the instruction of the program code. It goes without saying that a case where the function of the above-described embodiment is realized by performing part or all of the actual processing and the processing is included.
[0038]
Further, after the program code read from the storage medium is written into a memory provided in a function expansion card inserted in the computer or a function expansion unit connected to the computer, the function expansion is performed based on the instruction of the program code. It goes without saying that the CPU or the like provided in the card or the function expansion unit performs part or all of the actual processing and the functions of the above-described embodiments are realized by the processing.
[0039]
When the present invention is applied to the above-described storage medium, the storage medium stores program codes corresponding to the flowcharts described above. To briefly describe, each module shown in the memory map example of FIG. Is stored in a storage medium. That is, at least “binarization”, “character area detection”, “character image data reading”, and “image direction determination” modules may be stored in the storage medium.
[0040]
【The invention's effect】
As described above, according to the present invention, it is possible to prevent a reduction in the speed of copying processing.
[Brief description of the drawings]
FIG. 1 is a diagram for explaining an image processing function;
FIG. 2 is a block diagram showing a configuration example of a direction determination device according to an embodiment of the present invention;
FIG. 3 is a block diagram showing a second configuration example of the direction determination card shown in FIG.
4 is a block diagram showing a third configuration example of the direction determination card shown in FIG.
FIG. 5 is a block diagram showing a detailed configuration example of the direction determination card shown in FIG.
6 is a diagram for explaining processing of the coupling processing circuit shown in FIG. 5;
FIG. 7A is a diagram for explaining character detection processing;
FIG. 7B is a diagram for explaining character detection processing;
FIG. 8 is a diagram showing an example timing chart of the system;
FIG. 9 is a diagram for explaining another method of character extraction processing;
FIG. 10 is a diagram showing an example of a memory map of a storage medium storing program codes according to the present invention.

Claims (6)

Out extract each character area from the input image, by performing character recognition on each character region that is the extraction, by determining the direction of the each of the character areas, and outputs a direction judgment result towards the input image Processing means ;
Control means for controlling the copying process of the input image using the direction determination result output by the processing means ;
If the determination of the direction towards the input image is not completed within a predetermined time, the processing means outputs an intermediate direction determination result obtained so far, the control means of the direction of the input image within the predetermined time period based on a preset user instructions on when the determination is not completed, the image processing apparatus and controls the copy processing of the input image using the intermediate direction determination result output by said output means. The control means, the determination of the direction towards the input image not completed within the predetermined time, when the instruction of the user indicates a continuation of the copying process is controlled so as to continue the copying process of the input image 2. The image processing apparatus according to claim 1, wherein The control means, the determination of the direction towards the input image not completed within the predetermined time, when the instruction of the user indicating the abort of the copying process is controlled so as to stop the copying processing of the input image 3. The image processing apparatus according to claim 1 or 2 , wherein Out extract each character area from the input image, by performing character recognition on each character region that is the extraction, by determining the direction of the each of the character areas, outputs a direction judgment result towards the input image Processing steps to
Using the direction determination result output in the processing step, and a control step for controlling the copying process of the input image ,
If the determination of the direction towards the input image is not completed within a predetermined time, the processing step outputs an intermediate direction determination result obtained so far, the control step, the direction of the input image within the predetermined time period An image processing method comprising: controlling copying processing of the input image using the intermediate direction determination result output in the processing step based on a user instruction set in advance when the determination is not completed. The control step controls to continue the copying process of the input image when the determination of the direction of the input image does not end within the predetermined time and the user instruction indicates the continuation of the copying process. Claims characterized by Four The image processing method described in 1. The control step performs control so as to stop the copying process of the input image when the determination of the direction of the input image does not end within the predetermined time and the user instruction indicates that the copying process is stopped. Claims characterized by Four Or claims Five The image processing method described in 1.

Images