JP2007067871A - Image data processor, image processor, image forming apparatus, and image data processing method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To perform necessary processing automatically without managing steps of image processing. <P>SOLUTION: The processor is provided with a group of processing components 51 including a plurality of processing components for executing specified processing to image data and a processing component control means 52 for controlling processing procedures of each of processing components 51a and 51b in the group of processing components 51 by the component. Image data are inputted from an image reading part 1 or an external I/F part 3, the inputted image data are accumulated in an image memory part, the respective processing contents performed with the respective processing components 51a and 51b are embedded into the image data each time, the embedded contents are extracted, the processing contents are switched, and outputted. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to an image data processing method for executing desired processing on input image data, an image data processing device for executing the image data processing method, an image processing device including the image data processing device, The present invention relates to an image forming apparatus such as a digital multi-function peripheral that combines functions such as copying, faxing, printers, scanners, and image data storage provided with the image processing apparatus.

  In recent multifunction peripherals (MFPs), the processing flow has become complicated due to the enhancement of the copy function, scanner function, FAX function, and printer function. This is a result of steadily installing functions to cover various user requirements. As a result, hardware that actually performs image processing represented by ASIC and the like becomes bloated, and software that controls them becomes complicated, causing a problem of prolonged development delivery time.

  However, the shortening of the development delivery time is always screamed, and the case where a programmable DSP is used as one solution is increasing. In this case, although it is inferior to dedicated hardware such as ASIC in terms of cost, it is characterized by a high degree of freedom in which necessary functions can be freely programmed each time. For example, if the image data read by the scanner is expanded in the memory, the program code of the processing to be performed on the DSP is downloaded and the processing is started, only the corresponding processing is performed, and the processed data is obtained again in the memory. be able to. By repeating this, it is possible to realize a complicated process that has been conventionally performed by multi-function dedicated hardware. Furthermore, if you want to install a newly developed process, you can handle it simply by having the program code as software.

  If this is to be done with an ASIC, it is necessary to make the developed functions as many circuits as necessary, and it is not possible to respond to new requirements after development. Of course, it is effective to add hardware to a programmable device such as a DSP. Even if the DSP can do anything, it is unsuitable depending on the processing contents, and it is not practical if it takes several tens of times longer than the hardware implementation.

  As this type of technology, for example, the invention described in Patent Document 1 or 2 is known. Among them, Patent Document 1 discloses that a plurality of different systems are used for the purpose of enabling high-efficiency image processing by quickly switching to image processing corresponding to different image data input from a plurality of systems. Input / output control means for controlling the input / output of image data of each system through which image data is individually input / output; and image processing means for performing predetermined image processing corresponding to each of the image data input from each system and outputting In the image processing apparatus, the image processing means can change the contents of the image processing in a programmable manner, and is based on additional information arranged at a predetermined position of the image data input to the plurality of input / output control means. The image processing apparatus is characterized in that it can change to the image processing contents corresponding to the image data and can perform image processing of the image data of each system in parallel. To have.

  Further, Patent Document 2 discloses an image data generation device that is an original image data input device for the purpose of realizing image output that has been subjected to image processing that reflects the color reproduction characteristics and photographing intention of the photographing device. Image data input means, image processing control data setting means for setting image processing control data for specifying the content of image processing to be performed on the original image data, and digital watermarking of the image processing control data to the original image data An image data generation device is described that includes image data generation means for generating image data embedded as a result.

  In the prior art, various processes can be performed, but it is necessary to manage how far the image has been processed. For example, scanner γ correction processing, color conversion processing, filter processing, scaling processing, mask processing, halftone processing, image area separation processing, mirroring, inversion processing, and the like are various, and these are processed. Including parallel operations such as the order and how far processing has been performed, quite complicated management is required.

  The present invention has been made in view of such a background, and an object thereof is to be able to automatically execute necessary processing without managing the stage of image processing.

  In order to achieve the object, the first means includes a processing component group including a plurality of processing components for executing predetermined processing on image data, and processing order of each processing component in the processing component group as a component unit. And a processing component control means for controlling the image data, and embedding each processing content performed by the processing component in the image data each time, extracting the embedded content and switching the processing content, To do.

  The second means is characterized in that, in the first means, the predetermined processing executed by the processing component is one of correction, processing, recognition, editing, and data embedding / extraction.

  The third means is characterized in that, in the first or second means, the process in units of parts executed by the processing part control unit is an accumulation process or an output process.

  The fourth means includes an input means for inputting image data, a storage means for storing the input image data, an image data processing apparatus according to any one of the first to third means, and the image data processing apparatus. And an output unit for outputting the image data processed by the image processing apparatus.

  A fifth means is characterized in that, in the fourth means, the image data is input from an image reading means or an external I / F unit.

  A sixth means is characterized in that, in the fourth or fifth means, the image data is output to any one of an external I / F unit, an image writing means, and a mass storage means.

  The seventh means is characterized in that the image forming apparatus includes the image processing apparatus according to any one of the fourth to sixth means.

  The eighth means is an image data processing method for processing input image data with a plurality of processing components and outputting the processed image data. In the image data processing method, the processing order of each processing component in the processing component group is expressed in units of components. In addition to the control, each processing content performed by the processing component is embedded in the image data each time, and the embedded content is extracted to switch the processing content.

  In the embodiment described later, the processing components are denoted by reference numerals 51a and 51b, the processing component group is denoted by reference numeral 51, the processing component control means is denoted by the processing component control unit 52, and the image data processing device is denoted by the image processing unit 5. The input unit corresponds to the image reading unit 1 or the external I / F unit 3, the storage unit corresponds to the image memory unit, and the output unit corresponds to the external I / F unit 3, the image writing unit 2, and the large-capacity storage unit 6.

  According to the present invention, the contents to be processed are embedded electronically in the image data itself, and the processing component automatically detects, executes, and re-embeds the software. As a result, the necessary processing can be automatically executed without managing the image processing stage. For this reason, it is possible to proceed more and more simply by sending image data waiting for processing when the processing component is in an idle state, and the management of the image data becomes very simple.

  Embodiments of the present invention will be described below with reference to the drawings.

  FIG. 1 is a block diagram showing an example of an image processing apparatus according to an embodiment of the present invention. In the figure, an image processing apparatus includes an image reading unit 1 that reads a document with a scanner or the like, an image writing unit 2 that outputs image data to a medium such as paper with a printer, an external medium (CD / DVD / SD card, etc.), An external I / F unit 3 that transmits / receives image data to / from an external device (such as a PC), an image memory unit 4 that temporarily stores image data that has been read or input from the outside, correction, processing, The image processing unit 5 performs image processing such as recognition, editing, data embedding / embedded data extraction, and a large-capacity storage unit 6 that stores image data for backup, reuse, or the like.

  The image processing unit 5 further performs control including processing components 51a and 51b (hereinafter, the processing component group is denoted by reference numeral 51) for performing individual image processing and control of the processing order of these processing components 51a and 51b. And a processing component control unit 52. The image memory 4 is provided with a plurality of memories 4a, 4b and 4c.

FIG. 2 is a flowchart showing an example of a processing procedure in the present embodiment.
In the processing procedure of FIG. 2, first, input image data is input to the image processing apparatus (step S1), and processing information is extracted (step S2). However, since the data has just entered, no processing information is detected. Therefore, it is necessary to embed processing information before processing. At this time, what kind of processing is necessary is notified from the input side, and embedding processing is performed based on the notification. In step S3, it is checked whether there is processing information. If there is no processing information in step S3, the processing information is embedded in step S7.

  The processing information may be embedded / extracted by adding a header or tag to normal image data, but in this case, the format becomes unique. In view of the versatility of the image data sent to the outside, a method of embedding it in the image data itself is preferable to a method unique to this system. For this reason, in this embodiment, it is assumed that information is directly embedded in image data. The method of embedding in the image data itself involves processing the image data, and strictly speaking, the image quality deteriorates. However, an invention has been proposed in which the deterioration is hardly known. For example, by using a technique called digital watermark described in Japanese Patent Application Laid-Open No. 9-191394, it is possible to make the deterioration almost unknown.

  The watermarking is performed by a frequency spectrum image of the data, preferably by a Fourier transform of the data. That is, the watermark is inserted into a perceptually important component of the frequency spectrum image, and as a result, the watermarked spectrum image is subjected to inverse transformation, thereby generating watermarked data. The watermark is extracted from the watermarked data by first comparing the watermarked data with the original data to extract the watermark. From this extracted data, the original watermark, the original data, and the extracted watermark are compared and the authenticity of the watermark is analyzed.

  For example, for image data in which processing information is embedded by a method such as the digital watermark, processing information is extracted in step S2, and a program code necessary for processing is developed on a processing component based on the extracted information (step S2). S3, S4, S5). Further, when processing information information is extracted, embedded information is removed. This is a result of taking into account garbled embedded data and deterioration in image quality when processing is performed with information remaining. The processing contents to be executed include correction, processing, recognition, editing, data embedding / extraction, etc., but other processing can be applied as long as the processing program code can be generated.

  Image processing is performed on the image data after the processing component is developed (step S6). The image processing performed here is only single or limited processing, and the details of the processing and the remaining processing are embedded (step S7). Then, processing information is extracted again (step S2), and processing code expansion → processing execution → processing embedding → processing extraction (S3 → S4 → S5 → S2) is repeated. This repetition depends on the contents of image processing required for input / output and the amount of processing that can be performed at one time. When all the processes are completed (step S4-YES), that effect is embedded, an output destination is selected (step S8), and image data is output (step S9). This output destination is also preferably written when the first processing information is embedded.

  Furthermore, there is a case where processing is performed halfway, not the final output. In that case, processing information is embedded based on the input information, and the processing information is stored in a mass storage device such as a hard disk while remaining in the image. It is possible to output in the same manner by putting this in the processing flow again as necessary.

  FIG. 3 is a diagram illustrating an example of a data flow when image data is input from the image reading unit 1, various image processing is performed by the image processing unit 5, and output to the image writing unit 2. The image data read by the image reading unit 1 is temporarily stored in the memory 4a of the image memory unit 4 (A). In addition to the normal reading operation, the image reading unit 1 also performs correction mainly depending on the scanner such as interline correction and shading correction. Thus, even if various scanners are connected, it is possible to obtain certain image data that does not depend on the image reading unit (scanner) 1 on the memory 4a. Also, the processing component control unit 52 of the image processing unit 5 is notified of what processing is to be performed. At this time, the specific content is held in the processing component control unit 52 and the corresponding processing ID is notified.

  The image data on the memory 4a is subjected to processing information detection / image processing / processing information embedding according to the flowchart of FIG. In the processing component 51a, in the initial state, a processing code for detecting or embedding processing information is developed (B). Since the first image data is from the image reading unit 1 as it is, the processing information is not detected. Therefore, the processing component control unit 52 embeds processing information in the image based on the processing ID notified from the image reading unit 1, and the image data returns to the memory 4b (C). The processing information includes processing contents, order, various bibliographic information, and the like. Output destinations that will be needed later are also included.

  The image data in which the first processing information is embedded is transferred again from the memory unit 4b to the image processing unit 5 (D). This time, processing information is detected, program code for image processing necessary for the processing component 51b is developed, and embedded information is deleted. The image data is temporarily saved in the memory 4c (E), and the processing component 51b does not detect processing information for the next incoming image data, but performs processing according to the developed program code. Therefore, only the image data in which the embedded information is erased and saved in the memory 4c is the processing target. It is necessary to manage the image data with software that controls so that other image data cannot be input.

  The program code of the image processing is when the combination of the specified processing contents corresponding to the processing ID notified from the image reading unit 1 is too large for the processing component 51 to handle, or when the processing component 51 cannot keep up with the speed, A range that can be handled by the processing component 51 is developed. The image data to be processed by the processing component 51 is transferred to the image processing unit 5 (F), where image processing corresponding to the processing ID notified from the image reading unit 1 is executed, and after completion, the image data is returned to the memory 4c. (G). The program code of the processing component 51b that has been processed is deleted, and instead, the processing information detection / embedding code is expanded. The image data that has undergone the image processing is input again, and the processing information that has been completed and the processing information that has been left over are embedded. Based on this, processing information detection, processing code expansion, processing execution, and processing information embedding are repeated until all processing is completed.

  Then, after the processing is executed to the end, the image data is output to the output destination described in the embedded processing information. Since the output destination is the image writing unit 2 this time, it is output from the image writing unit 2 to a medium such as paper. The output image data is obtained by removing the processing information, but depending on the processing content, the processing information may be embedded separately with a background pattern. This is not the embedding of the processing information handled here, but is handled as another image processing realized on a medium such as paper.

  FIG. 4 is an example of a data flow when image data is input from the external I / F unit 3, various image processing is performed by the image processing unit 5, and output to the image writing unit 2. This example differs from the example in FIG. 3 only in input, and the processing content is the same as in FIG.

  FIG. 5 shows an example of a data flow when image data is input from the image reading unit 1, various image processing is performed by the image processing unit 5, and output to the external I / F unit 3. This example differs from the example in FIG. 3 only in output, and the processing content is the same as in FIG.

  FIG. 6 is an example of a data flow when image data is input from the external I / F unit 3, various image processing is performed by the image processing unit 5, and output to the external I / F unit. This example is different from the example in FIG. 5 only in input, and the processing content is the same as in FIG.

  FIG. 7 shows an example of a data flow in which image data is input from the image reading unit 1, various image processing is performed by the image processing unit 5 and accumulated in the large-capacity storage unit 6. The basic flow is the same as that in FIG. 3 or FIG. 5 described above, but the processing information is not removed at the final output (H) and remains embedded. Normally, in the case of re-output, the user does not specify the processing content again. Therefore, the processing component 51b performs the processing as it is when it is taken out from the large-capacity storage unit 6 again. However, when the user changes the output conditions, it is necessary to modify the processing information. At that time, the processing information may be extracted once and the processing information may be embedded again.

  FIG. 8 shows an example of a data flow in which image data is input from the external I / F unit 3, various image processes are performed in the image processing unit 5, and the large-capacity storage unit 6 is accumulated. This example differs from the example in FIG. 7 only in input, and the processing content is the same as in FIG.

  This time, processing information detection and processing code expansion, processing execution, and processing information embedding were performed by processing components. However, it is not necessary to embed and detect processing information in the entire image data, but partially. If possible, embedding and detection of processing information and execution of processing may be performed at once. In that case, a certain amount of buffer memory is required for the processing component 51, but the control of the data bus and the like is simplified.

  Although there is only one processing component 51 in the minimum configuration, a plurality of processing components 51 may be prepared as necessary. Accordingly, the resource management of the processing component 51 is complicated in the processing component control unit 52, but there are many processing variations such as processing one data in series or processing a plurality of image data in parallel. .

  A CPU (not shown) provided in the processing component control unit 52 uses a program (not shown) stored in a ROM (not shown) as a work area, and controls storage processing or output processing and processing order for each component. Is executed. Each processing component 51a, 51b is provided with a CPU, ROM, and RAM, and one process of correction, processing, recognition, editing, data embedding / extraction assigned to each processing component by the processing of each CPU is executed. Here, what processing should be performed on the image data itself for each processing component constituting the processing component group 51 and what the processing sequence should be performed are embedded in advance, and the processing component recognizes the contents. Thus, necessary processing is automatically executed without managing the stage of image processing.

  FIG. 9 is a diagram illustrating an example of a mechanical configuration of an image forming apparatus including the image processing apparatus illustrated in FIG. In the figure, a digital copying machine is for monochrome image formation. A main body 400, an image reading device 500 installed on the upper portion of the image forming apparatus main body 400, and an automatic document feeder (hereinafter referred to as an automatic document feeder) mounted thereon. , "ADF") 550, a large-capacity paper feeding device 700 disposed on the right side of the image forming apparatus main body 400 in the same figure, and a sheet post-processing apparatus disposed on the left side of the image forming apparatus main body 400 in the same figure. 800 is basically composed.

  The image forming apparatus main body 400 includes an image writing unit 410, an image forming unit 420, a fixing unit 430, a duplex conveying unit 440, a paper feeding unit 450, a vertical conveying unit 460, and a manual feeding unit 470.

  The image writing unit 410 modulates the LD, which is a light source, based on the image information of the document read by the image reading device 500, and writes laser on the photosensitive drum 421 by a scanning optical system such as a polygon mirror and an fθ lens. is there. The image forming unit 420 includes a photosensitive drum 421 and known electrophotographic imaging elements such as a developing unit 422, a transfer unit 423, a cleaning unit 424, and a charge eliminating unit provided along the outer periphery of the photosensitive drum 421. Consists of.

  The fixing unit 430 fixes the image transferred by the transfer unit 423 on the transfer paper. The double-sided conveyance unit 440 is provided downstream of the fixing unit 420 in the transfer sheet conveyance direction, and includes a first switching claw 441 that switches the transfer sheet conveyance direction to the sheet post-processing device 800 side or the double-side conveyance unit 440 side, , The reverse conveying path 442 guided by the switching claw 441, the image forming side conveying path 443 that conveys the transfer paper reversed by the reverse conveying path 442 to the transfer unit 423 again, and the reverse transfer paper after the sheet post-processing device 800. A second switching claw 445 is disposed at a branch portion between the image forming side conveying path 443 and the post processing side conveying path 444.

  The sheet feeding unit 450 includes four sheet feeding stages, and the transfer sheets stored in the sheet feeding stages selected by the pickup roller and the sheet feeding roller are drawn out and guided to the vertical conveyance unit 460. The vertical conveyance unit 460 conveys the transfer paper fed from each paper feed stage to the registration roller 461 immediately upstream in the paper conveyance direction of the transfer unit 423, and the registration roller 461 provides a visible image on the photosensitive drum 421. The transfer paper is fed into the transfer unit 423 in time with the leading edge. The manual feed portion 470 includes an openable and closable manual feed tray 471, and opens the manual feed tray 471 as needed to supply transfer paper manually. Also in this case, the transfer timing of the transfer paper is taken by the registration roller 461 and is transported.

  The large-capacity paper feeding device 700 supplies a large amount of transfer paper of the same size, and the bottom plate 702 rises as the transfer paper is consumed, so that the paper can always be picked up from the pickup roller 701. ing. The transfer paper fed from the pickup roller 701 is conveyed from the vertical conveyance unit 460 to the nip of the registration roller 461.

  The sheet post-processing apparatus 800 performs predetermined processing such as punching, alignment, stapling, and sorting. In this embodiment, the punch 801, the staple tray (alignment) 802, the stapler 803, and the shift tray 804 are used for the above functions. I have. In other words, the transfer paper carried from the image forming apparatus 400 to the paper post-processing apparatus 800 is punched one by one with the punch 801 when punching, and then if there is no particular processing, the proofing is performed. When sorting, stacking, and sorting to the tray 805, the sheets are discharged to the shift tray 804, respectively. In this embodiment, the sorting is performed by the reciprocating movement of the shift tray 804 by a predetermined amount in a direction orthogonal to the sheet conveyance direction. In addition, sorting can be performed by moving the paper in a direction orthogonal to the paper transport direction on the paper transport path.

  In the case of alignment, the transfer paper that has been punched or not punched is guided to the lower transport path 806, and the staple tray 804 is aligned in the direction perpendicular to the paper transport direction by the rear end fence. In the jogger fence, alignment in the direction parallel to the paper transport direction is performed. Here, when binding is performed, a predetermined position of the aligned sheet bundle, for example, a predetermined position such as a corner portion or two central positions is bound by the stapler 803 and discharged to the shift tray 804 by the discharge belt. In this embodiment, a pre-stack conveyance path 807 is provided in the lower conveyance path 806, and a plurality of sheets are stacked at the time of conveyance to avoid interruption of the image forming operation on the image forming apparatus main body 400 side during post-processing. Be able to.

  The image reading apparatus 500 is guided onto the contact glass 510 by the ADF 600, optically scans the stopped original, and reads the image formed by the imaging lens through the first to third mirrors, such as a CCD or CMOS. Read by the photoelectric conversion element. The read image data is subjected to predetermined image processing by an image processing circuit (not shown) and temporarily stored in a storage device. Then, it is read from the storage device by the image writing unit 410 during image formation, modulated according to the image data, and optical writing is performed.

  The ADF 550 has a double-sided reading function, and is attached to the contact glass 510 installation surface of the image reading device 500 so as to be freely opened and closed. In the ADF 550, the document placed on the document placement table 551 is automatically sent onto the contact glass 510 when the document is read.

It is a block diagram which shows an example of the image processing apparatus which concerns on embodiment of this invention. It is a flowchart which shows an example of the process sequence in this embodiment. It is a figure which shows an example of the data flow in case image data is input from an image reading part, various image processing is performed in an image processing part, and it outputs to an image writing part. It is a figure which shows an example of a data flow in case image data is input from an external I / F part, various image processing is performed in an image processing part, and it outputs to an image writing part. It is a figure which shows an example of a data flow in case image data is input from an image reading part, various image processing is performed in an image processing part, and it outputs to an external I / F part. It is a figure which shows an example of a data flow in case image data is input from an external I / F part, various image processing is performed in an image processing part, and it outputs to an external I / F part. FIG. 6 is a diagram illustrating an example of a data flow in which image data is input from an image reading unit, various image processes are performed in the image processing unit, and the image data is accumulated in a large-capacity storage unit. It is a figure which shows an example of the data flow by which image data is input from an external I / F part, various image processings are performed in an image processing part, and are accumulate | stored in a mass storage part. It is a figure which shows an example of the mechanical structure of the image forming apparatus provided with the image processing apparatus shown in FIG.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Image reading part 2 Image writing part 3 External I / F part 4 Image memory part 4a, 4b, 4c Memory 5 Image processing part 51 Processing component group 51a, 51b Processing component 52 Processing component control part 6 Large capacity storage part

Claims (8)

A processing component group including a plurality of processing components that execute predetermined processing on image data;
Processing component control means for controlling the processing order of each processing component of the processing component group in units of components;
An image data processing apparatus comprising: embedding each processing content performed by the processing component in the image data each time, extracting the embedded content, and switching the processing content.   The image data processing apparatus according to claim 1, wherein the predetermined process executed by the processing component is one of correction, processing, recognition, editing, and data embedding / extraction.   The image data processing apparatus according to claim 1, wherein the processing in units of components executed by the processing component control unit is an accumulation process or an output process. Input means for inputting image data;
Storage means for storing input image data;
The image data processing device according to any one of claims 1 to 3,
Output means for outputting image data processed by the image data processing device;
An image processing apparatus comprising:   The image processing apparatus according to claim 4, wherein the image data is input from an image reading unit or an external I / F unit.   6. The image processing apparatus according to claim 4, wherein the image data is output to any of an external I / F unit, an image writing unit, and a mass storage unit.   An image forming apparatus comprising the image processing apparatus according to claim 4. In an image data processing method for processing input image data by a plurality of processing components and outputting the processed image data,
The processing order of each processing component in the processing component group is controlled on a component basis, and each processing content performed by the processing component is embedded in the image data each time, and the embedded content is extracted and processing content is extracted. An image data processing method characterized by switching between the two.

Images