JPH0795388A - Picture processing unit and its method - Google Patents

Abstract

PURPOSE:To provide the picture processing unit realizing sophisticated picture processing with a minimum required memory capacity and its method. CONSTITUTION:A frame memory control section 4 stores picture data transferred from an external device to a band memory B being a division of a frame memory 110 based on control information of a picture received from the external device via an external parallel interface 150 or 151. The frame memory control section 4 processes the picture stored in the band memory B based on the control information and stores the processing result to a band memory A being a division of the frame memory 110 and sends the processed picture data as the result of processing to a printer section or the external device.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image processing apparatus and a method thereof, and more particularly to an image processing apparatus and a method thereof for image-processing image data transferred from an external device such as a computer.

[0002]

2. Description of the Related Art FIG. 19 is a block diagram showing the structure of an image forming apparatus, such as a printer which receives image data held by an external device such as a computer and forms an image on a recording medium such as recording paper. .

In the printer having the configuration shown in FIG. 1, the image data sent from the external device is received by the interface control unit 401 and stored in the frame memory 402 under the control of the memory controller 403. . The image data stored in the frame memory 402 is converted into print data by the image generation unit 404, and then stored in the output buffer 406. Then, under the control of the printer control unit 405, the print data is transferred from the output buffer 406 to the printer unit 407 in synchronization with the operation of the printer unit 407, and the printing is executed.

FIG. 20 is a diagram showing a printing operation in the printer unit 407. As shown in the figure, the print data is divided into units that match the recording width (bandwidth) of the recording (printing) head of the printer unit 407, and by sequentially printing in units of this bandwidth, one image is printed. Is formed.

[0005]

However, the above-mentioned conventional example has the following problems.

(1) It is possible on the image forming apparatus side to perform geometric conversion processing such as enlarging, reducing, and rotating on an image transferred from an external device. On the other hand, processing such as layout output of a plurality of images, pixel calculation between a plurality of images, and image processing by a spatial filter is performed in advance by an external device such as a host computer, and then the processed images are transferred to the image forming device. However, when processing an image with a large amount of data such as a color image, a large-capacity external storage device or high-speed processing is required, so that the external device that can implement the processing is limited.

(2) The image data format is RGB multivalue, CYMK
There are multivalues, palettes, bitmaps, etc., and there are multiple formats for each image type. In the above technique, the image data that can be transferred between the external device and the image forming device at the time of image formation is only a single image type and a single format.

The present invention is to solve the above-mentioned problems individually or all, and with a minimum required memory capacity, pixel calculation, composition, layout processing of a plurality of image data, format conversion of image data, etc. It is an object of the present invention to provide an image processing apparatus and a method thereof that realizes advanced image processing.

It is another object of the present invention to provide an image processing apparatus and method for realizing advanced image processing with a simple structure.

[0010]

[Means for Solving the Problems] and

The present invention has the following structure as one means for achieving the above object.

An image processing apparatus according to the present invention is an image processing apparatus for processing image data in a predetermined unit, and after receiving control information regarding at least one image from an external device, the image of the image is received by the external device. A communication unit that requests data in the predetermined unit and receives the image data from the external device, a storage unit that stores the image data received by the communication unit in a predetermined area, and the storage unit that stores the image data based on the control information. Processing means for processing the image data stored in a predetermined area of the storage means, and storing the processing result in another predetermined area of the storage means.

Further, the image processing apparatus processes the image data in a predetermined unit, and after receiving the control information about at least one image from the external device, requests the external device for the image data of the image in the predetermined unit. Then, the communication means for receiving the image data from the external device, the image processing procedure is selected based on the control information, the image data storage area of the storage means is set, and the image data received by the communication means is set. Control means for storing in the set first area of the storage means, and processing the image data stored in the first area of the storage means based on the image processing procedure set by the control means, and And a processing unit for storing the processing result in the second area of the storage unit set by the control unit.

An image processing apparatus for processing image data in a predetermined unit, wherein after receiving control information regarding at least one image from an external device, the external device is requested for the image data of the image in the predetermined unit. Then, a communication unit that receives the image data from the external device, a processing unit that processes the image data received by the communication unit based on the control information, and an output of the processing unit is output to the external device. And output means.

An image processing method according to the present invention is an image processing method for processing image data in a predetermined unit, the first receiving step of receiving control information on at least one image from an external device, and the external device. A request step for requesting image data of the image in the predetermined unit, a second receiving step of receiving the image data from the external device, and the image data received in the second receiving step in a predetermined storage means. A storage step of storing in an area, and a processing step of processing the image data stored in a predetermined area of the storage means based on the control information and storing the processing result in another predetermined area of the storage means. It is characterized by having.

An image processing method for processing image data in a predetermined unit, the first receiving step of receiving control information on at least one image from an external device,
A request step of requesting the image data of the image to the external device in the predetermined unit, a second receiving step of receiving the image data from the external device, and selecting and storing an image processing procedure based on the control information. A setting step of setting the image data storage area of the means, a storing step of storing the image data received in the second receiving step in the first area of the storage means set in the setting step, and the setting step. A processing step of processing the image data stored in the first area of the storage means based on the set image processing procedure, and storing the processing result in the second area of the storage means set in the setting step; It is characterized by having.

An image processing method for processing image data in predetermined units, the first receiving step of receiving control information on at least one image from an external device,
In the request step of requesting the image data of the image to the external device in the predetermined unit, the second receiving step of receiving the image data from the external device, and the second receiving step based on the control information. It is characterized by comprising a processing step of processing the received image data and an output step of outputting the image data processed in the processing step to the external device.

[0017]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS An image processing apparatus according to an embodiment of the present invention will be described in detail below with reference to the drawings.

[0018]

[Embodiment] [Functional block] FIGS. 1 and 2 are functional block diagrams showing a configuration example of an image processing method according to an embodiment of the present invention.

In the figure, control units 102, 111, 121 and 1
Reference numeral 12 denotes a control circuit that controls the scanner unit 1, the controller unit 2, the printer unit 3, and the frame memory control unit 4, and includes a microcomputer, a program ROM, a data memory, a communication circuit, and the like. The control units are connected by a communication line, and when this embodiment operates as a color copying machine, another control unit operates based on an instruction from the control unit 111, a so-called master / slave control mode. Has been adopted. Also, an external parallel interface
In the remote mode, which performs various operations from commands from the host machine (not shown) via 150 and 151, the control unit
112 becomes the master, sends an instruction to the control unit 111, and the control unit 11
1 is in the form of sending an instruction to the control units 102 and 121 based on this instruction. The transition to the remote mode is performed by an instruction from the host machine or a key switch operation of the operation unit 10.

When operating as a color copier, the control unit
111 operates according to an input instruction from the operation unit 10 or the digitizer 114. The operation unit 10 uses, for example, a liquid crystal display panel as its display unit, and further has a touch panel made of a transparent electrode on the surface thereof, and the user touches the touch panel to give instructions such as designation regarding color and designation of editing operation. Make a choice. Also, keys related to operation, for example,
Frequently used keys such as a start key for instructing the start of copying operation, a stop key for instructing to stop copying operation, a reset key for returning the operation mode to the standard state, and a projector key for selecting a projector are independently operated. It is provided in. The digitizer 114 is for inputting positional information necessary for trimming and masking processing, and is connected as an option when complicated editing processing is required. Further, the control unit 111 controls the multi-value synthesis unit 106, the image processing unit 107, the binarization processing unit 108, and the binary synthesis unit 109 that perform various types of image processing.

The control unit 102 controls the drive of the mechanism of the scanner unit 1, the mechanical drive unit 105, the exposure control unit 103 that controls the exposure of the lamp when reading the original, and the exposure control of the halogen lamp 90 when the projector is used. The exposure control unit 104 is controlled respectively. The control unit 102 also includes an analog signal processing unit 100 and an input image processing unit 1 that perform various types of processing related to images.
01 is also controlled respectively.

The control unit 121 controls the drive of the mechanism of the printer unit 3, the mechanical drive unit 122, absorbs the mechanical operation time variation of the printer unit 3 and compensates the delays corresponding to the mechanism of the recording heads 117 to 120. The respective synchronous delay memories 115 to be executed are controlled.

Next, the image processing of the present embodiment having the configuration of FIGS. 1 and 2 will be described along the flow of image data.

The image of the original 12 formed on the CCD 16 by the lens 15 is converted into an analog electric signal by the CCD 16. The converted image information is, for example, red (R), green (G), blue
The signals are serially input to the analog signal processing unit 100 in the order of (B). The analog signal processing unit 100 performs sample-and-hold, dark level correction, dynamic range control, etc. for each color of red, green, and blue, and then performs analog / digital conversion (A / D conversion) and serialization. It is converted into a multi-value (for example, 8-bit length for each color) digital image signal and output to the input image processing unit 101. The input image processing unit 101 performs correction processing required in the image reading system, such as CCD correction and γ correction,
The serial multilevel digital image signal input from the analog signal processing unit 100 is applied.

The multi-value synthesizing unit 106 of the controller unit 2 determines whether the serial multi-value digital image signal sent from the scanner unit 1 or the serial multi-value digital image signal sent from the frame memory 110. Select or synthesize. The selected or combined image data is sent to the image processing unit 107 as it is as a serial multi-valued digital image signal.

The image processing unit 107 performs smoothing processing, edge enhancement, black extraction, masking processing for color correction of recording ink used in the recording heads 117 to 120, and the like. The processed image data is input to the binarization processing unit 108 and the frame memory 110 as it is as a serial multi-valued digital image signal.

The binarization processing unit 108 is a circuit for binarizing a serial multivalued digital image signal, and selects simple binarization processing by a fixed slice level or pseudo halftone processing by an error diffusion method. be able to. here,
The serial multi-value digital signal is converted into a four-color binary parallel image signal, and four-color image data is sent to the binary synthesizing unit 109 and three-color image data is sent to the frame memory 110.

The binary synthesizer 109 is a binary parallel image signal of three colors or four colors sent from the frame memory 110 and a binary parallel image signal of four colors sent from the binarization processor 108. And either of them are combined or combined to form a four-color binary parallel image signal.

The control unit 112 of the frame memory control unit 4 controls the frame memory 110 so that the predetermined combination position is reached in time with the operations of the multi-value combining unit 106 and the binary combining unit 109 described above. , Outputs the image data stored in the frame memory 110. Further, the control unit 112 writes the image data sent from the scanner unit 1 into the frame memory 110 as multivalued from the image processing unit 107 or as binary from the binarization processing unit 108. Further, the control unit 112 uses the IEEE
-Controls general-purpose parallel interfaces such as -488 (so-called GPIB) interface or SCSI interface,
Input / output of image data with the host machine and remote control by the host machine can be performed via this interface.

The input image data processing unit 123, which will be described in detail later, performs enlargement processing, logarithmic conversion, palette conversion, etc. according to an instruction from the control unit 112.

The synchronous delay memory 115 of the printer unit 3 also absorbs the time variation of the mechanical operation of the printer unit 3 and generates the timing necessary for driving the recording head 117 $ \ sim $ 120.

The head driver 116 is a recording head 117 $ \ si.
An analog drive circuit for driving m $ 120 that internally generates a signal that can directly drive the printhead.

The recording heads 117 to 120 are cyan,
The magenta, yellow, and black inks are ejected to form an image on the recording paper.

[Frame Memory Control Unit] The frame memory control unit 4 described above will be described in more detail below.

FIG. 3 shows a frame memory 110 and a control unit 112.
3 is a block diagram showing a detailed configuration example of FIG.

In the figure, reference numeral 303 denotes a CPU, which is a known microprocessor in this embodiment. CPU303
According to the program stored in the program ROM 304,
The control is executed by using the RAM 305 as a work area.

The GPIB controller 308 and the SCSI controller 309 are for transmitting / receiving data to / from an external device (not shown), and both are connected to the frame memory 300 $ \ sim $ 302 via the DMA controller 307. You can directly transfer data with. The interface with the external device is
Needless to say, the interface is not limited to GPIB or SCSI, and any interface can be used.

A mailbox 320 has a well-known dual-port RAM configuration for communicating with the control unit 111. The control unit 112 uses this mailbox 320 to exchange various information.

In this embodiment, the frame memories 300 to 302 each have a storage capacity of 16 Mbytes and a total of 48 Mbytes.
A 32-bit address bus is required to cover this frame memory area, but the CPU3 used in this embodiment
03 and DMA controller 307
Since it has only bits, the bank register 306 compensates for the insufficient bits. An address value and other control information can be set in the bank register 306 by the CPU 303.

[Outline of Apparatus] FIG. 4 is an outline view of a digital color copying machine to which this embodiment is applied, and the whole can be divided into two parts.

In the upper part of the figure, a color image scanner section (the above-mentioned scanner section) 1 for reading an original image image and outputting digital color image data, and various image processing of digital color image data, and an external device A controller unit 2 having a processing function such as an interface is shown. The controller unit 2 is built in the scanner unit 1. The scanner unit 1 also has a built-in mechanism for reading a three-dimensional object or a sheet document placed downward under the document pressure plate 11.

The operation unit 10 arranged in the controller unit 2
Is for the user to input various information regarding the copying operation.

The controller unit 2 gives an operation instruction to the scanner unit 1 and the printer unit 3 according to the input information. If you have a process that does more complicated editing,
By attaching a digitizer or the like in place of the document pressure plate 11 and connecting this to the controller unit 2, more sophisticated processing becomes possible.

In the lower part of the figure, a printer section 3 for recording the color digital image signal output from the controller section 2 on recording paper is shown. The printer unit 3 in this embodiment is a full-color inkjet printer using an inkjet recording head.

The above-mentioned two parts, that is, the scanner section 1 and the printer section 3 can be separated from each other, and it is also possible to install them in separate places by extending a connecting cable connecting them.

[Control] The data transfer control between the printer unit 3 and the external device in the present embodiment is realized by the frame memory control unit 4 described above, and the program ROM
The control program is stored in 304. Hereinafter, the control will be described in detail.

As described above, this embodiment is provided with a GPIB interface, a SCSI interface, etc. as an interface with an external device, and selects either one according to the external device to be used. This selection is made by the frame memory controller
It is instructed by a switch (not shown) provided in 4.
That is, the CPU 303 detects the state of this switch,
Decide which interface to use. Thus, the data transfer with the external device is executed via the selected interface, the details of which will be described.

First, the external device notifies the frame memory control unit 4 of the control information prior to the transfer of the image data.
The control information is roughly classified into layout information and image processing information. Details of each information will be described below.

[Layout Information] The layout information includes an image identification number, an image type, format information, an image size and an output area.

The image identification number is an arbitrary integer from 1 to 128, and one unique number is set for each image. In this embodiment, the image data managed by the external device and the control information notified by the external device to the frame memory control unit 4 are uniquely associated with each other by the image identification number.

Further, in the present embodiment, for example, it is possible to handle three kinds of image types of RGB 24-bit, 8-bit palette and binary bitmap, and the external device specifies these image types according to the image type.

Further, in the case of an RGB 24-bit image, it is possible to adopt each of a frame sequential format, a line sequential format and a dot sequential format, and the external device specifies these formats by the format information.

The image size specifies the width W and the height H of the original image transferred by the external device, and is specified in pixel units, for example.

As shown in an example in FIG. 5, the output area has a coordinate value (X, X, X of the upper left apex of the image area with the upper left of the recording paper 501 as the origin when the image is laid out on the recording paper 501. Y) and the image size (W, H) are specified. As the coordinate unit, for example, mm, inch, or pixel can be designated, but whichever unit is designated, it is converted into a pixel unit by the software of the frame memory control unit 4. In the above description, the upper left corner of the recording paper 501 is set as the origin, and the upper left vertex of the image area is specified by the coordinate values (X, Y), but the present embodiment is not limited to this. It goes without saying that an arbitrary designation method such as designating the lower left of the image area with the lower right as the origin is acceptable.

[Image Processing Information] The image processing information is composed of the following items for each image processing content.

(1) Rotation processing An image processing function of rotating and outputting image data transferred from an external device in 90-degree units on recording paper, an image identification number and a rotation angle of an image to be subjected to rotation processing are stored in a frame memory control unit. (2) Mirror image processing An image processing function that outputs image data transferred from an external device as a mirror image on recording paper, and notifies the frame memory control unit 4 of the image identification number of the image to be mirror image processed (3 ) Spatial filter An image processing function that executes the sum of products operation of the image data transferred from the external device and the spatial filter table of the M × N area
The image identification number of the image to be spatially filtered and the spatial filter table of the M × N area, an example of which is shown in FIG.
The factor, the pixel position of interest (Fx, Fy), and the image area (Fw, Fh) on which the spatial filter calculation process is executed
(4) Inter-pixel operation The following inter-pixel operation is performed on the two images A and B transferred from the external device. The external device specifies this operation process, two-image specification, and each operation-specific operation. Specify the parameter.
Here, the image A is an image whose layout is specified by the layout information, and the image B means an image held by an external device that performs a calculation with the image A. Note that it is possible to select and specify multiple pixel calculation specifications for image A. (4) -1 Addition The calculation process shown in the following equation is executed between two images, and the image identification number and scale of images A and B are added. , Notify the offset value (Image A + Image B) / Scale + Offset (4) -2 Subtract The calculation processing shown in the following formula is performed between two images, and the image identification number, scale, and offset value of images A and B are calculated. Notify (Image A-Image B) / Scale + offset (4) -3 Absolute value of difference Execute the arithmetic processing shown in the following equation between two images and notify the image identification numbers of images A and B | Image A- Image B | (4) -4 Multiply Performs the arithmetic processing shown in the following equation between two images, and notifies the image identification numbers, scales, and offset values of images A and B (Image A x Image B) / scale + offset ( 4) -5 Composition 1 Perform the arithmetic processing shown in the following equation between the two images and notify the image identification numbers of image A and image B and the coefficient α. A × α + image B × (100-α)} / 100 (4) -6 Composition 2 Perform the arithmetic processing shown in the following equation between two images, and notify the image identification numbers of images A and B and the mask value β. {Image A × β + Image B × (255-β)} / 255 (4) -7 Comparison 1 Performs the comparison calculation process shown in the following equation between two images to obtain the corresponding pixel with the larger value of two pixels. , Image A, B image identification number is notified Max (Image A, Image B) (4) -8 Comparison 2 The comparison calculation process shown in the following equation is executed between two images and the corresponding two pixel values are small. Min (image A, image B) that notifies the image identification number of images A and B to obtain pixels (4) -9 Logical operation 1 Performs the logical operation processing shown in the following equation between two images to obtain the logic of each pixel. Image A AND Image B that notifies the image identification numbers of images A and B (4) -10 Logical operation 2 Performs the logical operation processing shown in the following equation between two images to obtain the logical sum of each pixel , Image A and B image identification numbers are notified Image A OR Image B (4) -11 Logical operation 3 The logical operation processing shown in the following equation is executed between two images to obtain the exclusive OR of each pixel, and the image identification numbers of images A and B are notified.Image A XOR image B Figure 7 shows the image after the print command is issued. It is a figure which shows the outline of an image output process.

Upon completion of the above notification of control information,
The external device notifies the frame memory control unit 4 of the print command (step S80).

The frame memory control unit 4 uses the command as a trigger, and based on the layout information and the image processing information,
A band information table, an example of which is shown in FIG. 8, is created (step S81).

The band information table is created for each band, and an image identification number and a pointer pointing to the corresponding attribute information table are set. When outputting a plurality of images in one band, corresponding information is set from the beginning of the band information table in the order in which the external device transfers the image data.

In the attribute information table, the image type, the image size (W, H), the enlargement / reduction ratio (1 to 2,000%), the output area of the band, and the pointer indicating the image processing table are set. The output area of the band is the area information in each band created based on the area information notified from the external device, and as shown in an example in FIG. 9, the offset A is an offset value from the upper end of the band, an offset. B indicates an offset value from the lower end of the band, offset C indicates an offset value from the end on the band side, and D width indicates an output width.

The image processing table is created on the basis of the image processing information, and the image processing code and the parameters determined for each image processing are set. When a plurality of image processes are designated for one image data, the above-mentioned information is set in the table in a linked form as shown in FIG. If no image processing is specified, for example, "0" is set in the pointer field of the attribute information table.

After issuing the print command, the external device requests the frame memory control unit 4 to acquire image information (GET IMAGE IN
FORMATION) command is issued (step S82). The frame memory control unit 4 that has received the command, after performing various settings for image data transfer, notifies the image identification number of the image data to be transferred and the data transfer size (for example, in bytes) (step S83). . The external device starts image transfer by using this notification as a trigger (step S8).
Four).

The frame memory control unit 4 manages the frame memories 300 to 302 as a band memory for two bands by logically dividing each of the color frames into two, and according to the contents of image processing, one of the band memories is controlled. Image data is stored in. When the frame memory control unit 4 receives the image data of the designated transfer size, it performs image processing on the image data, then issues a start request to the printer unit 3,
The processed image data is output to the printer unit 3 (step S85).

Hereinafter, by repeating this control, an output image of a desired size can be obtained.

Next, the details of image transfer and band memory control in the frame memory control unit 4 will be described for each image processing content. Note that here, from the external device, as shown in FIG.
Assuming that the layout information and the image processing information indicating an example have been notified, the control details will be sequentially described from the first band. In the figure, it is assumed that the following settings are made in the areas (A) to (D).

(A) Layout output of a single image (B) Spatial filter processing (C) Pixel calculation processing / pulling-out synthesis processing between two images (D) Designation of output of multiple images in the same band First, in FIG. As shown, when there is no image up to the output area of the first image (A) (hereinafter referred to as “(A) pattern”), the frame memory control unit 4 sends the recording paper by the amount corresponding to the bandwidth. Is notified to the printer unit 3. During this time, image information acquisition from an external device (GET IMAGE INFORMA
TION) command, the image identification number and data transfer size are both reported as “0”, and the image data transfer is not executed.

(A) When the paper feed is completed to the band position where the pattern is output, image information acquisition (GET IMAGE INFORMA
For the (TION) command, the frame memory control unit 4 starts notification of the image identification number and the data transfer size, but in the case of the (A) pattern, the band memory control procedure differs depending on the image type and the image processing content. 11 and 12 are flowcharts showing an example of the control procedure executed by the frame memory control unit 4.

In the figure, the band information table and the attribute information table are searched to obtain the enlargement / reduction ratio and the image type of the output image in the corresponding band (step
S121). The data transfer size is calculated based on these pieces of information (step S122).

Next, various settings for image data transfer are executed (step S123), and when the settings are completed, the band information table is read from the band information table in response to the image information acquisition (GET IMAGE INFORMATION) command of the external device. The image identification number of the obtained output image and the data transfer size calculated previously are notified (step S124). The external device starts the transfer of the image data by the notification as a trigger (step S125), but since the band memory for storing the image data differs depending on the image type and the presence or absence of image processing, in step S126, the image type is an RGB 24-bit image. If so, the process branches to step S127; otherwise, the process branches to step S138.

In the case of an RGB 24-bit image, the setting of the enlargement / reduction ratio field of the attribute information table and the setting of the image processing table pointer are judged (step S127), and "equal size output" and "0" (that is, image processing). If not specified),
The image data is sequentially stored in the band memory A (step S1
28).

Then, it is judged whether or not the transfer of the image data corresponding to the data transfer size notified previously is completed.
When completed (step S129), a start request is issued to the printer unit 3 (step S130), and the image data stored in the band memory A is transmitted to the printer unit 3. During this period, the image information number (GET IMAGE INFORMATION) command of the external device is notified of "0" for both the image identification number and the data transfer size.

Then, when a print completion notification for one band is received from the printer unit 3 (step S131), the band number is incremented (step S132), the process returns to step S121, and the information table of the next band is searched. By repeating the above control, the image output of the (A) pattern is realized.

On the other hand, in step S127, if the field of the enlargement / reduction ratio is set to other than the same size, or if the image processing table pointer is set to other than "0" (that is, image processing is designated), Data in band memory B
Are sequentially stored in (step S133).

Subsequently, it is judged whether or not the transfer of the image data corresponding to the data transfer size notified previously is completed.
(Step S134), when completed, the image data stored in the band memory B is sequentially read by the CPU 303, and the enlarging / reducing operation is performed based on the enlarging / reducing ratio set in the attribute information table (step S135). Band memory a
Write to (step S136). At this time, when rotation or mirror image processing is designated in the image processing table, the write address of the band memory A corresponding to the designated processing is calculated, and the result of the enlargement / reduction calculation is written to the address.

When the above processing is completed (step S137),
It proceeds to step S130 described above. During this time, the image information number (GET IMAGE INFORMATION) command of the external device is notified of "0" for both the image identification number and the data transfer size.

On the other hand, in step S126, when the image type is other than the RGB 24-bit image (for example, palette or bitmap image), the image data is sequentially stored in the band memory B.
(Step S138).

Then, it is judged whether or not the transfer of the image data corresponding to the data transfer size previously notified is completed.
(Step S139) When completed, the attribute information table is searched to determine whether the enlargement / reduction ratio field of the attribute information table is set or the image processing table pointer is set (step S140). When “one-size output” and the image processing table pointer are “0”, the image data stored in the band memory B is sequentially read by the CPU 303 and read from the bitmap image.
Conversion to an RGB 24-bit image or a palette image to an RGB 24-bit image is performed (step S141), the result is written to the band memory A (step 142), and when this conversion process is completed (step S143), the aforementioned step S130 Go to.

When the setting is other than the same size or when the pointer is other than "0", the image data stored in the band memory B is sequentially read by the CPU 303 to convert the bitmap image to the RGB 24-bit image, or The palette image is converted to an RGB 24-bit image (step S144), and the result is written again to the band memory B (step S145).
When this conversion process is completed (step S146), the process proceeds to step S135 described above.

After the (A) pattern is output, if the output image does not exist up to the output area of the (B) pattern, the frame memory control section 4 sends the recording paper by the amount corresponding to the band width of the printer section 3 Notify to. During this period, the image information number (GET IMAGE INFORMATION) command of the external device is notified of "0" for both the image identification number and the data transfer size.

When the recording paper is sent to the output band position of the (B) pattern, notification of the image identification number and the data transfer size is started for the image information acquisition (GET IMAGE INFORMATION) command. Also in this case, the control procedure of the band memory differs depending on the image type. FIG. 13 is a flowchart showing an example of the control procedure executed by the frame memory control unit 4.

In the figure, the band information table and the attribute information table are searched to obtain the enlargement / reduction ratio and the image type of the output image in the corresponding band (step
S151), and the data transfer size is calculated based on these pieces of information (step S152).

Next, various settings for image data transfer are executed (step S153), and when the settings are completed, the band information table is read from the band information table in response to the image information acquisition (GET IMAGE INFORMATION) command of the external device. The image identification number of the obtained output image and the data transfer size calculated previously are notified (step S154). The external device starts the transfer of the image data by using the notification as a trigger (step S155).

In step S156, the image type is RGB24.
If it is a bit image, the process branches to step S157; otherwise, it branches to step S165.

When the image type is RGB 24-bit image, the image data transferred from the external device is sequentially stored in the band memory B (step S157). When the transfer of the image data corresponding to the data transfer size notified earlier is completed (step S
158), referring to the parameters of the image processing table (spatial filter matrix, central pixel position information, factors, etc.), based on these parameters, the filter operation is executed on the image data stored in the band memory B (step S
159). The processing result is written in the address of the band memory A calculated based on the output area (step S160).

When this process is completed for all the data stored in the band memory B (step S161), the printer unit 3
To the band memory A (step S162).
The image data stored in is transmitted to the printer unit 3. During this time, get image information of external device (GET IMAGE INFORMATION)
"0" is notified to the command for both the image identification number and the data transfer size.

Then, when a print completion notification for one band is received from the printer unit 3 (step S163), the band number is incremented (step S164), the process returns to step S151 to search the information table of the next band, By repeating the above control, the image output of the (B) pattern is realized.

On the other hand, in step S156, the image type is
If the image data is other than the RGB 24-bit image (for example, palette or bitmap image), the image data transferred from the external device is sequentially stored in the band memory B (step S165). When the transfer of the image data corresponding to the previously notified data transfer size is completed (step S166), the image data stored in the band memory B is sequentially read by the CPU 303 to convert the bitmap image to the RGB 24-bit image or the palette image. R
Conversion to a GB 24-bit image is performed (step S167), the conversion result is written to the band memory B (step S168), and when the conversion process is completed (step S169), the process proceeds to step S159 described above.

After the output of the (B) pattern, if the output image does not exist up to the output area of the (C) pattern, the frame memory control section 4 sends the recording paper by the amount corresponding to the bandwidth. Notify 3. During this period, both the image identification number and the data transfer size are "0" for the image information acquisition (GET IMAGE INFORMATION) command of the external device.
Is notified and the image data transfer is not executed.

When the paper feed is completed up to the output band position of the (C) pattern, the frame memory control section 4 acquires the image information (G
Starts notification of image identification number and transfer image size to ET IMAGE INFORMATION) command.

14 and 15 are flowcharts showing an example of the control procedure executed by the frame memory control unit 4 in the case of inter-pixel calculation. In addition, when performing the calculation between pixels,
The image A, that is, the image in which the output area is designated is transferred first from the external device.

In the figure, the band information table and the attribute information table are searched (step S171), and the data transfer size of the image A is calculated based on these information (step S172).

Next, various settings for data transfer of the image A are executed (step S173), and when the setting is completed, the band information table is read from the image information acquisition (GET IMAGE INFORMATION) command of the external device. The image identification number of the obtained output image and the data transfer size calculated in the preprocessing are notified (step S174). The external device starts the data transfer of the image A by using the notification as a trigger (step S17
Five).

In step S176, the image type is RGB24.
If it is a bit image, the process branches to step S177; otherwise, it branches to step S179.

When the image type is RGB 24-bit image data, the data of the image A transferred from the external device is sequentially stored in the band memory A (step S177). When the data transfer of the image A corresponding to the previously notified data transfer size is completed (step S178), the process proceeds to step S184.

On the other hand, if the image type is other than the RGB 24-bit image (for example, palette or bitmap image), the image data transferred from the external device is sequentially stored in the band memory B (step S179). When the transfer of the image data corresponding to the previously notified data transfer size is completed (step S18
0), the image data stored in the band memory B is sequentially read by the CPU 303, and a bitmap image is converted to an RGB 24-bit image or a palette image is converted to an RGB 24-bit image (step S181), and the conversion result is set to the band memory A. Writing to (step S182), when this conversion process is completed (step S183), the process proceeds to step S184.

The frame memory control unit 4 executes step S171.
When the processing from S178 to S178 (or S183) is completed, the data transfer processing of the image B is started.

First, the band information table and the attribute information table are searched (step S184), and the data transfer size of the image B is calculated based on the area size and the image type previously designated by the external device (step S185). .

Next, various settings for data transfer of the image B are executed (step S186), and when the settings are completed, the band information table is read from the band information table in response to the image information acquisition (GET IMAGE INFORMATION) command of the external device. The image identification number of the obtained output image and the data transfer size calculated in the preprocessing are notified (step S187). The external device triggers the notification to start data transfer of image B (step S18).
8) The received image data B is sequentially stored in the band memory B (step S189).

When the data transfer corresponding to the previously notified data transfer size is completed (step S190), the band memory
The image type of image B stored in B is determined (step S19
1), in the case of a palette or bitmap image, it is converted into an RGB 24-bit image (step S192).

Subsequently, the image processing table is searched, the designated area is converted into an address based on the pixel calculation designated by the external device, the image processing designated area and the parameter, and then stored in the band memory A and the band memory B. Read the image data and perform arithmetic processing according to the above-mentioned arithmetic expression
(Step S193). The calculation result is again written to the band memory A (step S194), and when the pixel calculation of the designated area is completed.
(Step S195), a start request is issued to the printer unit 3 (step S196), and the image data stored in the band memory A is transmitted. During this period, the image information of the external device is acquired (GET IMAGE INF
The ORMATION) command is notified of "0" for both the image identification number and the data transfer size.

When the print completion notice for one band is received from the printer unit 3 (step S197), the band number is incremented (step S198), and the process returns to step S171.

After that, by repeating the above-mentioned control procedure (C)
Realizes pattern image output.

After the output of the (C) pattern, if the output image of the (D) pattern does not exist in the output area of the frame memory control section 4, the printer section 3 sends the recording paper by the amount corresponding to the bandwidth. To notify. During this period, the image information acquisition (GET IMAGE INFORMATION) command of the external device is notified of "0" for both the image identification number and the data transfer size, and the image data transfer is not executed.

When the paper feed is completed up to the output band position of the (D) pattern, the frame memory control unit 4 acquires the image information (G
The ET IMAGE INFORMATION) command is notified of the image identification number and the transfer image size, and the image data is received in the order of the image identification numbers registered in the band information table.

FIG. 16 is a flow chart showing an example of the control procedure executed by the frame memory control unit 4. The control flow for each image type and image processing content is as described above.
Since it is the same as the case of (A) pattern output, its detailed description is omitted.

In the figure, in accordance with the layout information obtained by searching the band information table and the attribute information table (step S201), the image data is sequentially written in the band memory A (step S202), and the output image is output on the band memory A. Form an equivalent image.

When the data transfer of one image is completed, the next image information is retrieved from the band information table and the attribute information table (step S203) and registered in the table.
It is determined whether or not all the images for one band have been written in the band memory A (step S204). If the writing is completed, the process proceeds to step S205, and if not completed, the process returns to step S202. If the image identification number in the band information table is “0”, it is determined that the writing is completed.

Subsequently, a start request is issued to the printer unit 3 (step S205), and the image data stored in the band memory A is transmitted to the printer unit 3. During this time, in response to the image information acquisition (GET IMAGE INFORMATION) command of the external device,
Notify "0" for both the image identification number and the data transfer size.

When a print completion notice for one band is received from the printer unit 3 (step S206), the band number is incremented (step S207), the process returns to step S201, and the above control procedure is repeated to repeat the (D) pattern. Realize the output of.

The image designated by the external device is formed on the recording paper by the series of flow described above. The table contents held by the frame memory control unit 4 are held until the initialization command is received from the external device. Therefore, when outputting multiple images, the external device sends the control information for the second and subsequent images to the frame memory control unit 4.
Need not be notified.

[0111]

[Modification] In the embodiment described above, the band memory A
In the above description, the band memory B is used as a buffer for image processing and the image output to the printer unit 3, and the band memory B is used as a buffer for receiving image data. With a configuration that can be used for reception and for image output, for example, image processing such as pixel calculation and spatial filter processing for an image for which spatial filter processing or layout processing has been completed can be speeded up.

Further, in the above-described embodiment, the memory space of 16 Mbytes is theoretically divided into the band memories A and B, but if the band memories A and B are independently accessed from the CPU 303, a bus structure may be used. Since image data can be received from an external device while the image is being output from the band memory A to the printer unit 3, higher speed processing can be realized.

The band memories A and B, which are obtained by logically dividing the 16 Mbyte memory space into two, each have a fixed memory capacity of 8 Mbytes, which is variable for each band according to the image size. It is also possible to divide into two or more band memories. In this case, one of the band memories is used as an image output buffer to the printer unit 3,
By using the remaining multiple band memories as a buffer for image data reception or a work memory for image processing, it is possible to process pixel calculation processing between two images, bitmaps, RGB 24-bit conversion of palette images, etc. at higher speed. it can.

Further, in the above-mentioned embodiment, the control procedure for transferring and forming an image in band units has been described, but depending on the memory capacity of the mounted frame memory or the type of output device to be connected. As shown in FIGS. 17 and 18, an example of two memory control modes is possible.

FIG. 17 shows an example in which a memory capacity corresponding to the image size of one band is secured for image formation and the remaining memory space is used for image data registration, as in the above-described embodiment. is there.

The external device transfers the image data after notifying the layout information and the image processing information. All the transferred image data are registered in the image data registration memory, and the print command is used as a trigger, and the image from the memory area in which the corresponding image is registered is based on the processing table in the same manner as described in the above embodiment. Read the data and form the output image band by band. In this case, during the printing operation, the image data transfer control with the external device does not intervene, and since the registered image is held unless there is an instruction from the external device, even when outputting the same image multiple times, Since it is not necessary to transfer control information and image data again, faster image output control can be realized.

Further, FIG. 18 is an example in which a memory capacity equivalent to one page of recording paper is secured and the remaining memory space is used as a buffer for image data communication.

Similar to the control flow described in the above embodiment, the external device issues the print command after notifying the layout information and the image processing information, and thereafter outputs the image data in accordance with the notification from the frame memory control unit 4. Forward. The frame memory control unit 4 writes the result of executing the corresponding image processing in the page memory, and when the output image for one page is completed, issues a start notification to the printer unit 3. The image formed on the page memory is retained unless instructed by an external device, so even when outputting the same image multiple times, there is no need to transfer control information and image data again, and a faster image output is possible. Control can be realized.

Further, in the case of the example shown in FIG. 18, since the output to the printer unit 3 is started after the output image for one page is completed, the printer as the image forming apparatus is arranged in the band unit shown in the above-mentioned embodiment. The present invention is not limited to printers that form images, but can also be applied to printers that form images in page units such as electrophotographic systems and thermal systems, and image output devices such as copying machines.

Further, in the above embodiment, the example in which the CPU 303 executes various image processing operations has been described.
It is also possible to have a configuration provided with a processor dedicated to image processing operations such as P (Digital Signal Processor), and have the DSP or the like execute various image processing operations.

Further, in the above-described embodiment, the example in which the image data formed in the band memory A is output to the printer has been described, but the output destination is an external storage device such as a hard disk or a magneto-optical disk. Good. By doing so, for example, when the same processed image is output to the printer unit 3 multiple times, the command and the image data may be transferred from the external storage device without being transferred again from the external device, so that a faster image Output control can be realized.

Further, in the above-described embodiment, the example in which the image data formed in the band memory A is output to the printer has been described, but the output destination may be a monitor device such as a CRT. In this case, it is possible to output to an output device such as a printer after confirming the processing result for the layout and the image processing information notified from the external device on the monitor, so that a print result more faithful to the user's intention is obtained. In addition to the above, it is possible to reduce unnecessary consumption of recording paper and recording medium.

Furthermore, the output destination of the image data formed in the band memory A can be an external device. That is,
The processing result for the layout and the image processing information notified from the external device can be transferred to the external device or another external device. FIG. 21 is a diagram showing an outline of the image transfer process after the print command is issued in this case.

In the figure, the external device executes step S211.
Then, a print command including an instruction to return the processing result to the external device is issued. After that, the figures up to step S215
The same sequence as S81 to S84 shown in 7 is executed, and then, in step S216, the external device issues a processed image information request command for confirming size information of the processed image. Upon receiving this command, the frame memory control unit 4 notifies the transfer size of the processed image data in step S217. The external device uses this notification reception as a trigger to perform step S218.
Starts transfer (reception) of processed image data with. After that, by repeating steps S213 to S218, all the processing results of the frame memory control unit 4 are transferred to the external device.

As a result, even if the external device does not have the image processing function, the external device can hold the desired image processing result. For example, the external device can store the desired image processing result. The processed image can be output and the processed image data can be stored in a connected external storage device or the like.

As described above, according to this embodiment,
Even if the installed memory has a small capacity and the processing capability of the external device that is connected and communicates is low, it is possible to perform advanced image processing such as pixel calculation, composition, and layout processing using a plurality of image data.

Furthermore, according to this embodiment, RGB multi-value, CYM
Even if there are multiple formats such as K multi-value, palette, and bitmap, it is possible to execute desired image processing after converting all formats.

The present invention may be applied to either a system composed of a plurality of devices or an apparatus composed of a single device.

It goes without saying that the present invention can also be applied to the case where it is achieved by supplying a program to a system or an apparatus.

[0130]

As described above, according to the present invention,
It is possible to provide an image processing apparatus and a method thereof that can realize high-level image processing such as pixel calculation, composition, layout processing of multiple image data, format conversion of image data, and the like with a minimum required memory capacity.

The present invention can also provide an image processing apparatus and method for realizing high-level image processing with a simple structure.

[0132]

[Brief description of drawings]

FIG. 1 is a block diagram showing a configuration example of an image processing apparatus according to an embodiment of the present invention,

FIG. 2 is a block diagram showing a configuration example of an image processing apparatus according to an embodiment of the present invention,

FIG. 3 is a block diagram showing a detailed configuration of a frame memory and a control unit shown in FIGS. 1 and 2.

FIG. 4 is a schematic view of a digital color copying machine to which the embodiment is applied,

FIG. 5 is a diagram showing an example of an output area,

FIG. 6 is a diagram showing an example of a spatial filter table for an M × N region,

FIG. 7 is a diagram showing an outline of an image output process after issuing a print command,

FIG. 8 is a diagram showing an example of a band information table,

FIG. 9 is a diagram showing an example of area information,

FIG. 10 is a diagram showing an example of an image formed by this embodiment,

FIG. 11 is a flowchart showing an example of a control procedure executed by a frame memory control unit,

FIG. 12 is a flowchart showing an example of a control procedure executed by a frame memory control unit,

FIG. 13 is a flowchart showing an example of a control procedure executed by a frame memory control unit,

FIG. 14 is a flowchart showing an example of a control procedure executed by a frame memory control unit in the case of inter-pixel calculation.

FIG. 15 is a flowchart showing an example of a control procedure executed by a frame memory control unit in the case of inter-pixel calculation.

FIG. 16 is a flowchart showing an example of a control procedure executed by a frame memory control unit,

FIG. 17 is a diagram showing another control mode of the frame memory,

FIG. 18 is a diagram showing a second example of another control mode of the frame memory;

FIG. 19 is a block diagram showing a configuration example of an image forming apparatus,

20 is a diagram showing an example of a printing operation in the printer section shown in FIG.

FIG. 21 is a diagram showing an outline of an image output process after issuing a print command.

[Explanation of symbols]

 1 Scanner section 2 Controller section 3 Printer section 4 Frame memory control section

Claims (24)

[Claims] 1. An image processing method for processing image data in predetermined units, comprising a first receiving step of receiving control information relating to at least one image from an external device, and the image data of the image to the external device. A request step of requesting in the predetermined unit, a second receiving step of receiving the image data from the external device, and a storing step of storing the image data received in the second receiving step in a predetermined area of a storage unit. An image data stored in a predetermined area of the storage means based on the control information, and a processing step of storing the processing result in another predetermined area of the storage means. Processing method. 2. The image processing method according to claim 1, wherein the control information includes image layout information and image processing information. 3. An image processing apparatus for processing image data in predetermined units, wherein after receiving control information regarding at least one image from an external device, the external device is requested for image data of the image in the predetermined unit. Then, a communication unit that receives the image data from the external device, a storage unit that stores the image data received by the communication unit in a predetermined area, and a storage unit that stores the image data in the predetermined area of the storage unit based on the control information. An image processing apparatus for processing the processed image data and storing the processing result in another predetermined area of the storage means. 4. The image processing apparatus according to claim 3, wherein the control information includes image layout information and image processing information. 5. The image forming apparatus further comprises a forming unit that forms an image based on the image-processed image data stored in the storage unit, and the communication unit is connected to the external device according to the formation of the image by the forming unit. 4. The image processing apparatus according to claim 3, wherein the image data of the predetermined unit is requested again. 6. The image processing apparatus according to claim 5, wherein the predetermined unit is a width of an image that the forming unit can form at one time. 7. The communication means transmits the image-processed image data stored in the storage means to the external device, and when the transmission is completed, requests the external device again for the image data of the predetermined unit. 4. The image processing device according to claim 3, wherein 8. An image processing method for processing image data in predetermined units, comprising a first receiving step of receiving control information relating to at least one image from an external device, and the image data of the image to the external device. A request step of requesting in a predetermined unit, a second receiving step of receiving the image data from the external device, and a setting for selecting an image processing procedure based on the control information and setting an image data storage area of a storage unit. A step of storing the image data received in the second receiving step in the first area of the storage unit set in the setting step; and storing the image data based on the image processing procedure set in the setting step. The image data stored in the first area of the storage means is processed, and the processing result is stored in the second area of the storage means set in the setting step. An image processing method, comprising: a processing step of storing. 9. The image processing method according to claim 8, wherein the control information includes image layout information and image processing information. 10. An image processing apparatus for processing image data in a predetermined unit, wherein after receiving control information relating to at least one image from an external device, the external device is requested for image data of the image in the predetermined unit. Then, the communication means for receiving the image data from the external device, the image processing procedure is selected based on the control information, the image data storage area of the storage means is set, and the image data received by the communication means is set. Control means for storing in the set first area of the storage means, and processing the image data stored in the first area of the storage means based on the image processing procedure set by the control means, An image processing apparatus comprising: a processing unit that stores a processing result in a second area of the storage unit set by the control unit. 11. The control unit calculates a transfer unit of image data based on the control information, and the communication unit receives each unit based on the control information in response to a request from the external device. Identification information for specifying image data to be transmitted and a transfer unit calculated by the control means are notified, and image data corresponding to the identification information is received from the external device in the transfer unit. The image processing device according to claim 10. 12. The image processing apparatus according to claim 11, wherein the control information includes image layout information and image processing information. 13. The apparatus further comprises a forming unit that forms an image based on image data stored in a second area of the storage unit, and the communication unit is the external device according to the image formation by the forming unit. 12. The image processing apparatus according to claim 11, wherein the image data of the transfer unit is requested again to the. 14. The communication means transmits the image data stored in the second area of the storage means to the external device, and when the transmission is completed, requests the external device again for the image data of the transfer unit. The image processing device according to claim 11, wherein 15. An image processing method for processing image data in predetermined units, comprising a first receiving step of receiving control information relating to at least one image from an external device, and the image data of the image to the external device. A request step of requesting in the predetermined unit, a second receiving step of receiving the image data from the external device, and a processing step of processing the image data received in the second receiving step based on the control information. An output step of outputting the image data processed in the processing step to the external device. 16. The image processing method according to claim 15, wherein the control information includes image layout information and image processing information. 17. An image processing apparatus for processing image data in a predetermined unit, wherein after receiving control information regarding at least one image from an external device, the image data of the image is requested to the external device in the predetermined unit. Then, a communication unit that receives the image data from the external device, a processing unit that processes the image data received by the communication unit based on the control information, and an output of the processing unit is output to the external device. An image processing apparatus comprising: an output unit. 18. The image processing apparatus according to claim 17, wherein the control information includes image layout information and image processing information. 19. The image forming apparatus further comprises a forming unit that forms an image based on the image-processed image data stored in the storage unit, and the communication unit is connected to the external device according to the formation of the image by the forming unit. 18. The image processing apparatus according to claim 17, wherein the image data of the predetermined unit is requested again. 20. The image processing apparatus according to claim 19, wherein the predetermined unit is a width of an image that the forming unit can form at one time. 21. The communication unit transmits the image-processed image data stored in the storage unit to the external device, and when the transmission is completed, requests the external device again for the image data of the predetermined unit. The image processing device according to claim 17, wherein 22. An image processing apparatus for processing image data divided for each band, wherein layout and image processing information regarding at least one image are communicated with an external device, and the image data is externally supplied for each band. A communication unit that communicates as requested to the device and receives the image data of the image, and the image data received by the communication unit is temporarily stored in a predetermined area for each band of the storage unit, and the image stored in the predetermined area An image processing apparatus, comprising: a processing unit that performs image processing on data based on the layout and image processing information, and stores a processing result in another predetermined area of the storage unit. 23. The image processing according to claim 22, wherein the processing means selects an image processing procedure according to the layout and the image processing information and sets a storage area of the storage means. apparatus. 24. A calculation unit that calculates a transfer unit of image data based on a layout and image processing information received by the communication unit, wherein the communication unit responds to a request from the external device. Identification information specifying image data to be received for each division unit based on the image information and the transfer unit calculated by the calculating unit are notified, and the image data corresponding to the identification information is transmitted from the external device. The image processing apparatus according to claim 22 or 23, wherein the image processing apparatus receives the image data in units of transfer.