JP5697544B2 - Image processing apparatus and image processing method - Google Patents

Description

  Embodiments described herein relate generally to an image processing apparatus and an image processing method for correcting color misregistration caused by vibration received from the outside.

  2. Description of the Related Art Conventionally, in an electrophotographic image forming apparatus, an image reading unit (scanner unit) reads an original to generate RGB signals, and the RGB signals are used to perform character identification, ACS (Auto Color Select) processing, and the like. It is carried out. The ACS determines whether or not the document is a color document, and counts the color pixels (chromatic pixels) from the RGB signals, and determines that the document is a color document when there are color pixels equal to or greater than a predetermined threshold. . By the way, in a conventional image processing apparatus, character identification and ACS determination are performed after performing color misregistration correction processing in the main scanning direction in order to suppress erroneous determination of character identification and ACS.

  However, conventional color misregistration correction only corrects color misregistration in the main scanning direction, that is, lens aberration. Therefore, there is a problem that the color shift in the sub-scanning direction, that is, the color shift due to vibration received from the outside cannot be corrected. In addition, when character identification, ACS determination, or image processing is performed based on RGB signals that cause color misalignment due to external vibration, erroneous identification or image quality degradation is caused.

JP 11-266372 A

  The problem to be solved by the invention is an image processing apparatus that performs image processing such as identification processing, ACS determination, compression processing, enlargement / reduction, etc. after correcting color misregistration in the main scanning direction and sub-scanning direction caused by external vibration It is to provide an image processing method.

The image processing apparatus according to the embodiment includes an image reading unit that reads an original to generate R (red), G (green), and B (blue) signals, and a plurality of pixels near the target pixel including the target pixel. An average value of the RGB signals is calculated, a regression line (y = ax + b) between the average value and the R signal, a regression line (y = cx + d) between the average value and the G signal, the average value and the B Correction of the target pixel by obtaining a regression line (y = ex + f) with the signal and substituting the average value of the RGB signals of the target pixel into the respective linear expressions defined by the slope and intercept of these regression lines R signal after, G signals after the correction by obtaining a B signal after correction, the color shift correction unit you correct the color shift caused by external vibration, RGB signal color misregistration correction by the color shift correction unit Input by the image reading unit. Image read Te is provided a determining section for determining a color document or a monochrome document, and a control unit for controlling the image forming processing according to the determination result in the determination unit.

1 is a configuration diagram of an image forming apparatus including an image processing apparatus according to an embodiment. 1 is a block diagram illustrating a configuration of a preprocessing unit of an image processing apparatus according to an embodiment. 1 is a block diagram illustrating a configuration of a post-processing unit of an image processing apparatus according to an embodiment. 1 is a block diagram illustrating an example of a color misregistration correction unit of an image processing apparatus according to an embodiment. FIG. 5 is a diagram illustrating a color misregistration correction operation of a color misregistration correction unit according to an embodiment. The figure which shows the pixel adjacent to the attention pixel in one Embodiment. The figure explaining the color shift correction operation | movement of G signal in one Embodiment. The figure explaining the color shift correction operation | movement of the B signal in one Embodiment.

  Embodiments for carrying out the invention will be described below with reference to the drawings. In addition, in each figure, the same code | symbol is attached | subjected about the same location.

(First embodiment)
FIG. 1 is a configuration diagram of an image forming apparatus including an image processing apparatus according to an embodiment. In FIG. 1, an image forming apparatus 10 is, for example, an MFP (Multi-Function Peripherals), a printer, a copying machine, or the like, which is a multifunction peripheral. In the following description, an MFP will be described as an example.

  An automatic document feeder (ADF) 11, a transparent document table 12, and an operation panel 13 are provided on the upper part of the image forming apparatus (MFP) 10. A plurality of paper feeders 14 are provided below the MFP 10, and a tray 15 on which paper is stacked is provided on the side of the MFP 10.

  The MFP 10 includes a scanner unit 20 and a printer unit 30 below the ADF 12. The scanner unit 20 reads an image of a document, and the printer unit 30 forms an image on a recording medium such as paper based on the read image data. In the following description, an example in which the paper S is used as a recording medium will be described.

  The scanner unit 20 constitutes an image reading unit, and includes a carriage 21, an exposure lamp 22, a reflection mirror 23, a condenser lens 24, a CCD (Charge Coupled Device) line sensor 25, and a laser unit 26. The scanner unit 20 scans and reads a document sent by the ADF 11 or a document placed on the document placing table 12, and reads light from an exposure lamp 22 provided on the carriage 21 from below the document placing table 12. Irradiate. Then, the reflected light from the original is taken into the CCD line sensor 25 through the reflecting mirror 23 and the condenser lens 24.

  The CCD line sensor 25 includes three line sensors in which blue, green and red color filters are arranged on the light receiving surface, and a shift register provided corresponding to each line sensor. Light incident on each line sensor is photoelectrically converted to output image information. The image information is output as an analog signal, the analog signal is converted into a digital signal, and further subjected to image processing to generate image data (RGB signal). The image data is supplied to the laser unit 26, and a laser beam is generated from the laser unit 26 according to the image data.

  The printer unit 30 includes a rotatable photosensitive drum 31. The photosensitive drum 31 is an image carrier, and has a charging device 32, a developing device 33, a transfer device 34, a cleaning device 35, and a static elimination lamp 36 around the photosensitive drum 31 in the rotation direction. The laser beam from the laser unit 26 is applied to the photosensitive drum 31, and an electrostatic latent image corresponding to the image information of the original is formed on the outer peripheral surface of the photosensitive drum 31.

  When image formation starts, the charging device 32 discharges at a predetermined discharge position, and charges the outer peripheral surface of the rotating photosensitive drum 31 uniformly in the axial direction. Next, the photosensitive drum 31 is irradiated with a laser beam from the laser unit 26, and an electrostatic latent image is formed and held on the outer peripheral surface of the photosensitive drum 31.

  A developer (for example, toner) is provided on the outer peripheral surface of the photosensitive drum 31 from the developing device 33, and the electrostatic latent image is converted into a toner image and developed. The toner image formed on the outer peripheral surface of the photosensitive drum 31 is electrostatically transferred onto the paper S by the transfer device 34. The sheet S is conveyed from the sheet feeding device 14 via the conveyance path 371. Foreign matter such as paper residue remaining on the photosensitive drum 31 is removed by a cleaning device 35 disposed in a subsequent process of the transfer device 34. The static elimination lamp 36 removes residual charges on the outer peripheral surface of the photosensitive drum 31.

  The configuration of the printer unit 30 is not limited to the illustrated example, and other methods such as a method using an intermediate transfer belt may be used. In FIG. 1, the image forming unit is illustrated in a simplified manner. However, when a color image is formed, a color image forming unit for black, magenta, cyan, yellow, or the like is provided. The MFP 10 can also process print data input from a PC (Personal computer), etc., and output it to the printer unit 30 for printing.

  The sheet S on which the toner image is transferred by the printer unit 30 is conveyed to the fixing device 38 via the conveyance path 372. The fixing device 38 arranges the fixing roller and the pressure roller facing each other, and conveys the paper S between the fixing roller and the pressure roller, thereby fixing the toner image transferred onto the paper S to the paper S. The sheet S on which the toner image is fixed and image formation is completed is discharged to the tray 15 by the discharge roller 39.

  FIG. 2 is a block diagram illustrating a configuration of the preprocessing unit 40 of the image processing apparatus according to the embodiment. In FIG. 2, RGB signals that are image data from the image reading unit 20 are input to the color misregistration correction unit 43 via the shading correction unit 41 and the interline correction unit 42.

  The image reading unit 20 includes a CCD line sensor 25 and reads an original to generate an RGB signal. However, the CCD line sensor 25 is shifted from the reading position because each line sensor is physically separated. Has occurred. Therefore, the shading correction unit 41 corrects CCD sensitivity unevenness, light source unevenness, and the like, and the interline correction unit 42 corrects a physical line shift of the CCD.

  The image data that has undergone the shading correction and interline correction processing is input to the color misregistration correction unit 43. Although details of the color misregistration correction unit 43 will be described later, the color misregistration correction unit 43 corrects the color misregistration in the sub-scanning direction caused by external vibration, and the RGB signal subjected to the color misregistration correction is supplied to an ACS (Auto Color Select) determination unit 44. input.

The ACS determination unit 44 counts color pixels (chromatic pixels) from the RGB signals corrected for color misregistration, and if there are color pixels equal to or greater than a predetermined threshold (th1, th2, th3), the document is a color original. judge. Specifically, the pixel is counted as a color pixel when the following condition is satisfied. That is,
| RG |> th1 and | GB |> th2 and | BR |> th3
In this case, the corresponding pixel is counted as a color pixel. When color misregistration occurs due to vibration or the like, color misregistration occurs in an image that is originally a black line, and may be determined as a color pixel. In order to suppress such erroneous determination, an image signal after color misregistration correction is input to the ACS determination unit 44.

  The output signal of the color misregistration correction unit 43 is processed by the enlargement / reduction unit 45, the filter unit 46, and the compression unit 47, and the compressed image data is stored in the storage unit (page memory) 48. The compressed image stored in the page memory 48 is saved in a storage device (for example, the HDD 49) as necessary. The enlargement / reduction unit 45 performs a scaling process such as enlargement or reduction of the image. By inputting the output signal of the color misregistration correction unit 43 to the enlargement / reduction unit 45, the image signal whose color misregistration has been corrected is enlarged / reduced, so that the color misregistration is not noticeable.

  The filter unit 46 performs noise removal of the image data. Further, by compressing the image data by the compression unit 47 and storing it in the page memory 48 or the HDD 49, the capacity of the page memory 48 or the HDD 49 can be reduced.

  The compression unit 47 performs image compression using a compression method such as JPEG compression. Image compression uses an image signal after color misregistration correction, thereby improving the compression rate for achromatic images such as black lines and black characters and reducing the amount of data. In other words, if the image is compressed before correcting the color misregistration, in the case of an achromatic image, the data representing the color will contain unnecessary data where it should be zero, and the compression rate will deteriorate. Thus, the compression rate can be improved.

  Note that the determination result by the ACS determination unit 44 is supplied to the CPU 60. The CPU 60 constitutes a control unit that controls the overall operation of the MFP 10. The CPU 60 controls the image forming process. For example, when the ACS determination unit 44 determines that the document is a color document, the CPU 60 operates the black, magenta, cyan, and yellow color image forming units of the MFP 10. Also, parameters for color conversion processing in the color conversion unit 52 described later are set. When the ACS determination unit 44 determines that the document is a monochrome document, the CPU 60 stops the operation of the magenta, cyan, and yellow color image forming units and operates only the black (K) image forming unit. Control.

  FIG. 3 is a block diagram showing the configuration of the post-processing unit 50 that post-processes the image data read from the page memory 48. In FIG. 3, the image signal output from the page memory 48 is input to the decoding unit 51 where decompression processing and decoding processing are performed, and the RGB signal is output from the decoding unit 51. The output RGB signal is input to the color conversion unit 52 and the identification processing unit 53. The color conversion unit 52 converts RGB signals into C (cyan), M (magenta), and Y (yellow) signals.

The identification processing unit 53 includes an edge detection unit 54, an achromatic color detection unit 55, and an identification signal generation unit 56. The edge detection unit 54 detects the edge of the image using a known Sobel filter or the like. The achromatic color determination unit 55 obtains | RG | and | GB | signals from the RGB signals, compares them with predetermined threshold values (th1, th2), and determines an achromatic color under the following conditions. For example,
| RG | <th1 and | GB | <th2
If it is, it will be determined as an achromatic color, otherwise it will be determined as a chromatic color. The achromatic color detection unit 55 receives the image signal after the color misregistration correction, thereby improving the achromatic color detection accuracy.

  The identification signal generation unit 56 determines black characters, color characters, and non-characters using the detection result of the edge detection unit 54 and the detection result of the achromatic color detection unit 55. That is, if there is an edge and an achromatic color, it is determined as a black character, if there is an edge and a chromatic color, it is determined as a color character, and if there is no edge, it is determined as a non-character.

  The image signal (C, M, Y) after color conversion by the color conversion unit 52 is output to the printer unit 30 which is an image output unit via the filter unit 57, the background processing unit 58, and the inking / gradation processing unit 59. Is done. The identification signal generated by the identification signal generation unit 56 is supplied to the filter unit 57, the background processing unit 58, and the inking / gradation processing unit 59.

  The filter unit 57 performs processing of a low pass filter (LPF) and a high pass filter (HPF). For example, the pixel identified by the identification signal from the identification signal generator 56 is emphasized by performing HPF processing on the pixel identified as a signal indicating a character, and the LPF processing is performed on a pixel identified as a signal indicating a photograph (non-character). I do.

  The background processing unit 58 detects the background level of the image data, removes only the background level data, and performs processing so as not to affect other data. For example, when performing color copying, if the original is yellow, the background is removed. The inking / gradation processing unit 59 performs inking processing (black correction) on the Y, M, and C image data, and converts the inked image data Y, M, C, and K (black). Gradation processing (for example, dither processing) is performed on the image, and the result is output to the printer unit 30.

  FIG. 4 is a block diagram illustrating an example of the color misregistration correction unit 43. The color misregistration correction unit 43 receives an RGB signal from the inter-line correction unit 42, calculates an average value (k) of the RGB signal, and a regression line based on the output from the average calculation unit 431. A regression line calculation unit 432 for calculating the correction color signal generation unit 433. The corrected color signal generation unit 433 corrects the RGB signal based on the regression line y calculated by the regression line calculation unit 432 and the average value k from the average calculation unit 431, and corrects the RGB signal (here, R ′ for convenience). G′B ′ signal) is output.

  Next, a color misregistration correction operation by the color misregistration correction unit 43 will be described with reference to FIG. FIG. 5A shows an example of an RGB signal in a portion where color misregistration occurs. If there is no color shift, the RGB signals should overlap, but the RGB signal shifts due to the color shift. FIG. 5B shows an example of the RGB signal (R′G′B ′) after color misregistration correction. 5A and 5B, the horizontal axis indicates the pixel position, and the vertical axis indicates the signal value. Comparing (a) and (b) of FIG. 5, the color misalignment width is W1 before correction, but after color misalignment correction, the color misalignment width is reduced to W2.

  Hereinafter, a method for correcting color misregistration will be described using the R signal as an example. Focusing on the R signal in FIG. 5 (a) and assuming that the point in the circle (P) of the R signal is the target pixel, the three average values (k) of RGB at the same position as the five neighboring pixels of the target pixel are When plotted, the result is as shown in FIG. FIG. 6 is a diagram showing neighboring pixels (five pixels) that are adjacent in the horizontal direction with the target pixel (shaded portion) as the center.

  From the above plot, a regression line is calculated as shown in FIG. 5C, and it can be seen that the pixel of interest P is away from the regression line. FIG. 5D shows the R ′ signal when this point P is approximated to a regression line. The approximation method to the regression line uses the slope and intercept of the linear expression obtained from the regression line calculated as the ideal state. Equation (1) shows a linear expression of the regression line.

y = ax + b (1)
In the equation (1), a is a slope and b is an intercept. When approximating the regression line, the slope and intercept of equation (1) are used, and RGB average 3 is substituted for x in equation (1). As a result, the output y becomes the color signal R ′ after color misregistration correction.

  By performing the above processing on the G and B signals in the same manner, each color approaches an ideal state, and color misregistration correction can be realized. That is, as shown in FIGS. 7 and 8, regression lines y = cx + d and y = ex + f used for correcting the color misregistration of the G signal and the B signal are obtained, and the three average values k of RGB are substituted for x. Thus, corrected color signals G ′ and B ′ can be obtained as shown in FIG.

  In the example described above, the description is made in one dimension as shown in FIG. 6. However, the processing range is set to two dimensions of 5 × 5, for example, so that the document is scanned in both main scanning and sub-scanning directions. Color misregistration can be corrected. In addition, since processing is performed based on the correlation between each RGB signal and the RGB signal 3 average value k, there is no color change, and in the case of a chromatic color, only the color shift of the edge portion is corrected and the chromatic color is corrected. The color of is preserved. For this reason, it is not necessary to switch processing for both chromatic and achromatic conditions.

  According to the embodiment described above, it is possible to improve the determination accuracy by performing the ACS determination, the enlargement / reduction, compression, and the identification processing after correcting the color shift caused by the external vibration. can do.

  In addition, although several embodiment of this invention was described, these embodiment is shown as an example and is not intending limiting the range of invention. These embodiments can be implemented in various other forms, and various omissions, replacements, and changes can be made without departing from the scope of the invention. These embodiments and modifications thereof are included in the invention described in the claims and equivalents thereof as well as included in the scope and gist of the invention.

10. Image forming apparatus (MFP)
11: Image forming apparatus body 20: Scanner unit (image reading unit)
30. Printer unit (image output unit)
41 ... Shading correction unit 42 ... Inter-line correction unit 43 ... Color deviation correction unit 431 ... Average calculation unit 432 ... Regression line calculation unit 433 ... Correction color signal generation unit 44 ... ACS determination unit 45 ... Enlargement / reduction unit 46 ... Filter unit 47 ... Compression unit 48 ... Page memory 49 ... Storage device (HDD)
50 ... Post-processing unit 51 ... Decoding unit 52 ... Color conversion unit 53 ... Identification processing unit 54 ... Edge detection unit 55 ... Achromatic color detection unit 56 ... Identification signal generation unit 57 ... Filter unit 58 ... Background processing unit 59 ... Inking / Gradation processing unit 60 CPU

Claims (10)

An image reading unit that reads an original and generates R (red), G (green), and B (blue) signals;
An average value of the RGB signals is calculated for a plurality of pixels near the target pixel including the target pixel, a regression line (y = ax + b) between the average value and the R signal, and the average value and the G signal A regression line (y = cx + d), a regression line (y = ex + f) between the average value and the B signal is obtained, and the RGB of the pixel of interest is expressed in a linear expression defined by the slope and intercept of these regression lines. R signal after correction of the pixel of interest by assigning an average value of the signal, G signal after correction by obtaining a B signal after correction, the color shift correction unit correct the color shift caused by external vibration ,
A determination unit that inputs an RGB signal in which color misregistration is corrected by the color misregistration correction unit and determines whether the image read by the image reading unit is a color document or a monochrome document;
A control unit that controls image forming processing according to a determination result in the determination unit;
An image processing apparatus comprising: An image reading unit that reads an original and generates R (red), G (green), and B (blue) signals;
An average value of the RGB signals is calculated for a plurality of pixels near the target pixel including the target pixel, a regression line (y = ax + b) between the average value and the R signal, and the average value and the G signal A regression line (y = cx + d), a regression line (y = ex + f) between the average value and the B signal is obtained, and the RGB of the pixel of interest is expressed in a linear expression defined by the slope and intercept of these regression lines. R signal after correction of the pixel of interest by assigning an average value of the signal, G signal after correction by obtaining a B signal after correction, the color shift correction unit correct the color shift caused by external vibration ,
A compression unit that compresses the RGB signal in which the color shift is corrected by the color shift correction unit;
A post-processing unit that processes the image data from the compression unit and outputs the processed image data to the image output unit;
An image processing apparatus comprising:   The image processing apparatus according to claim 2, further comprising: an enlargement / reduction unit that enlarges / reduces the color-shift-corrected RGB signal before the compression unit compresses the RGB signal.   The post-processing unit includes a storage unit that stores the image data compressed by the compression unit, and a decoding unit that decompresses the image data stored in the storage unit, and processes the image data from the decoding unit, and The image processing apparatus according to claim 2, wherein the image processing apparatus outputs the image to an image output unit. An image reading unit that reads an original and generates R (red), G (green), and B (blue) signals;
An average value of the RGB signals is calculated for a plurality of pixels near the target pixel including the target pixel, a regression line (y = ax + b) between the average value and the R signal, and the average value and the G signal A regression line (y = cx + d), a regression line (y = ex + f) between the average value and the B signal is obtained, and the RGB of the pixel of interest is expressed in a linear expression defined by the slope and intercept of these regression lines. R signal after correction of the pixel of interest by assigning an average value of the signal, G signal after correction by obtaining a B signal after correction, the color shift correction unit correct the color shift caused by external vibration ,
An RGB signal that has been corrected for color misregistration by the color misregistration correction unit, and an identification processing unit that identifies whether or not each pixel unit is a character pixel;
Image processing apparatus comprising, a post-processing unit for post-processing the RGB signals after correcting the color deviation in accordance with the identification result of the identification processor.   The image processing apparatus according to claim 5, wherein the identification processing unit includes an edge detection unit and an achromatic color detection unit, and identifies black characters, color characters, and non-characters based on detection results of the edge detection unit and the achromatic color detection unit. Scan the document and generate R (red), G (green), and B (blue) signals,
An average value of the RGB signals is calculated for a plurality of pixels near the target pixel including the target pixel, a regression line (y = ax + b) between the average value and the R signal, and the average value and the G signal A regression line (y = cx + d), a regression line (y = ex + f) between the average value and the B signal is obtained, and the RGB of the pixel of interest is expressed in a linear expression defined by the slope and intercept of these regression lines. By substituting the average value of the signal to obtain the corrected R signal, corrected G signal, and corrected B signal of the pixel of interest, the color shift caused by external vibration is corrected,
An RGB signal in which the color misregistration is corrected is input, and it is determined whether the read image is a color document or a monochrome document,
An image processing method for controlling an image forming process according to the determination result. Scan the document and generate R (red), G (green), and B (blue) signals,
An average value of the RGB signals is calculated for a plurality of pixels near the target pixel including the target pixel, a regression line (y = ax + b) between the average value and the R signal, and the average value and the G signal A regression line (y = cx + d), a regression line (y = ex + f) between the average value and the B signal is obtained, and the RGB of the pixel of interest is expressed in a linear expression defined by the slope and intercept of these regression lines. By substituting the average value of the signal to obtain the corrected R signal, corrected G signal, and corrected B signal of the pixel of interest, the color shift caused by external vibration is corrected,
Compresses the RGB signal obtained by correcting the color shift,
An image processing method in which the compressed image data is processed by a post-processing unit and output to an image output unit. The image processing method according to claim 8, wherein the RGB signal whose color misregistration is corrected is enlarged or reduced before the compression. Scan the document and generate R (red), G (green), and B (blue) signals,
An average value of the RGB signals is calculated for a plurality of pixels near the target pixel including the target pixel, a regression line (y = ax + b) between the average value and the R signal, and the average value and the G signal A regression line (y = cx + d), a regression line (y = ex + f) between the average value and the B signal is obtained, and the RGB of the pixel of interest is expressed in a linear expression defined by the slope and intercept of these regression lines. By substituting the average value of the signal to obtain the corrected R signal, corrected G signal, and corrected B signal of the pixel of interest, the color shift caused by external vibration is corrected,
Receives the RGB signal obtained by correcting the color shift, to identify whether the character pixels in each pixel unit,
Image processing method for post-processing by the post-processing unit of RGB signals after correcting the color shift in response to the identification result.

Images