JP2009105492A - Image processing apparatus and image forming apparatus - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image processing apparatus which is adaptive to the case that, for example, a document on which a pattern etc., of a predetermined color is printed, is subjected to handwriting of the same color as the predetermined color in the image processing apparatus, which reads a document, containing handwritten characters or graphics, and processes-obtained image data, and to provide an image forming apparatus. <P>SOLUTION: As for image data, associated with a document containing handwritten characters or a pattern, an image processing unit, adjusts the hue, saturation, or lightness of a part (c) adjacent to the handwriting part (w), so as to make the handwriting part (w) and the part (c) adjacent to the handwriting area different in hue, saturation, or lightness. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to an image processing apparatus that reads a document and processes the obtained image data, and an image forming apparatus including the image processing apparatus.

  Along with the advancement of image processing technology, the performance of printing processing of a copying machine, a multifunction machine, etc. having a so-called copying function is being improved. As such an image processing technique applied to the printing process, for example, an error diffusion process can be cited.

  The error diffusion process is a process for expressing a richer color tone using a limited color tone. For example, when printing a photograph with a device that can express only two colors of white or black, such as a black and white printer, by adjusting the pixel density of white (white dot) and black (black dot) per area, An intermediate color such as gray can be expressed, and the human eye recognizes the image as having a pseudo smooth change.

Further, in Patent Document 1, when performing the above-described error diffusion processing, an image processing method that improves the contrast of a halftone image by suppressing the generation of white spots in a black background and the generation of black spots in a white background. Is provided.
JP 2001-1111831 A

  On the other hand, when handwritten writing using a black ballpoint pen, pencil, or the like is performed on a printing paper on which a black pattern, symbol, or character (hereinafter referred to as a pattern) is printed, even on the black pattern or the like Even if the handwritten writing is partially performed, the handwritten writing can be sufficiently visually recognized with the naked eye. However, when this is copied in black and white, the black pattern or the like and the handwritten area composed of the handwritten writing are displayed as the same black, and the handwritten area on the black pattern or the like cannot be visually recognized. there were. Such a problem cannot be solved by the image processing method of Patent Document 1.

  The present invention has been made in view of such circumstances, and an object of the present invention is to read a manuscript including handwritten characters or figures, and to obtain the image data obtained from the edge of the handwritten region or the handwritten region. Adjustment means for adjusting the hue, saturation, or brightness of a predetermined range adjacent to the document, for example, a case where a handwritten of the same color as the predetermined color is printed on a document on which a pattern of a predetermined color is printed. An object of the present invention is to provide an image processing apparatus and an image forming apparatus.

  An image processing apparatus according to the present invention reads a document including handwritten characters or figures, and processes the obtained image data. In the image processing apparatus, the image data is handwritten with handwritten characters or figures. It is characterized by comprising adjusting means for adjusting the hue, saturation or brightness of a predetermined range adjacent to the edge of the region or the handwritten region.

  In the present invention, the adjustment means adjusts the hue, saturation, or lightness of a predetermined range adjacent to the edge of the handwritten area or the handwritten area with respect to the image data relating to the document including the handwritten characters or figures. The hue, saturation, or brightness of the handwritten area and the predetermined range adjacent to the handwritten area are made different.

  The image processing apparatus according to the present invention includes a determination unit that determines whether the hue of the handwritten region is the same as or similar to the hue of the outer region surrounding the handwritten region based on the image data, and the determination result of the determination unit The adjustment means is configured to adjust the hue, saturation, or brightness.

  In the present invention, the determination means determines whether the hue of the handwritten region is the same as or similar to the hue of the outer region surrounding the handwritten region based on the image data (for example, R, G, B signals), Based on the determination result of the determination unit, the adjustment unit adjusts the hue, saturation, or brightness of a predetermined range adjacent to the handwritten region or the edge of the handwritten region.

  The image processing apparatus according to the present invention is characterized in that the outer region is a range of one or a plurality of dots adjacent to the handwritten region.

  In the present invention, the determination unit determines whether the hue of the range of one or more dots adjacent to the handwriting region is the same as or similar to the hue of the handwriting region, and based on the determination result of the determination unit. The adjusting means adjusts the hue, saturation, or brightness.

  The image processing apparatus according to the present invention includes an instruction receiving unit that receives an instruction relating to execution of hue, saturation, or brightness adjustment by the adjusting unit, and when the instruction receiving unit receives the instruction, the adjusting unit It is configured to adjust hue, saturation, or brightness.

  In the present invention, when the instruction receiving unit receives the instruction from the user, the adjustment unit adjusts the hue, saturation, or brightness of a predetermined range adjacent to the handwritten region or the edge of the handwritten region. However, if the instruction receiving unit does not receive the instruction, the adjusting unit does not perform the adjustment.

  The image processing apparatus according to the present invention displays, on the display unit, an image based on image data predicted when the adjustment is performed before the adjustment of hue, saturation, or brightness by the adjustment unit. And a display means.

  In the present invention, the display unit displays the image on the display unit before the hue, saturation, or lightness is adjusted by the adjustment unit, and the user refers to the image to check the hue, saturation, or Instructs the brightness adjustment.

  An image forming apparatus according to the present invention includes the image processing apparatus according to any one of the above-described present inventions, and is configured to form an image on a sheet based on image data processed by the image processing apparatus. It is characterized by being.

  In the present invention, the image data processed by the image processing apparatus is printed on, for example, printing paper.

  According to the present invention, since the adjustment unit that adjusts the hue, saturation, or brightness of the predetermined range adjacent to the handwritten region or the edge of the handwritten region is provided, for example, printing in which a pattern of a predetermined color is printed It is possible to cope with a case where a handwriting of the same color as the predetermined color is written on the sheet.

  According to the present invention, when the determination unit determines that the hues of the handwritten region and the outer region surrounding the handwritten region are the same or similar, the adjustment unit determines the predetermined range adjacent to the handwritten region or the edge of the handwritten region. Since the hue, saturation, or lightness of the portion is adjusted, it is possible to cope with a case where a handwriting of the same color as the predetermined color is written on a print sheet on which a pattern of a predetermined color is printed.

  According to the present invention, it is possible to perform processing without waste. That is, when handwriting of the same color as the predetermined color is written on a print sheet on which a pattern or the like of a predetermined color is printed, whether or not the handwriting area can actually be visually recognized is not a wide range but the handwriting area. The determination means determines whether the hue of only one or a plurality of dots adjacent to the handwritten area and the hue of the handwritten area are the same or similar. Therefore, more substantial processing can be performed.

  According to the present invention, only when the instruction receiving unit receives an instruction related to execution of hue, saturation, or brightness adjustment from the user, the adjustment unit is a predetermined range adjacent to the handwritten region or an edge of the handwritten region. Since the hue, saturation, or brightness is adjusted, it is possible to sufficiently reflect the user's intention by entrusting the determination to the execution of the adjustment to the user.

  According to the present invention, the display unit displays an image based on image data predicted when the adjustment is performed on the display unit before the hue, saturation, or brightness is adjusted by the adjustment unit. The user can instruct adjustment of hue, saturation, or brightness with reference to the image displayed on the display unit.

  According to the present invention, even when a handwriting of the same color as the predetermined color is written on a print sheet on which a pattern or the like of a predetermined color is printed, the image processing device applies an edge of the handwriting region or the handwriting region. An image based on image data in which the hue, saturation, or lightness of the predetermined range adjacent to the handwritten region and the predetermined range adjacent to the handwritten region is adjusted is performed by adjusting the hue, saturation, or lightness of the adjacent predetermined range. Since it is formed on the top, the handwritten region is easily visually recognized in the formed image.

(Embodiment 1)
Hereinafter, Embodiment 1 of the present invention will be described in detail with reference to the drawings. For convenience of explanation, the multifunction peripheral will be described as an example of the image processing apparatus and the image forming apparatus according to the first embodiment. FIG. 1 is a block diagram showing a main configuration of a multifunction machine 1 according to Embodiment 1 of the present invention. The multi-function device 1 is a copy mode that reads an image of a document and prints it on a print sheet, a printer mode that receives an image from the outside and prints it on a print sheet, a scanner mode that reads an image of a document and transmits it to the outside, It is possible to selectively perform a facsimile mode or the like in which an image is read and transmitted, or an original image is received and printed on printing paper.

  The multifunction device 1 according to the first embodiment includes an operation unit 4 having an image reading unit 2 such as an image scanner that reads an image of a document, an input unit 4a such as an input key, and a display unit 4b such as a liquid crystal display panel. An image forming unit 6 having a memory 6a for temporarily storing image data and a printing unit (LSU: Laser Scanning Unit) 6b for forming an image on printing paper, and a communication unit such as a LAN or an interface for communicating with the outside 10, a FAX modem 11 connected to a telephone network, a hard disk drive (hereinafter referred to as a hard disk) 12 for storing image data, and an image processing unit 3 for performing image processing on the image data read to the memory 6a A management unit 14 such as a flash memory for storing a control program and various settings, and the above-described components in the apparatus according to the control program A control unit 8 such as a CPU (Central Processing Unit) for controlling

  The control unit 8 controls each component of the multifunction device 1. For example, an operation instruction is received from the input unit 4a such as a touch panel or an input key, processing according to the received operation instruction is executed, information on the operation state of the multifunction device 1 is displayed on the display unit 4b, and necessary information is displayed. Notify the user. Further, the management unit 14 stores information related to operation settings of the respective components, and the control unit 8 controls the operation of the entire multifunction device 1 based on the information.

  The image reading unit 2 is a reading unit that optically reads image data of an original, and includes a light source that irradiates light to the original to be read, an image sensor such as a CCD (Charge Coupled Device) 2a, and the like. In the image reading unit 2, a reflected light image from a document set at a predetermined reading position is formed on the image sensor and output as an analog electric signal (image data). The analog electrical signal output from the image reading unit 2 is temporarily stored in the memory 6a.

  The analog electrical signal obtained by the image reading unit 2 is input to the image processing unit 3 via the memory 6a. The image processing unit 3 generates digital image data based on the analog electrical signal, performs processing according to the type of image, and then generates image data for output. The generated image data is output to the image forming unit 6. Further, in the first embodiment of the present invention, the image processing unit 3 performs image processing in accordance with an instruction from the control unit 8, and even if the handwriting unit w and the surrounding unit s described later are the same color, It can be so.

  The image forming unit 6 includes the memory 6a and the printing unit 6b as described above, and the printing unit 6b forms an image on a printing sheet such as printing paper or an OHP film based on the image data output from the memory 6a. The memory 6a of the image forming unit 6 includes, for example, a DRAM (Dynamic Random Access Memory), and temporarily stores image data from the image reading unit 2, the image processing unit 3, the communication unit 10, or the hard disk 12. Further, the printing unit 6b of the image forming unit 6 includes a photosensitive drum, a charger that charges the photosensitive drum to a predetermined potential, and a laser beam that emits laser light according to image data received from the outside. A laser writing device for generating an electrostatic latent image, a developer for supplying toner to the electrostatic latent image formed on the surface of the photosensitive drum for visualization, and a toner image formed on the surface of the photosensitive drum on the paper A transfer device or the like (not shown) for transferring is provided, and an image is formed on a print sheet by an electrophotographic method. In addition to image formation by an electrophotographic method using a laser writing apparatus, an image formation may be performed by an inkjet method, a thermal transfer method, a sublimation method, or the like.

  The hard disk 12 stores image data of a document read by the CCD 2a of the image reading unit 2, external image data received by the communication unit 10, and image data processed by the image processing unit 3. In accordance with the received instruction, the control unit 8 controls the image forming unit 6 or the communication unit 10 to output image data stored in the hard disk 12.

  FIG. 2 is a flowchart showing a processing procedure of the control unit 8 of the multifunction machine 1 according to the first embodiment of the present invention. For convenience of explanation, the multifunction device 1 has a color copy function, and the processing procedure of the control unit 8 in the copy mode will be described as an example.

  FIG. 3 is an exemplary diagram illustrating an example of a document to be copied. The original to be copied has a rhombus pattern d printed on the printing paper P, and the pattern d is handwritten similar to a V-shape. The pattern d and the handwriting w are the same black. (In order to distinguish between the pattern d and the handwriting w, the pattern d is black-hatched with a small interval.) In addition, an area related to handwriting in the manuscript is referred to as a handwriting part w, and is adjacent to the handwriting part w. A region in a range corresponding to five dots is referred to as a peripheral portion s.

  When the user operates the input unit 4a of the operation unit 4, the control unit 8 receives a copy instruction (S101). The control unit 8 instructs the image reading unit 2 to read a document. In accordance with an instruction from the control unit 8, the image reading unit 2 reads a document set at a predetermined reading position (S102). The document image read by the image reading unit 2 is input as an analog signal to the image processing unit 3 and subjected to analog / digital conversion to obtain image data relating to the document.

  Next, the control unit 8 determines whether or not handwriting is included in the document based on the image data (S103). A known technique is used to determine whether or not handwriting is included based on the image data relating to the document. For example, a method for determining whether or not the character is a handwritten character by extracting the thickness, linearity, and angle of the stroke, and determining the handwritten character using the shape and size of the binarized data, and the linearity Any of a method, a method of judging handwritten characters using the linearity of binarized data, or a method of binarizing image data and using the pattern may be used.

  When it is determined that the handwriting is not included (S103: NO), the control unit 8 proceeds to the process of S107. On the other hand, when it is determined that the handwriting is included (S103: YES), the control unit 8 determines the hues of the handwritten portion w and the surrounding portion s based on the R, G, and B signals of the image data of the document. (S104). For example, the R, G, and B analog signals are digitally converted into 256 gradations, respectively, and the hue is determined by comparing the digitally converted R, G, and B signals. Moreover, the control part 8 determines whether the hue of the handwritten part w and the surrounding part s is the same based on the discrimination | determination result of the hue of the handwritten part w and the surrounding part s (S105).

  When the control unit 8 determines that the hues of the handwritten part w and the surrounding part s are not the same (S105: NO), the process proceeds to S107. On the other hand, when the control unit 8 determines that the hues of the handwritten part w and the surrounding part s are the same (S105: YES), the image processing unit 3 is adjacent to the handwritten part w, for example, in a range corresponding to two dots. Adjustment is performed to increase the brightness of the region (hereinafter referred to as an adjacent portion) (S106).

  Next, the control unit 8 instructs the image forming unit 6 to print an image based on the image data in which the brightness of the adjacent portion is adjusted to be high. That is, the image data processed by the image processing unit 3 is output to the memory 6a, and the printing unit 6b forms an image on the printing paper based on the image data input to the memory 6a (S107).

  FIG. 4 is an exemplary diagram illustrating an example of an image formed on the printing paper P2 based on the image data in which the brightness of the adjacent portion c is adjusted to be high in the first embodiment. When comparing FIG. 3 and FIG. 4, the brightness of the adjacent portion c surrounding the handwritten portion w is adjusted to be high, so that the handwritten portion w and the pattern d have the same hue, but are visually recognized and distinguished. I can do it.

(Embodiment 2)
FIG. 5 is a flowchart showing a processing procedure of the control unit 8 of the multifunction machine 1 according to the second embodiment of the present invention.

  When the user operates the input unit 4a of the operation unit 4, the control unit 8 receives a copy instruction (S201). The control unit 8 instructs the image reading unit 2 to read the document, and the image reading unit 2 reads the document set at a predetermined reading position (S202), and image data relating to the document is obtained.

  Next, the control unit 8 determines whether or not handwriting is included in the document based on the image data (S203). When it is determined that the handwriting is not included (S203: NO), the control unit 8 proceeds to the process of S207. On the other hand, when it is determined that the handwriting is included (S203: YES), the control unit 8 determines the hues of the handwritten portion w and the surrounding portion s based on the R, G, and B signals of the image data of the document. (S204). Moreover, the control part 8 determines whether the hue of the handwritten part w and the surrounding part s is the same based on the discrimination | determination result of the hue of the handwritten part w and the surrounding part s (S205).

  When the control unit 8 determines that the hues of the handwritten part w and the surrounding part s are not the same (S205: NO), the process proceeds to S207. On the other hand, when the control unit 8 determines that the hues of the handwritten part w and the surrounding part s are the same (S205: YES), the image processing unit 3 has a range corresponding to an edge portion of the handwritten part w, for example, three dots. Adjustment is performed to increase the brightness of a region (hereinafter referred to as an edge) (S206).

  Next, in accordance with an instruction from the control unit 8, the image data processed by the image processing unit 3 is output to the memory 6a, and the printing unit 6b forms an image on the printing paper based on the image data input to the memory 6a (S207). ).

  FIG. 6 is an exemplary diagram illustrating an example of an image formed on the printing paper P3 based on the image data in which the brightness of the edge is adjusted to be high in the second embodiment. The same parts as those in the first embodiment are denoted by the same reference numerals, and detailed description thereof is omitted. When comparing FIG. 3 and FIG. 6, the brightness of the edge portion o of the handwritten portion w is adjusted to be high, so that the handwritten portion w and the pattern d can be visually recognized and distinguished even though they have the same hue. I can do it.

(Embodiment 3)
FIG. 7 is a flowchart showing a processing procedure of the control unit 8 of the multifunction machine 1 according to the third embodiment of the present invention.

  When the user operates the input unit 4a of the operation unit 4, the control unit 8 receives a copy instruction (S301). The control unit 8 instructs the image reading unit 2 to read the original, and the image reading unit 2 reads the original set at a predetermined reading position (S302), and image data relating to the original is obtained.

  Next, the control unit 8 determines whether or not handwriting is included in the document based on the image data (S303). When it is determined that the handwriting is not included (S303: NO), the control unit 8 proceeds to the process of S309. On the other hand, when it is determined that the handwriting is included (S303: YES), the control unit 8 determines the hues of the handwritten part w and the surrounding part s based on the R, G, and B signals of the image data of the document. (S304). Moreover, the control part 8 determines whether the hue of the handwritten part w and the surrounding part s is the same based on the discrimination | determination result of the hue of the handwritten part w and the surrounding part s (S305).

  When the control unit 8 determines that the hues of the handwritten part w and the surrounding part s are not the same (S305: NO), the process proceeds to S309. On the other hand, when the control unit 8 determines that the hues of the handwritten part w and the surrounding part s are the same (S305: YES), the image is predicted when adjustment is performed to increase the brightness of the edge o of the handwritten part w. An image based on the data is displayed on the display unit 4b of the operation unit 4 (S306), and the user is asked for permission to perform adjustment to increase the brightness of the edge o of the handwriting unit w. For example, a question “Do you want to execute processing for handwritten visual recognition?” And selection buttons “YES” and “NO” are displayed on the display unit 4 b of the operation unit 4.

  Next, the control unit 8 determines whether or not an instruction relating to “YES” has been received (S307). When the user operates the “NO” selection button and the control unit 8 accepts an instruction related to “NO” (S307: NO), the process proceeds to S309. On the other hand, when the user operates the selection button “YES” and the control unit receives an instruction “YES” (S307: YES), the image processing unit 3 sets the brightness of the edge o of the handwriting unit w. Adjustment to increase is performed (S308).

  Next, in accordance with an instruction from the control unit 8, the image data processed by the image processing unit 3 is output to the memory 6a, and the printing unit 6b forms an image on the printing paper based on the image data input to the memory 6a (S309). ).

  In Embodiment 1 thru | or 3, although the case where the brightness of the adjacent part c or the edge part o was adjusted when the hue of the handwritten part w and the surrounding part s was the same was demonstrated, it is not restricted to this, For example, You may comprise so that the saturation of the adjacent part c or the edge part o may be adjusted, and you may comprise so that the hue of the adjacent part c or the edge part o may be changed to what is called a complementary color.

  In the first to third embodiments, the description has been given of the case where all the handwritten portions w are in the area of the pattern or the like. However, the present invention is not limited to this. For example, a case where the handwritten part w straddles a region such as a pattern and a region such as a non-pattern may occur. In such a case, the lightness, saturation, or hue of the adjacent portion c or the edge portion o only when the ratio of the portion having the same hue as the handwritten portion w in the entire peripheral portion is equal to or greater than a predetermined ratio (for example, 50%). The brightness, saturation, or hue of the adjacent part c or edge part o may be adjusted only for the part that has the same hue as the handwritten part w in the entire peripheral part. good.

  In the first to third embodiments, when the hues of the handwritten part w and the surrounding part s are the same, the brightness, saturation, or hue of the adjacent part c or the edge part o of the handwritten part w is adjusted. Although the configured example has been described, the present invention is not limited to this. For example, when the R signal, the G signal, and the B signal of the peripheral portion s are within a predetermined range with respect to the R signal, the G signal, and the B signal of the digitally converted handwritten portion, the colors of the handwritten portion w and the peripheral portion s May be determined to be similar, and the brightness, saturation, or hue of the adjacent portion c or the edge portion o may be adjusted.

  In the first to third embodiments, when the handwriting part w and the surrounding part s have the same hue, the adjacent part c is adjacent to the handwritten part w in the process of adjusting the brightness of the adjacent part c or the edge part o. In the above description, the case where the edge o is the edge portion of the range corresponding to the three dots of the handwriting part w has been described as an example. You may comprise so that the width | variety of the adjacent part c (or edge part o) may be changed according to the hue relationship of w and the adjacent part c (or edge part o). For example, when the hue of the handwritten part w is black and the hue of the adjacent part c (or edge o) is white, the difference between the two hues can be clearly recognized, so the adjacent part c (or edge part) Even if the width of o) is narrowed, the handwritten part w can be easily visually recognized.

  Moreover, in the above, although the case where it comprised so that the width | variety of the adjacent part c (or edge part o) might be changed according to the hue relationship between the handwritten part w and the adjacent part c (or edge part o), this was demonstrated. The width of the adjacent portion c (or edge o) is changed according to the degree of saturation or brightness of the hue between the handwritten portion w and the adjacent portion c (or edge o). May be. For example, when the saturation (or lightness) of the hue of the handwritten part w is low and the saturation (or lightness) of the hue of the adjacent part c (or edge o) is high, the handwritten part w and the adjacent part c Since the difference in hue saturation (or lightness) from (or edge o) can be clearly recognized, the handwritten part w can be easily visually recognized even if the width of the adjacent part c (or edge o) is reduced. I can do it.

1 is a block diagram illustrating a configuration of a main part of a multifunction machine according to Embodiment 1 of the present invention. 4 is a flowchart illustrating a processing procedure of a control unit of the multifunction peripheral according to the first embodiment of the present invention. It is an illustration which illustrates an example of the original which should be copied. 6 is an exemplary diagram illustrating an example of an image formed on a print sheet based on image data in which brightness of an adjacent portion is adjusted to be high in Embodiment 1. FIG. 7 is a flowchart illustrating a processing procedure of a control unit of a multifunction machine according to Embodiment 2 of the present invention. In Embodiment 2, it is an illustration figure which shows an example of the image formed on the printing paper based on the image data which adjusted the brightness of the edge part highly. 10 is a flowchart illustrating a processing procedure of a control unit of a multifunction machine according to Embodiment 3 of the present invention.

Explanation of symbols

2 Image reading unit 3 Image processing unit 4b Display unit 6 Image forming unit 6a Memory 6b Printing unit 8 Control unit 14 Management unit P Printing paper c Adjacent part o Edge w Handwriting part s Surrounding part

Claims (6)

In an image processing apparatus that reads a document including handwritten characters or figures and processes the obtained image data,
Image processing comprising adjusting means for adjusting the hue, saturation, or lightness of a predetermined range adjacent to an edge of a handwritten area composed of handwritten characters or figures or the handwritten area for the image data apparatus. Based on the image data, comprising a determination means for determining whether the hue of the handwritten region is the same as or similar to the hue of the outer region surrounding the handwritten region,
The image processing apparatus according to claim 1, wherein the adjustment unit is configured to adjust a hue, saturation, or brightness based on a determination result of the determination unit.   The image processing apparatus according to claim 2, wherein the outer area is a range of one or a plurality of dots adjacent to the handwriting area. Comprising an instruction receiving means for receiving an instruction relating to execution of adjustment of hue, saturation or brightness by the adjusting means;
The image processing apparatus according to claim 1, wherein when the instruction receiving unit receives the instruction, the adjustment unit adjusts hue, saturation, or brightness. A display unit;
Display means for displaying on the display unit an image based on image data predicted when the adjustment is performed before the adjustment of hue, saturation, or brightness by the adjustment means. The image processing apparatus according to claim 4. An image processing apparatus according to any one of claims 1 to 5, comprising:
An image forming apparatus configured to form an image on a sheet based on image data processed by the image processing apparatus.

Images