US10546220B2 - Image processing apparatus that generates halftone image, image processing method, and storage medium - Google Patents
Image processing apparatus that generates halftone image, image processing method, and storage medium Download PDFInfo
- Publication number
- US10546220B2 US10546220B2 US16/178,074 US201816178074A US10546220B2 US 10546220 B2 US10546220 B2 US 10546220B2 US 201816178074 A US201816178074 A US 201816178074A US 10546220 B2 US10546220 B2 US 10546220B2
- Authority
- US
- United States
- Prior art keywords
- threshold value
- cell
- smallest
- image processing
- matrix
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06K—GRAPHICAL DATA READING; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
- G06K15/00—Arrangements for producing a permanent visual presentation of the output data, e.g. computer output printers
- G06K15/02—Arrangements for producing a permanent visual presentation of the output data, e.g. computer output printers using printers
- G06K15/18—Conditioning data for presenting it to the physical printing elements
- G06K15/1867—Post-processing of the composed and rasterized print image
- G06K15/1872—Image enhancement
- G06K15/1881—Halftoning
Definitions
- the present invention relates to a technique of pseudo halftone processing by a dither method.
- An electrophotographic image forming apparatus performs printing by forming a latent image by exposing a photoconductor drum with a light-emitting element, such as a laser beam, developing the latent image by toner, which is electrified color materials, and transferring and fixing the developed toner onto a printing medium. It is frequent for such an image forming apparatus to be capable of producing an output only at a low tone level in units of pixels. Consequently, in order to reproduce a halftone representation of print-target image data stably and faithfully, processing to reduce the number of tone levels in units of pixels is performed by performing pseudo halftone processing that represents multiple tone levels by using a plurality of pixels having two tone levels for multi-value image data representing multiple tone levels in units of pixels.
- Japanese Patent Laid-Open No. 2008-227770 has disclosed a method of pseudo halftone processing that improves reproducibility of a highlight portion (low-density portion).
- a thin line or character (in particular, a small point character having an area whose width is narrow) in a highlight portion has a small number of corresponding lit pixels in image data represented at a low tone level after pseudo halftone processing. Because of this, depending on the drawing position of a thin line or character, there is a possibility that drawing failure, such as drawing omission, occurs in a highlight portion.
- the method described in Japanese Patent Laid-Open No. 2008-227770 does not take into consideration the drawing failure of a thin line or character such as this. Consequently, an object of the present invention is to provide an image processing apparatus capable of preventing deterioration in quality of a thin line or character, which may result from pseudo halftone processing.
- the image processing apparatus includes: a memory device storing at least a first threshold value matrix as a threshold value matrix used in halftone processing; and a controller having at least one processor which executes a set of instructions or having at least one circuitry, the controller being configured to act as: a generation unit configured to generate halftone image data in which a dot pattern is formed for each cell, which a unit representing a tone level, by performing halftone processing using the first threshold value matrix for multi-value input image data, and in the first threshold value matrix, threshold values for forming the dot pattern are arranged for each cell and further, in threshold value arrangement for each cell of the first threshold value matrix, the second smallest threshold value within the cell is arranged at a position neighboring a position at which the smallest threshold value within the cell is arranged, and the position at which the second smallest threshold value is arranged is different between adjacent cells.
- FIG. 1 is a block diagram showing an example of a configuration of an image forming system including an image processing apparatus according to a first embodiment
- FIG. 2 is a block diagram showing an example of a configuration of a controller of an image forming apparatus
- FIG. 3 is a flowchart showing a flow of rendering processing of a rendering unit
- FIG. 4 is a flowchart showing a flow of processing of an image processing unit
- FIG. 5A to FIG. 5C are diagrams for explaining pseudo halftone processing by a dither method
- FIG. 6 is a diagram showing an example of a cell of a general dither matrix
- FIG. 7 is a diagram showing an example of a configuration of a general dither matrix
- FIG. 8A and FIG. 8B are diagrams showing the way a binary bitmap is generated by pseudo halftone processing using a general dither matrix
- FIG. 9A to FIG. 9C are diagrams showing the way a yellow thin line having a width of three pixels is printed by a monochrome printer
- FIG. 10 is a diagram for explaining cells making up a dither matrix of different direction growth according to the first embodiment
- FIG. 11 is a diagram showing an example of a configuration of the dither matrix of different direction growth according to the first embodiment
- FIG. 12A to FIG. 12C are diagrams for explaining pseudo halftone processing using the dither matrix of different direction growth according to the first embodiment
- FIG. 13 is a diagram for explaining cells making up a dither matrix of different direction growth according to a second embodiment
- FIG. 14 is a diagram showing an example of a configuration of the dither matrix of different direction growth according to the second embodiment
- FIG. 15A to FIG. 15C are diagrams for explaining pseudo halftone processing using the dither matrix of different direction growth according to the second embodiment
- FIG. 16 is a diagram showing an example of a density correction test chart
- FIG. 17 is a flowchart showing a flow of processing until a density correction table is generated
- FIG. 18A to FIG. 18D are diagrams for explaining a relationship between a current density characteristic and a target density characteristic
- FIG. 19 is a flowchart showing a flow of dither matrix selection processing.
- FIG. 20A and FIG. 20B are diagrams showing another example of a dither matrix of different direction growth.
- a threshold value table called a dither matrix is used. Then, the pixel value of each pixel of image data and the corresponding threshold value within the threshold value table are compared and the target pixel is set to on (lit) or off (unlit). In this manner, in the dither method, a dot pattern is formed for each cell, which is a unit representing a tone level, and pseudo halftone image (halftone image) is generated.
- FIG. 1 is a block diagram showing an example of a configuration of an image forming system including an image processing apparatus according to the first embodiment.
- a host computer hereinafter, referred to as PC
- an image forming apparatus 101 are connected via a network 106 .
- the connection method a network is applied, but this is not limited.
- the connection method it is also possible to apply the serial transmission scheme, such as USB, the parallel transmission scheme, such as Centronics and SCSI, and so on.
- the PC 100 has functions of a personal computer.
- the PC 100 transmits and receives data via the network 106 .
- the PC 100 transmits drawing data via a printer driver to the image forming apparatus 101 .
- the image forming apparatus 101 has a printer 104 , which is an image output device, an operation unit 102 configured to display a plurality of keys for a user to give instructions and various kinds of information to be reported to a user, and a scanner 105 that reads a document image. Further, the image forming apparatus 101 has a controller 103 in charge of the operation control of the entire image forming apparatus 101 .
- FIG. 2 is a block diagram showing an example of the configuration of the controller 103 of the image forming apparatus 101 .
- the controller (also called image processing apparatus) 103 has a CPU 201 , a RAM 202 , a ROM 203 , an HDD (Hard Disk Drive) 204 , a rendering unit 207 , an image processing unit 208 , and a density correction table generation unit 210 .
- the controller 103 has an operation unit I/F 205 , a network I/F 206 , a printer I/F 209 , and a scanner I/F 211 .
- the controller 103 is connected with the PC 100 , an external image forming apparatus and so on via the network 106 .
- controller 103 input and output drawing data and device information.
- the configuration of the controller 103 is not limited to the configuration shown in FIG. 2 .
- the HDD 204 and the like may be arranged outside the controller 103 .
- the CPU 201 centralizedly controls access to various devices being connected based on control programs and the like stored in the ROM 203 and at the same time, centralizedly controls various kinds of processing, such as image processing, performed inside the controller 103 .
- the RAM 202 is a system work memory for the CPU 201 to operate.
- the RAM 202 is also used as a memory for temporarily storing image data, such as drawing data and bitmap data.
- the RAM 202 includes an SRAM that stores stored data also after the power source is turned off and a DRAM from which stored contents are deleted after the power source is turned off.
- the ROM 203 stores boot programs of devices, and the like.
- the HDD 204 is a hard disk drive and stores system software, image data, and a threshold value matrix (in the present embodiment, dot concentration type dither matrix) used for pseudo halftone processing, to be described later. Further, in the present embodiment, a case where the threshold value matrix is stored in the HDD 204 is illustrated, but the case is not limited to this. For example, it is also possible to store the threshold value matrix in a nonvolatile memory possessed by the image processing unit 208 .
- the operation unit I/F 205 is an interface for connecting with the operation unit 102 .
- the operation unit I/F 205 outputs image data that is displayed on the operation unit 102 to the operation unit 102 . Further, the operation unit I/F 205 acquires information input to the operation unit 102 from the operation unit 102 .
- the network I/F 206 is connected to the network 106 and performs transmission and reception of information, such as drawing data and image data, with another device via the network 106 .
- the scanner I/F 211 is connected to the scanner 105 and receives image data obtained by the scanner 105 reading a document image from the scanner 105 .
- the rendering unit 207 receives intermediate data generated based on PDL code data, which is drawing data transmitted from the PC 100 or the like, and generates contone (multi-value) image bitmap data from the intermediate data.
- the image bitmap data is represented simply as an image bitmap.
- the density correction table generation unit 210 generates a density correction table for correcting the pixel value of an image bitmap.
- the image processing unit 208 receives an image bitmap generated by the rendering unit 207 and performs image processing for the image bitmap while referring to attribute data attached to the image bitmap.
- the image bitmap for which image processing has been performed is output to the printer 104 via the printer I/F 209 .
- FIG. 3 is a flowchart showing a flow of rendering processing of the rendering unit 207 .
- the rendering unit 207 acquires drawing data transmitted from the PC 100 or the like (step S 301 ).
- the rendering unit 207 analyzes the drawing data and determines which attribute of character, line, graphics, and image the drawing data has (step S 302 ).
- the drawing data is information on character drawing represented by a character type, character code and so on
- the rendering unit 207 determines that that drawing data has the character attribute.
- the drawing data is commands of line drawing represented by a coordinate point, length, and thickness
- the rendering unit 207 determines that the drawing data has the line attribute.
- the rendering unit 207 determines that the drawing data has the graphics attribute. In the case where the drawing data is information on image drawing represented by bitmap data, the rendering unit 207 determines that the drawing data has the image attribute. Further, the rendering unit 207 classifies the character attribute into small point character and the other according to character size.
- the rendering unit 207 forms a pixel pattern that is drawn in accordance with the processing resolution of the controller from the information on the drawing data and generates an image bitmap indicating information (contone value) on the color drawn in each pixel (step S 303 ).
- the information on the color is represented as color information.
- the rendering unit 207 generates attribute bitmap data storing the attribute analyzed at step S 302 so as to correspond to each pixel of the image bitmap and terminates the processing (step S 304 ).
- the attribute bitmap data is represented simply as an attribute bitmap.
- the generated image bitmap and attribute bitmap are stored in the RAM 202 or the HDD 204 , or sent to the image processing unit 208 .
- FIG. 4 is a flowchart showing a flow of processing of the image processing unit 208 .
- the image processing unit 208 acquires the image bitmap and the attribute bitmap generated by the rendering unit 207 in accordance with the processing resolution of the controller from the rendering unit 207 (step S 401 ). In the case where the image bitmap and the attribute bitmap are stored in the RAM 202 or the HDD 204 , each bitmap is read from those storage devices.
- the image processing unit 208 determines whether the printer engine is a color printer engine (step S 402 ).
- the image processing unit 208 converts the color information on each pixel of the image bitmap into the color format of a color printer engine by a color conversion LUT or matrix arithmetic operation (step S 403 ).
- the color format of a color printer engine is CMYK.
- the image processing unit 208 converts the color information into the value of K used in a monochrome printer engine (step S 404 ). At this time, the image processing unit 208 converts the color information on each pixel of the image bitmap into the value of K by using a gray conversion formula and a luminance/density conversion formula, to be described later.
- the image processing unit 208 corrects the pixel value of the image bitmap by using the density correction table of each color in accordance with the attribute information on each pixel of the attribute bitmap (step S 405 ). Finally, the image processing unit 208 selects a dither matrix in accordance with the attribute information on each pixel of the attribute bitmap and performs pseudo halftone processing by the dither method using the selected dither matrix for the pixel of the image bitmap (step S 406 ).
- the image forming apparatus 101 holds the dither matrix for each attribute.
- the image forming apparatus 101 holds a low screen ruling (for example, 106 lines) dither matrix as the dither matrix for the attribute, such as graphics, for which it is desired to stabilize the density.
- the image forming apparatus 101 holds a high screen ruling (for example, 212 lines) dither matrix as the dither matrix for the attribute, such as character, for which it is desired to suppress jaggies (roughness).
- each pixel value (contone value) of the image bitmap is converted so as to have two values and binary bitmap data (also called halftone image data) is generated.
- the binary bitmap data is simply represented as a binary bitmap.
- the generated binary bitmap is sent to the printer 104 and the printer 104 performs printing based on the binary bitmap.
- the case where the arithmetic operation of halftone processing in the image processing unit 208 is implemented by a circuit, such as an ASIC and an FPGA, is supposed.
- the case is not limited to this.
- FIG. 5A to FIG. 5C are diagrams for explaining the pseudo halftone processing by the dither method.
- the image processing unit 208 receives image data of the corresponding color from the image bitmap (color image data or monochrome image data). That is, the image processing unit 208 acquires image data of C, image data of M, image data of Y, and image data of K from the color image data. Alternatively, the image processing unit 208 acquires image data of K from the monochrome image data.
- the image processing unit 208 reads a threshold value corresponding to each pixel position of the acquired image data (input image data) from the dither matrix in which a threshold value is arranged at each pixel position. Then, the image processing unit 208 compares the pixel value and the read threshold value for each pixel position. Then, the image processing unit 208 outputs 1 (black) in the case where the pixel value is larger than the threshold value and in the other cases, outputs 0 (white), and thus, the image data is binarized. Due to this, image data having two tone levels (halftone image data) in which each pixel has values of 0 (white) and 1 (black) is generated.
- FIG. 5A an example of a dither matrix with a resolution of 600 dpi is shown.
- a dither matrix 501 shown in FIG. 5A is a general binary dither matrix used at the time of binarizing image data.
- a binary dither matrix includes one matrix.
- An N-value dither matrix used in the case of N-valuing image data includes (N ⁇ 1) matrixes.
- Image data 502 shown in FIG. 5B is data of a monochrome image of K with a resolution of 600 dpi including graphics data of the pixel value (140) and blank data of the pixel value (0).
- N-valuing image data In the case of N-valuing image data, (N ⁇ 1) matrixes in which (N ⁇ 1) threshold values are set stepwise at each pixel position are used. Then, from each of the (N ⁇ 1) matrixes, a threshold value corresponding to each pixel position is read and the pixel value and the read (N ⁇ 1) threshold values are compared for each pixel position. Then, in accordance with the comparison results, one of values between 0 and N ⁇ 1 is output. Explanation of details of the configuration of an N-value dither matrix and the N-valuing processing is omitted.
- the input image data of continuous tone is converted into image data of area gradation including a halftone dot (dot pattern) by the pseudo halftone processing.
- image data obtained by applying the pseudo halftone processing to the image data 502 is shown.
- the pseudo halftone processing is performed for the image data 502 by using the dither matrix 501 , of the pixels within the area whose pixel value is 140, for the pixel whose corresponding threshold value is smaller than 140, the pixel value is set to 1 (black).
- the pixel value is set to 0 (white). Due to this, binary bitmap data 503 as shown in FIG. 5C is generated.
- FIG. 6 is a diagram showing an example of a cell of a general dither matrix.
- a cell is a matrix of an N ⁇ M size and to each element, a value (threshold value) indicating an order of lighting a dot is set.
- a cell of a dither matrix whose screen angle is 45 degrees and screen ruling is 106 lines is illustrated.
- FIG. 6 is a cell of a matrix of an 8 ⁇ 4 size and one dot pattern is formed by lighting dots in the order from the element to which a small value is set.
- Cells 602 to 606 shown in FIG. 6 show the way a dot pattern is formed in the cell 601 . As shown in the cell 602 , lighting starts from the dot an element (1, 1) to which 0, the smallest value, is set.
- An element (x, y) indicates an element whose position in the cell is (x, y). Further, x represents a column number and y represents a row number.
- the dot of an element (2, 1) to which 1, the second smallest value, is set is lit.
- a dot pattern is formed by sequentially lighting dots.
- a tone level is represented by the size of the dot pattern and it is possible to represent 32 tone levels by the cell of an 8 ⁇ 4 size.
- FIG. 7 is a diagram showing an example of the configuration of a general dither matrix.
- a dither matrix combining the eight cells of an 8 ⁇ 4 size as shown in FIG. 6 is necessary.
- a dither matrix of a 16 ⁇ 16 size as shown in FIG. 7 in which to each element, one of values (threshold values) capable of representing 256 tone levels is set, is obtained.
- a dither matrix 701 shown in FIG. 7 represents a dither matrix in units of cells and the value within each cell indicates the lighting order of the cell.
- a dither matrix 702 represents the dither matrix 701 in units of elements. The thick line within the dither matrix 702 indicates the boundary between cells.
- the RGB data of the color signal of yellow is converted into K data (image data represented by the value of k) by the gray conversion processing and the luminance/density conversion processing at step S 404 .
- FIG. 8A shows image data 801 obtained in the case where gray conversion and luminance/density conversion are performed for the yellow graphics by the monochrome printer.
- Expression 2 is a luminance/density conversion formula.
- K 255 ⁇ Gray (expression 2)
- the yellow graphics is represented by the image data 801 having the K value (19) for each pixel value as shown in FIG. 8A .
- FIG. 8B shows a binary bitmap 802 obtained by performing pseudo halftone processing for the image data 801 by using the dither matrix 702 .
- the dither matrix 702 is arranged for the image data 801 so that a top position (0, 0) of the dither matrix 702 is located at a top position (0, 0) of the image data 801 .
- the threshold value corresponding to each pixel of the image data 801 is read from the dither matrix 702 and the pixel value of each pixel and the threshold value corresponding to each pixel are compared.
- 1 (black) is set.
- 0 white
- the dither matrix is arranged repeatedly in accordance with the size of the image data.
- the pixel value (19) of the pixel and the threshold value (64) of an element (0, 0) of the dither matrix 702 , which corresponds to the position of the pixel, are compared.
- the pixel value (19) is smaller than the threshold value (64), and therefore, to the pixel (0, 0) of the binary bitmap 802 , 0 (white) is set.
- the pixel value (19) of the pixel and the threshold value (8) of an element (2, 1) of the dither matrix 702 , which corresponds to the position of the pixel are compared.
- the pixel value (19) is larger than the threshold value (8), and therefore, to the pixel (2, 1) of the binary bitmap 802 , 1 (black) is set.
- the binary bitmap 802 shown in FIG. 8B is generated. In this manner, the yellow graphics shown in FIG. 8A becomes a binary bitmap made up of two-pixel or three-pixel dot patterns shown in FIG. 8B .
- FIG. 9A shows image data 900 including yellow thin lines having a width of three pixels.
- a plurality of thin lines 901 to 905 is arranged at positions different from one another and each thin line is a yellow color.
- FIG. 9B is a diagram showing the way the dot patterns obtained by the pseudo halftone processing using the general dither matrix 702 and the image data of the yellow thin lines are superimposed.
- the configuration of the dot patterns obtained by the pseudo halftone processing using the general dither matrix 720 is as the binary bitmap 802 shown in FIG. 8B .
- the image data 900 is superimposed on the binary bitmap 802 so that each of the positions of the yellow thin lines 901 to 905 is located at the corresponding position of the binary bitmap 802 , a bitmap 910 as shown in FIG. 9B is obtained.
- Areas 911 to 915 in the bitmap 910 indicate areas corresponding to the thin lines 901 to 905 , respectively, and the dot patterns belonging to the areas 911 to 915 are drawn as the dot patterns of the thin lines. Because of this, at the time of printing the yellow thin lines 901 to 905 having a width of three pixels by a monochrome printer, in the case where the general dither matrix 702 is used for the pseudo halftone processing, a binary bitmap 920 as shown in FIG. 9C is generated.
- dither matrix of different direction growth in order to suppress the disappearance of a thin line and the like whose density is low in the pseudo halftone processing, a dither matrix made up of cells in which a dot pattern is caused to grow in different directions is used (hereinafter, sometimes called dither matrix of different direction growth).
- the dither matrix of different direction growth is made up by combining four cells whose dot lighting order is different from one another in order to cause the dot pattern to grow in four direction, that is, the upward, downward, leftward, and rightward directions.
- FIG. 10 is a diagram for explaining cells making up a dither matrix of different direction growth according to the first embodiment.
- Each of four cells 1001 , 1011 , 1021 , and 1031 whose lighting order is different from one another is an N ⁇ M matrix and a value (threshold value) indicating the order of lighting a dot is set to each element.
- FIG. 10 cells of a dither matrix of different direction growth whose screen angle is 45 degrees and whose screen ruling is 106 lines are illustrated.
- the start position (start point) at which the dot is lit first is set to the same phase. That is, the start point of the four cells 1001 , 1011 , 1021 , and 1031 is the same and lighting of a dot is started from a position (1, 1). However, the position of the dot that is lit second is different for each of the four cells.
- the cell in which the second dot is lit in the rightward direction of the start point is called a cell of A type or a cell A.
- the cell in which the second dot is lit in the upward direction of the start point is called a cell of B type or a cell B.
- the cell in which the second dot is lit in the leftward direction of the start point is called a cell of C type or a cell C.
- the cell in which the second dot is lit in the downward direction of the start point is called a cell of D type or a cell D.
- Cells 1002 to 1006 shown in FIG. 10 indicate a formation process of a dot pattern of the cell A.
- the dot is lit at the position (1, 1) first and following this, the dot is lit at a position (2, 1) in the rightward direction thereof. After this, with the position (1, 1) as a reference, dots are lit sequentially in the clockwise direction.
- Cells 1012 to 1016 indicate a formation process of a dot pattern of the cell B.
- the dot at the position (1, 1) is lit first.
- the position of the dot that is lit second is different from the position in the cell A and the second dot is lit at a position (1, 0) in the upward direction of the start point.
- dots are lit sequentially in the clockwise direction.
- Cells 1022 to 1026 indicate a formation process of a dot pattern of the cell C.
- the dot at the position (1, 1) is lit first.
- the position of the dot that is lit second is different from the positions in the cells A and B and the second dot is lit at a position (0, 1) in the leftward direction of the start point.
- dots are lit sequentially in the clockwise direction.
- Cells 1032 to 1036 indicate a formation process of a dot pattern of the cell D.
- the dot at the position (1, 1) is lit first.
- the position of the dot that is lit second is different from the positions in the cells A, B, and C and the second dot is lit at a position (1, 2) in the downward direction of the start point.
- dots are lit sequentially in the clockwise direction.
- a dot pattern is formed by sequentially lighting dots in directions different from one another.
- the position within the cell, at which the dot is lit second is made different between adjacent cells and then in each cell, with the start point as a reference, a dot pattern is caused to grow in the clockwise direction. Due to this, for example, a dot pattern whose height is two dots is formed in the range of three dots as in the cells 1004 , 1014 , 1024 , and 1034 shown in FIG. 10 , and therefore, drawing incomplete and drawing omission of a thin line or character are made unlikely to occur.
- examples in which dots are lit in the clockwise direction in each cell are shown, but the direction at the time of sequentially lighting dots may be, for example, the counterclockwise direction.
- FIG. 11 is a diagram showing an example of a configuration of the dither matrix of different direction growth according to the first embodiment.
- a dither matrix 1101 represents the dither matrix of different direction growth according to the present embodiment in units of cells.
- a dither matrix 1102 represents the lighting order of cells of the dither matrix 1101 and the value within each cell indicates the lighting order.
- the cells A, B, C, and D are arranged by shifting the cells A, B, C, and D so that the growth directions of adjacent cells are different from one another.
- the lighting order of the 32 cells arranged in the dither matrix is set. Due to this, a dither matrix 1103 of a 32 ⁇ 32 size having threshold values capable of representing 256 tone levels is generated.
- the dither matrix 1103 represents the dither matrix 1101 in units of elements. In this manner, the dither matrix of different direction growth that suppresses the disappearance of a thin line and the like whose density is low is generated.
- FIG. 12A to FIG. 12C generation of a binary bitmap by the pseudo halftone processing using the dither matrix of different direction growth according to the first embodiment is explained.
- FIG. 12A shows a binary bitmap 1200 obtained by performing pseudo halftone processing for the image data 801 by using the dither matrix 1103 .
- the dither matrix 1103 is arranged for the image data 801 so that a top position (0, 0) of the dither matrix 1103 is located at the top position (0, 0) of the image data 801 .
- the threshold value corresponding to each pixel of the image data 801 is read from the dither matrix 1103 and the pixel value of each pixel and the threshold value corresponding to each pixel are compared.
- the binary bitmap 1200 shown in FIG. 12A is generated.
- the dither matrix is arranged repeatedly in accordance with the size of the image data.
- the binary bitmap 1200 obtained by the pseudo halftone processing using the dither matrix 1103 of different direction growth is made up of two-pixel or three-pixel dot patterns as in the case with the binary bitmap 802 shown in FIG. 8B .
- the directions (orientations) of dot patterns of adjacent cells are different from each other.
- the image data 900 including the yellow thin lines having a width of three pixels shown in FIG. 9A is printed by performing the pseudo halftone processing by the dither matrix 1103 of different direction growth is explained.
- the plurality of the thin lines 901 to 905 is arranged at the positions different from one another and each thin line is a yellow color. Consequently, in the case where the gray conversion and the luminance/density conversion described previously are performed, the pixel value of each thin line becomes 19.
- FIG. 12B is a diagram showing the way the dot patterns (dot patterns of the binary bitmap 1200 ) obtained by the pseudo halftone processing using the dither matrix 1103 of different direction growth and the image data of the yellow thin lines are superimposed.
- the image data 900 is superimposed on the binary bitmap 1200 so that each of the positions of the yellow thin lines 901 to 905 is located at the corresponding position of the binary bitmap 1200 .
- a bitmap 1210 as shown in FIG. 12B is obtained.
- Areas 1211 to 1215 in the bitmap 1210 indicate the areas corresponding to the thin lines 901 to 905 and dot patterns are included in all the areas.
- the second smallest threshold value within the cell is arranged at a position of one of eight neighborhoods adjacent to the position at which the smallest threshold value is arranged. Further, the position at which the second smallest threshold value within the cell is arranged is made to differ between adjacent cells. That is, in the present embodiment, threshold values are arranged in each cell of the dither matrix so that the direction in which the dot pattern is formed is made to differ between adjacent cells.
- the screen ruling of the dither matrix is reduced (for example, 106 lines) in order to output the density stably, it is possible to make conventional drawing failure (drawing incomplete and drawing omission of a low-density thin line and the like shown in FIG. 9C ) unlikely to occur. That is, by using the dither matrix of different direction growth according to the present embodiment in the pseudo halftone processing, it is made possible to suppress drawing failure of a low-density thin line or character (in particular, a small point character having an area whose width is narrow). Further, in the present embodiment, the start point at which the dot is lit first within each cell (cells A to D) is arranged in the same phase. Due to this, a moire resulting from a shift in position of dot patterns is made unlikely to occur.
- the dot pattern grows up to the 4 ⁇ 4 size, that is, after it becomes unnecessary to take into consideration the disappearance of a thin line and the like, the dot is lit in the same direction in each cell.
- the processing such as this in the process in which the dot pattern grows up from the 4 ⁇ 4 size to the 8 ⁇ 4 size, the occurrence of moire resulting from a shift in position of dot patterns is suppressed.
- the dither matrix of different direction growth made up of cells in which a dot pattern is caused to grow in the four directions, that is, in the upward, downward, leftward, and rightward directions is explained.
- the direction in which a dot pattern is caused to grow may be a direction other than the upward, downward, leftward, and rightward directions. Consequently, in the second embodiment, a dither matrix of different direction growth (second dither matrix of different direction growth) in which a dot pattern is caused to grow in a diagonal direction is explained.
- the dither matrix of different direction growth according to the present embodiment is made up by combining four cells whose lighting order of dots is different from one anther so that a dot pattern is caused to grown in the four directions, that is, in the diagonally downward to the right, diagonally upward to the right, diagonally upward to the left, and diagonally downward to the left directions.
- FIG. 13 is a diagram for explaining cells making up the dither matrix of different direction growth according to the second embodiment.
- Each of four cells 1301 , 1311 , 1321 , and 1331 different in lighting order is an N ⁇ M matrix and as in the case with the first embodiment, to each element, a value (threshold value) indicating lighting order of dots is set.
- the start point at which the dot is lit first is set to the same phase in the four cells. Furthermore, as in the case with the first embodiment, the position at which the dot is lit second is made to differ in the four cells. However, in the present embodiment, the second dot is lit in the diagonally downward to the right, diagonally upward to the right, diagonally upward to the left, and diagonally downward to the left directions of the start point, in place of the upward, downward, leftward, and rightward directions of the start point.
- the cell in which the second dot is lit in the diagonally downward to the right direction of the start point is called a cell of A type or a cell A.
- the cell in which the second dot is lit in the diagonally upward to the right direction of the start point is called a cell of B type or a cell B.
- the cell in which the second dot is lit in the diagonally upward to the left direction of the start point is called a cell of C type or a cell C.
- the cell in which the second dot is lit in the diagonally downward to the left direction of the start point is called a cell of D type or a cell D.
- Cells 1302 to 1306 shown in FIG. 13 show a formation process of a dot pattern of the cell A.
- the dot at a position (1, 1) is lit first and following this, a position (2, 2) in the diagonally downward to the right direction thereof is lit. After this, with the position (1, 1) as a reference, dots are lit sequentially in the clockwise direction.
- Cells 1312 to 1316 show a formation process of a dot pattern of the cell B.
- the dot at the position (1, 1) is lit first.
- the position of the dot that is lit second is different from that of the cell A and a position (2, 0) in the diagonally upward to the right direction of the start point is lit.
- dots are lit sequentially in the clockwise direction.
- Cells 1322 to 1326 show a formation process of a dot pattern of the cell C.
- the dot at the position (1, 1) is lit first.
- the position of the dot that is lit second is different from those of the cells A and B and a position (0, 0) in the diagonally upward to the left direction of the start point is lit.
- dots are lit sequentially in the clockwise direction.
- Cells 1332 to 1336 show a formation process of a dot pattern of the cell D.
- the dot at the position (1, 1) is lit first.
- a position (0, 2) in the diagonally downward to the left direction of the start point is lit.
- dots are lit sequentially in the clockwise direction.
- a dot pattern is formed by sequentially lighting dots in the directions different from one another.
- FIG. 14 is a diagram showing an example of the configuration of the dither matrix of different direction growth according to the second embodiment.
- FIG. 14 an arrangement example and a lighting order of the cells A, B, C, and D in the dither matrix of different direction growth according to the second embodiment are shown, respectively.
- a dither matrix 1401 shows the dither matrix of different direction growth according to the present embodiment in units of cells.
- a dither matrix 1402 shows the lighting order of the cells of the dither matrix 1401 and the value within each cell indicates the lighting order.
- the arrangement method of the cells in the present embodiment is the same as in the first embodiment as shown in the dither matrix 1401 .
- the cells are arranged while shifting the cells so that the growth directions of the dot patterns in adjacent cells are different from one another.
- the lighting order of the 32 cells arranged in the dither matrix is also the same as in the first embodiment as shown in the dither matrix 1402 . Due to this, a dither matrix 1403 of a 32 ⁇ 32 size, which has threshold values capable of representing 256 tone levels, is generated.
- the dither matrix 1403 shows the dither matrix 1401 in units of elements.
- FIG. 15A to FIG. 15C generation of a binary bitmap by pseudo halftone processing using the dither matrix of different direction growth according to the second embodiment is explained.
- FIG. 15A shows a binary bitmap 1500 obtained by performing pseudo halftone processing for the image data 801 by using the dither matrix 1403 .
- the dither matrix 1403 is arranged for the image data 801 so that a top position (0, 0) of the dither matrix 1403 is located at the top position (0, 0) of the image data 801 .
- the threshold value corresponding to each pixel of the image data 801 is read from the dither matrix 1403 and the pixel value of each pixel and the threshold value corresponding to each pixel are compared.
- the binary bitmap 1500 shown in FIG. 15A is generated.
- the dither matrix is arranged repeatedly in accordance with the size of the image data as described previously.
- the binary bitmap 1500 obtained by the pseudo halftone processing using the dither matrix 1403 of different direction growth is made up of two-pixel or three-pixel dot patterns as in the binary bitmap 802 shown in FIG. 8B . However, different from the binary bitmap 802 , the directions of dot patterns of adjacent cells are different from each other.
- FIG. 15B is a diagram showing the way the dot patterns (dot patterns of the binary bitmap 1500 ) obtained by the pseudo halftone processing using the dither matrix 1403 of different direction growth and the image data of the yellow thin lines are superimposed.
- the image data 900 is superimposed on the binary bitmap 1500 so that each of the positions of the yellow thin lines 901 to 905 is located at the corresponding position of the binary bitmap 1500 , a bitmap 1510 as shown in FIG. 15B is obtained.
- Areas 1511 to 1515 in the bitmap 1510 indicate the areas corresponding to the thin lines 901 to 905 and in FIG. 15B , dot patterns are included in all the areas. Consequently, in the case where the dither matrix 1403 of different direction growth is used for the pseudo halftone processing, as shown in FIG. 15C , it is possible to obtain a binary bitmap 1520 in which dot patterns are drawn in all areas 1521 to 1525 corresponding to the thin lines 901 to 905
- density adjustment is performed in order to represent ideal gradation.
- the density adjustment is performed by correcting (converting) an input pixel value by using a density correction table so that the current density characteristic measured from the input pixel value becomes a target density characteristic.
- the input pixel value is corrected so that the target density characteristic is obtained. Because of this, in the case where the current density characteristic (output density characteristic of the image forming apparatus 101 , which is measured from the input pixel value before correction) exhibits a density characteristic higher in density than the target density characteristic, the input pixel value after correction becomes smaller than the input pixel value before correction. Due to this, the number of lit pixels making up a dot pattern generated in dither processing becomes small. For example, in the case where 64 is set to the pixel value that can take a value in the range between 0 (white) and 255 (black), the dot pattern before correction is made up of lit pixels whose area ratio is 25%.
- the target density value of the pixel value 64 which is determined in advance, is set to 0.3. Further, in the case where the pixel value indicating a density value of 0.3 calculated from the current density characteristic obtained by actually performing measurement is 25, the input pixel value 64 is converted into the pixel value 25 by the density adjustment using a density correction table. Consequently, the dot pattern for the input pixel value 64 is made up of the lit pixels whose area ratio is 10%, which is the dot pattern corresponding to the pixel value 25.
- the number of lit pixels becomes small for a low-density thin line or character (in particular, a small point character having an area whose width is narrow), and therefore, no dot pattern exists depending on the drawing position. Because of this, there is a possibility that drawing incomplete or drawing omission as described above occurs for such a thin line or character. Consequently, the dither matrix of different direction growth according to the first and second embodiments is effective also for the image data after density adjustment.
- FIG. 16 is a diagram showing an example of a density correction test chart.
- the density correction test chart shown in FIG. 16 has a pattern area 1601 .
- the pattern area 1601 includes an image 1602 including a solid density pattern whose density level of an input pixel value is 100% and a plurality of halftone patterns whose density level is different by 2% from one another. It is assumed that the range of the density level of an input pixel value is between 0 (0%) and 255 (100%).
- the density correction test chart shown in FIG. 16 is printed on a sheet by a command from a host computer, such as the PC 100 , or a test print function of an image forming apparatus.
- FIG. 17 is a flowchart showing a flow of processing until a density correction table is generated. The processing shown in FIG. 17 is performed in the case where the above-described command from a host computer is received or in the case where a user starts to make use of the test print function of the image forming apparatus 101 .
- the controller 103 generates the density correction test chart shown in FIG. 16 (step S 1701 ).
- the generated test chart is printed by the printer 104 (step S 1702 ).
- a user places the test chart printed at step S 1702 on the document table of the image forming apparatus 101 and inputs instructions to perform reading via the operation unit 102 .
- the test chart placed on the document table is read by the scanner 105 .
- the controller 103 measures the density of the pattern at each density level from the test chart read by the scanner 105 (step S 1703 ).
- the density correction table generation unit 210 of the controller 103 receives a density measurement value measured at step S 1703 (step S 1704 ) and calculates the density characteristic from the density measurement value of the pattern at each density level (step S 1705 ).
- An example of the density characteristic calculated at this time is shown in FIG. 18A and FIG. 18C .
- a density characteristic 1801 indicates a density characteristic indicating a target density value and density characteristics 1802 and 1804 indicate density characteristics calculated at step S 1705 , that is, the current density characteristics.
- FIG. 18A shows that the current density characteristic 1802 becomes higher than the target density characteristic 1801 .
- a one-dimensional density correction table that reduces the density level of an input pixel and replaces the density level with the density level of the target density characteristic 1801 is created.
- a density correction table that is created at this time that is, a density correction table that performs correction so that the current density characteristic 1802 shown in FIG. 18A becomes the target density characteristic 1801 is indicated by a density correction table 1803 shown in FIG. 18B .
- FIG. 18C shows that the current density characteristic 1804 becomes lower than the target density characteristic 1801 .
- a one-dimensional density correction table that increases the density level of an input pixel and replaces the density level with the density level of the target density characteristic is created.
- a density correction table that is created at this time that is, a density correction table that performs correction so that the current density characteristic 1804 shown in FIG. 18C becomes the target density characteristic 1801 is indicated by a density correction table 1805 shown in FIG. 18D .
- FIG. 19 is a flowchart showing a flow of dither matrix selection processing.
- the dither matrix selection processing is performed in the processing (pseudo halftone processing) at step S 406 shown in FIG. 4 .
- the image processing unit 208 determines whether the current density characteristic calculated by the density correction table generation unit 210 is higher than the target density characteristic 1801 (step S 1901 ). Then, in the case where the current density characteristic is lower than or equal to the target density characteristic 1801 (NO at step S 1901 ), the image processing unit 208 selects the general dither matrix 702 shown in FIG. 7 (step S 1902 ). On the other hand, in the case where the current density characteristic is higher than the target density characteristic 1801 (YES at step S 1901 ), the image processing unit 208 selects the dither matrix 1103 of different direction growth or the dither matrix 1403 in order to suppress the disappearance of a thin line or the like whose density is low shown in FIG. 9A (step S 1903 ).
- the dither matrix of different direction growth whose screen angle is 45 degrees and whose screen ruling is 106 lines is taken as an example.
- the case where the dither matrix of different direction growth is a binary dither matrix is taken as an example, but it is also possible to apply the present invention to an N-value dither matrix.
- the present invention is applied to an N-value dither matrix, it is sufficient to set threshold values for each of (N ⁇ 1) matrixes as in the case with the dither matrix of different direction growth according to the above-described embodiments.
- the dither matrix of different direction growth in which rectangular cells are arranged is taken as an example.
- cells having another shape may be arranged in accordance with the screen ruling and screen angle.
- FIG. 20B it may also be possible to use a dither matrix 2002 as shown in FIG. 20B , which is obtained by arranging a cell 2001 having a shape as shown in FIG. 20A , in the pseudo halftone processing according to the above-described embodiments.
- A, B, C, and D within the cells shown in FIG. 20B indicate types of the above-described cell. That is, in the cells A, B, C, and D shown in FIG.
- the start point at which a dot is lit first is the same and the position at which a dot is lit second is different from one another.
- the dither matrix 2002 in the pseudo halftone processing for example, it is made possible to prevent a diagonal thin line (thin line drawn along the angle of arrangement of the cells A, B, C, and D shown in FIG. 20B ) from disappearing.
- a diagonal thin line thin line drawn along the angle of arrangement of the cells A, B, C, and D shown in FIG. 20B
- Embodiment(s) of the present invention can also be realized by a computer of a system or apparatus that reads out and executes computer executable instructions (e.g., one or more programs) recorded on a storage medium (which may also be referred to more fully as a ‘non-transitory computer-readable storage medium’) to perform the functions of one or more of the above-described embodiment(s) and/or that includes one or more circuits (e.g., application specific integrated circuit (ASIC)) for performing the functions of one or more of the above-described embodiment(s), and by a method performed by the computer of the system or apparatus by, for example, reading out and executing the computer executable instructions from the storage medium to perform the functions of one or more of the above-described embodiment(s) and/or controlling the one or more circuits to perform the functions of one or more of the above-described embodiment(s).
- computer executable instructions e.g., one or more programs
- a storage medium which may also be referred to more fully as a
- the computer may comprise one or more processors (e.g., central processing unit (CPU), micro processing unit (MPU)) and may include a network of separate computers or separate processors to read out and execute the computer executable instructions.
- the computer executable instructions may be provided to the computer, for example, from a network or the storage medium.
- the storage medium may include, for example, one or more of a hard disk, a random-access memory (RAM), a read only memory (ROM), a storage of distributed computing systems, an optical disk (such as a compact disc (CD), digital versatile disc (DVD), or Blu-ray Disc (BD)TM), a flash memory device, a memory card, and the like.
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Facsimile Image Signal Circuits (AREA)
- Image Processing (AREA)
Abstract
Description
Gray=0.212R+0.715G+0.0722B (expression 1)
Further, in the monochrome printer, in accordance with
K=255−Gray (expression 2)
As a result, in the monochrome printer, the yellow color signal (R=255, G=255, B=0) is converted into a value of K (19). By this, the yellow graphics is represented by the
Claims (17)
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2017-224582 | 2017-11-22 | ||
| JP2017224582A JP7005314B2 (en) | 2017-11-22 | 2017-11-22 | Image processing equipment, image processing methods, and programs |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| US20190156165A1 US20190156165A1 (en) | 2019-05-23 |
| US10546220B2 true US10546220B2 (en) | 2020-01-28 |
Family
ID=66533985
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| US16/178,074 Expired - Fee Related US10546220B2 (en) | 2017-11-22 | 2018-11-01 | Image processing apparatus that generates halftone image, image processing method, and storage medium |
Country Status (2)
| Country | Link |
|---|---|
| US (1) | US10546220B2 (en) |
| JP (1) | JP7005314B2 (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US11917115B1 (en) | 2023-03-10 | 2024-02-27 | Ricoh Company, Ltd. | Shift compensation mechanism |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2020235521A1 (en) | 2019-05-23 | 2020-11-26 | 旭化成株式会社 | Hydrogenated copolymer, adhesive film, resin composition, and molded article |
| US11200441B2 (en) | 2020-05-01 | 2021-12-14 | UiPath, Inc. | Text detection, caret tracking, and active element detection |
| US11461164B2 (en) | 2020-05-01 | 2022-10-04 | UiPath, Inc. | Screen response validation of robot execution for robotic process automation |
| US11080548B1 (en) * | 2020-05-01 | 2021-08-03 | UiPath, Inc. | Text detection, caret tracking, and active element detection |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2008227770A (en) | 2007-03-09 | 2008-09-25 | Ricoh Co Ltd | Image output method, image output apparatus, and image forming apparatus |
| US8384956B2 (en) | 2008-08-26 | 2013-02-26 | Canon Kabushiki Kaisha | Image processing apparatus generating an image processing flow for each segmented block of image data and corresponding, image processing method, and storage medium storing program instructing a computer to execute the method |
| US9894244B2 (en) | 2015-09-30 | 2018-02-13 | Canon Kabushiki Kaisha | Image processing system and image processing method that perform correction of shifting bitmap data in a sub-scanning direction to cancel bending of and electro-photographic laser scanning line |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2001211322A (en) * | 2000-01-27 | 2001-08-03 | Canon Inc | Image forming apparatus and method |
| JP2003189098A (en) * | 2001-12-20 | 2003-07-04 | Fuji Xerox Co Ltd | Image forming apparatus |
| JP6632345B2 (en) * | 2015-11-20 | 2020-01-22 | キヤノン株式会社 | Image processing apparatus, method, program and data structure |
-
2017
- 2017-11-22 JP JP2017224582A patent/JP7005314B2/en not_active Expired - Fee Related
-
2018
- 2018-11-01 US US16/178,074 patent/US10546220B2/en not_active Expired - Fee Related
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2008227770A (en) | 2007-03-09 | 2008-09-25 | Ricoh Co Ltd | Image output method, image output apparatus, and image forming apparatus |
| US8384956B2 (en) | 2008-08-26 | 2013-02-26 | Canon Kabushiki Kaisha | Image processing apparatus generating an image processing flow for each segmented block of image data and corresponding, image processing method, and storage medium storing program instructing a computer to execute the method |
| US9894244B2 (en) | 2015-09-30 | 2018-02-13 | Canon Kabushiki Kaisha | Image processing system and image processing method that perform correction of shifting bitmap data in a sub-scanning direction to cancel bending of and electro-photographic laser scanning line |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US11917115B1 (en) | 2023-03-10 | 2024-02-27 | Ricoh Company, Ltd. | Shift compensation mechanism |
Also Published As
| Publication number | Publication date |
|---|---|
| JP7005314B2 (en) | 2022-01-21 |
| US20190156165A1 (en) | 2019-05-23 |
| JP2019097021A (en) | 2019-06-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10546220B2 (en) | Image processing apparatus that generates halftone image, image processing method, and storage medium | |
| US9734439B2 (en) | Image processing apparatus and method thereof | |
| US9967429B2 (en) | Image processing apparatus, image processing method, and storage medium | |
| JP6403490B2 (en) | Image processing apparatus, image forming apparatus, image processing method, and program. | |
| US20120274989A1 (en) | Image processing apparatus, control method of image processing apparatus, and storage medium | |
| US10706340B2 (en) | Image processing apparatus and method for controlling the same with character attribute indicating that pixel is pixel of a character | |
| US9639790B2 (en) | Resolution conversion using dither processing | |
| JP2015156570A (en) | Color processing apparatus, image forming apparatus, and program | |
| US9894244B2 (en) | Image processing system and image processing method that perform correction of shifting bitmap data in a sub-scanning direction to cancel bending of and electro-photographic laser scanning line | |
| US10949720B2 (en) | Converting image data resolution using different coefficients depending on whether a target pixel constitutes a predetermined dot | |
| US9398194B2 (en) | Image processing apparatus and method performing density adjustment on image data based on generated density characteristics data | |
| US20090059254A1 (en) | Tint Block Image Generation Program and Tint Block Image Generation Device | |
| US10235610B2 (en) | Image processing apparatus which corrects a gray level of each pixel in image data, image forming apparatus and computer-readable medium | |
| US10571840B2 (en) | Image processing apparatus, method of controlling the same, and storage medium | |
| US10404892B2 (en) | Image forming apparatus for outputting a halftone image and image forming method | |
| US10567619B2 (en) | Image forming apparatus, method of generating image data therefor and storage medium | |
| JP7257806B2 (en) | Image forming device, generation device, conversion method, and generation method | |
| JP2013222983A (en) | Image processing system, image processing method, and computer program | |
| JP5885489B2 (en) | Image processing apparatus, image processing method, and computer program | |
| JP2008113364A (en) | Image processor, processing circuit, and processing method, and program | |
| JP2019047275A (en) | Image forming method, image forming apparatus, and program | |
| JP2019009621A (en) | Image forming apparatus, control method thereof, and program | |
| JP2023106806A (en) | Image processing device, image processing method and program | |
| JP2018196151A (en) | Image processing apparatus, image forming apparatus, image processing method, and program. | |
| JP2020195004A (en) | Image forming apparatus and control method for the same, and program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| FEPP | Fee payment procedure |
Free format text: ENTITY STATUS SET TO UNDISCOUNTED (ORIGINAL EVENT CODE: BIG.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
| STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |
|
| AS | Assignment |
Owner name: CANON KABUSHIKI KAISHA, JAPAN Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:NAKANO, TOSHIMITSU;REEL/FRAME:048180/0194 Effective date: 20181019 |
|
| STPP | Information on status: patent application and granting procedure in general |
Free format text: NOTICE OF ALLOWANCE MAILED -- APPLICATION RECEIVED IN OFFICE OF PUBLICATIONS |
|
| STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
| FEPP | Fee payment procedure |
Free format text: MAINTENANCE FEE REMINDER MAILED (ORIGINAL EVENT CODE: REM.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
| LAPS | Lapse for failure to pay maintenance fees |
Free format text: PATENT EXPIRED FOR FAILURE TO PAY MAINTENANCE FEES (ORIGINAL EVENT CODE: EXP.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
| STCH | Information on status: patent discontinuation |
Free format text: PATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362 |
|
| FP | Lapsed due to failure to pay maintenance fee |
Effective date: 20240128 |