EP3035663A1 - Bildverarbeitungsvorrichtung, bildverarbeitungsverfahren und programm - Google Patents

Bildverarbeitungsvorrichtung, bildverarbeitungsverfahren und programm Download PDF

Info

Publication number
EP3035663A1
EP3035663A1 EP15003591.3A EP15003591A EP3035663A1 EP 3035663 A1 EP3035663 A1 EP 3035663A1 EP 15003591 A EP15003591 A EP 15003591A EP 3035663 A1 EP3035663 A1 EP 3035663A1
Authority
EP
European Patent Office
Prior art keywords
threshold value
ink
valued data
data
image processing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP15003591.3A
Other languages
English (en)
French (fr)
Other versions
EP3035663B1 (de
Inventor
Minako Kato
Yumi Yanai
Masao Kato
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Canon Inc
Original Assignee
Canon Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Canon Inc filed Critical Canon Inc
Publication of EP3035663A1 publication Critical patent/EP3035663A1/de
Application granted granted Critical
Publication of EP3035663B1 publication Critical patent/EP3035663B1/de
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/40—Picture signal circuits
    • H04N1/405—Halftoning, i.e. converting the picture signal of a continuous-tone original into a corresponding signal showing only two levels
    • H04N1/4051—Halftoning, i.e. converting the picture signal of a continuous-tone original into a corresponding signal showing only two levels producing a dispersed dots halftone pattern, the dots having substantially the same size
    • H04N1/4052—Halftoning, i.e. converting the picture signal of a continuous-tone original into a corresponding signal showing only two levels producing a dispersed dots halftone pattern, the dots having substantially the same size by error diffusion, i.e. transferring the binarising error to neighbouring dot decisions
    • H04N1/4053—Halftoning, i.e. converting the picture signal of a continuous-tone original into a corresponding signal showing only two levels producing a dispersed dots halftone pattern, the dots having substantially the same size by error diffusion, i.e. transferring the binarising error to neighbouring dot decisions with threshold modulated relative to input image data or vice versa
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B41—PRINTING; LINING MACHINES; TYPEWRITERS; STAMPS
    • B41J—TYPEWRITERS; SELECTIVE PRINTING MECHANISMS, i.e. MECHANISMS PRINTING OTHERWISE THAN FROM A FORME; CORRECTION OF TYPOGRAPHICAL ERRORS
    • B41J2/00—Typewriters or selective printing mechanisms characterised by the printing or marking process for which they are designed
    • B41J2/005—Typewriters or selective printing mechanisms characterised by the printing or marking process for which they are designed characterised by bringing liquid or particles selectively into contact with a printing material
    • B41J2/01—Ink jet
    • B41J2/21—Ink jet for multi-colour printing
    • B41J2/2103—Features not dealing with the colouring process per se, e.g. construction of printers or heads, driving circuit adaptations
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06K—GRAPHICAL DATA READING; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K15/00—Arrangements for producing a permanent visual presentation of the output data, e.g. computer output printers
    • G06K15/02—Arrangements for producing a permanent visual presentation of the output data, e.g. computer output printers using printers
    • G06K15/18—Conditioning data for presenting it to the physical printing elements
    • G06K15/1867—Post-processing of the composed and rasterized print image
    • G06K15/1872—Image enhancement
    • G06K15/1881—Halftoning
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/40—Picture signal circuits
    • H04N1/405—Halftoning, i.e. converting the picture signal of a continuous-tone original into a corresponding signal showing only two levels
    • H04N1/4051—Halftoning, i.e. converting the picture signal of a continuous-tone original into a corresponding signal showing only two levels producing a dispersed dots halftone pattern, the dots having substantially the same size
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/46—Colour picture communication systems
    • H04N1/52—Circuits or arrangements for halftone screening

Definitions

  • the present invention relates to an image processing apparatus, image processing method, and program for performing a quantization process to form an image on a print medium.
  • an error diffusion method and a dither method are known.
  • the dither method that compares a preliminarily stored threshold value and a gradation value of multi-valued data to determine dot printing or non-printing is widely used in many image processing apparatuses because a processing load is small as compared with the error diffusion method.
  • Such a dither method has a problem of dot dispersibility in particular in a low gradation range; however, as a threshold value matrix for obtaining preferable dot dispersibility, a threshold value matrix having blue noise characteristics is proposed.
  • FIGS. 9A to 9C are diagrams for explaining a dither process using a threshold value matrix having blue noise characteristics.
  • FIG. 9A illustrates an example of image data to be inputted into a 10-pixel x 10-pixel area. This example shows a state where a gradation value of "36" is inputted into all the pixels.
  • FIG. 9B illustrates a threshold value matrix prepared corresponding to the above 10-pixel x 10-pixel area. Each of the pixels is related to any of threshold values of 0 to 254. In the dither method, in the case where a gradation value indicated by multi-valued image data is larger than a threshold value, a corresponding pixel is designated as dot printing "1".
  • FIG. 9C illustrates a quantization result based on the dither method. Pixels representing printing "1” are indicated in gray, and pixels representing non-printing "0" are indicated in white. The distribution of printing "1" pixels as seen in FIG. 9C changes depending on threshold value arrangement in the threshold value matrix. By using the threshold value matrix having blue noise characteristics as in FIG. 9B , even in the case where the same pieces of multi-valued data are inputted into a predetermined area as in FIG. 9A , the printing "1" pixels are arranged in a high dispersibility state as in FIG. 9C .
  • FIGS. 10A and 10B are diagrams illustrating blue noise characteristics and human visual characteristics or a human transfer function (VTF) at a visibility distance of 250 mm.
  • the horizontal axis represents a frequency (cycles/mm), indicating lower and higher frequencies toward the left and right of the graph, respectively.
  • the vertical axis represents intensity (power) corresponding to each frequency.
  • the blue noise characteristics are characterized by, for example, a suppressed low frequency component, a rapid rise, and a flat high frequency component.
  • a frequency fg corresponding to a peak resulting from the rapid rise is referred to as a principal frequency.
  • the human visual characteristics have high sensitivity in a lower frequency range, but sensitivity in a higher frequency range is low. That is, the lower frequency component is conspicuous, whereas the higher frequency component is inconspicuous.
  • the blue noise characteristics are based on such visual characteristics, and adapted to, in the visual characteristics, hardly has power in the highly sensitive (conspicuous) lower frequency range, but has power in the low sensitive (inconspicuous) higher frequency range. For this reason, when a person visually observes an image subjected to a quantization process using a threshold value matrix having blue noise characteristics, dot deviation or periodicity is unlikely to be perceived, and the image is recognized as a comfortable image.
  • US Patent No. 6867884 discloses a dither method for solving such a problem. Specifically, US Patent No. 6867884 discloses a method that prepares one common dither matric having preferable dispersibility as in FIG. 9B , and performs a quantization process while shifting mutual threshold values among multiple colors. According to US Patent No. 6867884 as described, dots having different colors are mutually exclusively printed in a highly dispersible state in a low gradation area, and therefore even in a mixed color image, preferable image quality can be achieved.
  • the principal frequency fg is an average frequency when dispersing a predetermined number of dots as uniformly as possible; however, the principal frequency fg depends on the density of the dots, i.e., gradation.
  • FIGS. 11A and 11B are diagrams illustrating the relationship between a gradation value (i.e. , the dot density) and the principal frequency fg.
  • the horizontal axis represents a gray level g (i.e., the dot density)
  • the vertical axis represents the principal frequency fg at each gray level.
  • the gray level g is given on the assumption that a state where dots are placed in all pixels in an image area corresponds to "1", a state where no dots are placed in all the pixels to "0", and a state where dots are placed in half of the pixels to "1/2".
  • the principal frequency fg in this case can be expressed by Expression 1.
  • f g ⁇ g u g ⁇ 1 2 1 - g u g > 1 2
  • u represents the reciprocal of a pixel spacing.
  • at a gray level of g 1/2, i.e., when dots are arranged in 50 % of the pixels in the entire pixel area.
  • the principal frequency fg also gradually shifts toward the lower frequency side.
  • FIG. 11B is a diagram illustrating frequency characteristics in four types of gradation lower than a gray level g of 1/2 when performing a quantization process using a threshold value matrix having blue noise characteristics, together with the visual characteristics VTF.
  • a horizontal axis represents a frequency (cycles/mm).
  • VTF refers the right side vertical axis representing intensity (power) corresponding to each frequency as Fig.9B .
  • the frequency characteristics in a low gradation refers the left side vertical axis representing intensity (power) corresponding to each frequency. Both of vertical axes have no unit of quantity required and quantity of them have no relationship with each other.
  • the diagram illustrates the case where the first gradation has the lowest gray level, and the gray level increases from the second to the third, to the fourth.
  • Blue noise characteristics indicating that a lower frequency component is suppressed, and in a higher frequency range, there is a peak at a principal frequency fg are common to all the types of gradation.
  • the principal frequencies fg in the first gradation and the second gradation are present within a range of 2 to 4 cycles/mm, which are also close to the peak of the VTF. That is, a dot pattern in lower gradation has blue noise characteristics, but the dot pattern itself is easily visually perceived.
  • US Patent No. 6867884 does not focus on any pseudo contour as described above.
  • US Patent No. 6867884 discloses an embodiment where increasing the dispersibility of a black ink having the highest contrast among multiple color inks is given priority, and black is set for a channel having the lowest threshold value area among multiple channels corresponding to the common threshold value matrix.
  • the threshold value matrix has blue noise characteristics
  • the dot arrangement of the black ink will have blue noise characteristics as described above from lower gradation to higher gradation.
  • frequency characteristics in a black ink dot patterns will be those as illustrated in FIG. 11B , which may cause the "pseudo contour" to deteriorate image quality.
  • the present invention is made in order to solve the above-described problem, and intends to provide an image processing apparatus and image processing method that can perform a dither process that prevents a pseudo contour associated with a shift in gradation level from being recognized despite suppressing graininess in a mixed color image.
  • the present invention in its first aspect provides an image processing apparatus as specified in claims 1 to 9.
  • the present invention in its second aspect provides an image processing method as specified in claims 10 to 14.
  • the present invention in its third aspect provides a program as specified in claims 15.
  • FIG. 1 is a block diagram illustrating the configuration of an inkjet printing system control applicable to the present invention.
  • the inkjet printing system in the present embodiment is configured to include an image supply device 3, an image processing apparatus 2, and an inkjet printing apparatus 1 (hereinafter also simply referred to as a printing apparatus).
  • Image data supplied from the image supply device 3 is subjected to a predetermined image process in the image processing apparatus 2, and then sent to the printing apparatus 1 for printing.
  • a printing apparatus main control unit 101 is one for controlling the whole of the printing apparatus 1, and configured to include a CPU, ROM, RAM, and the like.
  • the print buffer 102 can store image data before transfer to a print head 103 as raster data.
  • the print head 103 is an inkjet type print head having multiple printing elements capable of ejecting inks as droplets, and in accordance with image data stored in the print buffer 102, ejects inks from respective printing elements. In the present embodiment, it is assumed that printing element arrays for four colors of cyan, magenta, yellow, and black are arrayed on the print head 103.
  • a sheet feeding/discharging motor control unit 104 controls conveyance and feeding/discharging of print media.
  • a printing apparatus interface (I/F) 105 transceives a data signal with the image processing apparatus 2.
  • An I/F signal line 114 connects the both.
  • As the I/F signal line 114 one specified by, for example, Centronics Data Computer Corporation can be applied.
  • a data buffer 106 temporarily stores image data received from the image processing apparatus 2.
  • a system bus 107 connects the respective functions of the printing apparatus 1.
  • an image processing apparatus main control unit 108 is one for performing various processes on an image supplied from the image supply device 3, and thereby generating image data printable by the printing apparatus 1, and includes a CPU, ROM, RAM, and the like.
  • the below-described characteristics configuration of the present invention illustrated in FIGS. 3 and 4A is also provided in the image processing apparatus main control unit 108, and flowcharts to be described with FIGS. 2 and 4B are performed by the CPU of the image processing apparatus main control unit 108.
  • An image processing apparatus interface (I/F) 109 transceives a data signal with the printing apparatus 1.
  • An externally connecting interface (I/F) 113 transceives image data with the image supply device 3 externally connected.
  • a display unit 110 displays various pieces of information to a user, and can be applied with a display such as an LCD.
  • An operation unit 111 is a mechanism for a user to perform a command operation, and can be applied with, for example, a keyboard and a mouse.
  • a system bus 112 connects the image processing apparatus main control unit 108 and the respective functions to each other.
  • FIG. 2 is a flowchart for explaining an image data process performed by the image processing apparatus main control unit 108 in the present embodiment. This process is performed by the CPU provided in the image processing apparatus main control unit 108 in accordance with a program stored in the ROM.
  • the image processing apparatus main control unit 108 when image data on a target pixel is inputted from the image supply device 3 (Step S200), the image processing apparatus main control unit 108 first makes a color correction in Step S201.
  • the image data received by the image processing apparatus 2 from the image supply device 3 includes pieces of R (red), G (green), and B (blue) 8-bit luminance data for expressing standardized color space such as sRGB.
  • Step S201 these pieces of luminance data are converted to pieces of RGB 12-bit luminance data corresponding to color space specific to the printing apparatus.
  • a publicly known method such as a method that refers to a lookup table (LUT) preliminarily, stored in the ROM or the like can be employed.
  • LUT lookup table
  • Step S202 the image processing apparatus main control unit 108 decomposes the converted pieces of RGB data to pieces of 16-bit gradation data (density data) respectively for C (cyan), M (magenta), Y (yellow) and K (black) that are the ink colors of the printing apparatus.
  • a 16-bit gray image is generated for each of four channels (four colors) .
  • a lookup table (LUT) preliminarily stored in the ROM or the like can be referred to as in the color correction process.
  • Step S203 the image processing apparatus main control unit 108 performs a predetermined quantization process on the pieces of 16-bit gradation data respectively corresponding to the ink colors to convert to pieces of several bit quantized data.
  • the pieces of 16-bit gradation data are converted to pieces of 2-bit data each corresponding to any of Level 0 to Level 2.
  • the quantization process will be described later in detail.
  • Step S204 the image processing apparatus main control unit 108 performs an index expansion process. Specifically, from among multiple dot arrangement patterns where the number of dots to be printed in each pixel and a corresponding position are determined, one dot arrangement pattern is selected related to a level obtained in Step S203. Then, resultant pieces of dot data are outputted as pieces of binary data (Step S205). This completes the image data process.
  • FIG. 3 is a block diagram for explaining the detail of the quantization process performed in Step S203 of FIG. 2 .
  • the quantization process in the present invention is performed in accordance with a dither method.
  • an input value is first processed, then a threshold value is processed, and then the quantization process is performed.
  • These series of processes are parallel performed on a color basis (on a channel basis). In the following, each of the processes will be described in detail with reference to FIG. 3 .
  • An image data acquisition unit 301 acquires pieces of 16-bit gradation data indicating the density of each pixel. It is assumed that the image data acquisition unit 301 in the present embodiment can receive signals having at most 16 bits for eight colors.
  • the diagram illustrates a state where the pieces of 16-bit data respectively on first to fourth inks are inputted.
  • a noise addition process unit 302 adds predetermined noise to the pieces of 16-bit gradation data. By adding the noise, even in the case where pieces of gradation data of the same level are continuously inputted, a state where the same patterns are continuously arranged can be avoided to reduce a strip, texture, and the like.
  • the noise addition process unit 302 multiplies a predetermined random table, fixed intensity, and variable intensity corresponding to an input value, and thereby noise is generated for each pixel and added to the input value.
  • the random table is a table adapted to set the polarity of noise, and sets a plus, zero, or a minus for each pixel position.
  • the random table in the present embodiment can have at most eight faces, and the size of each table can be arbitrarily set.
  • the fixed intensity indicates the intensity of a noise amount, and the magnitude of the intensity determines whether noise is large or small.
  • a noise amount can be appropriately adjusted.
  • a normalization process unit 303 relates a gradation value of each pixel represented by 16 bits to a level value enabling the index expansion in Step S204, and then normalizes each level range to 12 bits.
  • the index expansion process in Step S204 is a process corresponding to n values from Level 0 to Level (n-1)
  • the normalization process unit 303 equally divides 65535 gradations represented by 16 bits into (n-1). Further, a range corresponding to each level is normalized to 12 bits (4096 gradations). This makes it possible to, for each pixel, obtain pieces of 12-bit data related to any of Level 0 to Level (n-1).
  • the normalization process unit 303 equally divides the 65535 gradations represented by 16 bits into two. Then, the normalization process unit 303 normalizes respective ranges corresponding to gradation values of 0 to 32767 and gradation values of 32768 to 65535 to 12 bits (0 to 4095 gradations). For a pixel corresponding to the input gradation values of 0 to 32767 as the first range, Level 0 or Level 1 is outputted by the subsequent quantization process, whereas for a pixel corresponding to the input gradation values of 32768 to 65535 as the second range, Level 1 or Level 2 is outputted by the subsequent quantization process.
  • a quantization number (n) is any number, the subsequent quantization process can be performed in the same manner.
  • the processes in the image data acquisition unit 301 to the normalization process unit 303 described above are parallel performed on the pieces of gradation data on the respective colors. That is, in the present embodiment, the pieces of 12-bit data on black, cyan, magenta, and yellow are generated, and inputted to a dither process unit 311.
  • 12-bit data to be quantized (processing target data) is directly transmitted to a quantization process unit 306.
  • pieces of 12-bit data on colors other than the processing target data are inputted to a color correlating process unit 304 as pieces of reference data.
  • the color correlating process unit 304 performs a predetermined process on a threshold value acquired by a threshold value acquisition unit 305 on the basis of the pieces of reference data to determine a final threshold value, and transmits the final threshold value to the quantization process unit 306.
  • the quantization process unit 306 compares the processing target data with the threshold value inputted from the color correlating process unit 304, and thereby determines printing (1) or non-printing (0).
  • the threshold value acquisition unit 305 acquires a threshold value corresponding to a pixel position associated with the processing target data from a dither pattern 310 stored in a memory such as the ROM.
  • the dither pattern 310 is a threshold value matrix formed by arraying threshold values of 0 to 4095 so as to have blue noise characteristics, and can provide various sizes and shapes such as 512 x 512 pixels, 256 x 256 pixels, and 512 x 256 pixels. That is, the memory preliminarily stores multiple threshold value matrices having different sizes and shapes as described, and the threshold value acquisition unit 305 selects a threshold value matrix corresponding to a print mode from among the multiple threshold value matrices.
  • the threshold value acquisition unit 305 provides a threshold value corresponding to the pixel position (x, y) associated with the processing target data to the color correlating process unit.
  • a method for determining a threshold value in the color correlating process unit 304 will be described in detail.
  • FIGS. 4A and 4B are a block diagram and a flowchart, respectively, for explaining the configuration and steps of a process in the color correlating process unit 304.
  • the color correlating process unit 304 sets the pieces of 12-bit data corresponding to the colors other than the processing target data as the pieces of reference data, uses these pieces of reference data to perform the predetermined process on the threshold value acquired by the threshold value acquisition unit 305, and calculates the threshold value for quantizing the processing target data.
  • the processing target data is 12-bit data on black
  • the pieces of reference data are pieces of 12-bit data on cyan, magenta, and yellow.
  • the processing target data is denoted by In1(x, y)
  • the pieces of reference data are denoted by In2(x, y), In3(x, y), and In4(x, y).
  • (x, y) represents the pixel position, which serves as a coordinate parameter for the threshold value acquisition unit 305 to select the threshold value corresponding to the pixel position associated with the processing target data from among the threshold value matrix.
  • the pieces of reference data In2 (x, y) to In4 (x, y) inputted to the color correlating process unit 304 are first inputted to a threshold value offset amount calculation unit 308 (Step S401).
  • the threshold value offset amount calculation unit 308 uses these pieces of reference data to calculate a threshold value offset Ofs_1(x, y) for the processing target data In1(x, y) (Step S402).
  • the threshold value offset value Ofs_1(x, y) is calculated in accordance with Expression 2.
  • Ofs_ 1 x y ⁇ i Ini x y
  • i represents a parameter individually indicating, among the pieces of reference data In2(x, y) to In4(x, y), reference data (hereinafter referred to as actual reference data) used to obtain the threshold value for the processing target data In1.
  • actual reference data reference data (hereinafter referred to as actual reference data) used to obtain the threshold value for the processing target data In1.
  • the number and type of such pieces of actual reference data are predesignated for each processing target data.
  • the processing target data is In1 (x, y)
  • the actual reference data is null
  • In2(x, y) In1(x, y) is the actual reference data.
  • In3 (x, y) In1 (x, y) and In2 (x, y) are the pieces of actual reference data
  • the processing target data is In4(x, y), In1(x, y), In2 (x, y), and In3(x, y) are the pieces of actual reference data.
  • offsets Ofs_1(x, y) to Ofs_4(x, y) for the respective pieces of processing target data In1(x, y) to In4 (x, y) can be expressed as follows in accordance with Expression 2.
  • the threshold value offset unit 309 acquires a threshold value Dth corresponding to the coordinates (x, y) of processing target data In (x, y) from the threshold value acquisition unit 305 (Step S403).
  • Step S404 a difference between the threshold value Dth (x, y) and the processing target data is offset by the threshold value offset unit 309.
  • the threshold value offset unit 309 subtracts the threshold value offset value Ofs_1(x, y) inputted from the threshold value offset amount calculation unit 308 from the threshold value Dth(x, y) inputted from the threshold value acquisition unit 305 to obtain a quantization threshold value Dth'(x, y).
  • Dth ⁇ x y Dth x y - Ofs_ 1 x y
  • Dth_max the maximum value of threshold values in the dither pattern
  • Dth_max the maximum value of threshold values in the dither pattern
  • the quantization process unit 306 compares the processing target data In1(x, y) and the quantization threshold value Dth'(x, y) with each other to determine dot printing (1) or non-printing (0) for the pixel position (x, y). This completes the processing steps.
  • the quantization process unit 306 compares the processing target data and the quantization threshold value with each other in a state a difference between the threshold value Dth(x, y) and the processing target data have been offset by the threshold value offset unit.
  • quantized data Out1(x, y) represented by several bits is subjected to the index expansion process, and a dot pattern to be printed at the pixel position (x, y) is determined.
  • the number of dots to be printed at the pixel position (x, y) is set to be a number corresponding to a level value, such as one dot when the level value is 1, or two dots when the level value is 2.
  • FIG. 5 is a diagram illustrating ranges of threshold values determined as printing (1) among the multiple threshold values 0 to Dth_max arranged in the dither pattern 310 when the first to fourth pieces of multi-valued data (In1 to In4) are inputted respectively for the first to fourth inks, respectively.
  • the horizontal axis represents a threshold value 0 to 4094, and "1710" represents Dth_max (the maximum value among the threshold values in the dither pattern).
  • Each thick line indicates a threshold value range where dots are arranged.
  • an area corresponding to the remainder obtained by dividing (In1 + In2 + In3) by Dth_max i.e., threshold values of 0 to In1 + In2 + In3 - Dth_max are set to printing (1).
  • In1 + In2 to Dth_max (1708 to 1710) and 0 to In1 + In2 + In3 - Dth_max (1707 to 1711) are threshold value ranges determined as printing (1).
  • an area corresponding to the remainder obtained by dividing (In1 + In2 + In3 + In4) by Dth_max i.e., threshold values of In1 + In2 + In3 - Dth_max to In1 + In2 + In3 + In4 - Dth_max (1713 to 1714) are set to printing (1).
  • the quantization threshold values Dth' specific to the respective colors are obtained by setting the mutual input values as the offset values. Further, by using the newly obtained quantization threshold values Dth' for the quantization process, dots can be arranged such that a dot print pattern in which the multiple colors are mixed have blue noise characteristics.
  • a dither pattern used in the present embodiment is a threshold value matrix having blue noise characteristics. That is, when arranging dots sequentially from a pixel having the smallest threshold value, threshold values are arranged so as to obtain preferable dispersibility in any type of gradation. For this reason, in the case of a color printed in pixels having continuous threshold values from a minimum value to a predetermined value, like the first ink, a printed image has blue noise characteristics and obtains preferable dispersibility. However, in contrast, the "pseudo contour" described in Description of the Related Art is also a concern.
  • FIGS. 6A and 6B are diagrams illustrating frequency characteristics of the first and second inks in four types of gradation having lower gray levels together with the visual characteristics (VTF) as with FIG. 11B .
  • a horizontal axis represents a frequency (cycles/mm).
  • VTF refers the right side vertical axis representing intensity (power) corresponding to each frequency as Fig.9B .
  • the frequency characteristics in a low gradation refers the left side vertical axis representing intensity (power) corresponding to each frequency. Both of vertical axes have no unit of quantity required and quantity of them have no relationship with each other.
  • FIG. 6A illustrates the frequency characteristics of the first ink
  • FIG. 6B illustrates the frequency characteristics of the second ink.
  • the power of a lower frequency component is suppressed to nearly zero, and at a principal frequency fg, a peak appears. That is, preferable dispersibility can be obtained, but the "pseudo contour" as described in Description of the Related Art is a concern.
  • the power gradually monotonously increases from the lower frequency range toward the higher frequency range, and no peak appears. That is, dispersibility is worse than that of the first ink.
  • a switch between types of gradation such as a switch from the first gradation to the second gradation, or a switch from the second gradation to the third gradation, the difference in dot pattern is not visually recognized, and therefore the "pseudo contour" is difficult to recognize.
  • the black ink having the highest contrast as the first ink is preferable as long as only dispersibility is focused on.
  • the pseudo contour is most conspicuous in the case of the black ink, and it turns out that between the dispersibility and the pseudo contour, there is a tradeoff relationship.
  • the present inventors have determined that in consideration of both the dispersibility and the pseudo contour, in the case of black, reducing the pseudo contour should be given priority rather than increasing the dispersibility. For this reason, in the present embodiment, as the first ink, not black but cyan is set; as the second ink, black is set; as the third ink, magenta is set; and as the fourth ink, yellow is set.
  • a method as described above may be used for offsetting a difference between the threshold value Dth (x, y) and the processing target data.
  • the quantization process unit 306 or further unit add a value corresponding to the threshold value offset value to the processing target data instead of subtracting the offset value inputted from the threshold value offset amount calculation unit 308 from the threshold value by the threshold value offset amount addition unit 309.
  • black is set as a second ink as in the first embodiment, and in addition, an ink color decomposition process that further reduces the graininess of black is performed.
  • the inkjet printing system and the quantization process described with FIGS. 1 to 4B are used.
  • FIG. 7 is a diagram illustrating the features of the ink color decomposition process in the present embodiment performed in Step S202 of FIG. 2 .
  • signal value conversion is performed such that various colors expressed by R (red), G (green), and B (blue) are expressed by four colors of cyan, magenta, yellow, and black.
  • FIG. 7 illustrates a state where a gray line expressed by R (red), G (green), and B (blue) is converted to 16-bit signals of cyan, magenta, yellow, and black.
  • the horizontal axis represents a gray gradation level, and 0 corresponds to white, whereas 4096 corresponds to black.
  • the vertical axis represents output value.
  • an output value of a black ink is suppressed to be zero from 0 to an intermediate density range. That is, in a gray color range having high lightness from white to intermediate density, gray is expressed by three colors of cyan, magenta, and yellow, and no black dot is printed. In addition, from a gradation level nearly exceeding the intermediate density, the black output value is gradually increased, whereas cyan, magenta, and yellow output values are decreased. At the highest density (4096), only black is printed, whereas the cyan, magenta, and yellow output values are set to be zero.
  • the gray line is taken as an example to give the description; however, ink color conversion that suppresses the black output value to be zero at least from the highlight to the intermediate density is performed in any hue. For this reason, a situation where black dots are sparsely printed in a blank area does not arise. In gradation where black dots are sparsely printed, relatively large amounts of the other inks are inevitably printed. That is, even in a state where black dots are sparsely printed, the contrast itself of black dots is inconspicuous, and even in the case where the dispersibility of black dots is low, graininess does not easily become problematic.
  • the number of color dots decreases; however, in such gradation, a large number of black dots are printed, and the surface of a print medium comes into a state of being nearly filled with the dots. For this reason, in such gradation as well, the graininess of black dots is inconspicuous.
  • the inkjet printing system using the inks of the four colors of cyan, magenta, yellow, and black is described.
  • the present embodiment additionally uses a gray ink as well.
  • an ink color decomposition process that reduces the graininess of a black ink in a positive manner is performed.
  • the inkjet printing system and the quantization process described with FIGS. 1 to 4B are performed.
  • FIGS. 8A and 8B are diagrams for explaining the features of the ink color decomposition process in the present embodiment performed in Step S202 of FIG. 2 .
  • FIG. 7 a state where a gray line is converted into 16-bit gradation data on each ink color.
  • FIG. 8A illustrates the case where the gray line is expressed only by a gray ink and a black ink. From 0 to an intermediate density area, only the gray ink is used, whereas an output value of the black ink is suppressed to be zero. Further, from a gradation level nearly exceeding the intermediate density, the black ink output value is gradually increased, whereas a gray output value is decreased, and at the highest density (4096), only black is outputted.
  • FIG. 8B illustrates the case where the gray line is expressed using, in addition to the gray ink and the black ink, cyan, magenta, and yellow inks. From 0 to an intermediate density region, the gray, cyan, magenta, and yellow inks are used, whereas a black ink output value is suppressed to be zero. Further, from a gradation level nearly exceeding the intermediate density, the black output value is gradually increased, whereas output values of the other colors are decreased, and at the highest density (4096), only black is outputted.
  • the black ink is set as the second ink, i.e., for a channel having a second lowest threshold value range; however, present invention is not limited to such a configuration.
  • a black ink having the highest dot contrast can be set for a channel having a threshold value range where an offset amount is not zero, i.e., as any of the second to fourth inks, the effect of the present invention can be sufficiently obtained.
  • multiple ink colors can be set for the same channel.
  • cyan is set; as the second ink, black is set; and as the third ink, magenta and yellow of which graininess is unlikely to be conspicuous is set.
  • magenta and yellow can be set as the first ink, and optimally set in accordance with ink characteristics.
  • a configuration additionally including the gray ink is described; however, a configuration additionally including a particular color ink such as red, green, or blue, or light cyan or light magenta ink of which color material density is lower than that of cyan or magenta is also possible.
  • a dot pattern corresponding to a level is related by the index expansion process; however, a way to express a multi-valued level is not limited to the index expansion.
  • dots having multiple sizes are printable, or in the case where inks having multiple different densities are ejectable, printing can also be performed with a dot size or ink density related to each level.
  • a dot array state can be made depending on a threshold value array state of an original dither pattern.
  • the quantization process performed in Step S203 is not necessarily required to be a multi-valued quantization process that converts to several-bit multi-valued data. That is, the quantization process in Step S203 may directly convert 16-bit gradation data to 1-bit binary data through a dither process. In this case, the index expansion process described in Step S204 is omitted, and binary data obtained in Step S203 is directly outputted to the printing apparatus 1.
  • any of the above embodiments is described on the basis of the configuration where all the steps illustrated in FIG. 2 are performed in the image processing apparatus 2; however, as long as each of the above processes is performed in the inkjet printing system in the present embodiment illustrated in FIG. 1 , the steps may be performed in any device.
  • a configuration where the steps up to the quantization in Step S203 are performed by the image processing apparatus 2, and the index process in Step S204 is performed in the printing apparatus 1 is also possible.
  • the printing apparatus 1 includes the function of the image processing apparatus 2 described above, and all the steps subsequent to Step S201 are performed in the printing apparatus 1. In this case, the printing apparatus 1 serves as the image processing apparatus of the present invention.
  • a bit number of input/output data in each of the above-described steps is not limited to that in any of the above-described embodiments.
  • an output bit number may be made larger than an input bit number, and a bit number may be variously adjusted depending on application or situations.
  • Embodiment (s) of the present invention can also be realized by a computer of a system or apparatus that reads out and executes computer executable instructions (e.g., one or more programs) recorded on a storage medium (which may also be referred to more fully as a 'non-transitory computer-readable storage medium') to perform the functions of one or more of the above-described embodiment (s) and/or that includes one or more circuits (e.g., application specific integrated circuit (ASIC)) for performing the functions of one or more of the above-described embodiment (s), and by a method performed by the computer of the system or apparatus by, for example, reading out and executing the computer executable instructions from the storage medium to perform the functions of one or more of the above-described embodiment(s) and/or controlling the one or more circuits to perform the functions of one or more of the above-described embodiment (s).
  • computer executable instructions e.g., one or more programs
  • a storage medium which may also be referred to more fully as
  • the computer may comprise one or more processors (e.g., central processing unit (CPU), micro processing unit (MPU)) and may include a network of separate computers or separate processors to read out and execute the computer executable instructions.
  • the computer executable instructions may be provided to the computer, for example, from a network or the storage medium.
  • the storage medium may include, for example, one or more of a hard disk, a random-access memory (RAM), a read only memory (ROM), a storage of distributed computing systems, an optical disk (such as a compact disc (CD), digital versatile disc (DVD), or Blu-ray Disc (BD)TM), a flash memory device, a memory card, and the like.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Facsimile Image Signal Circuits (AREA)
  • Color, Gradation (AREA)
  • Ink Jet (AREA)
  • Particle Formation And Scattering Control In Inkjet Printers (AREA)
EP15003591.3A 2014-12-16 2015-12-16 Bildverarbeitungsvorrichtung, bildverarbeitungsverfahren und programm Active EP3035663B1 (de)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2014254017 2014-12-16

Publications (2)

Publication Number Publication Date
EP3035663A1 true EP3035663A1 (de) 2016-06-22
EP3035663B1 EP3035663B1 (de) 2019-09-18

Family

ID=55070633

Family Applications (1)

Application Number Title Priority Date Filing Date
EP15003591.3A Active EP3035663B1 (de) 2014-12-16 2015-12-16 Bildverarbeitungsvorrichtung, bildverarbeitungsverfahren und programm

Country Status (3)

Country Link
US (1) US9661181B2 (de)
EP (1) EP3035663B1 (de)
JP (2) JP2016116227A (de)

Families Citing this family (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6587552B2 (ja) * 2015-02-20 2019-10-09 キヤノン株式会社 画像処理装置および画像処理方法
JP6433384B2 (ja) 2015-07-01 2018-12-05 キヤノン株式会社 画像処理装置および画像処理方法
JP6537376B2 (ja) 2015-07-01 2019-07-03 キヤノン株式会社 画像処理装置および画像処理方法
JP6478841B2 (ja) 2015-07-01 2019-03-06 キヤノン株式会社 画像処理装置および画像処理方法
JP6422405B2 (ja) 2015-07-01 2018-11-14 キヤノン株式会社 画像処理装置および画像処理方法
JP6512965B2 (ja) 2015-07-01 2019-05-15 キヤノン株式会社 画像処理装置および画像処理方法
JP6465765B2 (ja) 2015-07-01 2019-02-06 キヤノン株式会社 画像処理装置および画像処理方法
JP6536310B2 (ja) * 2015-09-14 2019-07-03 株式会社リコー 画像形成システム、情報処理装置、情報処理方法及びプログラム
JP6628764B2 (ja) 2017-05-12 2020-01-15 キヤノン株式会社 画像処理装置、画像処理方法及びプログラム
JP6869848B2 (ja) * 2017-08-08 2021-05-12 キヤノン株式会社 画像処理装置および画像処理方法
JP7161424B2 (ja) * 2019-02-26 2022-10-26 三菱重工コンプレッサ株式会社 インペラ及び回転機械
JP7208087B2 (ja) 2019-04-15 2023-01-18 キヤノン株式会社 画像処理装置、画像処理方法およびプログラム
JP7247006B2 (ja) 2019-04-15 2023-03-28 キヤノン株式会社 画像処理装置、画像処理方法およびプログラム
JP7481935B2 (ja) * 2020-07-21 2024-05-13 キヤノン株式会社 画像処理装置、画像処理方法
JP7543020B2 (ja) 2020-08-03 2024-09-02 キヤノン株式会社 画像処理装置、画像処理方法、およびプログラム

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6031627A (en) * 1996-10-01 2000-02-29 Seiko Epson Corporation Printing system and image recording method
US6250733B1 (en) * 1998-11-23 2001-06-26 Xerox Corporation Color printer halftoning method
US20030133606A1 (en) * 1998-06-18 2003-07-17 Kentaro Yano Quantization method, and recording apparatus and storage medium using the same
US6867884B1 (en) 2000-07-07 2005-03-15 Kodak Polychrome Graphics, Llc Halftone dot placement for multi-color images

Family Cites Families (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5289293A (en) 1989-03-14 1994-02-22 Canon Kabushiki Kaisha Pixel density conversion and processing
US6542642B2 (en) 1996-02-29 2003-04-01 Canon Kabushiki Kaisha Image coding process and motion detecting process using bidirectional prediction
JP3787398B2 (ja) 1996-11-27 2006-06-21 キヤノン株式会社 画像処理装置及びその方法
JP3667118B2 (ja) 1998-10-27 2005-07-06 キヤノン株式会社 記録装置および記録方法
JP2000197050A (ja) 1998-12-25 2000-07-14 Canon Inc 画像処理装置及び方法
JP2001232860A (ja) * 2000-02-24 2001-08-28 Canon Inc 記録装置用特別色の色相決定装置、その方法および記録媒体
JP3728191B2 (ja) * 2000-08-22 2005-12-21 キヤノン株式会社 色変換ルックアップテーブルの作成方法および装置
US7099046B2 (en) 2000-11-30 2006-08-29 Canon Kabushiki Kaisha Image processing apparatus and image processing method
US6648442B2 (en) * 2001-04-23 2003-11-18 Hewlett-Packard Development Company, L.P. Compensation for temperature dependent drop quantity variation
US20040218221A1 (en) * 2001-09-21 2004-11-04 Masanori Hirano Threshold value matrix creating method, image output system, storage medium, gradation reproducing method, threshold value matrix, image processing method, image processing apparatus, image forming apparatus and printer driver
US7312901B2 (en) 2002-03-15 2007-12-25 Canon Kabushiki Kaisha Image processing apparatus, image processing method, and program
JP3762319B2 (ja) 2002-03-15 2006-04-05 キヤノン株式会社 画像処理方法、画像処理装置及び画像処理システム
JP4095423B2 (ja) 2002-12-06 2008-06-04 キヤノン株式会社 画像処理装置、画像データ処理方法、記憶媒体、プログラム
KR100510132B1 (ko) * 2003-02-05 2005-08-26 삼성전자주식회사 컬러 영상의 이진화 장치 및 방법, 이에 사용되는 마스크생성장치 및 방법
JP5505029B2 (ja) * 2009-04-08 2014-05-28 セイコーエプソン株式会社 印刷装置、印刷方法およびディザマスクの作成方法
JP5330972B2 (ja) * 2009-11-27 2013-10-30 大日本スクリーン製造株式会社 画像記録装置、ハーフトーン画像データ生成装置および閾値マトリクス
JP5758675B2 (ja) * 2011-03-31 2015-08-05 理想科学工業株式会社 画像処理装置

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6031627A (en) * 1996-10-01 2000-02-29 Seiko Epson Corporation Printing system and image recording method
US20030133606A1 (en) * 1998-06-18 2003-07-17 Kentaro Yano Quantization method, and recording apparatus and storage medium using the same
US6250733B1 (en) * 1998-11-23 2001-06-26 Xerox Corporation Color printer halftoning method
US6867884B1 (en) 2000-07-07 2005-03-15 Kodak Polychrome Graphics, Llc Halftone dot placement for multi-color images

Also Published As

Publication number Publication date
US20160173725A1 (en) 2016-06-16
JP2016116227A (ja) 2016-06-23
JP6686121B2 (ja) 2020-04-22
EP3035663B1 (de) 2019-09-18
US9661181B2 (en) 2017-05-23
JP2019050629A (ja) 2019-03-28

Similar Documents

Publication Publication Date Title
EP3035663B1 (de) Bildverarbeitungsvorrichtung, bildverarbeitungsverfahren und programm
US10462333B2 (en) Image processing apparatus and image processing method quantizing first, second and third color data using first and second threshold matrices
US9636937B2 (en) Image processing apparatus, image processing method, and storage medium
US9815275B2 (en) Image processing apparatus, image processing method, and storage medium
US10469710B2 (en) Image processing apparatus and image processing method quantizing data for different types of ink based on a type of print operation to be performed
US10033906B2 (en) Image processing apparatus with improved quantization, image processing method and storage medium thereof
US10771657B2 (en) Image processing apparatus and image processing method quantizing first and second gradation data to generate first and second quantization data
US9704074B2 (en) Image processing apparatus and method for quantizing first and second multi-valued data
EP2439923A2 (de) Bildverarbeitungsvorrichtung, Bildverarbeitungsverfahren und Drucker
US10769506B2 (en) Image processing apparatus and image processing method quantizing gradation data to have a smaller number of gradations
US11657245B2 (en) Image processing apparatus, image processing method, and storage medium
US20240013507A1 (en) Image processing apparatus, image processing method, and non-transitory computer-readable storage medium storing program
US20240364837A1 (en) Image processing apparatus, image processing method, and non-transitory computer-readable storage medium
US10389910B2 (en) Image processing apparatus, image processing method, and storage medium
JP2018207501A (ja) 画像処理装置、記録装置、画像処理方法およびプログラム
WO2013179657A1 (en) Image processing apparatus and control method therefor

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20161222

RBV Designated contracting states (corrected)

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTG Intention to grant announced

Effective date: 20190523

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: CANON KABUSHIKI KAISHA

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602015038080

Country of ref document: DE

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 1182678

Country of ref document: AT

Kind code of ref document: T

Effective date: 20191015

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20190918

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190918

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190918

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190918

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20191218

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20191218

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190918

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190918

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190918

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190918

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20191219

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 1182678

Country of ref document: AT

Kind code of ref document: T

Effective date: 20190918

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190918

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200120

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190918

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190918

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190918

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190918

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190918

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190918

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190918

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190918

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200224

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190918

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602015038080

Country of ref document: DE

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

PG2D Information on lapse in contracting state deleted

Ref country code: IS

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190918

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200119

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

26N No opposition filed

Effective date: 20200619

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20191231

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190918

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190918

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20191218

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20191218

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20191216

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20191216

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20191231

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20191231

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20191231

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20191231

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190918

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20151216

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190918

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190918

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190918

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20231121

Year of fee payment: 9