EP1452319B1 - Printing method and printer with failure compensation - Google Patents
Printing method and printer with failure compensation Download PDFInfo
- Publication number
- EP1452319B1 EP1452319B1 EP04075451.7A EP04075451A EP1452319B1 EP 1452319 B1 EP1452319 B1 EP 1452319B1 EP 04075451 A EP04075451 A EP 04075451A EP 1452319 B1 EP1452319 B1 EP 1452319B1
- Authority
- EP
- European Patent Office
- Prior art keywords
- image
- failure
- strategy
- printhead
- printed
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Lifetime
Links
- 238000000034 method Methods 0.000 title claims description 53
- 230000011218 segmentation Effects 0.000 claims description 25
- 238000001914 filtration Methods 0.000 claims description 11
- 230000015654 memory Effects 0.000 claims description 8
- 230000003247 decreasing effect Effects 0.000 claims description 4
- 230000003213 activating effect Effects 0.000 claims 1
- 230000008569 process Effects 0.000 description 30
- 230000007547 defect Effects 0.000 description 14
- 230000000694 effects Effects 0.000 description 6
- 230000008901 benefit Effects 0.000 description 5
- 238000001514 detection method Methods 0.000 description 5
- 238000010586 diagram Methods 0.000 description 5
- 230000015556 catabolic process Effects 0.000 description 4
- 238000012545 processing Methods 0.000 description 4
- 239000003086 colorant Substances 0.000 description 3
- 230000002950 deficient Effects 0.000 description 3
- 230000007246 mechanism Effects 0.000 description 3
- 238000012360 testing method Methods 0.000 description 3
- 230000000007 visual effect Effects 0.000 description 3
- 238000004519 manufacturing process Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 238000000926 separation method Methods 0.000 description 2
- 239000007787 solid Substances 0.000 description 2
- 241000872198 Serjania polyphylla Species 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000004140 cleaning Methods 0.000 description 1
- 230000000295 complement effect Effects 0.000 description 1
- 238000005520 cutting process Methods 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000018109 developmental process Effects 0.000 description 1
- 230000001771 impaired effect Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000012423 maintenance Methods 0.000 description 1
- 230000000116 mitigating effect Effects 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000035945 sensitivity Effects 0.000 description 1
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B41—PRINTING; LINING MACHINES; TYPEWRITERS; STAMPS
- B41J—TYPEWRITERS; SELECTIVE PRINTING MECHANISMS, i.e. MECHANISMS PRINTING OTHERWISE THAN FROM A FORME; CORRECTION OF TYPOGRAPHICAL ERRORS
- B41J2/00—Typewriters or selective printing mechanisms characterised by the printing or marking process for which they are designed
- B41J2/005—Typewriters or selective printing mechanisms characterised by the printing or marking process for which they are designed characterised by bringing liquid or particles selectively into contact with a printing material
- B41J2/01—Ink jet
- B41J2/21—Ink jet for multi-colour printing
- B41J2/2132—Print quality control characterised by dot disposition, e.g. for reducing white stripes or banding
- B41J2/2139—Compensation for malfunctioning nozzles creating dot place or dot size errors
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B41—PRINTING; LINING MACHINES; TYPEWRITERS; STAMPS
- B41J—TYPEWRITERS; SELECTIVE PRINTING MECHANISMS, i.e. MECHANISMS PRINTING OTHERWISE THAN FROM A FORME; CORRECTION OF TYPOGRAPHICAL ERRORS
- B41J2/00—Typewriters or selective printing mechanisms characterised by the printing or marking process for which they are designed
- B41J2/005—Typewriters or selective printing mechanisms characterised by the printing or marking process for which they are designed characterised by bringing liquid or particles selectively into contact with a printing material
- B41J2/01—Ink jet
- B41J2/015—Ink jet characterised by the jet generation process
- B41J2/04—Ink jet characterised by the jet generation process generating single droplets or particles on demand
- B41J2/045—Ink jet characterised by the jet generation process generating single droplets or particles on demand by pressure, e.g. electromechanical transducers
- B41J2/04501—Control methods or devices therefor, e.g. driver circuits, control circuits
- B41J2/04508—Control methods or devices therefor, e.g. driver circuits, control circuits aiming at correcting other parameters
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B41—PRINTING; LINING MACHINES; TYPEWRITERS; STAMPS
- B41J—TYPEWRITERS; SELECTIVE PRINTING MECHANISMS, i.e. MECHANISMS PRINTING OTHERWISE THAN FROM A FORME; CORRECTION OF TYPOGRAPHICAL ERRORS
- B41J2/00—Typewriters or selective printing mechanisms characterised by the printing or marking process for which they are designed
- B41J2/005—Typewriters or selective printing mechanisms characterised by the printing or marking process for which they are designed characterised by bringing liquid or particles selectively into contact with a printing material
- B41J2/01—Ink jet
- B41J2/015—Ink jet characterised by the jet generation process
- B41J2/04—Ink jet characterised by the jet generation process generating single droplets or particles on demand
- B41J2/045—Ink jet characterised by the jet generation process generating single droplets or particles on demand by pressure, e.g. electromechanical transducers
- B41J2/04501—Control methods or devices therefor, e.g. driver circuits, control circuits
- B41J2/0451—Control methods or devices therefor, e.g. driver circuits, control circuits for detecting failure, e.g. clogging, malfunctioning actuator
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B41—PRINTING; LINING MACHINES; TYPEWRITERS; STAMPS
- B41J—TYPEWRITERS; SELECTIVE PRINTING MECHANISMS, i.e. MECHANISMS PRINTING OTHERWISE THAN FROM A FORME; CORRECTION OF TYPOGRAPHICAL ERRORS
- B41J2/00—Typewriters or selective printing mechanisms characterised by the printing or marking process for which they are designed
- B41J2/005—Typewriters or selective printing mechanisms characterised by the printing or marking process for which they are designed characterised by bringing liquid or particles selectively into contact with a printing material
- B41J2/01—Ink jet
- B41J2/015—Ink jet characterised by the jet generation process
- B41J2/04—Ink jet characterised by the jet generation process generating single droplets or particles on demand
- B41J2/045—Ink jet characterised by the jet generation process generating single droplets or particles on demand by pressure, e.g. electromechanical transducers
- B41J2/04501—Control methods or devices therefor, e.g. driver circuits, control circuits
- B41J2/04551—Control methods or devices therefor, e.g. driver circuits, control circuits using several operating modes
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B41—PRINTING; LINING MACHINES; TYPEWRITERS; STAMPS
- B41J—TYPEWRITERS; SELECTIVE PRINTING MECHANISMS, i.e. MECHANISMS PRINTING OTHERWISE THAN FROM A FORME; CORRECTION OF TYPOGRAPHICAL ERRORS
- B41J2/00—Typewriters or selective printing mechanisms characterised by the printing or marking process for which they are designed
- B41J2/005—Typewriters or selective printing mechanisms characterised by the printing or marking process for which they are designed characterised by bringing liquid or particles selectively into contact with a printing material
- B41J2/01—Ink jet
- B41J2/015—Ink jet characterised by the jet generation process
- B41J2/04—Ink jet characterised by the jet generation process generating single droplets or particles on demand
- B41J2/045—Ink jet characterised by the jet generation process generating single droplets or particles on demand by pressure, e.g. electromechanical transducers
- B41J2/04501—Control methods or devices therefor, e.g. driver circuits, control circuits
- B41J2/04586—Control methods or devices therefor, e.g. driver circuits, control circuits controlling heads of a type not covered by groups B41J2/04575 - B41J2/04585, or of an undefined type
Definitions
- the invention relates to a printing method for a printer comprising a transport system for a recording medium, and a printhead with a plurality of print units each of which is capable of printing a pixel line when the printhead is scanned over the recording medium, wherein a failure compensation unit controls the print operation such that a failure of a print unit is compensated.
- EP-A-0 981 105 which relates to an ink jet printer.
- the print units are formed by ink jet nozzles which are arranged in a linear array extending in the direction in which the recording medium is transported.
- a swath of an image can be printed, and the number of pixel lines in the swath corresponds essentially to the number of nozzles present in the printhead.
- Such a printer can generally operate in different print modes.
- a single-pass mode each nozzle of the printhead prints the complete image information of a pixel line during a stroke in which the printhead is moved over the paper. Then, the paper is transported over the width of the swath that has been printed, and the next swath is printed in a return stroke of the printhead.
- a two-pass mode may be applied, in which each nozzle prints only every second pixel of the corresponding line during the first stroke, and the missing pixels are inserted in the return stroke of the printhead. In this mode, the paper may be transported in steps which correspond to only half the length of the nozzle array.
- one half of the nozzles will be used for printing every second pixel of a new swath, whereas the other half of the nozzles is used for inserting the missing pixels in the swath that had been printed in the previous stroke.
- two different nozzles will be involved in printing all the pixels of a given pixel line.
- the above-mentioned document proposes a compensation strategy which employs the two-pass mode.
- the job of the inoperative nozzle is taken over by the nozzle which is normally utilized only for inserting the missing pixels.
- the scanning speed of the printhead is not reduced, this requires that the nozzle that is used for failure compensation is capable of printing pixels which twice the normal frequency.
- EP-A-1 060 896 discloses a failure compensation strategy which is also applicable in a single-pass mode. When, in the event of breakdown of a nozzle, a specific pixel should but cannot be printed with the inoperative nozzle, this pixel is transferred to an addressable position in the vicinity of the designated pixel position, so that it can be printed with another nozzle. This strategy helps to prevent loss of information but will not fully compensate the nozzle failure and is in many cases sufficient for suppressing the visual effect of the nozzle failure below acceptable limits.
- Another known failure compensation strategy is particularly applicable to the case where a breakdown of a nozzle or, more generally, a print unit occurs near the end of the nozzle array. Then, an end section of the nozzle array, which section includes the inoperative nozzle, is cut-off, i.e. the nozzles of this section are disabled. As a result, the usable length of the nozzle array is somewhat reduced, and the swath of the image that is printed in a single stroke is reduced in width. By adapting the transport width of the recording medium to the reduced width of the swath, a defect-free image can be printed, although on the cost of productivity.
- failure compensation involves a tradeoff between productivity and image quality.
- EP-A-983855 discloses the preamble of claim 1.
- the printing method according to the invention is characterized by the steps of
- a segmentation process may be employed for analyzing the contents of an image to be printed and for identifying different types of image information such as text, CAD graphics, photographs and the like. In this way, it is possible for example to identify those parts of a page to be printed which contain photographs for which a halftone processing of the print data is necessary, whereas other parts of the page, e.g., text, do not need halftone processing.
- a segmentation process may also be used for automatically adapting the operation mode of the printer to the type of image information to be printed, so that different segments of a page may respectively be printed with the most suitable operation mode of the printer.
- US-A-6 149 264 discloses a printer in which a page to be printed is segmented into text areas and graphic areas, and a single-pass mode is adapted for text, whereas graphic data are printed in a two-pass mode.
- segmentation is employed for automatically switching between different failure compensation strategies, so that each segment of the image will be printed with a failure compensation strategy that is most suitable for the type of image information contained in the respective segment.
- the shift-type failure compensation strategy disclosed in EP-A-1 060 896 in which the black pixels that cannot printed are shifted to neighbouring locations, will be most suitable for relatively bright image areas, i.e. image areas in which the density of black pixels is comparatively low, so that a sufficient number of white pixel locations is available to which the black pixels may be shifted.
- relatively dark image area e.g. a solid black area
- this compensation strategy is likely to lead to a visible defect in the printed image.
- it would therefore be preferable to adopt one of the other failure compensation strategies discussed above which are capable of fully compensating the defect but which will generally lead to certain losses in productivity.
- the independent product claim 14 relates to a printer adapted for carrying out the method according to the invention.
- the segments identified in the segmentation process will preferable consist of swaths or bands that extend over the whole width of the page and correspond to an integral number of strokes of the printhead. Then, the part of the segment that is most sensitive to failure of a print unit will determine the compensation strategy to be adopted.
- the printer comprises a failure detection system which automatically detects failures of print units, so that appropriate failure compensation strategies may be activated automatically. Failure detection and compensation may even be performed "on the fly", i.e. while the printer is operating. Then, when a nozzle failure occurs at a time when the printer has printed a part of a page, the failure compensation unit will be activated immediately, so that the printer can continue with printing the rest of the page with failure compensation. Thus, visible defects in the printed image will only occur in the relatively short delay time between the detection of a nozzle failure and the time when the failure compensation unit becomes effective.
- This problem may be solved according to the invention by configuring or programming the segmentation unit to search for critical (nozzle failure sensitive) image items such as thin horizontal lines, so that an appropriate failure compensation strategy may be applied proactively or precautionarily.
- the ultimate failure compensation strategy can only be determined when the exact location is known where the nozzle failure has occurred, and this information will be available only a certain time after the failure has been detected.
- the defect may be compensated in the second pass. If the failure is detected only in the second pass, at least every second pixel in the defective line will have been printed already in the first pass, so that the visible effect of the failure is at least mitigated and complete loss of information is avoided.
- At least two and preferably more than two different failure compensation strategies are implemented in the printer, e.g. by storing appropriate compensation programs in the memory of the failure compensation unit, and these compensation strategies are ordered in a sequence with increasing image quality and decreasing productivity.
- the segmentation process comprises a step of specifying for each segment a minimum requirement for the image quality, depending on the image information contained in the segment, and the controller will select the first compensation strategy in the sequence that fulfils this minimum requirement.
- the darkness or brightness of an image area is an important criterion for selecting the failure compensation strategy.
- this criterion may be quantified by measuring a primary image classifier which is a measure for the darkness or the brightness of the image area.
- a suitable primary image classifier may for example be the average number of black pixels contained in a given basic area. The minimum requirement for the image quality and hence the failure compensation strategy to be applied may then be determined simply by setting threshold values to which the primary image classifiers are compared.
- each classifier may then be compared to an associated threshold value, and the comparison results may be filtered with an appropriate filter in order to determine the ultimate compensation strategy.
- a defect in the printed image which defect may be the result of an incomplete failure compensation, is less perceptible to the human eye when there exists a high level of high-frequency contrast in the vicinity of the defect.
- the context filter may be applied to the primary classifiers or, alternatively, to the associated threshold values, e.g. by shifting the threshold values depending on the level of contrast in the basic area or the vicinity thereof.
- the size of the segments determined in the segmentation process will naturally be adapted to the pattern of swaths printed by the printhead, i.e. the length of the nozzle array in the direction of paper transport. Since a frequent switching between different failure compensation strategies and, especially, a frequent switching between single-pass and multi-pass, may itself lead to a loss in productivity, it is preferable to apply a low-pass filter to the segments in order to reduce the number of switch operations.
- the invention is not only applicable to black and white printers but also to colour printers.
- the hybrid failure compensation process described above may be applied individually to each colour separation image, preferably with different segmentation criteria for the different colours, because, for example, a defect in a yellow colour separation will be less visible than one in cyan.
- additional inter-colour failure compensation strategies For example, in four colour printing with the basic colours yellow, cyan, magenta and black with subtractive colour composition, a failure of a black nozzle may be compensated by superimposing yellow, magenta and cyan pixels. Consequently, a failure of a cyan nozzle, for example, may be compensated to some extent by inserting black pixels so as to reproduce at least the grey level of the surroundings.
- an ink jet printer comprises a platen 10 driven for rotation in the direction of an arrow A for transporting a paper sheet 12 which serves as an image recording medium.
- a printhead 14 is mounted on a carriage 16 which is guided on guide rails 18 and travels back and forth in the direction of an arrow B along the platen 10 so as to scan the paper sheet 12.
- the printhead 14 comprises four nozzle heads 20, one for each of the basic colours yellow, cyan, magenta and black.
- each nozzle head 20 On the side facing the sheet 12, each nozzle head 20 has a linear array of nozzles 22.
- the nozzle heads 20 are energized in accordance with image information of an image to be printed on the sheet 12.
- Each nozzle 22 can be energized separately so as to eject an ink droplet which will form a dot at a corresponding pixel position on the sheet 12.
- each nozzle 22 can be energized to draw a single pixel line of the intended image.
- the printhead 14 will print a swath or band of the image, and the number of pixel lines of the swath will correspond to the number of nozzles 22 present in each nozzle array.
- the number of nozzles will be considerably larger.
- Each nozzle head 20 has an electronic failure detector 24 capable of detecting failure of a nozzle in the associated nozzle head.
- the failure detector will also indicate the location of the nozzle or nozzles that have become inoperative.
- a failure detector may be provided near one end of the platen 10 in a position outside of the area of the sheet 12, and when the carriage has reached the position of this detector at the end of a stroke, the detector will check whether ink droplets have actually been expelled from each of the nozzles 22.
- one of a plurality of failure compensation strategies will be called-up in order to compensate for the breakdown of the nozzle or nozzles, as will be explained in detail below.
- Figure 2 shows an example of an image of a page 26 to be printed.
- the image comprises a number of image items 28, 30, 32 and 34 which include different types of image information.
- item 28 is a relatively dark narrow horizontal bar
- item 30 is a photograph with comparatively large dimensions and a comparatively high average darkness
- item 32 is a thin horizontal line which has only a width of a single pixel
- item 34 is a text item.
- the photograph 30 is relatively sensitive to nozzle failure, because a missing pixel line would be clearly visible on the dark background.
- the thin horizontal line 32 is also very sensitive to nozzle failure, because a failure of the pertinent nozzle would lead to a complete loss of image information.
- the items 28 and 34 are less sensitive to nozzle failure, because a missing pixel line would always be located in the vicinity of a borderline where there exists a sharp contrast between dark and bright which would somewhat shield the image defect so that the latter is less perceptible.
- the items 30 and 32 would require a failure compensation strategy which results in a high image quality and avoids a complete loss of image information, respectively. Such compensation strategies will generally require a slower operation mode of the printhead, so that the time required for printing the page 26 would be increased.
- the items 28 and 34 would permit a failure compensation strategy which only mitigates the effect of the nozzle failure rather than completely compensating the same, and such failure compensation strategies permit a higher printing speed.
- a segmentation process is applied to the image in order to identify the different image items and to evaluate the type of image information contained therein.
- two preliminary segments 36 and 38 corresponding to the items 30 and 32 are indicated in dot-dashed lines. Since a failure compensation strategy will always apply to one or more complete strokes of the printhead 14, the segments 36 and 38 each extend over the whole width of the page 26. For simplicity, it is assumed here that the rest of the page 26, i.e. the areas outside of the segments 36 and 38 form segments that can be printed with a simple, relatively fast failure compensation strategy.
- Figure 3 shows the page 26 divided into a number of swaths 40 which are each printed in a single stroke of the printhead 14. It is assumed here that the printer operates in a single-pass mode, so that the swaths 40 are not or hardly overlapping, and the sheet 12 will be transported by the width of a single swath after each stroke of the printhead.
- the size of the segments 36, 38 has been matched to the raster of the swaths 40. It can be seen that the segments 36 and 38 are separated only by a single swath. As an example, it shall be assumed that the failure compensation strategy adopted for the segments 36 and 38 requires a two-pass mode, in which there is an overlap of 50% between the swaths covered by the printhead in the forward stroke and the rearward stroke. This has been symbolized by dot-lines 42 above and below the segment 38. When the print mode is switched from single-pass to two-pass or vice versa, one half of a swath must be wasted.
- Figure 6 is a block diagram of a failure compensation unit 46 of the printer.
- the failure compensation unit may be configured as a physical unit comprising one or more processors, memories and the like or may be implemented in the general control software of the printer.
- the image data to be printed are input as a pixel bit stream 48 and are buffered in a print data file 50.
- a memory 52 includes a number (5 in the given example) of failure compensation strategies, e.g. in the form of program code. The failure compensation strategies will be described below.
- a segmentation unit 54 receives detection signals from the failure detectors 24 and has access to the data file 50 so as to perform the segmentation process described above with reference to figures 2 to 5 .
- the result is a strategy file 56 which assigns one of the failure compensation strategies stored in the memory 52 to each of the (single-pass) swaths 40.
- the swaths are counted from the bottom of the page 26 in figure 5 .
- swaths No. 6 to 11 form the segment 44 for which the compensation strategy No. 5 is applied, whereas strategy No. 1 is applied to the rest of the page.
- a controller 58 reads the strategy file 56 and calls-up the failure compensation strategies from the memory 52 as determined by the strategy file.
- the controller also reads the image data file 50, modifies the image data in accordance with the pertinent failure compensation strategy and outputs the modified image data 60 to the nozzle heads 20 and generates control data 62 to be output to other components of the printer such as carriage drive, paper transport and the like, so that the image will be printed in accordance with the failure compensation strategies as scheduled in the strategy file.
- Strategy No. 1 which is called "single-pass and shift" is illustrated in figure 7 .
- the image of the pertinent segment consists of two slanting lines having each a width of two pixels and separated by a gap of three white pixels.
- the printer operates in the single-pass mode, so that all the information of a given pixel line has to be printed with only one nozzle of the nozzle head 20 for the respective colour. It is assumed that a nozzle failure has occurred in pixel line 64. Consequently, the pixels in line 64 and columns 66, 68, 70 and 72 should but cannot be printed with the pertinent nozzle, and a defect in the form of a white pixel line occurs in the printed image.
- the pixels in columns 66-72 are shifted either upwards into the line above line 64 or downward into the line below line 64.
- the pixel cannot be shifted upwards because the pixel thereabove would be black anyway. This is why this pixel is shifted downward to the location 74.
- the pixel in column 68 is shifted from line 64 into the line immediately thereabove. The same holds true for the pixels in columns 72 and 70, respectively.
- the average darkness of the image is conserved even in the vicinity of the line 64.
- the pixel size is largely exaggerated in figure 7 and will in practice be close to the limit of spatial resolution of the human eye, the resulting visual impression is fully acceptable.
- This failure compensation strategy also conserves the full productivity of the printer, because the operating speed of the printhead need not be reduced. However, this strategy would be less effective if the segment to be printed would consist of a solid black area.
- Failure compensation strategy No. 2 "single-pass and cut" is slightly less productive but permits a complete failure compensation.
- This strategy which is illustrated in figure 8 , is applicable when a nozzle failure occurs in a top or bottom end portion of the nozzle array of a nozzle head 20.
- the nozzle head 20 is symbolized by a rectangle, and an end portion 76 containing the inoperative nozzle has been hatched.
- the compensation strategy consists of cutting away, i.e. disabling the nozzles in the end portion 76, so that the swath 40' that is actually printed has a slightly reduced width. The paper transport distance at the end of a printhead stroke is reduced accordingly, so that the swaths 40 are seamlessly butted together, as can be seen in figure 8 .
- Figure 9 illustrates a modification of this strategy, which is even less productive but permits to compensate a nozzle failure in a central portion 78 of the nozzle head 20.
- the central portion 78 having a length of one third of the complete nozzle array is disabled, so that the swath printed in a single stroke consists of two separate sub-swaths 40a, 40b.
- the gap between these swaths is inserted in the return stroke by the swath 40a, i.e. the swaths 40a and 40b are interleaved.
- this strategy has not been implemented.
- a two-pass mode or, more generally, a multi-pass mode has the advantage that two or more nozzles are involved in printing a single pixel line, so that a nozzle failure will affect only some of the pixels in the line.
- FIG 10 where, in lines 1-8, all pixels having an odd column number have been printed in a forward pass n. In lines 1-4, even-numbered pixels had been printed already in a previous return pass n-1. Due to a breakdown of a nozzle 22', pixels are missing in lines 3, 7 and 3'.
- every second pixel can still be printed with an operative nozzle 22".
- the black pixels in line 3 have been printed in the same way.
- switching to a two-pass mode has the effect that, even in case of a nozzle failure, the corresponding pixel line will not be missing completely but is still printed with an optical density of 50%.
- the carriage 16 travelling along the platen 10 is driven with twice the normal speed, while the dot generation frequency of the nozzles 22 is kept at the original value.
- the productivity is almost as high as in the single- pass mode.
- a certain loss in productivity is caused by the necessity to decelerate the carriage 16 and to reverse its direction of movement more frequently.
- the strategy No. 3 is less productive than the strategy No. 1 and even less productive than the strategy No. 2, if the cut-away portion 76 of the nozzle array is relatively short.
- a multipass mode leads to an improvement in the overall image quality because defects resulting from dot position errors, for example, can be smoothened out.
- the failure compensation strategy No. 5 "single pass slow and insert" is illustrated in figure 12 .
- the two-pass mode is adopted, but the carriage is moved only with the normal speed, and the dot generation frequency of most of the nozzles 22 is reduced to 50%.
- the productivity of the print process is also reduced to 50%.
- this strategy has the advantage that a complete failure compensation can be achieved even in cases where nozzle failure occurs in a central portion of the nozzle array, so that the cut strategy of figure 8 would not work, or in cases where nozzle failure occurs for two adjacent nozzles, so that the shift strategy would not work.
- the complementary nozzle 22" is operated with the normal drop generation frequency, i.e. twice the frequency of the other nozzles, so that all the pixels missing in line 7 can be filled-in with the nozzle 22".
- the printer operates with a nominal dot generation frequency of 10 kHz, for example, but is also capable of operating with twice the nominal dot generation frequency, i.e. 20 kHz.
- the mode with the nominal frequency will then be used for example in a quality mode in order to achieve an optimal image quality, whereas the mode with double frequency, in which the image quality may be slightly less, will be adopted in a draft mode, for example.
- the strategy shown in figure 12 may be applied with the nominal dot generation frequency and double carriage speed, and only the nozzle 22" will be operated with double frequency, so that a higher productivity can be achieved.
- FIG. 13 shows a pixel pattern of a portion of an image to be printed, as specified in the data file 50.
- most of the area has a grey level of 50%, i.e. one half of the pixels is black and the other half is white.
- the image area is divided into square basic areas of, preferably, 32 x 32 pixels, although only 8 x 8 pixels have been shown in the drawing.
- One basic area 80 has been highlighted in figure 13 by a white borderline.
- a first step in the segmentation process consists of measuring the average brightness of each basic area by counting the number of white pixels. This average brightness will be taken as a primary image classifier for determining the failure compensation strategy to be applied.
- the value 0 is assigned to black pixels, and the value 255 is assigned to white pixels.
- the average image value of the basic area 80 will be 127.
- a high value of the primary image classifier means that a rather productive failure compensation strategy, e.g. strategy No. 1, can be applied, whereas a low primary image classifier means that one of the high quality strategies, e.g. strategy No. 5, has to be applied.
- the primary image classifiers are subjected to context filtering in view of the fact that a defect caused by a nozzle failure will be less visible when it occurs near a border between the dark area and an adjacent bright area.
- a square window of 5 x 5 basic areas is shifted over the image, with the basic area 80 that is currently inspected being in the center of this window.
- the 5 x 5 window surrounding the basic area 80 is indicated as the base of a pyramid 82.
- the primary image classifiers measured for each of the 25 basic areas in the window 82 are subjected to maximum filtering.
- the maximum is also 127, as is indicated on the top of the pyramid symbolizing the window 82.
- the window which is now symbolized by a pyramid 86 shown in dashed lines, includes also a brighter basic area 88 which has a basic image classifier of 191. Then, maximum filtering leads to a filtered image value of 191 for the basic area 84. In this way, by shifting the window over the whole page 26, a filtered primary classifier is obtained for each basic area.
- the next step consists of comparing the filtered primary classifiers to appropriate threshold values.
- the filtered primary classifiers of all basic areas in a row extending over the whole width of the page 26 exceed the highest threshold value, then this row of basic areas can be classified as part of a segment to which the failure compensation strategy No. 1 applies.
- this row will be classified as part of a segment to which failure compensation strategy No. 5 applies.
- the provisional segment 36 shown in figure 2 can be obtained, whereas the items 28, 32 and 34 have passed the context filtering procedure for strategy No. 1.
- the segment 38 corresponding to the single pixel line 32 is obtained by a different process, as will be explained below.
- Figure 14 is a flow chart illustrating a more elaborated segmentation process.
- step 100 the data file 50 is read-in.
- step 101 the whole image of the page 26 is checked for thin horizontal lines such as the line 32 in figure 2 . This is achieved by conventional image processing techniques that are known in the art. If one or more of such horizontal lines are found, a proactive failure compensation strategy is scheduled in step 102.
- This step includes the identification of the segment 38, as in figure 2 , and the matching of the segment to the swath width, as in figure 4 .
- the steps 100 - 102 are performed before the operation of the printhead 14 starts. It is further specified in step 102 that the failure compensation strategy No. 5 shall be adopted for the segment 38, even though it is not known at that instant whether a nozzle failure will actually occur and which nozzle will be affected. In any case, a two-pass mode will be scheduled for this segment. This has the advantage that the failure compensation process can readily be activated if the demand occurs. Thus, a complete loss of information can reliably be avoided.
- step 102 the printhead 14 is started to operate in step 104. If no thin horizontal lines have been found in step 101, then the step 102 is skipped.
- step 105 it is checked by means of the failure detectors 24 whether or not a nozzle failure has occurred, and the location of the nozzle failure or failures is communicated to the segmentation unit 54. If no nozzle failure has been detected, the step 105 is repeated in a loop while the page is being printed.
- threshold values Tij for the segmentation process are set in step 106.
- primary image classifiers Bj are measured for basic areas (such as 80) with different sizes, e.g. with sizes of 8 ⁇ x ⁇ 8, 16 x 16, 32 x 32 pixels and so on (and possibly also for different window sizes such as 5 x 5 or 3 x 3 basic areas).
- the second index j of the classifiers Bjand of the threshold values Tij identifies the type or size of basic area to which the classifiers and threshold values apply.
- step 107 the primary classifiers Bj are measured for the various sizes of the basic areas, of course always for rows of basic areas extending over the whole width of the page 26.
- step 108 context filtering is applied individually to each set of primary classifiers Bj.
- step 109 the index i is set to 1.
- step 110 it is checked whether all the filtered primary classifiers Bj for all sizes of the basic areas and for all basic areas in the row are larger than the maximum max j (Tij) of the threshold values Tij. Since, in the present instant, i has been set to 1, the maximum is taken over the threshold values T1j. If the condition checked in step 110 is fulfilled, the failure compensation strategy i (1) is adopted in step 111. Since the values Bj have been compared to the maximum of the threshold values T1j in step 110, the failure compensation strategy No. 1 with the highest productivity will be applied only if the values Bj for all sizes of the basic areas have passed the test in step 110.
- step 110 If the test in step 110 has failed, it is checked in step 111 whether the index i has reached the maximum value 5. If this is not the case, i is incremented in step 113, and the process loops back to step 110. Thus, the loop consisting of the steps 110, 111, 112 and 113 identifies the failure compensation strategy with the highest productivity which still provides a sufficient image quality for the segment that is being inspected. If none of the strategies No. 1-4 has passed the test in step 110, the loop is exited with step 114 where the strategy No. 5 for highest quality is scheduled.
- step 111 or step 114 the process loops back to step 105, where it is checked whether a new nozzle failure has occurred while the print process proceeds. It will be understood that the steps 105 through 114 are repeated until the whole page 26 or at least a certain number of adjacent swaths 40 has been examined with basic areas of all sizes, thereby to determine the dimensions of the segments 36, 38 as in figure 4 . Finally, although this is not shown in figure 14 , the segments are subjected to low-pass filtering in order to remove unreasonably small gaps between segments of the same type, as has been shown in figure 5 .
- step 106 The threshold values Tij determined in step 106 may of course depend upon the locations of the defective nozzles as detected in step 105. Thus, step 106 should be performed after step 105. However, the steps 107 and 108 may be performed prior to step 106 or to step 105 or even before the print process has started in step 104. This will reduce the processing time needed after a nozzle failure has been detected and will therefore permit to react more quickly when a nozzle failure occurs.
- the nozzle failures detected in step 105 may be stored in a nonvolatile memory, so that they are readily available when the printer has been switched off and is switched on again at a later time.
- the invention may also permit to tolerate a certain number of nozzle failures for a virgin printhead, and thereby to increase the yield in the manufacturing process of the printhead.
Landscapes
- Engineering & Computer Science (AREA)
- Quality & Reliability (AREA)
- Ink Jet (AREA)
Description
- The invention relates to a printing method for a printer comprising a transport system for a recording medium, and a printhead with a plurality of print units each of which is capable of printing a pixel line when the printhead is scanned over the recording medium, wherein a failure compensation unit controls the print operation such that a failure of a print unit is compensated.
- An example of a printer of this type is disclosed in
EP-A-0 981 105 , which relates to an ink jet printer. In the printhead of this printer, the print units are formed by ink jet nozzles which are arranged in a linear array extending in the direction in which the recording medium is transported. Thus, when the printhead is scanned over the recording medium, a swath of an image can be printed, and the number of pixel lines in the swath corresponds essentially to the number of nozzles present in the printhead. - Such a printer can generally operate in different print modes. In a single-pass mode, each nozzle of the printhead prints the complete image information of a pixel line during a stroke in which the printhead is moved over the paper. Then, the paper is transported over the width of the swath that has been printed, and the next swath is printed in a return stroke of the printhead. As an alternative, a two-pass mode may be applied, in which each nozzle prints only every second pixel of the corresponding line during the first stroke, and the missing pixels are inserted in the return stroke of the printhead. In this mode, the paper may be transported in steps which correspond to only half the length of the nozzle array. Then, one half of the nozzles will be used for printing every second pixel of a new swath, whereas the other half of the nozzles is used for inserting the missing pixels in the swath that had been printed in the previous stroke. As a result, two different nozzles will be involved in printing all the pixels of a given pixel line.
- If a nozzle of the printhead has become clogged or fails for any other reason, the pixels that would have been printed with the inoperative nozzle will be missing in the printed image, and the image quality will be impaired. A variety of failure compensation strategies are known for avoiding or mitigating this undesirable effect.
- For example, the above-mentioned document proposes a compensation strategy which employs the two-pass mode. Here, the job of the inoperative nozzle is taken over by the nozzle which is normally utilized only for inserting the missing pixels. Of course, if the scanning speed of the printhead is not reduced, this requires that the nozzle that is used for failure compensation is capable of printing pixels which twice the normal frequency.
-
EP-A-1 060 896 discloses a failure compensation strategy which is also applicable in a single-pass mode. When, in the event of breakdown of a nozzle, a specific pixel should but cannot be printed with the inoperative nozzle, this pixel is transferred to an addressable position in the vicinity of the designated pixel position, so that it can be printed with another nozzle. This strategy helps to prevent loss of information but will not fully compensate the nozzle failure and is in many cases sufficient for suppressing the visual effect of the nozzle failure below acceptable limits. - Another known failure compensation strategy is particularly applicable to the case where a breakdown of a nozzle or, more generally, a print unit occurs near the end of the nozzle array. Then, an end section of the nozzle array, which section includes the inoperative nozzle, is cut-off, i.e. the nozzles of this section are disabled. As a result, the usable length of the nozzle array is somewhat reduced, and the swath of the image that is printed in a single stroke is reduced in width. By adapting the transport width of the recording medium to the reduced width of the swath, a defect-free image can be printed, although on the cost of productivity.
- In general, unless redundant nozzles are present in the printhead, failure compensation involves a tradeoff between productivity and image quality.
-
EP-A-983855 claim 1. - It is an object of the invention to provide a printing method and a printer that are capable of optimizing the failure compensation strategy in terms of productivity and image quality for a large variety of images to be printed.
- To this end, the printing method according to the invention is characterized by the steps of
- storing a plurality of failure compensation strategies,
- dividing an image to be printed into segments containing different types of image information, and
- selecting different ones of the stored compensation strategies for printing different segments of the image.
- As is generally known in the art, a segmentation process may be employed for analyzing the contents of an image to be printed and for identifying different types of image information such as text, CAD graphics, photographs and the like. In this way, it is possible for example to identify those parts of a page to be printed which contain photographs for which a halftone processing of the print data is necessary, whereas other parts of the page, e.g., text, do not need halftone processing. A segmentation process may also be used for automatically adapting the operation mode of the printer to the type of image information to be printed, so that different segments of a page may respectively be printed with the most suitable operation mode of the printer. For example,
US-A-6 149 264 discloses a printer in which a page to be printed is segmented into text areas and graphic areas, and a single-pass mode is adapted for text, whereas graphic data are printed in a two-pass mode. - According to the invention, segmentation is employed for automatically switching between different failure compensation strategies, so that each segment of the image will be printed with a failure compensation strategy that is most suitable for the type of image information contained in the respective segment.
- For example, the shift-type failure compensation strategy disclosed in
EP-A-1 060 896 , in which the black pixels that cannot printed are shifted to neighbouring locations, will be most suitable for relatively bright image areas, i.e. image areas in which the density of black pixels is comparatively low, so that a sufficient number of white pixel locations is available to which the black pixels may be shifted. In contrast, in a relatively dark image area, e.g. a solid black area, this compensation strategy is likely to lead to a visible defect in the printed image. In order to achieve a high image quality in such dark image areas, it would therefore be preferable to adopt one of the other failure compensation strategies discussed above which are capable of fully compensating the defect but which will generally lead to certain losses in productivity. It is a main advantage of the invention that, when a page to be printed contains both, dark and bright image areas, it is not necessary to use a relatively slow failure compensation strategy, which assures a good image quality in the dark areas, for the whole page, but is is possible to use this slower strategy only where it is actually needed, whereas other parts of the page, i.e. the bright image areas, can be printed with a more productive failure compensation strategy which nevertheless provides a sufficient image quality in these areas. As a result, it is possible to achieve a satisfactory image quality and nevertheless to increase the overall productivity of the print operation. - The
independent product claim 14 relates to a printer adapted for carrying out the method according to the invention. - Useful details and further developments of the invention are indicated in the dependent claims.
- Although it would be feasible to change the failure compensation strategy even within a single stroke of the printhead, it will generally be more efficient to retain one and the same compensation strategy for a complete printhead stroke. Thus, the segments identified in the segmentation process will preferable consist of swaths or bands that extend over the whole width of the page and correspond to an integral number of strokes of the printhead. Then, the part of the segment that is most sensitive to failure of a print unit will determine the compensation strategy to be adopted.
- In a preferred embodiment, the printer comprises a failure detection system which automatically detects failures of print units, so that appropriate failure compensation strategies may be activated automatically. Failure detection and compensation may even be performed "on the fly", i.e. while the printer is operating. Then, when a nozzle failure occurs at a time when the printer has printed a part of a page, the failure compensation unit will be activated immediately, so that the printer can continue with printing the rest of the page with failure compensation. Thus, visible defects in the printed image will only occur in the relatively short delay time between the detection of a nozzle failure and the time when the failure compensation unit becomes effective.
- In some cases, however, even a short delay time between failure detection and failure compensation may lead to an unacceptable loss of image information. This is particularly the case when a thin horizontal line has to be printed, i.e. a line which extends in the scanning direction of the printhead and has a width of only a single pixel.
- Then, when the nozzle that is responsible for printing this pixel line becomes defective, the whole line will disappear. If, in that instant, the printer is in the single-pass mode, there will be no efficient way to compensate this defect.
- This problem may be solved according to the invention by configuring or programming the segmentation unit to search for critical (nozzle failure sensitive) image items such as thin horizontal lines, so that an appropriate failure compensation strategy may be applied proactively or precautionarily. Of course, the ultimate failure compensation strategy can only be determined when the exact location is known where the nozzle failure has occurred, and this information will be available only a certain time after the failure has been detected. However, it is possible and advisable to proactively adopt a multi-pass print mode for such critical segments, so that the powerful failure compensation strategies that require a multi-pass mode are readily available. Then, when a nozzle failure is detected in the first pass of a two-pass mode, the defect may be compensated in the second pass. If the failure is detected only in the second pass, at least every second pixel in the defective line will have been printed already in the first pass, so that the visible effect of the failure is at least mitigated and complete loss of information is avoided.
- According to another optional feature of the invention, at least two and preferably more than two different failure compensation strategies are implemented in the printer, e.g. by storing appropriate compensation programs in the memory of the failure compensation unit, and these compensation strategies are ordered in a sequence with increasing image quality and decreasing productivity. Then, the segmentation process comprises a step of specifying for each segment a minimum requirement for the image quality, depending on the image information contained in the segment, and the controller will select the first compensation strategy in the sequence that fulfils this minimum requirement.
- As has been mentioned already, the darkness or brightness of an image area is an important criterion for selecting the failure compensation strategy. In the segmentation process, this criterion may be quantified by measuring a primary image classifier which is a measure for the darkness or the brightness of the image area. In case of bi-level print process in which a single pixel can be printed only either in black or in white, a suitable primary image classifier may for example be the average number of black pixels contained in a given basic area. The minimum requirement for the image quality and hence the failure compensation strategy to be applied may then be determined simply by setting threshold values to which the primary image classifiers are compared. In order to increase the sensitivity of the segmentation process, there may be provided a set of different primary image classifiers which differ from one another in the size of the basic area. Each classifier may then be compared to an associated threshold value, and the comparison results may be filtered with an appropriate filter in order to determine the ultimate compensation strategy.
- It has been observed that a defect in the printed image, which defect may be the result of an incomplete failure compensation, is less perceptible to the human eye when there exists a high level of high-frequency contrast in the vicinity of the defect. In order to take advantage of this effect, it is preferable to employ a context filtering procedure in the segmentation process. The context filter may be applied to the primary classifiers or, alternatively, to the associated threshold values, e.g. by shifting the threshold values depending on the level of contrast in the basic area or the vicinity thereof.
- The size of the segments determined in the segmentation process will naturally be adapted to the pattern of swaths printed by the printhead, i.e. the length of the nozzle array in the direction of paper transport. Since a frequent switching between different failure compensation strategies and, especially, a frequent switching between single-pass and multi-pass, may itself lead to a loss in productivity, it is preferable to apply a low-pass filter to the segments in order to reduce the number of switch operations.
- The invention is not only applicable to black and white printers but also to colour printers. In a colour printer, the hybrid failure compensation process described above may be applied individually to each colour separation image, preferably with different segmentation criteria for the different colours, because, for example, a defect in a yellow colour separation will be less visible than one in cyan. In case of a colour printer, it is also possible to employ additional inter-colour failure compensation strategies. For example, in four colour printing with the basic colours yellow, cyan, magenta and black with subtractive colour composition, a failure of a black nozzle may be compensated by superimposing yellow, magenta and cyan pixels. Consequently, a failure of a cyan nozzle, for example, may be compensated to some extent by inserting black pixels so as to reproduce at least the grey level of the surroundings.
- A preferred embodiment of the invention will now be described in conjunction with the drawings, in which:
- Fig. 1
- is a diagram showing essential parts of an ink jet printer to which the invention is applicable;
- Figs. 2 to 5
- show images of a page to be printed, for illustrating the effect of a segmentation process;
- Fig. 6
- is a block diagram of a failure compensation unit of the printer;
- Figs. 7-12
- are diagrams for explaining different failure compensation strategies;
- Fig. 13
- is a diagram illustrating a step in the segmentation process; and
- Fig. 14
- a flow chart of a process for selecting a failure compensation strategy in a print process.
- As is shown in
figure 1 , an ink jet printer comprises aplaten 10 driven for rotation in the direction of an arrow A for transporting apaper sheet 12 which serves as an image recording medium. Aprinthead 14 is mounted on acarriage 16 which is guided onguide rails 18 and travels back and forth in the direction of an arrow B along theplaten 10 so as to scan thepaper sheet 12. Theprinthead 14 comprises four nozzle heads 20, one for each of the basic colours yellow, cyan, magenta and black. On the side facing thesheet 12, eachnozzle head 20 has a linear array ofnozzles 22. The nozzle heads 20 are energized in accordance with image information of an image to be printed on thesheet 12. Eachnozzle 22 can be energized separately so as to eject an ink droplet which will form a dot at a corresponding pixel position on thesheet 12. Thus, when theprinthead 14 performs a single stroke along theplaten 10, eachnozzle 22 can be energized to draw a single pixel line of the intended image. As a result, during each forward or backward stroke of thecarriage 16, theprinthead 14 will print a swath or band of the image, and the number of pixel lines of the swath will correspond to the number ofnozzles 22 present in each nozzle array. Although only eightnozzles 22 have been shown pernozzle head 20 infigure 1 , in practice, the number of nozzles will be considerably larger. - Each
nozzle head 20 has anelectronic failure detector 24 capable of detecting failure of a nozzle in the associated nozzle head. The failure detector will also indicate the location of the nozzle or nozzles that have become inoperative. As an alternative, a failure detector may be provided near one end of theplaten 10 in a position outside of the area of thesheet 12, and when the carriage has reached the position of this detector at the end of a stroke, the detector will check whether ink droplets have actually been expelled from each of thenozzles 22. - When a failure of one or more of the
nozzles 22 has been detected by thefailure detectors 24, one of a plurality of failure compensation strategies will be called-up in order to compensate for the breakdown of the nozzle or nozzles, as will be explained in detail below. -
Figure 2 shows an example of an image of apage 26 to be printed. In this simplified example, the image comprises a number ofimage items item 28 is a relatively dark narrow horizontal bar,item 30 is a photograph with comparatively large dimensions and a comparatively high average darkness, item 32 is a thin horizontal line which has only a width of a single pixel, anditem 34 is a text item. - The
photograph 30 is relatively sensitive to nozzle failure, because a missing pixel line would be clearly visible on the dark background. The thin horizontal line 32 is also very sensitive to nozzle failure, because a failure of the pertinent nozzle would lead to a complete loss of image information. In contrast, theitems items 30 and 32 would require a failure compensation strategy which results in a high image quality and avoids a complete loss of image information, respectively. Such compensation strategies will generally require a slower operation mode of the printhead, so that the time required for printing thepage 26 would be increased. On the other hand, theitems - In order to be able to adopt an optimal failure compensation strategy in terms of image quality and productivity for each of the items 28-34, a segmentation process is applied to the image in order to identify the different image items and to evaluate the type of image information contained therein. In
figure 2 , twopreliminary segments items 30 and 32 are indicated in dot-dashed lines. Since a failure compensation strategy will always apply to one or more complete strokes of theprinthead 14, thesegments page 26. For simplicity, it is assumed here that the rest of thepage 26, i.e. the areas outside of thesegments -
Figure 3 shows thepage 26 divided into a number ofswaths 40 which are each printed in a single stroke of theprinthead 14. It is assumed here that the printer operates in a single-pass mode, so that theswaths 40 are not or hardly overlapping, and thesheet 12 will be transported by the width of a single swath after each stroke of the printhead. - In
figure 4 , the size of thesegments swaths 40. It can be seen that thesegments segments lines 42 above and below thesegment 38. When the print mode is switched from single-pass to two-pass or vice versa, one half of a swath must be wasted. It would therefore not be efficient to switch over to the single-pass mode for the one swath existing between thesegments figure 5 where thesegments single segment 44. -
Figure 6 is a block diagram of afailure compensation unit 46 of the printer. The failure compensation unit may be configured as a physical unit comprising one or more processors, memories and the like or may be implemented in the general control software of the printer. The image data to be printed are input as apixel bit stream 48 and are buffered in aprint data file 50. Amemory 52 includes a number (5 in the given example) of failure compensation strategies, e.g. in the form of program code. The failure compensation strategies will be described below. - A
segmentation unit 54 receives detection signals from thefailure detectors 24 and has access to the data file 50 so as to perform the segmentation process described above with reference tofigures 2 to 5 . The result is astrategy file 56 which assigns one of the failure compensation strategies stored in thememory 52 to each of the (single-pass)swaths 40. The swaths are counted from the bottom of thepage 26 infigure 5 . In the example shown, swaths No. 6 to 11 form thesegment 44 for which the compensation strategy No. 5 is applied, whereas strategy No. 1 is applied to the rest of the page. - A
controller 58 reads thestrategy file 56 and calls-up the failure compensation strategies from thememory 52 as determined by the strategy file. The controller also reads theimage data file 50, modifies the image data in accordance with the pertinent failure compensation strategy and outputs the modifiedimage data 60 to the nozzle heads 20 and generatescontrol data 62 to be output to other components of the printer such as carriage drive, paper transport and the like, so that the image will be printed in accordance with the failure compensation strategies as scheduled in the strategy file. - The various failure compensation strategies stored in the
memory 52 will now be explained in conjunction withfigures 7 to 13 . - Strategy No. 1, which is called "single-pass and shift" is illustrated in
figure 7 . By way of example, it is assumed that the image of the pertinent segment consists of two slanting lines having each a width of two pixels and separated by a gap of three white pixels. The printer operates in the single-pass mode, so that all the information of a given pixel line has to be printed with only one nozzle of thenozzle head 20 for the respective colour. It is assumed that a nozzle failure has occurred inpixel line 64. Consequently, the pixels inline 64 andcolumns line 64 or downward into the line belowline 64. Incolumn 66, the pixel cannot be shifted upwards because the pixel thereabove would be black anyway. This is why this pixel is shifted downward to thelocation 74. In contrast, the pixel incolumn 68 is shifted fromline 64 into the line immediately thereabove. The same holds true for the pixels incolumns line 64. Keeping in mind that the pixel size is largely exaggerated infigure 7 and will in practice be close to the limit of spatial resolution of the human eye, the resulting visual impression is fully acceptable. This failure compensation strategy also conserves the full productivity of the printer, because the operating speed of the printhead need not be reduced. However, this strategy would be less effective if the segment to be printed would consist of a solid black area. - Failure compensation strategy No. 2 "single-pass and cut" is slightly less productive but permits a complete failure compensation. This strategy, which is illustrated in
figure 8 , is applicable when a nozzle failure occurs in a top or bottom end portion of the nozzle array of anozzle head 20. Infigure 8 , thenozzle head 20 is symbolized by a rectangle, and anend portion 76 containing the inoperative nozzle has been hatched. The compensation strategy consists of cutting away, i.e. disabling the nozzles in theend portion 76, so that the swath 40' that is actually printed has a slightly reduced width. The paper transport distance at the end of a printhead stroke is reduced accordingly, so that theswaths 40 are seamlessly butted together, as can be seen infigure 8 . -
Figure 9 illustrates a modification of this strategy, which is even less productive but permits to compensate a nozzle failure in acentral portion 78 of thenozzle head 20. In this case, thecentral portion 78 having a length of one third of the complete nozzle array is disabled, so that the swath printed in a single stroke consists of twoseparate sub-swaths swath 40a, i.e. theswaths figure 6 , this strategy has not been implemented. - Failure compensation strategy No. 3 "two pass fast and shift" will now be explained in conjunction with
figures 10 and 11 . This strategy employs the shift mechanism that has already been described in conjunction withfigure 7 , but now in a fast two-pass mode. A two-pass mode or, more generally, a multi-pass mode has the advantage that two or more nozzles are involved in printing a single pixel line, so that a nozzle failure will affect only some of the pixels in the line. This is illustrated infigure 10 , where, in lines 1-8, all pixels having an odd column number have been printed in a forward pass n. In lines 1-4, even-numbered pixels had been printed already in a previous return pass n-1. Due to a breakdown of a nozzle 22', pixels are missing inlines line 7, every second pixel can still be printed with anoperative nozzle 22". The black pixels inline 3 have been printed in the same way. Thus, switching to a two-pass mode has the effect that, even in case of a nozzle failure, the corresponding pixel line will not be missing completely but is still printed with an optical density of 50%. - By adopting the shift mechanism discussed above, the result can be improved further, as has been shown in
figure 11 . This figure shows the same image asfigure 7 , but now only the pixels incolumns - In the fast two-pass mode, the
carriage 16 travelling along theplaten 10 is driven with twice the normal speed, while the dot generation frequency of thenozzles 22 is kept at the original value. Thus, although two passes are needed for printing a complete swath, the productivity is almost as high as in the single- pass mode. However, a certain loss in productivity is caused by the necessity to decelerate thecarriage 16 and to reverse its direction of movement more frequently. This is why the strategy No. 3 is less productive than the strategy No. 1 and even less productive than the strategy No. 2, if the cut-awayportion 76 of the nozzle array is relatively short. On the other hand, a multipass mode leads to an improvement in the overall image quality because defects resulting from dot position errors, for example, can be smoothened out. - The failure compensation strategy No. 4 shown in
figure 6 , "two-pass fast and cut" employs the fast two-pass mode in combination with the cut procedure illustrated infigure 8 . - The failure compensation strategy No. 5 "single pass slow and insert" is illustrated in
figure 12 . Here, the two-pass mode is adopted, but the carriage is moved only with the normal speed, and the dot generation frequency of most of thenozzles 22 is reduced to 50%. As a consequence, the productivity of the print process is also reduced to 50%. On the other hand, this strategy has the advantage that a complete failure compensation can be achieved even in cases where nozzle failure occurs in a central portion of the nozzle array, so that the cut strategy offigure 8 would not work, or in cases where nozzle failure occurs for two adjacent nozzles, so that the shift strategy would not work. To compensate for the failure of nozzle 22' infigure 12 , thecomplementary nozzle 22" is operated with the normal drop generation frequency, i.e. twice the frequency of the other nozzles, so that all the pixels missing inline 7 can be filled-in with thenozzle 22". - In a modified embodiment, it is possible that the printer operates with a nominal dot generation frequency of 10 kHz, for example, but is also capable of operating with twice the nominal dot generation frequency, i.e. 20 kHz. The mode with the nominal frequency will then be used for example in a quality mode in order to achieve an optimal image quality, whereas the mode with double frequency, in which the image quality may be slightly less, will be adopted in a draft mode, for example. Then, in the quality mode, the strategy shown in
figure 12 may be applied with the nominal dot generation frequency and double carriage speed, and only thenozzle 22" will be operated with double frequency, so that a higher productivity can be achieved. - Of course, other failure compensation strategies that are known in the art may also be implemented, and the set of selectable compensation strategies may be varied depending upon the operating mode (draft, normal or quality) of the printer.
- Details of the segmentation process employed in the
segmentation unit 54 will now be explained with reference tofigure 13 . This figure shows a pixel pattern of a portion of an image to be printed, as specified in the data file 50. In the example shown, most of the area has a grey level of 50%, i.e. one half of the pixels is black and the other half is white. The image area is divided into square basic areas of, preferably, 32 x 32 pixels, although only 8 x 8 pixels have been shown in the drawing. Onebasic area 80 has been highlighted infigure 13 by a white borderline. - A first step in the segmentation process consists of measuring the average brightness of each basic area by counting the number of white pixels. This average brightness will be taken as a primary image classifier for determining the failure compensation strategy to be applied. The value 0 is assigned to black pixels, and the value 255 is assigned to white pixels. Thus, the average image value of the
basic area 80 will be 127. In general, a high value of the primary image classifier means that a rather productive failure compensation strategy, e.g. strategy No. 1, can be applied, whereas a low primary image classifier means that one of the high quality strategies, e.g. strategy No. 5, has to be applied. - In the next step, the primary image classifiers are subjected to context filtering in view of the fact that a defect caused by a nozzle failure will be less visible when it occurs near a border between the dark area and an adjacent bright area. To this end, a square window of 5 x 5 basic areas is shifted over the image, with the
basic area 80 that is currently inspected being in the center of this window. Infigure 13 , the 5 x 5 window surrounding thebasic area 80 is indicated as the base of apyramid 82. The primary image classifiers measured for each of the 25 basic areas in thewindow 82 are subjected to maximum filtering. Since, in the example shown, all 25 basic areas have the primary image value of 127, the maximum is also 127, as is indicated on the top of the pyramid symbolizing thewindow 82. However, when the window is shifted by one basic area to the right, in order to inspect abasic area 84, the window, which is now symbolized by apyramid 86 shown in dashed lines, includes also a brighterbasic area 88 which has a basic image classifier of 191. Then, maximum filtering leads to a filtered image value of 191 for thebasic area 84. In this way, by shifting the window over thewhole page 26, a filtered primary classifier is obtained for each basic area. - In a simplified version of the segmentation process, the next step consists of comparing the filtered primary classifiers to appropriate threshold values. When the filtered primary classifiers of all basic areas in a row extending over the whole width of the
page 26 exceed the highest threshold value, then this row of basic areas can be classified as part of a segment to which the failure compensation strategy No. 1 applies. On the other hand, if none of the filtered primary classifiers in this row exceeds the lowest threshold value, then this row will be classified as part of a segment to which failure compensation strategy No. 5 applies. In this way, theprovisional segment 36 shown infigure 2 can be obtained, whereas theitems segment 38 corresponding to the single pixel line 32 is obtained by a different process, as will be explained below. -
Figure 14 is a flow chart illustrating a more elaborated segmentation process. - In
step 100, the data file 50 is read-in. Instep 101, the whole image of thepage 26 is checked for thin horizontal lines such as the line 32 infigure 2 . This is achieved by conventional image processing techniques that are known in the art. If one or more of such horizontal lines are found, a proactive failure compensation strategy is scheduled instep 102. This step includes the identification of thesegment 38, as infigure 2 , and the matching of the segment to the swath width, as infigure 4 . In the example shown, the steps 100 - 102 are performed before the operation of theprinthead 14 starts. It is further specified instep 102 that the failure compensation strategy No. 5 shall be adopted for thesegment 38, even though it is not known at that instant whether a nozzle failure will actually occur and which nozzle will be affected. In any case, a two-pass mode will be scheduled for this segment. This has the advantage that the failure compensation process can readily be activated if the demand occurs. Thus, a complete loss of information can reliably be avoided. - In a modified embodiment, it would also be possible to schedule the failure compensation process No. 3 for horizontal lines having a width of two pixels, for example.
- It should further be observed here that it would also be possible to employ the failure compensation strategy No. 1 (shift) for single-pixel lines. Then, the line as a whole would be shifted by one pixel. However, in the case of high quality printing of CAD graphics, where positional accuracy is important, this strategy may not be acceptable.
- Subsequent to step 102, the
printhead 14 is started to operate instep 104. If no thin horizontal lines have been found instep 101, then thestep 102 is skipped. - In
step 105, it is checked by means of thefailure detectors 24 whether or not a nozzle failure has occurred, and the location of the nozzle failure or failures is communicated to thesegmentation unit 54. If no nozzle failure has been detected, thestep 105 is repeated in a loop while the page is being printed. - As soon as a nozzle failure occurs, threshold values Tij for the segmentation process are set in
step 106. The index i (i = 1, ..., 5) identifies the failure compensation strategy to which the threshold value applies. It will be noted that, as is shown infigure 6 , the compensation strategies are ordered in a sequence with increasing image quality and decreasing productivity. Thus, i = 1 means highest productivity and i = 5 means highest quality. - In the segmentation process of this embodiment, primary image classifiers Bj are measured for basic areas (such as 80) with different sizes, e.g. with sizes of 8†x†8, 16 x 16, 32 x 32 pixels and so on (and possibly also for different window sizes such as 5 x 5 or 3 x 3 basic areas). The second index j of the classifiers Bjand of the threshold values Tij identifies the type or size of basic area to which the classifiers and threshold values apply.
- In
step 107, the primary classifiers Bj are measured for the various sizes of the basic areas, of course always for rows of basic areas extending over the whole width of thepage 26. - In
step 108, context filtering is applied individually to each set of primary classifiers Bj. - In
step 109, the index i is set to 1. Instep 110, it is checked whether all the filtered primary classifiers Bj for all sizes of the basic areas and for all basic areas in the row are larger than the maximum maxj(Tij) of the threshold values Tij. Since, in the present instant, i has been set to 1, the maximum is taken over the threshold values T1j. If the condition checked instep 110 is fulfilled, the failure compensation strategy i (1) is adopted instep 111. Since the values Bj have been compared to the maximum of the threshold values T1j instep 110, the failure compensation strategy No. 1 with the highest productivity will be applied only if the values Bj for all sizes of the basic areas have passed the test instep 110. - If the test in
step 110 has failed, it is checked instep 111 whether the index i has reached themaximum value 5. If this is not the case, i is incremented instep 113, and the process loops back tostep 110. Thus, the loop consisting of thesteps step 110, the loop is exited withstep 114 where the strategy No. 5 for highest quality is scheduled. - Subsequent to step 111 or step 114, the process loops back to step 105, where it is checked whether a new nozzle failure has occurred while the print process proceeds. It will be understood that the
steps 105 through 114 are repeated until thewhole page 26 or at least a certain number ofadjacent swaths 40 has been examined with basic areas of all sizes, thereby to determine the dimensions of thesegments figure 4 . Finally, although this is not shown infigure 14 , the segments are subjected to low-pass filtering in order to remove unreasonably small gaps between segments of the same type, as has been shown infigure 5 . - The threshold values Tij determined in
step 106 may of course depend upon the locations of the defective nozzles as detected instep 105. Thus, step 106 should be performed afterstep 105. However, thesteps step 104. This will reduce the processing time needed after a nozzle failure has been detected and will therefore permit to react more quickly when a nozzle failure occurs. - On the other hand, the nozzle failures detected in
step 105 may be stored in a nonvolatile memory, so that they are readily available when the printer has been switched off and is switched on again at a later time. - Thanks to the powerful and yet productive failure compensation mechanism according to the invention, it is possible to extend the cleaning or maintenance intervals for the printer and or to reduce the number of instances where service personal has to be called for mending nozzle failures.
- With increasing resolution of printers, and hence with increasing numbers of nozzles or other print units and decreasing dimensions of the print units, the likelihood of nozzle failures becomes larger, not only when the printer is in use but already in the production process of the printhead. The invention may also permit to tolerate a certain number of nozzle failures for a virgin printhead, and thereby to increase the yield in the manufacturing process of the printhead.
Claims (15)
- A printing method to be performed with a printhead (14) with a plurality of print units (22) each of which is capable of printing a pixel line when the printhead is scanned over a recording medium (12), wherein the print operation is controlled such that a failure of a print unit (22) is compensated, characterized by the steps of- storing a plurality of failure compensation strategies,- dividing an image (26) to be printed into segments (36, 38; 44) containing different types of image information, and- selecting different ones of the stored compensation strategies for printing different segments of the image.
- Method according to claim 1, wherein the segments (36, 38; 44) extend over the whole width of the image (26) to be printed.
- Method according to claim 2, wherein the dimension of the segments (36, 38; 44) in a direction normal to the scanning direction (B) of the printhead (14) is adapted to the length of an array of print units (22) of the printhead.
- Method according to any of the preceding claims, comprising the steps of sorting the stored compensation strategies in a sequence of increasing image quality and decreasing productivity,
assigning to each segment a criterion (Tij) specifying a minimum requirement for the image quality, and
selecting, for a segment to be printed, the first strategy in the sequence that fulfills the criterion assigned to that segment. - Method according to any of the preceding claims, comprising a step of filtering the pattern of segments (36, 38) with a low-pass spatial frequency filter for reducing the number of switching operations from one compensation strategy to another.
- Method according to any of the preceding claims, comprising a step of automatically detecting a failure of a print unit (22) and a step of automatically activating or adapting a failure compensation strategy in accordance with the detected failure.
- Method according to any of the preceding claims, comprising the steps of searching the image to be printed for nozzle failure sensitive items (32), and
proactively applying such a compensation strategy in accordance with the search result. - Method according any of the preceding claims, wherein the failure compensation strategies comprise at least one strategy that is applicable in a single-pass mode of the printhead (14) and at least one strategy that is applicable in a multi-pass mode of the printhead.
- Method according to any of the preceding claims, wherein the step of dividing the image into segments (36, 38; 44) includes a step (107) of extracting a primary image classifier (Bj) from each area of the image, said primary image classifier being a measure for the brightness of that area, and a step of determining the segments on the basis of the values of the primary image classifiers (Bj) of the image areas contained therein.
- Method according to claim 9, comprising a step (108) of context filtering the primary classifiers (Bj) of the image areas and determining the segments on the basis of the filtered classifiers.
- Method according to claim 10, wherein the image is divided into basic areas (80, 84, 88) comprising a plurality of pixel, the primary classifier (Bj) is measured for each basic area, and context filtering is applied to blocks (82, 86) consisting of a plurality of basic areas.
- Method according to any of the claims 9 to 10, wherein at least one threshold value (Tij) is defined for each failure compensation strategy (i), and the failure compensation strategy for a segment is selected by comparing the smallest primary image classifier (Bj), that has been found for the segment, to said threshold values (Tij).
- Method according to claims 11 and 12, wherein primary image classifiers (Bj) are measured for basic areas of different sizes, and the primary classifiers obtained for each basic area size are compared to respective threshold values (Tij).
- A printer comprising a transport system (10) for a recording medium (12), a printhead (14) with a plurality of print units (22) each of which is capable of printing a pixel line when the printhead is scanned over the recording medium, and a failure compensation unit (46) controlling the print operation such that a failure of a print unit is compensated, characterized in that a segmentation unit (54) is provided for dividing an image (26) to be printed into segments (36, 38; 44) containing different types of image information, and in that the failure compensation unit (46) comprises a memory (52) storing a plurality of compensation strategies and a controller (58) selecting one of said compensation strategies in accordance with the segment to be printed.
- Printer according to claim 14, implementing a printing method according to any of the claims 1 to 13.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP04075451.7A EP1452319B1 (en) | 2003-02-26 | 2004-02-13 | Printing method and printer with failure compensation |
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP03075838 | 2003-02-26 | ||
EP03075838 | 2003-02-26 | ||
EP04075451.7A EP1452319B1 (en) | 2003-02-26 | 2004-02-13 | Printing method and printer with failure compensation |
Publications (2)
Publication Number | Publication Date |
---|---|
EP1452319A1 EP1452319A1 (en) | 2004-09-01 |
EP1452319B1 true EP1452319B1 (en) | 2015-10-21 |
Family
ID=32773654
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP04075451.7A Expired - Lifetime EP1452319B1 (en) | 2003-02-26 | 2004-02-13 | Printing method and printer with failure compensation |
Country Status (1)
Country | Link |
---|---|
EP (1) | EP1452319B1 (en) |
Families Citing this family (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR100694119B1 (en) * | 2005-06-01 | 2007-03-12 | 삼성전자주식회사 | Print head unit and color inkjet printer with the same |
US20100066779A1 (en) | 2006-11-28 | 2010-03-18 | Hanan Gothait | Method and system for nozzle compensation in non-contact material deposition |
WO2009153795A1 (en) * | 2008-06-19 | 2009-12-23 | Xjet Ltd. | Method and system for nozzle compensation in non-contact material deposition |
WO2019206831A1 (en) * | 2018-04-23 | 2019-10-31 | OCE Holding B.V. | Method of fast nozzle failure detection |
CN113211980B (en) * | 2021-04-21 | 2022-04-22 | 华南理工大学 | Piezoelectric control system for printing OLED device and optimization method |
Family Cites Families (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6007174A (en) * | 1991-07-30 | 1999-12-28 | Canon Kabushiki Kaisha | Ink jet recording apparatus and method |
EP0981105A1 (en) | 1998-08-17 | 2000-02-23 | Océ-Technologies B.V. | Method of compensating failure of a dot generating unit in a printing system |
EP0983855A3 (en) * | 1998-08-31 | 2000-08-02 | Hewlett-Packard Company | Dot substitution to compensate for failed ink jet nozzles |
NL1012376C2 (en) | 1999-06-17 | 2000-12-19 | Ocu Technologies B V | Method for printing a substrate and a printing device suitable for applying this method. |
US6190000B1 (en) * | 1999-08-30 | 2001-02-20 | Hewlett-Packard Company | Method and apparatus for masking address out failures |
JP4681751B2 (en) * | 2000-05-01 | 2011-05-11 | キヤノン株式会社 | Recording apparatus and recording method |
-
2004
- 2004-02-13 EP EP04075451.7A patent/EP1452319B1/en not_active Expired - Lifetime
Also Published As
Publication number | Publication date |
---|---|
EP1452319A1 (en) | 2004-09-01 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US7104626B2 (en) | Printing method and printer with failure compensation | |
US7506947B2 (en) | Ink jet printing apparatus and method using media shape detection | |
US6540315B1 (en) | Systems and methods for stitching overlapping swaths | |
US20060158472A1 (en) | Printer and print system | |
JP5899222B2 (en) | Inkjet printing method and inkjet printer | |
JP5473435B2 (en) | Control method of recording apparatus | |
US7537308B2 (en) | Data processing method and ink jet printing apparatus | |
JP2008012828A (en) | Preliminary discharging method onto paper sheet, printing apparatus, and printer driver | |
JP3900723B2 (en) | Dot drop inspection method, printing apparatus, and recording medium recording program therefor | |
US5619233A (en) | Bidirectional ink jet printing with head signature reduction | |
JP4732319B2 (en) | Data processing method and ink jet recording apparatus | |
EP1452319B1 (en) | Printing method and printer with failure compensation | |
JP2010120254A (en) | Printer and method of detecting non-ejecting nozzle | |
JPH0885242A (en) | Ink jet recording device | |
JP2003231243A (en) | Ink-jet printer, ink-jet printing system, nozzle deterioration compensating method for ink-jet printer, printer, and printing method | |
JP5480460B2 (en) | Printing system and method for forming an image on a medium | |
JP2007130934A (en) | Inkjet recording apparatus | |
US10384444B2 (en) | Recording apparatus and recording method | |
JP2005178263A (en) | Recording device and its controlling method | |
JP2003276177A (en) | Image recorder | |
JP2004202962A (en) | Printing system | |
JP7459699B2 (en) | Image forming system and image forming method | |
JP2005178262A (en) | Recording device and recording method | |
US20130182028A1 (en) | Method of camouflaging artifacts in high coverage areas in images to be printed | |
JP2017213773A (en) | Control device for droplet discharge and image processing apparatus |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LI LU MC NL PT RO SE SI SK TR |
|
AX | Request for extension of the european patent |
Extension state: AL LT LV MK |
|
17P | Request for examination filed |
Effective date: 20050301 |
|
AKX | Designation fees paid |
Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LI LU MC NL PT RO SE SI SK TR |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
INTG | Intention to grant announced |
Effective date: 20150512 |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LI LU MC NL PT RO SE SI SK TR |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: REF Ref document number: 756330 Country of ref document: AT Kind code of ref document: T Effective date: 20151115 |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 602004048091 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 13 |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: MK05 Ref document number: 756330 Country of ref document: AT Kind code of ref document: T Effective date: 20151021 |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: FP |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151021 Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151021 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160122 Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151021 Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151021 Ref country code: BE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20160229 Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160222 Ref country code: AT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151021 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 602004048091 Country of ref document: DE |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151021 |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151021 Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151021 Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151021 Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151021 |
|
26N | No opposition filed |
Effective date: 20160722 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160213 Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151021 |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20160229 Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20160229 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151021 |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: MM4A |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151021 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20160213 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 14 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: DE Payment date: 20170217 Year of fee payment: 14 Ref country code: FR Payment date: 20170217 Year of fee payment: 14 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: GB Payment date: 20170216 Year of fee payment: 14 Ref country code: NL Payment date: 20170221 Year of fee payment: 14 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151021 Ref country code: HU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO Effective date: 20040213 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: TR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151021 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151021 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R119 Ref document number: 602004048091 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: MM Effective date: 20180301 |
|
GBPC | Gb: european patent ceased through non-payment of renewal fee |
Effective date: 20180213 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: ST Effective date: 20181031 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: NL Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20180301 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: DE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20180901 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: FR Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20180228 Ref country code: GB Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20180213 |