GB1579738A - Colour picture reproduction system - Google Patents
Colour picture reproduction system Download PDFInfo
- Publication number
- GB1579738A GB1579738A GB27681/76A GB2768176A GB1579738A GB 1579738 A GB1579738 A GB 1579738A GB 27681/76 A GB27681/76 A GB 27681/76A GB 2768176 A GB2768176 A GB 2768176A GB 1579738 A GB1579738 A GB 1579738A
- Authority
- GB
- United Kingdom
- Prior art keywords
- colour
- matrix
- signals
- auxiliary
- switch means
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired
Links
- 239000011159 matrix material Substances 0.000 claims description 81
- 230000000873 masking effect Effects 0.000 claims description 16
- 230000003287 optical effect Effects 0.000 claims description 16
- 230000007935 neutral effect Effects 0.000 claims description 11
- 239000003086 colorant Substances 0.000 claims description 10
- 229920006395 saturated elastomer Polymers 0.000 claims description 9
- 230000000694 effects Effects 0.000 claims description 8
- 238000000034 method Methods 0.000 claims description 4
- 230000000750 progressive effect Effects 0.000 claims description 4
- 239000003795 chemical substances by application Substances 0.000 description 6
- 238000010586 diagram Methods 0.000 description 3
- 230000005540 biological transmission Effects 0.000 description 2
- ORWQBKPSGDRPPA-UHFFFAOYSA-N 3-[2-[ethyl(methyl)amino]ethyl]-1h-indol-4-ol Chemical compound C1=CC(O)=C2C(CCN(C)CC)=CNC2=C1 ORWQBKPSGDRPPA-UHFFFAOYSA-N 0.000 description 1
- 230000015556 catabolic process Effects 0.000 description 1
- 238000006731 degradation reaction Methods 0.000 description 1
- 230000000593 degrading effect Effects 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 238000009795 derivation Methods 0.000 description 1
- 239000000839 emulsion Substances 0.000 description 1
- 238000002474 experimental method Methods 0.000 description 1
- 230000000977 initiatory effect Effects 0.000 description 1
- 239000000203 mixture Substances 0.000 description 1
- 238000006386 neutralization reaction Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/80—Camera processing pipelines; Components thereof
- H04N23/84—Camera processing pipelines; Components thereof for processing colour signals
- H04N23/85—Camera processing pipelines; Components thereof for processing colour signals for matrixing
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Color Television Image Signal Generators (AREA)
Description
(54) COLOUR PICTURE REPRODUCTION SYSTEM
(71) We, KODAK LIMITED, a Company registered under the law of England, of
Kodak House, Station Road, Hemel Hempstead, Hertfordshire, do hereby declare the invention for which we pray that a patent may be granted to us, and the method by which it is to be performed, to be particularly described in and by the following statement;
This invention relates to the production of video signals.
Video signals representative of a picture, or scene, are produced, in the case of a television camera, by electronically scanning an image or images of the picture, or scene, and processing the output signal(s) to the required form. Where a colour video signal is required it is known to apply the output signals to a matrix unit to obtain colour masking.
One difficulty encountered with electronic scanning systems, in television cameras and elsewhere, is that the signal/noise ratio is low when the picture, or scene, is badly lit or when the picture is very dense, and this can lead to degraded colour reproduction tor such areas when the video signal is used to form a display. An object of the present invention is to provide some compensation where such colour degradation would otherwise occur.
In accordance with the present invention there is provided electronic scanning apparatus adapted to produce a colour video signal output, the apparatus having a colour masking matrix arranged to receive and modify the colour signals produced by scanning a picture; wherein switch means responsive to the signals indicating a predetermined low light level or high optical density or high colour saturation at a scanned picture point are arranged to switch an auxiliary matrix into operation, this auxiliary matrix being arranged to receive the corresponding output signals from the colour masking matrix and to modify these signals so that the colour video signal output includes improved colour information for these picture points.
The apparatus may include more than one auxiliary matrix, the switch means being arranged to switch the auxiliary matrices selectively into operation in dependence upon the magnitude of signals corresponding to the scanned picture point. The switch means may switch the auxiliary matrices into and out of operation in a progressive manner.
The apparatus may include means for dividing each output signal from the colour masking matrix into upper and lower magnitude parts, and applying only one of these parts to an auxiliary matrix.
A first auxiliary matrix may be a unity matrix, and a second auxiliary matrix may be a colour compensating matrix.
A first auxiliary matrix may provide weak matrixing for at least one of the primary colours for which the scanning signals are derived, and a second auxiliary matrix may provide desaturating compensation.
The switch means may operate in response to the light level, optical density or colour saturation in all of red, green and blue signals from the colour masking matrix all of the colour signals being checked independently.
Alternatively the switch means may operate in response to a signal derived from an average of the lower magnitude parts of the output signals from the colour masking matrix.
According to another aspect of the invention, an auxiliary matrix is arranged to operate on an extreme range of one or more of the modified colour signals, the extreme range being one in which a colour signal has a non-linear image representation characteristic, to produce a changed set of video signals that are driven relatively towards neutral, and switch means are arranged to control the contribution of the changed set of video signals to the colour video signals output in accordance with the optical density at the scanned picture points.
The invention will normally be used with television cameras and film scanners of the conventional kind in which red, green and blue density signals of the scanned picture point are available, but it is not limited to such colours or devices.
The invention may be applied to an electronic film scanner in apparatus for producing a photographic print from a transparency, and two such applications will now be described by way of example with reference to the drawing accompanying the Provisional Specification in which Figure 1 is a block diagram of the relevant portion of the second example of signal processing circuit for red, green and blue signals; and in which Figure 2 is a block diagram of a fourth example of signal processing circuit, but for simplicity showing only the circuitry for the red signal.
Referring now to Figure 1, which is identical for the first and second embodiments except in so far as matrix unit 14 is concerned, there are shown three photomultipliers 1, 2 and 3 respectively sensitive to red, green and blue light reflected by mirrors 5 as it leaves the transparency 4 during scanning at the usual television scanning rate by a flying spot scanner having a cathode ray tube. The resultant red, green and blue transmission signals are applied to respective logarithmic amplifiers 7, 8 and 9 and the outputs thereof pass to a conventional electronic colour mask 10. The matrixed signals therefrom are applied to a divider or limiting amplifiers, 11/12 such that signals corresponding to a scanned picture point of a transparency having an optical density of less than a predetermined value appear in divider portion 11 and are applied to a summing amplifier 13 for the colour video output signal. Matrixed signals corresponding to picture points whose transparency density is more than the predetermined value appear in divider portion 12 and are applied to auxiliary matrix units 14 and 15, and the output from these auxiliary matrix units is also applied to the summing amplifier 13, the composition of these outputs being controlled by a selector switch 16 which is responsive to a control signal derived by a control signal generator 17.
The control signal gencrator operates when the transparency density of the scanned picture point reaches a selected value.
The predetermined value referred to above in connection with the divider 11/12 has been chosen as 2.4 in carrying the invention into effect since this is the greatest optical density expected from a normally exposed transparency or slide. A different value could be chosen, if necessary, where the invention is applied to a television camera.
In this embodiment the second auxiliary matrix unit is used to modify the colour video output signal in such a way as to neutralise shadow areas of a point made from the transparency using the colour video output signal to reconstitute the picture in known manner and this compensation is effected without degrading saturated colours. For this purpose the matrix unit 15 with all positive terms combines the upper parts of the density signals which are applied thereto, so as to make the picture point more neutral. Where the scanned point is a saturated colour then desaturation of the picture point is not desired and the required output will be derived from matrix unit 14 which is a unity matrix in this first embodiment. In other words the matrix terms for unit 14 should be 1 in this first embodiment, and not as shown in Figure 1.
It appears that a suitable instant for initiating switching in this arrangement, using selector switch 16, is when the red, green and blue densities rise together above 1.8. This point may be determined by means of a circuit which can make the three comparisons necessary independently and which can then actuate the selector switch 16 at the appropriate time. In practice however it is preferred to use a simplified circuit that produces a control signal which is the average of the lower parts of the red, green and blue density signals, that is, the average of the output of the divider 11. Switching then takes place at a density of 2.2, although in practice, to avoid contouring effects it is preferred that the switching between the matrix units 14 and 15 is progressive, beginning at a density of 2.0 and being complete at a density of 2.4. Thus if the scanned picture point is a red having densities R < 1.8, G > 2.4, B > 2.4 then the control signal is less than 2.2, the unity matrix 14 remains operative and the saturation is maintained. A near-neutral picture point with
R > 2.4, G > 2.4, B > 2.4 will however cause the desaturating matrix unit 15 to be switched in, and the colour of the resultant picture will be made more nearly neutral by the matrixing operation in unit 15.
The specific system may be summarised in matrix terms as follows where R', G', and B' are the red, green and blue output signals from the summer 13; AR, AG and AB are the lower parts of the divided density signals (from divider 11); and AR', AG' and AB' are the upper parts of the divided density signals (from divider 12).
A simplification of this specific system, resulting in what will be called the second embodiment, is possible if a compromise term value of .75 is adopted for the diagonal terms of both the matrix 14 and the desaturating matrix 15. Switching of the off-diagonal terms only of these matrices is then necessary in changing over from one matrix unit to the other.
In this case the matrix 14 is not a unity matrix, and the matrix terms shown in Figure 1 apply.
Improved colour reproduction in prints made from transparencies using a colour video output signal modified by the above techniques has been noted.
The embodiments described above can be changed to modify the colour video output signal so as to add detail in saturated coloured area of a print from a transparency. This is effective for example where there is some red information in the transparency in the form of modulation of the small amount of cyan dye, and where this corresponds to a point off the toe of the characteristic curve of the printing paper emulsion. This may be compensated for in the third embodiment by introducing some weak matrixing into the red channel of matrix 14 of Figure 1. Thus the same general arrangement is adopted as above but the matrices are modified as follows:-
The value of .06 was found by experiment to give an acceptable amount of modelling to reds (with G = B > 2.4) without adding too much 'wrong' information from the green and blue channels, and without causing yellows (with B > 2.4) to be reproduced too green.
Dark neutrals are not affected by the imbalance of the row sums in the first matrix, because they are handled by the second matrix 15.
A fourth embodiment will now be described with reference to Figure 2 of the drawings.
Bearing in mind that this block diagram is concerned mainly with the red channel of the signal processing circuit it will be seen that it corresponds broadly to the second embodiment except in the derivation of the control signal for effecting switching, and that the control signal differs from channel to channel.
As before, red, green and blue transmission signals are obtained from photomultipliers and logarithmic amplifiers (7, 8 and 9 in Figure 1) and applied to a conventional electronic colour mask 20. The matrixed signals therefrom are applied to a divider 21/22 which separates the red signal R, for example, into AR and AR', where AR is the signal corresponding to an optical density D between 0 and 2.4 of the scanned picture point of the transparency, and AR' corresponds to D above 2.4. Similarly the green signal G = AG +
AG', and the blue signal B = AB + AB', these signals being divided at the same optical densities.
From the divider 22 the signal AR' is applied to the first auxiliary matrix unit 23 which in this case is not a unity matrix but a 0.75 multiplier. The output from matrix unit 23 is fed to a summing amplifier 24 together with the output AR of divider 21.
From the inputs and output of divider 21 the signals, for the red channel, AR + B + G are applied to the summing amplifier 25 whose output passes to divide-by-3 divider 26 and thence to a level dependent switch 27. Switch 27 operates when its input, AR + G + B
3 is greater than 2.4 and allows the excess over 2.4 to pass. For a neutral colour where R = G = B, each greater than 2.4, then the output from switch 27 is AG' + AB'
3 Now the required output from the red channel for a neutral input in embodiment 2 is shown by
R' = AR + 0.75AR' + 0.25AG' + 0.25AB', and the output from switch 27 is therefore weighted by 0.25 x 3 to give the required coefficients for AG' and AB'. The 0.75 multiplier 28 produces as output, the positive part of 0.75 (AR .3G. S - 2.4)
and applies it to the summing amplifier 24.
Thus for a neutral colour, R = G = B > 2.4, the output of summing amplifier 24 is R'AR+o.7sARl+o.sH(AR+3+B - 2.4)
3 where H is the positive part.
For lighter or more saturated colours, the signal
AR + G + B < 2.4
3 and there will be no output from switch 27. The output from summing amplifier 24 is then
R' = AR + 0.75 R'.
In this fourth embodiment the desaturation or neutralisation is effected more gradually.
For example where the scanned picture spot is a red, G = B = 3, desaturation commences when the red density excceds 1.2 but does not reach its maximum until D is greater than 2.4.
The system may be represented in matrix form as follows:
The fourth embodiment may be modified to provide some modelling, i.e. addition of details in a saturated colour point whose optical density exceeds 2.4, as in the third embodiment. A suitable matrix for this fifth embodiment is as follows:
In the above embodiments there are two auxiliary matrix units, one possibly being a unity matrix. The invention may alternatively include a larger number of matrices, particularly where reversal films with large non-linear interimage effects are involved. The appropriate matrix would then be switched in according to the density or saturation of each scanned picture point in the film.
The preceding embodiments have been concerned with film scanners but it will be appreciated that the invention is applicable to television cameras. Thus the first embodiment can be applied to such a camera so that in the subsequent television display the shadow areas are reproduced nearer neutral and yet saturated colours are unaffected by this compensation. Further, since television systems have a sharp toe to their transfer characteristics, saturated colours are often reproduced with little detail in them. The addition of weak matrixing in all of the three channels, using the technique adopted for the third and fourth embodiments will then compensate for this effect.
As indicated above, the invention is useful where there is a high optical density at a scanned picture point. It should be appreciated that the undesirable effects which can be compensated for by use of the invention, where the film or slide information is at high density, include shading errors, mismatches in electronic circuits such as logarithmic amplifiers, and mismatch in the scanned film.
WHAT WE CLAIM IS:
1. Electronic scanning apparatus adapted to produce a colour video signal output, the apparatus having a colour masking matrix arranged to receive and modify the colour signals produced by scanning a picture; wherein switch means responsive to the signals indicating a predetermined low light level or high optical density or high colour saturation at a scanned picture point are arranged to switch an auxiliary matrix into operation, this auxiliary matrix being arranged to receive the corresponding output signals from the colour masking matrix and to modify these signals so that the colour video signal output includes improved colour information for these picture points.
2. Apparatus as claimed in Claim 1, including more than one auxiliary matrix, the switch means being arranged to switch the auxiliary matrices selectively into operation in dependence upon the magnitude of the signals corresponding to the scanned picture point.
3. Apparatus as claimed in Claim 2, wherein the switch means is arranged to switch the auxiliary matrices into and out of operation in a progressive manner.
4. Apparatus as claimed in Claim 1, including means for dividing each output signal from the colour masking matrix into upper and lower magnitude parts, and applying only one of these parts to an auxiliary matrix.
5. Apparatus as claimed in Claim 2 or Claim 3, wherein a first auxiliary matrix is a unity matrix, and a second auxiliary matrix is a colour compensating matrix.
6. Apparatus as claimed in Claim 2 or Claim 3, wherein a first auxiliary matrix provides weak matrixing for at least one of the primary colours for which the scanning signals are derived, and a second auxiliary matrix provides desaturating compensation.
7. Apparatus as claimed in any preceding claim, wherein the switch means operates in response to the light level, optical density or colour saturation in all of red, green and blue signals being checked independently.
8. Apparatus as claimed in Claim 4, wherein the switch means operates in response to a signal derived from an average of the lower magnitude parts of the output signal from the colour masking matrix.
9. A television camera including apparatus as claimed in any preceding claim.
10. A photographic film scanner including apparatus as claimed in any of Claims 1 to 8.
11. Electronic scanning apparatus substantially as hereinbefore described with reference to Figure 1 or to Figure 2 of the drawings accompanying the Provisional Specification.
12. Electronic scanning apparatus adapted to produce a colour video signal output, the apparatus having a colour masking matrix arranged to receive and modify the colour signals produced by scanning a picture; wherein an auxiliary matrix is arranged to operate on an extreme range of one or more of the modified colour signals, the extreme range being one in which a colour signal has a non-linear image representation characteristic, to produce a changed set of video signals that are driven relatively towards neutral, and switch means are arranged to control the contribution of the changed set of video signals to the colour video signal output in accordance with the optical density at the scanned picture points.
**WARNING** end of DESC field may overlap start of CLMS **.
Claims (12)
1. Electronic scanning apparatus adapted to produce a colour video signal output, the apparatus having a colour masking matrix arranged to receive and modify the colour signals produced by scanning a picture; wherein switch means responsive to the signals indicating a predetermined low light level or high optical density or high colour saturation at a scanned picture point are arranged to switch an auxiliary matrix into operation, this auxiliary matrix being arranged to receive the corresponding output signals from the colour masking matrix and to modify these signals so that the colour video signal output includes improved colour information for these picture points.
2. Apparatus as claimed in Claim 1, including more than one auxiliary matrix, the switch means being arranged to switch the auxiliary matrices selectively into operation in dependence upon the magnitude of the signals corresponding to the scanned picture point.
3. Apparatus as claimed in Claim 2, wherein the switch means is arranged to switch the auxiliary matrices into and out of operation in a progressive manner.
4. Apparatus as claimed in Claim 1, including means for dividing each output signal from the colour masking matrix into upper and lower magnitude parts, and applying only one of these parts to an auxiliary matrix.
5. Apparatus as claimed in Claim 2 or Claim 3, wherein a first auxiliary matrix is a unity matrix, and a second auxiliary matrix is a colour compensating matrix.
6. Apparatus as claimed in Claim 2 or Claim 3, wherein a first auxiliary matrix provides weak matrixing for at least one of the primary colours for which the scanning signals are derived, and a second auxiliary matrix provides desaturating compensation.
7. Apparatus as claimed in any preceding claim, wherein the switch means operates in response to the light level, optical density or colour saturation in all of red, green and blue signals being checked independently.
8. Apparatus as claimed in Claim 4, wherein the switch means operates in response to a signal derived from an average of the lower magnitude parts of the output signal from the colour masking matrix.
9. A television camera including apparatus as claimed in any preceding claim.
10. A photographic film scanner including apparatus as claimed in any of Claims 1 to 8.
11. Electronic scanning apparatus substantially as hereinbefore described with reference to Figure 1 or to Figure 2 of the drawings accompanying the Provisional Specification.
12. Electronic scanning apparatus adapted to produce a colour video signal output, the apparatus having a colour masking matrix arranged to receive and modify the colour signals produced by scanning a picture; wherein an auxiliary matrix is arranged to operate on an extreme range of one or more of the modified colour signals, the extreme range being one in which a colour signal has a non-linear image representation characteristic, to produce a changed set of video signals that are driven relatively towards neutral, and switch means are arranged to control the contribution of the changed set of video signals to the colour video signal output in accordance with the optical density at the scanned picture points.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
GB27681/76A GB1579738A (en) | 1977-07-04 | 1977-07-04 | Colour picture reproduction system |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
GB27681/76A GB1579738A (en) | 1977-07-04 | 1977-07-04 | Colour picture reproduction system |
Publications (1)
Publication Number | Publication Date |
---|---|
GB1579738A true GB1579738A (en) | 1980-11-26 |
Family
ID=10263560
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
GB27681/76A Expired GB1579738A (en) | 1977-07-04 | 1977-07-04 | Colour picture reproduction system |
Country Status (1)
Country | Link |
---|---|
GB (1) | GB1579738A (en) |
Cited By (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
FR2558026A1 (en) * | 1984-01-06 | 1985-07-12 | Thomson Csf | SYSTEM FOR PROCESSING IMAGE VIDEO SIGNALS FOR MONOCHROME VISUALIZATION |
WO1990000849A1 (en) * | 1988-07-08 | 1990-01-25 | Commonwealth Scientific And Industrial Research Organisation | A real-time signal processing circuit |
WO1991012695A1 (en) * | 1990-02-15 | 1991-08-22 | Eastman Kodak Company | Color difference compressor |
EP0472387A2 (en) * | 1990-08-21 | 1992-02-26 | Fujitsu Limited | Small-sized matrix operation apparatus |
GB2412810A (en) * | 2001-07-24 | 2005-10-05 | Hewlett Packard Co | Reducing inaccuracies caused by colour matrix transformation operations in dark areas of an image |
GB2378843B (en) * | 2001-07-24 | 2005-12-14 | Hewlett Packard Co | Method and apparatus for reducing inaccuracies when processing color data with a matrix |
-
1977
- 1977-07-04 GB GB27681/76A patent/GB1579738A/en not_active Expired
Cited By (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
FR2558026A1 (en) * | 1984-01-06 | 1985-07-12 | Thomson Csf | SYSTEM FOR PROCESSING IMAGE VIDEO SIGNALS FOR MONOCHROME VISUALIZATION |
EP0148705A2 (en) * | 1984-01-06 | 1985-07-17 | Thomson-Csf | Video signal-processing system for monochrome display |
EP0148705A3 (en) * | 1984-01-06 | 1985-08-14 | Thomson-Csf | Video signal-processing system for monochrome display |
WO1990000849A1 (en) * | 1988-07-08 | 1990-01-25 | Commonwealth Scientific And Industrial Research Organisation | A real-time signal processing circuit |
WO1991012695A1 (en) * | 1990-02-15 | 1991-08-22 | Eastman Kodak Company | Color difference compressor |
EP0472387A2 (en) * | 1990-08-21 | 1992-02-26 | Fujitsu Limited | Small-sized matrix operation apparatus |
EP0472387A3 (en) * | 1990-08-21 | 1993-05-19 | Fujitsu Limited | Small-sized matrix operation apparatus |
US5313274A (en) * | 1990-08-21 | 1994-05-17 | Fujitsu Limited | Color signal matrix circuit |
GB2412810A (en) * | 2001-07-24 | 2005-10-05 | Hewlett Packard Co | Reducing inaccuracies caused by colour matrix transformation operations in dark areas of an image |
GB2378843B (en) * | 2001-07-24 | 2005-12-14 | Hewlett Packard Co | Method and apparatus for reducing inaccuracies when processing color data with a matrix |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US2757571A (en) | Photographic color printer | |
US5370976A (en) | Metallic color printing process | |
US5557340A (en) | Noise reduction in video signals | |
US3647295A (en) | Color printing apparatus | |
US3196205A (en) | Color television camera system | |
US4160264A (en) | Matrix compensator for color video signals | |
US3123666A (en) | Boost | |
US2842610A (en) | Colour printing | |
US3131252A (en) | Electronic previewer for the graphic arts | |
US4812905A (en) | System for compensating for the violation of the constant luminance principle in color television systems | |
US4605954A (en) | Method of and arrangement for adjusting color saturation in a video printer | |
GB1579738A (en) | Colour picture reproduction system | |
US2976348A (en) | Electronic previewer for simulating image produced by photochemical processing | |
US2850563A (en) | Processes for the reproduction of images in color | |
US4403249A (en) | Apparatus for mixing image signals to obtain a printing master | |
DE2600901A1 (en) | METHOD AND DEVICE FOR IMAGE COMPENSATION DURING CORRECTION READING USING COLOR MONITORS | |
US3098895A (en) | Electronic previewer for televised color pictures | |
US3100815A (en) | Apparatus for producing color separation negatives and the like | |
US2872508A (en) | Color-correction systems | |
US3110761A (en) | Colour printer with colour correction | |
US2879326A (en) | Black printer for electro-optical reproduction | |
US2858362A (en) | Color television signal generating apparatus | |
US2905755A (en) | Electronic tone-masking system for use in the production of colour prints | |
JPS6361591A (en) | Method and device for image processing | |
US2823254A (en) | Color television receiver |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PS | Patent sealed [section 19, patents act 1949] | ||
PCNP | Patent ceased through non-payment of renewal fee |