EP1341374A2 - Imaging apparatus and method of optical-black clamping - Google Patents
Imaging apparatus and method of optical-black clamping Download PDFInfo
- Publication number
- EP1341374A2 EP1341374A2 EP03251167A EP03251167A EP1341374A2 EP 1341374 A2 EP1341374 A2 EP 1341374A2 EP 03251167 A EP03251167 A EP 03251167A EP 03251167 A EP03251167 A EP 03251167A EP 1341374 A2 EP1341374 A2 EP 1341374A2
- Authority
- EP
- European Patent Office
- Prior art keywords
- optical
- black
- area
- imaging
- pixels
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/70—SSIS architectures; Circuits associated therewith
- H04N25/71—Charge-coupled device [CCD] sensors; Charge-transfer registers specially adapted for CCD sensors
- H04N25/713—Transfer or readout registers; Split readout registers or multiple readout registers
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/60—Noise processing, e.g. detecting, correcting, reducing or removing noise
- H04N25/63—Noise processing, e.g. detecting, correcting, reducing or removing noise applied to dark current
- H04N25/633—Noise processing, e.g. detecting, correcting, reducing or removing noise applied to dark current by using optical black pixels
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/14—Picture signal circuitry for video frequency region
- H04N5/16—Circuitry for reinsertion of DC and slowly varying components of signal; Circuitry for preservation of black or white level
- H04N5/165—Circuitry for reinsertion of DC and slowly varying components of signal; Circuitry for preservation of black or white level to maintain the black level constant
Definitions
- the present invention relates to an imaging apparatus equipped with a solid-state image sensing device having an imaging area divided into at least two areas from which video signals are derived, and a method of optical-black clamping.
- the total number of pixels in a solid-state image sensing device has been dramatically increased with development of LSI microfabrication technology.
- the OB-clamp function adjusts a black level of a video signal output from a solid-state image sensing device.
- the clamp function requires rows of several ten black-level detecting pixels in the vertical direction in an imaging area of the image sensing device.
- pixel signals are extracted from among those black-level detecting pixels.
- the average level of these pixel signals is set in a signal level of no light output.
- the set signal level is subtracted from an output signal level from the imaging area to adjust a black level of a video signal.
- the number of pixels in each row increases as the number of those on a solid-state image sensing device increases.
- the clock frequency for signal output from the image sensing device becomes higher in proportion to the increase of pixels. This is because the duration of video-signal output from a solid-state image sensing device per row of pixels depends on video standard such as NTSC and PAL.
- Signal output from a solid-state image sensing device at high clock frequency requires the same high frequency for post processing. Such a requirement causes many restrictions on circuit design with noise and radiation suppression.
- the clock frequency can be made half by providing a solid-state image sensing device with two signal-output channels for an imaging area divided in left and right.
- Such imaging-area division increases the number of signal-output channels for imaging apparatus used in camera-built-in VTRs. Increase in the number of signal-output channels further causes variation in output-buffer characteristics over the channels. This results in stepped signal fluctuation on the border of the output channels. The stepped signal fluctuation will become sharp as the output fluctuates over the output-channel buffers due to temperature rise, which could occur in long-period filming.
- Imaging apparatus used in camera-built-in VTRs with right and left imaging areas suffer OB level differences for video signals output from the imaging areas.
- the main cause of the OB-level difference is variation in imaging characteristics occurring in mass production of solid-state image sensing devices.
- the OB-level difference causes inaccurate OB-clamp function due to usage of the average of different OB levels. This results in difference in black level between right and left in video.
- imaging apparatus with multiple pixels require a high frequency such as 36 MHz for drive pulses in charge transfer.
- a high frequency causes unrectangular pulse waveforms and inefficient charge transfer through many transfer stages. This results in OB-level differences over rows of pixels, which should not occur ideally.
- a reference black level is set at an average output-signal level from black-level detection pixels over the entire imaging areas in known imaging apparatus. This reference black-level setting could cause inaccurate black-level adjustments due to level difference between the upper and lower zones in imaging areas.
- Imaging apparatus further suffer small modulated light outputs through several color filters even at no light input. Such small outputs do not meet a reference black level set at the average of chrominance signals.
- a purpose of the present invention is to provide an imaging apparatus with a solid-state image sensing device and a method of optical-black clamping that achieve accurate cancellation of stepped outputs between right and left in device imaging area divided into two or more.
- Another purpose of the present invention is to provide an imaging apparatus with an enhanced OB-clamp function.
- Still another purpose of the present invention is to provide an imaging apparatus with a further enhanced OB-clamp function accurate between right and left in the imaging area divided into two or more on a solid-state image sensing device.
- the present invention provides an imaging apparatus comprising: a solid-state image sensing device having an imaging area divided into at least two sub-imaging areas in a horizontal direction in the imaging area, a first optical-black area and a second optical-black area being provided at both edges of the imaging area in the horizontal direction; an extractor to extract first video signals from a plurality of monitoring areas provided in the sub-imaging areas in the vicinity of the border between the sub-imaging areas; and an optical-black clamp processor to apply optical-black clamp processing to second video signals output from the sub-imaging areas by subtracting a first optical-black signal indicating an optical black level in the first optical-black area from the second video signal output from one of the sub-imaging areas and subtracting a second optical-black signal indicating an optical black level in the second optical-black area from the second video signal output from the other of the sub-imaging areas, the optical-black clamp processor including: a detector to detect a level difference between the extracted first video signals; a calculator to calculate an adjusting value per row of pixels, that provides
- the present invention provides an imaging apparatus comprising: a solid-state image sensing device having an imaging area divided into at least a first sub-imaging area and a second sub-imaging area in a horizontal direction in the imaging area, a first optical-black area and a second optical-black area being provided at both edges of the imaging area in the horizontal direction; and an optical-black clamp processor to apply optical-black clamp processing to first video signals output from the sub-imaging areas by subtracting a first optical-black signal indicating an optical black level in the first optical-black area from one of the first video signals output from the sub-imaging area and subtracting a second optical-black signal indicating an optical black level in the second optical-black area from the other of the first video signals output from the sub-imaging areas, theoptical-blackclamp processor including: a first optical-black adjusting-level calculator to calculate a first optical-black adjusting level per row of pixels in a vertical direction in the first optical-black area; a second optical-black adjusting-level calculator to calculate a second
- the present invention provides a method of optical-black clamping for an imaging apparatus having a solid-state image sensing device having an imaging area divided into at least two sub-imaging areas in a horizontal direction in the imaging area, a first optical-black area and a second optical-black area being provided at both edges of the imaging area in the horizontal direction, the method comprising the steps of: extracting first video signals from a plurality of monitoring areas provided in the sub-imaging areas in the vicinity of the border between the sub-imaging areas; and applying optical-black clamp processing to second video signals output from the sub-imaging areas by subtracting a first optical-black signal indicating an optical black level in the first optical-black area from the second video signal output from one of the sub-imaging areas and subtracting a second optical-black signal indicating an optical black level in the second optical-black area from the second video signal output from the other of the sub-imaging areas, the applying step including: detecting a level difference between the extracted first video signals; calculating an adjusting value per row of pixels, that provides the a
- the present invention provides a method of optical-black clamping for an imaging apparatus having a solid-state image sensing device having an imaging area divided into at least a first sub-imaging area and a second sub-imaging area in a horizontal direction in the imaging area, a first optical-black area and a second optical-black area being provided at both edges of the imaging area in the horizontal direction, the method comprising the steps of: applying optical-black clamp processing to first video signals output from the sub-imaging areas by subtracting a first optical-black signal indicating an optical black level in the first optical-black area from the first video signal output from one of the sub-imaging areas and subtracting a second optical-black signal indicating an optical black level in the second optical-black area from the first video signal output from the other of the sub-imaging areas , the applying step including: calculating a first optical-black adjusting level per row of pixels in a vertical direction in the first optical-black area; calculating a second optical-black adjusting level per row of pixels in the second optical-black area
- FIG. 1 is a block diagram of an embodiment of the imaging apparatus used in a camera-built-in VTR.
- Incident light from a target to be imaged and converged through an optical lens system 1 is radiated onto a solid-state image sensing device 2 for photoelectric transfer.
- FIG. 2 Illustrated in FIG. 2 is image-area arrangement on the solid-state image sensing device 2.
- the imaging area on the solid-state image sensing device 2 consists of two imaging areas 21A and 21B in left and right, and OB areas 22Aand 22B for optical-black-level detection provided on both sides of the imaging areas 21A and 21B.
- the image sensing device 2 is equipped with a horizontal CCD (Charge-Coupled Device) 24A for horizontal transfer of charges transferred from pixels of the imaging area 21A and the OB area 22A through a vertical transfer path (not shown); a horizontal CCD 24B for horizontal transfer of charges transferred from pixels of the imaging area 21B and the OB area 22B through a vertical transfer path (not shown); and output amplifiers 25A and 25B for amplifying output video signals from the CCDs 24A and 24B.
- CCD Charge-Coupled Device
- the amplifiers 25A and 25B output video signals from the left and right imaging areas 21A and 21B, respectively, per row of pixels.
- the solid-state image sensing device 2 with the two signal output channels operates at horizontal-transfer clock frequency 1/2 that of known solid-state image sensing devices.
- the image sensing device 2 thus allows high-quality videos to be stored on storage media through an imaging apparatus similar to known apparatus.
- left and right two-channel video signals output from the amplifiers 25A and 25B are supplied to an analog-signal processor 3 for correlated double sampling, automatic gain control (AGC), etc., under control by a drive signal from a driver 12.
- AGC automatic gain control
- the processed video signals are supplied to an A/D converter 4 for analog-to-digital conversion.
- the digital two-channel video signals are supplied to an OB-clamp processor 5 for OB-clamp processing and gain adjustments to the amplifiers 25A and 25B (FIG. 2) which will be disclosed later, under control by a control signal from a controller 11.
- the two-channel video signals are supplied to a pixel-density converter 6 from the OB-clamp processor 5, for pixel-density conversion (pixel decimation per unit of time, etc.), thus converted into a one-channel video signal.
- the one-channel video signal output from the pixel-density converter 6 is supplied to a digital-signal processor 7 for several types of signal processing and standard TV-signal format conversion.
- the one-channel video signal converted into a standard TV-signal format data is supplied to a D/A converter 8 for digital-to-analog conversion.
- the one-channel video signal converted into an analog video signal is then displayed on a monitor screen 9.
- a video signal output from the digital-signal processor 7 is supplied to a VTR recorder 10 and recorded on a magnetic tape through rotary heads.
- the amplifiers 25A and 25B are designed to have the same gain, however, exhibit different gain characteristics due to mass production, which cause stepped output on the border between right-and left-channel video signals.
- FIG. 3 shows a block diagram of the OB-clamp processor 5 to avoid such a problem.
- a video signal taken from the imaging area 21A (FIG. 2) is converted into a digital video signal "A" by the A/D converter 4 and supplied to an OB-clamper 31A.
- Video signal components from several pixels on the OB area 22A are extracted and averaged.
- the average level is set to a signal level of no light input and subtracted from the video signal taken from the imaging area 21A under the known clamping processing.
- the video signal "A" taken from the imaging area 21A is also supplied to a border-area accumulator 32A.
- a video signal taken from the imaging area 21B is also converted into a digital video signal "B" by the A/D converter 4 and supplied to an OB-clamper 31B.
- the digital video signal is subjected to the known clamping processing the same as the OB-clamper 31a, based on a signal from the OB area 22B.
- the processed signal is supplied to a border-area accumulator 32B.
- the border-area accumulators 32A and 32B each extracts signal components from several pixels, such as 8 pixels, in the vicinity of the border between the imaging areas 21A and 21B and calculates the average of the extracted signal components.
- the output of the border-area accumulator 32A is supplied to a change-amount calculator 33A for accumulating signal components from pixels in monitoring areas 23 1 , 23 3 , 23 5 and 23 7 separately.
- the monitoring areas 23 1 , 23 3 , 23 5 and 23 7 are located in the imaging area 21A but close to the imaging area 21B, as shown in FIG. 2.
- the output of the border-area accumulator 32B is supplied to a change-amount calculator 33B for accumulating signal components from pixels in monitoring areas 23 2 , 23 4 , 23 6 and 23 8 separately.
- the monitoring areas 23 2 , 23 4 , 23 6 and 23 8 are located in the imaging area 21B but close to the imaging area 21A, as shown in FIG. 2.
- the monitoring areas 23 1 , 23 3 , 23 5 and 23 7 are located in the vicinity of the monitoring areas 23 2 , 23 4 , 23 6 and 23 8 , respectively.
- Each monitoring area covers, for example, 8 pixels in each of 64 rows, as shown in FIG. 4.
- Four pixels provided with cyan (Cy) color filters and other four pixels provided with yellow (Ye) color filters are alternatively aligned in 8 pixels in total on each odd row.
- four pixels provided with magenta (Mg) color filters and other four pixels provided with green (G) color filters are alternatively aligned in 8 pixels in total on each even row.
- each monitoring area covers 128 pixels for each color filter or 512 pixels in total in FIG. 4.
- the locations of the monitoring areas 23 1 , 23 3 , 23 5 and 23 7 in the imaging area 21A and also the locations of the monitoring areas 23 2 , 23 4 , 23 6 and 23 8 in the imaging area 21B can be shifted to any positions in each imaging area under control by the controller 11 (FIG. 1).
- the change-amount calculator 33A (FIG. 3) accumulates the signal components from the pixels in the monitoring areas 23 1 , 23 3 , 23 5 and 23 7 separately.
- the change-amount calculator 33A performs accumulation to the output of the border-area accumulator 32A for each of the monitoring areas 23 1 , 23 3 , 23 5 and 23 7 per 128 pixels of each of four color filters (not for 512 pixels at once) with four accumulators, as follows:
- the same accumulation is performed by the change-amount calculator 33B (FIG. 3) to the output of the border-area accumulator 32B for each of the monitoring areas 23 2 , 23 4 , 23 6 and 23 8 per 128 pixels of each of four color filters (not for 512 pixels at once) with four accumulating sections.
- the accumulation processing per 128 pixels cancels variation in modulation by the color filters for accurate detection of stepped outputs between imaging areas 21A and 21B.
- the accumulated values (C1, Y1, M1 and G1), (C2, Y2, M2 and G2), (C3, Y3, M3 and G3) and (C4, Y4, M4 and G4) from the monitoring areas 23 1 , 23 3 , 23 5 and 23 7 , respectively, are supplied to an interpolator 335AA (FIG. 3) of the change-amount calculator 33A.
- the interpolator 335A calculates an adjustment value for each row of pixels, as shown in FIG. 5 from (C1, C2, C3 and C4) for the pixels of Cy-color filer.
- the same adjustment-value calculation is applied to (Y1, Y2, Y3 and Y4), (M1, M2, M3 and M4) and (G1 G2, G3 and G4) for the pixels of Y-, Mg- and G-color filers, respectively.
- the accumulated values (C1, Y1, M1 and G1), (C2, Y2, M2 and G2), (C3, Y3, M3 and G3) and (C4, Y4, M4 and G4) from the monitoring areas 23 2 , 23 4 , 23 6 and 23 8 , respectively, are supplied to an interpolator 335B (FIG. 3) of the change-amount calculator 33B, for the adjustment-value calculation the same as the interpolator 335A.
- the adjustment-value calculation per row of pixels based on the accumulated values on the pixels of the same color filter is performed for each picture.
- the repeated calculation produces a constant signal level over several pictures while suppressing effects of spontaneous signal change and noises in each picture, for further accurate detection of stepped outputs between imaging areas 21A and 21B.
- Adjustment values obtained by the interpolators 335A and 335B are supplied to a level comparator 34 (FIG. 3).
- the level comparator 34 compares levels of the adjustment values for the same color filter on the same row of pixels between adjacent two monitoring areas among the 8 monitoring areas 23 1 to 23 8 (FIG. 2) to obtain stepped values from the level difference.
- the stepped values are subjected to linear interpolation to obtain level adjustment values.
- stepped values (signal-level differences), or the level differences between the adjustment values for the same color filter on the same row of pixels between adjacent two monitoring areas are indicated in FIG. 5.
- the signs LD 1 , LD 2 , LD 3 and LD 4 indicate signal-level differences between the monitoring areas 23 1 and 23 2 , 23 3 and 23 4 , 23 5 and 23 6 , and 23 7 and 23 8 (FIG. 2), respectively.
- the sign LD r indicates a signal-level difference per row of pixels
- LD m a signal-level difference between the monitoring areas in the vertical direction, such as, between the height of III (the height indicating the signal-level difference between the areas 23 5 and 23 6 ) and the height of IV (the height indicating the signal-level difference between the areas 23 7 and 23 8 )
- D m a distance between the monitoring areas in the vertical direction, such as the areas 23 1 and 23 3 .
- the signs I, II, III and IV, in FIG. 5, indicate the range of row of pixels in each monitoring area.
- the left, the center and the right vertical lines in the range I indicate the top, the middle and the last row of pixels, respectively, in the each of the monitoring areas 23 1 and 23 2 .
- the level comparator 34 applies linear interpolation to the stepped values I to IV for the respective rows of pixels.
- the interpolated stepped values are then stored in a buffer for respective row of pixels in the comparator 34.
- the level-adjustment values that match a level ratio per row of pixels is obtained from the stored interpolated stepped values.
- a level ratio is a/b when the outputs of the change-amount calculators 33A and 33B are "a" and "b", respectively.
- the level comparator 34 outputs a level-adjustment value b/a to a multiplier 35A (FIG. 3) for multiplying the output of the OB clamper 31A by the value b/a whereas a level-adjustment value 1 to a multiplier 35B (FIG. 3) for multiplying the output of the OB clamper 31B by the value 1.
- the outputs of the multipliers 35A and 35B of the OB-clamp processor 5 are the two-channel video signals with no stepped components between the adjacent imaging areas 21A and 21B even through the output amplifiers 25A and 25B (FIG. 2) exhibiting different gain characteristics due to mass production.
- the first embodiment provided with the OB-clamp processor 5 achieves high yields and cost reduction in production of imaging apparatus equipped with solid-state image sensing devices.
- FIG. 6 Disclosed next with reference to FIG. 6 is a modification to the OB-clamp processor 5. Elements in this modification that are the same or analogous to the elements shown in FIG. 3 are referenced by the same reference numerals and will not be explained.
- the OB-clamp processor 5 (FIG. 3) and the modification (FIG. 6) are different from each other as follows:
- the former processor (FIG. 3) obtains the signals to be accumulated by sampling the video signals before supplied to the OB clampers 31A and 31B.
- the latter obtains the signals to be accumulated by sampling the video signals after level adjustments by the OB clampers 31A and 31B and also the multipliers 35A and 35B.
- FIG. 6 a video signal output from the multiplier 35A after level adjustments for the imaging area 21A (FIG. 2) is supplied to a border-area calculator 36A for the same processing as the counterpart 32A (FIG. 3).
- FIG. 2 Another video signal output from the multiplier 3BA after level adjustments for the imaging area 21B (FIG. 2) is supplied to a border-area calculator 36B for the same processing as the counterpart 32B (FIG. 3).
- the outputs of the border-area calculators 36A and 36B are supplied to the change-amount calculators 33A and 33B, the level comparators 34 and the multipliers 35A and 35B under the same processing as explained with reference to FIGS. 3 to 5.
- the modification shown in FIG. 6 has feed-back loops for level-difference adjustments for the video signal from the left and right imaging areas 21A and 21B.
- This feed-back loop circuitry performs level control to achieve no gain difference all time between the output amplifiers 25Aand 25B (FIG. 2) of the solid-state image sensing device 2 (FIG. 1), as a self-management system.
- the border between the imaging areas 21A and 21B can be detected from the video signal and also horizontal and vertical synchronizing signals output from the digital-signal processor 7 for final stepped-component monitoring, thus achieving further accurate level-difference detection.
- the difference between the OB-clamp processors in FIGS. 3 and 6 lies in signal-sampling timing for level-difference detection. Not only one, but several sampling timings in FIGS. 3 and 6 can be used for accurate level-difference detection.
- FIG. 7 Disclosed next with reference to FIG. 7 is a modification to the solid-state image sensing device 2 shown in FIG. 2.
- a solid-state image sensing device 14 in this modification consists of two imaging areas 41A and 41B in left and right, and OB areas 42A and 42B for optical-black-level detection provided on both sides of the imaging areas 41A and 41B.
- the image sensing device 14 is equipped with a horizontal CCD 44A for horizontal transfer of charges transferred from pixels of the imaging area 41A and the OB area 42A through a vertical transfer path (not shown); a horizontal CCD 44B for horizontal transfer of charges transferred from pixels of the imaging area 41B and the OB area 42B through a vertical transfer path (not shown); and output amplifiers (not shown) for amplifying output video signals from the CCDs 44A and 44B.
- the horizontal CCDs 44A and 44B output video signals from the left and right imaging areas 41A and 41B, respectively, per row of pixels.
- the solid-state image sensing device 14 with the two signal output channels also operates at horizontal-transfer clock frequency 1/2 that of known solid-state image sensing devices.
- the image sensing device 14 thus allows high-quality videos to be stored on storage media through an imaging apparatus similar to known apparatus.
- the solid-state image sensing device 14 has a symmetrical structure as shown in FIG. 7.
- Video signals taken from the imaging area 41A and the OB area 42A are output per row of pixels through the horizontal CCD 44A and the amplifier (not shown).
- video signals taken from the imaging area 41B and the OB area 42B are output per row of pixels through the horizontal CCD 44B and the amplifier (not shown).
- the pixels in the left and right OB areas 42A and 42B are provided with photodiodes, color filters, on-chip lenses and vertical CCDs (transfer paths), having the same structure as the imaging areas 41A and 41B.
- the pixels in the OB areas 42A and 42B are provided with light shielding so that light from the outside can not reach the photodiodes.
- the OB areas 42A and 42B always output optically black-level (OB level) signals.
- the OB-level signals from the OB areas 42A and 42B are also output per row of pixels through the horizontal CCDs 44A and 44B and also the amplifiers (not shown).
- An OB-clamp processor 15 shown in FIG. 8 performs accumulation for each of four blocks of OB-level data output from the OB areas 42A and 42B.
- the four blocks are blocks 43A1 to 43A4 in the OB area 42A and also blocks 43B1 to 43B4 in the OB area 42B, as shown in FIG. 7.
- Each of the blocks 43A1 to 43A4 and the blocks 43B1 to 43B4 consists of, for example, 16 pixels in a horizontal direction and 64 pixels in a vertical direction, 1024 pixels in total, as shown in FIG. 9.
- each block covers 256 pixels for each color filter or 1024 pixels in total in FIG. 9.
- the OB-clamp processor 15 performs calculation as follows:
- An average OB-level data is calculated on each of the OB-area blocks 43A1 to 43A4 and also the OB-area blocks 43B1 to 43B4.
- the average OB-level data on the block 43A1 is subtracted from a row signal for each of several rows of pixels in the imaging area 41A but close to the OB-area block 43A1.
- the same subtraction processing is applied to the average OB-level data on the blocks 43A2, 43A3 and 43A4.
- the average OB-level data on the block 43B1 is subtracted from a row signal for each of several rows of pixels in the imaging area 41B but close to the OB-area block 43B1.
- the same subtraction processing is applied to the average OB-level data on the blocks 43B2, 43B3 and 43B4.
- the locations of the blocks 43A1 to 43A4 in the OB area 42A and also the locations of the blocks 43B1 to 43B4 in the OB area 42B can be shifted to any positions in each OB area under control by the controller 11 (FIG. 1), for signal accumulation on areas which could suffer the least effects of noises or pixel degradation on the solid-state image sensing device 14.
- the OB-clamp processor 15 in this modification will be disclosed in detail with reference to FIG. 8.
- the OB-clamp processor 15 shown in FIG. 8 is employed for each of the imaging areas 41A and 41B (FIG. 7). In other words, two OB-clamp processors 15 are provided in parallel for the two imaging areas 41A and 41B.
- 2-channel digital video signals are supplied to the OB-clamp processor 15 from the A/D converter shown in FIG. 1.
- a 1-channel digital video signal (for example, derived from the imaging area 41A and the OB area 42A) is supplied to an OB-block accumulator 51 and a subtractor 54.
- the 1-channel digital video signal derived from the imaging area 41A and the OB area 42A is then supplied to an OB-position gate 511.
- OB-level data on the four blocks 43A1 to 43A4 are output from the gate 511 based on positional data on the four blocks supplied by the controller 11 (FIG. 1) while vertical and horizontal synchronizing signals are being supplied.
- the 4-block OB-level data output from the gate 511 are supplied to an adder 512 and added to the output thereof for accumulation.
- the accumulated OB-level data on the four blocks 43A1 to 43A4 obtained by the OB-block accumulator 51 are supplied to a change-amount calculator 52.
- the accumulated OB-level data on the four blocks 43A1 to 43A4 are supplied to averaging units 521, 522, 523 and 524, respectively, for averaging processing.
- the four average accumulated OB-level data are supplied to a calculator 525 for obtaining an OB-adjusting level per row of pixels.
- the calculator 525 performs calculation disclosed below for average accumulated OB-level data AV1 on the block 43A1 from rows La to Lb, AV2 on the block 43A2 from rows Lc to Ld, AV3 on the block 43A3 from rows Le to Lf, and AV4 on the block 43A4 from rows Lg to Lh.
- the center positions in the blocks 43A1, 43A2, 43A3 and 43A4 in the vertical direction are given by (La + Lb)/2, (Lc + Ld)/2, (Le + Lf)/2 and (Lg + Lh)/2, respectively.
- OBA12(n) n•X(A12)/D(A12) + AV1 where "n" indicates the n-th row of pixels between the center pixel in the block 43A1 and that in the block 43A2.
- OB-adjusting levels on each row of pixels between the blocks 43A2 and 43A3, and also blocks 43A3 and 43A4 can be obtained in the same way.
- the signs AL 1 , AL 2 , ALD 3 and AL 4 indicate OB-adjusting levels obtained for the blocks 43A1, 43A2, 43A3 and 43A4, respectively.
- the sign AL r indicates an OB-adjusting level per row of pixels
- LD b an OB-adjusting-level difference between the blocks in the vertical direction, such as, between the blocks 43A3 and 43A4, and D b a distance between the blocks in the vertical direction, such as the blocks 43A1 and 43A2 3 .
- the signs V, VI, VII and VIII, in FIG. 10 indicate the range of row of pixels in each block.
- the left, the center and the right vertical lines in the range V indicate the top, the middle and the last row of pixels, respectively, in the block 43A1.
- Each obtained OB-adjusting level is once stored in the corresponding register among 480 parallel registers 531 in an adjusting-level storage 53 in FIG. 8.
- the stored OB-adjusting levels are supplied to a switch circuitry 532. Also supplied to the switch circuitry 532 are horizontal and vertical synchronizing signals of the input 1-channel video signal. The number of scanning lines of the input video signal is detected. The OB-adjusting levels corresponding to the detected scanning lines are selected by the switch circuitry 532 and supplied to a subtractor 54 for subtraction from the input 1-channel video signal in OB-clamping processing.
- OB-level change detection per row of pixels for varying OB-adjusting levels offers highly accurate OB-clamp function for the multi-pixel solid-state image sensing device 14 (FIG. 7). Therefore, the present invention achieves high reproducibility of constantly correct black level and achromatic color, thus suppressing shading due to change in black level and unnatural coloring under low illumination.
- the imaging apparatus shown in FIG. 1 equipped with the OB-clamp processor 5 extracts video signals on the left and right four monitoring areas as sampling signals, accumulates the sampling signals, calculates gain differences per row of pixels using the accumulated values for OB-level adjustments.
- all signal levels are calculated per row of pixels in calculation of adjusting level per row of pixels, the calculated adjusting level being once stored in a buffer provided per row of pixels in the controller 11 (FIG. 1) in video-signal adjustments.
- Video signals at, for example, 16 pixels in left and right may be extracted and averaged as a level difference per row of pixels.
- level accumulation for, for example, eight pixels and subtraction may be performed per color filter for further accurate gain-difference adjustments. This is achieved because the output of a pixel provided with two different types of color filters is generated per one clock.
- the imaging apparatus shown in FIG. 1 is equipped with the solid-state imaging device 2 or 14 having an imaging area divided into two areas in the horizontal direction.
- the imaging area may, however, be divided into three or more areas in the horizontal direction for signal-level adjustments on the borders between the divided areas with the same technique disclosed above.
- several blocks may be provided in each of two OB areas at left and right edges of an imaging area for accumulation of OB signals from the blocks and calculation of OB-adjusting level per row of pixels in OB-clamp processing.
- each block covers 256 pixels for each color filter or 1024 pixels in total for OB-level data accumulation in each of the blocks 43A1 to 43A4 and 43B1 to 43B4.
- This pixel arrangement allows for accumulation per color filter instead of accumulation of all 1024-pixel data from one block shown in FIG. 7.
- This is achieved with, in FIG. 8, two OB-block accumulators 51 that alternately accept a 1-channel digital video signal per pixel in accumulation per row of pixels and per color, and 16 registers (4 blocks ⁇ 4 colors) in the adjusting-level storage 53 for storing the accumulated values of the change-amount calculator 52.
- change-amount calculators and adjusting-level storages are provided for four channels per color filter.
- the accumulation per color filter with such arrangements offers further accurate OB-clamp function with almost no errors due to unstable clocks or noises.
- FIGS. 7 and 8 offer OB-clamp processing with accumulation of signals from the four blocks in each of the OB areas 42A and 42B and calculation of OB-adjusting level per row of pixels.
- all OB levels are calculated per row of pixels in calculation of OB-adjusting level per row of pixels, the calculated OB-adjusting level being once stored in a buffer provided per row of pixels in the adjusting-level storage 53 (FIG. 8) in vides-signal adjustments.
- Video signals may be extracted from an OB area of, for example, 16 pixels per row and averaged as an adjusting level per row.
- level accumulation for, for example, eight pixels and subtraction may be performed per color filter for further accurate OB-clamp function. This is achieved because the output of an OB pixel provided with two different types of color filters is generated per clock.
- the present invention decreases stepped signal fluctuation occurring in the vicinity of the borders between several divided imaging areas due to gain differences occurring in mass production of output amplifiers, by adjustments to attain the least signal-level difference between video signals from the monitoring areas in the imaging areas.
- the present invention achieves suppression of stepped signal fluctuation in center section of image due to gain differences in output amplifiers or fluctuation in output of output buffers caused by temperature change, thus achieving high yields in production of solid-stage image sensing devices at low cost.
- the present invention achieves accurate OB-clamp processing with calculation of first and second OB-adjusting levels per row of pixels for first and second left and right OB areas, respectively, in an imaging area.
- the OB-clamp processing is applicable to multi-pixel solid-stage image sensing devices that often suffer a big OB-level difference due to difference in the number of charge transfer stages for OB areas (more transfer stages for pixels provided in the upper section than the lower section of each OB area). Therefore, the present invention achieves high reproducibility of constantly correct black level and achromatic color with no difference in black level with respect to a reference black level in up and down and also left and right in an imaging area, thus suppressing shading due to change in black level and unnatural coloring under low illumination.
- the locations of the blocks in the first and the second OB areas can be shifted to any positions in each OB area, particularly, to the positions that do not suffer effects of noises and pixel damages.
- the present invention achieves further accurate OB-clamp processing.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Transforming Light Signals Into Electric Signals (AREA)
- Solid State Image Pick-Up Elements (AREA)
Abstract
Description
Claims (8)
- An imaging apparatus comprising:a solid-state image sensing device having an imaging area divided into at least two sub-imaging areas in a horizontal direction in the imaging area, a first optical-black area and a second optical-black area being provided at both edges of the imaging area in the horizontal direction;an extractor to extract first video signals from a plurality of monitoring areas provided in the sub-imaging areas in the vicinity of the border between the sub-imaging areas; andan optical-black clamp processor to apply optical-black clamp processing to second video signals output from the sub-imaging areas by subtracting a first optical-black signal indicating an optical black level in the first optical-black area from the second video signal output from one of the sub-imaging areas and subtracting a second optical-black signal indicating an optical black level in the second optical-black area from the second video signal output from the other of the sub-imaging areas, the optical-black clamp processor including:a detector to detect a level difference between the extracted first video signals;a calculator to calculate an adjusting value per row of pixels, that provides the smallest level difference per row of pixels in a vertical direction in the imaging area based on the detected level difference;a plurality of optical-black clampers each subtracting the first optical-black signal from the second video signal output from one of the sub-imaging areas and subtracting the second optical-black signal from the second video signal output from the other of the sub-imaging areas, thus outputting an optical-black-clamped video signal; andan adjuster to perform adjustments to video- signal levels by multiplying the optical-black-clamped video signal by the adjusting value.
- An imaging apparatus comprising:a solid-state image sensing device having an imaging area divided into at least a first sub-imaging area and a second sub-imaging area in a horizontal direction in the imaging area, a first optical-black area and a second optical-black area being provided at both edges of the imaging area in the horizontal direction; andan optical-black clamp processor to apply optical-black clamp processing to first video signals output from the sub-imaging areas by subtracting a first optical-black signal indicating an optical black level in the first optical-black area from the first video signal output from one of the sub-imaging areas and subtracting a second optical-black signal indicating an optical black level in the second optical-black area from the first video signal output from the other of the sub-imaging areas, the optical-black clamp processor including:a first optical-black adjusting-level calculator to calculate a first optical-black adjusting level per row of pixels in a vertical direction in the first optical-black area;a second optical-black adjusting-level calculator to calculate a second optical-black adjusting level per row of pixels in the second optical-black area;a first adjuster to subtract the first optical-black adjusting level per row of pixels from a second video signal per row of pixels in the first sub-imaging area close to the first optical-black area; anda second adjuster to subtract the second optical-black adjusting level per row of pixels from a third video signal per row of pixels in the second sub-imaging area close to the second optical-black area.
- The imaging apparatus according to claim 2, wherein:the first optical-black adjusting-level calculator calculates an average optical-black level in each of a plurality of first blocks each including a plurality of pixels in the vertical and the horizontal directions in the first optical-black area, and calculates first optical-black adjusting levels on the rows of pixels based on a plurality of average optical-black levels in the first blocks; andthe second optical-black adjusting-level calculator calculates an average optical-black level in each of a plurality of secondblocks each including a plurality of pixels in the vertical and the horizontal directions in the first optical-black area, and calculates second optical-black adjusting levels on the rows of pixels based on a plurality of average optical-black levels in the second blocks.
- The imaging apparatus according to claim 3 further comprising a controller to shift locations of the first and the second blocks within the first and the second optical-black areas, respectively.
- A method of optical-black clamping for an imaging apparatus having a solid-state image sensing device having an imaging area divided into at least two sub-imaging areas in a horizontal direction in the imaging area, a first optical-black area and a second optical-black area being provided at both edges of the imaging area in the horizontal direction, the method comprising the steps of:extracting first video signals from a plurality of monitoring areas provided in the sub-imaging areas in the vicinity of the border between the sub-imaging areas; andapplying optical-black clamp processing to second video signals output from the sub-imaging areas by subtracting a first optical-black signal indicating an optical black level in the first optical-black area from the second video signal output from one of the sub-imaging areas and subtracting a second optical-black signal indicating an optical black level in the second optical-black area from the second video signal output from the other of the sub-imaging areas, the applying step including:detecting a level difference between the extracted first video signals;calculating an adjusting value per row of pixels, that provides the smallest level difference per row of pixels in a vertical direction in the imaging area based on the detected level difference;subtracting the first optical-black signal from the second video signal output from one of the sum-imaging areas and subtracting the second optical-black signal from the second video signal output from the other of the sum-imaging areas, thus outputting an optical-black-clamped video signal; andperforming adjustments to video-signal levels by multiplying the optical-black-clamped video signal by the adjusting value.
- A method of optical-black clamping for an imaging apparatus having a solid-state image sensing device having an imaging area divided into at least a first sub-imaging area and a second sub-imaging area in a horizontal direction in the imaging area, a first optical-black area and a second optical-black area being provided at both edges of the imaging area in the horizontal direction, the method comprising the steps of:applying optical-black clamp processing to first video signals output from the sub-imaging areas by subtracting a first optical-black signal indicating an optical black level in the first optical-black area from the first video signal output from one of the sub-imaging areas and subtracting a second optical-black signal indicating an optical black level in the second optical-black area from the first video signal output from the other of the sub-imaging areas, the applying step including:calculating a first optical-black adjusting level per row of pixels in a vertical direction in the first optical-black area;calculating a second optical-black adjusting level per row of pixels in the second optical-black area;subtracting the first optical-black adjusting level per row of pixels from a second video signal per row of pixels in the first sub-imaging area close to the first optical-black area; andsubtracting the second optical-black adjusting level per row of pixels from a third video signal per row of pixels in the second sub-imaging area close to the second optical-black area.
- The method of optical-black clamping according to claim 6, wherein:the first optical-black adjusting-level calculating step includes the steps of calculating an average optical-black level in each of a plurality of first blocks each including a plurality of pixels in the vertical and the horizontal directions in the first optical-black area, and calculating first optical-black adjusting levels on the rows of pixels based on a plurality of average optical-black levels in the first blocks; andthe second optical-black adjusting-level calculating step includes the steps of calculating an average optical-black level in each of a plurality of second blocks each including a plurality of pixels in the vertical and the horizontal directions in the first optical-black area, and calculating second optical-black adjusting levels on the rows of pixels based on a plurality of average optical-black levels in the second blocks.
- The method of optical-black clamping according to claim 6 further comprising the step of shifting locations of the first and the second blocks within the first and the second optical-black areas, respectively.
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2002050580 | 2002-02-27 | ||
| JP2002050580A JP3937870B2 (en) | 2002-02-27 | 2002-02-27 | Imaging device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| EP1341374A2 true EP1341374A2 (en) | 2003-09-03 |
| EP1341374A3 EP1341374A3 (en) | 2007-03-21 |
Family
ID=27678494
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| EP03251167A Ceased EP1341374A3 (en) | 2002-02-27 | 2003-02-26 | Imaging apparatus and method of optical-black clamping |
Country Status (3)
| Country | Link |
|---|---|
| US (1) | US6982705B2 (en) |
| EP (1) | EP1341374A3 (en) |
| JP (1) | JP3937870B2 (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2008037287A1 (en) | 2006-09-28 | 2008-04-03 | Nokia Corporation | Read out mthod for a cmos imager with reduced dark current |
| EP2043363A3 (en) * | 2007-09-27 | 2012-02-08 | Sony Corporation | Image pickup apparatus, image signal processing circuit and image signal processing method as well as computer program |
Families Citing this family (30)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP4329409B2 (en) * | 2003-05-23 | 2009-09-09 | 株式会社ニコン | Electronic camera shading correction circuit |
| EP1655957A4 (en) * | 2003-07-01 | 2009-03-18 | Nikon Corp | DEVICE FOR CORRECTING THE VIDEO SIGNAL OF AN ELECTRONIC CAMERA |
| JP4549040B2 (en) * | 2003-08-19 | 2010-09-22 | キヤノン株式会社 | Imaging device |
| KR100493900B1 (en) * | 2003-08-21 | 2005-06-10 | 삼성전자주식회사 | Method for Sharing Rights Object Between Users |
| US7692704B2 (en) * | 2003-12-25 | 2010-04-06 | Canon Kabushiki Kaisha | Imaging apparatus for processing noise signal and photoelectric conversion signal |
| JP4260003B2 (en) * | 2003-12-26 | 2009-04-30 | 三洋電機株式会社 | Electronic camera |
| JP4236603B2 (en) * | 2004-03-16 | 2009-03-11 | 三洋電機株式会社 | Electronic camera |
| US7443432B2 (en) * | 2004-06-15 | 2008-10-28 | Digital Imaging Systems Gmbh | Suppression of noise in pixel VDD supply |
| JP4636895B2 (en) | 2005-02-07 | 2011-02-23 | 三洋電機株式会社 | Electronic camera |
| JP4514138B2 (en) * | 2005-02-21 | 2010-07-28 | 株式会社リコー | Method for driving solid-state imaging device and digital camera |
| JP2007104256A (en) * | 2005-10-04 | 2007-04-19 | Pentax Corp | Image sensor and digital camera |
| JP4606306B2 (en) * | 2005-11-14 | 2011-01-05 | 三洋電機株式会社 | Electronic camera |
| JP2007150828A (en) * | 2005-11-29 | 2007-06-14 | Pentax Corp | Fixed pattern noise removal device |
| JP4698426B2 (en) * | 2006-01-11 | 2011-06-08 | 三洋電機株式会社 | Electronic camera |
| JP4462299B2 (en) * | 2007-07-17 | 2010-05-12 | ソニー株式会社 | Imaging apparatus, image processing method, and computer program |
| JP5686267B2 (en) * | 2008-02-14 | 2015-03-18 | ソニー株式会社 | Image sensor |
| JP2009284424A (en) * | 2008-05-26 | 2009-12-03 | Sony Corp | Imaging apparatus, imaging method, and program |
| JP5254830B2 (en) * | 2009-02-03 | 2013-08-07 | キヤノン株式会社 | Imaging apparatus, control method thereof, and program |
| US20110074997A1 (en) * | 2009-09-30 | 2011-03-31 | Border John N | Methods for capturing and reading out images from an image sensor |
| US8279317B2 (en) * | 2009-09-30 | 2012-10-02 | Truesense Imaging, Inc. | Methods for capturing and reading out images from an image sensor |
| US8149303B2 (en) * | 2009-09-30 | 2012-04-03 | Truesense Imaging, Inc. | Methods for capturing and reading out images from an image sensor |
| US8314873B2 (en) * | 2009-09-30 | 2012-11-20 | Truesense Imaging, Inc. | Methods for capturing and reading out images from an image sensor |
| US8194164B2 (en) * | 2009-09-30 | 2012-06-05 | Truesense Imaging, Inc. | Methods for capturing and reading out images from an image sensor |
| US8279316B2 (en) * | 2009-09-30 | 2012-10-02 | Truesense Imaging, Inc. | Methods for capturing and reading out images from an image sensor |
| US8294803B2 (en) * | 2009-09-30 | 2012-10-23 | Truesense Imaging, Inc. | Methods for capturing and reading out images from an image sensor |
| US8194165B2 (en) * | 2009-09-30 | 2012-06-05 | Truesense Imaging, Inc. | Methods for capturing and reading out images from an image sensor |
| US8194166B2 (en) | 2009-09-30 | 2012-06-05 | Truesense Imaging, Inc. | Methods for capturing and reading out images from an image sensor |
| CN101800022B (en) * | 2010-03-17 | 2012-01-11 | 福州大学 | Low grayscale enhancing method for field emission display based on subsidiary driving technique |
| JP5896947B2 (en) * | 2013-03-26 | 2016-03-30 | キヤノン株式会社 | IMAGING DEVICE AND ITS CONTROL METHOD, IMAGING SYSTEM, PROGRAM, AND STORAGE MEDIUM |
| CN108111785B (en) * | 2017-12-28 | 2020-05-15 | Oppo广东移动通信有限公司 | Image processing method and device, computer readable storage medium and computer device |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5293225A (en) * | 1991-05-31 | 1994-03-08 | Victor Company Of Japan, Ltd. | Digital signal processing system for color camera apparatus including separate delays for color signal and brightness signal processing |
| EP1033868A1 (en) * | 1999-03-01 | 2000-09-06 | Canon Kabushiki Kaisha | Image pickup apparatus |
| JP2000350055A (en) * | 1999-06-08 | 2000-12-15 | Nec Corp | Outline correction device for digital video camera |
| JP2001042042A (en) * | 1999-07-27 | 2001-02-16 | Canon Inc | Imaging device |
| JP4454750B2 (en) * | 1999-12-28 | 2010-04-21 | 日本バーブラウン株式会社 | Front-end signal processing method and apparatus for image sensor |
| US7050098B2 (en) * | 2001-03-29 | 2006-05-23 | Canon Kabushiki Kaisha | Signal processing apparatus and method, and image sensing apparatus having a plurality of image sensing regions per image frame |
-
2002
- 2002-02-27 JP JP2002050580A patent/JP3937870B2/en not_active Expired - Lifetime
-
2003
- 2003-02-26 EP EP03251167A patent/EP1341374A3/en not_active Ceased
- 2003-02-27 US US10/373,864 patent/US6982705B2/en not_active Expired - Lifetime
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2008037287A1 (en) | 2006-09-28 | 2008-04-03 | Nokia Corporation | Read out mthod for a cmos imager with reduced dark current |
| US8223227B2 (en) | 2006-09-28 | 2012-07-17 | Nokia Corporation | Read out method for a CMOS imager with reduced dark current |
| EP2043363A3 (en) * | 2007-09-27 | 2012-02-08 | Sony Corporation | Image pickup apparatus, image signal processing circuit and image signal processing method as well as computer program |
Also Published As
| Publication number | Publication date |
|---|---|
| US20030160772A1 (en) | 2003-08-28 |
| JP3937870B2 (en) | 2007-06-27 |
| JP2003259224A (en) | 2003-09-12 |
| EP1341374A3 (en) | 2007-03-21 |
| US6982705B2 (en) | 2006-01-03 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US6982705B2 (en) | Imaging apparatus and method of optical-black clamping | |
| US11233957B2 (en) | Solid state image sensor and electronic equipment | |
| KR101211117B1 (en) | Signal processing apparatus and signal processing method for solid-state image pickup element and image pickup apparatus | |
| US10229475B2 (en) | Apparatus, system, and signal processing method for image pickup using resolution data and color data | |
| US7826658B2 (en) | Image processing system, image processing method, image processing recording medium, and program suitable for extraction processing | |
| KR100381496B1 (en) | An image signal processing apparatus | |
| KR101252275B1 (en) | The signal process apparatus and method of the solid-state image pickup device and imaging device | |
| JP4305071B2 (en) | Signal correction method | |
| US7990442B2 (en) | Image pickup device and noise reduction method thereof | |
| JP2002238057A (en) | Imaging device, luminance correction method, and program for executing the method on computer | |
| JP3596860B2 (en) | Imaging device | |
| JP4420004B2 (en) | Imaging device | |
| JP5055173B2 (en) | IMAGING DEVICE AND IMAGING DEVICE CONTROL METHOD | |
| US6686961B1 (en) | Image pickup apparatus | |
| JPH0984028A (en) | Luminance signal forming circuit | |
| JP3733182B2 (en) | Imaging apparatus and vertical stripe removal method | |
| JP2007228152A (en) | Solid-state imaging device and imaging method | |
| JP6010943B2 (en) | Imaging device | |
| JP3733172B2 (en) | Imaging device | |
| JP4437940B2 (en) | Television camera | |
| JP2011101170A (en) | Smear correction method of ccd type solid-state imaging element, and imaging device | |
| JP2007124182A (en) | Solid-state imaging device, driving method thereof, and imaging apparatus | |
| JP2009017372A (en) | Imaging apparatus and driving method thereof | |
| JP2007074748A (en) | Image signal processing apparatus | |
| JP2011114474A (en) | Imaging apparatus and method for driving solid-state imaging element |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
| AK | Designated contracting states |
Kind code of ref document: A2 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LI LU MC NL PT SE SI SK TR |
|
| AX | Request for extension of the european patent |
Extension state: AL LT LV MK RO |
|
| PUAL | Search report despatched |
Free format text: ORIGINAL CODE: 0009013 |
|
| AK | Designated contracting states |
Kind code of ref document: A3 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LI LU MC NL PT SE SI SK TR |
|
| AX | Request for extension of the european patent |
Extension state: AL LT LV MK RO |
|
| 17P | Request for examination filed |
Effective date: 20070323 |
|
| 17Q | First examination report despatched |
Effective date: 20070614 |
|
| AKX | Designation fees paid |
Designated state(s): DE FR GB |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE APPLICATION HAS BEEN REFUSED |
|
| 18R | Application refused |
Effective date: 20090707 |