CA2136645A1 - Imaging system with dead element concealment - Google Patents

Imaging system with dead element concealment

Info

Publication number
CA2136645A1
CA2136645A1 CA002136645A CA2136645A CA2136645A1 CA 2136645 A1 CA2136645 A1 CA 2136645A1 CA 002136645 A CA002136645 A CA 002136645A CA 2136645 A CA2136645 A CA 2136645A CA 2136645 A1 CA2136645 A1 CA 2136645A1
Authority
CA
Canada
Prior art keywords
image
array
imaging system
dead
output
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
CA002136645A
Other languages
French (fr)
Inventor
Paul Anthony Manning
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
UK Secretary of State for Defence
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Publication of CA2136645A1 publication Critical patent/CA2136645A1/en
Abandoned legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/48Increasing resolution by shifting the sensor relative to the scene
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/60Noise processing, e.g. detecting, correcting, reducing or removing noise
    • H04N25/68Noise processing, e.g. detecting, correcting, reducing or removing noise applied to defects
    • H04N25/69SSIS comprising testing or correcting structures for circuits other than pixel cells

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Transforming Light Signals Into Electric Signals (AREA)

Abstract

A solid state imaging system with improved dead element concealment comprises image displacement means which cyclically displaces the image (20) relative to the array by a distance of at least one inter element pitch (P1, P2), in at least one coordinate direction of the array, so that each resolvable area of the image is focussed cyclically onto at least two different elements (2). By means of signal processing the output of each dead element (24) is replaced by output associated with the same area of the image but recorded by a different element in a previous image position.

Description

W O 93/25043 213 ~ 6 ~ 5 PCT/ÇB93/00896 Imaging system with dead element concealment This invention relates to imaging systems and particularly to solid state systems comprising an array of photoelectric elements, or staring array, for imaging electromagnetic radiation, generally in the visible or in~ra-red wavebands.

` One such system comprises a two-dimensional array of charge coupled devices~(CCD's). An image incident on the array causes each CCD to produce an electric potential dependent on the intensity of the image. The output from éach CCD lS recorded in turn and stored in a frame store for subsequent signal processing and storage or display.

The resolution of the system depends on the size and ~spacing of the photoelectric elements in the array and on the quality of each element. By;applying conventional data sampling theory to the array t is appreciated that tne highest spatial frequency which can be reproduced is equal to half the sampling frequency, which in this case is determined by the inter element pitch. If the image possesses spatial frequencies greater than half the pitch the displayed frequency will be a lower aliased freq~ency so that high frequency - detail is obscured. There is a constant desire for improved spatial resolution, but the~size and spacing of the elements in an array are limited by current manufacturing constraints.

In order to improve the resolution of such a system GB 2152781 proposes shift~ing the~image relative to the array by a fraction, such-as a;half or a quarter, of the inter element pitch in either one or both of the coordinate directions of the array.; This has the ef,ect of~reducing the pitch and hence the spatial freguency of the image which can be reproduced without aliasing.

The plxelated displayed image can be difficult to interpret and it is most usual for a system to include some signal processing operations which modify the image before display. These operations may include horizontal and vertical filtering and contrast averaging ~:: .
2 5 APR~L l9~ , `` 2136645 ` ~ - 2 -I

for example to effectively blurr the edges of each display pixel.
These types of operation may actually obscure high frequency detail but are considered necessary in order to enhance the acceptability of the displayed image to the viewer.
:
One such cignal processing operation is the effective concealment of non-working or dead elements by averaging the outputs o~ neighbouring elements associated with neighbouring areas of image.
This is generally necessary because present manufacturing constraints mean that 100% element operability is not achievable. In practice the most expensive arrays operating in the visible waveband-may have less than 0.1% dead elements but arrays operating in the infra-red wavebands typically have between 0.1% and 5% dead elements. Averaging ~
outputs from neighbouring elements clearly means that spatial , resolution is reduced in the vicinity of a dead element and the effect is even worse in the event two neighbouring elements are dead. For certain applications the loss of resolution of fine detail resulting from a percentage of dead elements as low as 0.1% is not acceptable and much work has concantrated on increasing the reliability of manufactured photoelectric elements and improving dead element concealment~signal processing techniques.

It is an object of the present~invention to provide an imaging system having improved dead element concealment combined with improved resolution According to the present invention there is provided an imaging syste~ comprising a two-dimensional array of photoelectric elements, focussing means Por focussing an optical image on the array, signal pr,oce~sing means for processing the output taken ~rom each element and image displacement means wherein the image displacement means is adapted to cyclically displace the imagP relative to the array in at least one coordinate~direction of the array by a distance equal to one and a half times the inter element pitch in that direction so that each resolvable area of the image is focussed cyclically onto at least two different elements and wherein the signal processing means is :

, ~ I PCT 1. m P^-t~t Office SU~5l~T~ St~ET

~t;T~QB 9 3 / ~ ~ 8 ~ 6 21366~5 ~ APRIL l994 adapted to replace the output of each dead element by output associated with the same area of the image but recorded in a previous image position by a different element.

The primary advantage of this method of dead element concealment is that an area of the image initially incident on a dead element will subsequently be incident~ on a different element, so that provided the second element is not also dead at least one actual output ~lill be recorded in respect of each re~olvable area of the image instead of relying on an average of the neighbouring outputs. Furthermore, every display pixel represents actual output associ~ted with the corresponding area~of lmage, even if the information came from a previous field, rather than averaged output associated with neighbouring areas of image. The effect on the display is that any area of image focussed onto a dead element during any part of the displacement-cycle merely has an effectively reduced sampling rate as opposed to an estimated output, Displacement by one and a half times the inter element pitch allows the advantages of dead element concealment to be combined with the known advantages of displacement by a ~raction of the inter eLement pitch, namely reducing the spatial frequency of the image which can be reproduced without aliasing.

A~further practical advantage is that an array containing significant~numbers of dead elements may now be useful in an imaging system, even where high resolution is required. The ability to use arrays with large numbers of dead elements dramatically increases the effective manufacturing yield and consequently significantly reduces the cost of a useful array.

The ~ignal processing means may also perform certain conventiona~ signal proc~ssing operations and it is also preferably adapted to displace the output ~rom each element in opposed synchronisation with the image displacement so that each display pixel created corresponds to the area of the image from which the output was I

~: UnltJd ~ Of~ I
PCT Ir,~ SV~3SlrlTU~ S~ET

u ~ :
213 6 6 4 ~ ~ 5 APRIL 199 taken. The practical effect of this is to remove the image displacement from the displayed picture and thereby to reduce picture flicker.
~: : ~
The dlsplacement means is preferabIy adapted to displace the image at~least once in each coordinate direction of the array per cycle of displacement. This means that each resolvable area, away from the edge of the image, will be incident on at least four different elements per cycle. In practice this means that the chance of gettlng~less~than two actual output readings for any resolvable area~per cycle of four displacements is virtually zero.

: me displacement~means conven1ently comprises an optical element, such as a reflective element provided in object space or a refractive element provided in image space, linked to a mechanical drive~ The~scan~amplitude~of the~image relative to the array must be at~least twice the size of that required~by the prior art and conmequently ~the~re~1s~a r1sk that 1ncreased aberrations may be introduced.~ ~The advantage o~ using a reflec~ive element in object space~is~that no image aberrations are produced and therefore the increased~scan~amplitude has no effect~on the quality of the image.
rica1~aberration introduced~as a.result of a refractive element in image~spac~e~may be corrected~ for in~the~lens design and, in any case, is~;negligiblLe~if~the~thickness of the refractive element is kept to a If~the~displ~acement is~caused~by periodically tilting the optical elémen~t~through~a~given angle the slew rates of the mechanical displacements must be greater then in prior art systems and power ~ ;
aonsumpt1on~w~ also bm greater. However, neither~of~these factors amounts to a problem in practice.
lternatively, the displacement may be caused by rotating a refractive~disc having areas of different thickness or of different refractive index, as illustrated in Figure 2 of GB2152781. In this csse~rotation i~ st the same raCe as in the prior art system and so power consumption is not increased but the difference in thickness or ,S ~ 3~ 5'~E~ ~

,. ~, 21366~S .
~ 93/25043 ~ PCT/~B93/00896 . '" ' . .

refractive index between the different parts of the disc must be greater to cause the required displacement and this may introduce image aberration.

The displacPment of the image is synchronised ~ith the fields of output taken from the array so that one field is read during each image position.

The dead element output replacement may be effected by incorporating a map of the dead elemen~s in the array into the signal processing circuitry. Alternatively, the signal processing means may be adapted to recognise the presence of a dead element in real time.
.
The invention will now be described by way of example only with reference to the accompanying drawings. iII which:-; Figure l schematically illus~rates a first embodiment of an imaging system according to the ~resent invention;

Figure 2 illustrates part of ~he system of Figure 1 in moredetail;

Figure 3 illustrates a second embodiment of the part of the : :
system shown in Figure 2;

Figure 4a and b illustrates a cycle of image displacement relative ko an array according to the present invention; and Figure 5a and b~illustrates 2 cycle of image displacement relative to an array according to the prior art.

Referring~to Figure 1 an image of an object ~not shown) is brought into focus in the plane of a two-dimensional array 1 of photoelectric elements 2 by a lens 3. A refractive plate 4 is mounted in image space between the lens 3 and array 1 such that it can be tilted into four positions by means of mechanical drive 5. A signal :

W O 93/25043 ~ ~ 3 ~ ~ 4 ~ PCT/GB93/00895~
"

output from the array 1 is operated on by standard signal processing circuitry 6 in order to improve the acceptability of the pixelated display to the human eye. A previously calculated map 7 of the dead elements known to exist in the array 1 is fed into the dead element output replacement circui~ry 8 which replaces the output of each dead element by output associated with the same area of the image but recorded in a previous image position by a different element. Further circuitry 9 then displaces the output in opposed synchronisation with the image displacement so that image displacement has no effect on the displayed picture 10.

The arrangement of the refractive plate 4 is shown in more detail in Figure 2. It is mounted generally parallel to the array 1 but can be tilted through an angle of ~ in order to cause an image displacement D relative to the arra~- 1. The array 1 co~prises rows of elements 2 in which the inter element pitch is pl and columns of elements 2 in which the inter element pitch is p2. ~ can therefore be calculated for each coordinate direction so that displacement D is equal to one and a half times the inter element pitch, pl or p2 as appropriate, using the equation:

D = t ~ (n-1) ~ n where: t is the thickness of the refractive plate : n is the refractive index of the plate material.
~ .
In an alternative embodiment the refracting plate 4 is replaced by a mirror 11 i, n object space, as shown in Figure 3. The mirror is also mounted such that it can be tilted through an angle 0 in order to cause image displacement D, relative to the array, e~ual to one and a half times the inter element pitch. In this case the equation required to calculate the necessary angle of tilt is:

D = 2 f 0 ~VO 93/2~043 213 6 6 ~ ~ PCT/GB93/00896 ~,~.,., , , I
. . . .

where: f is the focal length of the lens.

Figure 4a represents an optical image 20 incident on an array of photoelectric elements 2. The image 20 is displaced relative to the array by one and a half times the inter element pitch pl or p2 in each coordinate direction of th~ array per displacement cycle, the Figure showing the ~our image positions relative to the array which make up a complete frame of information for display. The array includes one dead element 24. Figure 4b shows the resolution elements in the image (corresponding to display pixels in the displayed image), with the number of times each resolvable part of the image is sampled per cycle. It can~be seen that every pixel away from the edge of the array is sampled at least three out of the possible four times per cycle. Even if a cluster of three dead elements occurs in the array each part of the image is sampled at least once per cycle.

In comparison Figure 5a represents an image 20 inoident on an array of photoelectric elements 2 wherein the image 20 is displaced by half the i~ter element pitch pl or p2 in each coordinate direction of the array, in accordance with the prior art. Again the array includes one dead e}ement 24. Figure 5b shows that one resolvable part of~the image is never sampled due to the presence of the dead element 24. and that consequently one display pixel receives no real information. Such a blank in the display is normally concealed by signal processing techniques. The advantage of the present invention is that every display pixel receives actual information relating to the corresponding part of the image rather than signal processed information relating to neighbouring parts of the i~a~e.

:

; ~i , r ~' :

Claims (8)

1. An imaging system comprising a two-dimensional array (1) of photoelectric elements (2), focussing means (3) for focussing an optical image (20) on the array (1), signal processing means (6,7,8,9 for processing the output taken from each element and image displacement means (4,5,11) wherein the image displacement means is adapted to cyclically displace the image (20) relative to the array (1) in at least one coordinate direction of the array by a distance equal to one and a half times the inter element pitch (p1,p2) in that direction so that each resolvable area of the image is focussed cyclically onto at least two different elements and wherein the signal processing means is adapted to replace the output of each dead element (24) by output associated with the same area of the image but recorded in a previous image position by a different element.
2. An imaging system as claimed in claim 1 wherein the signal processing means (9) is adapted to displace the output from each element in opposed synchronisation with the image displacement so that each display pixel created corresponds to the area of the image from which the output was taken.
3. An imaging system as claimed in claim 1 or claim 2 wherein the displacement means (4,5,11) is adapted to displace the image at least once in each coordinate direction of the array per cycle of displacement.
4. An imaging system as claimed in any preceding claim wherein the displacement means comprises an optical element (4,11) linked to a mechanical drive (5).
5. An imaging system as claimed in claim 4 wherein the optical element is a reflective element (11) provided in object space.
6. An imaging system as claimed in claim 4 wherein the optical element is a refractive element (4) provided in image space.
7. An imaging system as claimed in any preceding claim wherein the signal processing means (7) incorporates a map of the dead elements in the array.
8. An imaging system as claimed in any of claims 1 to 6 wherein the signal processing means is adapted to recognise the presence of a dead element in real time.
CA002136645A 1992-05-29 1993-04-29 Imaging system with dead element concealment Abandoned CA2136645A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
GB929211566A GB9211566D0 (en) 1992-05-29 1992-05-29 Imaging system
GB9211566.6 1992-05-29

Publications (1)

Publication Number Publication Date
CA2136645A1 true CA2136645A1 (en) 1993-12-09

Family

ID=10716331

Family Applications (1)

Application Number Title Priority Date Filing Date
CA002136645A Abandoned CA2136645A1 (en) 1992-05-29 1993-04-29 Imaging system with dead element concealment

Country Status (6)

Country Link
EP (1) EP0642723A1 (en)
JP (1) JPH08500944A (en)
CA (1) CA2136645A1 (en)
GB (1) GB9211566D0 (en)
IL (1) IL105794A (en)
WO (1) WO1993025043A1 (en)

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3647572B2 (en) * 1996-10-08 2005-05-11 シャープ株式会社 Imaging device
FR2756129B1 (en) * 1996-11-15 1999-07-09 Sagem RESOLUTION INCREASING DEVICE VIDEO CAMERA
FR2792149A1 (en) * 1999-04-12 2000-10-13 Commissariat Energie Atomique Medical imaging pixel camera faulty pixel zone removal has two horizontal and vertical camera step movements enabling detection faulty pixel image
EP1374564A2 (en) * 2001-03-30 2004-01-02 Sinar AG Digital photography method and digital camera
DE102004061978A1 (en) * 2004-12-23 2006-07-13 Lfk-Lenkflugkörpersysteme Gmbh Method and apparatus for replacing defective pixels in Focal Plane Array cameras
JP4603454B2 (en) * 2005-10-05 2010-12-22 本田技研工業株式会社 Image sensor fixed pattern noise removal device
WO2011086227A1 (en) * 2010-01-18 2011-07-21 Nokia Corporation Digital camera image error detection

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS59186481A (en) * 1983-04-08 1984-10-23 Citizen Watch Co Ltd Image pickup device
DE3477119D1 (en) * 1983-06-15 1989-04-13 Toshiba Kk Solid state image sensor with high resolution
US4748507A (en) * 1986-10-17 1988-05-31 Kenneth Gural Solid state imaging device having means to shift the image between scans and associated circuitry to improve the scanned image
GB2241401B (en) * 1990-02-21 1993-12-22 Plessey Co Ltd Defective sensor detection in sensor arrays
EP0483530B1 (en) * 1990-10-30 1996-06-12 ELTRO GmbH Gesellschaft für Strahlungstechnik Method and device for offset and response harmonization in an electrooptical linear or mosaic sensor

Also Published As

Publication number Publication date
IL105794A (en) 1996-09-12
EP0642723A1 (en) 1995-03-15
JPH08500944A (en) 1996-01-30
IL105794A0 (en) 1993-10-20
WO1993025043A1 (en) 1993-12-09
GB9211566D0 (en) 1992-07-15

Similar Documents

Publication Publication Date Title
US4920418A (en) Imaging system having a swing-driven image sensor
US5016109A (en) Apparatus and method for segmenting a field of view into contiguous, non-overlapping, vertical and horizontal sub-fields
US4419692A (en) High speed infrared imaging system
US4532548A (en) Resolution enhancement and zoom
EP0645659B1 (en) Three dimensional imaging apparatus, camera, and microscope.
US5099320A (en) Method of and installation for the production of orthostereoscopic images
US4019804A (en) Optical scanning systems with image curvature correcting means
JP2941752B2 (en) Method and system for implementing 3D image in multi-view direction
DE69106636T2 (en) Imaging system.
CA2136645A1 (en) Imaging system with dead element concealment
US6072627A (en) Stereoscopic image capture device
US4204122A (en) Method of and device for scanning pictures
JPH1096860A (en) Optical character reader using split beam
US5291018A (en) Robigon and sinugon; detector geometries
JP2801542B2 (en) Scanning light valve sensor system
US6963355B2 (en) Method and apparatus for eliminating unwanted mirror support images from photographic images
US5220429A (en) Vision system for detecting a picture and reproducing said picture as a picture within a picture
US5264930A (en) Fast light interconnected processor
US4962429A (en) Television camera having an increased resolution in a portion of the field of view
US4141625A (en) Optical system for multiple imaging a linear object
US4323776A (en) Infrared parallel scanning arrangement
US4593322A (en) Autofocus system for infrared imaging device
US5235656A (en) Variable spatial resolution focal plane
US4762989A (en) Image detection with image plane divider
CA1303217C (en) Apparatus including multielement detectors for recording heat images

Legal Events

Date Code Title Description
FZDE Discontinued
FZDE Discontinued

Effective date: 19990429