WO2000074391A1 - Camera dtc interchangeable a fonction de correction des defectuosites integree - Google Patents

Camera dtc interchangeable a fonction de correction des defectuosites integree Download PDF

Info

Publication number
WO2000074391A1
WO2000074391A1 PCT/US2000/014256 US0014256W WO0074391A1 WO 2000074391 A1 WO2000074391 A1 WO 2000074391A1 US 0014256 W US0014256 W US 0014256W WO 0074391 A1 WO0074391 A1 WO 0074391A1
Authority
WO
WIPO (PCT)
Prior art keywords
camera
pixels
blemish
addresses
video
Prior art date
Application number
PCT/US2000/014256
Other languages
English (en)
Other versions
WO2000074391A8 (fr
Inventor
Bing Zu
John F. Monahan
John E. Kennedy
Original Assignee
Vista Medical Technologies, Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Vista Medical Technologies, Inc. filed Critical Vista Medical Technologies, Inc.
Publication of WO2000074391A1 publication Critical patent/WO2000074391A1/fr
Publication of WO2000074391A8 publication Critical patent/WO2000074391A8/fr

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/50—Constructional details
    • H04N23/555—Constructional details for picking-up images in sites, inaccessible due to their dimensions or hazardous conditions, e.g. endoscopes or borescopes
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/66—Remote control of cameras or camera parts, e.g. by remote control devices
    • H04N23/663—Remote control of cameras or camera parts, e.g. by remote control devices for controlling interchangeable camera parts based on electronic image sensor signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/60—Noise processing, e.g. detecting, correcting, reducing or removing noise
    • H04N25/68—Noise processing, e.g. detecting, correcting, reducing or removing noise applied to defects
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/14—Picture signal circuitry for video frequency region
    • H04N5/21—Circuitry for suppressing or minimising disturbance, e.g. moiré or halo

Definitions

  • This invention relates to compensating for CCD blemishes in video cameras and more particularly to cameras that are designed to be used interchangeably with camera control units, notably but not exclusively video cameras that are incorporated in endoscopes for use with medical imaging systems.
  • Video cameras with detectors based on a Charge Coupled Device are available in many formats and are used advantageously in many disciplines, including broadcast and home video, medical imaging, industrial process control, and quality assurance.
  • CCD cameras have several desirable qualities that make them more suitable than other image sensors in many applications; these advantages include relatively low noise, high dynamic range, high linearity, and good light sensitivity.
  • Manufacturers constantly compete to produce devices with improved specifications, continually stretching the limits of processes, materials, and techniques to produce better devices. Cost competition is also a factor, and drives manufacturers to reduce manufacturing cycle times and material costs in efforts to maximize margins. These reductions, in turn, can affect image quality and product performance. For example, to reduce semiconductor processing time usually means less time is spent cleaning the semiconductor wafer during chip fabrication.
  • variations in the properties of the semiconductor wafer and minor uncontrolled variations in the processing and printing of the various semiconductor layers onto the chip affects operating characteristics. For example, local variations in the size and electrical characteristics of individual CCD pixels affects current leakage and illumination response. This can result in pixel to pixel variations in both the baseline signal level with no illumination (dark current) and the output level with illumination applied (responsivity). Additionally, CCD defects often result in completely nonfunctional cells that show up as constant black or white pixels in the video image.
  • Blemish compensation for video cameras is well known, as evidenced by the following U. S. Patents: 4,193,093, issued to Richard C. St. Clair; 4,454,541 , issued to Robert A. Duschl; 4,701 ,784, issued to Hiroki Matsuoka et al.; and 5,144,446, issued to Fumihiko Sudo.
  • the blemish-compensating function is a built-in capability of the associated camera control unit (CCU).
  • the blemish compensator portion of the CCU determines the location of pixels that fail to meet a specific performance criteria and the addresses of those "bad pixels" or blemishes are stored in digital memory in the CCU.
  • This selection and storage may be a manual process in which the user selects individual pixels with a cursor and then presses a command button on the CCU to cause the latter to store the address of the selected pixel in the digital memory of the CCU. Subsequently when the camera is used to acquire video, a pixel address register in the CCU keeps track of each current pixel and the blemish compensator portion of the CCU causes another "better" pixel to be substituted for the "bad pixel" in the video image output of the CCU.
  • the substituted pixels may be selected from the video stream, for example, by selecting the adjacent earlier pixel, or may be created by some other more complex process, such as by vertical and horizontal interpolation. More complex compensation schemes are also common. In the CCD blemish identification and compensation process the identification of "bad pixels" is determined by preventing light from passing into the camera to the CCD array, and measuring the signals for each pixel of the CCD.
  • CCUs have also been adapted to provide an automated blemish compensation capability in which the system automatically recognizes pixels that need to be replaced and stores the addresses of those pixels in the CCU digital memory. Subsequently when the camera is used to acquire a video stream, the automatic blemish compensation process substitutes acceptable pixels for the those whose addresses are stored in the digital memory.
  • FIG. 1 illustrates a prior art video system comprising a camera 2 and a CCU 4.
  • the camera comprises an optical system 6 and a CCD array 10.
  • the latter produces a video signal output when it is illuminated with light via optical system 6.
  • This video signal output is fed by an internal transmission bus 12 to an output connector 14 which forms part of the camera.
  • the CCU 4 comprises a controller 20 with local non-volatile digital memory 46, a blemish compensator 22 with associated volatile digital memory 48, a video signal processor 24, a pixel clock/pixel address register 50, and a push-button interface and mode selector 28 for directing operation of controller 20.
  • the compensator 22 may be a discrete stage of the CCU, as shown. Alternatively, it may be incorporated as part of the circuitry of video processor 24.
  • the blemish compensator draws pixel detail information from the volatile memory 48 to perform the appropriate compensation, for example, pixel substitution.
  • the CCU 4 also comprises an input connector 30 whereby the CCU may be coupled to camera output connector 14 via a suitable cable 32.
  • Connector 30 is connected to the CCU data bus 36 which provides data access for controller 20.
  • Connector 30 is further connected to a video bus 54 which applies the video signal to blemish compensator 22.
  • the pixel clock/pixel address register 50 clocks the blemish compensator 22 in time with the video signal received via bus 54.
  • the video signal stream is applied as shown at 38 to video processor 24 via blemish compensator 22.
  • the video processor 24 produces a video output signal which appears on an output bus 40 which may be connected to a suitable display device, e.g., a TV monitor, and/or a video recorder and/or a video transmitter.
  • the controller 20, blemish compensator 22, and memories 46 and 48 operate differently depending on the mode of operation. All four elements are typically comprised of distributed portions of several integrated circuits mounted on a motherboard of the CCU. There are two modes of operation -- an address storage mode and an operational mode. The address storage mode and the operational mode are either commanded by the user via the push-button interface 28, or are executed by a fully automatic system commanded by controller 20. When commanded by the user via push-button interface 28, the selection and storage of the addresses of "bad pixels" is accomplished using a cursor as described above.
  • the controller 20, blemish compensator 22 and memory 48 cooperate to store the address of pixels to be replaced in the local memory 46 of the controller.
  • this mode passage of light to the CCD 10 is intentionally blocked by a suitable light blocking means 8, thereby making it possible to identify the pixels to be replaced. Typically these are identified, with the incoming light blocked, as pixels that have signals higher than the surrounding pixels.
  • the controller 20 supervises address recording and transfer to and from memories 46 and 48, while pixel clock/pixel address register 50 provides timing signals to the CCD and supplies the address of the current pixel to blemish compensator 22.
  • the pixel clock of pixel clock/register 50 provides a vertical field reset pulse to the pixel address register of clock/register 50 once for each video field, while the pixel address register counts each pixel in the two interlaced frames that typically comprise a video frame.
  • each pixel in a frame is uniquely identified with an address.
  • Each pixel is evaluated by compensator 22 to determine if it is higher in signal level than any element on a list of previously stored pixels, and if it is higher, its address and value are recorded in a properly ordered place on the list.
  • the list is temporarily stored in the volatile memory 48 of the blemish compensator. When the pixel evaluation process is completed for the entire video frame, a list of addresses to be replaced is transferred to the non-volatile memory 46 of the controller.
  • the controller 20, compensator 22 and memory 48 cooperate to substitute replacement pixels for those whose address is stored in memory. More specifically, when the camera is acquiring video information for relaying to a video display, transmitter or recorder, the controller 20 uploads to volatile memory 48 the address information stored in non-volatile memory 46 for use by the compensator to substitute replacement pixels for those whose address is stored on the list.
  • the compensator tracks the value of the pixel address register (which supplies the address of the current pixel) and replaces any pixels with an address matching an address in memory 48 with another pixel of acceptable value. Typically the system is programmed to substitute an adjacent pixel for a "bad pixel" identified in the list.
  • the object of this invention is to facilitate use of video cameras having known pixel blemishes with different camera control units.
  • the present invention comprises incorporating into a CCD-type video camera an electronically programmable non-volatile memory which stores the location of "bad" pixels and is controlled by a device which is located remotely from the camera in a separate CCU. This arrangement assures that video cameras are interchangeable with CCU's regardless of CCD blemish content.
  • Fig. 1 diagrammatically illustrates a prior art video system employing blemish compensation
  • FIG. 2 diagrammatically illustrates a video camera incorporating the present invention. Description Of Invention
  • Fig. 2 illustrates the invention. Except as described hereinafter, the system shown in Fig. 2 incorporates the same elements and the same functions as the system of Fig. 1 , and identical elements are identified by the same numerals.
  • the camera 2 is modified by incorporating therein an electronically programmable non-volatile digital memory 42 which is coupled to camera connector 14 via a suitable bus 44.
  • bus 44 may be combined with other interconnections on the motherboard and need not comprise a separate bus.
  • the CCU 4 of Fig. 2 is like the CCU 4 of Fig. 1 in that it comprises a local digital memory 46 which is accessed via controller 20, and a second volatile blemish compensator digital memory 48.
  • Fig. 1 the system shown in Fig. 2 incorporates the same elements and the same functions as the system of Fig. 1 , and identical elements are identified by the same numerals.
  • the camera 2 is modified by incorporating therein an electronically programmable non-volatile digital memory 42 which is coupled to camera connector 14 via a suitable bus
  • FIG. 2 illustrates a clock/pixel address register 50 which provides timing signals for the CCD readout and also clocks the blemish compensator 22.
  • a CCU bus 52 applies the camera's video signal output containing the pixel blemish data to controller 20, and also serves to transmit pixel address data from controller 20 to camera memory 42.
  • a second bus 54 applies the video signal to blemish compensator 22 for relay to video processor 24.
  • the CCU 4 of Fig. 2 may include push button interface 28.
  • the controller 20 is programmed to automatically perform the operations described hereinafter.
  • controller 20 and blemish compensator 22 operate differently depending on whether the system is conducting the address storage mode or the operational mode.
  • the controller 20 controls operation of the memories 46 and 48 as well as the blemish compensator 22.
  • controller 20 controls data transfer to and from memories 46 and 48 and also, in address storage mode, it directs the address recording.
  • the controller causes the addresses of "bad pixels" to be relayed from blemish compensator 22 to memories 48 and 46. After all the pixels are compensated, the locations are transferred to memory 42 via buses 52 and 44.
  • the data in memory 42 is transferred to memories 46 and 48 whenever the unit is energized.
  • the blemish compensation operation is then performed by the blemish compensator 22 using pixel address data downloaded from camera memory 42.
  • the pixel address data is downloaded from camera memory 42 to blemish compensator memory 48 by the controller 20 via the buses 44 and 52.
  • the address storage mode is utilized during manufacture of the camera head using the CCU 4 shown in Fig. 2 or some other CCU capable of blemish correction.
  • a suitable light-blocking means 8 thereby making it possible to identify the pixels to be replaced. Typically these are identified, with the incoming light blocked, as pixels that have signals higher than the surrounding pixels.
  • Controller 20 supervises recording and transfer of data to and from memories 46 and 48, while pixel clock/pixel address register 50 provides timing signals for the CCD readout.
  • a vertical field pulse is used to reset the pixel address register 50 which preferably is an internal counter.
  • each pixel is read out in time to a "pixel clock" signal generated by clock/register 50.
  • the pixel is evaluated by blemish compensator 22 to determine if it is higher in signal level than any element on a list of previously stored pixels. If it is higher, it takes a properly ordered place on the list; if not, it is ignored.
  • the list is temporarily stored in the blemish compensator's volatile memory 48.
  • the pixel address list in memory 48 is uploaded to memory 46 and then to the electronically programmable non-volatile memory 42 in the camera 2 via bus 44.
  • the camera in the operational mode is coupled to a CCU that has a blemish correction capability.
  • That CCU may be the same one used to determine the camera's blemish control during its manufacture or some other CCU having components like those of the CCU 4 shown in Fig. 2 for compensating for "bad" pixels.
  • the controller 22 downloads the pixel address data from the camera's memory 42 to the protected local memory 46 of the controller 20. Subsequently that data is loaded into the volatile memory 48 of the blemish compensator 22. Typically this data transfer from camera memory 42 to the local memory 46 of the controller occurs after a forced rest imposed by controller 20, which clears, resets, and reloads all non-protected CCU memory. Alternatively the forced rest imposed by controller 20 may be delayed until data transfer from the camera memory 42 to the protected local memory 46 of controller 20 has occurred.
  • the double memory buffering via memories 46 and 48 permits complete reset and purge of the active video processing circuitry, including blemish compensator 22, video processor 24, memory 48, and register 50; it also permits use of faster volatile memory in the blemish compensation circuit.
  • the blemish compensator 22 tracks the value of the pixel register 50 which supplies the address of each pixel as it is read from the CCD.
  • a pixel address from the pixel register matches an address in volatile memory 48, that pixel is replaced.
  • the system is programmed so that the replacement pixel is selected from an adjacent pixel.
  • other modes of selecting pixels such as averaging may also be used.
  • the pixel data is sent on to the video processor 24 which generates the video output from the system at output bus 40.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Transforming Light Signals Into Electric Signals (AREA)
  • Color Television Image Signal Generators (AREA)

Abstract

L'invention concerne une caméra vidéo (2) du type à dispositif à transfert de charge (DTC) équipée d'une mémoire (48) non volatile électroniquement programmable servant à mémoriser l'emplacement des pixels imparfaits ('défectuosité'), auxquels un correcteur de défectuosités, éloigné de la caméra (2) et intégré dans une unité (4) de commande de la caméra séparée, peut accéder. Cette configuration permet d'interchanger différentes caméras vidéo du type DTC, indépendamment de leurs défectuosités DTC, avec des unités de commande de caméras comportant des circuits (22) de correction des défectuosités.
PCT/US2000/014256 1999-06-02 2000-05-24 Camera dtc interchangeable a fonction de correction des defectuosites integree WO2000074391A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US13774199P 1999-06-02 1999-06-02
US60/137,741 1999-06-02

Publications (2)

Publication Number Publication Date
WO2000074391A1 true WO2000074391A1 (fr) 2000-12-07
WO2000074391A8 WO2000074391A8 (fr) 2001-10-18

Family

ID=22478864

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2000/014256 WO2000074391A1 (fr) 1999-06-02 2000-05-24 Camera dtc interchangeable a fonction de correction des defectuosites integree

Country Status (1)

Country Link
WO (1) WO2000074391A1 (fr)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1378149A1 (fr) * 2001-03-19 2004-01-07 AFP Imaging Corporation Memorisation de caracterisation de capteur
EP1610669A1 (fr) * 2003-03-23 2006-01-04 Given Imaging Ltd. Dispositif et procede de commande de lumiere dans un dispositif d imagerie in vivo
US20120314910A1 (en) * 2011-06-09 2012-12-13 Carl Zeiss Smt Gmbh Method and device for determining the position of a first structure relative to a second structure or a part thereof
US9071762B2 (en) 2004-05-17 2015-06-30 Micron Technology, Inc. Image sensor including real-time automatic exposure control and swallowable pill including the same

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9149175B2 (en) 2001-07-26 2015-10-06 Given Imaging Ltd. Apparatus and method for light control in an in-vivo imaging device

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4739495A (en) * 1985-09-25 1988-04-19 Rca Corporation Solid-state imager defect corrector
US5047861A (en) * 1990-07-31 1991-09-10 Eastman Kodak Company Method and apparatus for pixel non-uniformity correction
US5805216A (en) * 1994-06-06 1998-09-08 Matsushita Electric Industrial Co., Ltd. Defective pixel correction circuit

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4739495A (en) * 1985-09-25 1988-04-19 Rca Corporation Solid-state imager defect corrector
US5047861A (en) * 1990-07-31 1991-09-10 Eastman Kodak Company Method and apparatus for pixel non-uniformity correction
US5805216A (en) * 1994-06-06 1998-09-08 Matsushita Electric Industrial Co., Ltd. Defective pixel correction circuit

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1378149A1 (fr) * 2001-03-19 2004-01-07 AFP Imaging Corporation Memorisation de caracterisation de capteur
EP1378149A4 (fr) * 2001-03-19 2009-04-01 Afp Imaging Corp Memorisation de caracterisation de capteur
EP1610669A1 (fr) * 2003-03-23 2006-01-04 Given Imaging Ltd. Dispositif et procede de commande de lumiere dans un dispositif d imagerie in vivo
EP1610669A4 (fr) * 2003-03-23 2009-04-22 Given Imaging Ltd Dispositif et procede de commande de lumiere dans un dispositif d imagerie in vivo
US9071762B2 (en) 2004-05-17 2015-06-30 Micron Technology, Inc. Image sensor including real-time automatic exposure control and swallowable pill including the same
US20120314910A1 (en) * 2011-06-09 2012-12-13 Carl Zeiss Smt Gmbh Method and device for determining the position of a first structure relative to a second structure or a part thereof
US9014505B2 (en) * 2011-06-09 2015-04-21 Carl Zeiss Smt Gmbh Method and device for determining the position of a first structure relative to a second structure or a part thereof

Also Published As

Publication number Publication date
WO2000074391A8 (fr) 2001-10-18

Similar Documents

Publication Publication Date Title
EP1250000B1 (fr) Méthode de correction pour pixels défectueux et système
US7202894B2 (en) Method and apparatus for real time identification and correction of pixel defects for image sensor arrays
US4739495A (en) Solid-state imager defect corrector
US6396539B1 (en) CMOS imaging device with integrated defective pixel correction circuitry
CN100574377C (zh) 图像处理装置,图像处理方法
US7729608B2 (en) Image processing method and image processing apparatus
US7657116B2 (en) Correction method of defective pixel in image pickup device and image processing apparatus using the correction method
US7286171B2 (en) Apparatus and method for concealing defective pixels in image sensors having test mode
CN102469258B (zh) 图像处理器及其控制方法
US8026964B2 (en) Method and apparatus for correcting defective imager pixels
WO2000074391A1 (fr) Camera dtc interchangeable a fonction de correction des defectuosites integree
US20050030412A1 (en) Image correction processing method and image capture system using the same
US20040262495A1 (en) Method for setting individual information of solid-state image sensor, solid-state image sensor, and imaging device
JP4508740B2 (ja) 画像処理装置
JP4305225B2 (ja) 赤外線画像補正装置
EP0222548A2 (fr) Transformateur d'images
JPH0759011A (ja) 固体撮像素子の欠陥画素の自動検出装置及び自動補正装置
JP2004064512A (ja) 欠陥画素の検出方法および装置、並びに撮像装置
US20040080635A1 (en) Charge coupled device (CCD) camera having a correction function for defective CCDS and a correction method
JP2003259221A (ja) 欠陥画素検出補正回路
KR100736528B1 (ko) 불량화소 검출을 위한 이미지 센서
JP3374418B2 (ja) Ｃｃｄカメラの欠陥補正装置
JP3539378B2 (ja) メモリの制御方法及びカメラの制御方法
JP2002152601A (ja) 固体撮像装置および欠陥画素補正方法
JP2002281389A (ja) 撮像装置

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): CA JP

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE

121 Ep: the epo has been informed by wipo that ep was designated in this application
AK Designated states

Kind code of ref document: C1

Designated state(s): CA JP

AL Designated countries for regional patents

Kind code of ref document: C1

Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE

CFP Corrected version of a pamphlet front page

Free format text: REVISED ABSTRACT RECEIVED BY THE INTERNATIONAL BUREAU AFTER COMPLETION OF THE TECHNICAL PREPARATIONS FOR INTERNATIONAL PUBLICATION

122 Ep: pct application non-entry in european phase
NENP Non-entry into the national phase

Ref country code: JP