EP1374564A2 - Procede de photographie numerique et appareil photo numerique - Google Patents

Procede de photographie numerique et appareil photo numerique

Info

Publication number
EP1374564A2
EP1374564A2 EP01914941A EP01914941A EP1374564A2 EP 1374564 A2 EP1374564 A2 EP 1374564A2 EP 01914941 A EP01914941 A EP 01914941A EP 01914941 A EP01914941 A EP 01914941A EP 1374564 A2 EP1374564 A2 EP 1374564A2
Authority
EP
European Patent Office
Prior art keywords
image
matrix
signals
comparison
comparison result
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP01914941A
Other languages
German (de)
English (en)
Inventor
Alain Wacker
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sinar AG
Original Assignee
Sinar AG
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sinar AG filed Critical Sinar AG
Publication of EP1374564A2 publication Critical patent/EP1374564A2/fr
Withdrawn legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/80—Camera processing pipelines; Components thereof
    • H04N23/81—Camera processing pipelines; Components thereof for suppressing or minimising disturbance in the image signal generation
    • H04N23/811—Camera processing pipelines; Components thereof for suppressing or minimising disturbance in the image signal generation by dust removal, e.g. from surfaces of the image sensor or processing of the image signal output by the electronic image sensor
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/60—Noise processing, e.g. detecting, correcting, reducing or removing noise
    • H04N25/68—Noise processing, e.g. detecting, correcting, reducing or removing noise applied to defects
    • H04N25/683—Noise processing, e.g. detecting, correcting, reducing or removing noise applied to defects by defect estimation performed on the scene signal, e.g. real time or on the fly detection

Definitions

  • the present invention relates to a digital photography method according to the preamble of claim 1 and a digital camera according to that of claim 10.
  • digital photography offers many advantages, since no films are used and thus running costs are avoided.
  • digital photography also has a major disadvantage: defects in photochemical films occur only once, and a new negative is already used for the next picture.
  • opto-electronic sensors or converters in digital photography, however, the same sensors are used for each image registration. Defects from or on these image sensors always have an effect.
  • the present invention is based primarily on the problem of defects that are mechanically connected to the matrix of optoelectronic sensors, such as scratches in the sensor coating, dust particles on the matrix, defective pixels or sensors and / or Glass defects, scratches, dust etc. in or on the protective glass positioned and connected in front of the sensor and / or eg IR cut filter etc. can be detected in a simple and reliable manner and thus create the basis for a corresponding image correction.
  • the above-mentioned task is primarily made possible for the aforementioned error detection and additionally for opening further detection possibilities for image properties, in principle by signals dependent on the image signals of the two images being fed to a comparison operation and a comparison result image in the form of electrical comparison result signals is generated with the respective sensor position information and with electrical
  • Signals of the comparison result image the first and / or second registered image is modified.
  • the mentioned defects or defects which are mechanically bound to the matrix of optoelectric sensor elements, move together with the matrix when the matrix is shifted, while the image impressed on the imaging beam moves with respect to the matrix, inversely to the matrix shift, shifts. If the matrix is only shifted to the right, for example, the image of the imaging beam shifts to the left with respect to the matrix; because the image of the defect is stationary on the matrix remains, the image shifts in the imaging beam on the matrix, the latter shifts with respect to the image of the defect.
  • the electrical image signals of the two images which of course also contain the position information, are compared directly with one another, and there are sensor elements whose output signals indicate a correspondence at least to a predetermined extent
  • Comparison result in the comparison result picture identified as malfunctioning. Because, in the mechanical matrix shift mentioned, faulty sensor elements are also shifted, the above-mentioned direct comparison results in signal identity at faulty sensor positions, and ideally corresponding zero signals when differences are formed, for example, due to shift tolerances, comparison result signals that do not ideally disappear can also result, and thus a measure of A predetermined criterion, for example a threshold value, is specified, which must be undercut for the identification of a fault location.
  • a predetermined criterion for example a threshold value
  • the comparison is now made between the phantom image and the associated non-phantom image: If a phantom image is generated from the first image, the comparison is preferably carried out on the first image and its phantom image and analogously for the second image. If necessary, phantom images can certainly be generated from both images and the detection quality can be increased by double comparison.
  • the location detection is now carried out.
  • use is now made of the fact that the undisturbed image information for the storage location is present in the already existing images.
  • electrical signals on the first, second or phantom image are preferably replaced at the positions at which, in the comparison result image, comparison result signals are below a predetermined value for the generation of the recording image - that is to say the definitive image
  • Threshold This also solves the problem that in the case of uniform scenes in which even after mechanical wear, uniform sections of the scene overlap with the original image and could be interpreted as error areas.
  • a digital camera according to the invention is further characterized or according to the characterizing part of claim 10 that of claim 14, preferred embodiments according to claims 11 to 13.
  • the invention is subsequently explained, for example, with reference to figures. These explanations open up a wide variety of possible implementations of the present invention to the person skilled in the art. In the figures, for example:
  • FIG. 2 in a representation analogous to that of FIG. 1, a first form of realization of the camera according to the invention or of the method according to the invention;
  • FIGS. 1 and 2 in a representation analogous to that of FIGS. 1 and 2, the method according to the invention or a digital camera according to the invention in a preferred embodiment
  • FIG. 4 shows a Bayer pattern as an example of the pattern of color-selective sensors on a sensor matrix for digital color photography.
  • a matrix 1 of optoelectric sensors such as a CCD matrix
  • a matrix 1 of optoelectric sensors is precisely displaceably guided in the camera with respect to the imaging beam (not shown) and, as shown schematically in FIG. 1, is drive-connected to a displacement drive 3.
  • a preferably used precision guide with drive of such a matrix 1 in a digital camera reference is made to WO 01/00001 by the same applicant, which in this regard is to be an integrated description part of the present application.
  • image Bi is imaged on the matrix 1.
  • the electrical output signals of the matrix sensor elements, at the output Ai, are fed to a multiplexer unit via a time-controlled switchover unit 5.
  • the matrix 1 is shifted by a drive 3 by a predeterminable displacement vector S (x s , y s ).
  • the image B 2 appears on the matrix 1, as shown on the right in FIG. 1, shifted by the direction-inverted vector 5 ′′ 1 .
  • the image B ⁇ e which has been optoelectrically converted on the matrix 1, is stored in a storage unit 1 ⁇ , likewise, after the displacement 5 of the matrix 1 has taken place, the image B 2e in a storage unit 7.
  • the stored images are formed by signals which are dependent on the sensor output signals and information on the position of each sensor on the matrix 1. Together, both signal components, signals of the optoelectric conversion and position information, hereinafter referred to as output signals of the sensors and thus also of the matrix 1.
  • comparison unit 9 the comparison unit 9 and one and / or both of the storage units 7 ⁇ or 7 2 are interposed with a processing unit III or 11 2 shown in dashed lines in FIG. 1, so that the respective output A 1 or A 72 is operatively connected to the corresponding inputs E 92 or E 9 ⁇ , but not necessarily directly.
  • comparison unit 9 On the comparison unit 9, according to a predetermined algorithm, output signals from sensors or sensor groups, possibly processed, are compared with one another.
  • the comparison result ⁇ at the output of the comparison unit 9, which corresponds to a matrix of comparison result signals is preferably revised. This takes place on an image processing arithmetic unit 12.
  • the correspondingly processed, corrected electronic image Bi k results in a memory unit 14.
  • a fault Z for example in the form of a dust particle, is present on the sensor matrix 1 at the location x z , y 2 . If the matrix 1 is shifted by a shift vector S, as has been described with reference to FIG. 1, the portion of the image Bi caused by the imaging beam moves on the
  • Matrix 1 corresponding to the direction-inverted vector S '1 .
  • the position coordinates of the disturbance Z on the matrix 1 are retained even after the matrix 1 has been shifted, ie the disturbance Z is shifted together with the matrix 1, in contrast to the image from the imaging beam.
  • This provides the basis for transmitting the information to the arithmetic unit 12 according to FIG. 1, which is not shown repeatedly in FIG. 2, and where in the matrix 1 interference-affected sensors or pixels are located. from that For example, the computing unit 12 can replace the interference-related output signals by signal interpolation of output signals from adjacent sensors.
  • FIG. 3 shows a particularly preferred embodiment of the present invention, in which output signals from sensors or pixels influenced by errors or defects are replaced with signals corresponding to the undisturbed image of the imaging beam and what next enables moving parts of the image in the
  • images Bi e and B 2e are stored in the assigned storage units 7 ⁇ and 7 2 .
  • a phantom image Ph B ⁇ is determined, preferably from one of the two stored images B ⁇ e or B 2e , as shown in FIG. 3, preferably from image B 2e .
  • the output of the storage unit 7 2 is operatively connected to a computing unit 14 and, as schematized in FIG. 3, it is supplied with the displacement vector information S.
  • the arithmetic unit 14 now rearranges the sensor output signals stored in the memory unit 7 2 in accordance with the image B e
  • Shift vector S shifted so that an image is created as phantom image Ph B ⁇ and stored in a storage unit 7 Ph , which, since shifted by S, actually corresponds to image B ⁇ e , with the difference that that now the position coordinates of the sensors or pixels, which have been disturbed by the fault
  • Comparison unit 9 the comparison between the image B ⁇ e stored on the memory unit 7 ⁇ and the electronic image P m stored on the phantom image memory 7 Ph .
  • the comparison signal matrix formed thereon only has signal values which do not vanish or signal values which lie above a predetermined threshold value, where image B ⁇ e differs from phantom image Ph B ⁇ , ie following the representations of FIG. 3, at locations x z / y z as well as at S x ' z / y' zr . Because the shift vector
  • the signal A (x 2 / y z ) is replaced by the computing unit 12, which is no longer shown here, in the place of the image B x or B le with the position coordinate xz / yz.
  • the information relating to x z and y z is thus obtained from the Comparison signal matrix determined in the comparison unit 9.
  • an interference-free image B 1 K according to Bi is provided in the image storage unit 14 according to FIG. 1.
  • sensor matrixes for digital color photography provide patterns of sensors, e.g. Register one of the primary colors red, green or blue.
  • the so-called Bayer pattern is known, which has the color grid of the sensor selectivity shown in FIG. 4.
  • the so-called four-shot method is used for recordings of the highest quality, for example when using the Bayer pattern mentioned.
  • the matrix is increased by one sensor grid dimension after each recording horizontally shifted, an image registration was carried out, then the matrix was shifted vertically by one sensor grid dimension with respect to the starting position, another image was registered and finally, with respect to the starting position, shifted horizontally and vertically with a sensor diagonal grid dimension, again an image was registered.
  • the color information of the red, blue and twice of the green channel is available for each image pixel.
  • the shift is preferably carried out with the arrangement described in WO 01/00001 by the same applicant, following the principle described there.
  • Shift S is made by more than one grid dimension, strictly speaking even with a combined horizontal / vertical shift of the matrix by one
  • Diagonal grid dimension Since, as can be seen from FIG. 4, every second sensor is a green sensor, with only two registrations shifted diagonally by a diagonal grid dimension, entire images can already be interpolated and compared with one another in the sense of the present invention. It may well be appropriate to shift by an even or an odd number of grid dimensions in order to implement the method according to the invention. In the event of a shift by an even number of grid dimensions, it is ensured that sensors of the same color selectivity are always present at the same image location. A shift by an odd number of sensor distances is suggested by combining the four-shot technique with a larger shift S in favor of the procedure according to the invention described with reference to FIGS.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Transforming Light Signals Into Electric Signals (AREA)
  • Solid State Image Pick-Up Elements (AREA)
  • Analysing Materials By The Use Of Radiation (AREA)

Abstract

L'invention vise à éliminer, dans le cadre de la photographie numérique, des défauts liés aux capteurs, ayant un effet sur la reproduction. A cet effet, la matrice de capteur (1) est décalée mécaniquement d'un vecteur (<o>S</o>) prédéfini. Etant donné que ce décalage mécanique provoque un décalage de l'image du faisceau de reproduction (B1, B2), mais non un décalage des défauts (xz, yz), la comparaison des images enregistrées avant et après décalage mécanique (71, 72, 9), et la matrice de signal de comparaison résultante DELTA permettent de déterminer la position de défauts liés aux capteurs.
EP01914941A 2001-03-30 2001-03-30 Procede de photographie numerique et appareil photo numerique Withdrawn EP1374564A2 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US09/821,792 US20040207738A1 (en) 2001-03-30 2001-03-30 Digital photography method and digital camera
PCT/CH2001/000206 WO2001052525A2 (fr) 2001-03-30 2001-03-30 Procede de photographie numerique et appareil photo numerique

Publications (1)

Publication Number Publication Date
EP1374564A2 true EP1374564A2 (fr) 2004-01-02

Family

ID=33541887

Family Applications (1)

Application Number Title Priority Date Filing Date
EP01914941A Withdrawn EP1374564A2 (fr) 2001-03-30 2001-03-30 Procede de photographie numerique et appareil photo numerique

Country Status (4)

Country Link
US (1) US20040207738A1 (fr)
EP (1) EP1374564A2 (fr)
AU (1) AU2001242209A1 (fr)
WO (1) WO2001052525A2 (fr)

Families Citing this family (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7120315B2 (en) * 2002-03-18 2006-10-10 Creo Il., Ltd Method and apparatus for capturing images using blemished sensors
JP4179079B2 (ja) * 2002-08-30 2008-11-12 株式会社ニコン 電子カメラ及びその制御プログラム
JP4757085B2 (ja) 2006-04-14 2011-08-24 キヤノン株式会社 撮像装置及びその制御方法、画像処理装置、画像処理方法、及びプログラム
DE102006039389A1 (de) * 2006-08-22 2008-02-28 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Vorrichtung und Verfahren zur Reduzierung von Übergangsartefakten in einem Gesamtbild, das sich aus Teilbildern zusammensetzt
JP2008072565A (ja) * 2006-09-15 2008-03-27 Ricoh Co Ltd 撮像装置及び欠陥画素補正方法
US8170321B2 (en) * 2008-05-23 2012-05-01 Siemens Aktiengesellschaft System and method for contour tracking in cardiac phase contrast flow MR images
RU2011138024A (ru) * 2009-02-16 2013-03-27 Мэньюфэкчеринг Ресорсиз Интернэшнл, Инк. Контур обратной связи характеристик дисплея
US8441574B2 (en) * 2009-02-16 2013-05-14 Manufacturing Resources International, Inc. Visual identifier for images on an electronic display
JP5868039B2 (ja) * 2011-06-30 2016-02-24 キヤノン株式会社 撮像装置、画像合成方法、及びコンピュータプログラム
US10319408B2 (en) 2015-03-30 2019-06-11 Manufacturing Resources International, Inc. Monolithic display with separately controllable sections
US10922736B2 (en) 2015-05-15 2021-02-16 Manufacturing Resources International, Inc. Smart electronic display for restaurants
US10269156B2 (en) 2015-06-05 2019-04-23 Manufacturing Resources International, Inc. System and method for blending order confirmation over menu board background
US10319271B2 (en) 2016-03-22 2019-06-11 Manufacturing Resources International, Inc. Cyclic redundancy check for electronic displays
AU2017273560B2 (en) 2016-05-31 2019-10-03 Manufacturing Resources International, Inc. Electronic display remote image verification system and method
US10510304B2 (en) 2016-08-10 2019-12-17 Manufacturing Resources International, Inc. Dynamic dimming LED backlight for LCD array
US11895362B2 (en) 2021-10-29 2024-02-06 Manufacturing Resources International, Inc. Proof of play for images displayed at electronic displays

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS59186481A (ja) * 1983-04-08 1984-10-23 Citizen Watch Co Ltd 撮像装置
US4748507A (en) * 1986-10-17 1988-05-31 Kenneth Gural Solid state imaging device having means to shift the image between scans and associated circuitry to improve the scanned image
JPS6462977A (en) * 1987-09-03 1989-03-09 Fujitsu Ltd Solid-state image pickup device
GB9211566D0 (en) * 1992-05-29 1992-07-15 Secr Defence Imaging system
US5889553A (en) * 1993-11-17 1999-03-30 Canon Kabushiki Kaisha Image pickup apparatus capable of high resolution imaging
US5514865A (en) * 1994-06-10 1996-05-07 Westinghouse Electric Corp. Dither image scanner with compensation for individual detector response and gain correction
JPH1038961A (ja) * 1996-07-22 1998-02-13 Fujitsu Ltd 二次元固体撮像デバイスの画素欠陥検出装置
FR2756129B1 (fr) * 1996-11-15 1999-07-09 Sagem Camera video a deviateur d'augmentation de resolution
US6011584A (en) * 1996-12-09 2000-01-04 Raytheon Company Method and apparatus for correcting offsets of two detectors using respective functions of a difference
US5838813A (en) * 1996-12-20 1998-11-17 Lockheed Martin Corp. Dithered image reconstruction

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See references of WO0152525A2 *

Also Published As

Publication number Publication date
WO2001052525A3 (fr) 2002-01-31
US20040207738A1 (en) 2004-10-21
AU2001242209A1 (en) 2001-07-24
WO2001052525A2 (fr) 2001-07-19

Similar Documents

Publication Publication Date Title
DE69733978T2 (de) Bilddateninterpolationsgerät
WO2001052525A2 (fr) Procede de photographie numerique et appareil photo numerique
DE69611113T3 (de) Vorrichtung zur Videorauschreduktion
DE102007005219B4 (de) Erkennung von bewegtem interlaced Text für Filmmode-Abklärung
DE102010062496B4 (de) Verfahren und Vorrichtung zum Verarbeiten von Bildinformationen zweier zur Bilderfassung geeigneter Sensoren eines Stereo-Sensor-Systems
DE4108288C2 (fr)
EP0702487A1 (fr) Méthode et circuit de détection et de masquage d&#39;erreurs dans un signal vidéo
DE3310826A1 (de) Adaptive fehlerkaschierung bei abgetasteter videoinformation
DE4411179A1 (de) Bildeinfangvorrichtung
DE3609887A1 (de) Schaltungsanordnung zur adaptiven steuerung eines rekursiven filters fuer videosignale
EP1585059A2 (fr) Procédé et dispositif d&#39;évaluation de vecteurs de vitesse attribués à des régions d&#39;image
DE3636077C2 (de) Verfahren zum Verdecken von Fehlern in einem Videosignal und Schaltung zur Durchführung des Verfahrens
DE3142602C2 (de) Kompensationsschaltung
DE3905234C2 (fr)
DE69635259T2 (de) Verdeckung von Flecken in Videosignalen
DE10084783B3 (de) System und Verfahren zur Generierung von Videoframes
DE2261228C2 (de) Verfahren und Schaltungsanordnung zur Unterdrückung des Kammeffekts bei der Aufzeichnung von dem Zeilensprungverfahren entsprechenden Videosignalen auf Kinofilm
DE2048349C3 (de) Farbfernsehkamera mit mehreren Bildaufnahmeröhren
DE60031559T2 (de) Verfahren und gerät zur lernfähigen klassenauswahl nach mehreren klassifikationen
WO2000019713A1 (fr) Circuit permettant de transformer un debit binaire
EP0596561B1 (fr) Dispositif de doublement de la fréquence de trame d&#39;un signal d&#39;image
DE4105517C2 (de) Verfahren und Vorrichtung zur verbesserten Wiedergabe von Konturen
DE2225993C3 (de) Farbfemseh-Trick-Mischverfahren- und -gerät zur Einblendung eines Vordergrundbildes in ein Hintergrundbild
EP1729258A2 (fr) Procédé et dispositif destinés à la détermination de vecteurs de déplacement
DE3140825A1 (de) Verfahren und einrichtung zur signaluebertragung

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20030826

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LI LU MC NL PT SE TR

AX Request for extension of the european patent

Extension state: AL LT LV MK RO SI

17Q First examination report despatched

Effective date: 20040419

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

RBV Designated contracting states (corrected)

Designated state(s): CH DE DK GB LI NL

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN

18D Application deemed to be withdrawn

Effective date: 20051001