EP1516304A1 - Elektronische korrektureinrichtung für optische verzerrungen in einer aus einer matrixanzeige erhaltenen kollimierten abbildung - Google Patents

Elektronische korrektureinrichtung für optische verzerrungen in einer aus einer matrixanzeige erhaltenen kollimierten abbildung

Info

Publication number
EP1516304A1
EP1516304A1 EP03756013A EP03756013A EP1516304A1 EP 1516304 A1 EP1516304 A1 EP 1516304A1 EP 03756013 A EP03756013 A EP 03756013A EP 03756013 A EP03756013 A EP 03756013A EP 1516304 A1 EP1516304 A1 EP 1516304A1
Authority
EP
European Patent Office
Prior art keywords
electronic
image
pixels
display
pixel
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP03756013A
Other languages
English (en)
French (fr)
Inventor
Jean-René Thales Intellectual Property VERBEQUE
Olivier Thales Intellectual Property ROLS
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Thales SA
Original Assignee
Thales SA
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Thales SA filed Critical Thales SA
Publication of EP1516304A1 publication Critical patent/EP1516304A1/de
Withdrawn legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G3/00Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
    • G09G3/001Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes using specific devices not provided for in groups G09G3/02 - G09G3/36, e.g. using an intermediate record carrier such as a film slide; Projection systems; Display of non-alphanumerical information, solely or in combination with alphanumerical information, e.g. digital display on projected diapositive as background
    • G09G3/002Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes using specific devices not provided for in groups G09G3/02 - G09G3/36, e.g. using an intermediate record carrier such as a film slide; Projection systems; Display of non-alphanumerical information, solely or in combination with alphanumerical information, e.g. digital display on projected diapositive as background to project the image of a two-dimensional display, such as an array of light emitting or modulating elements or a CRT
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/80Geometric correction

Definitions

  • the field of the invention is that of systems for presenting collimated images, and more precisely that of so-called head-up viewfinders or helmet visuals used on aircraft.
  • a collimated display system comprises a display D and an optical system O for collimation and superposition making it possible to present to a user U the image V provided by l display in the form of an aerial image A collimated at infinity and superimposed on the exterior landscape, this image coming from image sources not shown in the figure.
  • These systems are particularly used on aircraft.
  • the superimposed image must be of excellent optical quality to avoid any piloting error and not to cause significant eyestrain.
  • One of the main technical difficulties in obtaining a good quality image is the correction of the geometric distortion introduced on the one hand by the collimation and superposition optics and on the other hand, and to a lesser extent, by the transparent canopy. from the cockpit of the aircraft in the case of use with a Head Up sight or from the visor of the helmet in the case of use with a helmet visual. It has been shown that, given the geometric constraints imposed by the use of the system in a cockpit or on a helmet, the geometric distortion is significant and cannot be corrected simply by conventional optical means.
  • F the distortion function which, at a point M (x, y) of the two-dimensional image presented by the display, corresponds to a point M '( ⁇ , ⁇ ), ⁇ , ⁇ representing the angular coordinates of the point M', image of M through the collimated optics.
  • KF ⁇ (x, y)
  • the upper part of FIG. 2 represents on the left the initial image V 0 provided by the display and on the right the final image A 0 deformed by the distortion function F of the optics seen through the collimated optics.
  • the conventionally used method consists in subjecting the image of the display to a distortion opposite to that of the optics, this distortion function being denoted F "1 as indicated on the left side. of FIG. 2 which represents at the top the initial non-deformed image V 0 and at the bottom the image V having undergone the inverse deformation F "1 .
  • F "1 the distortion function
  • FIG. 2 which represents at the top the initial non-deformed image V 0 and at the bottom the image V having undergone the inverse deformation F "1 .
  • This method is particularly well suited in the case where the image provided by the display is continuous, it is that is, the points making up the image are not differentiated.
  • Whatever distortion function is applied there is always a point on the screen of the corresponding tube.
  • the distortion function is achieved by modifying the adjustment parameters of the horizontal and vertical deflection systems of the cathode rays.
  • cathode ray tubes have a certain number of drawbacks, such as size, complex electronics to be implemented, requiring in particular high operating voltages as well as a short service life.
  • a matrix display includes so classic P U ⁇ V pixels organized in a matrix of R rows and S columns; u, v being whole numbers varying respectively from 1 to R, and from 1 to S.
  • the application of this function F " 1 to the pixel Pjj, k cannot correspond, in the general case, exactly one pixel P u , v from the display. It will then necessarily be necessary to match the calculation result to the pixel of the nearest display.
  • Ej contain a quantity of pixels lower or close to that of the display.
  • the device constructs the image of the display by following the reverse process, that is to say by associating with each pixel P u , v always the same number of pixels Pjj. k of each electronic image E ⁇ , the addresses of the pixels Py. k being obtained from the calculation of F (P U , V ) -
  • the photometric value L u , v of the pixel P U) v is obtained from the photometric values L. k of Pg. k .
  • the subject of the invention is a device for electronic correction of the geometric distortion aberrations of a collimation and superposition optic forming part of a display assembly comprising: “a device for generating at least one image- electronic source Ej, i whole number varying between 1 and L;
  • F u (u, v), F v (u, v) being the representations of the two-dimensional function F of distortion of the optical system; characterized in that the electronics comprise a distortion correction system comprising an electronic memory unit making it possible to store the electronic images Ej, an address calculation unit and an interpolation and mixing unit such that,
  • the electronic memory unit organizes each image into a matrix of M rows and N columns of pixels Pjj. k to which correspond e-mail addresses (i, j, k); j, k being whole numbers varying respectively from 1 to Mj, and from 1 to Nj; each pixel Pj ⁇ k being associated with a photometric value Lj j , k ;
  • the address calculation unit associates with each address (u, v) the addresses (i, j, k) of the pixels Pjj.k stored in the electronic memory, said addresses close to the calculated points (i, j r , k r ), j r , k r being real numbers obtained by the calculation of Kj'.F u (u, v) and Kj'.Fv (uN); Kj 'being a normalization constant associated with each electronic image Ej such that, for all i, j r is less than Mj and k r is less than Nj.
  • the interpolation unit calculates the photometric value Lj, u , v , contribution of each electronic image to the value L U ⁇ V from the photometric values Lj. k of said address pixels (i, j, k) supplied by the address calculation unit.
  • the pixels used by the interpolation unit for the calculation of the photometric value LJ , UFV are at least the four pixels of referenced addresses (i, j e , ke), ( i, j e + 1, ke), (i, je, ke + 1) and (i, je + 1, k e +1) with (j e , whole parts of the numbers (j r , k r ), Lj ⁇ U , v being a function of at least the four values Ljj e , ke. Ljj e + ⁇ , ke, e.
  • the photometric value Lj U ⁇ V .
  • the normalization constants Kj ′ are calculated so that all the pixels of the display have correspondents in each electronic image.
  • An electronic zoom effect is then obtained, part of the initial electronic images being only shown enlarged over the entire surface of the display.
  • the electronic correction can be implemented in an electronic component comprising arrays of logic gates (AND or OR).
  • These components can be of the non-programmable type such as, for example, the ASIC (Application Specifies Integrated Circuit) or programmable like, for example, the FPGA (Field Programmable Gray Array) or EPLD (Erasable Programmable Logic Device).
  • ASIC Application Specifies Integrated Circuit
  • FPGA Field Programmable Gray Array
  • EPLD Erasable Programmable Logic Device
  • FIG. 1 represents a general view of a display device presenting collimated images in the particular case of
  • Figure 2 shows the principle of distortion correction according to the known art.
  • Figure 3 shows the correction principle according to the invention.
  • FIG. 4 represents the principle of determining the pixels of the electronic images used to determine the luminance value of the pixels of the display.
  • Ej images arriving at a collimated viewing system can have several origins. They can come from:
  • u F u ( x, y)
  • v F v (x, y)
  • the electronic unit comprises an address calculation unit UCA such that said unit associates with each address (u, v) the addresses (i, j, k) of the pixels Pj j , k stored in the electronic memory, said addresses being close to the calculated points (i, j r , k r ), j r , k r being real numbers obtained by the calculation of
  • F u (u, v) F u (uo, v 0 ) + ⁇ F u (u 0 , Vo) / ⁇ u .u 0 + ⁇ F u (u 0 , v 0 ) / ⁇ v .v 0 + ... + ⁇ n F u (u 0l v 0 ) / ⁇ v n .v 0 n with (uo.vo) original address and ⁇ n F u (uo, vo) / ⁇ v n partial derivative of degree n of the function F u with respect to v around the address (uo.Vo).
  • F v (u, v) Fv (uoNo) + ⁇ F v (u 0 , vo) / ⁇ u .u 0 + ⁇ F v (u 0 , v 0 ) / ⁇ v .v 0 + ... + ⁇ n F v (u 0 , vo) / ⁇ v n .Vo "with (uo, v 0 ) original address and ⁇ n F v (Uo, Vo) / ⁇ v n partial derivative of degree n of the function F v with respect to v around the address (uo, v 0 ).
  • each pair (Mj.Nj) must be significantly different from the pair (R, S).
  • the address (i, j r , k r ) corresponding to the address (u, v) of the pixel P u? V being known, the interpolation unit UIM and of mixing calculates the photometric values Lj, u , v To carry out this calculation, the photometric values Ljj, k of the pixels whose address is closest to the address (i, j r , k r ) are used.
  • each of these values being weighted by a weighting coefficient essentially dependent on the distance from the address of the pixel to the calculated address.
  • ⁇ U ⁇ V can be obtained simply.
  • the overall photometric value Lj ⁇ U ⁇ V of each point of the display is equal to the contribution of each of the photometric values L i ⁇ U ⁇ V .
  • This interpolation and mixing unit as well as the address calculation unit can be implemented in electronic components comprising arrays of logic gates (AND or OR). These components can be of non-programmable type such as, for example, ASICs (Application Specifies Integrated Circuit); in this case, the information is engraved when the circuit is produced. These components can also be programmable such as, for example, the FPGA (Field Programmable Gate Array) or EPLD (Erasable Programmable Logic Device). These components are commonly used for professional electronics or onboard aircraft applications.
  • the display being polychromatic consisting of colored pixels, each pixel consisting of a triplet of three colored sub-pixels, each corresponding to a primary color and the electronic source images also being polychromatic each consisting of color pixels, each pixel also being composed of a triplet of three colored sub-pixels, each corresponding to a primary color; the calculations performed by the address calculation unit and the interpolation unit in order to determine the photometric values of each colored pixel of the display are carried out respectively for each type of sub-pixel of the display and for each type of sub-pixel of the same color source images.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Hardware Design (AREA)
  • Image Processing (AREA)
  • Control Of Indicators Other Than Cathode Ray Tubes (AREA)
  • Liquid Crystal Display Device Control (AREA)
  • Transforming Electric Information Into Light Information (AREA)
EP03756013A 2002-05-31 2003-05-27 Elektronische korrektureinrichtung für optische verzerrungen in einer aus einer matrixanzeige erhaltenen kollimierten abbildung Withdrawn EP1516304A1 (de)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
FR0206721 2002-05-31
FR0206721A FR2840491B1 (fr) 2002-05-31 2002-05-31 Dispositif de correction electronique des distorsions optiques d'une visualisation collimatee obtenue a partir d'un afficheur matriciel
PCT/FR2003/001601 WO2003102904A1 (fr) 2002-05-31 2003-05-27 Dispositif de correction electronique des distorsions optiques d'une visualisation collimatee obtenue a partir d'un afficheur matriciel

Publications (1)

Publication Number Publication Date
EP1516304A1 true EP1516304A1 (de) 2005-03-23

Family

ID=29558881

Family Applications (1)

Application Number Title Priority Date Filing Date
EP03756013A Withdrawn EP1516304A1 (de) 2002-05-31 2003-05-27 Elektronische korrektureinrichtung für optische verzerrungen in einer aus einer matrixanzeige erhaltenen kollimierten abbildung

Country Status (9)

Country Link
US (1) US20040179271A1 (de)
EP (1) EP1516304A1 (de)
JP (1) JP2005528833A (de)
AU (1) AU2003254537A1 (de)
BR (1) BR0304931A (de)
CA (1) CA2455764A1 (de)
FR (1) FR2840491B1 (de)
IL (1) IL159912A0 (de)
WO (1) WO2003102904A1 (de)

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
FR2860601B1 (fr) * 2003-10-07 2005-12-30 Thales Sa Procede de correction de distorsion d'un imageur a cristaux liquides
EP1742459A1 (de) * 2005-06-13 2007-01-10 SONY DEUTSCHLAND GmbH Korrektur von Geometrieverzerrungen
ITBO20060027A1 (it) * 2006-01-17 2007-07-18 Ferrari Spa Metodo di controllo di sistema hud per un veicolo stradale
US7873233B2 (en) * 2006-10-17 2011-01-18 Seiko Epson Corporation Method and apparatus for rendering an image impinging upon a non-planar surface
JP5341462B2 (ja) * 2008-10-14 2013-11-13 キヤノン株式会社 収差補正方法、画像処理装置および画像処理システム
JP5214060B1 (ja) * 2011-08-18 2013-06-19 パイオニア株式会社 虚像表示装置
WO2015025190A1 (en) 2013-08-19 2015-02-26 Aselsan Elektronik Sanayi Ve Ticaret Anonim Sirketi Modular element in sintered expanded-polystyrene for building reinforced-concrete floors
CN106646869B (zh) * 2015-10-30 2019-07-26 上海和辉光电有限公司 一种虚拟实境显示装置
DE102017004859B4 (de) 2017-05-19 2019-03-14 Daimler Ag Verfahren zum Kalibrieren einer Projektionsgeometrie eines Head-Up Displays und zugehörige Kalibriervorrichtung

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5504622A (en) * 1993-03-18 1996-04-02 Kansei Corporation Apparatus for head up display comprising a parabolic reflective mirror
EP1079365A1 (de) * 1999-03-17 2001-02-28 Seiko Epson Corporation Verfahren und gerät zur projektionsanzeige

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4656521A (en) * 1985-04-01 1987-04-07 The Singer Company Digital distortion-correcting circuit for projection a flat image on a curved screen from a digital data source for a simulator projected-image visual system
US6188460B1 (en) * 1990-06-11 2001-02-13 Reveo, Inc. Image display panel having a backlighting structure and a single-layer pixelated aray of reflective-type spectral filtering elements where between light is recycled for producing color images with enhanced brightness
US5465121A (en) * 1993-03-31 1995-11-07 International Business Machines Corporation Method and system for compensating for image distortion caused by off-axis image projection
EP0777198A1 (de) * 1995-11-30 1997-06-04 Victor Company Of Japan, Limited Bildverarbeitungsvorrichtung
US6232986B1 (en) * 1997-08-12 2001-05-15 Ricoh Company, Ltd. Three-dimensional graphics processing apparatus
US6367933B1 (en) * 1998-10-02 2002-04-09 Macronix International Co., Ltd. Method and apparatus for preventing keystone distortion
JP3998840B2 (ja) * 1998-12-24 2007-10-31 セイコーエプソン株式会社 投写型表示装置およびそのための画像処理方法
US6496231B1 (en) * 1999-06-30 2002-12-17 Koninklijke Philips Electronics N.V. Method and apparatus for correcting convergence and geometry errors in display devices
JP2002158946A (ja) * 2000-11-20 2002-05-31 Seiko Epson Corp プロジェクタおよび画像歪補正方法

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5504622A (en) * 1993-03-18 1996-04-02 Kansei Corporation Apparatus for head up display comprising a parabolic reflective mirror
EP1079365A1 (de) * 1999-03-17 2001-02-28 Seiko Epson Corporation Verfahren und gerät zur projektionsanzeige

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
LIM F.S. ET AL: "CIRCULAR INTERPOLATORS FOR NUMERICAL CONTROL: A COMPARISON OF THE MODIFIED DDA TECHNIQUES AND AN LSI INTERPOLATOR", COMPUTERS IN INDUSTRY, ELSEVIER SCIENCE PUBLISHERS. AMSTERDAM, NL LNKD- DOI:10.1016/0166-3615(92)90095-5, vol. 18, no. 1, 1 January 1992 (1992-01-01), pages 41 - 52, XP000257514, ISSN: 0166-3615 *
See also references of WO03102904A1 *

Also Published As

Publication number Publication date
AU2003254537A1 (en) 2003-12-19
JP2005528833A (ja) 2005-09-22
IL159912A0 (en) 2004-06-20
FR2840491B1 (fr) 2004-12-03
CA2455764A1 (fr) 2003-12-11
BR0304931A (pt) 2004-08-24
WO2003102904A1 (fr) 2003-12-11
FR2840491A1 (fr) 2003-12-05
US20040179271A1 (en) 2004-09-16

Similar Documents

Publication Publication Date Title
EP0661671B1 (de) Bildverarbeitungsverfahren und -gerät zur Erzeugung eines Zielbildes von einem Quellenbild mit Veränderung der Perspektive
EP0661672B1 (de) Bildverarbeitungsverfahren und -gerät zur Erzeugung eines Zielbildes von einem Quellenbild mit Veränderung der Perspektive
EP0282364B1 (de) Verfahren zur Darstellung eines Perspektivbildes eines Gebiets und System zur Durchführung des Verfahrens
ES2311061T3 (es) Procedimiento y sistema para proporcionar informaciones formateadas a medios de tratamiento de imagenes.
CA2592293C (fr) Procede de traitement d'images mettant en oeuvre le georeferencement automatique d'images issues d'un couple d'images pris dans le meme plan focal
EP2567537B1 (de) Polychromatisches bildgebungsverfahren
US11893701B2 (en) Method for simulating natural perception in virtual and augmented reality scenes
FR2466061A1 (fr) Perfectionnement aux systemes de visualisation du type a image engendree par calculateur
US9418408B1 (en) Dynamic range optimization
EP0650299A1 (de) Bildverarbeitungssystem mit festen Kameras und einer eine sich bewegende Kamera simulierenden Vorrichtung
EP0605045A1 (de) Bildverarbeitungsverfahren und -vorrichtung zum Erzeugen eines Bildes aus mehreren angrenzenden Bildern
FR2633476A1 (fr) Systemes de visualisation que l'on peut regarder sans devoir baisser la tete
FR2922323A1 (fr) Dispositif de surveillance croisee pour afficheurs dits tete haute
EP1516304A1 (de) Elektronische korrektureinrichtung für optische verzerrungen in einer aus einer matrixanzeige erhaltenen kollimierten abbildung
Meyer et al. Advanced Spaceborne Thermal Emission and Reflection Radiometer level 1 precision terrain corrected registered at-sensor radiance (AST_L1T) product, algorithm theoretical basis document
EP2947433A1 (de) System und verfahren zur erfassung von hyperspektralen bildern
EP2469868B1 (de) Verfahren zur Korrektur der Hyperstereoskopie, und entsprechendes Visualisierungssystem mit Helm
EP3438725A1 (de) Anzeigesystem, das eine optische holografische vorrichtung umfasst, die es ermöglicht, bilder in verschiedenen ebenen anzuzeigen
US20210407046A1 (en) Information processing device, information processing system, and information processing method
WO2005033774A1 (fr) Procede de correction de distorsion d'un imageur a cristaux liquides
EP2444953A1 (de) Matrix-Anzeigevorrichtung für zwei verschmolzene Bilder
Crass et al. The AOLI low-order non-linear curvature wavefront sensor: a method for high sensitivity wavefront reconstruction
EP2442272A1 (de) Vorrichtung und Verfahren zur digitalen Bildbearbeitung
EP2703298A1 (de) Vorrichtung und Verfahren zur Stimulation eines optoelektronischen Sensors
FR3085519A1 (fr) Procede de mesure d'un espace de couleur propre a un individu et procede de correction d'images numeriques en fonction de l'espace de couleur propre a l'individu

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20050103

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LI LU MC NL PT RO SE SI SK TR

AX Request for extension of the european patent

Extension state: AL LT LV MK

DAX Request for extension of the european patent (deleted)
RBV Designated contracting states (corrected)

Designated state(s): CH DE FR GB LI

17Q First examination report despatched

Effective date: 20101027

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN

18D Application deemed to be withdrawn

Effective date: 20110308