EP1595226A2 - Appareil et procede pour redresser une image prise au grand angle - Google Patents

Appareil et procede pour redresser une image prise au grand angle

Info

Publication number
EP1595226A2
EP1595226A2 EP04704571A EP04704571A EP1595226A2 EP 1595226 A2 EP1595226 A2 EP 1595226A2 EP 04704571 A EP04704571 A EP 04704571A EP 04704571 A EP04704571 A EP 04704571A EP 1595226 A2 EP1595226 A2 EP 1595226A2
Authority
EP
European Patent Office
Prior art keywords
image
typical
features
recorded
relative positions
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP04704571A
Other languages
German (de)
English (en)
Inventor
Roland Aubauer
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Siemens AG
Siemens Corp
Original Assignee
Siemens AG
Siemens Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Siemens AG, Siemens Corp filed Critical Siemens AG
Publication of EP1595226A2 publication Critical patent/EP1595226A2/fr
Withdrawn legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/04—Context-preserving transformations, e.g. by using an importance map
    • G06T3/047—Fisheye or wide-angle transformations
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/80—Geometric correction
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/60—Noise processing, e.g. detecting, correcting, reducing or removing noise
    • H04N25/61—Noise processing, e.g. detecting, correcting, reducing or removing noise the noise originating only from the lens unit, e.g. flare, shading, vignetting or "cos4"

Definitions

  • the invention relates to a device with a digital optical recording device for wide-angle recording of an image of a person, a being or an object, the spatial orientation and the typical pictorial features of which are essentially fixed, and with a storage device for electronically storing the image.
  • the invention also relates to a method for rectifying such an image.
  • Examples of devices of the type mentioned above are commercially available digital cameras, in which digital images are generated and stored, particularly when taking portraits.
  • the spatial orientation and the typical pictorial features of the object to be photographed are essentially defined, especially in the portrait shots already mentioned.
  • Digital cameras have also recently been used in mobile phones to make it easier for a user of the
  • wide-angle lenses / lenses are usually used, so that the user can film (video sound) or record (single image).
  • the invention is therefore based on the object of providing a device with a digital optical recording device for wide-angle recording of an image of an object, and a method in which an effective equalization of the recorded image is achieved.
  • this object is achieved by a detection device for the two-dimensional detection of relative positions of the typical pictorial features of the recorded object relative to one another, a reference storage device which contains relative positions of the typical pictorial features corresponding to a standard arrangement, and an equalization device, those for reading out the image stored in the memory device and for equalizing the stored image, depending on a comparison of the relative
  • Reference storage device is formed.
  • a “wide-angle photograph” is understood to mean a photograph that captures an image section that is larger than that that is imaged on a retina of a human eye. This applies, for example, to object focal lengths of less than 50 mm in the 35 mm photograph a film section of 24 x 36 mm.
  • the device is thus suitable for using the detection device to identify the typical pictorial features of the recorded object - these are, for example, the mouth, nose and ears in a human face - and the relative positions of the identified typical pictorial features.
  • the actual equalization of the recorded image takes place in such a way that a standard arrangement is used, in which corresponding relative positions of the typical pictorial features to one another are fixed.
  • the equalization device preferably operates at least partially in a non-linear manner.
  • linearization algorithms can generally be used which do not work linearly in certain value ranges and linearly in other value ranges.
  • the comparison carried out then provides information about the extent to which the relative positions of the typical pictorial features differ from one another in the recorded object and in the standard arrangement.
  • the recorded image can then be approximated to the standard arrangement with regard to the locations of its typical pictorial features.
  • the typical pictorial features should preferably be selected such that they are partly in the outer region of the object being recorded and partly in the inner region of the object being recorded. This gives a particularly representative picture of the distortion attributable to the wide-angle lens.
  • the equalization device is preferably designed in such a way that a value for a variable is determined in the comparison, the one
  • Ears, head circumference and / or head outline can be used.
  • the equalization device is preferably designed to enlarge and reduce sections of the image, so that distortions can be effectively compensated for by an inserted wide-angle lens.
  • the equalization can be carried out both at the pixel level and at the surface level.
  • a mean value can be formed for corresponding pixels of the recorded image in order to reduce the size of an image section to calculate a pixel value of an associated reduced image section.
  • the equalization device is preferably designed for this purpose.
  • the equalization device can be designed to enlarge an image section to calculate a pixel value of an associated enlarged image section by interpolation based on neighboring pixels of the recorded image. In this case, the enlargement results in additional pixel values for a recorded image section, to which intensity and color values can be assigned. Such “gaps” resulting from the enlargement are closed by means of interpolation to generate new pixels.
  • non-linear equalization of the stored recorded image wherein the recorded image is read out and, depending on a comparison of the relative positions of typical pictorial features of the recorded object, is rectified by the detection device with the relative positions of the typical pictorial features corresponding to the standard arrangement by the reference storage device ,
  • a dimensional ratio between the relative positions of the typical features of the recorded object to one another and the relative positions of the typical features to one another in the standard arrangement can be determined that the equalization is involved.
  • This measure takes into account the fact that in certain cases there is a significant difference in the absolute dimensions of the item in the Image and the object can be in the standard arrangement. Such differences can be compensated for by determining the dimensional ratio in the manner described above.
  • the ratio between a distance between the layers of two is more typical as the dimensional ratio
  • Portrait shot can be the eye relief to form the
  • the equalization can be improved further by determining the spatial orientation of an object represented by the image when detecting the relative positions of the typical features of the recorded object the spatial alignment of the standard arrangement is adjusted for the comparison.
  • This measure can be useful if, for example, typical features for a portrait shot in the sense of the typical front view are stored as the standard arrangement, while the human head was taken in a perspective view in the case of a captured image.
  • the spatial orientation for the recorded image can be determined as part of the identification of the typical features of the human face, such as the eyes and ears, and the spatial orientation of the standard arrangement can be adapted on the basis of this.
  • the equalization can be carried out both for still images which are already available, for example, in a compressed data format such as JPEG, and for films in which several images are connected to one another.
  • the equalization can thus in real time, i.e. be carried out during a transmission via a communication connection as well as with a time delay.
  • the exemplary embodiment relates to a portrait that is taken by means of a digital camera that is integrated in a mobile phone.
  • the digital camera is equipped with a wide-angled lens to enable its user to take pictures of themselves while holding the mobile phone comfortably.
  • a two-dimensional detection of relative positions of typical pictorial features of the head of the user is carried out using a software-implemented detection device.
  • the typical visual features such as the eyes, ears, mouth, head size and head outline are recorded. These features are identified by means of the detection device.
  • their positions and thus their relative positions to each other are determined.
  • a reference storage device is then accessed, the relative positions of the typical pictorial features of a human being corresponding to a standard arrangement
  • a non-linear equalization device reads the cached image from the user's head from a storage device. This is followed by equalization of the stored image as described below. This equalization is based on a comparison of the relative positions of the typical pictorial features of the recorded head of the user with the relative positions of the typical pictorial features according to the standard arrangement. In this standard arrangement, relative positions and positions of the typical features are stored, which can be obtained, for example, from an "average face".
  • the comparison is evaluated to determine whether there is a significant correlation between the relative positions of the typical pictorial features of the recorded object, here the head of the user, and the relative positions provided by the reference storage device. This can be accomplished, for example, using the least squares method that provides a representative value for the correlation between pixel values of the recorded image and pixel values of the standard arrangement. If there is no sufficient correlation, no equalization takes place. In this way, it is avoided that in the case of the exemplary embodiment described here, equalization is carried out on the basis of the standard arrangement which relates to a human face in the case of non-portrait recordings.
  • the comparison is also evaluated to the extent that, in the equalization, a dimensional relationship between the relative positions of the typical features of the recorded object to one another and the relative positions of the typical features in the
  • Standard arrangement is determined. In this way, prior to the actual equalization, it is recognized whether there are any significant absolute dimensional differences between the recorded image and the standard arrangement.
  • the distance between the two eyes in the standard arrangement for the portrait picture discussed here can be compared with the eye distance in the picture taken in order to obtain a suitable value for the dimensional ratio.
  • the result delivered by the detection device is evaluated via the positions of the typical pictorial features. Based on the identification and the position of the eyes, ears, etc. of the head of the user, the spatial orientation can be inferred.
  • an internal image detail is reduced during the actual equalization, while an outer image detail is enlarged.
  • an outer image detail is enlarged.
  • averaging over a number of pixels of the recorded image is carried out so that an intensity value and a color value for the pixel, which reflects the number of pixels in the original image detail, are obtained.
  • the result of only enlarged image sections the result of only enlarged image sections, the result
  • an imaging rule can be obtained according to which, for a certain distance, the human head and the wide-angle lens between at one

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Image Processing (AREA)
  • Television Signal Processing For Recording (AREA)

Abstract

L'invention concerne un appareil comprenant un dispositif optique numérique de prise de vues permettant d'obtenir au grand-angle une image d'une personne, d'un être vivant ou d'un objet dont l'orientation spatiale et les caractéristiques d'image particulières sont sensiblement définies, ainsi qu'un dispositif de stockage servant à conserver l'image sous forme électronique. Selon l'invention, pour qu'il soit possible d'obtenir un redressement bidimensionnel efficace, cet appareil comprend en outre un dispositif d'enregistrement servant à enregistrer en deux dimensions des positions relatives des caractéristiques d'image particulières de l'objet photographié les unes par rapport aux autres, un dispositif de stockage de référence contenant des positions relatives des caractéristiques d'image particulières les unes par rapport aux autres correspondant à une disposition standard, ainsi qu'un dispositif de redressement conçu pour extraire l'image stockée dans le dispositif de stockage et pour redresser cette image d'après une comparaison des positions relatives des caractéristiques d'image particulières de l'objet photographié, enregistrées par le dispositif d'enregistrement, avec les positions relatives des caractéristiques d'image particulières correspondant à la disposition standard, contenues dans le dispositif de stockage de référence. L'invention concerne également un procédé de redressement d'images prises au grand angle.
EP04704571A 2003-02-19 2004-01-23 Appareil et procede pour redresser une image prise au grand angle Withdrawn EP1595226A2 (fr)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
DE10306986 2003-02-19
DE10306986A DE10306986A1 (de) 2003-02-19 2003-02-19 Gerät und Verfahren zur Entzerrung eines weitwinklig aufgenommenen Bildes
PCT/EP2004/000576 WO2004075111A2 (fr) 2003-02-19 2004-01-23 Appareil et procede pour redresser une image prise au grand angle

Publications (1)

Publication Number Publication Date
EP1595226A2 true EP1595226A2 (fr) 2005-11-16

Family

ID=32841707

Family Applications (1)

Application Number Title Priority Date Filing Date
EP04704571A Withdrawn EP1595226A2 (fr) 2003-02-19 2004-01-23 Appareil et procede pour redresser une image prise au grand angle

Country Status (5)

Country Link
EP (1) EP1595226A2 (fr)
CN (1) CN1751322A (fr)
DE (1) DE10306986A1 (fr)
TW (1) TWI243598B (fr)
WO (1) WO2004075111A2 (fr)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN100379266C (zh) * 2005-04-26 2008-04-02 明基电通股份有限公司 摄影装置以及摄影方法
CN111027474B (zh) * 2019-12-09 2024-03-15 Oppo广东移动通信有限公司 人脸区域获取方法、装置、终端设备和存储介质

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE69526635T2 (de) * 1994-12-29 2002-12-05 Koninklijke Philips Electronics N.V., Eindhoven Bilderzeugungsgerät und Verfahren zur Verbesserung geometrischer optischer Bildverzerrungen
US5878174A (en) * 1996-11-12 1999-03-02 Ford Global Technologies, Inc. Method for lens distortion correction of photographic images for texture mapping
US5886735A (en) * 1997-01-14 1999-03-23 Bullister; Edward T Video telephone headset

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See references of WO2004075111A3 *

Also Published As

Publication number Publication date
TWI243598B (en) 2005-11-11
CN1751322A (zh) 2006-03-22
WO2004075111A3 (fr) 2005-03-24
WO2004075111A2 (fr) 2004-09-02
TW200417252A (en) 2004-09-01
DE10306986A1 (de) 2004-09-09

Similar Documents

Publication Publication Date Title
DE60312508T2 (de) System und verfahren zur digitalen bildauswahl
DE602006000400T2 (de) Bildsegmentierungsverfahren und -system
DE102004001890B4 (de) Digitaler automatischer Weißausgleich
DE69333177T2 (de) Aufzeichnungsmedium, ein Gerät zum Aufzeichnen bewegter Bilder, ein Gerät und ein System zum Erzeugen eines Abrisses bewegter Bilder, und Verfahren zu dessen Erzeugung
DE19782037C2 (de) Verfahren und Einrichtung zur Erzeugung eines zusammengesetzten Bildes
US8212889B2 (en) Method for activating a function, namely an alteration of sharpness, using a colour digital image
DE69734855T2 (de) Vorrichtung und Verfahren zur Extraktion eines Objektes in einem Bild
EP2030433B1 (fr) Procédé et système de traitement d'enregistrements de données de capteurs de formation d'images, ainsi que programme informatique correspondant et support d'enregistrement correspondant pouvant être lu informatiquement
DE69825220T2 (de) Filterverfahren, Filter und Mobilendgerät
DE102005000820B4 (de) Verfahren zum Verbessern der Sehfähigkeit einer sehbehinderten Person und Sehhilfe
DE602005003917T2 (de) Verfahren und Vorrichtung zur Erzeugung von Bildern mit hoher Dynamik aus mehreren Belichtungen
DE10315462B4 (de) Bildkorrektursystem und -verfahren
DE112017006107T5 (de) Digitale Korrektur von optischen Systemaberrationen
DE112013004507T5 (de) Bildverarbeitungsvorrichtung, Bilderfassungsvorrichtung, Bildverarbeitungsverfahren, Programm und Aufzeichnungsmedium
DE102012006493A1 (de) Kameraimplementierung des Wählens und Stitchens von Einzelbildern für Panoramaaufnahmen
DE102007011222A1 (de) Autofokusverfahren und Autofokusvorrichtung zu dessen Durchführung
DE102007037310A1 (de) Netzwerkkamera und Steuerungsverfahren hierfür
DE102014117120A1 (de) Bildverarbeitungsvorrichtung
DE69925696T2 (de) Bildaufnahmevorrichtung, Bildanzeigevorrichtung und Informationsaufzeichnungsmedium mit einem Fischaugenobjektiv
DE102018123402A1 (de) Bildunschärfekorrekturvorrichtung und steuerverfahren
DE112006001017T5 (de) Verfahren und Vorrichtung zum Eingliedern von Irisfarbe in eine Rotes-Auge-Korrektur
DE602005004195T2 (de) Verfahren und Vorrichtung der Bildverarbeitung zur rote-Augen-Korrekur
EP1906655B1 (fr) Procédé de correction de déformations de perspective d'un système de lentilles
EP3286690B1 (fr) Document d'identification, dispositif d'identification et procédés correspondants
EP1595226A2 (fr) Appareil et procede pour redresser une image prise au grand angle

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20050712

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LI LU MC NL PT RO SE SI SK TR

AX Request for extension of the european patent

Extension state: AL LT LV MK

DAX Request for extension of the european patent (deleted)
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN

18D Application deemed to be withdrawn

Effective date: 20070801