WO2006136270A1 - Systeme et procede d'affichage - Google Patents

Systeme et procede d'affichage Download PDF

Info

Publication number
WO2006136270A1
WO2006136270A1 PCT/EP2006/005144 EP2006005144W WO2006136270A1 WO 2006136270 A1 WO2006136270 A1 WO 2006136270A1 EP 2006005144 W EP2006005144 W EP 2006005144W WO 2006136270 A1 WO2006136270 A1 WO 2006136270A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
display device
user
display
head
Prior art date
Application number
PCT/EP2006/005144
Other languages
German (de)
English (en)
Inventor
Simon Brattke
Martin Edelmann
Rüdiger Landsinger
Birgit Rottenkolber
Bernd Spruck
Norbert Wurscher
Original Assignee
Carl Zeiss Ag
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Carl Zeiss Ag filed Critical Carl Zeiss Ag
Publication of WO2006136270A1 publication Critical patent/WO2006136270A1/fr

Links

Classifications

    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/64—Imaging systems using optical elements for stabilisation of the lateral and angular position of the image

Definitions

  • the invention relates to a display device with a carrying device which can be placed on the head of a user, an image display device which comprises a display module attached to the carrying device, and an image recording device which records an object to be viewed and generates corresponding image data which the image display device uses for image reproduction.
  • Such a display device can be used in particular for the enlarged representation of an object, in which the image recorded by means of the image recording device is displayed enlarged to the user via the image display device.
  • the difficulty arises that image shake occurring in the image acquisition due to the enlarged representation in the image reproduction are displayed in accordance with the magnification factor.
  • the shake may be due to the natural trembling of the head or due to age or illness-related head shaking.
  • a display device with a carrying device which can be placed on the head of a user, an image display device which comprises a display module fastened to the carrying device, an image recording device which records an object to be viewed and generates corresponding image data, and a sensor which is one a blurred image recording leading movement of the image pickup device detects and generates corresponding motion signals, wherein the image display device based on the image data and the motion signals by means of the display module, the image in on the user's head patch state of the carrying device in an image-stabilizing manner so that the user can perceive the image shake-free.
  • the blurring of the recorded images on the image reproduction side of the display device is compensated.
  • the blurred image data is transferred to the image display device, which reproduces the image for the user from these image data and the motion signals so that it can capture it as a still, still image.
  • the support means may be any means adapted to be carried on the head of a user and to which the display module may be attached.
  • the carrying device can be designed as a spectacle-like frame, cap, cap, helmet.
  • the display module comprises a planar, imaging element. This may be self-illuminating imaging element or even an imaging element to be illuminated.
  • an LCD module, an LCoS module or a tilting mirror matrix can be used.
  • the image display device can perform electronic image stabilization.
  • the image data is electronically displaced in accordance with the movement signal, thereby compensating for the blurring due to the movement.
  • an opposite displacement of the image is performed, so that the object contained in the displayed image can then be perceived by the user as a quiet, stationary object.
  • a conditional by the shake rotation of the recorded object can be compensated.
  • the image display device may perform a deep or band pass filtering. This ensures that only unwanted and higher-frequency jitter movements (for example of the head or the hand with which the image recording device is held) are compensated. Normal movements of the head or the hand to change the image section or the like are not affected.
  • the image display device can perform optical image stabilization. This can be done by a suitable movement of the imaging element of the display module or one or more of the imaging element of the display module downstream optical elements. It is possible that part of the image stabilization is already performed by the image pickup device, which is preferably done in response to the motion signals. Thus, a portion of the necessary compensation can be carried out both on the image recording and on the image reproduction side, which leads to very good results.
  • the image recording device can be attached to the carrying device. In this case, dithering movements of the head are compensated with the display device according to the invention.
  • a viewing device can be provided, with which an object can be viewed enlarged.
  • the image recording device and the sensor can also be detachably attached to the carrying device.
  • the senor is attached to the image recording device.
  • the movement of the image pickup device can be extremely accurately detected, so that the compensation can be made with excellent quality.
  • the image display device preferably provides the user with the image to be acquired as a virtual image.
  • the display device is designed so that the object to be viewed enlarged reproduced to the user.
  • the display device can also be designed as a stereoscopic display device.
  • the compensation for the image reproduction for the user's left and right eyes may be the same or different.
  • the image display device can not display an edge of the image when reproducing the captured image. This is used in particular when an electronic image stabilization is performed.
  • the display module may comprise a picture element having an imaging area, wherein an edge area of the imaging area of the picture element is darkened independently of the image data and motion signals. This can be prevented that disturbing movements of the edge of the displayed image can be perceived in the electronic compensation in the edge region.
  • a display method for a display device with a picture display device which comprises a display module attached to a carrying device, which can be placed on the head of a user, in which an object to be viewed is recorded with an image recording device and corresponding image data are generated, one leading to a blurred image capture
  • Movement of the image pickup device detected and corresponding motion signals are generated, and the image display device based on the image data and the
  • Motion signals by means of the display module reproduces the image in the state of the carrying device placed on the head of the user in an image-stabilizing manner so that the user can perceive the image without blur.
  • the display method disturbing camera shake during the image acquisition can be well compensated.
  • the display method can be developed in the same way, the display device.
  • Fig. 1 is a schematic representation of an embodiment of the display device
  • FIG. 2 is an illustration of a portion of a captured video stream
  • FIG. 3 is an illustration of a portion of a video stream to be played
  • Fig. 5 is a representation of the imaging area
  • the display device 1 comprises a helmet-shaped carrying device 2 to which is attached an image display device 3 comprising a control module 4 and a display module 5.
  • the display device 1 comprises an image pickup device which is formed as a conventional video camera, and a movement sensor 9 attached to the image pickup device 8 or the helmet 2, which detects the movements of the helmet 2 and thus the image pickup device 8 attached to the helmet and corresponding movement signals to the Control module 4 transmits.
  • the image recording device 8 in turn transmits the image data of the object to be recorded to the control module 4.
  • the control module 4 provides the image data in a manner to be described in more detail below the display module 5, which generates the image by means of the image unit 6 and the imaging optics 7, which is reflected at a mounted on the helmet 2 mirror 10 so that a helmet carrying user can perceive the generated image as a virtual image.
  • the display module 5 which generates the image by means of the image unit 6 and the imaging optics 7, which is reflected at a mounted on the helmet 2 mirror 10 so that a helmet carrying user can perceive the generated image as a virtual image.
  • an eye 11 is shown here schematically.
  • the beam path from the imaging unit via the imaging optics and the mirror 10 to the eye 11 is designated by the reference numeral 12.
  • Camera 8 is located at different positions in the image. This is shown schematically in Fig. 2, in the three consecutive images A1, A2 and A3 of the video stream of the camera
  • the recorded object 13 (in this case schematically a triangle) is recorded offset in relation to the photographs A1 and A3 downwards and to the right in the figure.
  • the movement of the camera 8 causing this displacement was detected by the motion sensor 9, which transmits corresponding motion signals to the control module 4.
  • the control module 4 processes the image data of the camera 8 in such a way that the image A2 is displayed shifted electronically to the left and above in such a way that the recorded object 13 is at the same position as in the preceding and following photographs A1 and A3.
  • the offset to be displayed is indicated by A2 1 .
  • the display device in particular used as a visual aid, in which an object to be viewed is displayed enlarged. Even with age-related or disease-related head shaking, the object being observed is always stationary to the user.
  • control module performs a suitable low-pass or band-pass filtering in such a way that an image stabilization against undesired dithering is achieved, but still normal head movements are still possible, so that in the usual way by moving the head of the viewed image detail can be changed.
  • the blurred image data of the video camera is transferred to the image reproducing unit, which performs correction only upon reproduction, so that image-stabilized reproduction which is free of blur becomes possible.
  • the display device can be used particularly advantageously in applications in which a user wants to zoom in on an object.
  • this can be advantageously compensated with the described display device.
  • Fig. 5 the imaging area of the image unit 6 is shown alone, wherein a peripheral edge portion 14, which is hatched drawn, is selected so that it corresponds to the maximum image offset due to a maximum expected dither amplitude.
  • This edge region 14 is always scanned dark, regardless of the image data, so that a reduced imaging region 15 of the image unit 6 remains.
  • the user is always presented the image only in the image area 15 and unwanted movements in the edge region 14 are no longer visible.
  • the size of the receptacle A may be greater than the size of the imaging area of the imaging unit 6.
  • the size of the receptacle A is preferably chosen to be much larger than the maximum expected zitter amplitude.
  • This larger area of the shot compared to the imaging area 17 of the image unit 6 is the shaded peripheral edge area 16 shown in FIG. 6.
  • dithering movements at least parts of the edge region 16 enter the imaging region 17 of the imaging unit 6, so that depending on the dithering movement, a certain portion of the edge region 16 is always displayed.
  • the entire imaging area 17 of the image unit 6 is always filled with image information, so that no flickering or other image movements occur at the edge of the imaging area.
  • the compensation can also be performed in the display module 5 itself.
  • one or more elements of the imaging optics 7 can be suitably moved with an actuating element 17, which is controlled by the control module 4.
  • the image unit 6 can be moved.
  • the movement of image unit 6 and imaging optics 7 can also be combined.
  • image stabilization on the image display side can only be partially performed. The other part can then be done on the image acquisition side.
  • the video camera 8 may be mounted correspondingly on the helmet 2, so that certain smaller dithering movements are compensated thereby. It is also possible to move the image recording sensor and / or the recording optics of the video camera 8 in accordance with the signals of the motion sensor 9 in such a way that a certain precompensation takes place during the recording.
  • the carrying device 2 does not necessarily have to be designed as a helmet, but can for example also be realized in the manner of a spectacle frame. Any other training of the support device is possible, provided that it allows attachment or clamping or other fixation of the display module on the user's head.
  • the camera 8 may be a camera of known or constant focal length. From the detected by the sensor 9 angular movement and the known estimated or measured by autofocus distance to the object can be deduced the movement of the recorded object on the sensor surface of the image sensor of the camera 8. It is also possible that the movement of the recorded object on the sensor surface is deduced only from the angular movement detected by means of the sensor 9. This is especially possible if lens and camera sensor parameters are known. On the basis of the shift thus determined, the necessary backlash is determined. This is done by the control module 4.
  • an additional sensor is preferably attached to the lens, with which the instantaneous zoom position is detected.
  • the sensor 9 for detecting the movement of the camera 8 is preferably mechanically connected to the camera 8 and in particular measures rotational movements about two independent axes. All sensors known to those skilled in the art can be used as sensors, which can measure the corresponding rotational movements. In particular, these sensors may have small electronic gyros. Of course, the sensor 9 can also be designed so that it detects linear movements.
  • the sensor 9 need not be attached to the camera 8.
  • the sensor 9 may be formed as a so-called tracker.
  • the display device can be designed as a stereoscopic display device.
  • a separate image recording device 8 and a separate display module 5 are provided for each of the eyes.
  • the right view of the user's left and right eyes can be displayed so that the user obtains a three-dimensional image impression.
  • the compensation of the dithering movement takes place in the same way as described above in connection with FIG.
  • a different compensation is carried out in particular when the distance from the object is so small that the individual views would drift apart by changing the convergence angle.
  • the display device 1 may have further elements, such as e.g. a power supply and the like, which is necessary for the operation of the display device.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
  • Controls And Circuits For Display Device (AREA)
  • Control Of Indicators Other Than Cathode Ray Tubes (AREA)

Abstract

L'invention concerne un système d'affichage qui comprend un dispositif support (2) pouvant être placé sur la tête d'un utilisateur, un dispositif de reproduction d'image (3) comprenant un module d'affichage (5) fixé au dispositif support (2), un dispositif d'acquisition d'image (8) qui acquiert une image d'un objet à observer et qui génère des données d'image correspondantes, ainsi qu'un capteur (9) qui détecte un déplacement du dispositif d'acquisition d'image (8) entraînant une acquisition d'image floue et qui génère des signaux de déplacement correspondants. Selon l'invention, le dispositif support (2) étant placé sur la tête de l'utilisateur, le dispositif de reproduction d'image (3) reproduit l'image d'après les données d'image et les signaux de déplacement au moyen du module d'affichage (5) de façon stabilisée de sorte que l'utilisateur puisse percevoir cette image de manière nette.
PCT/EP2006/005144 2005-06-23 2006-05-30 Systeme et procede d'affichage WO2006136270A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
DE102005029230.5 2005-06-23
DE200510029230 DE102005029230A1 (de) 2005-06-23 2005-06-23 Anzeigevorrichtung und -verfahren

Publications (1)

Publication Number Publication Date
WO2006136270A1 true WO2006136270A1 (fr) 2006-12-28

Family

ID=36636534

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/EP2006/005144 WO2006136270A1 (fr) 2005-06-23 2006-05-30 Systeme et procede d'affichage

Country Status (2)

Country Link
DE (1) DE102005029230A1 (fr)
WO (1) WO2006136270A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2660645A1 (fr) * 2012-05-04 2013-11-06 Sony Computer Entertainment Europe Limited Système dýaffichage à assemblage avec tête

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102009058597B4 (de) 2009-12-17 2012-04-19 Siemens Aktiengesellschaft Bildaufnahmesystem zur Aufnahme und Übertragung digitaler Videobilder, Bilddatenverarbeitungssystem zum Empfangen und Verarbeiten digitaler Bilddaten, Bildstabilisierungssystem und Verfahren zum Generieren verwacklungsarmer digitaler Videobilder
DE102015208738B4 (de) * 2015-05-12 2018-11-08 Volkswagen Aktiengesellschaft Head-up-Display für ein Fahrzeug
DE102017201502B4 (de) 2017-01-31 2022-10-13 Volkswagen Aktiengesellschaft Datenbrille und Verfahren zur Wartung, Instandhaltung, Reparatur oder Herstellung eines Kraftfahrzeugs
DE102019126905A1 (de) * 2019-10-07 2021-04-08 Bayerische Motoren Werke Aktiengesellschaft Verfahren und Vorrichtung zum Betreiben einer Datenbrille

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5777715A (en) * 1997-01-21 1998-07-07 Allen Vision Systems, Inc. Low vision rehabilitation system
US5815411A (en) * 1993-09-10 1998-09-29 Criticom Corporation Electro-optic vision system which exploits position and attitude
US20020101510A1 (en) * 2001-01-31 2002-08-01 Ibm Corporation Image position stabilizer
US6580448B1 (en) * 1995-05-15 2003-06-17 Leica Microsystems Ag Process and device for the parallel capture of visual information
WO2004041078A2 (fr) * 2002-11-08 2004-05-21 Ludwig-Maximilians-Universität Dispositif de prise de vues pour la capture d'images assistee par des mouvements de la tete, et procede de commande de ce dispositif de prise de vues

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4961626A (en) * 1989-02-21 1990-10-09 United Techologies Corporation Direct incorporation of night vision in a helmet mounted display
JP2902966B2 (ja) * 1994-12-16 1999-06-07 三洋電機株式会社 手振れ補正装置およびそれを用いたビデオカメラ
JP3579595B2 (ja) * 1998-09-30 2004-10-20 ペンタックス株式会社 像振れ補正装置

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5815411A (en) * 1993-09-10 1998-09-29 Criticom Corporation Electro-optic vision system which exploits position and attitude
US6580448B1 (en) * 1995-05-15 2003-06-17 Leica Microsystems Ag Process and device for the parallel capture of visual information
US5777715A (en) * 1997-01-21 1998-07-07 Allen Vision Systems, Inc. Low vision rehabilitation system
US20020101510A1 (en) * 2001-01-31 2002-08-01 Ibm Corporation Image position stabilizer
WO2004041078A2 (fr) * 2002-11-08 2004-05-21 Ludwig-Maximilians-Universität Dispositif de prise de vues pour la capture d'images assistee par des mouvements de la tete, et procede de commande de ce dispositif de prise de vues

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2660645A1 (fr) * 2012-05-04 2013-11-06 Sony Computer Entertainment Europe Limited Système dýaffichage à assemblage avec tête

Also Published As

Publication number Publication date
DE102005029230A1 (de) 2007-01-04

Similar Documents

Publication Publication Date Title
EP1669963B1 (fr) Procédé destiné à l'amélioration de la vision d'une personne handicapée de la vue et aide à la vision
DE10251933B4 (de) Aufnahmevorrichtung für die kopfgestützte Bilderfassung und Verfahren zur Steuerung der Aufnahmevorrichtung
DE102006054713B4 (de) Stereoprojektion mit Interferenzfiltern
DE69123926T2 (de) System zum Korrigieren von Kamerazittern
DE19942900B4 (de) Vorrichtung zur Korrektur von Bildfehlern, die durch ein Kameraverwackeln hervorgerufen werden
DE602005001406T2 (de) Am Kopf befestigte Kamera mit Anzeige- und Wählvorrichtung für das Blickfeld
DE60219618T2 (de) Am kopf montierte bildanzeigevorrichtung
DE4212924A1 (de) Stereomikroskop
WO2006136270A1 (fr) Systeme et procede d'affichage
DE102013208306A1 (de) Stereoskopisches Mikroskop
DE69114686T2 (de) Vorrichtung und methode zur stereoskopischen betrachtung von diapositiven und abzügen.
DE102005014759A1 (de) Anzeigevorrichtung und Anzeigeverfahren
DE102005001652A1 (de) Verfahren zum Verarbeiten von aus einem Filmaufnahmestrahlengang einer Laufbildkamera abgezweigten Filmbildern
WO2005098508A2 (fr) Systeme d'enregistrement d'images, systeme de reproduction d'images et systeme d'enregistrement/ reproduction d'images
DE102005025613B3 (de) Elektronische Suchereinrichtung für Photoapparate und Filmkameras
WO2007025661A1 (fr) Procede pour prendre une image et camera a images animees
WO2021175727A1 (fr) Système de visualisation visiocasque
DE102018202707A1 (de) Erzeugung von Panoramabildern
DE102020116397A1 (de) Stabilisierungssteuervorrichtung, Bildaufnahmevorrichtung, und Stabilisierungssteuerverfahren
DE102004004806B4 (de) Elektronische Laufbildkamera
DE102012202957B4 (de) Anzeigevorrichtung
EP1464164A1 (fr) Unite camera video
DE10240826B3 (de) Verfahren zum Betreiben eines Endoskops
DE102020128278A1 (de) Vorrichtung zur Vermeidung oder Minderung einer Parallaxe
DE102005007838A1 (de) Anzeigevorrichtung zur stereoskopischen Darstellung eines Bildes

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application
NENP Non-entry into the national phase

Ref country code: DE

WWW Wipo information: withdrawn in national office

Country of ref document: DE

122 Ep: pct application non-entry in european phase

Ref document number: 06753978

Country of ref document: EP

Kind code of ref document: A1