WO2013030002A1 - Procédé et dispositif de contrôle visuel tridimensionnel d'un élément - Google Patents

Procédé et dispositif de contrôle visuel tridimensionnel d'un élément Download PDF

Info

Publication number
WO2013030002A1
WO2013030002A1 PCT/EP2012/065984 EP2012065984W WO2013030002A1 WO 2013030002 A1 WO2013030002 A1 WO 2013030002A1 EP 2012065984 W EP2012065984 W EP 2012065984W WO 2013030002 A1 WO2013030002 A1 WO 2013030002A1
Authority
WO
WIPO (PCT)
Prior art keywords
dimensional
component
light field
image
data
Prior art date
Application number
PCT/EP2012/065984
Other languages
German (de)
English (en)
Inventor
Thomas Seiffert
Original Assignee
Robert Bosch Gmbh
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Robert Bosch Gmbh filed Critical Robert Bosch Gmbh
Publication of WO2013030002A1 publication Critical patent/WO2013030002A1/fr

Links

Classifications

    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
    • G01B11/00—Measuring arrangements characterised by the use of optical techniques
    • G01B11/24—Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/111—Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation
    • H04N13/117—Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation the virtual viewpoint locations being selected by the viewers or determined by viewer tracking
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/204—Image signal generators using stereoscopic image cameras
    • H04N13/243—Image signal generators using stereoscopic image cameras using three or more 2D image sensors
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2200/00—Indexing scheme for image data processing or generation, in general
    • G06T2200/21—Indexing scheme for image data processing or generation, in general involving computational photography

Definitions

  • the invention relates to a method for the three-dimensional inspection of a component, wherein a 4-dimensional light field of the component is recorded and wherein an image of the component on a for a two-dimensional or three-dimensional
  • the invention further relates to a device for three-dimensional inspection of a component, wherein a first sub-device for detecting a 4-dimensional light field of the component is provided and wherein a second sub-device is provided for a two-dimensional or three-dimensional representation.
  • Technoscopes are used to visually inspect components in hard to reach areas. An image of the point to be inspected is fed via a series of rod lenses or image conductors to a viewing lens, which can be observed by an examiner or a camera. Usually, technoscopes produce a two-dimensional image. Special designs with two image conductors or at least one special image conductor structure can also generate a three-dimensional image of the component to be examined via two cameras.
  • WO 96/01224 describes a video endoscope with two lenses arranged at an angle whose images are fed via a V or a Y-shaped prism to a camera, in which case each image has only half the resolution.
  • a picture of a 4D light field is described in a company brochure by Raytrix.
  • the object is imaged via a lens and an additional microlens array in a so-called plenoptic camera on a two-dimensional CCD sensor.
  • the construction of such a camera is described in the article "T. Adelson, J. Wang: Single lens stereo with a plenoptic camera. IEEE Transactions on Pattern Analysis and Machine Intelligence, pp 99-106, 1992 "
  • Sharpness level can be generated.
  • US 20020030107712 A1 describes a "lightfield display" with which images can be displayed autostereoscopically for a plurality of persons A reproduction of three-dimensional information by means of two images of different polarization and associated spectacles or by means of a mutual representation of two images on a screen and an associated shutter glasses known.
  • three-dimensional representation can take place during an inspection of a component.
  • the object of the invention relating to the method is achieved by generating a two-dimensional or three-dimensional image from a predefinable perspective or an image sequence along a predeterminable trajectory from the data of the 4-dimensional light field in an evaluation step.
  • the method decouples the recording of three-dimensional image information with its information content on the view of a component from two perspectives ("disparity information") of the image reproduction.
  • the viewing of the component can be processed purely digitally and a perspective that seems appropriate to the viewer can subsequently be selected.
  • the 4D light field of another component can already be detected.
  • the perspective or the trajectory is specified by the viewer during the evaluation step, the latter can interactively move in the component or around the component by means of an input device.
  • a 3D input device such as a 3D mouse
  • small changes in perspective can create a three-dimensional impression or at least an idea of the spatial arrangement.
  • the user can also get an idea of the item by interactively driving around the component along a trajectory. This spatial impression arises, as in a simplified form in
  • textures from 2D images are partially applied there to improve the impression on a three-dimensional data record of the environment in addition to the impression of the architectural arrangements in the outer and inner areas, by which one can "move.” the real texture has been recorded from the desired viewing direction, small differences in reflectance, such as, for example, defects, are recorded in the light field and can therefore be viewed retrospectively.
  • a simplified embodiment of the method is characterized in that in the Ausensesch rode the image is presented to the viewer along a predetermined trajectory. In the inspection of similar components so the intervention of the Reduced operator and thus simplified. Furthermore, differences and mistakes are perceived particularly well.
  • a further development of the method provides that in the evaluation step the observer specifies a focal plane and / or a depth of field and, if necessary, adapts it interactively.
  • a 3D input device such as a 3D mouse, can be used. The observer can thus apparently move into the inspection of a bore by choosing the focal plane in this and concentrate by selecting the depth of field on subregions.
  • a third sub-device for generating the two-dimensional or three-dimensional representation from a predefinable perspective or along a predeterminable trajectory from the data of the 4-dimensional light field.
  • the reproduction of the image information does not show the component to be tested during real movements from different views but generates the views from the 4D light field. In a suitably recorded 4D light field, no difference between real motion and later edited view is apparent.
  • Device as a visual inspection device in the inspection of objects to be tested for defects, in particular their surfaces, provided.
  • Three-dimensional rendering such as extra glasses, can be omitted.
  • Control of a 3D playback device such as a monitor with
  • the necessary image files can be provided with the device and the method.
  • Figure 1 is a schematic view of an arrangement for receiving a
  • FIG. 1 shows a schematic representation of an arrangement for receiving a 4D light field 1 1 of an object 10 with a recording device 12.
  • the data from the recording device 12 are transmitted via a first data transmission 13 to a memory device 14 and stored there for later evaluation.
  • the data, or at least the part of the data required in the current evaluation step is transmitted as required via a second data transmission 15 to a 2D image display device 16 and displayed there two-dimensionally as a 2D view 17.
  • the user 21 can enter commands for changing the 2D view 17 via a trajectory input 19 to an operating and arithmetic unit 18 in such a way that he receives 2D views 17 with views of the object 10 along preselectable or predefined trajectories.
  • the necessary data is transmitted from the memory device 14 via the second data transmission 15 to the 2D image display device and displayed there.
  • a 3D reconstruction 20 of the object 10 is created.
  • only data from the memory device 14 has to be used for different 2D views 17 which allow the user 21 to create a 3D reconstruction 20 in his imagination.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)

Abstract

L'invention concerne un procédé d'inspection tridimensionnelle d'un élément, selon lequel un champ lumineux quadridimensionnel de l'élément est enregistré et une image de l'élément est affichée sur un appareil de reproduction prévu pour une représentation bidimensionnelle ou tridimensionnelle. Selon l'invention, au cours d'une étape d'évaluation, le procédé consiste à générer, à partir des données du champ lumineux quadridimensionnel, une image bidimensionnelle ou tridimensionnelle à partir d'une perspective pouvant être prédéfinie ou une séquence d'images le long d'une trajectoire pouvant être prédéfinie. La présente invention concerne en outre un dispositif destiné à la mise en œuvre du procédé. Grâce à la génération des données pour l'observateur à partir des données du champ lumineux quadridimensionnel, le dispositif et le procédé permettent de supprimer des erreurs associées à un étalonnage réciproque des deux canaux d'enregistrement qui est requis pour des enregistrements tridimensionnels. La présente invention permet d'améliorer sensiblement la qualité de reproduction et d'empêcher les éventuelles irritations suscitées chez un observateur par une optique qui ne serait pas correctement ajustée.
PCT/EP2012/065984 2011-09-01 2012-08-16 Procédé et dispositif de contrôle visuel tridimensionnel d'un élément WO2013030002A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
DE102011082021A DE102011082021A1 (de) 2011-09-01 2011-09-01 Verfahren und Vorrichtung zur dreidimensionalen Sichtprüfung eines Bauteils
DE102011082021.3 2011-09-01

Publications (1)

Publication Number Publication Date
WO2013030002A1 true WO2013030002A1 (fr) 2013-03-07

Family

ID=46690510

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/EP2012/065984 WO2013030002A1 (fr) 2011-09-01 2012-08-16 Procédé et dispositif de contrôle visuel tridimensionnel d'un élément

Country Status (2)

Country Link
DE (1) DE102011082021A1 (fr)
WO (1) WO2013030002A1 (fr)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3364174A1 (fr) 2017-02-15 2018-08-22 Christian Koller Systeme d'inspection optique et procede d 'inspection visuelle d'un objet
US10354435B2 (en) 2015-12-23 2019-07-16 Interdigital Ce Patent Holdings Tridimensional rendering with adjustable disparity direction

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1994024601A1 (fr) 1993-04-14 1994-10-27 HEINRICH-HERTZ-INSTITUT FüR NACHRICHTENTECHNIK BERLIN GMBH Dispositif de reproduction
WO1996001224A1 (fr) 1994-07-02 1996-01-18 Mcgill Technology Limited Appareil distributeur
DE19836886C2 (de) 1998-08-14 2002-01-03 Dieter Just Verfahren zur autostereoskopischen Bilderzeugung und Bildwiedergabe
US20030107712A1 (en) 2001-12-11 2003-06-12 New York University Steerable lightfield display

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2011066275A2 (fr) * 2009-11-25 2011-06-03 Massachusetts Institute Of Technology Appareil de prise de vue à champ lumineux à ouverture adressable activement

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1994024601A1 (fr) 1993-04-14 1994-10-27 HEINRICH-HERTZ-INSTITUT FüR NACHRICHTENTECHNIK BERLIN GMBH Dispositif de reproduction
WO1996001224A1 (fr) 1994-07-02 1996-01-18 Mcgill Technology Limited Appareil distributeur
DE19836886C2 (de) 1998-08-14 2002-01-03 Dieter Just Verfahren zur autostereoskopischen Bilderzeugung und Bildwiedergabe
US20030107712A1 (en) 2001-12-11 2003-06-12 New York University Steerable lightfield display

Non-Patent Citations (5)

* Cited by examiner, † Cited by third party
Title
HUAMIN WANG H ET AL: "Space-Time Light Field Rendering", IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, IEEE SERVICE CENTER, LOS ALAMITOS, CA, US, vol. 13, no. 4, 1 July 2007 (2007-07-01), pages 697 - 710, XP011190842, ISSN: 1077-2626, DOI: 10.1109/TVCG.2007.1019 *
ISAKSEN A ET AL: "DYNAMICALLY REPARAMETERIZED LIGHT FIELDS", COMPUTER GRAPHICS. SIGGRAPH 2000 CONFERENCE PROCEEDINGS. NEW ORLEANS, LA, JULY 23 - 28, 2000; [COMPUTER GRAPHICS PROCEEDINGS. SIGGRAPH], NEW YORK, NY : ACM, US, 23 July 2000 (2000-07-23), pages 297 - 306, XP001003568, ISBN: 978-1-58113-208-3, DOI: 10.1145/344779.344929 *
LEVOY M ET AL: "LIGHT FIELD RENDERING", COMPUTER GRAPHICS PROCEEDINGS 1996 (SIGGRAPH). NEW ORLEANS, AUG. 4 - 9, 1996; [COMPUTER GRAPHICS PROCEEDINGS (SIGGRAPH)], NEW YORK, NY : ACM, US, 1 January 1996 (1996-01-01), pages 1 - 12, XP002913619 *
T. ADELSON; J. WANG: "Single lens stereo with a plenoptic camera", IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1992, pages 99 - 106
TAKAHASHI K ET AL: "Layered light-field rendering with focus measurement", SIGNAL PROCESSING. IMAGE COMMUNICATION, ELSEVIER SCIENCE PUBLISHERS, AMSTERDAM, NL, vol. 21, no. 6, 1 July 2006 (2006-07-01), pages 519 - 530, XP027934283, ISSN: 0923-5965, [retrieved on 20060701] *

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10354435B2 (en) 2015-12-23 2019-07-16 Interdigital Ce Patent Holdings Tridimensional rendering with adjustable disparity direction
EP3364174A1 (fr) 2017-02-15 2018-08-22 Christian Koller Systeme d'inspection optique et procede d 'inspection visuelle d'un objet
WO2018149877A1 (fr) 2017-02-15 2018-08-23 Christian Koller Système d'inspection optique et procédé d'inspection optique d'un échantillon d'essai

Also Published As

Publication number Publication date
DE102011082021A1 (de) 2013-03-07

Similar Documents

Publication Publication Date Title
DE102012112322B4 (de) Verfahren zum optischen Abtasten und Vermessen einer Umgebung
KR101237945B1 (ko) 무안경식 디스플레이를 위한 시차 이미지의 특정한 정렬시스템 및 방법
DE102006055641B4 (de) Anordnung und Verfahren zur Aufnahme und Wiedergabe von Bildern einer Szene und/oder eines Objektes
EP2174188B1 (fr) Système de positionnement automatique de caméras accouplées pour représentation en trois dimensions
EP0776576B1 (fr) Procede et dispositif d'affichage d'images video stereoscopiques sur un ecran
DE19640936A1 (de) Positionsadaptiver Autostereoskoper Monitor (PAM)
EP3293558B1 (fr) Dispositif de détection d'une image stéréo
EP1333306A2 (fr) Procédé et dispositif de microscopie stéréoscopique
WO2009149961A1 (fr) Appareil d'observation optique à incrustation multicanal de données
DE102012212801B4 (de) Multifokale Darstellungsvorrichtung und multifokales Darstellungsverfahren zum dreidimensionalen Darstellen eines Objektes
DE102006017003A1 (de) Endoskop zur Tiefendatenakquisition
DE102011104216A1 (de) Verfahren und Vorrichtung zum dreidimensionalen Erfassen von Objekten sowie Computerprogrammprodukt
DE102006060553A1 (de) Verfahren zur Erprobung eines Fahrerassistenzsystems
DE102012106890A1 (de) Dreidimensionale Darstellung von Objekten
JP2005026756A (ja) 立体画像再現歪み出力装置、立体画像再現歪み出力方法および立体画像再現歪み出力プログラム
WO2013030002A1 (fr) Procédé et dispositif de contrôle visuel tridimensionnel d'un élément
DE102010024042B4 (de) Verfahren und Vorrichtung zur Aufnahme von dreidimensionalem Bildmaterial für unterschiedliche Darstellungsgrößen unter Ausnutzung des jeweils vollen Tiefenbudgets
DE102004004806A1 (de) Elektronische Laufbildkamera
EP1300108B1 (fr) Méthode permettant d'obtenir, d'évaluer et d'analyser les sequences de vision
DE102014107185A1 (de) Verfahren zur Bereitstellung eines dreidimensionalen Topographiemodells, Verfahren zur Betrachtung einer Topographiedarstellung eines Topographiemodells, Visualisierungsvorrichtung und Mikroskopiersystem
DE3719329C2 (fr)
DE102012108249A1 (de) Verfahren und Vorrichtung zur Verbesserung der Wiedergabe stereoskopischer Bilder
DE102007055252A1 (de) Verfahren zur Bestimmung der Abstände eines Objekts innerhalb einer Struktur
DE102012102962B3 (de) Verfahren zur Bildaufzeichnung
DE102008022922A1 (de) Vorrichtung und Verfahren zur Erstellung einer 3D Darstellung von einem Objekt

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 12748212

Country of ref document: EP

Kind code of ref document: A1

122 Ep: pct application non-entry in european phase

Ref document number: 12748212

Country of ref document: EP

Kind code of ref document: A1