WO2011011193A1 - Dispositif d'affichage intégré dans un système métrologique tridimensionnel portatif - Google Patents

Dispositif d'affichage intégré dans un système métrologique tridimensionnel portatif Download PDF

Info

Publication number
WO2011011193A1
WO2011011193A1 PCT/US2010/041045 US2010041045W WO2011011193A1 WO 2011011193 A1 WO2011011193 A1 WO 2011011193A1 US 2010041045 W US2010041045 W US 2010041045W WO 2011011193 A1 WO2011011193 A1 WO 2011011193A1
Authority
WO
WIPO (PCT)
Prior art keywords
user
display
manipulated
dimensional
images
Prior art date
Application number
PCT/US2010/041045
Other languages
English (en)
Inventor
Nathan E. Wallace
Timothy I. Fillion
Original Assignee
Dimensional Photonics International, Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Dimensional Photonics International, Inc. filed Critical Dimensional Photonics International, Inc.
Publication of WO2011011193A1 publication Critical patent/WO2011011193A1/fr

Links

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/36—Image-producing devices or illumination devices not otherwise provided for
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61C—DENTISTRY; APPARATUS OR METHODS FOR ORAL OR DENTAL HYGIENE
    • A61C9/00—Impression cups, i.e. impression trays; Impression methods
    • A61C9/004—Means or methods for taking digitized impressions
    • A61C9/0046—Data acquisition means or methods
    • A61C9/0053—Optical means or methods, e.g. scanning the teeth by a laser or light beam
    • A61C9/006—Optical means or methods, e.g. scanning the teeth by a laser or light beam projecting one or more stripes or patterns on the teeth
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H20/00—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance
    • G16H20/40—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance relating to mechanical, radiation or invasive therapies, e.g. surgery, laser therapy, dialysis or acupuncture

Definitions

  • the invention relates to the field of three-dimensional imaging and more specifically to the field of displaying non-contact surface measurement data for dental and medical applications.
  • Conventional systems typically include a handheld camera or scanner connected to a processing unit that communicates with a display monitor.
  • the display monitor presents a variety of information to the user.
  • the information can include control options, acquired images, and operator assistance information such as an indication of an optimal focus condition.
  • This configuration requires the user to look in two directions, that is, to look at the position of the handheld device with respect to the patient and to look at the display monitor to determine that proper images are being acquired.
  • the time and effort to obtain the desired measurement data is adversely affected by the requirement for the user to alternately view the position of the device and view the acquired images.
  • the invention features a method of displaying
  • the method includes acquiring a plurality of two-dimensional (2D) images of a surface of an object with an imaging device manipulated by a user in position relative to the surface of the object and within a field of view of the user.
  • the 2D images are processed to generate three-dimensional surface data for the surface of the object.
  • Measurement data are displayed to the user within the field of view of the user during continued manipulation of the imaging device.
  • the displayed measurement information includes the two-dimensional images acquired by the imaging device and, in another embodiment, the displayed information includes a representation of the 3D surface data.
  • the invention features a user-manipulated imaging device for measuring a 3D surface of an object.
  • the imaging device includes an imager, a device housing, a processor and a display.
  • the imager is configured for acquiring 2D images of a surface of the object.
  • the device housing is coupled to the imager and configured for manipulation by a user to position the imager relative to the surface of the object.
  • the processor communicates with the imager and is configured to generate 3D surface data for the surface based on the 2D images.
  • the display is coupled to the device housing and communicates with at least one of the imager and the processor.
  • the display shows images of the surface observable within a field of view of the user while the device housing is manually positioned within the field of view of the user relative to the surface.
  • the display shows the 2D images of the surface acquired by the imager and, in another embodiment, the display shows a representation of the 3D surface data generated by the processor.
  • DPI-019PC DPI-019PC
  • FIG. 1 illustrates a 3D imaging device that projects a structured light pattern onto an object.
  • FIG. 2 is a flowchart representation of an embodiment of a
  • FIG. 3 illustrates an embodiment of a user-manipulated imaging device according to the invention.
  • FIG. 4A illustrates an embodiment of a user-manipulated imaging device according to the invention and showing a display panel in an open position.
  • FIG. 4B illustrates the user-manipulated imaging device of FIG. 4A showing the display panel in a closed position.
  • the invention relates to a user-manipulated 3D metrology device such as a hand-held camera or scanning device.
  • the device includes an integrated display monitor that provides the user with convenient access to control options, acquired images, and operator assistance indications within a field of view of the user.
  • the location of the operating tip of the device relative to the object being measured can be viewed without the need to redirect the view of the user to DPI-019PC a display monitor.
  • the user positions and aligns the device to a patient while simultaneously viewing a display of the acquired images or data. As a result, measurement data are obtained with less time and operator effort than is required for conventional user-manipulated 3D metrology devices.
  • FIG. 1 shows an example of a 3D imaging system 10 in which the structured light pattern is generated by a projector 14 as a pair of
  • the 3D imaging system 10 may be constructed to operate in accordance with the principles described in U.S. Patent No. 5,870, 191 , titled “Apparatus and Methods for Surface Contour Measurement,” incorporated herein by reference in its entirety.
  • a CCD camera 22 is used to acquire images of the illuminated object 18.
  • the fringe pattern 26 resulting from the interference of the two beams 16 is varied between successive 2D images acquired by the camera 22. For example, the fringes in the fringe pattern 26 can be shifted by changing the phase difference between the two beams 16.
  • DPI-019PC DPI-019PC
  • a processor 30 calculates the distance from the camera 22 to the object surface for each image pixel based on the intensity values for the pixel in the 2D images.
  • the process creates a set of 3D coordinates, that is, a "point cloud," for the object surface.
  • a series of point clouds is acquired while the camera or scanner is in motion relative to the object surface.
  • the imaging system can be a handheld device that a user manually positions relative to the object surface.
  • multiple objects surfaces are measured by moving the device relative to the objects so that surfaces obscured from view of the device in one position are observable by the device in another position.
  • a processor registers the overlapped region of adjacent point clouds, using a 3D correlation technique or other registration technique, to transform each successive point cloud into an initial coordinate space. The successive point clouds are thus "stitched" into a common reference space.
  • the user aligns and positions (step 1 10) the hand-held imaging device relative to the patient while acquiring 2D images of a patient area of interest.
  • the 2D images are processed (step 120) to generate 3D surface data of the area of interest.
  • the user simultaneously observes measurement images in a display while controlling (step 130) the positioning and motion of the handheld imaging device with respect to the patient.
  • the images in the display can be the acquired 2D images.
  • the displayed images can be 3D surface representations generated by processing the acquired 2D images.
  • the 3D surface representations can be 3D wire-mesh
  • Providing a display that is in communication with the processor and mounted to or otherwise integrated with the 3D imaging device permits the user to see the acquired 2D images, 3D surface representation, other display information or
  • Other displayed information can include operator assistance information such as a slide bar shown along the edge of the display to indicate measured position within a usable imaging range, the distance to a surface of the object being measured, and a color box to indicate the current mode of the device, such as idle, preview and scan modes.
  • the display includes a touchscreen that permits the user to input selection data while maintaining the handheld device in proper position relative to the patient.
  • Control options shown on the touchscreen display can include, by way of example, preview, scan and stop function activation "buttons;" save and redo buttons presented at the completion of a scan, and input data buttons.
  • the input data buttons can be used to indicate the jaw to be imaged (upper or lower) or particular teeth to be imaged for a partial jaw scan.
  • the imaging device 34 includes a miniature display 38 similar to the displays typically used in mass-produced cell phones for consumers.
  • the miniature display 38 can be embedded in a side of the device housing 42 and optionally has a viewing surface that is flush with the housing 42.
  • the miniature display 38 may have a 1.8 inch diagonal viewing area.
  • the display is a compact liquid crystal display (LCD). DPI-019PC
  • a display 46 is integral to a panel 50 that is pivotally attached to a side of a device housing 54 for the 3D imaging device 58 shown in FIG. 4A and FIG. 4B.
  • the panel 50 is small enough to be compatible with the overall dimensions of the device 58 and yet include a display 46 that is large enough to present detailed images to the user.
  • the display 46 can have a four inch diagonal viewing area.
  • FIG. 4A shows the panel 50 in an open position in which the user views the displayed images, 3D representations and information.
  • FIG. 4B shows the panel 50 in a closed position such that the panel 50 is substantially parallel and adjacent to the side of the device housing 54.
  • the closed position is intended for when the device 58 is stored or otherwise not in use for extended periods of time.
  • the device according to the invention is generally described as a handheld device; however, the invention also contemplates that the device can be manually adjusted or manipulated by a user without being directly held by hand.

Landscapes

  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Surgery (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Veterinary Medicine (AREA)
  • Public Health (AREA)
  • Animal Behavior & Ethology (AREA)
  • Epidemiology (AREA)
  • Physics & Mathematics (AREA)
  • Dentistry (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Pathology (AREA)
  • Optics & Photonics (AREA)
  • Engineering & Computer Science (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Medical Informatics (AREA)
  • Molecular Biology (AREA)
  • Endoscopes (AREA)
  • Dental Tools And Instruments Or Auxiliary Dental Instruments (AREA)

Abstract

L'invention décrit un dispositif d'imagerie manipulé par l'utilisateur pour mesurer une surface tridimensionnelle d'un objet. Le dispositif comprend un imageur configuré pour acquérir des images bidimensionnelles de la surface et un boîtier de dispositif raccordé à l'imageur et configuré pour le positionnement manuel de l'imageur. Le dispositif comprend également un processeur en communication avec l'imageur et configuré pour générer des données de surface tridimensionnelles sur la base des images bidimensionnelles. Le dispositif comprend également un dispositif d'affichage raccordé au boîtier de dispositif et en communication avec au moins l'un de l'imageur et du processeur. Le dispositif d'affichage affiche des images de la surface et est observable dans un champ de vision de l'utilisateur tandis que le boîtier de dispositif est positionné manuellement dans le champ de vision et par rapport à la surface. Dans plusieurs modes de réalisation, le dispositif d'affichage affiche les images bidimensionnelles et les représentations des données de surface tridimensionnelles.
PCT/US2010/041045 2009-07-21 2010-07-06 Dispositif d'affichage intégré dans un système métrologique tridimensionnel portatif WO2011011193A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US22725509P 2009-07-21 2009-07-21
US61/227,255 2009-07-21

Publications (1)

Publication Number Publication Date
WO2011011193A1 true WO2011011193A1 (fr) 2011-01-27

Family

ID=43499345

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2010/041045 WO2011011193A1 (fr) 2009-07-21 2010-07-06 Dispositif d'affichage intégré dans un système métrologique tridimensionnel portatif

Country Status (1)

Country Link
WO (1) WO2011011193A1 (fr)

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2614768A1 (fr) * 2012-01-13 2013-07-17 Ormco Corporation Système et procédé pour imagerie intra-oral tridimensionnelle
EP2668904A1 (fr) * 2012-05-30 2013-12-04 Ormco Corporation Filtre spectral pour système d'imagerie intraorale
US9286530B2 (en) 2012-07-17 2016-03-15 Cognex Corporation Handheld apparatus for quantifying component features
US9329675B2 (en) 2010-12-06 2016-05-03 3Shape A/S System with 3D user interface integration
WO2019053730A1 (fr) * 2017-09-18 2019-03-21 Dentlytec G.P.L. Ltd Interface utilisateur pour système de mesure dentaire
USRE48221E1 (en) 2010-12-06 2020-09-22 3Shape A/S System with 3D user interface integration
US11368667B2 (en) 2009-06-17 2022-06-21 3Shape A/S Intraoral scanning apparatus
US11701208B2 (en) 2014-02-07 2023-07-18 3Shape A/S Detecting tooth shade

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6438272B1 (en) * 1997-12-31 2002-08-20 The Research Foundation Of State University Of Ny Method and apparatus for three dimensional surface contouring using a digital video projection system
US20050237581A1 (en) * 2004-04-21 2005-10-27 Knighton Mark S Hand held portable three dimensional scanner
US7046286B1 (en) * 1997-12-24 2006-05-16 Canon Kabushiki Kaisha Video camera

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7046286B1 (en) * 1997-12-24 2006-05-16 Canon Kabushiki Kaisha Video camera
US6438272B1 (en) * 1997-12-31 2002-08-20 The Research Foundation Of State University Of Ny Method and apparatus for three dimensional surface contouring using a digital video projection system
US20050237581A1 (en) * 2004-04-21 2005-10-27 Knighton Mark S Hand held portable three dimensional scanner

Cited By (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11671582B2 (en) 2009-06-17 2023-06-06 3Shape A/S Intraoral scanning apparatus
US11368667B2 (en) 2009-06-17 2022-06-21 3Shape A/S Intraoral scanning apparatus
US11831815B2 (en) 2009-06-17 2023-11-28 3Shape A/S Intraoral scanning apparatus
US11539937B2 (en) 2009-06-17 2022-12-27 3Shape A/S Intraoral scanning apparatus
US11622102B2 (en) 2009-06-17 2023-04-04 3Shape A/S Intraoral scanning apparatus
USRE48221E1 (en) 2010-12-06 2020-09-22 3Shape A/S System with 3D user interface integration
US9329675B2 (en) 2010-12-06 2016-05-03 3Shape A/S System with 3D user interface integration
CN103271715A (zh) * 2012-01-13 2013-09-04 奥姆科公司 用于三维口腔内成像的系统和方法
EP2614768A1 (fr) * 2012-01-13 2013-07-17 Ormco Corporation Système et procédé pour imagerie intra-oral tridimensionnelle
EP2668904A1 (fr) * 2012-05-30 2013-12-04 Ormco Corporation Filtre spectral pour système d'imagerie intraorale
US9803975B2 (en) 2012-07-17 2017-10-31 Cognex Corporation Handheld apparatus for quantifying component features
US9286530B2 (en) 2012-07-17 2016-03-15 Cognex Corporation Handheld apparatus for quantifying component features
US11701208B2 (en) 2014-02-07 2023-07-18 3Shape A/S Detecting tooth shade
US11707347B2 (en) 2014-02-07 2023-07-25 3Shape A/S Detecting tooth shade
US11723759B2 (en) 2014-02-07 2023-08-15 3Shape A/S Detecting tooth shade
US11547273B2 (en) 2017-09-18 2023-01-10 Dentlytec G.P.L. Ltd. User interface for a dental measurement system
WO2019053730A1 (fr) * 2017-09-18 2019-03-21 Dentlytec G.P.L. Ltd Interface utilisateur pour système de mesure dentaire

Similar Documents

Publication Publication Date Title
WO2011011193A1 (fr) Dispositif d'affichage intégré dans un système métrologique tridimensionnel portatif
US11539937B2 (en) Intraoral scanning apparatus
US20120281087A1 (en) Three-dimensional scanner for hand-held phones
WO2015026636A1 (fr) Guidage d'inspection en temps réel d'un dispositif de balayage à triangulation
JP5113990B2 (ja) 計測用内視鏡装置
JP2010541058A (ja) 三次元デジタル化方法
US20130172735A1 (en) Optical coherent imaging medical device
Ares Rodríguez et al. Handheld 3D scanning system for in-vivo imaging of skin cancer
JP6799893B2 (ja) 三次元測定装置
JP6722522B2 (ja) 三次元測定装置及びその制御方法
JP6885762B2 (ja) レンズメータ
JP7081941B2 (ja) 三次元形状計測装置及び三次元形状計測方法
EP4379316A1 (fr) Système de mesure fournissant une forme à partir d'un ombrage
JP7389484B2 (ja) 子宮頸がん用診察装置
RU2522840C1 (ru) Способ электронного сканирования пространства
US11399707B2 (en) Endoscope apparatus
JP2018100829A (ja) 対象物の表面を観察または検査するための装置及び方法。

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 10802649

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 10802649

Country of ref document: EP

Kind code of ref document: A1