WO2016025358A1 - Scanner de triangulation à six degrés de liberté et caméra de réalité augmentée - Google Patents

Scanner de triangulation à six degrés de liberté et caméra de réalité augmentée Download PDF

Info

Publication number
WO2016025358A1
WO2016025358A1 PCT/US2015/044409 US2015044409W WO2016025358A1 WO 2016025358 A1 WO2016025358 A1 WO 2016025358A1 US 2015044409 W US2015044409 W US 2015044409W WO 2016025358 A1 WO2016025358 A1 WO 2016025358A1
Authority
WO
WIPO (PCT)
Prior art keywords
camera
light
retroreflector
image
dof
Prior art date
Application number
PCT/US2015/044409
Other languages
English (en)
Inventor
Robert E. Bridges
Original Assignee
Faro Technologies, Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US14/820,665 external-priority patent/US10021379B2/en
Application filed by Faro Technologies, Inc. filed Critical Faro Technologies, Inc.
Priority to GB1701984.5A priority Critical patent/GB2543459A/en
Priority to JP2017508083A priority patent/JP2017524944A/ja
Priority to DE112015003734.9T priority patent/DE112015003734T5/de
Publication of WO2016025358A1 publication Critical patent/WO2016025358A1/fr

Links

Classifications

    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
    • G01B11/00—Measuring arrangements characterised by the use of optical techniques
    • G01B11/002—Measuring arrangements characterised by the use of optical techniques for measuring two or more coordinates
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
    • G01B11/00—Measuring arrangements characterised by the use of optical techniques
    • G01B11/24—Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures
    • G01B11/25—Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures by projecting a pattern, e.g. one or more lines, moiré fringes on the object
    • G01B11/2513—Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures by projecting a pattern, e.g. one or more lines, moiré fringes on the object with several lines being projected in more than one direction, e.g. grids, patterns
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/02—Systems using the reflection of electromagnetic waves other than radio waves
    • G01S17/06—Systems determining position data of a target
    • G01S17/46—Indirect determination of position data
    • G01S17/48—Active triangulation systems, i.e. using the transmission and reflection of electromagnetic waves other than radio waves
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/66—Tracking systems using electromagnetic waves other than radio waves
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/86—Combinations of lidar systems with systems other than lidar, radar or sonar, e.g. with direction finders
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/87—Combinations of systems using electromagnetic waves other than radio waves
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/88—Lidar systems specially adapted for specific applications
    • G01S17/89—Lidar systems specially adapted for specific applications for mapping or imaging
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
    • G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
    • G01S7/4808—Evaluating distance, position or velocity data

Definitions

  • the present disclosure relates to a six degree-of-freedom (six-DOF) triangulation scanner and an integral camera configured to achieve augmented reality (AR).
  • ix-DOF six degree-of-freedom
  • AR augmented reality
  • One set of coordinate measurement devices belongs to a class of instruments that measure the three-dimensional (3D) coordinates of a point by sending a laser beam to the point.
  • the laser beam may impinge directly on the point or on a retroreflector target in contact with the point.
  • the instrument determines the coordinates of the point by measuring the distance and the two angles to the target.
  • the distance is measured with a distance measuring device such as an absolute distance meter or an interferometer.
  • the angles are measured with an angle measuring device such as an angular encoder.
  • a gimbaled beam-steering mechanism within the instrument directs the laser beam to the point of interest.
  • the laser tracker is a particular type of coordinate measuring device that tracks the retroreflector target with one or more laser beams it emits.
  • the laser tracker is thus a "time-of-flight" type of measurement device.
  • Coordinate measuring devices closely related to the laser tracker are the laser scanner and the total station.
  • the laser scanner steps one or more laser beams to points on a surface of an object. It picks up light scattered from the surface and from this light determines the distance and two angles to each point.
  • the total station which is most often used in surveying applications, may be used to measure the coordinates of diffusely scattering or retroreflective targets.
  • the term laser tracker is used in a broad sense to include laser scanners and total stations.
  • the laser tracker sends a laser beam to a retroreflector target.
  • a common type of retroreflector target is the spherically mounted retroreflector (SMR), which comprises a cube-corner retroreflector embedded within a metal sphere.
  • SMR spherically mounted retroreflector
  • the cube-corner retroreflector comprises three mutually perpendicular mirrors. The vertex, which is the common point of intersection of the three mirrors, is located at the center of the sphere.
  • the laser tracker can measure the 3D coordinates of the object surface by following the position of an SMR as it is moved over the surface. Stating this another way, the laser tracker needs to measure only three degrees of freedom (one radial distance and two angles) to fully characterize the 3D coordinates of a surface.
  • One type of laser tracker contains only an interferometer (IFM) without an absolute distance meter (ADM). If an object blocks the path of the laser beam from one of these trackers, the IFM loses its distance reference. The operator must then track the retroreflector to a known location to reset to a reference distance before continuing the measurement. A way around this limitation is to put an ADM in the tracker. The ADM can measure distance in a point-and-shoot manner, as described in more detail below. Some laser trackers contain only an ADM without an interferometer.
  • a gimbal mechanism within the laser tracker may be used to direct a laser beam from the tracker to the SMR. Part of the light retroreflected by the SMR enters the laser tracker and passes onto a position detector.
  • a control system within the laser tracker can use the position of the light on the position detector to adjust the rotation angles of the mechanical axes of the laser tracker to keep the laser beam centered on the SMR. In this way, the tracker is able to follow (track) an SMR that is moved over the surface of an object of interest.
  • Angle measuring devices such as angular encoders are attached to the mechanical axes of the tracker.
  • the one distance measurement and two angle measurements performed by the laser tracker are sufficient to completely specify the three-dimensional location of the SMR at any point on the surface of the object being measured.
  • An alternative to a time-of-flight measurement device such as a laser tracker is a scanning system that determines the 3D coordinates of an object surface based on triangulation principles.
  • Systems such as laser trackers that make use of time-of-flight distance meters in some cases are relatively more accurate than triangulation scanners, but non-contact triangulation scanners may be relatively faster because they typically project a plurality of light spots onto the object surface at each instant in time.
  • a typical triangulation scanner projects either a line of light (e.g., light from a laser line probe) or a two-dimensional (2D) pattern of light over an area (e.g., structured light) onto the object surface.
  • a camera e.g., a CCD or CMOS photosensitive array
  • a projector e.g., a laser light source
  • the projected line or pattern of light emitted from the projector is reflected off of the object surface and imaged by the camera. Since the camera and projector are arranged in a fixed relationship to each other, the distance and angles to the object surface may be determined from the projected line or pattern, the captured camera images and a baseline distance separating the projector and the camera according to trigonometric principles.
  • Triangulation systems provide advantages in quickly acquiring 3D coordinate data over large areas.
  • the triangulation scanner acquires a series of 3D images, which may be registered relative to each other so that the position and orientation of each 3D image relative to the other 3D images is known. If the scanner is stationary, such image registration is not necessary. Similarly, if the triangulation scanner is attached to, or works in conjunction with, a mechanical device having the ability to measure the position and orientation of the triangulation scanner, it is not necessary to provide such image registration. Examples of such mechanical devices include laser trackers, articulated arm coordinate measurement machines (CMMs), and Cartesian CMMs.
  • CCMs articulated arm coordinate measurement machines
  • Cartesian CMMs Cartesian CMMs
  • Augmented reality is a relatively new type of technology that grew out of virtual reality. Augmented reality merges, superimposes, or transprojects actual real-world information or data with, on, into, or onto virtual information or data. That is, the virtual information or data "augments,” compliments or supplements the actual sensed, measured, captured or imaged real- world information or data related to some object or scene to give the user an enhanced view or perception of the real world object or scene.
  • Augmented reality applications include technical or industrial areas such as part, component or device manufacturing and assembly and/or repair and maintenance, and facility, building or structure layout and construction. A number of modern-day AR applications are disclosed at http://en.wikipedia.org/wiki/Augmented_reality.
  • the actual information or data relating to the part, component or device or area may be obtained in various ways using various devices.
  • One type of device includes a coordinate measurement device such as, for example, a CMM or a laser tracker.
  • a camera may also be used to take still or video images of the actual part, component or device, and/or a desired area by itself or that surrounding or associated with the part, component or device.
  • the virtual information or data may be stored artificial information regarding the part, component or device.
  • the stored virtual information or data may be related to the design of the part, component or device ranging from, for example, simple text or symbols to relatively more complex, graphic 3D CAD design data.
  • the stored virtual information or data may also comprise audible or sound information or data.
  • the stored virtual information or data may also relate to information such as textual or part, component or device repair or maintenance instructions, or visual information depicting parts, components or devices that may be used, for example, in the design of an office or manufacturing and/or repair facility (e.g., a building or facility layout).
  • the combined actual and virtual information or data in an AR system is usually digital in nature and may be delivered in real-time (i.e., as the actual information is being measured or sensed) to a user on a display screen that may be in many different types or forms, such as that associated with, for example, a desktop or laptop computer monitor, tablet, smartphone or even a head-mounted display such as those associated with glasses, hats or helmets. Audio information may be delivered through a speaker.
  • a three-dimensional (3D) coordinate measuring system includes a six degree-of-freedom (six-DOF) unit having a unit frame of reference, the unit including a structure, a retroreflector, a triangulation scanner, and an augmented reality (AR) camera, the retroreflector, the triangulation scanner, and the AR camera attached to the structure, the triangulation scanner including a first camera and a projector, the projector configured to project a pattern of light onto an object, the first camera configured to form a first image of the pattern of light on the object, the projector and the first camera configured to cooperate to determine first 3D coordinates of a point on the object in the unit frame of reference, the determination based at least in part on the projected pattern of light and the first image, the AR camera being a color camera configured to obtain a color image in the unit frame of reference.
  • six-DOF six degree-of-freedom
  • AR augmented reality
  • the 3D coordinate measuring system also includes a coordinate measuring device having a device frame of reference, the device configured to measure a pose of the retroreflector in the device frame of reference, wherein the measured pose includes measurements of six degrees-of-freedom of the retroreflector.
  • a three- dimensional (3D) measuring method includes sending a first beam of first light from a coordinate measuring device to a retroreflector in a six degree-of-freedom (six-DOF) unit and receiving a reflected first beam of reflected first light in response, the coordinate measuring device having a device frame of reference, the six-DOF unit having a unit frame of reference, the six-DOF unit including a structure, the retroreflector, a triangulation scanner, and an AR camera, the retroreflector, the triangulation scanner, and the AR camera attached to the structure, the triangulation scanner including a first camera and a projector, the AR camera being a color camera configured to obtain a color image in the unit frame of reference.
  • the method also includes determining by the coordinate measuring device a first pose of the retroreflector based at least in part on the reflected first beam, the determined first pose being measurements of six degrees-of-freedom of the retroreflector in the device frame of reference.
  • the method further includes projecting from the projector a first pattern of light onto an object, forming with the first camera a first image of a reflection of the first pattern of light from the object, and determining with the one or more processors second 3D
  • the method also includes capturing with the AR camera a first color image in the unit frame of reference, and combining with the one or more processors the first 3D coordinates and the first color image in a common frame of reference based at least in part on the determined first pose of the retroreflector.
  • FIG. 1 is a perspective view of a laser tracker system with a retroreflector target in accordance with an embodiment of the present invention
  • FIG. 2 is a perspective view of a laser tracker system with a six-DOF target in accordance with an embodiment of the present invention
  • FIG. 3 is a block diagram describing elements of laser tracker optics and electronics in accordance with an embodiment of the present invention
  • FIG. 4 which includes FIGs. 4A and 4B, shows two types of prior art afocal beam expanders
  • FIG. 5 shows a prior art fiber-optic beam launch
  • FIGs. 6A-D are schematic figures that show four types of prior art position detector assemblies
  • FIGs. 6E and 6F are schematic figures showing position detector assemblies according to embodiments of the present invention.
  • FIG. 7 is a block diagram of electrical and electro-optical elements within a prior art ADM
  • FIGs. 8A and 8B are schematic figures showing fiber-optic elements within a prior art fiber-optic network
  • FIG. 8C is a schematic figure showing fiber-optic elements within a fiberoptic network in accordance with an embodiment of the present invention.
  • FIG. 9 is an exploded view of a prior art laser tracker;
  • FIG. 10 is a cross-sectional view of a prior art laser tracker
  • FIG. 11 is a block diagram of the computing and communication elements of a laser tracker in accordance with an embodiment of the present invention.
  • FIG. 12A is a block diagram of elements in a laser tracker that uses a single wavelength according to an embodiment of the present invention.
  • FIG. 12B is a block diagram of elements in a laser tracker that uses a single wavelength according to an embodiment of the present invention.
  • FIG. 13 is a block diagram of elements in a laser tracker with six-DOF capability according to an embodiment of the present invention.
  • FIG. 14 is a block diagram of elements in a laser tracker having six-DOF capability according to an embodiment of the present invention.
  • FIGs. 15 is a block diagram of elements in a laser tracker having six-DOF capability according to an embodiment of the present invention.
  • FIGs. 15A and 15B are schematic representations illustrating the principles of operation of triangulation based scanning measurement systems.
  • FIG. 16 is a flow chart that includes steps in a method of obtaining a three- dimensional representation of a surface using an augmented reality camera attached to a six- DOF triangulation scanner according to an embodiment of the present invention.
  • An exemplary laser tracker system 5 illustrated in FIG. 1 includes a laser tracker 10, a retroreflector target 26, an optional auxiliary unit processor 50, and an optional auxiliary computer 60.
  • An exemplary gimbaled beam- steering mechanism 12 of laser tracker 10 comprises a zenith carriage 14 mounted on an azimuth base 16 and rotated about an azimuth axis 20.
  • a payload 15 is mounted on the zenith carriage 14 and rotated about a zenith axis 18.
  • Zenith axis 18 and azimuth axis 20 intersect orthogonally, internally to tracker 10, at gimbal point 22, which is typically the origin for distance measurements.
  • a laser beam 46 virtually passes through the gimbal point 22 and is pointed orthogonal to zenith axis 18.
  • laser beam 46 lies in a plane approximately perpendicular to the zenith axis 18 and that passes through the azimuth axis 20.
  • Outgoing laser beam 46 is pointed in the desired direction by rotation of payload 15 about zenith axis 18 and by rotation of zenith carriage 14 about azimuth axis 20.
  • a zenith angular encoder, internal to the tracker, is attached to a zenith mechanical axis aligned to the zenith axis 18.
  • An azimuth angular encoder internal to the tracker, is attached to an azimuth mechanical axis aligned to the azimuth axis 20.
  • the zenith and azimuth angular encoders measure the zenith and azimuth angles of rotation to relatively high accuracy.
  • Outgoing laser beam 46 travels to the retroreflector target 26, which might be, for example, a spherically mounted retroreflector (SMR) as described above.
  • SMR spherically mounted retroreflector
  • Outgoing laser beam 46 may include one or more laser wavelengths, as described hereinafter.
  • a steering mechanism of the sort shown in FIG. 1 is assumed in the following discussion. However, other types of steering mechanisms are possible. For example, it is possible to reflect a laser beam off a mirror rotated about the azimuth and zenith axes. The techniques described herein are applicable, regardless of the type of steering mechanism.
  • Magnetic nests 17 may be included on the laser tracker for resetting the laser tracker to a "home" position for different sized SMRs - for example, 1.5, 7/8, and 1 ⁇ 2 inch SMRs.
  • An on-tracker retroreflector 19 may be used to reset the tracker to a reference distance.
  • an on-tracker mirror not visible from the view of FIG. 1, may be used in combination with the on-tracker retroreflector to enable performance of a self- compensation, as described in U.S. Patent No. 7,327,446 ('446), the contents of which are incorporated herein by reference.
  • FIG. 2 shows an exemplary laser tracker system 7 that is like the laser tracker system 5 of FIG. 1 except that retroreflector target 26 is replaced with a six-DOF probe 1000.
  • retroreflector target 26 is replaced with a six-DOF probe 1000.
  • other types of retroreflector targets may be used. For example, a cateye
  • retroreflector which is a glass retroreflector in which light focuses to a small spot of light on a reflective rear surface of the glass structure, is sometimes used.
  • FIG. 3 is a block diagram showing optical and electrical elements in a laser tracker embodiment. It shows elements of a laser tracker that emit two wavelengths of light - a first wavelength for an ADM and a second wavelength for a visible pointer and for tracking. The visible pointer enables the user to see the position of the laser beam spot emitted by the tracker. The two different wavelengths are combined using a free- space beam splitter.
  • Electrooptic (EO) system 100 includes visible light source 110, isolator 115, optional first fiber launch 170, optional interferometer (IFM) 120, beam expander 140, first beam splitter 145, position detector assembly 150, second beam splitter 155, ADM 160, and second fiber launch 170.
  • IDM interferometer
  • Visible light source 110 may be a laser, superluminescent diode, or other light emitting device.
  • the isolator 115 may be a Faraday isolator, attenuator, or other device capable of reducing the light that reflects back into the light source.
  • Optional IFM may be configured in a variety of ways. As a specific example of a possible implementation, the IFM may include a beam splitter 122, a retroreflector 126, quarter waveplates 124, 130, and a phase analyzer 128.
  • the visible light source 110 may launch the light into free space, the light then traveling in free space through the isolator 115, and optional IFM 120.
  • the isolator 115 may be coupled to the visible light source 110 by a fiber optic cable.
  • the light from the isolator may be launched into free space through the first fiber-optic launch 170, as discussed hereinbelow with reference to FIG. 5.
  • Beam expander 140 may be set up using a variety of lens configurations, but two commonly used prior-art configurations are shown in FIGs. 4A and 4B.
  • FIG. 4A shows a configuration 140A based on the use of a negative lens 141A and a positive lens 142A.
  • a beam of collimated light 220A incident on the negative lens 141A emerges from the positive lens 142A as a larger beam of collimated light 230A.
  • FIG. 4B shows a configuration 140B based on the use of two positive lenses 141B, 142B.
  • a beam of collimated light 220B incident on a first positive lens 141B emerges from a second positive lens 142B as a larger beam of collimated light 230B.
  • a small amount reflects off the beam splitters 145, 155 on the way out of the tracker and is lost. That part of the light that passes through the beam splitter 155 is combined with light from the ADM 160 to form a composite beam of light 188 that leaves that laser tracker and travels to the retroreflector 90.
  • the ADM 160 includes a light source 162, ADM
  • optical fibers 168, 169, 184, 186 interconnecting optical fibers 168, 169, 184, 186.
  • ADM electronics send electrical modulation and bias voltages to light source 162, which may, for example, be a distributed feedback laser that operates at a wavelength of approximately 1550 nm.
  • the fiber network 166 may be the prior art fiber-optic network 420A shown in FIG. 8 A.
  • light from the light source 162 in FIG. 3 travels over the optical fiber 184, which is equivalent to the optical fiber 432 in FIG. 8A.
  • the fiber network of FIG. 8A includes a first fiber coupler 430, a second fiber coupler 436, and low-transmission reflectors 435, 440.
  • the light travels through the first fiber coupler 430 and splits between two paths, the first path through optical fiber 433 to the second fiber coupler 436 and the second path through optical fiber 422 and fiber length equalizer 423.
  • Fiber length equalizer 423 connects to fiber length 168 in FIG. 3, which travels to the reference channel of the ADM electronics 164.
  • the purpose of fiber length equalizer 423 is to match the length of optical fibers traversed by light in the reference channel to the length of optical fibers traversed by light in the measure channel.
  • Matching the fiber lengths in this way reduces ADM errors caused by changes in the ambient temperature. Such errors may arise because the effective optical path length of an optical fiber is equal to the average index of refraction of the optical fiber times the length of the fiber. Since the index of refraction of the optical fibers depends on the temperature of the fiber, a change in the temperature of the optical fibers causes changes in the effective optical path lengths of the measure and reference channels. If the effective optical path length of the optical fiber in the measure channel changes relative to the effective optical path length of the optical fiber in the reference channel, the result will be an apparent shift in the position of the retroreflector target 90, even if the retroreflector target 90 is kept stationary. To get around this problem, two steps are taken.
  • the length of the fiber in the reference channel is matched, as nearly as possible, to the length of the fiber in the measure channel.
  • the measure and reference fibers are routed side by side to the extent possible to ensure that the optical fibers in the two channels see nearly the same changes in temperature.
  • the light travels through the second fiber optic coupler 436 and splits into two paths, the first path to the low-reflection fiber terminator 440 and the second path to optical fiber 438, from which it travels to optical fiber 186 in FIG. 3.
  • the light on optical fiber 186 travels through to the second fiber launch 170.
  • fiber launch 170 is shown in prior art FIG. 5.
  • the light from optical fiber 186 of FIG. 3 goes to fiber 172 in FIG. 5.
  • the fiber launch 170 includes optical fiber 172, ferrule 174, and lens 176.
  • the optical fiber 172 is attached to ferrule 174, which is stably attached to a structure within the laser tracker 10. If desired, the end of the optical fiber may be polished at an angle to reduce back reflections.
  • the light 250 emerges from the core of the fiber, which may be a single mode optical fiber with a diameter of between 4 and 12 micrometers, depending on the wavelength of the light being used and the particular type of optical fiber.
  • the light 250 diverges at an angle and intercepts lens 176, which collimates it.
  • the beam splitter 155 may be a dichroic beam splitter, which transmits different wavelengths than it reflects.
  • the light from the ADM 160 reflects off dichroic beam splitter 155 and combines with the light from the visible laser 110, which is transmitted through the dichroic beam splitter 155.
  • the composite beam of light 188 travels out of the laser tracker to retroreflector 90 as a first beam, which returns a portion of the light as a second beam. That portion of the second beam that is at the ADM wavelength reflects off the dichroic beam splitter 155 and returns to the second fiber launch 170, which couples the light back into the optical fiber 186.
  • the optical fiber 186 corresponds to the optical fiber 438 in FIG. 8A.
  • the returning light travels from optical fiber 438 through the second fiber coupler 436 and splits between two paths.
  • a first path leads to optical fiber 424 that, in an embodiment, corresponds to optical fiber 169 that leads to the measure channel of the ADM electronics 164 in FIG. 3.
  • a second path leads to optical fiber 433 and then to the first fiber coupler 430.
  • the light leaving the first fiber coupler 430 splits between two paths, a first path to the optical fiber 432 and a second path to the low reflectance termination 435.
  • optical fiber 432 corresponds to the optical fiber 184, which leads to the light source 162 in FIG. 3. In most cases, the light source 162 contains a built-in Faraday isolator that minimizes the amount of light that enters the light source from optical fiber 432.
  • ADM electronics 3300 includes a frequency reference 3302, a synthesizer 3304, a measure detector 3306, a reference detector 3308, a measure mixer 3310, a reference mixer 3312, conditioning electronics 3314, 3316, 3318, 3320, a divide-by-N prescaler 3324, and an analog-to-digital converter (ADC) 3322.
  • ADC analog-to-digital converter
  • the frequency reference which might be an oven-controlled crystal oscillator (OCXO), for example, sends a reference frequency fREF ? which might be 10 MHz, for example, to the synthesizer, which generates two electrical signals - one signal at a frequency f ⁇ and two signals at frequency f L o-
  • the signal f ⁇ goes to the light source 3102, which corresponds to the light source 162 in FIG. 3.
  • the two signals at frequency fi > go to the measure mixer 3310 and the reference mixer 3312.
  • the light from optical fibers 168, 169 in FIG. 3 appear on fibers 3232, 3230 in FIG. 7, respectively, and enter the reference and measure channels, respectively.
  • Reference detector 3308 and measure detector 3306 convert the optical signals into electrical signals.
  • These signals are conditioned by electrical components 3316, 3314, respectively, and are sent to mixers 3312, 3310, respectively.
  • the mixers produce a frequency % equal to the absolute value of fi£> - fRF-
  • the signal may be a relatively high frequency, for example, 2 GHz, while the signal fjp may have a relatively low frequency, for example, 10 kHz.
  • the reference frequency fjyj is sent to the prescaler 3324, which divides the frequency by an integer value. For example, a frequency of 10 MHz might be divided by 40 to obtain an output frequency of 250 kHz. In this example, the 10 kHz signals entering the ADC 3322 would be sampled at a rate of 250 kHz, thereby producing 25 samples per cycle.
  • the signals from the ADC 3322 are sent to a data processor 3400, which might, for example, be one or more digital signal processor (DSP) units located in ADM electronics 164 of FIG. 3.
  • DSP digital signal processor
  • the method for extracting a distance is based on the calculation of phase of the ADC signals for the reference and measure channels. This method is described in detail in U.S. Patent No. 7,701,559 ('559) to Bridges et al., the contents of which are incorporated herein by reference. Calculation includes use of equations (1) - (8) of patent '559.
  • the frequencies generated by the synthesizer are changed some number of times (for example, three times), and the possible ADM distances calculated in each case. By comparing the possible ADM distances for each of the selected frequencies, an ambiguity in the ADM measurement is removed.
  • the part of the return light beam 190 that passes through the beam splitter 155 arrives at the beam splitter 145, which sends part of the light to the beam expander 140 and another part of the light to the position detector assembly 150.
  • the light emerging from the laser tracker 10 or EO system 100 may be thought of as a first beam and the portion of that light reflecting off the retroreflector 90 or 26 as a second beam. Portions of the reflected beam are sent to different functional elements of the EO system 100. For example, a first portion may be sent to a distance meter such as an ADM 160 in FIG. 3. A second portion may be sent to a position detector assembly 150. In some cases, a third portion may be sent to other functional units such as an optional interferometer 120.
  • the first portion and the second portion of the second beam are sent to the distance meter and the position detector after reflecting off beam splitters 155 and 145, respectively, it would have been possible to transmit, rather than reflect, the light onto a distance meter or position detector.
  • FIG. 6A depicts the simplest implementation, with the position detector assembly including a position sensor 151 mounted on a circuit board 152 that obtains power from and returns signals to electronics box 350, which may represent electronic processing capability at any location within the laser tracker 10, auxiliary unit 50, or external computer 60.
  • FIG. 6B includes an optical filter 154 that blocks unwanted optical wavelengths from reaching the position sensor 151. The unwanted optical wavelengths may also be blocked, for example, by coating the beam splitter 145 or the surface of the position sensor 151 with an appropriate film.
  • FIG. 6C includes a lens 153 that reduces the size of the beam of light.
  • FIG. 6D includes both an optical filter 154 and a lens 153.
  • FIG. 6E shows a novel position detector assembly that includes an optical conditioner 149E.
  • Optical conditioner contains a lens 153 and may also contain optional wavelength filter 154.
  • it includes at least one of a diffuser 156 and a spatial filter 157.
  • a popular type of retroreflector is the cube-corner
  • One type of cube corner retroreflector is made of three mirrors, each joined at right angles to the other two mirrors. Lines of intersection at which these three mirrors are joined may have a finite thickness in which light is not perfectly reflected back to the tracker. The lines of finite thickness are diffracted as they propagate so that upon reaching the position detector they may not appear exactly the same as at the position detector. However, the diffracted light pattern will generally depart from perfect symmetry. As a result, the light that strikes the position detector 151 may have, for example, dips or rises in optical power (hot spots) in the vicinity of the diffracted lines.
  • the uniformity of the light from the retroreflector may vary from retroreflector to retroreflector and also because the distribution of light on the position detector may vary as the retroreflector is rotated or tilted, it may be advantageous to include a diffuser 156 to improve the smoothness of the light that strikes the position detector 151. It might be argued that, because an ideal position detector should respond to a centroid and an ideal diffuser should spread a spot symmetrically, there should be no effect on the resulting position given by the position detector. However, in practice the diffuser is observed to improve performance of the position detector assembly, probably because the effects of nonlinearities (imperfections) in the position detector 151 and the lens 153.
  • Cube corner retroreflectors made of glass may also produce non-uniform spots of light at the position detector 151. Variations in a spot of light at a position detector may be particularly prominent from light reflected from cube corners in six-DOF targets, as may be understood more clearly from commonly assigned U.S. Patent No. 8,740,396 ('396) to Brown et al., and the aforementioned commonly assigned U.S. Patent No. 4,467,072 ( ⁇ 72) to Cramer et al., the contents of each of which are incorporated herein by reference.
  • the diffuser 156 is a holographic diffuser.
  • a holographic diffuser provides controlled, homogeneous light over a specified diffusing angle.
  • other types of diffusers such as ground glass or "opal" diffusers are used.
  • the purpose of the spatial filter 157 of the position detector assembly 150E is to block ghost beams that may be the result, for example, of unwanted reflections off optical surfaces, from striking the position detector 151.
  • a spatial filter includes a plate 157 that has an aperture. By placing the spatial filter 157 a distance away from the lens equal
  • the returning light 243E passes through the spatial filter when it is near its narrowest - at the waist of the beam.
  • Beams that are traveling at a different angle, for example, as a result of reflection of an optical element strike the spatial filter away from the aperture and are blocked from reaching the position detector 151.
  • An example is shown in FIG. 6E, where an unwanted ghost beam 244E reflects off a surface of the beam splitter 145 and travels to spatial filter 157, where it is blocked. Without the spatial filter, the ghost beam 244E would have intercepted the position detector 151, thereby causing the position of the beam 243E on the position detector 151 to be incorrectly determined. Even a weak ghost beam may significantly change the position of the centroid on the position detector 151 if the ghost beam is located a relatively large distance from the main spot of light.
  • a retroreflector of the sort discussed here, a cube corner or a cateye retroreflector has the property of reflecting a ray of light that enters the retroreflector in a direction parallel to the incident ray.
  • the incident and reflected rays are symmetrically placed about the point of symmetry of the retroreflector.
  • the point of symmetry of the retroreflector is the vertex of the cube corner.
  • the point of symmetry is also the vertex, but one must consider the bending of the light at the glass-air interface in this case.
  • the point of symmetry is the center of the sphere.
  • the point of symmetry is a point lying on the plane and at the spherical center of each hemisphere.
  • the main point is that, for the type of retroreflectors ordinarily used with laser trackers, the light returned by a retroreflector to the tracker is shifted to the other side of the vertex relative to the incident laser beam.
  • This behavior of a retroreflector 90 in FIG. 3 is the basis for the tracking of the retroreflector by the laser tracker.
  • the position sensor has on its surface an ideal retrace point.
  • the ideal retrace point is the point at which a laser beam sent to the point of symmetry of a retroreflector (e.g., the vertex of the cube corner retroreflector in an SMR) will return.
  • the retrace point is near the center of the position sensor. If the laser beam is sent to one side of the retroreflector, it reflects back on the other side and appears off the retrace point on the position sensor. By noting the position of the returning beam of light on the position sensor, the control system of the laser tracker 10 can cause the motors to move the light beam toward the point of symmetry of the retroreflector.
  • the retroreflector If the retroreflector is moved transverse to the tracker at a constant velocity, the light beam at the retroreflector will strike the retroreflector (after transients have settled) a fixed offset distance from the point of symmetry of the retroreflector.
  • the laser tracker makes a correction to account for this offset distance at the retroreflector based on scale factor obtained from controlled measurements and based on the distance from the light beam on the position sensor to the ideal retrace point.
  • the position detector performs two important functions - enabling tracking and correcting measurements to account for the movement of the retroreflector.
  • the position sensor within the position detector may be any type of device capable of measuring a position.
  • the position sensor might be a position sensitive detector or a photosensitive array.
  • the position sensitive detector might be lateral effect detector or a quadrant detector, for example.
  • the photosensitive array might be a CMOS or CCD array, for example.
  • the return light that does not reflect off beam splitter 145 passes through beam expander 140, thereby becoming smaller.
  • the positions of the position detector and the distance meter are reversed so that the light reflected by the beam splitter 145 travels to the distance meter and the light transmitted by the beam splitter travels to the position detector.
  • the light continues through optional IFM, through the isolator and into the visible light source 110.
  • the optical power should be small enough so that it does not destabilize the visible light source 110.
  • the light from visible light source 110 is launched through a beam launch 170 of FIG. 5.
  • the fiber launch may be attached to the output of light source 110 or a fiber optic output of the isolator 115.
  • the fiber network 166 of FIG. 3 is prior art fiber network 420B of FIG. 8B.
  • the optical fibers 184, 186, 168, 169 of FIG. 3 correspond to optical fibers 443, 444, 424, 422 of FIG. 8B.
  • the fiber network of FIG. 8B is like the fiber network of FIG. 8A except that the fiber network of FIG. 8B has a single fiber coupler instead of two fiber couplers.
  • the advantage of FIG. 8B over FIG. 8A is simplicity; however, FIG. 8B is more likely to have unwanted optical back reflections entering the optical fibers 422 and 424.
  • the fiber network 166 of FIG. 3 is fiber network 420C of FIG. 8C.
  • the optical fibers 184, 186, 168, 169 of FIG. 3 correspond to optical fibers 447,
  • the fiber network 420C includes a first fiber coupler 445 and a second fiber coupler 451.
  • the first fiber coupler 445 is a 2 x 2 coupler having two input ports and two output ports. Couplers of this type are usually made by placing two fiber cores in close proximity and then drawing the fibers while heated. In this way, evanescent coupling between the fibers can split off a desired fraction of the light to the adjacent fiber.
  • the second fiber coupler 451 is of the type called a circulator. It has three ports, each having the capability of transmitting or receiving light, but only in the designated direction. For example, the light on optical fiber 448 enters port 453 and is transported toward port 454 as indicated by the arrow. At port 454, light may be transmitted to optical fiber 455. Similarly, light traveling on port 455 may enter port 454 and travel in the direction of the arrow to port
  • the circulator 451 may suffer less losses of optical power than the 2 x 2 coupler.
  • a circulator 451 may be more expensive than a 2 x 2 coupler, and it may experience polarization mode dispersion, which can be problematic in some situations.
  • FIGs. 9 and 10 show exploded and cross sectional views, respectively, of a prior art laser tracker 2100, which is depicted in FIGs. 2 and 3 of the aforementioned patent '983.
  • Azimuth assembly 2110 includes post housing 2112, azimuth encoder assembly 2120, lower and upper azimuth bearings 2114A, 2114B, azimuth motor assembly 2125, azimuth slip ring assembly 2130, and azimuth circuit boards 2135.
  • azimuth encoder assembly 2120 The purpose of azimuth encoder assembly 2120 is to accurately measure the angle of rotation of yoke 2142 with respect to the post housing 2112.
  • Azimuth encoder assembly 2120 includes encoder disk 2121 and read-head assembly 2122.
  • Encoder disk 2121 is attached to the shaft of yoke housing 2142, and read head assembly 2122 is attached to post assembly 2110.
  • Read head assembly 2122 comprises a circuit board onto which one or more read heads are fastened.
  • Laser light sent from read heads reflect off fine grating lines on encoder disk 2121. Reflected light picked up by detectors on encoder read head(s) is processed to find the angle of the rotating encoder disk in relation to the fixed read heads.
  • Azimuth motor assembly 2125 includes azimuth motor rotor 2126 and azimuth motor stator 2127.
  • Azimuth motor rotor comprises permanent magnets attached directly to the shaft of yoke housing 2142.
  • Azimuth motor stator 2127 comprises field windings that generate a prescribed magnetic field. This magnetic field interacts with the magnets of azimuth motor rotor 2126 to produce the desired rotary motion.
  • Azimuth motor stator 2127 is attached to post frame 2112.
  • Azimuth circuit boards 2135 represent one or more circuit boards that provide electrical functions required by azimuth components such as the encoder and motor.
  • Azimuth slip ring assembly 2130 includes outer part 2131 and inner part 2132.
  • wire bundle 2138 emerges from auxiliary unit processor 50.
  • Wire bundle 2138 may carry power to the tracker or signals to and from the tracker. Some of the wires of wire bundle 2138 may be directed to connectors on circuit boards.
  • wires are routed to azimuth circuit board 2135, encoder read head assembly 2122, and azimuth motor assembly 2125.
  • Other wires are routed to inner part 2132 of slip ring assembly 2130.
  • Inner part 2132 is attached to post assembly 2110 and consequently remains stationary.
  • Outer part 2131 is attached to yoke assembly 2140 and consequently rotates with respect to inner part 2132.
  • Slip ring assembly 2130 is designed to permit low impedance electrical contact as outer part 2131 rotates with respect to the inner part 2132.
  • Zenith assembly 2140 comprises yoke housing 2142, zenith encoder assembly 2150, left and right zenith bearings 2144A, 2144B, zenith motor assembly 2155, zenith slip ring assembly 2160, and zenith circuit board 2165.
  • Zenith encoder assembly 2150 The purpose of zenith encoder assembly 2150 is to accurately measure the angle of rotation of payload frame 2172 with respect to yoke housing 2142.
  • Zenith encoder assembly 2150 comprises zenith encoder disk 2151 and zenith read-head assembly 2152.
  • Encoder disk 2151 is attached to payload housing 2142, and read head assembly 2152 is attached to yoke housing 2142.
  • Zenith read head assembly 2152 comprises a circuit board onto which one or more read heads are fastened.
  • Laser light sent from read heads reflect off fine grating lines on encoder disk 2151. Reflected light picked up by detectors on encoder read head(s) is processed to find the angle of the rotating encoder disk in relation to the fixed read heads.
  • Zenith motor assembly 2155 comprises azimuth motor rotor 2156 and azimuth motor stator 2157.
  • Zenith motor rotor 2156 comprises permanent magnets attached directly to the shaft of payload frame 2172.
  • Zenith motor stator 2157 comprises field windings that generate a prescribed magnetic field. This magnetic field interacts with the rotor magnets to produce the desired rotary motion.
  • Zenith motor stator 2157 is attached to yoke frame 2142.
  • Zenith circuit board 2165 represents one or more circuit boards that provide electrical functions required by zenith components such as the encoder and motor.
  • Zenith slip ring assembly 2160 comprises outer part 2161 and inner part 2162.
  • Wire bundle 2168 emerges from azimuth outer slip ring 2131 and may carry power or signals. Some of the wires of wire bundle 2168 may be directed to connectors on circuit board. In the example shown in FIG. 10, wires are routed to zenith circuit board 2165, zenith motor assembly 2150, and encoder read head assembly 2152. Other wires are routed to inner part 2162 of slip ring assembly 2160.
  • Inner part 2162 is attached to yoke frame 2142 and consequently rotates in azimuth angle only, but not in zenith angle.
  • Outer part 2161 is attached to payload frame 2172 and consequently rotates in both zenith and azimuth angles.
  • Slip ring assembly 2160 is designed to permit low impedance electrical contact as outer part 2161 rotates with respect to the inner part 2162.
  • Payload assembly 2170 includes a main optics assembly 2180 and a secondary optics assembly 2190.
  • FIG. 11 is a block diagram depicting a dimensional measurement electronics processing system 1500 that includes a laser tracker electronics processing system 1510, processing systems of peripheral elements 1582, 1584, 1586, computer 1590, and other networked components 1600, represented here as a cloud.
  • Exemplary laser tracker electronics processing system 1510 includes a master processor 1520, payload functions electronics 1530, azimuth encoder electronics 1540, zenith encoder electronics 1550, display and user interface (UI) electronics 1560, removable storage hardware 1565, radio frequency identification (RFID) electronics, and an antenna 1572.
  • UI user interface
  • the payload functions electronics 1530 includes a number of subfunctions including the six-DOF electronics 1531, the camera electronics 1532, the ADM electronics 1533, the position detector (PSD) electronics 1534, and the level electronics 1535. Most of the subfunctions have at least one processor unit, which might be a digital signal processor (DSP) or field programmable gate array (FPGA), for example.
  • the electronics units 1530, 1540, and 1550 are separated as shown because of their location within the laser tracker.
  • the payload functions 1530 are located in the payload 2170 of FIGs. 9 and 10, while the azimuth encoder electronics 1540 is located in the azimuth assembly 2110 and the zenith encoder electronics 1550 is located in the zenith assembly 2140.
  • peripheral devices Many types are possible, but here three such devices are shown: a temperature sensor 1582, a six-DOF probe 1584, and a personal digital assistant, 1586, which might be a smart phone, for example.
  • a triangulation scanner in particular a six-DOF triangulation scanner, such as, for example, a laser line probe (LLP) or an area structured light scanner.
  • LLP laser line probe
  • the laser tracker may communicate with the peripheral devices in a variety of ways, including by wireless communication over the antenna 1572, by a vision system such as a camera, and by distance and angular readings of the laser tracker to a cooperative target such as the six-DOF probe 1584 or triangulation scanner.
  • the peripheral devices may contain processors.
  • the six-DOF accessories may include six-DOF probing systems, six- DOF scanners, six-DOF projectors, six-DOF sensors, and six-DOF indicators.
  • the processors in these six-DOF devices may be used in conjunction with processing devices in the laser tracker as well as an external computer and cloud processing resources.
  • laser tracker processor or measurement device processor it is meant to include possible external computer and cloud support.
  • a separate communications bus goes from the master processor 1520 to each of the electronics units 1530, 1540, 1550, 1560, 1565, and 1570.
  • Each communications line may have, for example, three serial lines that include the data line, clock line, and frame line.
  • the frame line indicates whether or not the electronics unit should pay attention to the clock line. If it indicates that attention should be given, the electronics unit reads the current value of the data line at each clock signal.
  • the clock-signal may correspond, for example, to a rising edge of a clock pulse.
  • information is transmitted over the data line in the form of a packet.
  • each packet includes an address, a numeric value, a data message, and a checksum.
  • the address indicates where, within the electronics unit, the data message is to be directed.
  • the location may, for example, correspond to a processor subroutine within the electronics unit.
  • the numeric value indicates the length of the data message.
  • the data message contains data or instructions for the electronics unit to carry out.
  • the checksum is a numeric value that is used to minimize the chance that errors are transmitted over the communications line.
  • the master processor 1520 sends packets of information over bus 1610 to payload functions electronics 1530, over bus 1611 to azimuth encoder electronics 1540, over bus 1612 to zenith encoder electronics 1550, over bus 1613 to display and UI electronics 1560, over bus 1614 to removable storage hardware 1565, and over bus 1616 to RFID and wireless electronics 1570.
  • master processor 1520 also sends a synch
  • the synch pulse provides a way of synchronizing values collected by the measurement functions of the laser tracker.
  • the azimuth encoder electronics 1540 and the zenith electronics 1550 latch their encoder values as soon as the synch pulse is received.
  • the payload functions electronics 1530 latch the data collected by the electronics contained within the payload.
  • the six-DOF, ADM, and position detector all latch data when the synch pulse is given. In most cases, the camera and inclinometer collect data at a slower rate than the synch pulse rate but may latch data at multiples of the synch pulse period.
  • the azimuth encoder electronics 1540 and zenith encoder electronics 1550 are typically separated from one another and from the payload electronics 1530 by slip rings, for example. This is why the bus lines 1610, 1611, and 1612 are depicted as separate bus lines in FIG. 11.
  • the laser tracker electronics processing system 1510 may communicate with an external computer 1590, or it may provide computation, display, and UI functions within the laser tracker.
  • the laser tracker communicates with computer 1590 over communications link 1606, which might be, for example, an Ethernet line or a wireless connection.
  • the laser tracker may also communicate with other elements 1600, represented by the cloud, over communications link 1602, which might include one or more electrical cables, such as Ethernet cables, and one or more wireless connections.
  • An example of an element 1600 is another three dimensional test instrument - for example, an articulated arm CMM, which may be relocated by the laser tracker.
  • a communication link 1604 between the computer 1590 and the elements 1600 may be wired (e.g., Ethernet) or wireless.
  • An operator sitting on a remote computer 1590 may make a connection to the Internet, represented by the cloud 1600, over an Ethernet or wireless line, which in turn connects to the master processor 1520 over an Ethernet or wireless line. In this way, a user may control the action of a remote laser tracker.
  • the red wavelength may be provided by a frequency stabilized helium-neon (HeNe) laser suitable for use in an interferometer and also for use in providing a red pointer beam.
  • HeNe frequency stabilized helium-neon
  • the red wavelength may be provided by a diode laser that serves just as a pointer beam.
  • Another disadvantage in using two light sources is that it is difficult to perfectly align the two light beams along the entire paths the beams travel. This may result in a variety of problems including inability to simultaneously obtain good performance from different subsystems that operate at different wavelengths.
  • a system that uses a single light source, thereby eliminating these disadvantages, is shown in opto-electronic system 500 of FIG. 12A.
  • FIG. 12A includes a visible light source 110, an isolator 115, a fiber network 420, ADM electronics 530, a fiber launch 170, a beam splitter 145, and a position detector 150.
  • the visible light source 110 might be, for example, a red or green diode laser or a vertical cavity surface emitting laser (VCSEL).
  • the isolator might be a Faraday isolator, an attenuator, or any other device capable of sufficiently reducing the amount of light fed back into the light source.
  • the light from the isolator 115 travels into the fiber network 420, which in an embodiment is the fiber network 420A of FIG. 8A.
  • FIG. 12B shows an embodiment of an optoelectronic system 400 in which a single wavelength of light is used but wherein modulation is achieved by electro-optic modulation of the light rather than by direct modulation of a light source.
  • the optoelectronic system 400 includes a visible light source 110, an isolator 115, an electrooptic modulator 410, ADM electronics 475, a fiber network 420, a fiber launch 170, a beam splitter 145, and a position detector 150.
  • the visible light source 110 may be, for example, a red or green laser diode.
  • Laser light is sent through an isolator 115, which may be a Faraday isolator or an attenuator, for example.
  • the isolator 115 may be fiber coupled at its input and output ports.
  • the isolator 115 sends the light to the electrooptic modulator 410, which modulates the light to a selected frequency, which may be up to 10 GHz or higher if desired.
  • An electrical signal 476 from ADM electronics 475 drives the modulation in the electrooptic modulator 410.
  • the modulated light from the electrooptic modulator 410 travels to the fiber network 420, which might be the fiber network 420A, 420B, 420C, or 420D discussed hereinabove. Some of the light travels over optical fiber 422 to the reference channel of the ADM electronics 475.
  • Another portion of the light travels out of the tracker, reflects off retroreflector 90, returns to the tracker, and arrives at the beam splitter 145. A small amount of the light reflects off the beam splitter and travels to position detector 150, which has been discussed hereinabove with reference to FIGs. 6A-F. A portion of the light passes through the beam splitter 145 into the fiber launch 170, through the fiber network 420 into the optical fiber 424, and into the measure channel of the ADM electronics 475.
  • the system 500 of FIG. 12A can be manufactured for less money than system 400 of FIG. 12B; however, the electro-optic modulator 410 may be able to achieve a higher modulation frequency, which can be advantageous in some situations.
  • FIG. 13 shows an embodiment of a locator camera system 950 and an optoelectronic system 900 in which an orientation camera 910 is combined with the optoelectronic functionality of a 3D laser tracker to measure six degrees of freedom of a device.
  • the optoelectronic system 900 includes a visible light source 905, an isolator 910, an optional electrooptic modulator 410, ADM electronics 715, a fiber network 420, a fiber launch 170, a beam splitter 145, a position detector 150, a beam splitter 922, and an orientation camera 910.
  • the light from the visible light source is emitted in optical fiber 980 and travels through isolator 910, which may have optical fibers coupled on the input and output ports.
  • the light may travel through the electrooptic modulator 410 modulated by an electrical signal 716 from the ADM electronics 715.
  • the ADM electronics 715 may send an electrical signal over cable 717 to modulate the visible light source 905.
  • Some of the light entering the fiber network travels through the fiber length equalizer 423 and the optical fiber 422 to enter the reference channel of the ADM electronics 715.
  • An electrical signal 469 may optionally be applied to the fiber network 420 to provide a switching signal to a fiber optic switch within the fiber network 420.
  • a part of the light travels from the fiber network to the fiber launch 170, which sends the light on the optical fiber into free space as light beam 982. A small amount of the light reflects off the beamsplitter 145 and is lost.
  • the six-DOF device 400 comprises a six-DOF triangulation scanner such as, for example, a laser line probe (LLP) or a structured light area scanner.
  • the six-DOF triangulation scanner has a
  • retroreflector attached thereto to facilitate measuring or determining of the six degrees of freedom of the scanner.
  • the light from the six-DOF device 4000 enters the optoelectronic system 900 and arrives at beamsplitter 922. Part of the light is reflected off the beamsplitter 922 and enters the orientation camera 910.
  • the orientation camera 910 records the positions of some marks placed on the retroreflector target. From these marks, the orientation angle (i.e., three degrees of freedom) of the six-DOF probe device is found. The principles of the orientation camera are described hereinafter in the present application and also in the aforementioned patent '758.
  • a portion of the light at beam splitter 145 travels through the beamsplitter and is put onto an optical fiber by the fiber launch 170. The light travels to fiber network 420. Part of this light travels to optical fiber 424, from which it enters the measure channel of the ADM electronics 715.
  • the locator camera system 950 includes a camera 960 and one or more light sources 970.
  • the locator camera system is also shown with respect to the laser tracker 10 in FIG. 1, where the cameras are elements 52 and the light sources are elements 54.
  • the camera 960 includes a lens system 962, a photosensitive array 964, and a body 966.
  • One use of the locator camera system 950 is to locate retroreflector targets in the work volume. It does this by flashing the light source 970, which the camera picks up as a bright spot on the photosensitive array 964.
  • a second use of the locator camera system 950 is establish a coarse orientation of the six-DOF device 4000 based on the observed location of a reflector spot or LED on the six-DOF device 4000.
  • the direction to each retroreflector target in the work volume may be calculated using the principles of triangulation. If a single locator camera is located to pick up light reflected along the optical axis of the laser tracker, the direction to each retroreflector target may be found. If a single camera is located off the optical axis of the laser tracker, then approximate directions to the retroreflector targets may be immediately obtained from the image on the photosensitive array. In this case, a more accurate direction to a target may be found by rotating the mechanical axes of the laser to more than one direction and observing the change in the spot position on the photosensitive array.
  • FIG. 14 shows an embodiment of a six-DOF probe 2000 used in conjunction with an optoelectronic system 900 and a locator camera system 950 of a laser tracker.
  • the laser tracker may, for example, be any of the laser trackers disclosed and illustrated herein, such as the laser tracker 10 of FIG. 1, or other similar devices not disclosed herein.
  • the optoelectronic system 900 and the locator camera system 950 were discussed in reference to FIG. 13. In another embodiment, the
  • optoelectronic system 900 is replaced by an optoelectronic system having two or more wavelengths of light.
  • the six-DOF probe (or "wand") 2000 which may be handheld in
  • the retroreflector 2010 may be a cube corner retroreflector with a hollow core or a glass core.
  • the retroreflector 2010 may be marked in a way that enables determination by the orientation camera within the optoelectronic system 900 of the laser tracker of the three orientational degrees of freedom of the six-DOF probe 2000 that is physically separate from the laser tracker.
  • An example of such markings is a darkening of the lines of intersection between the three planar reflector surfaces of the retroreflector 2010, as discussed in the aforementioned patent '758.
  • the probe extension assembly 2050 includes a probe extension 2052 and a probe tip 2054.
  • the probe tip 2054 may be a "hard" contact-type probe tip that is typically brought into physical contact with the object under test in order to make 3D coordinate measurements of the surface of the object by determining the 3D coordinates of the probe tip 2054.
  • the probe tip 2054 is connected with yet separated or located from the body 2014 of the retroreflector 2010 by some distance, it is known that a six-DOF laser tracker can readily determine the 3D coordinates of the probe tip 2054 at a point hidden from the line of sight of the light beam 784 sent from the laser tracker to the six-DOF probe 2000. This is why a six-DOF probe is sometimes referred to as a hidden-point probe.
  • Electric power may be provided over an optional electrical cable 2046 or by an optional battery 2044.
  • the electric power provides power to an electronics circuit board 2042.
  • the electronics circuit board 2042 provides power to the antenna 2048, which may communicate with the laser tracker or an external computer, and to actuator buttons 2016, which provide the user with a convenient way of communicating with the laser tracker or external computer.
  • the electronics circuit board 2042 may also provide power to an LED, a material temperature sensor (not shown), an air temperature sensor (not shown), an inertial sensor (not shown) or an inclinometer (not shown).
  • the interface component 2012 may be, for example, a light source (such as an LED), a small retroreflector, a region of reflective material, or a reference mark.
  • the interface component 2012 is used to establish the coarse orientation of the retroreflector 2010, which is needed in the calculations of the six-DOF angle to determine the frame of reference of the six-DOF probe 2000.
  • the identifier element 2049 is used to provide the laser tracker with parameters or a serial number for the six-DOF probe 2000.
  • the identifier element may be, for example, a bar code or an RF identification tag.
  • the laser tracker may alternatively provide the light beam 784 to a retroreflector 2011.
  • the handheld six-DOF probe or wand 2000 may be physically oriented in a wide variety of directions while probing an object with the probing extension assembly 2050.
  • the six degrees of freedom of the probe 2000 measured by the laser tracker may be considered to include three translational degrees of freedom and three orientational degrees of freedom.
  • the three translational degrees of freedom may include a radial distance measurement between the laser tracker and a retroreflector, a first angular measurement, and a second angular measurement.
  • the radial distance measurement may be made with an IFM or an ADM within the laser tracker.
  • the first angular measurement may be made with an azimuth angular measurement device, such as an azimuth angular encoder, and the second angular measurement made with a zenith angular measurement device, such as a zenith angular encoder.
  • the first angular measurement device may be the zenith angular measurement device and the second angular measurement device may be the azimuth angular measurement device.
  • the radial distance, first angular measurement, and second angular measurement constitute three coordinates in a spherical coordinate system, which can be transformed into three coordinates in a Cartesian coordinate system or another coordinate system.
  • the three orientational degrees of freedom of the probe 2000 may be determined using a patterned cube corner, as described hereinabove and in the
  • a method that may be used is to provide a six-DOF laser tracker having a camera that images a collection of light points on a six-DOF tactile probe, while at the same time sending a beam of light to a retroreflector on the six-DOF probe to determine a distance and two angles to the
  • a method that might be used is to provide a six-DOF laser tracker having a retroreflector with an apex partially removed so as to allow light to pass through the apex onto a position detector.
  • the position of the transmitted light on the position detector may be used to determine the pitch and yaw of the retroreflector.
  • the retroreflector may be mounted in a structure that includes a multi-axis inclinometer configured to measure a roll angle of the six-DOF sensor. The combination of the measured roll angle and the measured pitch and yaw angles provides the three orientational degrees of freedom.
  • a laser beam sent to the retroreflector may be used to determine the distance and two angles to the retroreflector, thereby providing the three translational degrees of freedom.
  • the three translational degrees of freedom and the three orientational degrees of freedom fully define the position and orientation of a six-DOF probe such as the six-DOF probe 2000 (and, thus, of the probe tip 2054) in space. It is important to note that this is the case for the systems considered here because it is possible to have systems in which the six degrees of freedom are not independent so that six degrees of freedom are not sufficient to fully define the position and orientation of a device in space.
  • translational set is a shorthand notation for three degrees of translational freedom of a six-DOF accessory (such as the six-DOF probe 2000) in the laser tracker frame of reference.
  • orientational set is a shorthand notation for three orientational degrees of freedom of a six-DOF accessory (e.g., the probe 2000) in the laser tracker frame of reference.
  • surface set is a shorthand notation for three-dimensional coordinates of a point on the object surface in the laser tracker frame of reference as measured by the probe tip 2054.
  • FIG. 15 shows an embodiment of a six-DOF scanner 2500 used in conjunction with an optoelectronic system 900 and a locator camera system 950.
  • the six-DOF scanner 2500 may also be referred to as a "target scanner.”
  • the optoelectronic system 900 and the locator camera system 950 were discussed in reference to FIG. 13.
  • the optoelectronic system 900 is replaced by the optoelectronic system that uses two or more wavelengths of light.
  • the six-DOF scanner 2500 includes a body 2514, one or more retroreflectors 2510, 2511, a scanner camera 2530, a scanner light projector 2520, an optional electrical cable 2546, an optional battery 2444, an interface component 2512, an identifier element 2549, actuator buttons 2516, an antenna 2548, and an electronics circuit board 2542.
  • the one or more retroreflectors 2510, 2511, the scanner camera 2530, and the scanner light projector 2520 are fixed relative to the body 2514.
  • the scanner projector 2520 and the scanner camera 2530 are used to measure the three dimensional coordinates of a workpiece 2528.
  • the camera 2530 includes a camera lens system 2532 and a photosensitive array 2534.
  • the photosensitive array 2534 may be a CCD or CMOS array, for example.
  • the scanner projector 2520 includes a projector lens system 2523 and a source pattern of light 2524.
  • the source pattern of light may emit a point of light, a line of light, or a two dimensional (2D) structured pattern of light, either coded or uncoded, as discussed in more detail hereinafter. If the scanner emits a line of light, the scanner may be referred to as a "laser line probe" (LLP).
  • LLP laser line probe
  • the scanner may be referred to as a "structured light scanner.”
  • the structured light pattern may be one of various patterns such as, for example, those patterns disclosed in the journal article "DLP-Based Structured Light 3D Imaging Technologies and Applications,” by Jason Geng, published in the Proceedings of SPIE, Vol. 7932, which is incorporated herein by reference.
  • a common form of uncoded structured light relies on a striped pattern varying in a periodic manner along one dimension. These types of patterns are usually applied in a sequence to provide an approximate distance to the object. Some uncoded pattern embodiments, such as sinusoidal patterns for example, may provide relatively highly accurate measurements. However, for these types of uncoded patterns to be effective, it is usually necessary for the scanner device and the object to be held stationary relative to each other. Where the scanner device or the object are in motion (relative to the other), then a coded pattern may be used.
  • a coded pattern allows the image to be analyzed using a single acquired image. Some coded patterns may be placed in a particular orientation on the projector pattern (for example, perpendicular to epipolar lines on the projector plane), thereby simplifying analysis of the three-dimensional surface coordinates based on a single image.
  • the light from projector 2520 is reflected from a surface of the workpiece 2528 and the reflected light is received by the camera 2530.
  • variations or features in the workpiece surface such as one or more protrusions for example, create distortions in the structured pattern when the image of the pattern is captured by the camera 2530.
  • a controller Since the pattern is formed by structured light, it is possible in some instances for a controller to determine a one to one correspondence between the pixels in the emitted pattern and the pixels in the imaged pattern. This enables triangulation principals to be used to determine the coordinates of each pixel in the imaged pattern.
  • the collection of 3D coordinates of the workpiece surface is sometimes referred to as a point cloud.
  • a point cloud may be created of the entire work piece 2528.
  • the scanner light source emits a point of light
  • the point may be scanned, for example, with a moving mirror, to produce a line or an array of lines.
  • the scanner light source emits a line of light
  • the line may be scanned, for example, with a moving mirror, to produce an array of lines.
  • the source pattern of light might be an LED, laser, or other light source reflected off a digital micromirror device (DMD) such as a digital light projector (DLP) from Texas Instruments, a liquid crystal device (LCD) or liquid crystal on silicon (LCOS) device, or it may be a similar device used in transmission mode rather than reflection mode.
  • DMD digital micromirror device
  • LCD liquid crystal device
  • LCOS liquid crystal on silicon
  • the source pattern of light might also be a slide pattern, for example, a chrome-on-glass slide, which might have a single pattern or multiple patterns, the slides moved in and out of position as needed.
  • retroreflector 2511 may be added to the first retroreflector 2510 to enable the laser tracker to track the six- DOF scanner from a variety of directions, thereby giving greater flexibility in the directions to which light may be projected by the six-DOF projector 2500.
  • the six-DOF scanner 2500 may be held by hand or mounted, for example, on a tripod, an instrument stand, a motorized carriage, or a robot end effector.
  • the three dimensional coordinates of the workpiece 2528 is measured by the scanner camera 2530 by using the principles of triangulation. There are several ways that the triangulation
  • the measurement may be implemented, depending on the pattern of light emitted by the scanner light source 2520 and the type of photosensitive array 2534. For example, if the pattern of light emitted by the scanner light source 2520 is a line of light or a point of light scanned into the shape of a line and if the photosensitive array 2534 is a two dimensional array, then one dimension of the two dimensional array 2534 corresponds to a direction of a point 2526 on the surface of the workpiece 2528. The other dimension of the two dimensional array 2534 corresponds to the distance of the point 2526 from the scanner light source 2520.
  • the three dimensional coordinates of each point 2526 along the line of light emitted by scanner light source 2520 is known relative to the local frame of reference of the six-DOF scanner 2500.
  • the six degrees of freedom of the six-DOF scanner are known by the six-DOF laser tracker using the methods described in patent '758. From the six degrees of freedom, the three dimensional coordinates of the scanned line of light may be found in the tracker frame of reference, which in turn may be converted into the frame of reference of the workpiece 2528 through the measurement by the laser tracker of three points on the workpiece, for example.
  • a line of laser light emitted by the scanner light source 2520 may be moved in such a way as to "paint" the surface of the workpiece 2528, thereby obtaining the three dimensional coordinates for the entire surface. It is also possible to "paint" the surface of a workpiece using a scanner light source 2520 that emits a structured pattern of light. Alternatively, when using a scanner 2500 that emits a structured pattern of light, more accurate measurements may be made by mounting the six- DOF scanner on a tripod or instrument stand.
  • the structured light pattern emitted by the scanner light source 2520 might, for example, include a pattern of fringes, each fringe having an irradiance that varies sinusoidally over the surface of the workpiece 2528.
  • the sinusoids are shifted by three or more phase values.
  • the amplitude level recorded by each pixel of the camera 2530 for each of the three or more phase values is used to provide the position of each pixel on the sinusoid. This information is used to help determine the three dimensional coordinates of each point 2526.
  • the structured light may be in the form of a coded pattern that may be evaluated to determine three-dimensional coordinates based on single, rather than multiple, image frames collected by the camera 2530. Use of a coded pattern may enable relatively accurate measurements while the six-DOF scanner 2500 is moved by hand at a reasonable speed.
  • a structured light pattern as opposed to a line of light, has some advantages.
  • the density of points may be high along the line but much less between the lines.
  • the spacing of points is usually about the same in each of the two orthogonal directions.
  • the three-dimensional points calculated with a structured light pattern may be more accurate than other methods.
  • a sequence of structured light patterns may be emitted that enable a more accurate calculation than would be possible other methods in which a single pattern was captured (i.e., a single-shot method).
  • An example of a sequence of structured light patterns is one in which a pattern having a first spatial frequency is projected onto the object.
  • the projected pattern is a pattern of stripes that vary sinusoidally in optical power.
  • the phase of the sinusoidally varying pattern is shifted, thereby causing the stripes to shift to the side.
  • the pattern may be made to be projected with three phase angles, each shifted by 120 degrees relative to the previous pattern. This sequence of projections provides enough information to enable relatively accurate
  • the scanning methods represented by FIG. 15 are based on the principle of triangulation. A more complete explanation of the principles of triangulation are given with reference to the system 2560 of FIG. 15 A and the system 4760 of FIG. 15B.
  • the system 2560 includes a projector 2562 and a camera 2564.
  • the projector 2562 includes a source pattern of light 2570 lying on a source plane and a projector lens 2572.
  • the projector lens may include several lens elements.
  • the projector lens has a lens perspective center 2575 and a projector optical axis 2576.
  • the ray of light 2573 travels from a point 2571 on the source pattern of light through the lens perspective center onto the object 2590, which it intercepts at a point 2574.
  • the camera 2564 includes a camera lens 2582 and a photosensitive array 2580.
  • the camera lens 2582 has a lens perspective center 2585 and an optical axis 2586.
  • a ray of light 2583 travels from the object point 2574 through the camera perspective center 2585 and intercepts the photosensitive array 2580 at point 2581.
  • the line segment that connects the perspective centers is the baseline 2588 in FIG. 15A and the baseline 4788 in FIG. 15B.
  • the length of the baseline is called the baseline length (2592, 4792).
  • the angle between the projector optical axis and the baseline is the baseline projector angle (2594, 4794).
  • the angle between the camera optical axis (2583, 4786) and the baseline is the baseline camera angle (2596, 4796).
  • a point on the source pattern of light (2570, 4771) is known to correspond to a point on the photosensitive array (2581, 4781)
  • the baseline length, baseline projector angle, and baseline camera angle it is possible using the baseline length, baseline projector angle, and baseline camera angle to determine the sides of the triangle connecting the points 2585, 2574, and 2575, and hence determine the surface coordinates of points on the surface of object 2590 relative to the frame of reference of the measurement system 2560.
  • a triangulation method such as described in reference to FIG. 15 is used.
  • the angles of the sides of the small triangle between the projector lens 2572 and the source pattern of light 2570 are found using the known distance between the lens 2572 and plane 2570 and the distance between the point 2571 and the intersection of the optical axis 2576 with the plane 2570.
  • the system 4760 is similar to the system 2560 of FIG. 15A except that the system 4760 does not include a lens.
  • the system may include a projector 4762 and a camera 4764.
  • the projector includes a light source 4778 and a light modulator 4770.
  • the light source 4778 may be a laser light source since such a light source may remain in focus for a long distance using the geometry of FIG. 15B.
  • a ray of light 4773 from the light source 4778 strikes the optical modulator 4770 at a point 4771.
  • Other rays of light from the light source 4778 strike the optical modulator at other positions on the modulator surface.
  • the optical modulator 4770 changes the power of the emitted light, in most cases by decreasing the optical power to a degree. In this way, the optical modulator imparts an optical pattern to the light, referred to here as the source pattern of light, which is at the surface of the optical modulator 4770.
  • the optical modulator 4770 may be a DLP or LCOS device for example.
  • the modulator 4770 is transmissive rather than reflective.
  • the light emerging from the optical modulator 4770 appears to emerge from a virtual light perspective center 4775.
  • the ray of light appears to emerge from the virtual light perspective center 4775, pass through the point 4771, and travel to the point 4774 at the surface of object 4790.
  • the baseline is the line segment extending from the camera lens perspective center 4785 to the virtual light perspective center 4775.
  • triangulation involves finding the lengths of the sides of a triangle, for example, the triangle having the vertex points 4774, 4785, and 4775.
  • a way to do this is to find the length of the baseline, the angle between the baseline and the camera optical axis 4786, and the angle between the baseline and the projector reference axis 4776.
  • additional smaller angles are found.
  • the small angle between the camera optical axis 4786 and the ray 4783 can be found by solving for the angle of the small triangle between the camera lens 4782 and the photosensitive array 4780 based on the distance from the lens to the photosensitive array and the distance of the pixel from the camera optical axis.
  • the angle of the small triangle is then added to the angle between the baseline and the camera optical axis to find the desired angle.
  • the angle between the projector reference axis 4776 and the ray 4773 is found can be found by solving for the angle of the small triangle between these two lines based on the known distance of the light source 4777 and the surface of the optical modulation and the distance of the projector pixel at 4771 from the intersection of the reference axis 4776 with the surface of the optical modulator 4770. This angle is subtracted from the angle between the baseline and the projector reference axis to get the desired angle.
  • the camera 4764 includes a camera lens 4782 and a photosensitive array 4780.
  • the camera lens 4782 has a camera lens perspective center 4785 and a camera optical axis 4786.
  • the camera optical axis is an example of a camera reference axis. From a mathematical point of view, any axis that passes through the camera lens perspective center may equally easily be used in the triangulation calculations, but the camera optical axis, which is an axis of symmetry for the lens, is customarily selected.
  • a ray of light 4783 travels from the object point 4774 through the camera perspective center 4785 and intercepts the photosensitive array 4780 at point 4781.
  • Other equivalent mathematical methods may be used to solve for the lengths of the sides of a triangle 4774-4785-4775, as will be clear to one of ordinary skill in the art.
  • Each lens system has an entrance pupil and an exit pupil.
  • the entrance pupil is the point from which the light appears to emerge, when considered from the point of view of first-order optics.
  • the exit pupil is the point from which light appears to emerge in traveling from the lens system to the photosensitive array.
  • the entrance pupil and exit pupil do not necessarily coincide, and the angles of rays with respect to the entrance pupil and exit pupil are not necessarily the same.
  • the model can be simplified by considering the perspective center to be the entrance pupil of the lens and then adjusting the distance from the lens to the source or image plane so that rays continue to travel along straight lines to intercept the source or image plane.
  • a fast measurement method uses a two- dimensional coded pattern in which three-dimensional coordinate data may be obtained in a single shot.
  • coded patterns different characters, different shapes, different thicknesses or sizes, or different colors, for example, may be used to provide distinctive elements, also known as coded elements or coded features. Such features may be used to enable the matching of the point 2571 to the point 2581.
  • a coded feature on the source pattern of light 2570 may be identified on the photosensitive array 2580.
  • Epipolar lines are mathematical lines formed by the intersection of epipolar planes and the source plane 2570 or the image plane 2580.
  • An epipolar plane is any plane that passes through the projector perspective center and the camera perspective center.
  • the epipolar lines on the source plane and image plane may be parallel in some special cases, but in general are not parallel.
  • An aspect of epipolar lines is that a given epipolar line on the projector plane has a corresponding epipolar line on the image plane. Hence, any particular pattern known on an epipolar line in the projector plane may be immediately observed and evaluated in the image plane.
  • a coded pattern is placed along an epipolar line in the projector plane that the spacing between coded elements in the image plane may be determined using the values read out by pixels of the photosensitive array 2580 and this information used to determine the three-dimensional coordinates of an object point 2574. It is also possible to tilt coded patterns at a known angle with respect to an epipolar line and efficiently extract object surface coordinates.
  • An advantage of using coded patterns is that three-dimensional coordinates for object surface points can be quickly obtained.
  • a sequential structured light approach such as the sinusoidal phase-shift approach discussed above, will give more accurate results. Therefore, the user may advantageously choose to measure certain objects or certain object areas or features using different projection methods according to the accuracy desired.
  • a programmable source pattern of light such a selection may easily be made.
  • the six-DOF triangulation scanner 2500 of FIG. 15 also includes an augmented reality (AR) camera 2508.
  • the AR camera 2508 may be considered to be one that is capable of taking "full field" images.
  • the AR camera 2508 includes a camera lens 2502 and a photosensitive array 2504.
  • the photosensitive array 2504 may be a CCD or CMOS array, for example.
  • the AR camera 2508 may be digital in nature, and may take still images or video images.
  • the AR camera 2508 is connected by dashed lines 2506 to the body 2514 of the six-DOF triangulation scanner 2500.
  • the AR camera 2508 may be an integral part of the scanner body 2014.
  • the term "integral" is used to mean that the AR camera 2508 may be
  • the AR camera 2508 is permanently or temporarily attached to the scanner body 2014 such that the AR camera 2508 is in a fixed spatial relationship with respect to the scanner body 2014.
  • the six degrees of freedom (i.e., the "pose") of the AR camera 2508 are also known for each image taken by the AR camera 2508.
  • the laser tracker, six-DOF triangulation scanner 2500, and the AR camera 2508 may all be placed into a common frame of reference.
  • the AR camera is a camera also used in a triangulation measurement.
  • the AR camera is the camera 2530 in FIG. 15.
  • the lens 2502 (which may be a lens system including a plurality of lens elements) is a perspective center of the lens.
  • the rays of light passing through the lens 2502 may be considered to pass through the perspective center before arriving at the photosensitive array 2504.
  • the lens 2502 may be characterized to account for lens aberrations, which result in a slight shift in the intersection positions of the rays on the photosensitive array 2504.
  • the rays pass through the perspective center, with aberration correction to the image provided in another step of image processing.
  • the surface of an object under investigation is imaged by the lens 2502 onto the photosensitive array 2504 to form an image on the collection of pixels that are a part of the photosensitive array 2504.
  • Light falling on each pixel is converted, within an integration period of the camera, from a charge into a digital signal.
  • An analog-to-digital converter either located within the photosensitive array 2504 (for CMOS arrays) or external to the array 2504 (for CCD arrays), performs the conversion from analog to digital signal.
  • the signal for each pixel is typically given in a binary representation of between 8 and 12 bits.
  • the l's and 0's represented by these bits are delivered over parallel channels, and may be converted into serial form using a serializer/deserializer capability for transmission over a bus line.
  • the six-DOF triangulation scanner 2500 is handheld in embodiments of the present invention. However, in other embodiments the scanner 2500 may be kept stationary by placing it on a stationary mount, stand, or fixture; for example a tripod. Further, although the position and orientation of the six-DOF triangulation scanner 2500 are known from the six-DOF measurements made by the laser tracker as described hereinabove and although corrections can be made for movements of a handheld six-DOF scanner 2500, the resulting noise may be somewhat greater than it would have been if the scanner 2500 were kept stationary. It is also possible to mount the six-DOF triangulation scanner 2500 on a robot or machine tool.
  • multiple two-dimensional (2D) camera images taken by an augmented reality camera 2508 that is part of a six-DOF triangulation scanner 2500 are combined or "registered” together according to a method, described hereinbelow, to obtain a three-dimensional (3D) image representation of various real-world features such as, for example, a surface of an object or of some real-world scene (e.g., the inside of a building, the location of a vehicle accident, or a crime scene).
  • This method is based on the fact that because the pose or six degrees of freedom of the scanner 2500 having the integral AR camera 2508 is known for each 2D photograph or image taken by the AR camera 2508, a plurality of the 2D photographic images taken by the AR camera 2508 may be combined together to form a 3D image.
  • 3D image or composite 3D image as used herein is taken to mean a representation of a recorded scene that may be displayed in two dimensions from a variety of perspective viewpoints, with the displayed 2D image changed with the viewpoint in such a way that a 3D representation of the scene is recreated for the observer.
  • values of 3D coordinates may be extracted for points observed in the 3D image.
  • a six-DOF triangulation scanner 2500 and a coordinate measurement device are provided.
  • the six-DOF scanner 2500 also includes the retroreflector 2510 and an integral AR camera 2508, as described hereinabove with respect to FIG. 15.
  • the coordinate measurement device which may comprise a laser tracker such as the laser tracker 5 described hereinabove, has a device frame of reference and is separate from the six-DOF triangulation scanner 2500.
  • the coordinate measurement device includes an orientation sensor, a first and second motor, a first and second angle measuring device, a distance meter, a position detector, a control system, and a processor.
  • the laser tracker and six-DOF scanner with AR camera may be identical or similar to those described and illustrated hereinabove.
  • a step 1610 is, in a first instance, measuring with the device the two angles of rotation and distance to the retroreflector and the three orientational degrees of freedom of the six-DOF triangulation scanner 2500.
  • a 2D image is also formed on the AR camera 2508.
  • the electronics circuit board 2542 within the six-DOF scanner 2500 may process and/or send the position and orientation information from the AR camera 2508.
  • the electronics circuit board 2542 may also receive a first digital signal representing a 2D image sent through the camera lens 2502 onto the photosensitive array 2504.
  • a step 1615 the six-DOF triangulation scanner 2500 is moved to a new position, and the device measures the two angles and distance to the six-DOF scanner 2500 and the orientation of the six-DOF scanner 2500. It also forms a 2D image at the new position.
  • the electronics circuit board 2542 may process and/or send the position and orientation information from the AR camera 2508 at this second position and orientation to the laser tracker.
  • the electronics circuit board 2542 may also receive a second digital signal representing the 2D image sent through the camera lens 2502 onto the photosensitive array 2504.
  • a cardinal point in common to the first image and a second image is found.
  • the term "cardinal point” is typically used to refer to points that are identified in images and that can be used to connect or register the images together. Also, these points are typically not placed intentionally at their locations by someone.
  • the step includes determining the corresponding locations of a cardinal point on a photosensitive array in first and second instances. We may refer to the location of the cardinal point in the first instance as the first location and the location of the cardinal point in the second instance as the second location. There is a well-developed collection of techniques that may be used to determine such cardinal points, generally using methods referred to as image processing or feature detection.
  • an interest point has a mathematically well-founded definition, a well-defined position in space, an image structure around the interest point that is rich in local information content, and a variation in illumination level that is relatively stable over time.
  • a particular example of an interest point is a corner point, which might be a point corresponding to an intersection of three planes, for example.
  • SIFT scale invariant feature transform
  • the processor finds those cardinal points common to the first and second images to obtain at least one cardinal point (but usually a large set of cardinal points).
  • Other common feature detection methods for finding cardinal points include edge detection, blob detection, and ridge detection.
  • a step 1625 is determining the 3D coordinates of the corresponding cardinal points in the first and second 2D images within a first frame of reference. This determination may be made by first using triangulation to determine the 3D coordinates of the cardinal points in the first and second images in the frame of reference of the six-DOF scanner 2500 and then using coordinate transformations to obtain the cardinal points in a first frame of reference, which might be the device frame of reference. These coordinate transformations are based at least in part on the two angle measurements, one distance measurement, and orientation angle measurements provided by the device. It is understood that, in this calculation, the position and orientation of the 2D camera 2508 within the six-DOF scanner 2500 is known, for example, based on factory measurements.
  • a baseline having a baseline distance may be drawn between the perspective centers of the camera in a first instance (corresponding to the first 2D image) and in a second instance (corresponding to the second 2D image). Because the baseline distance is known from six- DOF measurements by the tracker, each cardinal point is determined in 3D space in the first frame of reference. In general, the 3D coordinates of a cardinal point in the first image and the 3D coordinates of a corresponding cardinal point in the second image will not match exactly. However, averaging of the 3D coordinates or similar methods may be used to determine a representative 3D coordinate in the first frame of reference for the corresponding cardinal points in the first and second 2D images.
  • a step 1630 is creating a composite 3D image based at least in part on the first and second 2D images and on the 3D coordinates of the cardinal points in the first frame of reference. In most cases, the first and second 2D images will share many cardinal points, and for each of these 3D coordinates can be obtained. These cardinal points form the framework for a 3D representation onto which other image elements may be interpolated between the two 2D images or among multiple 2D images (in a more general case). Besides providing 3D coordinate information, a composite 3D image may also convey texture and color
  • the 3D coordinates obtained in the step 1625 and 1630 are the same for the corresponding cardinal points in the first and second images; however, the composite 3D image may contain additional 3D information, for example, by interpolation between cardinal points, and by adding color and texture information.
  • a step 1635 is storing the composite 3D image.
  • processors internal to the tracker are used to construct and store the composite 3D image and to combine it with measured 3D coordinates.
  • Such processors may include one or more of master processor 1520, six-DOF processor 1531, and camera processor 1532.
  • a computer 1590 may also be additionally used or used exclusively to construct and store the composite 3D image and to combine it with 3D coordinates obtained from the master processor.
  • a cloud processor may be used by sending raw data to a computer network, possibly a remote computer network, to form the composite 3D image.
  • a different combination of processors may be used. Such a combination of processors may be referred to as a processor system.
  • each cardinal point may correspond to cardinal points on several of the images obtained with the photosensitive array 2504 in different poses of the AR camera 2508.
  • the points of intersection of the multiple lines projected from the photosensitive array 2504 through the perspective centers of the camera lens 2502 may be determined using a best-fit method according to methods of optimization well known in the art, for example, by using least- squares minimization methods. Additional optimization of registration of the multiple images may be carried out, if desired, by providing targets on or near the object under test. Additional targets may be reflective targets or light emitting diodes, for example.
  • the AR camera 2508 is a color camera
  • the reconstructed 3D surface may be represented in color, or other texture attributes may be retrieved.
  • Various features of a light pattern, in addition to a 3D surface profile, may be provided by this method 1600 in other embodiments. For example, an "X" marked on the surface of an object may be retrieved in addition to the general coordinates corresponding to the location of the "X.”
  • an overall shape for a portion of a surface it may be possible to project a captured image onto the surface.
  • the surface has a colored pattern that may be projected onto an assumed surface, which in a particular case might be a flat surface, for example.
  • this pattern may be projected onto the assumed surface from each of images obtained for the AR camera 2508 in different poses (a "pose" being a combination of a three degree-of-freedom position and a three degree-of- freedom orientation).
  • the images would be expected to overlap on the surface. If this is not the case, it would indicate that the assumed shape is not correct, and a change to the shape should be made.
  • it may be a good practice to obtain additional cardinal points based on the images captured by the AR camera 2508 in the different poses. These additional cardinal points may then be used to more accurately determine the surface profile.
  • An AR camera 2508 may be used to capture background images, for example of relatively distant background objects over a relatively large field of view and it may also be used to capture foreground images, which may be, for example, images of an object being scanned by the six-DOF triangulation scanner 2500.
  • the images taken by the AR camera 2508 at various camera positions and orientations are registered together based in part on knowledge of the six degrees of freedom provided by the laser tracker. As such, it is possible to register the 2D images from the AR camera 2508 with proper dimensional scale and with fewer camera images that would otherwise be possible.
  • these images may have data overlaid or superimposed thereon.
  • the data superimposed on the 3D images may comprise CAD design data of the object.
  • the CAD data may be stored in memory associated with the laser tracker 5 (FIG. 1). Other types of data may be
  • An AR camera 2508 in a six-DOF triangulation scanner 2500 may be used to measure surroundings instead of (or in addition to) a part being measured with the scanner 2500.
  • the AR camera 2508 may have a relatively long focal length that enables it to provide a higher resolution image that captures its surroundings in greater detail than the triangulation camera 2530.
  • the AR camera 2508 has a relatively short focal length that enables it to view a wider field-of-view than the triangulation camera 2530. Reconstruction methods described hereinabove may be used to obtain a 3D
  • one or more parts measured to an accuracy of a few micrometers or tens of micrometers with the scanner 2500 may be placed within surroundings measured to an accuracy of a few millimeters based on the AR camera images.
  • Software may be used to observe the object and the surroundings from different perspectives and different distances, with the parallax shift between the object and surroundings properly represented.
  • the background information may be important.
  • a project may involve attaching a structure to the object being measured while confirming that there is adequate room in the 3D surroundings having a 3D image obtained with the AR camera 2508.
  • Such a structure may be available as a CAD model, as a scanned image of a part or assembly, or as a scaled 3D representation obtained through the use of multiple camera images.
  • the AR camera 2508 may be used to obtain representations of areas ordinarily obstructed from view.
  • the AR camera may be used to view all sides of an object to obtain 3D images of regions not easily measured with a scanner 2500. Such full coverage from all directions is particularly useful when images are displayed - for example, in a presentation, on a website, or in a brochure.
  • the addition of color (texture) from the AR camera 2508 also of value in this instance.
  • 3D representations obtained from the AR camera 2508 may be supplemented by other 3D representations. Models of parts, assemblies, furniture, and so forth, may in some cases be downloaded from files or websites and incorporated into a composite 3D representation.
  • a wall may have a left side, a right side, an upper side, and a lower side.
  • the method of matching cardinal points described hereinabove provides scaled 3D images, the dimensional accuracy will generally be much better is 3D coordinates are measured with the six-DOF scanner 2500 than with camera images alone.
  • the scaling accuracy of the composite 3D image can, in many cases, be greatly improved.
  • improved scale of a building may be obtained by measuring one or more positions on each of the left, right, upper, and lower sides with the scanner 2500.
  • the AR camera 2508 may be used to measure only surroundings, only objects, or both surroundings or objects.
  • object means an item for which accurate dimensional information is desired.
  • An object is typically measured by the six-DOF triangulation scanner 2500 which has accuracy on the order of a few tens of micrometers.
  • Measurement by an AR camera 2508 provides the ability to superimpose images on drawings (for example, CAD).
  • drawings for example, CAD
  • An object may be placed within its surroundings, the 3D coordinates of which are obtained through the use of the AR camera 2508. With the information provided by the AR camera and six-DOF triangulation scanner 2500, it is possible to view the objects from a variety of perspectives relative to its surroundings and also to view an object or its surroundings from all directions.
  • a purely graphical element (which could be a photographic element, a drawn element, or a rendered element, for example) is placed within a composite image.
  • a first example of such a graphical element is an addition to a machine tool on a factory floor. Such an addition may be superimposed on a CAD model to which a composite color image is overlaid. The addition might be a new machined part. A collection of such additions may be placed in the context of a factory environment to ensure that all elements fit properly.
  • a second example of such a graphical element is a new item of machinery or furniture placed in the same factory environment. A question might be whether such an element will fit in the new plans.
  • websites may be available that enable downloading of such 3D images from the Cloud, which is a network typically found on the Internet through a service provider.
  • a 3D component may be moved into position with a computer mouse and then viewed from different positions and orientations.

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Electromagnetism (AREA)
  • General Physics & Mathematics (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Length Measuring Devices By Optical Means (AREA)
  • Studio Devices (AREA)

Abstract

La présente invention concerne un système de mesure de coordonnées 3D comprenant une unité à six degrés de liberté comportant un cadre de référence d'unité et comprenant une structure, un rétroréflecteur, un scanner de triangulation et une caméra couleur de réalité augmentée (AR). Le rétroréflecteur, le scanner et la caméra AR sont fixés à la structure. Le scanner comprend une première caméra conçue pour former une première image du motif de lumière projeté sur l'objet par un projecteur. La première caméra et le projecteur sont conçus de façon à coopérer pour déterminer des premières coordonnées 3D d'un point sur l'objet dans le cadre de référence d'unité, la détermination étant basée, au moins en partie, sur le motif de lumière projeté et sur la première image. Le système comprend également un dispositif de mesure de coordonnées comportant un cadre de référence de dispositif et conçu pour mesurer une pose du rétroréflecteur dans le cadre de référence de dispositif, la pose mesurée comprenant des mesures de six degrés de liberté du rétroréflecteur.
PCT/US2015/044409 2014-08-11 2015-08-10 Scanner de triangulation à six degrés de liberté et caméra de réalité augmentée WO2016025358A1 (fr)

Priority Applications (3)

Application Number Priority Date Filing Date Title
GB1701984.5A GB2543459A (en) 2014-08-11 2015-08-10 A six degree-of-freedom triangulation scanner and camera for augmented reality
JP2017508083A JP2017524944A (ja) 2014-08-11 2015-08-10 拡張現実のための６自由度三角計測スキャナとカメラ
DE112015003734.9T DE112015003734T5 (de) 2014-08-11 2015-08-10 Triangulationsscanner mit sechs Freiheitsgraden und Kamera für erweiterte Realität

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US201462035587P 2014-08-11 2014-08-11
US62/035,587 2014-08-11
US14/820,665 2015-08-07
US14/820,665 US10021379B2 (en) 2014-06-12 2015-08-07 Six degree-of-freedom triangulation scanner and camera for augmented reality

Publications (1)

Publication Number Publication Date
WO2016025358A1 true WO2016025358A1 (fr) 2016-02-18

Family

ID=53836913

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2015/044409 WO2016025358A1 (fr) 2014-08-11 2015-08-10 Scanner de triangulation à six degrés de liberté et caméra de réalité augmentée

Country Status (4)

Country Link
JP (1) JP2017524944A (fr)
DE (1) DE112015003734T5 (fr)
GB (1) GB2543459A (fr)
WO (1) WO2016025358A1 (fr)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109238247A (zh) * 2018-07-15 2019-01-18 天津大学 一种面向大空间复杂现场的六自由度测量方法
CN110006339A (zh) * 2019-03-25 2019-07-12 北京卫星制造厂有限公司 一种天线反射器复材模具型面精度在位测量方法及系统

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102017101580A1 (de) 2017-01-26 2018-07-26 Picofine GmbH Messkopf für ein Laserinterferometer und betreffendes Messverfahren
DE102017212973A1 (de) * 2017-07-27 2019-01-31 Friedrich-Alexander-Universität Erlangen - Nürnberg Abstandsmessvorrichtung, Messsystem und Verfahren zur optischen Abstandsmessung
AU2019336263A1 (en) * 2018-09-04 2021-04-08 Fastbrick Ip Pty Ltd Vision system for a robotic machine
JP7112929B2 (ja) * 2018-09-28 2022-08-04 株式会社トプコン 点群データ表示システム
JP7118845B2 (ja) * 2018-10-04 2022-08-16 株式会社トプコン 角度検出システム
JP2021051031A (ja) * 2019-09-26 2021-04-01 株式会社ミツトヨ 測定支援システム

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2011134083A1 (fr) * 2010-04-28 2011-11-03 Ryerson University Système et procédés de rétroaction de guidage peropératoire
US20120257017A1 (en) * 2007-08-10 2012-10-11 Leiga Geosystems Ag Method and surveying system for noncontact coordinate measurement on an object surface
US20130096873A1 (en) * 2011-10-17 2013-04-18 Kla-Tencor Corporation Acquisition of Information for a Construction Site
US20140139639A1 (en) * 2013-01-30 2014-05-22 Qualcomm Incorporated Real-time 3d reconstruction with power efficient depth sensor usage

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103398656B (zh) * 2007-08-10 2016-08-10 莱卡地球系统公开股份有限公司 用于在物体表面上进行非接触坐标测量的方法和勘测系统
EP2568870B1 (fr) * 2010-03-30 2018-05-02 3Shape A/S Balayage de cavités à accessibilité réduite
JP2014516409A (ja) * 2011-04-15 2014-07-10 ファロ テクノロジーズ インコーポレーテッド レーザトラッカの改良位置検出器

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120257017A1 (en) * 2007-08-10 2012-10-11 Leiga Geosystems Ag Method and surveying system for noncontact coordinate measurement on an object surface
WO2011134083A1 (fr) * 2010-04-28 2011-11-03 Ryerson University Système et procédés de rétroaction de guidage peropératoire
US20130096873A1 (en) * 2011-10-17 2013-04-18 Kla-Tencor Corporation Acquisition of Information for a Construction Site
US20140139639A1 (en) * 2013-01-30 2014-05-22 Qualcomm Incorporated Real-time 3d reconstruction with power efficient depth sensor usage

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109238247A (zh) * 2018-07-15 2019-01-18 天津大学 一种面向大空间复杂现场的六自由度测量方法
CN110006339A (zh) * 2019-03-25 2019-07-12 北京卫星制造厂有限公司 一种天线反射器复材模具型面精度在位测量方法及系统
CN110006339B (zh) * 2019-03-25 2021-08-10 北京卫星制造厂有限公司 一种天线反射器复材模具型面精度在位测量方法及系统

Also Published As

Publication number Publication date
GB201701984D0 (en) 2017-03-22
GB2543459A (en) 2017-04-19
JP2017524944A (ja) 2017-08-31
DE112015003734T5 (de) 2017-06-14

Similar Documents

Publication Publication Date Title
US10574963B2 (en) Triangulation scanner and camera for augmented reality
US10021379B2 (en) Six degree-of-freedom triangulation scanner and camera for augmented reality
US10089789B2 (en) Coordinate measuring device with a six degree-of-freedom handheld probe and integrated camera for augmented reality
US9395174B2 (en) Determining retroreflector orientation by optimizing spatial fit
US10302413B2 (en) Six degree-of-freedom laser tracker that cooperates with a remote sensor
US10126415B2 (en) Probe that cooperates with a laser tracker to measure six degrees of freedom
US10082521B2 (en) System for measuring six degrees of freedom
US8902408B2 (en) Laser tracker used with six degree-of-freedom probe having separable spherical retroreflector
US9476695B2 (en) Laser tracker that cooperates with a remote camera bar and coordinate measurement device
WO2016025358A1 (fr) Scanner de triangulation à six degrés de liberté et caméra de réalité augmentée
US20150331159A1 (en) Markings on glass cube-corner retroreflector and method of measuring retroreflector orientation
WO2013173116A1 (fr) Appareil et procédé pour compenser le battement d'un palier dans un appareil de poursuite laser
US20150377604A1 (en) Zoom camera assembly having integrated illuminator
WO2015200746A1 (fr) Marquages sur un rétroréflecteur en coin de cube en verre et procédé de mesure de l'orientation d'un rétroréflecteur

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15750602

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 201701984

Country of ref document: GB

Kind code of ref document: A

Free format text: PCT FILING DATE = 20150810

ENP Entry into the national phase

Ref document number: 2017508083

Country of ref document: JP

Kind code of ref document: A

WWE Wipo information: entry into national phase

Ref document number: 112015003734

Country of ref document: DE

122 Ep: pct application non-entry in european phase

Ref document number: 15750602

Country of ref document: EP

Kind code of ref document: A1