US20040041996A1 - Range finder and method - Google Patents

Range finder and method Download PDF

Info

Publication number
US20040041996A1
US20040041996A1 US10/373,761 US37376103A US2004041996A1 US 20040041996 A1 US20040041996 A1 US 20040041996A1 US 37376103 A US37376103 A US 37376103A US 2004041996 A1 US2004041996 A1 US 2004041996A1
Authority
US
United States
Prior art keywords
camera
stripe pattern
projector
pattern
projected
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US10/373,761
Inventor
Tsutomu Abe
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Fuji Xerox Co Ltd
Original Assignee
Fuji Xerox Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority to JP2002248034 priority Critical
Priority to JP2002-248034 priority
Application filed by Fuji Xerox Co Ltd filed Critical Fuji Xerox Co Ltd
Assigned to FUJI XEROX CO., LTD. reassignment FUJI XEROX CO., LTD. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: ABE, TSUTOMU
Publication of US20040041996A1 publication Critical patent/US20040041996A1/en
Application status is Abandoned legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/50Depth or shape recovery
    • G06T7/55Depth or shape recovery from multiple images
    • G06T7/593Depth or shape recovery from multiple images from stereo images
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01CMEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C11/00Photogrammetry or videogrammetry, e.g. stereogrammetry; Photographic surveying
    • G01C11/04Interpretation of pictures
    • G01C11/06Interpretation of pictures by comparison of two or more pictures of the same area
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01CMEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C3/00Measuring distances in line of sight; Optical rangefinders
    • G01C3/02Details
    • G01C3/06Use of electric means to obtain final indication
    • G01C3/08Use of electric radiation detectors
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/02Systems using the reflection of electromagnetic waves other than radio waves
    • G01S17/06Systems determining position data of a target
    • G01S17/42Simultaneous measurement of distance and other co-ordinates
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/88Lidar systems specially adapted for specific applications
    • G01S17/89Lidar systems specially adapted for specific applications for mapping or imaging
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/50Depth or shape recovery
    • G06T7/521Depth or shape recovery from laser ranging, e.g. using interferometry; from the projection of structured light
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20Image signal generators
    • H04N13/204Image signal generators using stereoscopic image cameras
    • H04N13/254Image signal generators using stereoscopic image cameras in combination with electromagnetic radiation sources for illuminating objects
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20Image signal generators
    • H04N13/261Image signal generators with monoscopic-to-stereoscopic image conversion

Abstract

Pattern projection apparatuses are placed on each other in a stack manner in a stripe pattern direction for projecting the same patterns. An image pickup apparatus (camera 1) is placed between the pattern projection apparatuses. The optical axes of the pattern projection apparatuses and the image pickup apparatus are aligned on the same plane parallel with the stripe pattern direction. On the plane, the principal points also become the same. An image of a stripe pattern is picked up directly by the image pickup apparatus without the intervention of a half mirror, etc., and is recoded. An image of the recoded stripe pattern is picked up by an image pickup apparatus (camera 2) and is decoded and the range of an object is measured by triangulation based on image correspondence points.

Description

  • The present disclosure relates to the subject matter contained in Japanese Patent Application No. 2002-248034 filed on Aug. 28, 2002, which is incorporated herein by reference in its entirety. [0001]
  • BACKGROUND OF THE INVENTION
  • 1. Field of the Invention [0002]
  • The invention relates to a three-dimensional image pickup art based on a triangulation technique for picking up a pattern projection image provided by applying pattern light to a measurement object from different directions by one or a plurality of image pickup device and obtaining a range data based on pattern change. [0003]
  • 2. Description of the Related Art [0004]
  • As a technique of acquiring a three-dimensional shape, active vision and passive vision are available. The active vision includes (1) a technique of emitting laser light or a ultrasonic wave, measuring reflected light amount from an object or arrival time at the object, and extracting depth information, (2) a pattern projection method of using a special pattern light source such as stripe light to estimate an object shape from image information such as geometric change of an object surface pattern, (3) a method of forming contour lines based on moire fringes by optical processing and obtaining three-dimensional information. On the other hand, the passive vision includes monocular stereoscopic viewing for estimating three-dimensional information from one image using knowledge concerning object viewing, light source, lighting, shadow information and the like, and twin-lens stereoscopic viewing for estimating depth information of each pixel based on the triangulation principle. [0005]
  • Generally, the active vision has higher measurement accuracy than the passive vision, but often has a small measurement range because of limit of a light projection device and the like. On the other hand, the passive vision is a general-purpose technique and has less restriction on an object. The invention relates to the pattern projection method of a range finder of the active vision. [0006]
  • In the pattern projection method, reference pattern light is projected onto an object and an image is picked up from a different direction from a projection direction of the reference pattern light. The picked-up pattern image is deformed by the shape of the object. The observed deformation pattern and the projection pattern are related to each other, whereby range finding on the object can be conducted. The pattern projection method involves a problem of how to lessen erroneous correspondence in relating the deformation pattern and the projection pattern to each other and easily relate the deformation pattern and the projection pattern to each other. Then, various pattern projection techniques (space coding method, moire, color coding) have been proposed. [0007]
  • As a typical example of the space coding, a proposition disclosed in JP-A-5-3327375 will be discussed. An apparatus in the example has a laser light source, a lens system, a scanner, a camera, and a controller. The lens system shapes laser light into a slit form. The scanner applies and scans the shaped laser light to and over an object. The camera detects reflected light from the object. The controller controls the components. [0008]
  • Laser light application portions and laser light non-application portions form stripes on the object by the laser light scanned from the scanner. As the laser light is applied according to different patterns, the object is divided into N identifiable portions. It is determined which division portion each pixel of the image of the object picked up by the camera from different positions is contained in, whereby the shape of the object can be calculated. [0009]
  • In the example, to raise the resolution, it becomes necessary to perform laser scanning two or more times and pick up an image by the camera two or more times. For example, when a full screen is divided into 256 regions (256 resolution levels), it becomes necessary to pick up an image eight times. Thus, it becomes difficult to pick up an image of an object moving fast and further the image pickup system needs to be reliably fixed during scanning. Therefore, even if the apparatus itself becomes simple, it is difficult to easily pick up an image. [0010]
  • As a technique for decreasing number of pattern light projection times, a color coding method disclosed in JP-A-3-192474 is available. In the color coding, letting q and k be predetermined natural numbers of two or more, a coded pattern is controlled so that using q or more colors, two adjacent stripe light beams do not become the same color and color alignment produced by k adjacent stripe light beams appears only once. Stripe colors are detected from the observed image. Stripe numbers are acquired from the color alignment of the corresponding stripes. The stripe application directions can be calculated from the stripe numbers and the range data can be calculated as with the example of the space coding. [0011]
  • However, in the color coding, codes are restored from the coding pattern list and thus there is a problem of large calculation amount of restoring the codes. Further, in a case of dividing an area into 256 regions using three colors of R, G, and B, it is necessary to know alignment of eight stripe light beams surrounding the stripe whose code is to be known. Therefore, the color coding suits only for measurement of a shape in which stripes can be continuously long observed. [0012]
  • As a technique for easily restoring stripes and further projecting a coded pattern once, a space coding method disclosed in Japanese Patent No.2565885 is available. In Japanese Patent No.2565885, there are provided three or more kinds of gradation areas using light and shade of a ternary value or more, or three or more colors, or a combination of light and shade with color. Also provided is a multi-valued lattice plate pattern disposed so that at least three kinds of gradation areas contact one another at an intersection point of boundary lines of the gradation areas. Main codes, which conform to the kind and order of gradations, are generated at an intersection point of projected images resulting from projection of pattern to an object to be measured, to touch the intersection point. A combined code obtained by combining the main codes with each other is used as a feature code for identification of the previous intersection point. [0013]
  • However, in the above described system, coding is broken depending on the object to be measured and it may be made impossible to correctly relate codes to each other. Projected pattern row may be recognized with missing pattern row photographed by a camera or an inverted pattern row may be obtained depending on the structure of the photographed object. It becomes difficult to relate because of change in the projected pattern and photographed pattern row depending on the shape of the object, the reflection factor of the object, etc. [0014]
  • In the color coding, this problem is circumvented by using a technique in which decoding is not performed for a pattern having a possibility of loss or inversion of stripe when stripes are grouped at the decoding time. In the space coding method, a two-dimensional pattern is used to decrease the possibility of the error described above, but the same error will occur depending on the object on principle. Therefore, the above-described system can provide excellent accuracy in photographing (image pickup) in special circumstances in a laboratory or in circumstances where the objects are limited, but the accuracy is degraded in general photographing (image pickup) circumstances where the objects are not limited. [0015]
  • The applicant proposed a range finder, which does not depend on the object by feeding back a projected pattern and generating new code (JP-A-2000-9442, JP-A-2000-65542, and U.S. Pat. No. 6,356,298 corresponding to JP-A-2000-65542). The proposition will be discussed below: [0016]
  • FIG. 15 shows the general configuration of a range finder disclosed in JP-A-2000-65542. FIG. 16 shows a positional relationship between a light source and image pickup devices of the range finder. [0017]
  • In the configuration shown in FIG. 16, a range finder includes three cameras [0018] 101 to 103 and a projector 104. Distances 11, 12, and 13 in the figure are made equal so that the distance relationship among the cameras matches. The first camera 101 and the projector 104 are placed so that optical axes match using a half mirror 105 as a beam splitter. The second camera 102 and the third camera 103 are placed on both sides of the first camera 101 and the projector 104 so that the second camera 102 and the third camera 103 differ from the first camera 101 and the projector 104 in optical axis. A distance between the optical axis at the center and that on either side is base line length L.
  • The projector [0019] 104 has a light source 106, a mask pattern 107, a strength pattern 108, and a prism 109. An invisible-region light source using infrared or ultraviolet light can be used as the light source 106. In this case, each camera is configured as shown in FIG. 17. That is, incident light 310 is split in two directions through a prism 301. One is incident on an image pickup apparatus (for example, a CCD camera) 303 through an invisible-region (infrared or ultraviolet) transmission filter 302. The other is incident on an image pickup apparatus 305 through an invisible-region (infrared and ultraviolet) cut-off filter 304.
  • A light source having a wavelength range capable of picking up an image regardless of a visible region or an invisible region may be used as the light source [0020] 106 shown in FIG. 16. In this case, a CCD camera of progressive scan type is used as the first camera 301 and the second camera 102 and the third camera 103 may be of any configuration. However, considering compatibility with the first camera 101, CCD cameras of the same configuration as the first camera 101 are desirable. A pattern is projected from the light source 106 and the three cameras (101 to 103) pick up an image at the same time. Each camera acquires an image in batch by obtaining the light passing through the filter 302, 304 (see FIG. 17) in the image pickup apparatus 303, 305.
  • The configuration of the range finder will be discussed with reference to FIG. 15. As shown in the figure, the second camera [0021] 102 stores brightness information provided by picking up an image in brightness value memory 121 and stores an image pickup pattern in pattern image memory 122. Likewise, the third camera 103 stores brightness information in brightness value memory 123 and stores an image pickup pattern in pattern image memory 124. The first camera 101 stores brightness information in brightness value memory 125 and stores an image pickup pattern in pattern image memory 126. To reference a coded pattern, which is prepared in advance, later, the projector 104 divides each slit into cells on a square lattice for storage in frame memory 127.
  • Using the stored image pickup patterns and brightness information, a three-dimensional image is obtained as follows: The following operation is common to both a combination of the second camera [0022] 102 and the first camera 101 and a combination of the third camera 103 and the first camera 101 and therefore will be discussed by taking the combination of the second camera 102 and the first camera 101 as an example.
  • In FIG. 15, an area division section [0023] 128 performs area division of an image pickup pattern picked up by the first camera 101. The area division section 128 extracts an area with the strength difference between adjacent slit patterns being a threshold value or less as an area 1 where light from the projector does not reach, and extracts an area with the strength difference between adjacent slit patterns being the threshold value or more as an area 2. A recoding section 129 recodes the extracted area 2 using the image pickup pattern stored in the pattern image memory 126 and the projection pattern stored in the frame memory 127.
  • FIG. 18 is a flowchart for recoding. First, each slit pattern is divided in a longitudinal direction for each slit width (step S[0024] 11) to generate square cells. The strengths of the generated cells are averaged and the average value is adopted as the strength of each cell (step S12). A comparison is made between each of cells of the projection pattern and each of corresponding cells of the image pickup pattern with respect to the strength in order starting at the center of the image. Then whether or not the strength difference between the cells is more than a threshold value because of change in pattern caused by the reflection factor of the object, the range data to the object, and the like is determined (step S13). If the strength difference between cells is not more than the threshold value, the recoding is terminated for all picked-up image cells (step S17).
  • If the strength difference between the cells is more than the threshold value, whether or not the cell of the image pickup pattern is a cell having new strength is determined (step S[0025] 14) If the cell of the image pickup pattern is a cell having new strength, new code is generated and assigned (step S15). If the cell of the image pickup pattern is not a cell having new strength, coding is performed using a slit pattern alignment of other part (step S16). The recoding is now complete (step S17).
  • FIGS. 19A to [0026] 19C show a coding example of a slit pattern; FIG. 19A shows a projection pattern coded based on a slit alignment, and 3 (strong), 2 (medium), and 1 (weak) are assigned as the strength. In FIG. 19B, the strength is changed in the third cell from the left and a new code appears. Thus, new code of 0 is assigned. In FIG. 19C, an existing code appears in the third cell from the left, the second cell from the top. Thus, recoding is performed in such a manner that the vertical alignment is [232] and the horizontal alignment is [131] as new code from the cell alignment. This recoding is equal to light projection of a complicated pattern such as a two-dimensional pattern to a part of the object shape rich in change and light projection of a simple pattern to apart less in change. This process is repeated for assigning unique codes to all cells, thereby performing recoding.
  • FIG. 20 shows an example of projecting a coded pattern onto a plate [0027] 606 placed in front of a wall 605 using cameras 601 to 603 and a projector 604. The coded pattern is a slit pattern shown in FIG. 21. At this time, areas 801 and 901 as shadows of the plate 606 occur in images provided by the cameras 601 and 602, as shown in FIGS. 22 and 23. In the example, on the surface of the plate 606, a slit pattern as shown in FIG. 24 is provided as a new coded pattern.
  • Referring again to FIG. 15, a decoding section [0028] 130 of the second camera 102 extracts the image on which the projection pattern is pick up from the pattern image memory 122 and divides the image pickup pattern into cells in a similar manner to that described above. Using the codes provided by the recoding section 129, a decoding section 130 detects the code of each cell and calculates slit angle θ from the light source based on the detected codes. FIG. 25 is a drawing to show a range calculation method in the space coding. Range Z is calculated according to the following expression (1) from the slit angle θ of the cell to which each pixel belongs, the x coordinate on the image picked up by the second camera 102, focal distance F of a camera parameter, and base line length L:
  • Z=(F×L)/(x+F×tan θ)  (1)
  • The range Z is also calculated in a similar manner in a decoding section [0029] 131 of the third camera 103.
  • For the area 1 described above, the rage is calculated as follows: In the area 1, pattern detection based on the projected pattern cannot be executed and thus a correspondence point search section [0030] 132 detects a parallax using the brightness information read from the brightness value memories 121, 123, and 125 of the cameras 101 to 103, and calculates the range based on the detected parallax. For areas except the area 1, the range is calculated by performing the above-described operation and thus the minimum value of the range of the area 1 is obtained and the pixels, which can be related, are also limited. Using the limitation, the pixels are related to each other and parallax d is detected and using pixel size λ of a camera parameter, the range Z is calculated according to the following expression (2):
  • Z=(L×F)/(λ×d)  (2)
  • With the range information provided by using the first camera [0031] 101 and the third camera 103 in combination according to the technique described above, range information of the area 801 as the shadow of the plate shown in FIG. 22 cannot be detected. On the other hand, with the range information provided by using the first camera 101 and the second camera 102 in combination, range information of the area 901 as the shadow of the plate shown in FIG. 23 cannot be detected. That is, the shadow areas are areas blocked by the plate that light does not reach, and cannot be measured according to the system. Therefore, range information is found for areas other than the shadow areas. That is, a range information integration section 133 in FIG. 15 acquires range information for all pixels of the image of the first camera 101 (FIG. 26), namely, pixels other than the shadows from the range information calculated in the pair of the first camera 101 and the second camera 102 and the range information calculated in the pair of the first camera 101 and the third camera 103. The range information provided by performing the described operation is related to brightness image of the first camera 101, for example, for storage in three-dimensional memory, whereby three-dimensional image pickup is performed.
  • The description of the contents of the related art (JP-A-2000-65542) is now complete. [0032]
  • The range finder described in JP-A-2000-9442, JP-A-2000-65542 projects a projection pattern coded according to a plurality of strengths and a plurality of wavelengths. At this time, the projection pattern is changed by the effects of brightness information, material, and the like of the subject and when a three-dimensional shape is calculated, an error occurs and an appropriate three-dimensional shape cannot be measured. Thus, the range finder includes the monitor image pickup device placed at the same principal point as the projection element, monitors change in a projection pattern based on measured object information, performs recoding, and measures a three-dimensional shape. [0033]
  • In the configuration, however, making the same the principal points of the projection element and the image pickup device is indispensable for recoding; to do this, a beam splitter such as a half mirror is used to match the principal points of the projection element and the image pickup device. [0034]
  • If a half mirror or the like is used to match the principal points, the light projected from the projection element is attenuated through the half mirror. The pattern projected onto the measured object is attenuated in brightness through the half mirror and is input to the image pickup device. It is assumed that ideally the half mirror can distribute at 50:50 at an angle of 45 degrees. The measured object is observed with an attenuation of 25% as compared with a case where light from the projection element is projected directly on the measured object and the measured object is observed on the image pickup device. In the range finder in the related art, as shown in FIG. 16, the half mirror intervenes between the image pickup device intended for recoding and the image pickup device for shape measurement. Because of the effect of the half mirror, double brightness difference occurs on principle between the measured object observed on the image pickup device for shape measurement and the measured object observed on the image pickup device intended for recoding. [0035]
  • Further, in the pattern projected from the projection element, pattern unevenness is also caused due to optical passage difference before and after being split, film thickness unevenness of the application material of the half mirror and the like. A light scattering produced by dirt, dust, or the like on the half mirror also occurs in coaxial image. [0036]
  • Thus, if information with the projection pattern changed by subject information is recoded in the monitor image pickup device, the image is not provided strictly under the same condition as the image observed on the image pickup device for shape calculation and therefore precision degradation of shape measurement is caused. [0037]
  • Further, as for the dynamic range of image pickup device, if image pickup devices of the same characteristics are used, it is difficult to drive the monitor and measurement image pickup devices under the same condition, and degradation of precision of measurement caused by recoding occurs. [0038]
  • SUMMARY OF THE INVENTION
  • According to the invention, to solve the problems, a combination of a projector for projecting a coded pattern and an image pickup device for monitoring is formed without using a beam splitter or a half mirror. [0039]
  • The combination of the projector and the image pickup device is called projection system. As the coded pattern, a stripe pattern ideally orthogonal to an epipola line of the projection system and an image pickup device for shape measurement is projected. The range finder in JP-A-2000-9442, JP-A-2000-65542 performs recoding by matching the principal points of the projector and the image pickup device of the projection system with each other. To perform recoding, optical match in the direction orthogonal to stripes is required. That is, the principal points of the projector and the image pickup device of the projection system need to match in the direction orthogonal to the stripes. [0040]
  • In the invention, attention is focused on this point and preferably two or more projectors are placed on each other in the same direction as the stripes of the stripe pattern projected by the projection element so as to project the same pattern. At this time, the projectors are placed so that the stripe images shift depending on the subject. The principal point positions in the direction orthogonal to the stripe direction are matched between the projectors and the image pickup device for recoding is placed therebetween. According to the configuration of the projection system described above, it is made possible to match the principal points of the image pickup device for recoding and the projector without the need for the intervention of an optical device such as a half mirror or a beam splitter, so that a range finder free of the effect of image degradation, etc., affected by placing a half mirror or a beam splitter can be provided. [0041]
  • Since the principal points of the projector and the image pickup device of the projection system need only to match in the direction orthogonal to the stripe direction, the number of projectors may be reduced to only one. [0042]
  • To the end, according to one aspect of the invention, there is provided a range finder including a projector for projecting a coded stripe pattern, a first camera for picking up an image of the stripe pattern projected by the projector, the first camera placed so that a principal point of the first camera and a principal point of the projector are placed along a length direction of the stripe pattern; and a second camera for picking up an image of the stripe pattern projected by the projector, the second camera placed so that a principal point of the second camera and the principal point of the first camera are placed away from each other in a direction not parallel to the length direction of the stripe pattern. An area with change amount of the stripe pattern, which is picked up by the first camera, with respect to the stripe pattern projected by the projector being a predetermined value or more is determined. A new code is assigned to the area. The second camera picks up a recoded stripe pattern projected by the projector after the new code is assigned. Range information of a three-dimensional object onto which the stripe pattern is projected is generated based on the recoded stripe pattern picked up by the second camera. [0043]
  • Preferably, the principal point of the second camera and the principal point of the first camera are placed on the same line along the direction perpendicular to the length direction of the stripe pattern. However, the principal points of the first and second camera may be placed on the same line forming a predetermined angle other than the right angles with the length direction of the stripe pattern. [0044]
  • In the configuration, it is not necessary to place a half mirror or a beam splitter between the projector and the image pickup device (first camera) of the projection system as described above, so that image degradation can be circumvented.[0045]
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • In the accompanying drawings: [0046]
  • FIG. 1 is a plan view to show a range finder of an embodiment of the invention; [0047]
  • FIG. 2 is a perspective view to show the range finder of the embodiment of the invention; [0048]
  • FIG. 3 is a drawing to describe the relationship between the principal point of pattern projection apparatus and the principal point of an image pickup apparatus for monitoring in the range finder of the embodiment of the invention; [0049]
  • FIG. 4 is a side view of the range finder of the embodiment of the invention to describe projection and picking up of a pattern image; [0050]
  • FIG. 5 is a drawing to describe an observation image of an image pickup apparatus (camera 1) when a screen is at position 0 in FIG. 4; [0051]
  • FIG. 6 is a drawing to describe an observation image of the image pickup apparatus (camera 1) when the screen is at position + in FIG. 4; [0052]
  • FIG. 7 is a drawing to describe an observation image of the image pickup apparatus (camera 1) when the screen is at position − in FIG. 4; [0053]
  • FIG. 8 is a drawing to describe the relationship between the range finder of the embodiment of the invention and subject (two flat plates); [0054]
  • FIG. 9 is a side view of the apparatus and subject in FIG. 8; [0055]
  • FIG. 10 is a drawing to describe an observation image of the image pickup apparatus (camera 1) in the example in FIG. 9; [0056]
  • FIG. 11 is a side view when only pattern projection apparatus (projector 2) is installed in FIG. 8; [0057]
  • FIG. 12 is a drawing to describe an observation image of the image pickup apparatus (camera [0058] 1) in the example in FIG. 11;
  • FIG. 13 is a side view when only pattern projection apparatus (projector [0059] 1) is installed in FIG. 8;
  • FIG. 14 is a drawing to describe an observation image of the image pickup apparatus (camera [0060] 1) in the example in FIG. 13;
  • FIG. 15 is a block diagram to show a configuration example of a range finder in a related art; [0061]
  • FIG. 16 is a drawing to show a camera configuration example of the range finder in the related art in FIG. 15; [0062]
  • FIG. 17 is a drawing to describe the image pickup configuration of the range finder in the related art in FIG. 15; [0063]
  • FIG. 18 is a flowchart to show a processing flow of the range finder in the related art in FIG. 15; [0064]
  • FIGS. 19A to [0065] 19C are drawings to show a coding example of a projection pattern of the range finder in the related art in FIG. 15;
  • FIG. 20 is a drawing to describe the image pickup configuration of the range finder in the related art in FIG. 15; [0066]
  • FIG. 21 is a drawing to show a projection pattern example of the range finder in the related art in FIG. 15; [0067]
  • FIG. 22 is a drawing to show an example of a slit pattern photographed by a third camera [0068] 103 of the range finder in the related art in FIG. 15;
  • FIG. 23 is a drawing to show an example of a slit pattern photographed by a second camera [0069] 102 of the range finder in the related art in FIG. 15;
  • FIG. 24 is a drawing to show an example of a new coded slit pattern in the range finder in the related art in FIG. 15; [0070]
  • FIG. 25 is a drawing to show a range calculation method according to a space coding method of the range finder in the related art in FIG. 15; and [0071]
  • FIG. 26 is a drawing to show an example of a slit pattern photographed by a first camera [0072] 101 of the range finder in the related art in FIG. 15.
  • DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
  • Referring now to the accompanying drawings, there is shown a preferred embodiment of the invention. [0073]
  • FIG. 1 is a top view of a range finder according to an embodiment of the invention. FIG. 2 is a drawing of viewing the range finder from the slanting top thereof. In the embodiment, two pattern projection apparatus (also called projectors) are used. As the pattern projection apparatus, for example, commercially available projectors for projecting an image onto a screen can be used. [0074]
  • In the embodiment, generation of a coded stripe pattern, monitor of a coded stripe pattern, re-coding based on the monitor, and triangulation are similar to those in the related arts previously described with reference to FIGS. [0075] 15 to 26 and therefore will not be discussed again.
  • In FIGS. 1 and 2, the range finder includes two pattern projection apparatus (projectors) [0076] 10 and 11, an image pickup apparatus (camera 1) 12, and an image pickup apparatus (camera 2) 13 for triangulation. The image pickup apparatus 12 monitors a pattern on the same optical axis as the projectors 10 and 11. The term “same optical axis” mentioned here means that optical axes of the pattern projection apparatus 10 and 11 and the image pickup apparatus 12 for monitoring are arranged in the same plane along pattern stripes.
  • Basically, as with the related art example, the stripe patterns projected by the pattern projection apparatus [0077] 10 and 11 are observed from the image pickup apparatus (camera 1) 12 at the same principal point, recoding is performed, and a range image is calculated using the image observed on the image pickup apparatus (camera 2) 13 for measurement. As the recoding is performed, error-free, highly accurate measurement is made possible. As the projection apparatus, projectors or laser stripe projection systems are used.
  • In the embodiment, as shown clearly in FIG. 2, two pattern projection apparatus [0078] 10 and 11 are placed on each other in a stripe pattern direction for projecting the same pattern, and the image pickup apparatus (camera 1) 12 is placed between the pattern projection apparatus 10 and 11. Consequently, as shown in FIG. 3, the principal points of the lenses in a spread direction of the stripe image are matched and recoding is performed. The image pickup apparatus (camera 2) 13 is place so that a principal point of the image pickup apparatus (camera 2) 13 and a principal point of the image pickup apparatus (camera 1) 12 are placed away from each other in a direction not being parallel to a stripe pattern direction (in this case, in a direction substantially perpendicular to the stripe pattern direction).
  • A specific description is given. FIG. 4 is a side view of the range finder. Placed up and down are the pattern projection apparatus [0079] 10 and 11 and placed therebetween is the image pickup apparatus (camera 1) 12. The pattern projection apparatus 10 and 11 are placed in a manner generally called a projector stack manner for the up and down projection apparatus to project the same patterns onto a screen (position of 0) with image free of distortion or shift. As a stripe pattern, a pattern as shown in FIG. 5 is projected and the same stripe patterns are projected and superposed up and down. A case that the screen shifts back and forth is considered. If the screen shifts in the plus direction, namely, shifts to the front, the images of the up and down projection apparatus do not match. As shown in FIG. 6, the portion where the optical paths of the up and down projectors overlap becomes a similar pattern to that in FIG. 5; however, in the portion where the optical paths of the up and down projectors do not overlap, the brightness is as much as that of one projection apparatus and thus an image as shown in FIG. 6 is projected at the position of +. If the screen shifts in the minus direction, namely, shifts to the back, similarly an image as shown in FIG. 7 is projected. Recoding is performed for the purpose of eliminating erroneous recognition caused by change in the stripe pattern based on object information (such as color of an object, density of an object, gloss of a surface of an object, and reflectivity of an object) and the like. Change in the density distribution in the stripe direction with the stripe shape maintained as in FIGS. 6, 7 does not involve any problem as long as recoding is performed.
  • A description is given based on a specific measured object. FIG. 8 is a schematic drawing to conduct measurement with two flat plates arranged in front of the range finder of the invention. FIG. 9 is a side view thereof. An image of the image pickup apparatus (camera 1) [0080] 12 observed according to the configuration is as shown in FIG. 10. That is, a projection pattern of only either of the projection apparatus is projected onto the shadow portion of the front flat plate. Assuming that only either of the projection apparatus 10 and 11 exists as shown in FIG. 11 or 13, the shadow of the front flat plate is reflected on the rear flat plate and an area where no stripe pattern exists occurs as shown in FIG. 12 or 14. As shown in FIG. 10, even if either of the projection apparatus cannot project a stripe pattern because of the shadow of the measured object, the image of the stripe pattern of either of the projection apparatus can be picked up in the image observed on the image pickup apparatus (camera 1) 12, and it is also made possible to execute recoding.
  • According to the described configuration, the image recoded in the image pickup apparatus (camera 1) [0081] 12 and checked on the image pickup apparatus (camera 2) 13 can be used to calculate a range image based the principle of triangulation.
  • In the example, two pattern projection apparatus are installed, but three or more pattern projection apparatus may be installed. Only one pattern projection apparatus may be placed. In this case, a portion where no pattern is formed occurs and it is made impossible to relate based on code as for the portion and it is made impossible to perform range calculation of the portion. In this case, processing of interpolating using the nearby range or the like may be performed. Alternatively, the object and the range finder may be moved relatively for making it possible to conduct measurement on an unmeasurable portion. [0082]
  • Shape measurement using the pattern projection apparatus [0083] 10 and shape measurement using the pattern projection apparatus 11 may be conducted separately and the measurement results may be made complementary to each other. That is, making adjustment so that the stripe patterns of the two up and down pattern projection apparatus 10 and 11 are completely superposed on each other as in the embodiment requires considerable accuracy and a considerable number of steps. In contrast, number of steps of adjustment of principal point matching between the pattern projection apparatus and the image pickup apparatus is small. Then, the pattern projection apparatus 10 and 11 project patterns separately, and shape measurement using the image pickup apparatus (camera 1) 12 and the image pickup apparatus (camera 2) 13 is conducted in each pattern projection. A shadow is produced in each of the pattern projection apparatus 10 and 11 and some shape measurement cannot be conducted. However, the shape portion produced in the pattern projection apparatus 10 differs from that produced in the pattern projection apparatus 11 and thus if both the shape measurement results are combined, the complete shape measurement result can be provided. Thus, if the user (operator) does not stick to one image pickup and shape measurement sequence, easy and complete shape measurement can be conducted.
  • This measurement will be described in more detail. [0084]
  • At first, principal points of the image pickup apparatus (camera 1) [0085] 12 and the pattern projection apparatuses 10, 11 are placed along a length direction of the stripe pattern with the pattern projection apparatuses 10, 11 sandwiching the image pickup apparatus (camera 1) 12 therebetween. The image pickup apparatuses (cameras 1, 2) 12, 13 are disposed so that the principal point of the image pickup apparatus (camera 1) 12 and a principal point of the image pickup apparatus (camera 2) 13 away from each other in a direction not parallel to the length direction of the stripe pattern. Under this state, shape measurement using the pattern projection apparatus 10 and shape measurement using the pattern projection apparatus 11 are conducted separately. That is, the pattern projection apparatus 10 and the pattern projection apparatus 11 are driven to project stripe patterns in different time periods. Then, an area is determined, with change amount of the stripe pattern, which is picked up by the image pickup apparatus (camera 1) 12, with respect to the stripe pattern projected by the pattern projection apparatus 10 being a predetermined value or more. A new code is assigned to the area. The image pickup apparatus (camera 2) 13 picks up a recoded stripe pattern projected by the pattern projection apparatus 10 after the new code is assigned. First range information of a three-dimensional object onto which the stripe pattern is projected is generated based on the recoded stripe pattern picked up by the image pickup apparatus (camera 2) 13. Then, the pattern projection apparatus 11 projects the stripe pattern to obtain second range information in a similar manner. That is, an area is determined, with change amount of the stripe pattern, which is picked up by the image pickup apparatus (camera 1) 12, with respect to the stripe pattern projected by the pattern projection apparatus 11 being a predetermined value or more. A new code is assigned to the area. The image pickup apparatus (camera 2) 13 picks up an image of a recoded stripe pattern projected by the pattern projection apparatus 11 after the new code is assigned. Then, the second range information of the three-dimensional object onto which the stripe pattern is projected is generated based on the image of the recoded stripe pattern picked up by the image pickup apparatus (camera 2) 13. Finally, the first range information and the second range information are combined to form total range information.
  • As described above, according to the invention, the need for a half mirror or a beam splitter used with the measurement apparatus in the related art is eliminated and problems of brightness difference, a light scattering caused by dirt, dust, etc., and the like caused by a substance placed between a pattern projection apparatus and an image pickup apparatus do not occur on principle, so that more accurate measurement is made possible. [0086]

Claims (6)

What is claimed is:
1. A range finder comprising:
a projector for projecting a coded stripe pattern;
a first camera for picking up an image of the stripe pattern projected by the projector, the first camera placed so that a principal point of the first camera and a principal point of the projector are placed along a length direction of the stripe pattern; and
a second camera for picking up an image of the stripe pattern projected by the projector, the second camera placed so that a principal point of the second camera and the principal point of the first camera are placed away from each other in a direction being not parallel to the length direction of the stripe pattern,
wherein an area with change amount of the stripe pattern, which is picked up by the first camera, with respect to the stripe pattern projected by the projector being a predetermined value or more is determined;
wherein a new code is assigned to the area;
wherein the second camera picks up a recoded stripe pattern projected by the projector after the new code is assigned; and
wherein range information of a three-dimensional object onto which the stripe pattern is projected is generated based on the recoded stripe pattern picked up by the second camera.
2. The range finder according to claim 1,
wherein the projector is at least one projector;
wherein the principal point of all the projector and the principal point of the first camera are placed along the length direction of the stripe pattern; and
wherein the coded stripe pattern projected from all the projector is matched with each other.
3. The range finder according to claim 2,
wherein total number of the projectors is two; and
wherein the two projectors are placed so as to sandwich the first camera therebetween.
4. The range finder according to claim 1, wherein texture information of a surface of the three-dimensional object onto which the stripe pattern is projected is generated from the image of the stripe pattern picked up by the first camera.
5. A three-dimensional image pickup method comprising:
providing a projector for projecting a coded stripe pattern, a first camera and a second camera each for picking up the stripe pattern projected by the projector,
determining an area with change amount of the stripe pattern, which is picked up by the first camera, with respect to the stripe pattern projected by the projector being a predetermined value or more;
assigning a new code to the area;
picking up a recoded stripe pattern projected by the projector after the new code is assigned by the second camera; and
generating range information of a three-dimensional object onto which the stripe pattern is projected based on the image of the recoded stripe pattern picked up by the second camera,
wherein a principal point of the first camera and a principal point of the projector are placed along a length direction of the stripe pattern; and
wherein the principal point of the first camera and a principal point of the second camera are placed away from each other in a direction not parallel to the length direction of the stripe pattern.
6. A three-dimensional image pickup method comprising:
providing a first projector and a second projector each for projecting a coded stripe pattern, and a first camera and a second camera for picking up images of the stripe patterns projected by the first projector and the second projector;
placing a principal point of the first camera and principal points of the first projector and the second projector along a length direction of the stripe pattern;
placing the two projectors to sandwich the first camera therebetween;
placing the principal point of the first camera and a principal point of the second camera away from each other in a direction not parallel to the length direction of the stripe pattern;
driving the first projector and the second projector to project stripe patterns in different time periods;
determining an area with change amount of the stripe pattern, which is picked up by the first camera, with respect to the stripe pattern projected by the first projector being a predetermined value or more;
assigning a new code to the area;
picking up a recoded stripe pattern projected by the first projector after the new code is assigned by the second camera;
generating first range information of a three-dimensional object onto which the stripe pattern is projected based on the recoded stripe pattern picked up by the second camera;
determining an area with change amount of the stripe pattern, which is picked up by the first camera, with respect to the stripe pattern projected by the second projector being a predetermined value or more;
assigning a new code to the area;
picking up an image of are coded stripe pattern projected by the second projector after the new code is assigned by the second camera;
generating second range information of the three-dimensional object onto which the stripe pattern is projected based on the image of the recoded stripe pattern picked up by the second camera; and
combining the first range information and the second range information to form total range information.
US10/373,761 2002-08-28 2003-02-27 Range finder and method Abandoned US20040041996A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
JP2002248034 2002-08-28
JP2002-248034 2002-08-28

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
US10/702,597 US7075625B2 (en) 2002-08-28 2003-11-07 Range finder and method

Related Child Applications (2)

Application Number Title Priority Date Filing Date
US10/702,597 Continuation-In-Part US7075625B2 (en) 2002-08-28 2003-11-07 Range finder and method
US10/702,597 Continuation US7075625B2 (en) 2002-08-28 2003-11-07 Range finder and method

Publications (1)

Publication Number Publication Date
US20040041996A1 true US20040041996A1 (en) 2004-03-04

Family

ID=31972497

Family Applications (2)

Application Number Title Priority Date Filing Date
US10/373,761 Abandoned US20040041996A1 (en) 2002-08-28 2003-02-27 Range finder and method
US10/702,597 Expired - Fee Related US7075625B2 (en) 2002-08-28 2003-11-07 Range finder and method

Family Applications After (1)

Application Number Title Priority Date Filing Date
US10/702,597 Expired - Fee Related US7075625B2 (en) 2002-08-28 2003-11-07 Range finder and method

Country Status (1)

Country Link
US (2) US20040041996A1 (en)

Cited By (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102012100955A1 (en) * 2012-02-06 2013-08-08 A.Tron3D Gmbh Device for detecting three-dimensional geometry of object e.g. teeth, has light source of projector that is provided to emit within predetermined range, and optical device that is provided with light source and camera
US20130335559A1 (en) * 2010-12-13 2013-12-19 Surveylab Group Limited Mobile measurement devices, instruments and methods
WO2014010251A1 (en) * 2012-07-13 2014-01-16 Panasonic Corporation Hand and object tracking in three-dimensional space
US20140268093A1 (en) * 2013-03-15 2014-09-18 Faro Technologies, Inc. Three-dimensional coordinate scanner and method of operation
US9007601B2 (en) 2010-04-21 2015-04-14 Faro Technologies, Inc. Automatic measurement of dimensional data with a laser tracker
US9151830B2 (en) 2011-04-15 2015-10-06 Faro Technologies, Inc. Six degree-of-freedom laser tracker that cooperates with a remote structured-light scanner
US9164173B2 (en) 2011-04-15 2015-10-20 Faro Technologies, Inc. Laser tracker that uses a fiber-optic coupler and an achromatic launch to align and collimate two wavelengths of light
US9377885B2 (en) 2010-04-21 2016-06-28 Faro Technologies, Inc. Method and apparatus for locking onto a retroreflector with a laser tracker
US9395174B2 (en) 2014-06-27 2016-07-19 Faro Technologies, Inc. Determining retroreflector orientation by optimizing spatial fit
US9400170B2 (en) 2010-04-21 2016-07-26 Faro Technologies, Inc. Automatic measurement of dimensional data within an acceptance region by a laser tracker
US9453913B2 (en) 2008-11-17 2016-09-27 Faro Technologies, Inc. Target apparatus for three-dimensional measurement system
US9482755B2 (en) 2008-11-17 2016-11-01 Faro Technologies, Inc. Measurement system having air temperature compensation between a target and a laser tracker
US9482529B2 (en) 2011-04-15 2016-11-01 Faro Technologies, Inc. Three-dimensional coordinate scanner and method of operation
US9686532B2 (en) 2011-04-15 2017-06-20 Faro Technologies, Inc. System and method of acquiring three-dimensional coordinates using multiple coordinate measurement devices
US9772394B2 (en) 2010-04-21 2017-09-26 Faro Technologies, Inc. Method and apparatus for following an operator and locking onto a retroreflector with a laser tracker
DE102016105426A1 (en) * 2016-03-23 2017-09-28 Gottfried Wilhelm Leibniz Universität Hannover Optical measurement system and optical measuring method
US9781397B2 (en) 2015-10-05 2017-10-03 Panasonic Intellectual Property Management Co., Ltd. Projector and projector system

Families Citing this family (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6634552B2 (en) * 2001-09-26 2003-10-21 Nec Laboratories America, Inc. Three dimensional vision device and method, and structured light bar-code patterns for use in the same
US8224064B1 (en) * 2003-05-21 2012-07-17 University Of Kentucky Research Foundation, Inc. System and method for 3D imaging using structured light illumination
CN1942780B (en) * 2004-04-02 2012-07-04 莱卡地球系统公开股份有限公司 Electronic distance meter featuring spectral and spatial selectivity
JP2009517634A (en) * 2005-11-28 2009-04-30 3シェイプ アー/エス Coded structured light
CA2536411C (en) * 2006-02-14 2014-01-14 Lmi Technologies Inc. Multiple axis multipoint non-contact measurement system
US7525114B2 (en) 2006-02-14 2009-04-28 Lmi Technologies Ltd. Multiple axis multipoint non-contact measurement system
US7957007B2 (en) * 2006-05-17 2011-06-07 Mitsubishi Electric Research Laboratories, Inc. Apparatus and method for illuminating a scene with multiplexed illumination for motion capture
JP4380663B2 (en) * 2006-06-08 2009-12-09 コニカミノルタセンシング株式会社 Three-dimensional shape measuring method, apparatus, and focus adjusting method
GB0612786D0 (en) * 2006-06-28 2006-08-09 Spiral Scratch Ltd Imaging with depth information
US20080007700A1 (en) * 2006-07-10 2008-01-10 Vanbaar Jeroen Method and system for aligning an array of rear-projectors
JP4270264B2 (en) * 2006-11-01 2009-05-27 セイコーエプソン株式会社 Image correction apparatus, projection system, image correction method, image correction program, and a recording medium
CN103776392B (en) 2006-11-21 2017-03-01 曼蒂斯影像有限公司 3D geometric modeling and three-dimensional video content creation
US8090194B2 (en) 2006-11-21 2012-01-03 Mantis Vision Ltd. 3D geometric modeling and motion capture using both single and dual imaging
US20080156619A1 (en) * 2006-12-01 2008-07-03 Mehul Patel Range finder
US20110001935A1 (en) * 2007-06-25 2011-01-06 Spotless, Llc Digital image projection system
US20080316432A1 (en) * 2007-06-25 2008-12-25 Spotless, Llc Digital Image Projection System
US8031346B2 (en) * 2008-10-31 2011-10-04 Siemens Energy, Inc. Coating evaluation process
CN101930071A (en) * 2009-06-19 2010-12-29 鸿富锦精密工业(深圳)有限公司;鸿海精密工业股份有限公司 Device and method for detecting movement of object
US8681217B2 (en) * 2010-07-21 2014-03-25 Olympus Corporation Inspection apparatus and measurement method
US9536312B2 (en) * 2011-05-16 2017-01-03 Microsoft Corporation Depth reconstruction using plural depth capture units
TWI461656B (en) 2011-12-01 2014-11-21 Ind Tech Res Inst Apparatus and method for sencing distance
US20140160162A1 (en) * 2012-12-12 2014-06-12 Dhanushan Balachandreswaran Surface projection device for augmented reality
US9233470B1 (en) * 2013-03-15 2016-01-12 Industrial Perception, Inc. Determining a virtual representation of an environment by projecting texture patterns
JP6410079B2 (en) * 2014-06-26 2018-10-24 パナソニックIpマネジメント株式会社 Optical projection device and illumination device using the same

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4842411A (en) * 1986-02-06 1989-06-27 Vectron, Inc. Method of automatically measuring the shape of a continuous surface
US6356298B1 (en) * 1998-08-18 2002-03-12 Fuji Xerox Co., Ltd. Three-dimensional image photographing system
US6417880B1 (en) * 1995-06-29 2002-07-09 Matsushita Electric Industrial Co., Ltd. Stereoscopic CG image generating apparatus and stereoscopic TV apparatus
US6549289B1 (en) * 2000-03-07 2003-04-15 Pheno Imaging, Inc. Three-dimensional measuring system for animals using light pattern triangulation
US6549288B1 (en) * 1998-05-14 2003-04-15 Viewpoint Corp. Structured-light, triangulation-based three-dimensional digitizer

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH03192474A (en) 1989-12-22 1991-08-22 Fujitsu Ltd Three-dimensional shape measuring system
JPH0816608B2 (en) 1991-03-15 1996-02-21 幸男 佐藤 Shape measurement apparatus
US5548392A (en) * 1995-01-31 1996-08-20 Kabushikikaisha Wacom Optical position detector having scale pattern spot-illuminated to increase resolution
JP3384329B2 (en) 1998-06-22 2003-03-10 富士ゼロックス株式会社 3-dimensional image capturing device

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4842411A (en) * 1986-02-06 1989-06-27 Vectron, Inc. Method of automatically measuring the shape of a continuous surface
US6417880B1 (en) * 1995-06-29 2002-07-09 Matsushita Electric Industrial Co., Ltd. Stereoscopic CG image generating apparatus and stereoscopic TV apparatus
US6549288B1 (en) * 1998-05-14 2003-04-15 Viewpoint Corp. Structured-light, triangulation-based three-dimensional digitizer
US6356298B1 (en) * 1998-08-18 2002-03-12 Fuji Xerox Co., Ltd. Three-dimensional image photographing system
US6549289B1 (en) * 2000-03-07 2003-04-15 Pheno Imaging, Inc. Three-dimensional measuring system for animals using light pattern triangulation

Cited By (32)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9482755B2 (en) 2008-11-17 2016-11-01 Faro Technologies, Inc. Measurement system having air temperature compensation between a target and a laser tracker
US9453913B2 (en) 2008-11-17 2016-09-27 Faro Technologies, Inc. Target apparatus for three-dimensional measurement system
US9377885B2 (en) 2010-04-21 2016-06-28 Faro Technologies, Inc. Method and apparatus for locking onto a retroreflector with a laser tracker
US9400170B2 (en) 2010-04-21 2016-07-26 Faro Technologies, Inc. Automatic measurement of dimensional data within an acceptance region by a laser tracker
US10209059B2 (en) 2010-04-21 2019-02-19 Faro Technologies, Inc. Method and apparatus for following an operator and locking onto a retroreflector with a laser tracker
US9007601B2 (en) 2010-04-21 2015-04-14 Faro Technologies, Inc. Automatic measurement of dimensional data with a laser tracker
US9146094B2 (en) 2010-04-21 2015-09-29 Faro Technologies, Inc. Automatic measurement of dimensional data with a laser tracker
US9772394B2 (en) 2010-04-21 2017-09-26 Faro Technologies, Inc. Method and apparatus for following an operator and locking onto a retroreflector with a laser tracker
US20130335559A1 (en) * 2010-12-13 2013-12-19 Surveylab Group Limited Mobile measurement devices, instruments and methods
US9494412B2 (en) 2011-04-15 2016-11-15 Faro Technologies, Inc. Diagnosing multipath interference and eliminating multipath interference in 3D scanners using automated repositioning
US9207309B2 (en) 2011-04-15 2015-12-08 Faro Technologies, Inc. Six degree-of-freedom laser tracker that cooperates with a remote line scanner
US9164173B2 (en) 2011-04-15 2015-10-20 Faro Technologies, Inc. Laser tracker that uses a fiber-optic coupler and an achromatic launch to align and collimate two wavelengths of light
US9157987B2 (en) 2011-04-15 2015-10-13 Faro Technologies, Inc. Absolute distance meter based on an undersampling method
US9151830B2 (en) 2011-04-15 2015-10-06 Faro Technologies, Inc. Six degree-of-freedom laser tracker that cooperates with a remote structured-light scanner
US9448059B2 (en) 2011-04-15 2016-09-20 Faro Technologies, Inc. Three-dimensional scanner with external tactical probe and illuminated guidance
US10119805B2 (en) 2011-04-15 2018-11-06 Faro Technologies, Inc. Three-dimensional coordinate scanner and method of operation
US9453717B2 (en) 2011-04-15 2016-09-27 Faro Technologies, Inc. Diagnosing multipath interference and eliminating multipath interference in 3D scanners using projection patterns
US10267619B2 (en) 2011-04-15 2019-04-23 Faro Technologies, Inc. Three-dimensional coordinate scanner and method of operation
US9482746B2 (en) 2011-04-15 2016-11-01 Faro Technologies, Inc. Six degree-of-freedom laser tracker that cooperates with a remote sensor
US9686532B2 (en) 2011-04-15 2017-06-20 Faro Technologies, Inc. System and method of acquiring three-dimensional coordinates using multiple coordinate measurement devices
US9482529B2 (en) 2011-04-15 2016-11-01 Faro Technologies, Inc. Three-dimensional coordinate scanner and method of operation
US10302413B2 (en) 2011-04-15 2019-05-28 Faro Technologies, Inc. Six degree-of-freedom laser tracker that cooperates with a remote sensor
DE102012100955A1 (en) * 2012-02-06 2013-08-08 A.Tron3D Gmbh Device for detecting three-dimensional geometry of object e.g. teeth, has light source of projector that is provided to emit within predetermined range, and optical device that is provided with light source and camera
US9720511B2 (en) 2012-07-13 2017-08-01 Panasonic Intellectual Property Management Co., Ltd. Hand and object tracking in three-dimensional space
WO2014010251A1 (en) * 2012-07-13 2014-01-16 Panasonic Corporation Hand and object tracking in three-dimensional space
US9482514B2 (en) 2013-03-15 2016-11-01 Faro Technologies, Inc. Diagnosing multipath interference and eliminating multipath interference in 3D scanners by directed probing
US9041914B2 (en) * 2013-03-15 2015-05-26 Faro Technologies, Inc. Three-dimensional coordinate scanner and method of operation
US20140268093A1 (en) * 2013-03-15 2014-09-18 Faro Technologies, Inc. Three-dimensional coordinate scanner and method of operation
US9395174B2 (en) 2014-06-27 2016-07-19 Faro Technologies, Inc. Determining retroreflector orientation by optimizing spatial fit
US9781397B2 (en) 2015-10-05 2017-10-03 Panasonic Intellectual Property Management Co., Ltd. Projector and projector system
DE102016105426B4 (en) * 2016-03-23 2018-01-11 Gottfried Wilhelm Leibniz Universität Hannover Optical measurement system and optical measuring method
DE102016105426A1 (en) * 2016-03-23 2017-09-28 Gottfried Wilhelm Leibniz Universität Hannover Optical measurement system and optical measuring method

Also Published As

Publication number Publication date
US7075625B2 (en) 2006-07-11
US20040246495A1 (en) 2004-12-09

Similar Documents

Publication Publication Date Title
Bruno et al. Experimentation of structured light and stereo vision for underwater 3D reconstruction
EP1277026B1 (en) Combined stereovision, color 3d digitizing and motion capture system
US9582889B2 (en) Depth mapping based on pattern matching and stereoscopic information
Trobina Error model of a coded-light range sensor
US10225543B2 (en) System and methods for calibration of an array camera
US7953271B2 (en) Enhanced object reconstruction
US8538166B2 (en) 3D geometric modeling and 3D video content creation
AU2003286238B2 (en) Ranging apparatus
US6549288B1 (en) Structured-light, triangulation-based three-dimensional digitizer
Zhang et al. High-resolution, real-time 3D absolute coordinate measurement based on a phase-shifting method
Berger et al. Markerless motion capture using multiple color-depth sensors.
US6862097B2 (en) Three-dimensional shape measuring method, and three-dimensional shape measuring apparatus
Pages et al. Optimised De Bruijn patterns for one-shot shape acquisition
CN101821578B (en) Non-contact measurement apparatus and method
Hall-Holt et al. Stripe boundary codes for real-time structured-light range scanning of moving objects
US6496218B2 (en) Stereoscopic image display apparatus for detecting viewpoint and forming stereoscopic image while following up viewpoint position
US4893183A (en) Robotic vision system
US6721444B1 (en) 3-dimensional object recognition method and bin-picking system using the method
US20120070077A1 (en) Method for optically scanning and measuring an environment
US7724379B2 (en) 3-Dimensional shape measuring method and device thereof
CN101118155B (en) Method and system for sensing the surface shape of a reflective object
US7844079B2 (en) System and technique for retrieving depth information about a surface by projecting a composite image of modulated light patterns
US5155775A (en) Structured illumination autonomous machine vision system
US6369401B1 (en) Three-dimensional optical volume measurement for objects to be categorized
Khoshelham Accuracy analysis of kinect depth data

Legal Events

Date Code Title Description
AS Assignment

Owner name: FUJI XEROX CO., LTD., JAPAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:ABE, TSUTOMU;REEL/FRAME:013818/0369

Effective date: 20030225

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION