Classifications

• • A—HUMAN NECESSITIES
  • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
  • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
  • A61B5/00—Measuring for diagnostic purposes; Identification of persons
  • A61B5/103—Measuring devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
  • A61B5/107—Measuring physical dimensions, e.g. size of the entire body or parts thereof
  • A61B5/1077—Measuring of profiles
• • A—HUMAN NECESSITIES
  • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
  • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
  • A61B5/00—Measuring for diagnostic purposes; Identification of persons
  • A61B5/103—Measuring devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
  • A61B5/107—Measuring physical dimensions, e.g. size of the entire body or parts thereof
  • A61B5/1079—Measuring physical dimensions, e.g. size of the entire body or parts thereof using optical or photographic means
• • A—HUMAN NECESSITIES
  • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
  • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
  • A61B5/00—Measuring for diagnostic purposes; Identification of persons
  • A61B5/44—Detecting, measuring or recording for evaluating the integumentary system, e.g. skin, hair or nails
  • A61B5/441—Skin evaluation, e.g. for skin disorder diagnosis
  • A61B5/444—Evaluating skin marks, e.g. mole, nevi, tumour, scar
• • G—PHYSICS
  • G01—MEASURING; TESTING
  • G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
  • G01B11/00—Measuring arrangements characterised by the use of optical techniques
  • G01B11/02—Measuring arrangements characterised by the use of optical techniques for measuring length, width or thickness
  • G01B11/026—Measuring arrangements characterised by the use of optical techniques for measuring length, width or thickness by measuring distance between sensor and object
• • G—PHYSICS
  • G01—MEASURING; TESTING
  • G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
  • G01B11/00—Measuring arrangements characterised by the use of optical techniques
  • G01B11/22—Measuring arrangements characterised by the use of optical techniques for measuring depth
• • G—PHYSICS
  • G01—MEASURING; TESTING
  • G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
  • G01B11/00—Measuring arrangements characterised by the use of optical techniques
  • G01B11/24—Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures
  • G01B11/25—Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures by projecting a pattern, e.g. one or more lines, moiré fringes on the object
  • G01B11/2513—Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures by projecting a pattern, e.g. one or more lines, moiré fringes on the object with several lines being projected in more than one direction, e.g. grids, patterns

Definitions

• the present invention relates to an apparatus and method for profiling a depth of a surface of a target object.
• Techniques for generating 3D digital data are an active area of research, for example to allow for gesture control and recording 3D scenes.
• There are three main range finding techniques which are interferometry, triangulation and time-of- flight imaging. The latter can be used for larger depth ranges, while triangulation is better for close ranges, to achieve a high resolution, interferometry-based methods may be used.
• Triangulation is a known technique wherein active lighting and an image recording device are used. Active lighting techniques make use of a specific light pattern which is projected onto a target object. Subsequently, the distortions of the detected light pattern can be used to reconstruct the depth profile.
• Non-contact methods of depth profiling of surfaces may be required to detect and quantify surface quality, like wrinkles and fine lines.
• a non-contact method for close range measurement may be required where contact between the depth profiling apparatus and the surface could deform the depth profile of the surface to be scanned and lead to a false measurement.
• depth profiling could be used to scan moles (melanocytic nevus) in the home environment and to follow the growth of the mole over time. In another field, one would possibly like to scan the surface relief structure of leaves. Depth profiling may be of interest with respect to features on the order of micrometers or greater.
• Laser line scanners which profile 3D objects in process lines of industry whereby a laser line is imaged by an optical diffractive element and is moved across the surface of the target object.
• these require accurate motion and/or possibly tracking of either the laser line or the object to obtain 3D data of the object under
• Speckle noise from the laser is a limiting factor.
• Another method is to use a light projector device, but these are relatively large and expensive.
• projector devices are typically used for larger object like complete faces with lower depth resolution of several millimeters.
• the present invention provides an apparatus for profiling a depth of a surface of a target object, the apparatus comprising a first light source comprising a two-dimensional array of lasers, an optical device for projecting a two-dimensional multiline illumination pattern onto an area of the surface of the target object, an image capture device arranged to capture an image of the two-dimensional illumination pattern projected onto the area of the surface of the target object and a processor configured to process the captured image in order to reconstruct a depth profile of the two-dimensional area of the surface of the target object from the image captured by the image capture device, wherein the two dimensional array comprises a plurality of rows wherein at least one row is laterally offset with respect to an adjacent row.
• the present invention may provide that the two-dimensional array of lasers comprises at least two lasers having different shapes.
• the present invention may provide that the two-dimensional array is configured to be switched between a homogeneous illumination mode and a structured illumination mode.
• the present invention may provide means for determining distance between the two-dimensional array and the surface of a target object.
• the present invention may provide that the means for determining distance between the two-dimensional array and the surface of a target object comprises a second light source inclined at a predetermined angle relative to the first light source, wherein the second light source is configured to project a second illumination pattern onto the surface of the target object and the image capture device is configured to capture an image of the second illumination pattern, and wherein the processor is further configured to process the captured image of the second illumination pattern and determine a distance between the first active light source and the surface of the target object based on the predetermined angle and the captured image of the second illumination pattern.
• the present invention may provide that the two-dimensional array of lasers comprises vertical cavity surface emitting lasers.
• the present invention provides a method of profiling a depth of a surface of a target object, the method comprising projecting a two-dimensional multiline illumination pattern from a first light source comprising a two-dimensional array of lasers onto an area of the surface of the target object, capturing an image of the illumination pattern and processing the captured image in order to reconstruct a depth profile of the area of the surface of the target object from the image captured by the image capture device, wherein the two dimensional array comprises a plurality of rows wherein at least one row is laterally offset with respect to an adjacent row.
• the present invention may provide switching the two dimensional array between a homogeneous illumination mode and a structured illumination mode.
• the present invention may provide determining a distance between the two- dimensional array and the surface of the target object.
• the present invention may provide that determining a distance between the two-dimensional array and the surface of a target object comprises directing a second light source towards the target object, the second light source oriented at a predetermined angle to the first light source, projecting, from the second light source, a second illumination pattern onto the surface of the target object, capturing an image of the second illumination pattern, processing the captured image of the second illumination pattern, and determining the distance between the first active light source and the surface of the target object based on the predetermined angle and the captured image of the second illumination pattern.
• the present invention may provide a computer readable storage medium arranged to store computer program instructions that, when executed by a processor, perform the method provided by the invention.
• Figure 1 is a schematic representation of a depth profiling apparatus according to an embodiment of the present invention
• Figures 2A and 2B are plan views of a laser array according to respective embodiments of the present invention.
• Figure 3 is a side-on view diagram showing an embodiment of the present invention.
• Figures 4A and 4B are plan views of illumination patterns according to respective embodiments of the present invention.
• Figure 5 is a diagram of an embodiment of the present invention.
• Figure 6 is a diagram of an embodiment of the present invention.
• Figure 7 is a plan view of a chip supporting a laser array according to an embodiment of the present invention.
• Figure 1 shows a depth profiling apparatus 1 comprising a two dimensional laser array 5, an image capture device 10 such as a CCD or CMOS camera and a first lens 15 coupled to the laser array 5.
• the image capture device 10 may comprise an image capture array and a second lens 20 to focus an image captured by the image capture device 10.
• the depth profiling apparatus 1 may further comprise a processor 25 to control the depth profiling apparatus 1 and to process images captured by the image capture device 10.
• the depth profiling apparatus 1 may further comprise a memory 26 for storing software used by the processor to control the depth profiling apparatus 1 and to process captured images.
• the depth profiling apparatus 1 may further comprise a power source 27 such as a battery or a mains connection and may comprise a user interface 28 having an output unit such as a display screen and/or an input unit such as a keyboard.
• Figures 2A and 2B show a laser array 5 in plan view according to two exemplary embodiments.
• Figure 2 A shows a rectangular laser array 5 where each laser (1 st , 2 nd , 3 rd etc) on a particular row of the laser array 5 has the same x-axis coordinate as a respective laser (1 st , 2 nd , 3 rd etc) on the preceding and following rows, where the x-axis is the row direction as shown by the arrow at the bottom of Figure 2B.
• FIG. 2B shows a laser array 5 where successive rows are displaced by a certain distance along the x-axis compared with a preceding row.
• the laser array 5 may be an array of vertical cavity surface emitting lasers (hereinafter, VCSELs).
• VCSELs vertical cavity surface emitting lasers
• the use of VCSELs in the laser array 5 is advantageous due to their high efficiency, low current threshold current and high modulation bandwidths.
• using an array of VCSELs has cost advantages due to the vertical emission of the lasers which allows for straightforward processing and wafer scale testing as well as integration of wafer scale optics.
• the layout of multiple VCSELs in an array such as the laser array 5 can be controlled by one lithographic step during manufacture, which allows a high freedom of choice with respect to shape, size and density over the array surface area.
• the laser array 5 may have an area of approximately 1 square millimeter (hereinafter, sq mm) or smaller in preferred embodiments. Having an array of lasers is advantageous because of the small dimensions that may be achieved which reduces the cost of manufacture. Furthermore, using a cylindrical lens to image the array in one dimension (i.e. in lines) is a simpler arrangement than using more complex optical devices.
• the laser array 5 may comprise between 5 and 50 rows, each row comprising between 10 and 50 lasers. Successive rows may be shifted in the x-direction with respect to the preceding row, substantially as shown in Figure 2B.
• Each of the lasers within the laser array 5 may have a diameter between approximately 1 micrometer and approximately 25 micrometers (hereinafter, microns) and may be separated by approximately 25 microns.
• microns approximately 1 micrometer and approximately 25 micrometers
• an array comprising 18 rows may be employed, with each row comprising 25 lasers, each with a diameter of
• each successive row may be shifted in the x-direction by half the separation between each laser. In the above example, the shift may be approximately 12.5 microns.
• the position in the x-direction of successive lasers i.e. the 1 st , 2 nd , 3 rd , ...) in a row corresponds to the position in the x-direction of successive lasers in alternate rows.
• the first lens 15, shown in Figure 1 may be a cylindrical lens which is placed in front of the array 5. Cylindrical lenses may be used to focus light passing there through onto a line.
• the first lens 15 may be plano-convex or convex-convex although a Fresnel lens or single diffractive optical element may be used instead.
• the laser array 5 and first lens 15 together form a laser projector 16.
• Figure 3 shows the laser array 5, first lens 15 and a target object 30 having a two-dimensional illumination pattern 31 projected thereon according to one embodiment.
• the first lens 15 is a cylindrical lens and the two-dimensional illumination pattern 31 is a multiline pattern. The number of lines projected depends on the arrangement of the laser array 5.
• a rectangular array such as that shown in Figure 2 A will project eight lines equal to the number of lasers in each row.
• An array such as that shown in Figure 2B will generate 15 lines 31.
• 50 lines will be projected onto the surface of the target object 30.
• Embodiments of the invention may have successive rows of lasers shifted in the x-direction with respect to the preceding row by a varying amount.
• Each laser in the laser array 5 may therefore have a unique position in the x-direction thereby increasing the number of laser lines projected onto the surface of the target object 30 up to a number equal to the number of lasers in the laser array 5.
• Figure 4A shows an illumination pattern 31 obtained from the laser array 5 shown in Figure 2A
• Figure 2B shows an illumination pattern 31 obtained from the laser array 5 shown in Figure 2B in plan view when using a cylindrical first lens 15.
• Figure 5 is a diagram showing the laser projector 16 and image capture device 10 arranged to profile a target object 30.
• the image capture device 10 is oriented at an angle 9d relative to the laser projector 16.
• the laser projector 16 has an opening angle ⁇ and the image capture device 10 has a field of view of 9s.
• the first lens 15 may have a focal length of the order of several millimeters and the laser projector 16 may have an opening angle ⁇ of between approximately 5 and approximately 45 degrees.
• the laser array 5 may be positioned relative to the first lens 15 so that it is in or out of focus. If the laser array 5 is located a distance from the first lens 15 equal to the focal length then the laser array 5 is imaged at infinity and has a maximum depth of focus.
• the first lens 15 may have a focal length of 3 mm and the laser array 5 may be located at a distance 3.5 mm away from the first lens 15. An image of the laser array 5 is thereby created at a distance of 21 mm from the laser array 5, the image being magnified by a factor of 6. This leads to an illumination area of the order of 6x6 mm.
• the laser projector 16 has an opening angle ⁇ of approximately 17 degrees. The opening angle ⁇ may be increased by using a first lens 15 having a shorter focal length.
• a two-dimensional illumination pattern comprising a plurality of lines may be projected onto the surface of the target object 30 by the laser projector 16 as described above. Diffuse scattering or reflection of the illumination pattern occurs and the illumination pattern on the surface of the target object 30 is captured by the image capture device 10.
• the image capture device 10 is arranged so that it has a base distance b as shown in Figure 4 of between approximately 5 mm and approximately 50 mm.
• the angle 9d may be between approximately 25 and approximately 45 degrees. However, the angle 9d depends on the depth range and area of the surface of the target obj ect 30.
• the image capture device 10 captures and records an image of the surface of the target object 30 and the two-dimensional illumination pattern projected thereon by the laser projector 16.
• the illumination pattern is distorted by the depth profile of the surface of the target object 30.
• the depth of a two-dimensional area of the surface may be profiled without sweeping the illumination pattern across the target object 30.
• the illumination pattern projected onto the surface of the target object 30 comprises a plurality of lines.
• the illumination pattern may have a different structure.
• different shapes may be projected onto the surface of the target object 30.
• the distance between the laser array 5 and the surface of the target object 30 is determined. Determining the distance between the laser array 5 and the surface of the target object 30 enables a magnification factor of the illumination pattern to be calculated and allows the apparatus 1 to be operated in a non-static or hand-held mode.
• the distance between the laser array 5 and the surface of the target object 30 may be calculated using triangulation of the illumination pattern projected onto the surface of the target object 30. Triangulation using a projected pattern is a conventional method with which the person skilled in the art will be familiar. Alternatively, a time of flight method may be employed, wherein a laser pulse is projected onto the surface of the target object 30 and the time taken for the scattered or reflected laser to be detected is measured. The distance may then be calculated in a manner familiar to those skilled in the art. The distance between the laser array 5 and the surface of the target object 30 may also be calculated using known methods based on interferometry which will be apparent to those skilled in the art.
• the depth profiling apparatus may comprise a second light source 50.
• the distance between the laser array 5 and the surface of the target object 30 may be determined by using the second light source 50 as shown in Figure 6.
• the second laser light source 50 may be a second array of lasers or alternatively, a single laser.
• the laser used in the second light source 50 may be a VCSEL.
• the second laser light source 50 is collimated and positioned at an angle ⁇ with respect to the laser projector 16 and a second illumination pattern, independent of the illumination pattern obtained from the laser array 5, is projected onto the surface of the target object 30.
• the second illumination pattern may then be captured using the image capture device 10.
• the position of the second illumination pattern on the surface of the target object 30 varies with the distance between the apparatus 1 and the target object 30.
• the position of the second illumination pattern and the angle ⁇ may be used by the processor 25 to determine the distance using suitable software stored in the memory 26.
• the apparatus 1 may be provided with an audible alarm (not shown) controlled by the processor 25.
• the processor 25 may be configured to actuate the audible alarm when the apparatus 1 is at a distance from the target object 30 which allows the surface of the target object 30 to be profiled.
• separate regions of the laser array 5 may be individually addressed so that a time -varying illumination pattern may be obtained which can improve the accuracy of the triangulation-based distance determination hereinbefore described.
• the duty cycle of the laser array 5 may be reduced.
• Operation of the laser array 5 may be synchronized with that of the image capture device 10 to reduce power consumption.
• the shape of individual lasers may be varied to produce any two-dimensional shape using a lithographic mask for example circles, squares or trapeziums.
• An illumination pattern may therefore be produced combining different shapes projected onto the surface of the target object 30.
• the laser array 5 may include individual VCSELs having different shapes to produce a different illumination pattern from those hereinbefore described.
• Such an illumination pattern has the advantage that individual VCSELs within the array 5 may be identified based on the illumination pattern observed. Since lasers of different shapes may be operated in parallel, variations in the active area of the individual lasers may be limited to the range of +/- 10 %.
• the laser array 5 is supported by a chip.
• Figure 7 shows a chip 60 according to one embodiment.
• the chip 60 comprises first and second chip regions 61, 62 which may be contacted separately to a power supply to allow electronic switching between homogenous illumination and structured illumination. If all lasers are operated, an illumination pattern having a rectangular homogeneous intensity pattern is obtained. By addressing only one of the chip regions 61, 62, every alternate row is illuminated resulting in a striped pattern, to allow measurement of the distance between the array 5 and the surface of the target object 30. It will be appreciated by those skilled in the art that more than two areas of the chip can be addressed using known methods.
• the laser array 5 may be arranged so that individuals lasers may be switched on and off. This feature has the advantage of reducing ambiguity between features of the illumination pattern captured by the image capture device 10.
• a diffraction grating may be added to each individual laser.
• the addition of a diffraction grating is a wafer-scale process.
• the diffraction grating may stabilize the polarization of the emitted laser light.
• the image capture device may be provided with a polarizer to decrease the amount of ambient light captured. Ambient light is noise with respect to the captured illumination pattern which is of interest.
• the polarization direction of individual lasers in the array 5 may be varied. In this way, two or more illumination patterns may be obtained from the array, and detected by a camera with correct polarizer's. This would avoid additional electronics to have to switch the individual lasers on or off and would advantageously allow the use of time-of- flight and triangulation methods at the same time.
• the term "comprising” does not exclude other elements or steps and that the indefinite article "a” or “an” does not exclude a plurality.
• a single processor may fulfill the functions of several items recited in the claims. The mere fact that certain measures are recited in mutually different dependent claims does not indicate that a combination of these measures cannot be used to an advantage. Any reference signs in the claims should not be construed as limiting the scope of the claims.

Landscapes

• Health & Medical Sciences (AREA)
• Life Sciences & Earth Sciences (AREA)
• Physics & Mathematics (AREA)
• Engineering & Computer Science (AREA)
• Surgery (AREA)
• Animal Behavior & Ethology (AREA)
• Pathology (AREA)
• General Physics & Mathematics (AREA)
• Biomedical Technology (AREA)
• Heart & Thoracic Surgery (AREA)
• Medical Informatics (AREA)
• Molecular Biology (AREA)
• Veterinary Medicine (AREA)
• Biophysics (AREA)
• General Health & Medical Sciences (AREA)
• Public Health (AREA)
• Dentistry (AREA)
• Oral & Maxillofacial Surgery (AREA)
• Computer Vision & Pattern Recognition (AREA)
• Dermatology (AREA)
• Length Measuring Devices By Optical Means (AREA)
• Measurement Of Optical Distance (AREA)
• Semiconductor Lasers (AREA)
• Character Input (AREA)

Priority Applications (6)

Applications Claiming Priority (2)

Publications (1)

Family

ID=48628752

Family Applications (1)

Country Status (7)

Cited By (5)

Families Citing this family (18)

Citations (7)

Family Cites Families (17)

• 2013
  • 2013-05-03 BR BR112014028135A patent/BR112014028135A2/pt not_active Application Discontinuation
  • 2013-05-03 WO PCT/IB2013/053534 patent/WO2013171613A1/en not_active Ceased
  • 2013-05-03 JP JP2015512155A patent/JP2015524050A/ja not_active Ceased
  • 2013-05-03 CN CN201380023599.4A patent/CN104284625B/zh not_active Expired - Fee Related
  • 2013-05-03 EP EP13729455.9A patent/EP2849644A1/en not_active Withdrawn
  • 2013-05-03 RU RU2014150348A patent/RU2633922C2/ru not_active IP Right Cessation
  • 2013-05-03 US US14/400,580 patent/US9797708B2/en not_active Expired - Fee Related

Patent Citations (7)

Also Published As

Similar Documents

Legal Events