WO2013116299A1 - Method and apparatus for measuring the three dimensional structure of a surface - Google Patents
Method and apparatus for measuring the three dimensional structure of a surface Download PDFInfo
- Publication number
- WO2013116299A1 WO2013116299A1 PCT/US2013/023789 US2013023789W WO2013116299A1 WO 2013116299 A1 WO2013116299 A1 WO 2013116299A1 US 2013023789 W US2013023789 W US 2013023789W WO 2013116299 A1 WO2013116299 A1 WO 2013116299A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- images
- coordinate system
- sequence
- sharpness
- volume
- Prior art date
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/204—Image signal generators using stereoscopic image cameras
- H04N13/207—Image signal generators using stereoscopic image cameras using a single 2D image sensor
- H04N13/221—Image signal generators using stereoscopic image cameras using a single 2D image sensor using the relative movement between cameras and objects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
- G06T17/10—Constructive solid geometry [CSG] using solid primitives, e.g. cylinders, cubes
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
- G01B11/00—Measuring arrangements characterised by the use of optical techniques
- G01B11/002—Measuring arrangements characterised by the use of optical techniques for measuring two or more coordinates
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
- G01B11/00—Measuring arrangements characterised by the use of optical techniques
- G01B11/24—Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
- G01B11/00—Measuring arrangements characterised by the use of optical techniques
- G01B11/30—Measuring arrangements characterised by the use of optical techniques for measuring roughness or irregularity of surfaces
- G01B11/303—Measuring arrangements characterised by the use of optical techniques for measuring roughness or irregularity of surfaces using photoelectric detection means
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/50—Depth or shape recovery
- G06T7/55—Depth or shape recovery from multiple images
- G06T7/571—Depth or shape recovery from multiple images from focus
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2200/00—Indexing scheme for image data processing or generation, in general
- G06T2200/04—Indexing scheme for image data processing or generation, in general involving 3D image data
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2200/00—Indexing scheme for image data processing or generation, in general
- G06T2200/08—Indexing scheme for image data processing or generation, in general involving all processing steps from image acquisition to 3D model generation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10016—Video; Image sequence
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10028—Range image; Depth image; 3D point clouds
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30108—Industrial image inspection
- G06T2207/30124—Fabrics; Textile; Paper
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30108—Industrial image inspection
- G06T2207/30136—Metal
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2219/00—Indexing scheme for manipulating 3D models or images for computer graphics
- G06T2219/20—Indexing scheme for editing of 3D models
- G06T2219/2004—Aligning objects, relative positioning of parts
Definitions
- the present disclosure is directed to a non-transitory computer readable medium including software instructions to cause a computer processor to:receive, with an online computerized inspection system, a sequence of images of a moving surface of a web material, wherein the sequence of images is captured with a stationary imaging sensor including a camera and a telecentric lens having a focal plane aligned at a non-zero viewing angle with respect to an x-y plane of a surface coordinate system; align a reference point on the surface in each image in the sequence to form a registered sequence of images; stack the registered sequence of images along a z direction in a camera coordinate system to form a volume, wherein each image in the registered sequence of images comprises a layer in the volume; compute a sharpness of focus value for each pixel within the volume, wherein the pixels lie in a plane normal to the z direction in the camera coordinate system; compute, based on the sharpness of focus values, a depth of maximum focus value z m for each pixel within the volume
- the present disclosure is directed to a method including translating an imaging sensor relative to a surface, wherein the sensor includes a lens with a focal plane aligned at a non-zero viewing angle with respect to an x-y plane of a surface coordinate system; imaging the surface with the imaging sensor to acquire a sequence of images; estimating the three dimensional locations of points on the surface to provide a set of three dimensional points representing the surface; and processing the set of three dimensional points to generate a range- map of the surface in a selected coordinate system.
- FIG. 3 is a flowchart illustrating another method for determining the structure of a surface using the apparatus of FIG. 1.
- FIG. 6 is a photograph of three images obtained by the optical inspection apparatus in Example 1.
- FIGS. 9A-C are surface reconstructions formed using the apparatus of FIG. 1 as described in Example 3 at viewing angles ⁇ of 22.3°, 38.1°, and 46.5°, respectively.
- FIG. 1 is a schematic illustration of a sensor system 10, which is used to image a surface 14 of a material 12.
- the surface 14 is moving along the direction of the arrow A along the direction y s at a known speed toward the imaging sensor system 18, and includes a plurality of features 16 having a three-dimensional (3D) structure (extending along the direction z s ).
- the surface 14 may be moving away from the imaging sensor system 18 at a known speed.
- the translation direction of the surface 14 with respect to the imaging sensor system 18, or the number and/or position of the imaging sensors 18 with respect to the surface 14, may be varied as desired so that the imaging sensor system 18 may obtain a more complete view of areas of the surface 14, or of particular parts of the features 16.
- the imaging sensor system 18 includes a lens system 20 and a sensor included in, for example, the CCD or CMOS camera 22. At least one optional light source 32 may be used to illuminate the surface 14.
- the lens 20 has a focal plane 24 that is aligned at a non-zero angle ⁇ with respect to an x- y plane of the surface coordinate system of the surface 14.
- the viewing angle ⁇ between the lens focal plane and the x-y plane of the surface coordinate system may be selected depending on the characteristics of the surface 14 and the features 16 to be analyzed by the system 10.
- ⁇ is an acute angle less than 90°, assuming an arrangement such as in FIG. 1 wherein the translating surface 14 is moving toward the imaging sensor system 18.
- the viewing angle ⁇ is about 20° to about 60°, and an angle of about 40° has been found to be useful.
- the viewing angle ⁇ may be periodically or constantly varied as the surface 14 is imaged to provide a more uniform and/or complete view of the features 16.
- the sensor system 10 includes a processor 30, which may be internal, external or remote from the imaging sensor system 18.
- the processor 30 analyzes a series of images of the moving surface 14, which are obtained by the imaging sensor system 18.
- the amount that an image must be translated to register it with another image in the sequence depends on the translation of the surface 14 between images. If the translation speed of the surface 14 is known, the motion of the surface 14 sample from one image to the next as obtained by the imaging sensor system 18 is also known, and the processor 30 need only determine how much, and in which direction, the image should be translated per unit motion of the surface 14. This determination made by the processor 30 depends on, for example, the properties of the imaging sensor system 18, the focus of the lens 20, the viewing angle ⁇ of the focal plane 24 with respect to the x-y plane of the surface coordinate system, and the rotation (if any) of the camera 22.
- a modified Laplacian sharpness metric may be applied to compute the quantity
- Partial derivatives can be computed using finite differences. The intuition behind this metric is that it can be thought of as an edge detector - clearly regions of sharp focus will have more distinct edges than out-of-focus regions.
- a median filter may be used to aggregate the results locally around each pixel in the sequence of images.
- the processor 30 computes a sharpness of focus volume, similar to the volume formed in earlier steps by stacking the registered images along the z c direction. To form the sharpness of focus volume, the processor replaces each (x,y) pixel value in the registered image volume by the corresponding sharpness of focus measurement for that pixel. Each layer (corresponding to an x-y plane in the plane x c -y c ) in this registered stack is now a "sharpness of focus" image, with the layers registered as before, so that an image location corresponding to the same physical location on the surface 14 are aligned.
- the sharpness of focus values observed moving through different layers in the z c -direction comes to a maximum value when the point imaged at that location comes into focus (i.e., when it intersects with the focal plane 24 of the camera 22), and that the sharpness value will decrease moving away from that layer in either direction along the z c axis.
- the processor 30 estimates the 3D location of each point on the surface 14 by approximating the theoretical location of the slice in the sharpness of focus volume with the sharpest focus through that point.
- the processor approximates this theoretical location of sharpest focus by fitting a Gaussian curve to the measured sharpness of focus values at each location (x,y) through slice depths z c in the sharpness of focus volume.
- the model for sharpness of focus values as a function of slice de th z c is given by
- an approximate algorithm can be used that executes more quickly without substantially sacrificing accuracy.
- a quadratic function can be fit to the sharpness profile samples at each location (x,y), but only using the samples near the location with the maximum sharpness value. So, for each point on the surface, first the depth is found with the highest sharpness value, and a few samples are selected on either side of this depth. A quadratic function is fit to these few samples using the standard Least-Squares formulation, which can be solved in closed form.
- the parabola in the quadratic function may open upwards - in this case, the result of the fit is discarded, and the depth of the maximum sharpness sample is simply used instead. Otherwise, the depth is taken as the location of the theoretical maximum of the quadratic function, which may in general lie between two of the discrete samples.
- the processor 30 estimates the 3D location of each point on the surface of the sample. This point cloud is then converted into a surface model of the surface 14 using standard triangular meshing algorithms.
- step 502 the processor 30 approximates the sharpness of focus for each pixel in the newly acquired image using an appropriate algorithm such as, for example, the modified Laplacian sharpness metric described in detail in the discussion of the batch process above.
- step 504 the processor 30 then computes a
- step 506 based on the apparent shift of the surface in the last image in the sequence, the processor finds transitional points on the surface 14 that have just exited the field of view of the lens 20, but which were in the field of view in the previous image in the sequence.
- step 508 the processor then estimates the 3D location of all such transitional points. Each time a new image is received in the sequence, the processor repeats the estimation of the 3D location of the transitional points, then accumulates these 3D locations to form a point cloud representative of the surface 14.
- step 502 may be performed in one thread, while steps 504-508 occur in another thread.
- step 510 the point cloud is further processed as described in FIG. 4 to form a range map of the surface 14.
- the surface analysis method and apparatus described herein are particularly well suited, but are not limited to, inspecting and characterizing the structured surfaces 14 of web-like rolls of sample materials 12 that include piece parts such as the feature 16 (FIG. 1).
- the web rolls may contain a manufactured web material that may be any sheet-like material having a fixed dimension in one direction (cross-web direction generally normal to the direction A in FIG. 1) and either a predetermined or indeterminate length in the orthogonal direction (down- web direction generally parallel to direction A in FIG. 1). Examples include, but are not limited to, materials with textured, opaque surfaces such as metals, paper, woven materials, non-woven materials, glass, abrasives, flexible circuits or combinations thereof.
- the apparatus of FIG. 1 may be utilized in one or more inspection systems to inspect and characterize web materials during manufacture.
- unfinished web rolls may undergo processing on multiple process lines either within one web manufacturing plant, or within multiple manufacturing plants.
- a web roll is used as a source roll from which the web is fed into the manufacturing process.
- the web may be converted into sheets or piece parts, or may be collected again into a web roll and moved to a different product line or shipped to a different manufacturing plant, where it is then unrolled, processed, and again collected into a roll. This process is repeated until ultimately a finished sheet, piece part or web roll is produced.
- EPROM electronically erasable programmable read only memory
- EEPROM electronically erasable programmable read only memory
- flash memory a hard disk, a CD-ROM, a floppy disk, a cassette, magnetic media, optical media, or other computer-readable storage media.
- FIGS. 7A-7C show the reconstructed surface in the images shown in FIGS. 7A-7C from three different perspectives.
- the reconstructed surface in the images shown in FIGS. 7A-7C is realistic and accurate, and a number of quantities of interest could be computed from this surface, such as feature sharpness, size and orientation in the case of a web material such as an abrasive.
- FIG. 7C shows that that there are several gaps or holes in the reconstructed surface. These holes are a result of the manner in which the samples were imaged.
- the parts of the surface on the backside of tall features on the sample in this case, grains on the abrasive
- This lack of data could potentially be alleviated through the use of two cameras viewing the sample simultaneously from different angles.
- sample 1 showed a median range residual value of 12 ⁇
- Sample 2 showed a median range residual value of 9 ⁇ .
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Geometry (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Computer Graphics (AREA)
- Software Systems (AREA)
- Length Measuring Devices By Optical Means (AREA)
- Investigating Materials By The Use Of Optical Means Adapted For Particular Applications (AREA)
- Image Processing (AREA)
Abstract
Description
Claims
Priority Applications (6)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2014554952A JP2015513070A (en) | 2012-01-31 | 2013-01-30 | Method and apparatus for measuring the three-dimensional structure of a surface |
US14/375,002 US20150009301A1 (en) | 2012-01-31 | 2013-01-30 | Method and apparatus for measuring the three dimensional structure of a surface |
KR1020147023980A KR20140116551A (en) | 2012-01-31 | 2013-01-30 | Method and apparatus for measuring the three dimensional structure of a surface |
CN201380007293.XA CN104254768A (en) | 2012-01-31 | 2013-01-30 | Method and apparatus for measuring the three dimensional structure of a surface |
EP13743682.0A EP2810054A4 (en) | 2012-01-31 | 2013-01-30 | Method and apparatus for measuring the three dimensional structure of a surface |
BR112014018573A BR112014018573A8 (en) | 2012-01-31 | 2013-01-30 | METHOD AND APPARATUS FOR MEASURING THE THREE-DIMENSIONAL STRUCTURE OF A SURFACE |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201261593197P | 2012-01-31 | 2012-01-31 | |
US61/593,197 | 2012-01-31 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2013116299A1 true WO2013116299A1 (en) | 2013-08-08 |
Family
ID=48905775
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/US2013/023789 WO2013116299A1 (en) | 2012-01-31 | 2013-01-30 | Method and apparatus for measuring the three dimensional structure of a surface |
Country Status (7)
Country | Link |
---|---|
US (1) | US20150009301A1 (en) |
EP (1) | EP2810054A4 (en) |
JP (1) | JP2015513070A (en) |
KR (1) | KR20140116551A (en) |
CN (1) | CN104254768A (en) |
BR (1) | BR112014018573A8 (en) |
WO (1) | WO2013116299A1 (en) |
Cited By (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN104463964A (en) * | 2014-12-12 | 2015-03-25 | 英华达(上海)科技有限公司 | Method and equipment for acquiring three-dimensional model of object |
US9291877B2 (en) | 2012-11-15 | 2016-03-22 | Og Technologies, Inc. | Method and apparatus for uniformly focused ring light |
CN109886961A (en) * | 2019-03-27 | 2019-06-14 | 重庆交通大学 | Medium-and-large-sized measurement of cargo measurement method based on depth image |
WO2019211515A3 (en) * | 2018-05-03 | 2020-01-16 | Valmet Automation Oy | Measurement of elastic modulus of moving web |
WO2022074171A1 (en) | 2020-10-07 | 2022-04-14 | Ash Technologies Ltd., | System and method for digital image processing |
DE102021111706A1 (en) | 2021-05-05 | 2022-11-10 | Carl Zeiss Industrielle Messtechnik Gmbh | Method, measuring device and computer program product |
CN116045852A (en) * | 2023-03-31 | 2023-05-02 | 板石智能科技(深圳)有限公司 | Three-dimensional morphology model determining method and device and three-dimensional morphology measuring equipment |
Families Citing this family (77)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8908995B2 (en) | 2009-01-12 | 2014-12-09 | Intermec Ip Corp. | Semi-automatic dimensioning with imager on a portable device |
US9779546B2 (en) | 2012-05-04 | 2017-10-03 | Intermec Ip Corp. | Volume dimensioning systems and methods |
US10007858B2 (en) | 2012-05-15 | 2018-06-26 | Honeywell International Inc. | Terminals and methods for dimensioning objects |
JP6518187B2 (en) * | 2012-05-22 | 2019-05-22 | ユニリーバー・ナームローゼ・ベンノートシヤープ | Personal care composition |
US10321127B2 (en) | 2012-08-20 | 2019-06-11 | Intermec Ip Corp. | Volume dimensioning system calibration systems and methods |
US9939259B2 (en) | 2012-10-04 | 2018-04-10 | Hand Held Products, Inc. | Measuring object dimensions using mobile computer |
US9841311B2 (en) | 2012-10-16 | 2017-12-12 | Hand Held Products, Inc. | Dimensioning system |
US9080856B2 (en) | 2013-03-13 | 2015-07-14 | Intermec Ip Corp. | Systems and methods for enhancing dimensioning, for example volume dimensioning |
US10228452B2 (en) | 2013-06-07 | 2019-03-12 | Hand Held Products, Inc. | Method of error correction for 3D imaging device |
US9464885B2 (en) | 2013-08-30 | 2016-10-11 | Hand Held Products, Inc. | System and method for package dimensioning |
WO2015036432A1 (en) * | 2013-09-11 | 2015-03-19 | Novartis Ag | Contact lens inspection system and method |
US9823059B2 (en) | 2014-08-06 | 2017-11-21 | Hand Held Products, Inc. | Dimensioning system with guided alignment |
US9779276B2 (en) | 2014-10-10 | 2017-10-03 | Hand Held Products, Inc. | Depth sensor based auto-focus system for an indicia scanner |
US10775165B2 (en) | 2014-10-10 | 2020-09-15 | Hand Held Products, Inc. | Methods for improving the accuracy of dimensioning-system measurements |
US10810715B2 (en) | 2014-10-10 | 2020-10-20 | Hand Held Products, Inc | System and method for picking validation |
US9762793B2 (en) | 2014-10-21 | 2017-09-12 | Hand Held Products, Inc. | System and method for dimensioning |
US9557166B2 (en) * | 2014-10-21 | 2017-01-31 | Hand Held Products, Inc. | Dimensioning system with multipath interference mitigation |
US10060729B2 (en) | 2014-10-21 | 2018-08-28 | Hand Held Products, Inc. | Handheld dimensioner with data-quality indication |
US9752864B2 (en) | 2014-10-21 | 2017-09-05 | Hand Held Products, Inc. | Handheld dimensioning system with feedback |
US9897434B2 (en) | 2014-10-21 | 2018-02-20 | Hand Held Products, Inc. | Handheld dimensioning system with measurement-conformance feedback |
EP3209523A4 (en) | 2014-10-24 | 2018-04-25 | Magik Eye Inc. | Distance sensor |
EP3295118A4 (en) * | 2015-05-10 | 2018-11-21 | Magik Eye Inc. | Distance sensor |
US10488192B2 (en) | 2015-05-10 | 2019-11-26 | Magik Eye Inc. | Distance sensor projecting parallel patterns |
US9786101B2 (en) | 2015-05-19 | 2017-10-10 | Hand Held Products, Inc. | Evaluating image values |
US10066982B2 (en) | 2015-06-16 | 2018-09-04 | Hand Held Products, Inc. | Calibrating a volume dimensioner |
US20160377414A1 (en) | 2015-06-23 | 2016-12-29 | Hand Held Products, Inc. | Optical pattern projector |
US9857167B2 (en) | 2015-06-23 | 2018-01-02 | Hand Held Products, Inc. | Dual-projector three-dimensional scanner |
US9835486B2 (en) | 2015-07-07 | 2017-12-05 | Hand Held Products, Inc. | Mobile dimensioner apparatus for use in commerce |
EP3396313B1 (en) | 2015-07-15 | 2020-10-21 | Hand Held Products, Inc. | Mobile dimensioning method and device with dynamic accuracy compatible with nist standard |
US20170017301A1 (en) | 2015-07-16 | 2017-01-19 | Hand Held Products, Inc. | Adjusting dimensioning results using augmented reality |
US10094650B2 (en) | 2015-07-16 | 2018-10-09 | Hand Held Products, Inc. | Dimensioning and imaging items |
US10249030B2 (en) | 2015-10-30 | 2019-04-02 | Hand Held Products, Inc. | Image transformation for indicia reading |
US10225544B2 (en) | 2015-11-19 | 2019-03-05 | Hand Held Products, Inc. | High resolution dot pattern |
US10025314B2 (en) | 2016-01-27 | 2018-07-17 | Hand Held Products, Inc. | Vehicle positioning and object avoidance |
JP6525271B2 (en) * | 2016-03-28 | 2019-06-05 | 国立研究開発法人農業・食品産業技術総合研究機構 | Residual feed measuring device and program for measuring residual feed |
KR101804051B1 (en) * | 2016-05-17 | 2017-12-01 | 유광룡 | Centering apparatus for the inspection object |
US10339352B2 (en) | 2016-06-03 | 2019-07-02 | Hand Held Products, Inc. | Wearable metrological apparatus |
US9940721B2 (en) | 2016-06-10 | 2018-04-10 | Hand Held Products, Inc. | Scene change detection in a dimensioner |
US10163216B2 (en) | 2016-06-15 | 2018-12-25 | Hand Held Products, Inc. | Automatic mode switching in a volume dimensioner |
US10066986B2 (en) * | 2016-08-31 | 2018-09-04 | GM Global Technology Operations LLC | Light emitting sensor having a plurality of secondary lenses of a moveable control structure for controlling the passage of light between a plurality of light emitters and a primary lens |
US10265850B2 (en) * | 2016-11-03 | 2019-04-23 | General Electric Company | Robotic sensing apparatus and methods of sensor planning |
JP6493811B2 (en) * | 2016-11-19 | 2019-04-03 | スミックス株式会社 | Pattern height inspection device and inspection method |
WO2018106671A2 (en) | 2016-12-07 | 2018-06-14 | Magik Eye Inc. | Distance sensor including adjustable focus imaging sensor |
US10909708B2 (en) | 2016-12-09 | 2021-02-02 | Hand Held Products, Inc. | Calibrating a dimensioner using ratios of measurable parameters of optic ally-perceptible geometric elements |
US20200080838A1 (en) * | 2017-01-20 | 2020-03-12 | Intekplus Co.,Ltd. | Apparatus and method for measuring three-dimensional shape |
US11047672B2 (en) | 2017-03-28 | 2021-06-29 | Hand Held Products, Inc. | System for optically dimensioning |
EP3635619A4 (en) * | 2017-05-07 | 2021-01-20 | Manam Applications Ltd. | System and method for construction 3d modeling and analysis |
US10733748B2 (en) | 2017-07-24 | 2020-08-04 | Hand Held Products, Inc. | Dual-pattern optical 3D dimensioning |
KR101881702B1 (en) * | 2017-08-18 | 2018-07-24 | 성균관대학교산학협력단 | An apparatus to design add-on lens assembly and method thereof |
KR20200054326A (en) | 2017-10-08 | 2020-05-19 | 매직 아이 인코포레이티드 | Distance measurement using hardness grid pattern |
WO2019070806A1 (en) | 2017-10-08 | 2019-04-11 | Magik Eye Inc. | Calibrating a sensor system including multiple movable sensors |
US10679076B2 (en) | 2017-10-22 | 2020-06-09 | Magik Eye Inc. | Adjusting the projection system of a distance sensor to optimize a beam layout |
KR20200123849A (en) | 2018-03-20 | 2020-10-30 | 매직 아이 인코포레이티드 | Distance measurement using a projection pattern of variable densities |
JP7354133B2 (en) | 2018-03-20 | 2023-10-02 | マジック アイ インコーポレイテッド | Camera exposure adjustment for 3D depth sensing and 2D imaging |
US10518480B2 (en) * | 2018-04-02 | 2019-12-31 | Nanotronics Imaging, Inc. | Systems, methods, and media for artificial intelligence feedback control in additive manufacturing |
US11084225B2 (en) | 2018-04-02 | 2021-08-10 | Nanotronics Imaging, Inc. | Systems, methods, and media for artificial intelligence process control in additive manufacturing |
US10584962B2 (en) | 2018-05-01 | 2020-03-10 | Hand Held Products, Inc | System and method for validating physical-item security |
EP3803266A4 (en) | 2018-06-06 | 2022-03-09 | Magik Eye Inc. | Distance measurement using high density projection patterns |
US10753734B2 (en) * | 2018-06-08 | 2020-08-25 | Dentsply Sirona Inc. | Device, method and system for generating dynamic projection patterns in a confocal camera |
WO2020033169A1 (en) | 2018-08-07 | 2020-02-13 | Magik Eye Inc. | Baffles for three-dimensional sensors having spherical fields of view |
US11483503B2 (en) | 2019-01-20 | 2022-10-25 | Magik Eye Inc. | Three-dimensional sensor including bandpass filter having multiple passbands |
DE102019102231A1 (en) * | 2019-01-29 | 2020-08-13 | Senswork Gmbh | Device for detecting a three-dimensional structure |
CN109870459B (en) * | 2019-02-21 | 2021-07-06 | 武汉光谷卓越科技股份有限公司 | Track slab crack detection method for ballastless track |
US11474209B2 (en) | 2019-03-25 | 2022-10-18 | Magik Eye Inc. | Distance measurement using high density projection patterns |
CN110108230B (en) * | 2019-05-06 | 2021-04-16 | 南京理工大学 | Binary grating projection defocus degree evaluation method based on image difference and LM iteration |
CN114073075B (en) | 2019-05-12 | 2024-06-18 | 魔眼公司 | Mapping three-dimensional depth map data onto two-dimensional images |
KR20220054673A (en) | 2019-09-10 | 2022-05-03 | 나노트로닉스 이미징, 인코포레이티드 | Systems, methods and media for manufacturing processes |
US11639846B2 (en) | 2019-09-27 | 2023-05-02 | Honeywell International Inc. | Dual-pattern optical 3D dimensioning |
CN110705097B (en) * | 2019-09-29 | 2023-04-14 | 中国航发北京航空材料研究院 | Method for removing weight of nondestructive testing data of aeroengine rotating part |
CN110715616B (en) * | 2019-10-14 | 2021-09-07 | 中国科学院光电技术研究所 | Structured light micro-nano three-dimensional morphology measurement method based on focusing evaluation algorithm |
EP4065929A4 (en) | 2019-12-01 | 2023-12-06 | Magik Eye Inc. | Enhancing triangulation-based three-dimensional distance measurements with time of flight information |
JP2023508501A (en) | 2019-12-29 | 2023-03-02 | マジック アイ インコーポレイテッド | Association between 3D coordinates and 2D feature points |
US11688088B2 (en) | 2020-01-05 | 2023-06-27 | Magik Eye Inc. | Transferring the coordinate system of a three-dimensional camera to the incident point of a two-dimensional camera |
KR102354359B1 (en) * | 2020-02-11 | 2022-01-21 | 한국전자통신연구원 | Method of removing outlier of point cloud and appraratus implementing the same |
CN113188474B (en) * | 2021-05-06 | 2022-09-23 | 山西大学 | Image sequence acquisition system for imaging of high-light-reflection material complex object and three-dimensional shape reconstruction method thereof |
WO2022237544A1 (en) * | 2021-05-11 | 2022-11-17 | 梅卡曼德(北京)机器人科技有限公司 | Trajectory generation method and apparatus, and electronic device and storage medium |
KR102529593B1 (en) * | 2022-10-25 | 2023-05-08 | 성형원 | Device and method acquiring 3D information about an object |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR20020054223A (en) * | 2000-12-27 | 2002-07-06 | 오길록 | An Apparatus and Method to Measuring Dimensions of 3D Object on a Moving Conveyor |
US7177740B1 (en) * | 2005-11-10 | 2007-02-13 | Beijing University Of Aeronautics And Astronautics | Method and apparatus for dynamic measuring three-dimensional parameters of tire with laser vision |
US20090245616A1 (en) * | 2008-03-26 | 2009-10-01 | De La Ballina Freres | Method and apparatus for visiometric in-line product inspection |
US20110193953A1 (en) * | 2010-02-05 | 2011-08-11 | Applied Vision Company, Llc | System and method for estimating the height of an object using tomosynthesis-like techniques |
JP2011174879A (en) * | 2010-02-25 | 2011-09-08 | Canon Inc | Apparatus and method of estimating position and orientation |
Family Cites Families (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6603103B1 (en) * | 1998-07-08 | 2003-08-05 | Ppt Vision, Inc. | Circuit for machine-vision system |
KR101199475B1 (en) * | 2008-12-22 | 2012-11-09 | 한국전자통신연구원 | Method and apparatus for reconstruction 3 dimension model |
US20110304618A1 (en) * | 2010-06-14 | 2011-12-15 | Qualcomm Incorporated | Calculating disparity for three-dimensional images |
JP5663331B2 (en) * | 2011-01-31 | 2015-02-04 | オリンパス株式会社 | Control apparatus, endoscope apparatus, diaphragm control method, and program |
CN102314683B (en) * | 2011-07-15 | 2013-01-16 | 清华大学 | Computational imaging method and imaging system based on nonplanar image sensor |
-
2013
- 2013-01-30 KR KR1020147023980A patent/KR20140116551A/en not_active Application Discontinuation
- 2013-01-30 CN CN201380007293.XA patent/CN104254768A/en active Pending
- 2013-01-30 WO PCT/US2013/023789 patent/WO2013116299A1/en active Application Filing
- 2013-01-30 US US14/375,002 patent/US20150009301A1/en not_active Abandoned
- 2013-01-30 JP JP2014554952A patent/JP2015513070A/en active Pending
- 2013-01-30 EP EP13743682.0A patent/EP2810054A4/en not_active Withdrawn
- 2013-01-30 BR BR112014018573A patent/BR112014018573A8/en not_active IP Right Cessation
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR20020054223A (en) * | 2000-12-27 | 2002-07-06 | 오길록 | An Apparatus and Method to Measuring Dimensions of 3D Object on a Moving Conveyor |
US7177740B1 (en) * | 2005-11-10 | 2007-02-13 | Beijing University Of Aeronautics And Astronautics | Method and apparatus for dynamic measuring three-dimensional parameters of tire with laser vision |
US20090245616A1 (en) * | 2008-03-26 | 2009-10-01 | De La Ballina Freres | Method and apparatus for visiometric in-line product inspection |
US20110193953A1 (en) * | 2010-02-05 | 2011-08-11 | Applied Vision Company, Llc | System and method for estimating the height of an object using tomosynthesis-like techniques |
JP2011174879A (en) * | 2010-02-25 | 2011-09-08 | Canon Inc | Apparatus and method of estimating position and orientation |
Non-Patent Citations (1)
Title |
---|
See also references of EP2810054A4 * |
Cited By (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9291877B2 (en) | 2012-11-15 | 2016-03-22 | Og Technologies, Inc. | Method and apparatus for uniformly focused ring light |
US9594293B2 (en) | 2012-11-15 | 2017-03-14 | Og Technologies, Inc. | Method and apparatus for uniformly focused ring light |
CN104463964A (en) * | 2014-12-12 | 2015-03-25 | 英华达(上海)科技有限公司 | Method and equipment for acquiring three-dimensional model of object |
TWI607862B (en) * | 2014-12-12 | 2017-12-11 | 英華達股份有限公司 | Method and apparatus of generating a 3-d model from a, object |
CN112074717A (en) * | 2018-05-03 | 2020-12-11 | 维美德自动化有限公司 | Measurement of modulus of elasticity of moving web |
WO2019211515A3 (en) * | 2018-05-03 | 2020-01-16 | Valmet Automation Oy | Measurement of elastic modulus of moving web |
US11828736B2 (en) | 2018-05-03 | 2023-11-28 | Valmet Automation Oy | Measurement of elastic modulus of moving web |
CN112074717B (en) * | 2018-05-03 | 2024-01-19 | 维美德自动化有限公司 | Measurement of elastic modulus of moving web |
CN109886961A (en) * | 2019-03-27 | 2019-06-14 | 重庆交通大学 | Medium-and-large-sized measurement of cargo measurement method based on depth image |
CN109886961B (en) * | 2019-03-27 | 2023-04-11 | 重庆交通大学 | Medium and large cargo volume measuring method based on depth image |
WO2022074171A1 (en) | 2020-10-07 | 2022-04-14 | Ash Technologies Ltd., | System and method for digital image processing |
DE102021111706A1 (en) | 2021-05-05 | 2022-11-10 | Carl Zeiss Industrielle Messtechnik Gmbh | Method, measuring device and computer program product |
CN116045852A (en) * | 2023-03-31 | 2023-05-02 | 板石智能科技(深圳)有限公司 | Three-dimensional morphology model determining method and device and three-dimensional morphology measuring equipment |
Also Published As
Publication number | Publication date |
---|---|
BR112014018573A2 (en) | 2017-06-20 |
EP2810054A4 (en) | 2015-09-30 |
BR112014018573A8 (en) | 2017-07-11 |
KR20140116551A (en) | 2014-10-02 |
US20150009301A1 (en) | 2015-01-08 |
JP2015513070A (en) | 2015-04-30 |
EP2810054A1 (en) | 2014-12-10 |
CN104254768A (en) | 2014-12-31 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20150009301A1 (en) | Method and apparatus for measuring the three dimensional structure of a surface | |
Orteu et al. | Multiple-camera instrumentation of a single point incremental forming process pilot for shape and 3D displacement measurements: methodology and results | |
CN104655011B (en) | A kind of noncontact optical measurement method of irregular convex surface object volume | |
US8582824B2 (en) | Cell feature extraction and labeling thereof | |
Percoco et al. | Experimental investigation on camera calibration for 3D photogrammetric scanning of micro-features for micrometric resolution | |
Traxler et al. | Experimental comparison of optical inline 3D measurement and inspection systems | |
Liu et al. | Real-time 3D surface measurement in additive manufacturing using deep learning | |
Shaheen et al. | Characterisation of a multi-view fringe projection system based on the stereo matching of rectified phase maps | |
TW201445133A (en) | Online detection method for three dimensional imperfection of panel | |
Audfray et al. | A novel approach for 3D part inspection using laser-plane sensors | |
Cheng et al. | An effective coaxiality measurement for twist drill based on line structured light sensor | |
Hodgson et al. | Novel metrics and methodology for the characterisation of 3D imaging systems | |
US20140362371A1 (en) | Sensor for measuring surface non-uniformity | |
Ding et al. | Automatic 3D reconstruction of SEM images based on Nano-robotic manipulation and epipolar plane images | |
US20140240720A1 (en) | Linewidth measurement system | |
Setti et al. | Shape measurement system for single point incremental forming (SPIF) manufacts by using trinocular vision and random pattern | |
US20220011238A1 (en) | Method and system for characterizing surface uniformity | |
Qi et al. | Quality inspection guided laser processing of irregular shape objects by stereo vision measurement: application in badminton shuttle manufacturing | |
Helmli et al. | Ultra high speed 3D measurement with the focus variation method | |
Percoco et al. | 3D image based modelling for inspection of objects with micro-features, using inaccurate calibration patterns: an experimental contribution | |
Munaro et al. | Fast 2.5 D model reconstruction of assembled parts with high occlusion for completeness inspection | |
Zolfaghari et al. | On-line 3D geometric model reconstruction | |
Kubátová et al. | Data Preparing for Reverse Engineering | |
To et al. | On-line measurement of wrinkle using machine vision | |
Hu et al. | Edge measurement using stereovision and phase-shifting methods |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 13743682 Country of ref document: EP Kind code of ref document: A1 |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2013743682 Country of ref document: EP |
|
ENP | Entry into the national phase |
Ref document number: 2014554952 Country of ref document: JP Kind code of ref document: A |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
REG | Reference to national code |
Ref country code: BR Ref legal event code: B01A Ref document number: 112014018573 Country of ref document: BR |
|
ENP | Entry into the national phase |
Ref document number: 20147023980 Country of ref document: KR Kind code of ref document: A |
|
ENP | Entry into the national phase |
Ref document number: 112014018573 Country of ref document: BR Kind code of ref document: A2 Effective date: 20140728 |