WO2020168685A1 - 一种三维扫描视点规划方法、装置及计算机可读存储介质 - Google Patents

一种三维扫描视点规划方法、装置及计算机可读存储介质 Download PDF

Info

Publication number
WO2020168685A1
WO2020168685A1 PCT/CN2019/097952 CN2019097952W WO2020168685A1 WO 2020168685 A1 WO2020168685 A1 WO 2020168685A1 CN 2019097952 W CN2019097952 W CN 2019097952W WO 2020168685 A1 WO2020168685 A1 WO 2020168685A1
Authority
WO
WIPO (PCT)
Prior art keywords
point cloud
viewpoint
low
digital model
viewpoint planning
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2019/097952
Other languages
English (en)
French (fr)
Inventor
刘晓利
廖一帆
陈海龙
彭翔
汤其剑
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen University
Original Assignee
Shenzhen University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen University filed Critical Shenzhen University
Priority to US17/431,737 priority Critical patent/US11776217B2/en
Publication of WO2020168685A1 publication Critical patent/WO2020168685A1/zh
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F30/00Computer-aided design [CAD]
    • G06F30/20Design optimisation, verification or simulation
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00Manipulating three-dimensional [3D] models or images for computer graphics
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00Three-dimensional [3D] image rendering
    • G06T15/10Geometric effects
    • G06T15/20Perspective computation
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00Three-dimensional [3D] modelling for computer graphics
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00Manipulating three-dimensional [3D] models or images for computer graphics
    • G06T19/003Navigation within 3D models or images
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/70Determining position or orientation of objects or cameras
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/80Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration
    • G06T7/85Stereo camera calibration
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20Image signal generators
    • H04N13/204Image signal generators using stereoscopic image cameras
    • H04N13/207Image signal generators using stereoscopic image cameras using a single two-dimensional [2D] image sensor
    • H04N13/221Image signal generators using stereoscopic image cameras using a single two-dimensional [2D] image sensor using the relative movement between cameras and objects
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20Image signal generators
    • H04N13/275Image signal generators from three-dimensional [3D] object models, e.g. computer-generated stereoscopic image signals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20Image signal generators
    • H04N13/282Image signal generators for generating image signals corresponding to three or more geometrical viewpoints, e.g. multi-view systems
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30244Camera pose
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2210/00Indexing scheme for image generation or computer graphics
    • G06T2210/12Bounding box

Definitions

  • the present invention relates to the technical field of computer vision, in particular to a method, device and computer-readable storage medium for 3D scanning viewpoint planning.
  • binocular stereo vision measurement is widely used in manufacturing fields such as automobiles, aviation, and aerospace due to its high measurement accuracy, fast measurement speed, and good adaptability.
  • the single measurement range of the binocular stereo vision measurement system is the limited range in the common field of view of the left and right cameras. Therefore, when measuring complex parts, due to the limited field of view of the camera and the obstruction of the object under test, it usually requires more Secondary transformation of the pose relationship between the camera and the measured object, through multiple measurements and data splicing to obtain complete three-dimensional data of the part.
  • the pose of the camera also known as the sensor
  • it is usually achieved by the technician manually adjusting the pose of the camera.
  • the main purpose of the embodiments of the present invention is to provide a 3D scanning viewpoint planning method, device, and computer-readable storage medium, which can at least solve the problem of accurate measurement caused by manually adjusting the camera pose when 3D scanning objects in the related art The problem of low performance and long measurement process.
  • the first aspect of the embodiments of the present invention provides a method for 3D scanning viewpoint planning, which includes:
  • the low-precision digital model is used to characterize the spatial information of the object to be scanned;
  • the viewpoint information is determined as the target viewpoint set when the three-dimensional sensor scans the object to be scanned as a whole; the viewpoint information includes viewpoint position information and viewpoint direction information.
  • a second aspect of the embodiments of the present invention provides a three-dimensional scanning viewpoint planning device, which includes:
  • An acquisition module used to acquire a low-precision digital model of the object to be scanned; the low-precision digital model is used to characterize the spatial information of the object to be scanned;
  • the calculation module is configured to perform viewpoint planning calculations on the point cloud data on the low-precision digital model according to a preset viewpoint planning algorithm
  • the determining module is used to determine all the calculated viewpoint information as the target viewpoint set when the three-dimensional sensor scans the object to be scanned when it is determined that the preset algorithm termination condition is met; the viewpoint information includes viewpoints Position information and viewpoint direction information.
  • a third aspect of the embodiments of the present invention provides an electronic device, which includes: a processor, a memory, and a communication bus;
  • the communication bus is used to implement connection and communication between the processor and the memory
  • the processor is configured to execute one or more programs stored in the memory to implement the steps of any one of the above-mentioned three-dimensional scanning viewpoint planning methods.
  • a fourth aspect of the embodiments of the present invention provides a computer-readable storage medium, the computer-readable storage medium stores one or more programs, and the one or more programs can be processed by one or more The device executes to implement the steps of any one of the above-mentioned three-dimensional scanning viewpoint planning methods.
  • the viewpoint is performed on the point cloud data in the low-precision digital model based on the viewpoint planning algorithm Plan and calculate, and then respectively calculate the position and line of sight of multiple viewpoints in space when the three-dimensional sensor needs to perform three-dimensional scanning of the object to be scanned.
  • Calculating the viewpoint of the 3D sensor through the viewpoint planning algorithm can effectively improve the accuracy and scientificity of the sensor pose determination, greatly improve the efficiency of viewpoint planning, and reduce the time consumption of the entire 3D measurement process.
  • FIG. 1 is a schematic diagram of the basic flow of a three-dimensional scanning viewpoint planning method provided by the first embodiment of the present invention
  • FIG. 2 is a schematic diagram of a low-precision digital model provided by the first embodiment of the present invention.
  • FIG. 3 is a schematic diagram of the basic flow of the viewpoint planning algorithm provided by the first embodiment of the present invention.
  • FIG. 4 is a schematic diagram of a point cloud normal vector on the surface of an object provided by the first embodiment of the present invention.
  • FIG. 5 is a schematic diagram of matrix division provided by the first embodiment of the present invention.
  • FIG. 8 is a schematic diagram of the construction of the minimum bounding box provided by the first embodiment of the present invention.
  • FIG. 9 is a schematic structural diagram of a three-dimensional scanning viewpoint planning device provided by a second embodiment of the present invention.
  • FIG. 10 is a schematic structural diagram of an electronic device provided by a third embodiment of the present invention.
  • FIG. 1 is a schematic diagram of the basic flow of the 3D scanning viewpoint planning method provided in this embodiment.
  • the 3D scanning viewpoint planning method proposed in this embodiment includes the following steps:
  • Step 101 Obtain a low-precision digital model of the object to be scanned; the low-precision digital model is used to represent the spatial information of the object to be scanned.
  • the object to be scanned can be a known object or an unknown object, where the known object is an object whose spatial information is known in advance by the system, so when planning its viewpoint, it can be directly extracted
  • the object can be scanned by a depth camera to obtain its low-precision digital model.
  • Figure 2 is a schematic diagram of a low-precision digital model provided by this embodiment.
  • the method further includes: performing edge trimming processing on the low-precision digital model.
  • the edge of the model is trimmed in this embodiment, where the edge trimming includes edge repair processing and stray edge removal processing, Edge repairing is also to mending the edges.
  • Step 102 Perform a viewpoint planning calculation on the point cloud data on the low-precision digital model according to a preset viewpoint planning algorithm.
  • the point cloud data is a collection of point data on the surface of the object.
  • a viewpoint planning algorithm is performed on the point cloud data to calculate the position and posture in space when the three-dimensional sensor performs three-dimensional scanning of the object.
  • the viewpoint planning algorithm in this embodiment specifically includes the following steps:
  • Step 301 Perform surface normal estimation on the point cloud data on the low-precision digital model to obtain the point cloud normal vector of the surface of the object to be scanned;
  • the PCL point cloud library is used to estimate the surface normal of the point cloud to obtain the normal vector of the object surface. Please refer to Fig. 4, and then save the estimated normal vector of the point cloud.
  • Step 302 Transform the point cloud normal vector to a spherical coordinate system, and divide the point cloud normal vector in the spherical coordinate system into a matrix of M rows ⁇ N columns;
  • the normal vector of the point cloud To transform the coordinate system, transfer the three components of the normal vector to the spherical coordinate system using the azimuth angle ⁇ and the pitch angle It is represented by the radial distance r.
  • the radial distance may preferably be 1.
  • the azimuth and elevation angles can be divided into a group every n degrees to determine the row size and column size of the matrix, that is, M is 360/n, N is 180/n.
  • M is 360/n
  • N 180/n.
  • it can be divided into groups of 10 degrees in azimuth and 10 degrees in elevation
  • the normal line of the point cloud can be divided into a 36 ⁇ 18 matrix.
  • Figure 5 shows a schematic diagram of the matrix division provided for this example.
  • histogram statistics are performed on the number of point cloud normal vectors in each grouping area in the matrix, and the corresponding point cloud information is saved, as shown in FIG. 6 for the point cloud method provided in this embodiment Histogram of vector quantity.
  • the normal vector of the point cloud in the spherical coordinate system corresponding to the center of the window is transformed into the rectangular coordinate system to obtain the pointing direction of the three-dimensional sensor.
  • the size of the window is determined based on the viewing angle of the three-dimensional sensor and the visibility constraint condition; the visibility constraint condition is that the product of the normal vector of the point cloud and the view direction of the three-dimensional sensor is less than zero.
  • the equivalent field of view angle is 28°.
  • the optional point cloud normal vector direction does not exceed 76°.
  • the point cloud normal vector is used in the example of the present invention. If the direction does not exceed 45°, the corresponding window size is 9 ⁇ 9.
  • the range of azimuth angle is 0° ⁇ 360°
  • the range of pitch angle is 0° ⁇ 180°.
  • the window is moved circularly with each matrix as the center . If the window size exceeds the value range, the matrix needs to be expanded to a 44 ⁇ 26 matrix. For example, when the center is at (10°, 10°), the range of matrix rows is (330° ⁇ 360°, 10° ⁇ 50°), and the range of columns is (30° ⁇ 0°, 10° ⁇ 50°) .
  • the field of view space corresponding to the three-dimensional sensor is estimated, that is, the size of the viewing cone, and the minimum bounding box constructed is divided to achieve coverage of the point cloud space in the window, as shown in Figure 7.
  • the OBB Oriented Bounding Box
  • the PCA Principal Component Analysis, principal component analysis
  • the coordinate axis is redefined for the discrete point cloud contained in the window.
  • the PCA analysis first obtains the covariance matrix through the covariance calculation formula, and then calculates Take the eigenvalues and eigenvectors of the covariance matrix.
  • the eigenvectors corresponding to the largest eigenvalues are the directions of the three main axes of OBB.
  • the centroid of the point cloud under the current coordinate axis can be determined.
  • FIG. 8 shows a schematic diagram of the construction of the minimum bounding box provided by this embodiment.
  • Step 305 Determine the viewpoint information of the three-dimensional sensor in space based on n i , C i and the focusing distance D of the three-dimensional sensor.
  • the three-dimensional sensor based on the previously calculated pointing direction of the three-dimensional sensor, the three-dimensional coordinates of a point on the object pointed to by the three-dimensional sensor, and the focus distance of the three-dimensional sensor, the three-dimensional sensor’s specific area on the object is calculated through coordinate inverse calculation.
  • the three-dimensional coordinates of the space when scanning is performed that is, the position of the viewpoint, and the connection between the three-dimensional coordinates of a point on the object and the calculated three-dimensional coordinates of the three-dimensional sensor is the viewpoint direction.
  • the viewpoint position information and the viewpoint direction information constitute the viewpoint information.
  • Step 103 When it is determined that the preset algorithm termination condition is met, all the calculated viewpoint information is determined as the target viewpoint set of the three-dimensional sensor when the object to be scanned is scanned as a whole; the viewpoint information includes viewpoint position information and viewpoint direction information.
  • the target viewpoint set in this embodiment includes information corresponding to multiple viewpoints required by the three-dimensional sensor to realize the overall scanning of the object.
  • an algorithm termination condition is preset. When the algorithm termination condition is not met, the viewpoint planning algorithm of this embodiment is continued to be executed, and when the algorithm termination condition is met, the algorithm operation is stopped. After determining the set of target viewpoints, they are imported into a movement control system equipped with a 3D sensor. The system controls the movement of the 3D sensor according to the viewpoints calculated by the algorithm to realize automatic 3D scanning of objects and avoid manual operation. It is cumbersome, reduces the redundancy of measurement data, and greatly improves the efficiency of the system.
  • the algorithm termination condition is associated with the number of point clouds currently to be calculated N present ; N present is determined from the remaining point clouds after deleting the previously calculated point clouds The number of point clouds to be calculated.
  • the calculated point cloud is deleted.
  • the algorithm termination condition can be the completion of all point cloud data calculations in the low-precision digital model.
  • the algorithm can also end when all point cloud data is left.
  • a preset value for example, 1%
  • N present for example, it can be determined whether N present is less than 100, and if so, the algorithm is terminated.
  • the viewpoint planning algorithm is performed on the point cloud data in the low-precision digital model based on the viewpoint planning algorithm, and then the three-dimensional The sensor needs the position and line of sight direction of multiple viewpoints in space when the object to be scanned is scanned in three dimensions. Calculating the viewpoint of the 3D sensor through the viewpoint planning algorithm can improve the accuracy and scientificity of the sensor pose determination, greatly improve the efficiency of viewpoint planning, and reduce the time consumption of the entire measurement process.
  • This embodiment shows a three-dimensional scanning viewpoint planning device. Please refer to FIG. 9 for details.
  • the three-dimensional scanning viewpoint planning device of this embodiment includes:
  • the obtaining module 901 is used to obtain a low-precision digital model of the object to be scanned; the low-precision digital model is used to represent the spatial information of the object to be scanned;
  • the calculation module 902 is configured to perform viewpoint planning calculations on the point cloud data on the low-precision digital model according to a preset viewpoint planning algorithm
  • the determining module 903 is used to determine all the calculated viewpoint information as the target viewpoint set of the three-dimensional sensor when the object to be scanned is scanned as a whole when it is determined that the preset algorithm termination condition is met; the viewpoint information includes viewpoint position information and viewpoint Direction information.
  • the acquisition module 901 can scan the object through a depth camera to obtain its low-precision digital model.
  • a viewpoint planning algorithm is performed on the point cloud data to calculate the three-dimensional sensor pair.
  • the target viewpoint set in this embodiment includes three-dimensional The sensor realizes the information corresponding to multiple viewpoints required for the overall scanning of the object.
  • the 3D scanning viewpoint planning device further includes: a processing module, which is used to perform edge trimming processing on the low-precision digital model; optionally, the edge trimming processing includes: edge repair processing and stray processing Edge removal processing, edge repair processing is to mending the edges.
  • the calculation module 902 is specifically configured to perform viewpoint planning calculations on the point cloud data on the low-precision digital model after edge trimming processing according to a preset viewpoint planning algorithm.
  • the size of the window is determined based on the viewing angle of the three-dimensional sensor and the visibility constraint condition; the visibility constraint condition is that the product of the point cloud normal vector and the view point direction of the three-dimensional sensor is less than zero.
  • the calculation module 902 is specifically configured to use the principal component analysis PCA method to obtain the feature vector of the point cloud in the window with the largest number of point cloud normal vectors, and to reconstruct the feature vector based on the obtained feature vector.
  • the coordinate axis determine the centroid of the point cloud in the window with the largest number of point cloud normals under the redefined coordinate axis, and based on the redefined coordinate axis and centroid, determine the point in the window with the largest number of point cloud normals Cloud builds the smallest bounding box.
  • the determining module 903 is specifically configured to determine that all the calculated viewpoint information is that the three-dimensional sensor is present when it is determined that the preset algorithm termination condition is met based on the current number of point clouds N present to be calculated.
  • the set of target viewpoints when the object to be scanned is scanned as a whole; N present is the number of point clouds to be calculated determined from the remaining point clouds after deleting the previously calculated point clouds.
  • the viewpoint planning algorithm is performed on the point cloud data in the low-precision digital model based on the viewpoint planning algorithm, and then the 3D sensors are calculated separately
  • the viewpoint of the three-dimensional sensor can improve the accuracy and scientificity of the sensor pose determination, greatly improve the efficiency of viewpoint planning, and reduce the time consumption of the entire measurement process.
  • This embodiment provides an electronic device. As shown in FIG. 10, it includes a processor 1001, a memory 1002, and a communication bus 1003.
  • the communication bus 1003 is used to implement connection and communication between the processor 1001 and the memory 1002; processing
  • the device 1001 is configured to execute one or more computer programs stored in the memory 1002 to implement at least one step in the three-dimensional scanning viewpoint planning method in the first embodiment.
  • This embodiment also provides a computer-readable storage medium, which is included in any method or technology for storing information (such as computer-readable instructions, data structures, computer program modules, or other data). Volatile or non-volatile, removable or non-removable media.
  • Computer readable storage media include but are not limited to RAM (Random Access Memory), ROM (Read-Only Memory, read-only memory), EEPROM (Electrically Erasable Programmable read only memory, charged Erasable Programmable Read-Only Memory) ), flash memory or other storage technology, CD-ROM (Compact Disc Read-Only Memory), digital versatile disk (DVD) or other optical disk storage, magnetic cassettes, magnetic tapes, magnetic disk storage or other magnetic storage devices, Or any other medium that can be used to store desired information and can be accessed by a computer.
  • the computer-readable storage medium in this embodiment may be used to store one or more computer programs, and the stored one or more computer programs may be executed by a processor to implement at least one step of the method in the first embodiment.
  • This embodiment also provides a computer program, which can be distributed on a computer-readable medium and executed by a computer-readable device to implement at least one step of the method in the first embodiment; and in some cases At least one of the steps shown or described can be performed in a different order from the order described in the foregoing embodiment.
  • This embodiment also provides a computer program product, including a computer-readable device, and the computer-readable device stores the computer program as shown above.
  • the computer-readable device in this embodiment may include the computer-readable storage medium as shown above.
  • communication media usually contain computer-readable instructions, data structures, computer program modules, or other data in a modulated data signal such as a carrier wave or other transmission mechanism, and may include any information delivery medium. Therefore, the present invention is not limited to any specific combination of hardware and software.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Graphics (AREA)
  • Software Systems (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Computer Hardware Design (AREA)
  • General Engineering & Computer Science (AREA)
  • Geometry (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Evolutionary Computation (AREA)
  • Computing Systems (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Length Measuring Devices By Optical Means (AREA)

Abstract

本发明实施例公开了一种三维扫描视点规划方法、装置及计算机可读存储介质,在获取待扫描物体的低精度数字化模型之后,基于视点规划算法来对低精度数字化模型中的点云数据进行视点规划计算,然后分别计算出三维传感器需要对待扫描物体进行三维扫描时,在空间中的多个视点的位置和视线方向。通过视点规划算法计算三维传感器的视点,可以有效提高传感器位姿确定的准确性、科学性,并使得视点规划的效率大大提升,降低整个三维测量过程的耗时。

Description

一种三维扫描视点规划方法、装置及计算机可读存储介质 技术领域
本发明涉及计算机视觉技术领域,尤其涉及一种三维扫描视点规划方法、装置及计算机可读存储介质。
背景技术
在光学测量方法中,双目立体视觉测量由于其测量精度高、测量速度快、适应性好等特点被广泛用于汽车、航空、航天等制造领域。双目立体视觉测量系统的单次测量范围为左右相机的公共视场内的有限范围,从而在对复杂零件进行测量时,由于相机测量视场的有限以及被测物体的自身遮挡,通常需要多次变换相机与被测物体间的位姿关系,通过多次测量并进行数据拼接而获得零件完整的三维数据。目前在改变相机(亦称作传感器)相对于被测物体之间的位姿时,通常是基于技术人员手动调整相机的位姿来实现,这种方式完全依靠技术人员的经验和技术水平来进行调整,而技术人员的操作行为通常缺乏全局性、准确性,容易造成相机重复测量或遗漏测量等问题,并且人力的工作效率较低,使得整个测量过程耗时较长。
技术问题
本发明实施例的主要目的在于提供一种三维扫描视点规划方法、装置及计算机可读存储介质,至少能够解决相关技术中在对物体进行三维扫描时,通过人工调整相机位姿所导致的测量准确性较低、测量过程耗时较长的问题。
技术解决方案
为实现上述目的,本发明实施例第一方面提供了一种三维扫描视点规划方法,该方法包括:
获取待扫描物体的低精度数字化模型;所述低精度数字化模型用于表征所述待扫描物体的空间信息;
根据预设的视点规划算法,对所述低精度数字化模型上的点云数 据进行视点规划计算;
在确定符合预设的算法终止条件时,将所计算出的所有视点信息确定为三维传感器在对所述待扫描物体进行整体扫描时的目标视点集合;所述视点信息包括视点位置信息和视点方向信息。
为实现上述目的,本发明实施例第二方面提供了一种三维扫描视点规划装置,该装置包括:
获取模块,用于获取待扫描物体的低精度数字化模型;所述低精度数字化模型用于表征所述待扫描物体的空间信息;
计算模块,用于根据预设的视点规划算法,对所述低精度数字化模型上的点云数据进行视点规划计算;
确定模块,用于在确定符合预设的算法终止条件时,将所计算出的所有视点信息确定为三维传感器在对所述待扫描物体进行整体扫描时的目标视点集合;所述视点信息包括视点位置信息和视点方向信息。
为实现上述目的,本发明实施例第三方面提供了一种电子装置,该电子装置包括:处理器、存储器和通信总线;
所述通信总线用于实现所述处理器和存储器之间的连接通信;
所述处理器用于执行所述存储器中存储的一个或者多个程序,以实现上述任意一种三维扫描视点规划方法的步骤。
为实现上述目的,本发明实施例第四方面提供了一种计算机可读存储介质,该计算机可读存储介质存储有一个或者多个程序,所述一个或者多个程序可被一个或者多个处理器执行,以实现上述任意一种三维扫描视点规划方法的步骤。
有益效果
根据本发明实施例提供的三维扫描视点规划方法、装置及计算机可读存储介质,在获取待扫描物体的低精度数字化模型之后,基于视点规划算法来对低精度数字化模型中的点云数据进行视点规划计算,然后分别计算出三维传感器需要对待扫描物体进行三维扫描时,在空间中的多个视点的位置和视线方向。通过视点规划算法计算三维传感 器的视点,可以有效提高传感器位姿确定的准确性、科学性,并使得视点规划的效率大大提升,降低整个三维测量过程的耗时。
本发明其他特征和相应的效果在说明书的后面部分进行阐述说明,且应当理解,至少部分效果从本发明说明书中的记载变的显而易见。
附图说明
为了更清楚地说明本发明实施例或现有技术中的技术方案,下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本发明的一些实施例,对于本领域技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。
图1为本发明第一实施例提供的三维扫描视点规划方法的基本流程示意图;
图2为本发明第一实施例提供的低精度数字化模型的示意图;
图3为本发明第一实施例提供的视点规划算法的基本流程示意图;
图4为本发明第一实施例提供的物体表面的点云法向量的示意图;
图5为本发明第一实施例提供的矩阵划分示意图;
图6为本发明第一实施例提供的点云法向量数量的直方统计图;
图7为本发明第一实施例提供的最小包围盒划分示意图;
图8为本发明第一实施例提供的最小包围盒构建示意图;
图9为本发明第二实施例提供的三维扫描视点规划装置的结构示意图;
图10为本发明第三实施例提供的电子装置的结构示意图。
本发明的实施方式
为使得本发明的发明目的、特征、优点能够更加的明显和易懂,下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本发明一部分实 施例,而非全部实施例。基于本发明中的实施例,本领域技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本发明保护的范围。
第一实施例:
为了解决相关技术中在对物体进行三维扫描时,通过人工调整相机位姿所导致的测量准确性较低、测量过程耗时较长的技术问题,本实施例提出了一种三维扫描视点规划方法,如图1所示为本实施例提供的三维扫描视点规划方法的基本流程示意图,本实施例提出的三维扫描视点规划方法包括以下的步骤:
步骤101、获取待扫描物体的低精度数字化模型;低精度数字化模型用于表征待扫描物体的空间信息。
具体的,在本实施例中,待扫描物体可以是已知物体和未知物体,其中,已知物体为系统预先知道其空间信息的物体,那么在对其进行视点规划时,则是可以直接提取表征其空间信息的低精度数字化模型;而对于未知物体,空间信息未知,在实际应用中,则可以通过深度相机对物体进行扫描,从而得到其低精度数字化模型。如图2所示为本实施例提供的一种低精度数字化模型的示意图。
在本实施例一种可选的实施方式中,在获取待扫描物体的低精度数字化模型之后,还包括:对低精度数字化模型进行边缘修整处理。
具体的,在实际应用中,为尽量提高低精度数字化模型的效果和准确性,本实施例中对模型的边缘进行修整处理,其中,边缘修整处理包括:边缘修补处理和杂散边缘去除处理,边缘修补处理也即对边缘进行补缝。
步骤102、根据预设的视点规划算法,对低精度数字化模型上的点云数据进行视点规划计算。
具体的,点云数据为物体表面的点数据集合,本实施例中对点云数据进行视点规划算法,来计算三维传感器对物体进行三维扫描时,在空间中的位置和姿态。
在本实施例一种可选的实施方式中,如图3所示,本实施例中的视点规划算法具体包括以下步骤:
步骤301、对低精度数字化模型上的点云数据进行表面法线估计,得到待扫描物体表面的点云法向量;
在本实施例中,由得到的低精度数字化模型,利用PCL点云库对点云表面法线进行估计,得到物体表面的法向量,请参阅图4,然后保存估计的点云法向量。
步骤302、将点云法向量转化至球坐标系下,并将处于球坐标系下的点云法向量划分为M行×N列的矩阵;
在本实施例中,对的点云法向量
Figure PCTCN2019097952-appb-000001
进行坐标系的转化,将法向量的三个分量转到球坐标系下用方位角θ,俯仰角
Figure PCTCN2019097952-appb-000002
径向距离r来表示,在实际应用中,径向距离优选的可以取1。应当说明的是,本实施例中在进行矩阵划分时,可以分别按照方位角和俯仰角的每n度分为一组,来确定矩阵的行大小和列大小,也即M为360/n,N为180/n,例如,可以按照方位角每10度一组,俯仰角每10度一组进行划分,将点云法线分成36×18的矩阵。如图5所示为本实例提供的矩阵划分示意图。
步骤303、对矩阵内的点云法向量数量进行直方图统计,并以矩阵上的每个分组区域为中心,将预设大小的窗口在矩阵上进行循环移动,然后统计每次窗口中的点云法向量数量,确定点云法向量数量最大的窗口,再基于点云法向量数量最大的窗口中心的点云法向量,确定三维传感器的指向方向n i=(x i,y i,z i);
具体的,本实施例中对落在矩阵内每个分组区域中的点云法向量数量进行直方图统计,并保存对应的点云信息,如图6所示为本实施例提供的点云法向量数量的直方统计图。另外,将所述的窗口中心所对应的球坐标系下的点云法向量转化到直角坐标系下,得到三维传感 器的指向方向。
在本实施例一种可选的实施方式中,窗口的大小基于三维传感器的视场角以及可见性约束条件确定;可见性约束条件为点云法向量与三维传感器的视点方向的乘积小于零。特别说明的是本实例中等效视场角取28°,为满足可见性约束,理论上可选点云法向量方向不超过76°,而为了减小误差,本发明实例中以点云法向量方向不超过45°,则对应的窗口大小为9×9。
在选定窗口大小之后,依次移动窗口,并统计每次窗口中的点云法向量数量,找出以某个法向量方向为中心的最大窗口,记录保存窗口中的点云信息和窗口中心的法向量方向。
特别注意的是,因为在球坐标系,方位角的取值范围是0°~360°,俯仰角的取值范围是0°~180°,当以每个矩阵值为中心,循环移动窗口时,窗口大小超出取值范围则需要扩展矩阵,扩展为44×26的矩阵。如中心在(10°,10°)时,矩阵行取值范围是(330°~360°,10°~50°),列取值范围是(30°~0°,10°~50°)。
步骤304、对点云法向量数量最大的窗口内的点云构建最小包围盒,并基于三维传感器的视场空间大小对最小包围盒进行划分,确定所划分的空间中心的三维坐标C i=(x i,y i,z i);
在本实施例中,根据系统的参数,估算出三维传感器对应的视场空间,即视锥体的大小,划分所构建的最小包围盒,实现对窗口内点云空间的覆盖,如图7所示为本实施例提供的最小包围盒划分示意图,记录保存每次划分的视锥体的中心位置坐标。
在本实施例一种可选的实施方式中,采用OBB(Oriented Bounding Box,有向包围盒)思路来构建最小包围盒,也即采用PCA(Principal Component Analysis,主元分析)方法获得点云法向量数量最大的窗口内的点云的特征向量,并基于所获取的特征向量重新定义坐标轴;确定在重新定义的坐标轴下,点云法向量数量最大的窗口内的点云的质心,并基于重新定义的坐标轴以及质心,对点云法向量数量最大的窗 口内的点云构建最小包围盒。
具体的,在本实施例中,对窗口内所包含的离散点云重新定义坐标轴。可以利用PCL点云库,进行PCA分析而获得特征向量,也即OBB的三个主轴或点云的三个主方向,PCA分析是先通过协方差的计算公式,得到协方差矩阵,然后再求取协方差矩阵的特征值和特征向量,其中最大特征值所对应的特征向量,即为OBB三个主轴的方向,重新定义坐标轴之后,即可确定点云在当前坐标轴下的质心。利用所获得的主方向和质心,将输入点云转换至原点,且主方向与坐标系方向重回,建立变换到原点的点云的包围盒,而构建出最小包围盒。如图8所示为本实施例提供的最小包围盒构建示意图。
步骤305、基于n i、C i以及三维传感器的对焦距离D,确定三维传感器在空间中的视点信息。
具体的,本实施例中基于前述所计算到的三维传感器的指向方向、三维传感器所指向的物体上一点的三维坐标以及三维传感器的对焦距离,通过坐标反算求出三维传感器对物体上特定区域进行扫描时所处的空间三维坐标,也即视点位置,而物体上一点的三维坐标与所计算的三维传感器的三维坐标的连线即为视点方向,视点位置信息和视点方向信息组成视点信息。
步骤103、在确定符合预设的算法终止条件时,将所计算出的所有视点信息确定为三维传感器在对待扫描物体进行整体扫描时的目标视点集合;视点信息包括视点位置信息和视点方向信息。
具体的,在实际应用中,要实现三维传感器对物体的三维扫描,需要控制三维传感器在多个不同的视点进行扫描,才能获取物体的全部三维信息。本实施例中的目标视点集合中则包括三维传感器实现对物体的整体扫描所需要的多个视点所对应的信息。本实施例中预设有一算法终止条件,在不满足算法终止条件时,继续执行本实施例的视点规划算法,而满足算法终止条件时,则停止算法运算。在确定目标视点集合之后,将其导入至搭载有三维传感器的移动控制系统中,由系统根据算法计算出的各视点来控制三维传感器移动,来实现对物体 的自动三维扫描,避免了人工操作的繁琐,减少了测量数据的冗余,大大的提高了系统的效率。
在本实施例一种可选的实施方式中,算法终止条件关联于当前待计算的点云数量N present;N present为删除此前已计算的点云之后,从所剩余的点云中所确定的待计算点云的数量。
具体的,若所划分的点云计算完成之后,则将所计算的点云进行删除,在本实施例中,基于即将计算的点云数量来确定是否满足算法终止条件,在本实施例的一种极端情况下,算法终止条件可以是低精度数字化模型中的所有点云数据计算完成。当然,为了提升本实施例的计算效率,通常随着算法的持续进行,所剩余的点云数量越来越少,变得越来越稀疏,继续执行算法的意义和必要性较小,基于此,本实施例中也可以在所有点云数据还有剩余时即结束算法。
进一步地,在本实施例一种可选的实施方式中,基于当前待计算的点云数量N present确定符合预设的算法终止条件包括:根据当前待计算的点云数量N present与初始点云数量N total,确定点云比率p=N present/N total;在p低于预设的比率阈值时,确定符合预设的算法终止条件。
具体的,本实施例中根据当前待计算的点云数量与初始数量的比值低于预设值(例如1%)时,确定当前点云数量较少,点云较为稀疏,而终止算法,当然,在另一些实施例中,可以单纯的基于N present来确定是否终止算法,例如可以判断N present是否小于100,若是,则终止算法。
根据本发明实施例提供的三维扫描视点规划方法,在获取待扫描物体的低精度数字化模型之后,基于视点规划算法来对低精度数字化模型中的点云数据进行视点规划计算,然后分别计算出三维传感器需要对待扫描物体进行三维扫描时,在空间中的多个视点的位置和视线方向。通过视点规划算法计算三维传感器的视点,可以提高传感器位姿确定的准确性、科学性,并使得视点规划的效率大大提升,降低整 个测量过程的耗时。
第二实施例:
本实施例示出了一种三维扫描视点规划装置,具体请参见图9,为了解决现有技术中在对物体进行三维扫描时,通过人工调整相机位姿所导致的测量准确性较低、测量过程耗时较长的技术问题,本实施例的三维扫描视点规划装置包括:
获取模块901,用于获取待扫描物体的低精度数字化模型;低精度数字化模型用于表征待扫描物体的空间信息;
计算模块902,用于根据预设的视点规划算法,对低精度数字化模型上的点云数据进行视点规划计算;
确定模块903,用于在确定符合预设的算法终止条件时,将所计算出的所有视点信息确定为三维传感器在对待扫描物体进行整体扫描时的目标视点集合;视点信息包括视点位置信息和视点方向信息。
具体的,在待扫描物体为未知物体时,获取模块901可以通过深度相机对物体进行扫描,从而得到其低精度数字化模型,本实施例中对点云数据进行视点规划算法,来计算三维传感器对物体进行三维扫描时,在空间中的位置和姿态。另外,在实际应用中,要实现三维传感器对物体的三维扫描,需要控制三维传感器在多个不同的视点进行扫描,才能获取物体的全部三维信息,本实施例中的目标视点集合中则包括三维传感器实现对物体的整体扫描所需要的多个视点所对应的信息。
在本实施例的一些实施方式中,三维扫描视点规划装置还包括:处理模块,处理模块用于对低精度数字化模型进行边缘修整处理;可选的,边缘修整处理包括:边缘修补处理和杂散边缘去除处理,边缘修补处理也即对边缘进行补缝。对应的,计算模块902具体用于根据预设的视点规划算法,对边缘修整处理后的低精度数字化模型上的点云数据进行视点规划计算。
在本实施例的一些实施方式中,计算模块902具体用于对低精度数字化模型上的点云数据进行表面法线估计,得到待扫描物体表面的点云法向量;将点云法向量转化至球坐标系下,并将处于球坐标系下 的点云法向量划分为M行×N列的矩阵;对矩阵内每个分组区域的点云法向量数量进行直方图统计,并以每个分组区域为中心,将预设大小的窗口在矩阵上进行循环移动,然后统计每次窗口中的点云法向量数量,确定点云法向量数量最大的窗口,再基于点云法向量数量最大的窗口中心的点云法向量,确定三维传感器的指向方向n i=(x i,y i,z i);对点云法向量数量最大的窗口内的点云构建最小包围盒,并基于三维传感器的视场空间大小对最小包围盒进行划分,确定所划分的空间中心的三维坐标C i=(x i,y i,z i);基于n i、C i以及三维传感器的对焦距离D,确定三维传感器在空间中的视点信息。
进一步地,在本实施例的一些实施方式中,窗口的大小基于三维传感器的视场角以及可见性约束条件确定;可见性约束条件为点云法向量与三维传感器的视点方向的乘积小于零。
进一步地,在本实施例的一些实施方式中,计算模块902具体用于采用主元分析PCA方法获得点云法向量数量最大的窗口内的点云的特征向量,并基于所获取的特征向量重新定义坐标轴;确定在重新定义的坐标轴下,点云法向量数量最大的窗口内的点云的质心,并基于重新定义的坐标轴以及质心,对点云法向量数量最大的窗口内的点云构建最小包围盒。
在本实施例的一些实施方式中,确定模块903具体用于在基于当前待计算的点云数量N present确定符合预设的算法终止条件时,将所计算出的所有视点信息确定为三维传感器在对待扫描物体进行整体扫描时的目标视点集合;N present为删除此前已计算的点云之后,从所剩余的点云中所确定的待计算点云的数量。
进一步地,在本实施例的一些实施方式中,确定模块903具体用于根据当前待计算的点云数量N present与初始点云数量N total,确定点云比率p=N present/N total;在p低于预设的比率阈值时,确定符合预设的算法终止条件。
采用本实施例提供的三维扫描视点规划装置,在获取待扫描物体的低精度数字化模型之后,基于视点规划算法来对低精度数字化模型中的点云数据进行视点规划计算,然后分别计算出三维传感器需要对 待扫描物体进行三维扫描时,在空间中的多个视点的位置和视线方向。通过视点规划算法计算三维传感器的视点,可以提高传感器位姿确定的准确性、科学性,并使得视点规划的效率大大提升,降低整个测量过程的耗时。
第三实施例:
本实施例提供了一种电子装置,参见图10所示,其包括处理器1001、存储器1002及通信总线1003,其中:通信总线1003用于实现处理器1001和存储器1002之间的连接通信;处理器1001用于执行存储器1002中存储的一个或者多个计算机程序,以实现上述实施例一中的三维扫描视点规划方法中的至少一个步骤。
本实施例还提供了一种计算机可读存储介质,该计算机可读存储介质包括在用于存储信息(诸如计算机可读指令、数据结构、计算机程序模块或其他数据)的任何方法或技术中实施的易失性或非易失性、可移除或不可移除的介质。计算机可读存储介质包括但不限于RAM(Random Access Memory,随机存取存储器),ROM(Read-Only Memory,只读存储器),EEPROM(Electrically Erasable Programmable read only memory,带电可擦可编程只读存储器)、闪存或其他存储器技术、CD-ROM(Compact Disc Read-Only Memory,光盘只读存储器),数字多功能盘(DVD)或其他光盘存储、磁盒、磁带、磁盘存储或其他磁存储装置、或者可以用于存储期望的信息并且可以被计算机访问的任何其他的介质。
本实施例中的计算机可读存储介质可用于存储一个或者多个计算机程序,其存储的一个或者多个计算机程序可被处理器执行,以实现上述实施例一中的方法的至少一个步骤。
本实施例还提供了一种计算机程序,该计算机程序可以分布在计算机可读介质上,由可计算装置来执行,以实现上述实施例一中的方法的至少一个步骤;并且在某些情况下,可以采用不同于上述实施例所描述的顺序执行所示出或描述的至少一个步骤。
本实施例还提供了一种计算机程序产品,包括计算机可读装置, 该计算机可读装置上存储有如上所示的计算机程序。本实施例中该计算机可读装置可包括如上所示的计算机可读存储介质。
可见,本领域的技术人员应该明白,上文中所公开方法中的全部或某些步骤、系统、装置中的功能模块/单元可以被实施为软件(可以用计算装置可执行的计算机程序代码来实现)、固件、硬件及其适当的组合。在硬件实施方式中,在以上描述中提及的功能模块/单元之间的划分不一定对应于物理组件的划分;例如,一个物理组件可以具有多个功能,或者一个功能或步骤可以由若干物理组件合作执行。某些物理组件或所有物理组件可以被实施为由处理器,如中央处理器、数字信号处理器或微处理器执行的软件,或者被实施为硬件,或者被实施为集成电路,如专用集成电路。
此外,本领域普通技术人员公知的是,通信介质通常包含计算机可读指令、数据结构、计算机程序模块或者诸如载波或其他传输机制之类的调制数据信号中的其他数据,并且可包括任何信息递送介质。所以,本发明不限制于任何特定的硬件和软件结合。
以上内容是结合具体的实施方式对本发明实施例所作的进一步详细说明,不能认定本发明的具体实施只局限于这些说明。对于本发明所属技术领域的普通技术人员来说,在不脱离本发明构思的前提下,还可以做出若干简单推演或替换,都应当视为属于本发明的保护范围。

Claims (10)

  1. 一种三维扫描视点规划方法,其特征在于,包括:
    获取待扫描物体的低精度数字化模型;所述低精度数字化模型用于表征所述待扫描物体的空间信息;
    根据预设的视点规划算法,对所述低精度数字化模型上的点云数据进行视点规划计算;
    在确定符合预设的算法终止条件时,将所计算出的所有视点信息确定为三维传感器在对所述待扫描物体进行整体扫描时的目标视点集合;所述视点信息包括视点位置信息和视点方向信息。
  2. 如权利要求1所述的三维扫描视点规划方法,其特征在于,在根据预设的视点规划算法,对所述低精度数字化模型上的点云数据进行视点规划计算之前,还包括:
    对所述低精度数字化模型进行边缘修整处理;
    所述根据预设的视点规划算法,对所述低精度数字化模型上的点云数据进行视点规划计算包括:
    根据预设的视点规划算法,对边缘修整处理后的低精度数字化模型上的点云数据进行视点规划计算。
  3. 如权利要求1所述的三维扫描视点规划方法,其特征在于,所述确定符合预设的算法终止条件包括:
    基于当前待计算的点云数量N present确定符合预设的算法终止条件;所述N present为删除此前已计算的点云之后,从所剩余的点云中所确定的待计算点云的数量。
  4. 如权利要求3所述的三维扫描视点规划方法,其特征在于,所述基于当前待计算的点云数量N present确定符合预设的算法终止条件包括:
    根据当前待计算的点云数量N present与初始点云数量N total,确定点云比率p=N present/N total
    在所述p低于预设的比率阈值时,确定符合预设的算法终止条件。
  5. 如权利要求1至4中任意一项所述的三维扫描视点规划方法,其特征在于,所述对所述低精度数字化模型上的点云数据进行视点规划计算包括:
    对所述低精度数字化模型上的点云数据进行表面法线估计,得到所述待扫描物体表面的点云法向量;
    将所述点云法向量转化至球坐标系下,并将处于球坐标系下的所述点云法向量划分为M行×N列的矩阵;
    对所述矩阵内每个分组区域的点云法向量数量进行直方图统计,并以所述每个分组区域为中心,将预设大小的窗口在所述矩阵上进行循环移动,然后统计每次窗口中的点云法向量数量,确定所述点云法向量数量最大的窗口,再基于所述点云法向量数量最大的窗口中心的点云法向量,确定所述三维传感器的指向方向n i=(x i,y i,z i);
    对所述点云法向量数量最大的窗口内的点云构建最小包围盒,并基于所述三维传感器的视场空间大小对所述最小包围盒进行划分,确定所划分的空间中心的三维坐标C i=(x i,y i,z i);
    基于所述n i、C i以及所述三维传感器的对焦距离D,确定所述三维传感器在空间中的视点信息。
  6. 如权利要求5所述的三维扫描视点规划方法,其特征在于,所述窗口的大小基于所述三维传感器的视场角以及可见性约束条件确定;所述可见性约束条件为所述点云法向量与所述三维传感器的视点方向的乘积小于零。
  7. 如权利要求5所述的三维扫描视点规划方法,其特征在于,所述对所述点云法向量数量最大的窗口内的点云构建最小包围盒包括:
    采用主元分析PCA方法获得所述点云法向量数量最大的窗口内的点云的特征向量,并基于所获取的特征向量重新定义坐标轴;
    确定在重新定义的坐标轴下,所述点云法向量数量最大的窗口内的点云的质心,并基于所述重新定义的坐标轴以及所述质心,对所述点云法向量数量最大的窗口内的点云构建最小包围盒。
  8. 一种三维扫描视点规划装置,其特征在于,包括:
    获取模块,用于获取待扫描物体的低精度数字化模型;所述低精度数字化模型用于表征所述待扫描物体的空间信息;
    计算模块,用于根据预设的视点规划算法,对所述低精度数字化模型上的点云数据进行视点规划计算;
    确定模块,用于在确定符合预设的算法终止条件时,将所计算出的所有视点信息确定为三维传感器在对所述待扫描物体进行整体扫描时的目标视点集合;所述视点信息包括视点位置信息和视点方向信息。
  9. 一种电子装置,其特征在于,包括:处理器、存储器和通信总线;
    所述通信总线用于实现所述处理器和存储器之间的连接通信;
    所述处理器用于执行所述存储器中存储的一个或者多个程序,以实现如权利要求1至7中任意一项所述的三维扫描视点规划方法的步骤。
  10. 一种计算机可读存储介质,其特征在于,所述计算机可读存储介质存储有一个或者多个程序,所述一个或者多个程序可被一个或者多个处理器执行,以实现如权利要求1至7中任意一项所述的三维扫描视点规划方法的步骤。
PCT/CN2019/097952 2019-02-20 2019-07-26 一种三维扫描视点规划方法、装置及计算机可读存储介质 Ceased WO2020168685A1 (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US17/431,737 US11776217B2 (en) 2019-02-20 2019-07-26 Method for planning three-dimensional scanning viewpoint, device for planning three-dimensional scanning viewpoint, and computer readable storage medium

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201910125324.0 2019-02-20
CN201910125324.0A CN109977466B (zh) 2019-02-20 2019-02-20 一种三维扫描视点规划方法、装置及计算机可读存储介质

Publications (1)

Publication Number Publication Date
WO2020168685A1 true WO2020168685A1 (zh) 2020-08-27

Family

ID=67077019

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/097952 Ceased WO2020168685A1 (zh) 2019-02-20 2019-07-26 一种三维扫描视点规划方法、装置及计算机可读存储介质

Country Status (3)

Country Link
US (1) US11776217B2 (zh)
CN (1) CN109977466B (zh)
WO (1) WO2020168685A1 (zh)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113776452A (zh) * 2021-07-27 2021-12-10 中国铁道科学研究院集团有限公司标准计量研究所 一种圆柱形筒体的圆度测量方法及装置
CN114545434A (zh) * 2022-01-13 2022-05-27 燕山大学 一种路侧视角测速方法、系统、电子设备及存储介质
CN114626112A (zh) * 2022-03-24 2022-06-14 长春理工大学 一种基于边界检验的未知物体表面测量视点规划方法
CN115457133A (zh) * 2022-09-16 2022-12-09 长春工程学院 一种基于外形框架优先的三维点云数据存储方法
CN120655905A (zh) * 2025-08-19 2025-09-16 中国铁建电气化局集团有限公司 铁路通信设备的感兴趣区域确定方法、装置、设备及介质

Families Citing this family (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109977466B (zh) * 2019-02-20 2021-02-02 深圳大学 一种三维扫描视点规划方法、装置及计算机可读存储介质
CN117635815A (zh) * 2019-06-28 2024-03-01 上海交通大学 基于三维点云的初始视角控制和呈现方法及系统
JP7313998B2 (ja) * 2019-09-18 2023-07-25 株式会社トプコン 測量データ処理装置、測量データ処理方法および測量データ処理用プログラム
CN112733428B (zh) * 2020-12-17 2022-09-06 上海理工大学 一种光学测量的扫描姿态与覆盖路径规划方法
CN112902905A (zh) * 2021-01-20 2021-06-04 西安电子科技大学 一种基于高清3d扫描的地物谱测试方法及系统
CN115170625A (zh) * 2022-07-06 2022-10-11 浙江大学 基于曲面分割和icp配准算法的三维模型重建方法
CN115830217B (zh) * 2022-07-11 2025-07-15 深圳大学 待建模物体三维模型点云的生成方法、装置和系统
CN115159149B (zh) * 2022-07-28 2024-05-24 深圳市罗宾汉智能装备有限公司 一种基于视觉定位的取料卸货方法及其装置
CN115688260A (zh) * 2022-09-21 2023-02-03 浙江西图盟数字科技有限公司 一种尺寸报告生成方法、装置、设备及存储介质
CN115656238B (zh) * 2022-10-17 2023-05-12 中国科学院高能物理研究所 一种微区xrf元素分析与多维成像方法及系统
CN115758496B (zh) * 2022-12-28 2026-03-17 西安交通大学 一种面向叶片三维测量的视点规划方法及系统
CN116560410B (zh) * 2023-06-21 2025-12-02 西安交通大学 基于蒙特卡洛树搜索的无人机三维覆盖路径规划方法
CN117078765A (zh) * 2023-07-04 2023-11-17 浙江工业大学 一种基于信息驱动的回转体三维扫描视点动态规划方法
CN117314977B (zh) * 2023-08-28 2025-11-28 华侨大学 基于机器人扫描视点规划的工艺制品三维测量方法及装置
CN117496073B (zh) * 2023-12-29 2024-03-26 山东省国土测绘院 一种多时相实景三维模型的构建方法及系统
CN120198602B (zh) * 2025-05-26 2025-08-08 湖南大学 机器人三维重建设备视点规划方法、系统和计算机设备
CN120912788B (zh) * 2025-10-09 2025-12-09 南京航空航天大学 基于最佳扫描视点的大型飞机整体油箱三维扫描方法及装置

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102930536A (zh) * 2012-10-16 2013-02-13 深圳先进技术研究院 基于层次化结构的室内场景运动性分析与检测方法
CN103914837A (zh) * 2014-03-25 2014-07-09 西安电子科技大学 一种适用于多视角点云处理的圆柱形邻域及其搜索方法
CN104063894A (zh) * 2014-06-13 2014-09-24 中国科学院深圳先进技术研究院 点云三维模型重建方法及系统
CN105551039A (zh) * 2015-12-14 2016-05-04 深圳先进技术研究院 结构光三维扫描系统的标定方法及装置
WO2017167862A1 (en) * 2016-04-01 2017-10-05 Lego A/S Toy scanner
US20190005711A1 (en) * 2016-08-15 2019-01-03 Aquifi, Inc. System and method for three-dimensional scanning and for capturing a bidirectional reflectance distribution function
CN109977466A (zh) * 2019-02-20 2019-07-05 深圳大学 一种三维扫描视点规划方法、装置及计算机可读存储介质

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7208112B2 (en) * 2002-01-04 2007-04-24 Anchor Wall Systems, Inc. Concrete block and method of making same
DE10211262A1 (de) * 2002-03-14 2003-10-09 Tomec Imaging Systems Gmbh Verfahren und Vorrichtung zur Rekonstruktion und Darstellung von mehrdimensionalen Objekten aus ein- oder zweidimensionalen Bilddaten
CN102915559B (zh) * 2012-08-22 2015-04-29 北京航空航天大学 一种基于三维点云的实时透明物体gpu并行生成方法
US20140172377A1 (en) * 2012-09-20 2014-06-19 Brown University Method to reconstruct a surface from oriented 3-d points
CN103236064B (zh) * 2013-05-06 2016-01-13 东南大学 一种基于法向量的点云自动配准方法
CN103337071B (zh) * 2013-06-19 2016-03-30 北京理工大学 基于结构重建的皮下静脉三维可视化装置及方法
CN104408762A (zh) * 2014-10-30 2015-03-11 福州大学 利用单目和二维平台获取物体图像信息及三维模型的方法
CN107767375B (zh) * 2017-11-02 2021-06-29 广东电网有限责任公司电力科学研究院 一种点云质量评估方法及装置
CN108898662B (zh) * 2018-05-30 2022-05-27 中国人民解放军陆军勤务学院 基于点云数据的管线设施bim模型自动化重建方法
US11407111B2 (en) * 2018-06-27 2022-08-09 Abb Schweiz Ag Method and system to generate a 3D model for a robot scene

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102930536A (zh) * 2012-10-16 2013-02-13 深圳先进技术研究院 基于层次化结构的室内场景运动性分析与检测方法
CN103914837A (zh) * 2014-03-25 2014-07-09 西安电子科技大学 一种适用于多视角点云处理的圆柱形邻域及其搜索方法
CN104063894A (zh) * 2014-06-13 2014-09-24 中国科学院深圳先进技术研究院 点云三维模型重建方法及系统
CN105551039A (zh) * 2015-12-14 2016-05-04 深圳先进技术研究院 结构光三维扫描系统的标定方法及装置
WO2017167862A1 (en) * 2016-04-01 2017-10-05 Lego A/S Toy scanner
US20190005711A1 (en) * 2016-08-15 2019-01-03 Aquifi, Inc. System and method for three-dimensional scanning and for capturing a bidirectional reflectance distribution function
CN109977466A (zh) * 2019-02-20 2019-07-05 深圳大学 一种三维扫描视点规划方法、装置及计算机可读存储介质

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113776452A (zh) * 2021-07-27 2021-12-10 中国铁道科学研究院集团有限公司标准计量研究所 一种圆柱形筒体的圆度测量方法及装置
CN113776452B (zh) * 2021-07-27 2024-03-01 中国铁道科学研究院集团有限公司标准计量研究所 一种圆柱形筒体的圆度测量方法及装置
CN114545434A (zh) * 2022-01-13 2022-05-27 燕山大学 一种路侧视角测速方法、系统、电子设备及存储介质
CN114626112A (zh) * 2022-03-24 2022-06-14 长春理工大学 一种基于边界检验的未知物体表面测量视点规划方法
CN115457133A (zh) * 2022-09-16 2022-12-09 长春工程学院 一种基于外形框架优先的三维点云数据存储方法
CN115457133B (zh) * 2022-09-16 2025-12-23 长春工程学院 一种基于外形框架优先的三维点云数据存储方法
CN120655905A (zh) * 2025-08-19 2025-09-16 中国铁建电气化局集团有限公司 铁路通信设备的感兴趣区域确定方法、装置、设备及介质

Also Published As

Publication number Publication date
CN109977466B (zh) 2021-02-02
US11776217B2 (en) 2023-10-03
US20220139040A1 (en) 2022-05-05
CN109977466A (zh) 2019-07-05

Similar Documents

Publication Publication Date Title
WO2020168685A1 (zh) 一种三维扫描视点规划方法、装置及计算机可读存储介质
CN110335295B (zh) 一种基于tof相机的植物点云采集配准与优化方法
CN114310901B (zh) 用于机器人的坐标系标定方法、装置、系统以及介质
KR102068419B1 (ko) 포인트 클라우드 데이터 수집 궤적을 조정하기 위한 방법, 장치 및 컴퓨터 판독 가능한 매체
WO2021016854A1 (zh) 一种标定方法、设备、可移动平台及存储介质
CN107194974B (zh) 一种基于多次识别标定板图像的多目相机外参标定精度的提高方法
CN111123242B (zh) 一种基于激光雷达和相机的联合标定方法及计算机可读存储介质
WO2022110451A1 (zh) 机器人定位方法、装置、计算机可读存储介质及机器人
WO2022179094A1 (zh) 车载激光雷达外参数联合标定方法、系统、介质及设备
CN113077476A (zh) 一种高度测量方法、终端设备以及计算机存储介质
CN111142514B (zh) 一种机器人及其避障方法和装置
CN115685160B (zh) 基于标靶的激光雷达与相机标定方法、系统、电子设备
CN114814750B (zh) 雷达标定及验证方法、装置、计算机设备及存储介质
CN110597249A (zh) 一种机器人及其回充定位方法和装置
CN115018922B (zh) 畸变参数标定方法、电子设备和计算机可读存储介质
WO2019214193A1 (zh) 点云采样方法、图像处理设备及具有存储功能的装置
CN114926549B (zh) 三维点云处理方法、装置、设备以及存储介质
CN107504917B (zh) 一种三维尺寸测量方法及装置
CN113340201B (zh) 一种基于rgbd相机的三维测量方法
CN111337939B (zh) 一种矩形物体外边框的估计方法及装置
CN111336938A (zh) 一种机器人及其物体距离检测方法和装置
CN118518009B (zh) 标定参数确定方法、校正方法、介质及设备
CN119556277A (zh) 光学-雷达共址观测的空间目标姿态模型搜索匹配方法
CN117152270B (zh) 激光雷达与相机的联合标定方法、装置、设备及介质
CN119600110A (zh) 一种车辆标定的信息数据管理系统

Legal Events

Date Code Title Description
NENP Non-entry into the national phase

Ref country code: DE

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19916042

Country of ref document: EP

Kind code of ref document: A1

122 Ep: pct application non-entry in european phase

Ref document number: 19916042

Country of ref document: EP

Kind code of ref document: A1

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 220422)

122 Ep: pct application non-entry in european phase

Ref document number: 19916042

Country of ref document: EP

Kind code of ref document: A1