JP2006039622A - Curved surface reconstruction method for three-dimensional graphic, and curved surface reconstruction program for three-dimensional graphic - Google Patents
Curved surface reconstruction method for three-dimensional graphic, and curved surface reconstruction program for three-dimensional graphic Download PDFInfo
- Publication number
- JP2006039622A JP2006039622A JP2004214138A JP2004214138A JP2006039622A JP 2006039622 A JP2006039622 A JP 2006039622A JP 2004214138 A JP2004214138 A JP 2004214138A JP 2004214138 A JP2004214138 A JP 2004214138A JP 2006039622 A JP2006039622 A JP 2006039622A
- Authority
- JP
- Japan
- Prior art keywords
- curved surface
- vector
- normal
- dimensional
- signed distance
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Abstract
Description
この発明は、形状モデルの欠損部分の補完を行う3次元図形の曲面再構成方法および3次元図形の曲面再構成プログラムに関する。 The present invention relates to a method for reconstructing a curved surface of a three-dimensional figure and a program for reconstructing a curved surface of a three-dimensional figure to complement a missing part of the shape model.
近年、コンピュータ・デバイス・センサの性能・小型化・低価格化の向上により、様々な物体形状の計測手段が提案されている。光学的計測手法には、受光センサのみ使用する受動的手法と、光などを投射してその応答を利用する能動的手法がある。 In recent years, various object shape measuring means have been proposed due to improvements in performance, miniaturization, and cost reduction of computers, devices, and sensors. The optical measurement method includes a passive method using only a light receiving sensor and an active method using light and the like to project the response.
グラフ曲面として記述できるようないわゆる2.5次元データの欠損を補完する一般的枠組みとしては、正則化によるエネルギー最小化がある。データへの当てはめと連続性をエネルギー関数の形で表し、両立の拘束がバランスをとって満たされるようにエネルギー関数を最小化することにより、連続したもっともらしい面を生成することができる。コンピュータビジョンでは、この枠組みの中で、ステレオなどによって得られた疎な形状を補完する手法が多く提案された(例えば、下記非特許文献1〜3参照。)。 As a general framework for complementing the so-called 2.5-dimensional data deficiency that can be described as a graph curved surface, there is energy minimization by regularization. By representing the fit and continuity to the data in the form of an energy function and minimizing the energy function so that the compatibility constraints are balanced, a continuous plausible surface can be generated. In computer vision, many methods for complementing the sparse shape obtained by stereo or the like in this framework have been proposed (for example, see Non-Patent Documents 1 to 3 below).
物体表面からの符号付距離をスカラ場として離散的に標本化した符号付距離場(SDF:Signed Distance Field)によって形状を記述する手法が提案されている。符号付距離場からは、距離0の等値面として滑らかな表面を再構成することができるので、複数の形状計測データの平均として全体形状モデルに統合する手法が多く提案されている(例えば、下記非特許文献4〜6参照。)。 There has been proposed a method of describing a shape by a signed distance field (SDF) obtained by discretely sampling a signed distance from the object surface as a scalar field. Since a smooth surface can be reconstructed from the signed distance field as an isosurface with a distance of 0, many methods have been proposed for integrating the entire shape model as an average of a plurality of shape measurement data (for example, Non-patent documents 4 to 6 below).
また、距離データの統合だけでなく、誤計測点の判定や、複数の距離データの同時位置合わせに、SDFが利用できることが示されている(例えば、下記非特許文献7参照。)。この手法では、何らかの方法でデータ形状が事前にある程度大まかに位置合わせされていることを仮定し、外れ値処理を伴うロバストな形状統合処理と、統合形状への位置合わせを、交互に繰り返すことにより、重ねてみないと分からないような微妙な誤計測点やデータ欠損部を判定しながら、SDFによって記述された統合形状モデルを自動的に生成することができる。SDFにより記述された統合形状からは、簡単な処理でポリゴンによる形状記述を再構成することができる。 Further, it has been shown that SDF can be used not only for integration of distance data but also for determination of erroneous measurement points and simultaneous alignment of a plurality of distance data (for example, see Non-Patent Document 7 below). In this method, assuming that the data shape is roughly aligned to some extent in advance by some method, robust shape integration processing with outlier processing and alignment to the integrated shape are repeated alternately. The integrated shape model described by the SDF can be automatically generated while determining subtle erroneous measurement points and data missing portions that cannot be understood unless they are overlapped. From the integrated shape described by SDF, the shape description by polygon can be reconstructed by simple processing.
複数の距離画像の統合手法として、ボクセルにobject(内部)、surface(表面)、space(外部)の3種のラベルを付ける手法が提案されている(例えば、下記非特許文献8参照。)。この手法では、表面を挟まずに内部と外部が接している部分として未計測部分を判定することができる。この手法を適用するには、対象物とセンサの位置関係だけでなく、光学的な特性が既知である必要がある。ボクセルによる形状記述は滑らかでないため、SDFを経由した曲面復元が提案され、同様の方法でボクセルをempty(外部)、near surface(表面)、unseen(内部)と分類することにより欠損部分を簡易に埋めることができることが示されている(例えば、下記非特許文献5参照。)。 As a method for integrating a plurality of distance images, there has been proposed a method of attaching three types of labels, object (inside), surface (surface), and space (outside), to a voxel (see, for example, Non-Patent Document 8 below). In this method, an unmeasured portion can be determined as a portion where the inside and the outside are in contact with each other without sandwiching the surface. In order to apply this method, not only the positional relationship between the object and the sensor but also the optical characteristics need to be known. Since the shape description by voxels is not smooth, surface restoration via SDF is proposed, and the missing part can be simplified by classifying voxels as empty (external), near surface (surface), and unsenen (internal) in the same way. It is shown that it can be filled (for example, refer to the following non-patent document 5).
粗やノイズの多い距離データから平滑な形状モデルの再構成を行うために、level−set methodを利用する手法が提案された(例えば、下記非特許文献9参照。)。level−set methodは、界面の空間中の伝搬を微分方程式で記述したもので、時間微分の項を利用して場の更新規則を作ることができ、曲率に依存した伝搬速度を設定することで、場の平滑化などを行うことができる。level−set methodを応用して、符号付距離場での面の滑らかな補完(例えば、下記非特許文献10参照。)や、複数距離データ統合時に生じる不整合の解決(例えば、下記非特許文献11参照。)が行われた。 In order to reconstruct a smooth shape model from coarse or noisy distance data, a method using a level-set method has been proposed (for example, see Non-Patent Document 9 below). The level-set method describes the propagation in the space of the interface with a differential equation. The field update rule can be created using the term of time differentiation, and the propagation speed depending on the curvature can be set. And smoothing of the field. Applying the level-set method, smooth interpolation of the surface in the signed distance field (for example, see Non-Patent Document 10 below) and resolution of mismatches occurring when integrating multiple distance data (for example, Non-Patent Document below) 11).
level−set methodは、level−setの伝搬速度として曲率依存の値を設定することが一般的なため、生成される場の勾配の大きさがSDFのように一定になるとは限らない。また、SDFの法線情報を利用することにより、曲面の曲率を求めることができる(例えば、下記非特許文献12参照。)。 Since the level-set method generally sets a curvature-dependent value as the propagation speed of the level-set, the magnitude of the generated field gradient is not always constant as in the SDF. Further, the curvature of the curved surface can be obtained by using the normal information of the SDF (see, for example, Non-Patent Document 12 below).
センサには計測の原理や幾何的な配置から計測できる範囲が限定されており、一般に一度に対象物の全表面を計測することは難しい。例えば、表面が鏡面反射したり、黒い部分であったり、手前の部分に光路が遮られている場合には、投射した光の反射が戻って来ないので、能動的手法では計測できない。 A sensor has a limited range that can be measured from the principle of measurement and geometrical arrangement, and it is generally difficult to measure the entire surface of an object at once. For example, when the surface is specularly reflected, is a black portion, or the optical path is blocked by the front portion, the reflection of the projected light does not return, and therefore cannot be measured by the active method.
テクスチャがない均一な面は受動的手法では計測できない。撮像センサの焦点距離やセンサ間の間隔によって、計測可能な空間的範囲は限定される。センサは自由な空間にしか設置することができず、物体の周囲に存在する地面・台・壁面・他の物体だけでなく、対象物自体にも視点を制限されてしまう。また、一度に撮影できるのは、物体の手前の面だけである。 A uniform surface with no texture cannot be measured by passive methods. The measurable spatial range is limited by the focal length of the imaging sensor and the interval between the sensors. The sensor can be installed only in a free space, and the viewpoint is limited not only on the ground, platform, wall surface, and other objects existing around the object, but also on the object itself. Also, only the front side of the object can be photographed at one time.
このように視点の位置が制限されている場合には、単純な形状でも全面を計測するのに非常に多数の視点を要する場合がある。計測不可能であったり、計測するのに非常な労力を要したり、未計測のまま残されてしまったような欠損部分は、周囲のデータから補完することが実用上必要になる。 When the position of the viewpoint is limited in this way, a very large number of viewpoints may be required to measure the entire surface even with a simple shape. In practice, it is necessary to supplement missing portions that are impossible to measure, require a lot of labor to measure, or remain unmeasured.
この発明は、上述した従来技術による問題点を解消するため、図形の欠損部分を周囲のデータから補完することができる3次元図形の曲面再構成方法および3次元図形の曲面再構成プログラムを提供することを目的とする。 The present invention provides a method for reconstructing a curved surface of a three-dimensional figure and a program for reconstructing a curved surface of a three-dimensional figure, which can complement a missing part of the figure from surrounding data in order to solve the above-described problems caused by the prior art. For the purpose.
上述した課題を解決し、目的を達成するため、この発明にかかる3次元図形の曲面再構成方法は、3次元空間において、ベクトルpで表される所定のサンプル点から方向つき曲面である形状表面への符号付距離および最も近い点への法線により構成される、法線情報付符号付距離場が離散的にサンプルされたデータを入力し、前記ベクトルpで表されるサンプル点からベクトルΔpiだけずれたi番目の近傍のサンプル点の法線ベクトルniと符号付距離のサンプル値siに、所定の法線ベクトルn、符号付距離sおよび対称行列Mの成分で表される法線情報付符号付距離場の局所2次近似を行うことを特徴とする。 In order to solve the above-described problems and achieve the object, a method for reconstructing a curved surface of a three-dimensional figure according to the present invention is a shaped surface that is a directional curved surface from a predetermined sample point represented by a vector p in a three-dimensional space. The data obtained by discretely sampling the signed distance field with normal information composed of the signed distance to and the normal to the nearest point is input, and the vector Δp from the sample point represented by the vector p i just shifted i th sample point of the normal vector n i and the signed distance of the sample values s i in the vicinity of, the law represented by components in a predetermined normal vector n, the signed distance s and symmetric matrix M A local quadratic approximation of a signed distance field with line information is performed.
この発明によれば、複数方向から計測した距離データを統合して得られる形状データに未計測のまま残された領域を、後処理として補完することができる。形状表現として法線情報付の符号付距離場を用い、局所的な二次関数近似を繰り返し行うことにより欠損部分を推定することができ、二次関数を当てはめることにより、補完するだけでなく曲面の曲率を求めることができる。 According to the present invention, it is possible to supplement a region left unmeasured in shape data obtained by integrating distance data measured from a plurality of directions as post-processing. Using a signed distance field with normal information as a shape representation, it is possible to estimate missing parts by iteratively performing a local quadratic function approximation. Can be obtained.
また、この発明にかかる3次元図形の曲面再構成プログラムは、上述した3次元図形の曲面再構成方法を、コンピュータに実行させることを特徴とする。 A three-dimensional figure curved surface reconstruction program according to the present invention causes a computer to execute the above-described three-dimensional figure curved surface reconstruction method.
この発明によれば、コンピュータを用いて上述した3次元図形の曲面再構成方法を実行できる。 According to the present invention, the above-described method for reconstructing a curved surface of a three-dimensional figure can be executed using a computer.
本発明にかかる3次元図形の曲面再構成方法および3次元図形の曲面再構成プログラムによれば、SDFの逐次的な局所二次関数の当てはめによる形状モデルの欠損部分の補完を行うことができるので、当てはめる二次関数モデルと、曲面曲率との関係を明らかにし、符号付距離だけでなく法線の場も含めて整合性のとれた、曲率が滑らかな場の補完を行うことを図ることができるという効果を奏する。 According to the method of reconstructing a curved surface of a three-dimensional figure and the program for reconstructing a curved surface of a three-dimensional figure according to the present invention, it is possible to complement a missing part of a shape model by applying a local quadratic function of SDF sequentially. To clarify the relationship between the fitted quadratic function model and the curvature of the curved surface, and to complement not only the signed distance but also the normal field with a smooth curvature. There is an effect that can be done.
以下に添付図面を参照して、この発明にかかる3次元図形の曲面再構成方法および3次元図形の曲面再構成プログラムの好適な実施の形態を詳細に説明する。まず、(符号付距離場)の説明でSDFの概略を説明し、(符号付距離場と曲面曲率)の説明でSDFと曲率の関係を説明し未計測部分の補完方法を導出する。(実験について)の説明で実験結果を示す。 Exemplary embodiments of a 3D graphic curved surface reconstruction method and a 3D graphic curved surface reconstruction program according to the present invention will be described below in detail with reference to the accompanying drawings. First, the outline of the SDF will be explained in the explanation of (signed distance field), the relationship between the SDF and the curvature will be explained in the explanation of (signed distance field and curved surface curvature), and a method for complementing the unmeasured part will be derived. Experimental results are shown in the explanation of (Experiment).
(実施の形態)
(符号付距離場)
まず定義について説明する。図1は符号付距離場(SDF)を記述するパラメータの概要を示す図である。物体表面10を向き付の曲面Sとみなすとき、一般の位置にある3次元空間中の任意のベクトルpで表されるサンプル点11から最も近い曲面上の点である最近点12は一意に決めることができる。例外は球の中心・円柱の軸・2平面からの等距離面のような、曲面上の複数の点から等距離にある点、一般的には表面のボロノイ境界上にある点である。サンプル点11から物体表面10に最も近い最近点12を次の式(1)で表す。
(Embodiment)
(Signed distance field)
First, the definition will be described. FIG. 1 is a diagram showing an outline of parameters describing a signed distance field (SDF). When the object surface 10 is regarded as an oriented curved surface S, the closest point 12 which is a point on the curved surface closest to the sample point 11 represented by an arbitrary vector p in a three-dimensional space at a general position is uniquely determined. be able to. An exception is a point that is equidistant from a plurality of points on a curved surface, such as the center of a sphere, the axis of a cylinder, or an equidistant surface from two planes, generally on a Voronoi boundary of the surface. The closest point 12 closest to the object surface 10 from the sample point 11 is expressed by the following equation (1).
次に、SDF間の距離について説明する。サンプル点11の近傍で二つのデータ形状AとBのSDFが与えられているときに、その間の距離を、点pの近傍内で線形近似したSDFの差の二乗の積分で定義する(例えば、上記参考文献7参照。)。サンプル点11の近傍内でSDFが式(6)により線形近似されることを利用すると、SDF間の距離は、次の(7)式のように表される。 Next, the distance between SDFs will be described. When the SDFs of two data shapes A and B are given in the vicinity of the sample point 11, the distance between them is defined by the integral of the square of the difference of the SDF linearly approximated in the vicinity of the point p (for example, See Reference 7 above.) Using the fact that the SDF is linearly approximated by the equation (6) within the vicinity of the sample point 11, the distance between the SDFs is expressed as the following equation (7).
次に、離散化について説明する。SDFは概念的には連続量であるが、計算を行うためには離散化を行わなくてはならない。対象曲面を包含できるような一辺の長さWの立方体をサンプル領域としてとり、その端点を次の(8)式のようにする。 Next, discretization will be described. SDF is conceptually a continuous quantity, but it must be discretized in order to perform calculations. A cube having a length W of one side that can include the target curved surface is taken as a sample region, and its end point is expressed by the following equation (8).
図2−1は、格子上にとられたサンプル点11において物体表面10のSDFをサンプリングする過程を示す2次元模式図である。図2−2は、サンプル点11から最近点12へのベクトルの概要を示す図である。最近点12がデータ形状の端にある場合は無効なサンプルとしている。 FIG. 2A is a two-dimensional schematic diagram illustrating a process of sampling the SDF of the object surface 10 at the sample points 11 taken on the lattice. FIG. 2-2 is a diagram showing an outline of a vector from the sample point 11 to the nearest point 12. If the nearest point 12 is at the end of the data shape, the sample is invalid.
全空間のSDFサンプルは巨大な記憶容量を必要とするため、データ形状からの絶対値距離が閾値(実装ではT=2δ)以内のものだけ保存している。また、最近点12がデータの計測領域の端にある場合は法線nがサンプル点11への向きと一致しないため有効なサンプルとしては採用していない。 Since the SDF sample of the entire space requires a huge storage capacity, only those whose absolute value distance from the data shape is within a threshold value (T = 2δ in implementation) are stored. In addition, when the nearest point 12 is at the end of the data measurement region, the normal line n does not coincide with the direction to the sample point 11, so that it is not adopted as an effective sample.
次に、曲面再構成について説明する。SDFとして生成された統合形状から、汎用的な3角パッチによる形状表現に変換する手法としては、Marching Cube法が多く用いられているが、本手法ではSDFに持たせている法線情報も有効に活用して曲面再構成を行う。図3−1〜3−4は、曲面再構成の過程を示す図である。サンプル点11は次の(11)式でとられている。 Next, curved surface reconstruction will be described. The Marching Cube method is often used as a method for converting the integrated shape generated as SDF into shape representation using a general-purpose triangular patch. In this method, the normal information given to SDF is also effective. Used to reconstruct curved surface. FIGS. 3-1 to 3-4 are diagrams illustrating the process of curved surface reconstruction. The sample point 11 is taken by the following equation (11).
従って、サンプル点11を頂点とする立方体領域の中心点はci=o+iδにある。それぞれの立方体領域について、頂点にあるサンプル点11のSDFを中心点に線形補外すると中心点での符号付距離を求めることができる。その平均値の符号により、立方体領域を物体の内外いずれに近似すべきかを判定することができる。 Therefore, the center point of the cubic region having the sample point 11 as a vertex is at ci = o + iδ. For each cubic region, the signed distance at the center point can be obtained by linearly extrapolating the SDF of the sample point 11 at the vertex to the center point. The sign of the average value can determine whether the cubic region should be approximated to the inside or outside of the object.
内外の立方体領域の境界は正方形の集合の多面体となるが(図3−1参照)、その構造を維持したまま、各頂点の座標値を、サンプル点11に対応した最近点12(CPp)に置換することにより、滑らかな面が得られる(図3−2、3−3参照)。さらにサンプル点11の法線情報SNpも追加すると、さらに滑らかに描画することができる(図3−4参照)。この手法はSDFに含まれる法線情報も有効に利用しており、通常のMarching Cube法のように頂点座標の補間や接続の不定性の問題は起こらない(例えば、上記非特許文献4〜6参照。)。 Although the boundary between the inner and outer cube regions is a polyhedron of a set of squares (see FIG. 3A), the coordinate value of each vertex is set to the nearest point 12 (CP p ) corresponding to the sample point 11 while maintaining the structure. By replacing with, a smooth surface can be obtained (see FIGS. 3-2 and 3-3). Furthermore, when normal information SN p of the sample point 11 is also added, it is possible to draw more smoothly (see FIG. 3-4). This method also effectively uses normal information contained in the SDF, and does not cause problems of vertex coordinate interpolation and connection indefiniteness as in the ordinary Marching Cube method (for example, Non-Patent Documents 4 to 6 above). reference.).
(符号付距離場と曲面曲率)
まず曲面曲率について説明する。SDFの法線情報を利用すると、曲面の曲率を求めることができる(たとえば、非特許文献12参照。)。図4はサンプル点11の近傍のSDFからの曲率の計算に用いられるパラメータの概要を示す図である。サンプル点11における最近点12と法線を、cとn(いずれもベクトル値。)とする。サンプル点11がp+Δpに変化したときに最近点12と法線がc+Δcとn+Δnに変化するとする。法線nの方向への射影行列を次の式(12)とすると、
(Signed distance field and curved surface curvature)
First, the curved surface curvature will be described. By using the normal information of SDF, the curvature of the curved surface can be obtained (for example, see Non-Patent Document 12). FIG. 4 is a diagram showing an outline of parameters used for calculating the curvature from the SDF in the vicinity of the sample point 11. Let c and n (both are vector values) be the nearest point 12 and the normal line at the sample point 11. Assume that the nearest point 12 and the normal change to c + Δc and n + Δn when the sample point 11 changes to p + Δp. If the projection matrix in the direction of the normal n is the following equation (12),
行列Kは対称であるので、6つの独立成分k=(kxx,kyy,kzz,kyz,kzx,kxy)があり、実データの各近傍サンプルについて次の式(15)の方程式を立てることができる。 Since the matrix K is symmetric, six independent components k = (k xx, k yy , k zz, k yz, k zx, k xy) has, in the following for each neighborhood sample of the actual data to the equation of (15) An equation can be established.
方程式の数が変数より多いので、特異値分解を利用して対称行列Kの成分の最小自乗解を求めることができる。式(15)を解いて推定された結果は実対称なので、次の式(16)のように対角化できる。 Since there are more equations than variables, the least squares solution of the components of the symmetric matrix K can be obtained using singular value decomposition. Since the result estimated by solving the equation (15) is real symmetric, it can be diagonalized as the following equation (16).
ここで、||・||Fはフロベニウスノルムである。主方向が不要な場合はこの関係式を用いてKの正規化された推定値の成分から直接主曲率を求めることができる。以上の計算方法は、ΔnciとΔnniの組さえあれば適用可能である。 Here, || · || F is Frobenius norm. When the main direction is unnecessary, the main curvature can be obtained directly from the normalized estimated value component of K using this relational expression. The above calculation method is applicable as long as there is a set of Δ n c i and Δ n n i .
次に平行曲面について説明する。図5は平行曲面上の面要素におけるパラメータの概要を示す図である。最近点12の近傍での曲面上の面要素を次の式(21)で表す。ここで、w1とw2は主方向である。 Next, the parallel curved surface will be described. FIG. 5 is a diagram showing an outline of parameters in a plane element on a parallel curved surface. A surface element on the curved surface in the vicinity of the nearest point 12 is expressed by the following equation (21). Here, w 1 and w 2 is the main direction.
この計算結果は、曲面から一定幅内の空間内に均一な密度でサンプル点11が分布しているときに、曲面上の最近点12の面密度が、ガウス曲率に依存していることを示している。厚さをT=2δとし、この計算の仮定上で最も曲がっている状態であるK=±1/(2δ)2の場合、単位面積当りのサンプル点11の個数が±1/3個変化する程度である。 This calculation result shows that the surface density of the nearest point 12 on the curved surface depends on the Gaussian curvature when the sample points 11 are distributed at a uniform density in a space within a certain width from the curved surface. ing. When the thickness is T = 2δ and K = ± 1 / (2δ) 2 , which is the most bent state on the assumption of this calculation, the number of sample points 11 per unit area changes by ± 1/3. Degree.
次に二次近似による符号付距離場の補完について説明する。ここまで、サンプル点11の近傍の点xでSDFが線形補間できることを示し、サンプル点11の近傍での最近点CP[x,S]と法線SN[x,S]の関係を線形近似することによって曲面の曲率を求めることができることを示した。欠損データの補完を行う場合、サンプル点11ではSDFの値が与えられておらず、周囲のSDFから推定する必要がある。符号付距離場が局所的にサンプル点11の変位Δpiについて次の式(27)で表される二次式で近似できるとする。 Next, supplementation of the signed distance field by quadratic approximation will be described. Up to this point, it is shown that the SDF can be linearly interpolated at the point x in the vicinity of the sample point 11, and the relationship between the nearest point CP [x, S] and the normal SN [x, S] in the vicinity of the sample point 11 is linearly approximated. It was shown that the curvature of the curved surface can be obtained. When complementing missing data, the SDF value is not given at the sample point 11 and it is necessary to estimate from the surrounding SDF. Signed distance field is to be approximated by a quadratic expression represented by the following formula for the displacement Delta] p i of locally sample point 11 (27).
法線の場はスカラ場の勾配なので渦無しであり、Mは対称行列である必要がある。サンプル点11についての二次近似パラメータM,n,sをまとめてQSDF(p)と記述する。二次近似の係数QSDF(p)について、実データに対して次の式(29)を最小にするように当てはめを行う。 Since the normal field is a gradient of the scalar field, there is no vortex and M must be a symmetric matrix. The secondary approximation parameters M, n, and s for the sample point 11 are collectively described as QSDF (p). The quadratic approximation coefficient QSDF (p) is applied to the actual data so as to minimize the following equation (29).
ここで、d2(・)は式(7)で与えられるSDF間の距離であり、wiは各サンプルについての重み係数、SDF[pi,S]は曲面Sについてのpiでのサンプル値、QSDF(p)はpに関して求められた局所二次近似モデルで推定したサンプル点11の近傍でのSDF値である。 Here, d 2 (·) is the distance between SDF given in equation (7), samples in w i is a weighting factor for each sample, SDF [p i, S] is p i on the curved surface S The value, QSDF (p), is the SDF value in the vicinity of the sample point 11 estimated by the local quadratic approximation model obtained for p.
式(15)と同様に、対称な行列Kの6つの独立成分・法線・符号付距離について、式(30)の方程式を立てることができる。ここで、wni=wiwnである。左辺の行列を特異値分解して最小自乗解を求める。連立方程式の形にしてあるので、近傍が全て埋まっていない場合でも、非特許文献2のようにパターンを分類する必要がない。10個の変数があるので、解くにはサンプル点11を最低10必要とする。 Similar to equation (15), the equation of equation (30) can be established for six independent components, normals, and signed distances of the symmetric matrix K. Here, w ni = w i w n . Find the least squares solution by singular value decomposition of the left-hand side matrix. Since it is in the form of simultaneous equations, it is not necessary to classify the patterns as in Non-Patent Document 2, even when the entire neighborhood is not filled. Since there are 10 variables, at least 10 sample points 11 are required to solve.
すなわちMは階数2の対称行列で、その固有値は式(14)で与えられる平行曲面上の曲率であり、符号付距離sを用いて曲面の曲率κ1,κ2を求めることができる。このようにして求めた曲面曲率を用いて重み係数を次の式(38)で定めている。ただし、w(Δpi)は近傍のとりかたで決まる重みとする。 In other words, M is a symmetric matrix of rank 2, and its eigenvalue is the curvature on the parallel curved surface given by equation (14), and the curvatures κ 1 and κ 2 of the curved surface can be obtained using the signed distance s. The weighting coefficient is determined by the following equation (38) using the curved surface curvature thus obtained. However, w (Δp i ) is a weight determined by the way of neighborhood.
以上の計算により、中央のサンプル点11でのSDFのサンプルがなくても、近傍のSDFからQSDF(p)を推定することができるため、SDFの欠損値の補完を行うことができる。空間の各位置で局所的に二次近似しようとしていることから、三次微分、すなわち曲率の変化が小さくなるような場が推定されていることになる。 According to the above calculation, even if there is no SDF sample at the central sample point 11, QSDF (p) can be estimated from the neighboring SDF, so that the missing value of SDF can be complemented. Since the second-order approximation is attempted locally at each position in the space, a third derivative, that is, a field where the change in curvature is small is estimated.
式(30)の左辺行列の一般逆行列を求めると、M,n,sの係数は、右辺のデータni,siに対して3次元線形フィルタを掛けることによって得られることがわかる。すなわち、M(^)の係数はniに対する一次微分とsiに対する二次微分の和、n(^)はniの平均とsiの一次微分の和、s(^)はniの線形補外とsiの平滑化の和として求められる。正規化の影響をとりあえず考慮しなければ、データni,diの誤差がQSDFの推定値に及ぼす影響はその線形結合の程度である。 When the general inverse matrix of the left-side matrix of Equation (30) is obtained, it can be seen that the coefficients of M, n, and s are obtained by applying a three-dimensional linear filter to the data n i and s i on the right side. That, M of the second derivative with respect to the first-order derivative and s i are coefficients (^) for n i sum, n (^) is the sum of the first derivative of the mean and s i of n i, s (^) is the n i It is obtained as the sum of linear extrapolation and s i smoothing. If the influence of normalization is not taken into account for the time being, the influence of the error of the data n i and d i on the estimated value of the QSDF is the degree of the linear combination.
(実験について)
次に、SDFを用いて未計測部分の補完を行うアルゴリズムを提案する。光造形などの現場では、既に対話的な3次元形状編集ツールが使用されており、平面で埋めたり一定の厚みで表面を残すような操作は量が少なければあまり困難ではないため、今回対象とするのは、曲面として欠損している部分とする。
(About experiment)
Next, an algorithm for complementing unmeasured parts using SDF is proposed. At sites such as stereolithography, interactive 3D shape editing tools are already used, and operations such as filling with a flat surface or leaving the surface with a certain thickness are not difficult if the amount is small. The part that is missing as a curved surface is used.
SDFを用いて行った誤計測点除去、統合、位置合わせによれば、スカラ場の符号付距離だけでなく、その勾配のベクトル場である法線も用いることで、局所線形近似していた。本実施の形態の手法では微分連続性も保つように補完を行うために、二次近似を利用する。二次近似を求めることにより、曲面曲率といった微分幾何学的特徴量も得られる。また、線形近似では解消できていなかったような不整合も整えることができる。アルゴリズムは次の通りである。 According to the erroneous measurement point removal, integration, and alignment performed using SDF, local linear approximation is performed by using not only the signed distance of the scalar field but also the normal that is the vector field of the gradient. In the method of the present embodiment, quadratic approximation is used to perform complementation so as to maintain differential continuity. By obtaining a quadratic approximation, a differential geometric feature such as a curved surface curvature can also be obtained. Inconsistencies that could not be resolved by linear approximation can also be corrected. The algorithm is as follows.
Step1:入力SDF:orgに初期SDFを読み込む。
Step2:出力SDF:ext←org
Step3:extを拡張する。
Step4:extの各サンプル点で近傍のorgまたはextからQSDFを計算し、extを更新する。
Step5:Step3に戻って必要な回数繰り返す。
Step6:extが結果となる。
Step 1: Input initial SDF into input SDF: org.
Step 2: Output SDF: ext ← org
Step 3: Extends ext.
Step 4: QSDF is calculated from neighboring org or ext at each sample point of ext, and ext is updated.
Step 5: Return to Step 3 and repeat as many times as necessary.
Step 6: ext is the result.
orgは初期化した後には変化しない。Step3では、extを近傍のマスクで膨張させた領域を設定している。Step4では、同一サンプル点について、orgとextの両方にサンプルがある場合は、orgを優先することで、extが初期値から離れていかないように抑制している。QSDFを計算して距離|d|がT以上になるサンプルは除去して、計算対象が全空間に及んでしまわないように抑制している。 org does not change after initialization. In Step 3, a region where ext is expanded with a neighboring mask is set. In Step 4, if there are samples in both org and ext for the same sample point, org is given priority so that ext is not deviated from the initial value. A sample whose distance | d | is equal to or greater than T is calculated by calculating the QSDF, and is suppressed so that the calculation object does not reach the entire space.
データへの適用結果について説明する。図6−1は初期状態における本実施の形態の楕円体への適用結果を示す図である。図6−2は10回繰り返し後における本実施の形態の楕円体への適用結果を示す図である。図6−3は20回繰り返し後における本実施の形態の楕円体への適用結果を示す図である。図6−4は50回の繰り返し後における本実施の形態の楕円体への適用結果を示す図である。図6−5はサンプル点数、当てはめ誤差および初期状態を1とした場合の平均曲率の変化を示す図である。 The application result to data will be described. FIG. 6A is a diagram illustrating a result of application of the present embodiment to the ellipsoid in the initial state. FIG. 6B is a diagram illustrating a result of application of the present embodiment to the ellipsoid after 10 repetitions. FIG. 6-3 is a diagram illustrating a result of application of the present embodiment to the ellipsoid after 20 repetitions. FIG. 6-4 is a diagram illustrating a result of application of the present embodiment to the ellipsoid after 50 repetitions. FIG. 6-5 is a diagram showing a change in average curvature when the number of sample points, fitting error, and initial state is 1.
初期状態として楕円体の半分が与えられ、繰り返しの途中の状態を表示している。全体の形状が楕円体なのは明らかであるが、大局的な形状の知識を用いずに、局所演算の繰り返しだけで、欠損部分が埋められて滑らかな面が生成されていることがわかる。この実験ではw(Δpi)は標準偏差δのガウス分布とし、次の式(43)のような近傍範囲(33近傍)を用いている。 Half of the ellipsoid is given as the initial state, and the state during the repetition is displayed. It is clear that the overall shape is an ellipsoid, but it can be seen that a smooth surface is generated by filling in the missing portion only by repeating the local calculation without using knowledge of the global shape. In this experiment, w (Δp i ) is a Gaussian distribution with a standard deviation δ, and a neighborhood range (near 33) as shown in the following equation (43) is used.
図7−1〜7−4は本実施の形態における手法を、埴輪の馬を計測した距離データから生成したモデルに適用した結果を示す図である。生成に当たっては上述の非特許文献7の手法を用い、手法中の補外処理はあえて掛けていない。脚部の間に計測が困難な部分が残っていたが、本手法の20回の繰り返しにより、連続な面で補完されていることがわかる。誤差や曲率は楕円体の場合程単純な挙動は示さなかった。サンプル点は補完処理により248kから282kに増加し、計算時間は1.7GHzの単一CPUで約1時間半であった。 FIGS. 7-1 to 7-4 are diagrams showing the results of applying the method of the present embodiment to a model generated from distance data obtained by measuring a horse with a heel. In the generation, the above-described method of Non-Patent Document 7 is used, and extrapolation processing in the method is not performed. Although it was difficult to measure between the legs, it was found that the method was complemented with a continuous surface by repeating the method 20 times. The error and curvature were not as simple as the ellipsoid. The sample point increased from 248k to 282k by the complementary processing, and the calculation time was about 1 hour and a half with a single CPU of 1.7 GHz.
SDFの逐次的な局所二次関数当てはめによる形状モデルの欠損部分の補完を行った。当てはめる二次関数モデルと、曲面曲率との関係を明らかにし、符号付距離だけでなく法線の場も含めて整合性のとれた、曲率が滑らかな場の補完を行うことができた。ロバスト統計と組み合わせて極端な外れ値を除去することも可能である。また、本手法は多重解像度処理へ拡張することが可能であり、局所性のレベルを複数設定することで、より安定で高速な処理が行えることが期待できる。 The missing part of the shape model was complemented by SDF sequential local quadratic function fitting. The relationship between the quadratic function model to be applied and the curvature of the surface was clarified, and it was possible to complement not only the signed distance but also the field of smooth curvature, including the normal field. It is also possible to remove extreme outliers in combination with robust statistics. In addition, this method can be extended to multi-resolution processing, and it can be expected that more stable and high-speed processing can be performed by setting a plurality of locality levels.
以上のように、本発明にかかる3次元図形の曲面再構成方法および3次元図形の曲面再構成プログラムは、形状モデルの欠損部分の補完に有用であり、特に、レーザー・符号化光源・カメラを組み合わせた三次元形状計測システムなどにおける、計測が困難な部分が生ずる場合の補完処理に適している。 As described above, the method of reconstructing a curved surface of a three-dimensional figure and the program for reconstructing a curved surface of a three-dimensional figure according to the present invention are useful for complementing a missing part of a shape model. It is suitable for complementary processing when a portion that is difficult to measure occurs in a combined three-dimensional shape measurement system or the like.
10 物体表面
11 サンプル点
12 最近点
10 Object surface 11 Sample point 12 Nearest point
Claims (6)
前記ベクトルpで表されるサンプル点からベクトルΔpiだけずれたi番目の近傍のサンプル点の法線ベクトルniと符号付距離のサンプル値siに、所定の法線ベクトルn、符号付距離sおよび対称行列Mの成分で表される法線情報付符号付距離場の局所2次近似を行う近似工程と、
を含むことを特徴とする3次元図形の曲面再構成方法。 In a three-dimensional space, a signed distance field with normal information is formed by a signed distance from a predetermined sample point represented by a vector p to a shape surface that is a directional curved surface and a normal to the nearest point. An input process for inputting discrete sampled data;
Wherein the sample points represented by the vector p in the vector Delta] p i shifted by the i-th normal vector n i and the signed distance of the sample points in the vicinity of the sample values s i, a predetermined normal vector n, the distance signed an approximation step for performing local quadratic approximation of a signed distance field with normal information represented by components of s and symmetric matrix M;
A method for reconstructing a curved surface of a three-dimensional figure.
前記ベクトルpで表されるサンプル点からベクトルΔpiだけずれたi番目の近傍のサンプル点の法線ベクトルniと符号付距離のサンプル値siに、所定の法線ベクトルn、符号付距離sおよび対称行列Mの成分で表される法線情報付符号付距離場の局所2次近似を行う近似工程と、
をコンピュータに実行させることを特徴とする3次元図形の曲面再構成プログラム。 In a three-dimensional space, a signed distance field with normal information is formed by a signed distance from a predetermined sample point represented by a vector p to a shape surface that is a directional curved surface and a normal to the nearest point. An input process for inputting discrete sampled data;
Wherein the sample points represented by the vector p in the vector Delta] p i shifted by the i-th normal vector n i and the signed distance of the sample points in the vicinity of the sample values s i, a predetermined normal vector n, the distance signed an approximation step for performing local quadratic approximation of a signed distance field with normal information represented by components of s and symmetric matrix M;
A program for reconstructing a curved surface of a three-dimensional figure, wherein the computer is executed.
The sampled data is graphic data in a three-dimensional space, and the approximation step creates complementary data of graphic data in the three-dimensional space by applying the local quadratic approximation, and the complementary data 6. The computer program for reconstructing a curved surface of a three-dimensional figure according to claim 4 or 5, wherein the figure is drawn in the three-dimensional space by using.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2004214138A JP4441611B2 (en) | 2004-07-22 | 2004-07-22 | 3D graphic curved surface reconstruction device and 3D graphic curved surface reconstruction program |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2004214138A JP4441611B2 (en) | 2004-07-22 | 2004-07-22 | 3D graphic curved surface reconstruction device and 3D graphic curved surface reconstruction program |
Publications (2)
Publication Number | Publication Date |
---|---|
JP2006039622A true JP2006039622A (en) | 2006-02-09 |
JP4441611B2 JP4441611B2 (en) | 2010-03-31 |
Family
ID=35904597
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
JP2004214138A Expired - Fee Related JP4441611B2 (en) | 2004-07-22 | 2004-07-22 | 3D graphic curved surface reconstruction device and 3D graphic curved surface reconstruction program |
Country Status (1)
Country | Link |
---|---|
JP (1) | JP4441611B2 (en) |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2010256138A (en) * | 2009-04-23 | 2010-11-11 | Canon Inc | Imaging apparatus and method for controlling the same |
CN104408773A (en) * | 2014-12-02 | 2015-03-11 | 北京大学工学院南京研究院 | Method for interpolating structured grid non-matching interface |
JP2017509035A (en) * | 2014-01-03 | 2017-03-30 | インテル・コーポレーション | Real-time 3D reconstruction using depth camera |
CN112419502A (en) * | 2020-11-23 | 2021-02-26 | 苏州千机智能技术有限公司 | Blade curved surface reconstruction method of engine blade disc |
JP2022526082A (en) * | 2019-03-08 | 2022-05-23 | エクソキャド ゲーエムベーハー | Modeling of denture parts tailored to the patient |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR101828785B1 (en) * | 2017-03-20 | 2018-02-13 | 주식회사 에이치비티 | Method of and system for producing customized shoe using 3d scanner |
CN111473756B (en) * | 2020-04-03 | 2021-07-06 | 上海嘉奥信息科技发展有限公司 | Surface curve measuring method, system and medium based on Unity3D model |
-
2004
- 2004-07-22 JP JP2004214138A patent/JP4441611B2/en not_active Expired - Fee Related
Cited By (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2010256138A (en) * | 2009-04-23 | 2010-11-11 | Canon Inc | Imaging apparatus and method for controlling the same |
JP2017509035A (en) * | 2014-01-03 | 2017-03-30 | インテル・コーポレーション | Real-time 3D reconstruction using depth camera |
US10178366B2 (en) | 2014-01-03 | 2019-01-08 | Intel Corporation | Real-time 3D reconstruction with a depth camera |
CN104408773A (en) * | 2014-12-02 | 2015-03-11 | 北京大学工学院南京研究院 | Method for interpolating structured grid non-matching interface |
CN104408773B (en) * | 2014-12-02 | 2017-02-22 | 北京大学工学院南京研究院 | Method for interpolating structured grid non-matching interface |
JP2022526082A (en) * | 2019-03-08 | 2022-05-23 | エクソキャド ゲーエムベーハー | Modeling of denture parts tailored to the patient |
JP7423649B2 (en) | 2019-03-08 | 2024-01-29 | エクソキャド ゲーエムベーハー | Modeling of denture parts tailored to the patient |
CN112419502A (en) * | 2020-11-23 | 2021-02-26 | 苏州千机智能技术有限公司 | Blade curved surface reconstruction method of engine blade disc |
Also Published As
Publication number | Publication date |
---|---|
JP4441611B2 (en) | 2010-03-31 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
Schnabel et al. | Completion and reconstruction with primitive shapes | |
US10013801B2 (en) | Texturing a 3D modeled object | |
US8711143B2 (en) | System and method for interactive image-based modeling of curved surfaces using single-view and multi-view feature curves | |
EP2874118B1 (en) | Computing camera parameters | |
Pottmann et al. | Industrial geometry: recent advances and applications in CAD | |
Zaharescu et al. | Topology-adaptive mesh deformation for surface evolution, morphing, and multiview reconstruction | |
US20080100621A1 (en) | System and method for coronary segmentation and visualization | |
EP4092558A1 (en) | Parameterization of cad model | |
US11790605B2 (en) | 3D reconstruction with smooth maps | |
Yoshihara et al. | Topologically robust B-spline surface reconstruction from point clouds using level set methods and iterative geometric fitting algorithms | |
US11657195B2 (en) | Processing a 3D signal of a shape attribute over a real object | |
JP5220144B2 (en) | A method for reconstructing the surface of specular objects from low-density reflection response | |
Campos et al. | Splat-based surface reconstruction from defect-laden point sets | |
Alliez et al. | CGAL: the computational geometry algorithms library | |
Sagawa et al. | Hole filling of a 3D model by flipping signs of a signed distance field in adaptive resolution | |
Tubic et al. | A volumetric approach for interactive 3D modeling | |
JP4441611B2 (en) | 3D graphic curved surface reconstruction device and 3D graphic curved surface reconstruction program | |
Masuda | Filling the signed distance field by fitting local quadrics | |
Söderkvist | Introductory overview of surface reconstruction methods | |
Sagawa et al. | Taking consensus of signed distance field for complementing unobservable surface | |
Zhang et al. | Model reconstruction from cloud data | |
Clémot et al. | Neural skeleton: Implicit neural representation away from the surface | |
Koo et al. | Shape from projections via differentiable forward projector for computed tomography | |
Lu et al. | Surface reconstruction via cooperative evolutions | |
JP2006277712A (en) | Fitting device, method and program for three-dimensional model |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
A621 | Written request for application examination |
Free format text: JAPANESE INTERMEDIATE CODE: A621 Effective date: 20070129 |
|
A131 | Notification of reasons for refusal |
Free format text: JAPANESE INTERMEDIATE CODE: A131 Effective date: 20090908 |
|
A521 | Written amendment |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20091105 |
|
TRDD | Decision of grant or rejection written | ||
A01 | Written decision to grant a patent or to grant a registration (utility model) |
Free format text: JAPANESE INTERMEDIATE CODE: A01 Effective date: 20091201 |
|
A01 | Written decision to grant a patent or to grant a registration (utility model) |
Free format text: JAPANESE INTERMEDIATE CODE: A01 |
|
A61 | First payment of annual fees (during grant procedure) |
Free format text: JAPANESE INTERMEDIATE CODE: A61 Effective date: 20091202 |
|
R150 | Certificate of patent or registration of utility model |
Free format text: JAPANESE INTERMEDIATE CODE: R150 |
|
FPAY | Renewal fee payment (event date is renewal date of database) |
Free format text: PAYMENT UNTIL: 20130122 Year of fee payment: 3 |
|
FPAY | Renewal fee payment (event date is renewal date of database) |
Free format text: PAYMENT UNTIL: 20130122 Year of fee payment: 3 |
|
FPAY | Renewal fee payment (event date is renewal date of database) |
Free format text: PAYMENT UNTIL: 20130122 Year of fee payment: 3 |
|
FPAY | Renewal fee payment (event date is renewal date of database) |
Free format text: PAYMENT UNTIL: 20130122 Year of fee payment: 3 |
|
FPAY | Renewal fee payment (event date is renewal date of database) |
Free format text: PAYMENT UNTIL: 20140122 Year of fee payment: 4 |
|
FPAY | Renewal fee payment (event date is renewal date of database) |
Free format text: PAYMENT UNTIL: 20140122 Year of fee payment: 4 |
|
FPAY | Renewal fee payment (event date is renewal date of database) |
Free format text: PAYMENT UNTIL: 20140122 Year of fee payment: 4 |
|
R250 | Receipt of annual fees |
Free format text: JAPANESE INTERMEDIATE CODE: R250 |
|
R250 | Receipt of annual fees |
Free format text: JAPANESE INTERMEDIATE CODE: R250 |
|
S533 | Written request for registration of change of name |
Free format text: JAPANESE INTERMEDIATE CODE: R313533 |
|
R350 | Written notification of registration of transfer |
Free format text: JAPANESE INTERMEDIATE CODE: R350 |
|
LAPS | Cancellation because of no payment of annual fees |