TWI764593B - Method of constructing three-dimensional model by tomographic reconstruction technology - Google Patents
Method of constructing three-dimensional model by tomographic reconstruction technologyInfo
- Publication number
- TWI764593B TWI764593B TW110106913A TW110106913A TWI764593B TW I764593 B TWI764593 B TW I764593B TW 110106913 A TW110106913 A TW 110106913A TW 110106913 A TW110106913 A TW 110106913A TW I764593 B TWI764593 B TW I764593B
- Authority
- TW
- Taiwan
- Prior art keywords
- dimensional model
- inspected
- dimensional
- model
- constructing
- Prior art date
Links
Images
Landscapes
- Apparatus For Radiation Diagnosis (AREA)
- Image Processing (AREA)
Abstract
一種建構一待查物件之三維模型的方法包含:獲得多個關聯於該待查物體之二維層析成像圖數據庫;建構一初始三維模型;執行一疊代過程,該疊代過程包括執行一自旋轉換在該初始三維模型上,以便獲得一待替換的三維模型在一個三維傅立葉域之一極坐標系統上,利用該等轉換後數據庫來取代該待替換的三維模型的一部分,重複上述步驟直到該等轉換後影像的每一已被用於替換該待替換的三維模型,且根據該待疊代過程獲得該待查物件的該三維模型。A method of constructing a three-dimensional model of an object to be inspected includes: obtaining a plurality of databases of two-dimensional tomographic images associated with the object to be inspected; constructing an initial three-dimensional model; and performing an iterative process, the iterative process comprising executing an iterative process. The rotation is transformed on the initial 3D model to obtain a 3D model to be replaced on a polar coordinate system in a 3D Fourier domain, the transformed database is used to replace a part of the 3D model to be replaced, and the above steps are repeated Until each of the converted images has been used to replace the three-dimensional model to be replaced, and the three-dimensional model of the object to be inspected is obtained according to the iterative process.
Description
本發明是有關於一種建構一待查物件之三維模型的方法,特別是指一種使用層析成像重建技術來建構一待查物件之三維模型的方法。The present invention relates to a method for constructing a three-dimensional model of an object to be inspected, and more particularly to a method for constructing a three-dimensional model of an object to be inspected using tomographic reconstruction technology.
常規地,層析成像技術使一物件的內部成像成為可能。在使用中,可藉由一層析成像儀(即,一用於執行該層析成像的裝置)對該物件進行一層析成像掃描,用以獲得多個該物件的各個部分之二維(2D)影像。接著,該等二維影像被用來建構一該物件的三維模型以供後續使用(例如,檢查)。這樣的操作可被稱為層析成像重建術,並在多個領域像是晶圓/金屬缺陷檢查、半導體封裝及健康檢查等可有用的。Conventionally, tomographic techniques enable imaging of the interior of an object. In use, a tomographic scan of the object may be performed by a tomographic imager (ie, a device for performing the tomography) to obtain a plurality of two-dimensional (two-dimensional) ( 2D) image. The 2D images are then used to construct a 3D model of the object for subsequent use (eg, inspection). Such operations may be referred to as tomographic reconstructions, and may be useful in fields such as wafer/metal defect inspection, semiconductor packaging, and health inspection.
需注意的是,該層析成像具有一特定視場(FoV),該視場可能小於該物件的大小。在這種情況下,藉由該物件的該等部分之該等二維影像的資訊可能不包括該物件的所有資訊(例如,在該物件的邊緣之資訊可能遺漏),導致該等二維影像不能準確反映該物件的實際結構。或者,該等二維影像可具有不完整的表徵,從而導致偽像。Note that the tomography has a specific field of view (FoV), which may be smaller than the size of the object. In this case, the 2D images are caused by the fact that the information of the 2D images of the parts of the object may not include all the information of the object (eg, information at the edges of the object may be missing) does not accurately reflect the actual structure of the object. Alternatively, these two-dimensional images may have incomplete representations, resulting in artifacts.
解決此問題的一種方式是將該物件置放在遠離該層析成像儀的位置,用以保持該物件的整體在該層析成像儀的該視場範圍之內,從而可以獲得多個二維影像,該等二維影像的每一顯示該物件的整個部分。然而,在此方式下獲得的該等二維影像具有較低的解析度及較少的影像細節。One way to solve this problem is to place the object away from the tomograph to keep the whole of the object within the field of view of the tomograph, so that multiple two-dimensional images, each of the two-dimensional images showing an entire portion of the object. However, the 2D images obtained in this way have lower resolution and less image details.
因此,本發明的目的,即在提供一種解決習知技術的至少一缺點的方法。Accordingly, it is an object of the present invention to provide a method that addresses at least one of the disadvantages of the prior art.
於是,本發明建構一待查物件之三維模型的方法,該方法使用一包括一層析成像儀及一運算裝置來實施,該方法包含以下步驟(a)~(e):Therefore, the present invention provides a method for constructing a three-dimensional model of an object to be inspected. The method is implemented using a tomography device and a computing device. The method includes the following steps (a) to (e):
步驟(a)藉由該層析成像儀獲得多個關聯於該待查物體之層析成像圖,該等層析成像圖的每一是在以相對於該待查物件之一軸的一特定角位置被提取。Step (a) obtaining by the tomograph a plurality of tomograms associated with the object to be inspected, each of the tomograms being at a specific angle relative to an axis of the object to be inspected location is extracted.
步驟(b)藉由該運算裝置產生多個有關於根據該層析成像之該待查物件的二維層析成像圖數據庫,該等層析成像圖數據庫的每一是有關於一各自的該等層析成像圖及包括該各自的該等層析成像圖之數據,該等層析成像圖顯示該待查物件在一實域之一極坐標系統的一部分。Step (b) generating, by the computing device, a plurality of two-dimensional tomographic image databases related to the object to be inspected according to the tomographic imaging, each of the tomographic image databases related to a respective one of the Isotomograms and data including the respective tomograms, the tomograms showing a portion of a polar coordinate system in a real domain of the object to be inspected.
步驟(c)藉由一處理器建構一在該實域之一直角坐標系統的初始三維模型。Step (c) constructs an initial three-dimensional model of a rectangular coordinate system in the real domain by a processor.
(d)藉由該處理器執行一疊代過程,該疊代過程包括以下子步驟(d-1)~(d-4):(d) an iterative process is performed by the processor, and the iterative process includes the following sub-steps (d-1)~(d-4):
子步驟(d-1)執行一自旋轉換在該初始三維模型上,以便獲得一待替換的三維模型在一三維傅立葉域之一極坐標系統上,該待替換的三維模型是藉由相對於該待查物件之該軸的一自旋角來旋轉,Sub-step (d-1) performs a spin transformation on the initial three-dimensional model in order to obtain a three-dimensional model to be replaced on a polar coordinate system in a three-dimensional Fourier domain, the three-dimensional model to be replaced by relative to The object to be inspected rotates at a spin angle of the axis,
子步驟(d-2)執行一空間轉換在該等二維層析成像圖數據庫的每一,以便獲得多個轉換後數據庫,該等轉換後數據庫分別從該等二維層析成像圖數據庫獲得及分別相關於多個轉換後影像,該等轉換後影像在該三維傅立葉域之該極坐標系統上及分別對應於該等層析成像圖,Sub-step (d-2) performs a spatial transformation on each of the two-dimensional tomographic map databases to obtain a plurality of transformed databases obtained from the two-dimensional tomographic map databases, respectively and are respectively related to a plurality of transformed images on the polar coordinate system in the three-dimensional Fourier domain and respectively corresponding to the tomograms,
子步驟(d-3)藉由該處理器,在該三維傅立葉域之該極坐標系統上利用對應於該等轉換後數據庫其中之一的該等轉換後影像其中之一來取代該待替換的三維模型的一部分,及Sub-step (d-3) replaces the to-be-replaced image with one of the transformed images corresponding to one of the transformed databases on the polar coordinate system in the three-dimensional Fourier domain by the processor part of a 3D model, and
子步驟(d-4)重複有該待替換的三維模型之子步驟(d-1)至子步驟(d-3),該待替換的三維模型是在一先前子步驟(d-3)的執行過程中獲得,作為該初始三維模型在一當前子步驟(d-1)的執行過程將被處理直到該等轉換後影像的每一已被用於替換該待替換的三維模型;及Sub-step (d-4) repeats sub-step (d-1) to sub-step (d-3) with the three-dimensional model to be replaced, the three-dimensional model to be replaced is performed in a previous sub-step (d-3) obtained in the process, as the initial 3D model will be processed during the execution of a current sub-step (d-1) until each of the converted images has been used to replace the 3D model to be replaced; and
步驟(e)根據該子步驟(d-4)的待疊代過程的一結果,藉由該處理器獲得該待查物件的該三維模型在該實域之該直角坐標系統上。Step (e) obtains, by the processor, the three-dimensional model of the object to be checked on the Cartesian coordinate system of the real domain according to a result of the iterative process of the sub-step (d-4).
在本發明被詳細描述之前,應當注意在認為適當的情况下,在圖示中參考編號或參考編號的終端部分會被重複用以表示對應的或類似的元件,其中該等元件可選擇的具有類似的特徵。Before the present invention is described in detail, it should be noted that where considered appropriate, reference numerals or terminal portions of reference numerals have been repeated in the figures to indicate corresponding or analogous elements, wherein such elements may alternatively have similar characteristics.
在整個發明中,用詞「耦合」可指一透過一導電材料(例如,電線)直接連接於多個電器設備/裝置/儀器之間,或透過另一或更多電器設備/裝置/儀器或無線通信間接連接在兩個電器設備/裝置/儀器之間。Throughout this invention, the word "coupled" may refer to a direct connection between a plurality of electrical equipment/devices/instruments through a conductive material (eg, a wire), or through another or more electrical equipment/devices/instruments or Wireless communication is an indirect connection between two electrical devices/devices/instruments.
圖1是一說明系統100的方塊圖,該系統100用於實施一種建構一根據本發明的一實施例之該待查物件150之三維模型的方法。在該實施例中,該系統100包括一層析成像儀110及一耦合該層析成像110的運算裝置120。1 is a block diagram illustrating a system 100 for implementing a method of constructing a three-dimensional model of the
該層析成像110可使用一裝置來實施,該裝置能執行一層析成像操作在該待查物件150上。該層析成像儀110可包括被配置為使用X射線、核磁共振影像(MRI)、光學投影、超音波等執行該層析成像操作的元件。透過該層析成像操作,該層析成像儀110能產生多個關聯於該待查物件150之二維(2D)影像。具體來說,該等二維影像分別顯示該待查物件150的各個部分。該等二維影像可被稱為層析成像圖。The
在本實施例中,該待查物件150可是一鰭式場效電晶體(FinFET)、一半導體組件、一金屬材料、一生物醫學材料,或嵌入在該待查物件150之內可能需要結構檢查之其他種類的物體。In the present embodiment, the object to be inspected 150 may be a fin field effect transistor (FinFET), a semiconductor device, a metal material, a biomedical material, or an object embedded in the object to be inspected 150 that may require structural inspection other kinds of objects.
該運算裝置120可使用一伺服器、一個人電腦、一膝上型電腦、一平板電腦、一智慧型手機,或其他具有運算能力的裝置以執行以下所述的操作來實施。在本實施例中,該運算裝置120可是一伺服器及包括一處理器120、一數據儲存器124及一通信單元126。The
該處理器122可包括但不限於一單核處理器、一多核處理器、一雙核行動處理器、一微處理器、一微控制器、一數位信號處理器(DSP)、一現場可程式邏輯閘陣列(FPGA)、一特殊應用積體電路(ASIC)、一射頻積體電路(RFIC)等。The
該數據儲存器124耦合至該處理器122,及可使用隨機存取記憶體(RAM)、唯讀記憶體(ROM)、可程式唯讀記憶體(PROM)、韌體、快閃記憶體等,或其任意組合來實施。該數據儲存器124儲存多個指令,當該等指令藉由該處理器122執行時,使得該處理器122執行以下所述的操作。The
該通信單元126可包括至少一射頻積體電路(RFIC)、一支援一使用一藍芽及/或無線熱點等之無線技術的短程無線通訊網路之短程無線通訊模組,及一支援使用長期演進技術(LTE)、第三代(3G)及/或第五代(5G)無線行動遠距離通訊技術等之遠距離通訊。The
該層析成像儀110具有一特定視場(FoV)。該系統100可被配置為獲得多個該待查物件150的層析成像圖及根據該等層析成像圖執行一建構該待查物件150之三維(3D)模型的方法。The
圖2是一流程圖,說明根據本發明的一實施例之建構該待查物件150之三維模型的方法之步驟。在本實施例中,該方法是使用如圖1所示之該系統100來實施。FIG. 2 is a flowchart illustrating the steps of a method of constructing a three-dimensional model of the
在步驟202中,該層析成像儀110是被配置為在一實域之一極坐標系統上獲得該待查物件150之多個層析成像圖。在本實施例中,多個層析成像圖被提取,及該等層析成像圖的每一是在以相對於該待查物件150之一軸的一特定角位置被提取(例如,一垂直穿過該待查物件150之中心的中心軸)。圖5說明該待查物件150之多個示例性層析成像圖(總共64個)。該等層析成像圖的每一可在以相對於該待查物件150之該軸的一特定及不同角位置被提取。In
圖3是該待查物件150之一示例的一正視圖。如圖3所示,該待查物件150包括多個三維結構,該等結構的每一類似於一英文字元。在一實施例中,該待查物件150可包括多個嵌入其中的三維結構;例如,一個三維結構可以是一在半導體晶圓中的特定層。FIG. 3 is a front view of an example of the
需注意的是,該層析成像儀110的該特定視場可大於嵌入在該待查物件150上的該等結構之一,但小於該待查物件150的尺寸。此外,該待查物件150只有一部分是令人感興趣的,例如在如3中間所示的結構「E」。因此,在步驟202中,該層析成像操作可藉由放置該結構「E」在該層析成像儀110的該特定視場之中心來完成,及該等層析成像圖的結果可不只包括該結構「E」的資訊,而且包括該結構「E」周圍或附近之其他結構的資訊。It should be noted that the specific field of view of the
該等層析成像圖可以各種市售的方式之一來獲得,及為了簡潔,在此省略其細節。然後,該等層析成像圖被發送至該運算裝置120。The tomograms can be obtained in one of a variety of commercially available ways, and the details of which are omitted here for brevity. Then, the tomograms are sent to the
在步驟204中,響應於該等層析成像圖的接收,該運算裝置120的該處理器122被配置來基於該等層析成像圖產生多個有關於該待查物件150的二維層析成像圖數據庫。該等層析成像圖數據庫的每一是有關於該等層析成像圖的各自之一及包括該該等層析成像圖之數據的各自之一,該等層析成像圖顯示該待查物件150的一部分。該等層析成像圖之一的該數據對於該層析成像圖之像素的每一包括一像素值及一在該實域之極坐標系統上的該像素之坐標組。在圖5的示例中,六十四個二維層析成像圖數據庫可被產生。該等二維層析成像圖數據庫的每一可以至少一矩陣的形式來表示。該至少一矩陣的每一包括多個元素,該等元素的每一具有一值,該值可用來表示該待查物件150的像素數據。也就是說,根據該等層析成像圖產生該等矩陣,及該矩陣之一的該元素之該值是對應於該等層析成像圖之一的像素值。In
在步驟206中,該處理器122在該實域之一直角坐標系統建構一初始三維(3D)模型。該初始三維模型可以一包括多個矩陣之一矩陣陣列的形式來表示。該等矩陣的每一包括多個元素,該等元素的每一具有一值,該值可用來代表一三維物件的像素數據。需注意的是,該初始三維模型的像素數據在該矩陣陣列中可包括任意值。In
在步驟208中,該處理器122執行一疊代過程將該等層析成像圖的數據提取至該初始三維模型中,用以建構該待查物件150的該三維模型。需注意的是,執行該疊代過程的目的是使該等層析成像圖的數據(例如,該等二維層析成像圖數據庫)合適該初始三維模型,用以建構能準確反映該待查物件150的該三維模型。In
具體來說,圖5是一流程圖,說明根據本發明的一實施例之該疊代過程的示例性子步驟。Specifically, FIG. 5 is a flowchart illustrating exemplary sub-steps of the iterative process according to an embodiment of the present invention.
在子步驟208a中,該處理器122執行一自旋轉換在該初始三維模型上。該自旋轉換藉由一相對於該待查物件150之該軸的自旋角導致一代替換的三維模型在一三維傅立葉域之一極坐標系統上被旋轉。應當注意的是,該初始三維模型在子步驟208a的第一執行過程中作為該代替換的三維模型,及在子步驟208a的後續疊代中,該代替換的三維模型是在子步驟208a的最新執行中獲得的該代替換的三維模型。In sub-step 208a, the
具體來說,該自旋轉換涉及藉由一特定自旋角來「自旋」原本在該直角坐標系統上的該初始三維模型到該極坐標系統上之操作,該特定自旋角等於該等層析成像圖之一的該角位置。Specifically, the spin transformation involves the operation of "spinning" the initial three-dimensional model originally on the Cartesian coordinate system to the polar coordinate system by a specific spin angle equal to the This angular position of one of the tomograms.
進行該自旋轉換的原因是該層析成像圖在該極坐標系統上被提取,該該極坐標系統不同於該初始三維模型之該直角坐標系統,及為了執行在該初始三維模型與該層析成像圖之間的任意操作,該初始三維模型及該層析成像圖都需要在一相同域之一相同座標系統上表示。此外,該方法涉及在該極坐標系統上以相對於該等層析成像圖的該等角位置來頻繁且正確地「自旋」該初始三維模型,及在該直角坐標系統及該極坐標系統之間沒有可行的快速傅立葉變換,因此,本發明採用一有效率的方式來實施該自旋轉換以實現該等期望的操作,並在以下敘述。具體來說,可使用多個幾何平移操作完成「從該實域之該直角座標系統上轉移該初始三維系統的一點至該傅立葉域之該極坐標系統上的一點」的操作。The reason for the spin transformation is that the tomogram is extracted on the polar coordinate system, which is different from the Cartesian coordinate system of the initial three-dimensional model, and in order to perform between the initial three-dimensional model and the slice For any operation between tomograms, both the initial three-dimensional model and the tomogram need to be represented on the same coordinate system in one of the same domains. Furthermore, the method involves frequently and correctly "spinning" the initial three-dimensional model at the equiangular positions relative to the tomograms on the polar coordinate system, and in the Cartesian coordinate system and the polar coordinate system There is no feasible fast Fourier transform in between, therefore, the present invention implements the spin transform in an efficient manner to achieve the desired operations, and is described below. Specifically, a plurality of geometric translation operations can be used to complete the operation of "translating a point of the initial three-dimensional system from the rectangular coordinate system of the real domain to a point of the polar coordinate system of the Fourier domain".
在本實施例中,該等幾何平移操作的每一是一個二維快速傅立葉變換(FFT)操作,該快速傅立葉變換可以是一剪切快速傅立葉變換。In this embodiment, each of the geometric translation operations is a two-dimensional Fast Fourier Transform (FFT) operation, which may be a sheared Fast Fourier Transform.
需注意的是,為了藉由一角度(θ)來實現一原點的一常規旋轉操作的結果,可採用多個分別在不同方向的移位操作。該常規旋轉操作可以一矩陣操作的形式來表示: ,其中,(x, y)代表該原點的坐標,及( , )代表該常規旋轉操作後的一新點的坐標。 It should be noted that, in order to achieve the result of a conventional rotation operation of an origin by an angle (θ), a plurality of shift operations respectively in different directions may be employed. This general rotation operation can be expressed in the form of a matrix operation: , where (x, y) represent the coordinates of the origin, and ( , ) represents the coordinates of a new point after the normal rotation operation.
藉由在一方向之一剪切因子(α),該原點的移位操作(也稱為一「剪切」變換)可以一矩陣操作的形式來表示: ,其中,(x, y)代表該原點的坐標,及( , )代表該剪切變換操作後的一新點的坐標。圖6說明一相對於一水平方向的示例性剪切變換。 By a shear factor (α) in one direction, the shift operation of the origin (also called a "shear" transformation) can be expressed in the form of a matrix operation: , where (x, y) represent the coordinates of the origin, and ( , ) represents the coordinates of a new point after the clipping transformation operation. FIG. 6 illustrates an exemplary shear transformation relative to a horizontal direction.
需注意的是,子步驟208a的該自旋轉換可利用相對於不同方向的多個剪切變換來完成。該對應的操作可表示如 ,及分別用於該剪切變換的該剪切因子α、β及γ可被計算為 、β=-sinθ。因此,子步驟208a的該等操作可使用三個基於上述之剪切因子的剪切快速傅立葉變換操作來完成。 Note that this spin transformation of sub-step 208a can be accomplished using multiple shear transformations with respect to different directions. The corresponding operation can be expressed as , and the shearing factors α, β and γ for the shearing transformation, respectively, can be calculated as , β=-sinθ. Thus, the operations of sub-step 208a can be accomplished using three sheared fast Fourier transform operations based on the shearing factors described above.
如上所述的一自旋操作可分解成三個剪切操作,其每一可藉由快速傅立葉變換在該傅立葉域來實施。具體來說,剪切傅立葉操作的每一可使用一個一維(1D)傅立葉移位定理(即,一維傅立葉變換)的一個二維展開來執行。A spin operation as described above can be decomposed into three shear operations, each of which can be implemented in the Fourier domain by means of a fast Fourier transform. Specifically, each of the shear Fourier operations can be performed using a two-dimensional expansion of a one-dimensional (1D) Fourier shift theorem (ie, a one-dimensional Fourier transform).
在子步驟208b中,該處理器122在該等二維層析成像圖數據庫的每一上執行一空間轉換,用以獲得多個轉換後數據庫,該等轉換後數據庫分別自該等二維層析成像圖數據庫獲得及分別相關於多個轉換後影像。該等轉換後影像在該三維傅立葉域之該極坐標系統上及分別對應於該等層析成像圖。In sub-step 208b, the
在本實施例中需注意的是,該空間轉換可以是一個二維快速傅立葉操作。子步驟208b的目的是將該代替換的三維模型及該等轉換後影像的每一置於同域(三維傅立葉域)之同座標系統(極坐標系統)上。類似於該等二維層析成像數據庫,該等轉換後數據庫的每一可以是至少一矩陣的形式。It should be noted in this embodiment that the spatial transformation may be a two-dimensional fast Fourier operation. The purpose of sub-step 208b is to place the replacement 3D model and each of the transformed images on the same coordinate system (polar coordinate system) in the same domain (3D Fourier domain). Similar to the two-dimensional tomographic databases, each of the transformed databases may be in the form of at least one matrix.
在子步驟208c中,用該處理器122來編程以在該三維傅立葉域之該極坐標系統上利用一對應於該等轉換後數據庫其中之一的該等轉換後影像其中之一來取代該代替換的三維模型的一部分。In sub-step 208c, the
也就是說,在子步驟208a中該代替換三維模型已以一對應於該等轉換後影像其中之一之一角的角自旋之後,該處理器122可以被配置為使用對應於該等轉換後影像其中之一的該轉換後數據庫來直接替換該代替換三維模型的一部分,該部分穿過該軸及具有一相等於一對應該等轉換後影像其中之一之該角的角位置。在本方式中,在該等轉換後影像的每一使用來替換該代替換三維模型的各個部分之後,該三維模型的結果可以是近似於形成該待查物件150的該三維模型。That is, after the replacement 3D model has been spun at an angle corresponding to one of the corners of the transformed images in sub-step 208a, the
進一步參考圖7,在此呈現五個示例性轉換後影像,該等示例性轉換後影像的每一在一特定角。針對該等示例性轉換後影像的每一,在子步驟208a中,該初始三維模型是受一自旋轉換的分配,及在子步驟208b中,該轉換後影像是經由該空間轉換及在子步驟208c中被用來替換該代替換的三維模型之一部分來獲得。也就是說,在圖5的示例中,子步驟208a~208c被重複五次直到該等轉換後影像的每一已被用來替換該代替換的三維模型的該部分。需注意的是,在其他實施例中,可獲得多個層析成像圖,及可重複子步驟208a~208c以使用所有分別對應於該等層析成像圖之組合影像來替換該代替換的三維模型。With further reference to FIG. 7, there are presented five exemplary converted images, each of which is at a particular corner. For each of the exemplary transformed images, in sub-step 208a, the initial 3D model is assigned a spin transformation, and in sub-step 208b, the transformed image is subjected to the spatial transformation and in sub-step 208b In step 208c, a portion of the three-dimensional model used to replace the replacement is obtained. That is, in the example of FIG. 5, sub-steps 208a-208c are repeated five times until each of the transformed images has been used to replace the portion of the replacement 3D model. It should be noted that, in other embodiments, multiple tomograms may be obtained, and sub-steps 208a-208c may be repeated to replace the alternate 3D generation with all combined images corresponding to the tomograms, respectively. Model.
之後,在子步驟208d中,該處理器122執行一濾波雜訊操作在該等轉換後數據庫的每一上。Then, in sub-step 208d, the
具體來說,該處理器122可被編程為首先執行一逆自旋操作(即,實現該等自旋操作的相反作用的一組操作)在已用該等轉換後影像替換該代替換的三維模型上,用以將該代替換的三維模型放回一自旋角為零的該實域之該直角坐標系統上。Specifically, the
之後,該處理器122判定是否該等轉換後數據庫的任一包括對於該代替換的三維模型是不可能的值。Thereafter, the
舉例來說,該等轉換後數據庫的每一在一至少一矩陣的形式,該矩陣的每一包括多個具有一值的元素。在本實施例中,該處理器122針對多個元素的每一判定,是否該元素具有一負數值及一虛數值(基於來自該等前述操作的雜訊結果)。對於多個元素的任一,當判定該元素具有一負數值及一虛數值的其中之一,該處理器122可被編程為用一零值替換該元素的該值。For example, each of the transformed databases is in the form of at least one matrix, each of the matrices including a plurality of elements having a value. In this embodiment, the
需注意的是,在其他實施例中,也有各種濾波雜訊的方式可被實施。在本實施例中,舉例來說,該濾波雜訊操作包括該處理器122首先判定該等元素的任一是相關於該待查物件150的一部分。It should be noted that, in other embodiments, various noise filtering methods may be implemented. In this embodiment, for example, the noise filtering operation includes the
當判定該等元素之一是相關聯該待查物件150的一部分及具有一非零值,該處理器122用一零值替換該等元素之一的該值。When determining that one of the elements is part of the associated
在此階段,該疊代過程已完成一次。在步驟210中,該處理器122可以基於是否滿足相關於該疊代過程的一預定收斂條件來判定是否需要疊代該疊代過程。該預定收斂條件可以是,在該疊代過程的兩次執行或疊代之間,在該等轉換後數據庫上的該等元素的該等值沒有看到實質性變化(實質上沒有變化)。At this stage, the iterative process has completed once. In
當不滿足該預定收斂條件時,步驟210的該判定是正確,及該流程回到子步驟208a並針對在步驟208的最後一次疊代中已經處理過的該待替換的三維模型,重複該疊代過程。否則,該流程前進到步驟212,在步驟212中,該處理器122基於該疊代過程的一結果在該實域之該直角坐標上獲得該待查物件150的該三維模型。為了滿足該預定收斂條件,該疊代過程可能需要執行約三百次。在其他實施例中,一使用者可輸入一預定數量(例如,300),然後,該處理器122在獲得該三維模型之前針對該預定數量的次數執行該疊代過程。When the predetermined convergence condition is not met, the determination of
圖8說明該待查物件150的該三維模型結果的一影像,該影像聚焦在中間的結構「E」。需注意的是,使用前述方法建構的該三維模型的解析度(參閱圖8的(a)部分)顯著的高於其他使用傳統方法像是濾波反投影(FBP)(參閱圖8的(b)部分)及等斜率層析成像術(EST)(參閱圖8的(c)部分)建構的三維模型的解析度。圖9是一該待查物件150的該三維模型之一部分的示意性透視圖。FIG. 8 illustrates an image of the result of the 3D model of the
綜上所述,本發明的該等實施例提供一種建構一待查物件之三維模型的方法。由於完成工作可能需要大量的運算,該方法包含一有效「自旋」該待查物件之三維模型的新興方式。藉由使用該二維快速傅立葉變換操作,該自旋轉換的一時間複雜度可為(N logN),而使用該離散傅立葉變換的該自旋轉換的一時間複雜度為N 2。這極大地改善在該疊代過程中的該等操作之效率,允許執行多次該疊代過程來實現一更理想的結果,而無需花費大量的時間和運算能力。 To sum up, the embodiments of the present invention provide a method for constructing a three-dimensional model of an object to be inspected. Since completing the job can be computationally intensive, the method includes an emerging way of efficiently "spinning" the three-dimensional model of the object under investigation. By using the two-dimensional fast Fourier transform operation, a time complexity of the spin transform may be (N logN), and a time complexity of the spin transform using the discrete Fourier transform is N 2 . This greatly improves the efficiency of the operations in the iterative process, allowing the iterative process to be performed multiple times to achieve a more desirable result without spending a lot of time and computing power.
需注意的是,前述方法是在僅感興趣該待查物件150的該部分之情況下特別有用(例如,在圖3中間的結構「E」)。因為該疊代過程可以更高效率來重複執行,該三維模型之所感興趣的該部分之該結構可更專注於所感興趣的該部分,而無需獲得整個該待查物件150的層析成像圖。因此,可以更專注在所感興趣的該部分之該等層析成像圖,針對該獲得層析成像圖及該三維模型的結果允許有一更高的解析度。It should be noted that the foregoing method is particularly useful when only this portion of the
也需注意的是,在一些實施例中,均獲得該等層析成像圖以反映該待查物件150內部之一特定部分,其中,該待查物件150內部可具有一大於該層析成像儀110的該特定視場之大小,及該等轉換後影像均不與該待查物件150的整體相對應。也就是說,不需要為了執行前述操作而獲得覆蓋該待查物件150的整體之層析成像圖。在圖10的示例中,可選擇對應於該等層析成像圖之一的該初始三維模型之一部分,及執行相對於該初始三維模型之該部分的該自旋轉換。It should also be noted that, in some embodiments, the tomographic images are obtained to reflect a specific part inside the
在上面的敘述中,出於解釋的目的,已經闡述了多個具體細節以便提供一對該實施例的透徹理解。然而,對於本領域的技術人員顯而易見的是,可以在沒有這些特定細節中的一些情況下,實踐一個或多個其他實施例。還應當理解的是,在本說明書中,對「一實施例」,具有序數指示的實施例的引用是指在本發明的實踐中可以包括特定的特徵、結構或特性。應當進一步理解的是,在本說明書中,出於精簡本發明的目的及幫助理解發明的各種方面,有時在一單個實施例中,於圖示或其描述中將各種特徵組合在一起,並且在適當的情況下,在實施本發明的實踐中,可以將來自一實施例的一個或多個特徵或特定細節與來自另一實施例的一個或多個特徵或特定細節一起實踐。In the above description, for purposes of explanation, numerous specific details have been set forth in order to provide a thorough understanding of the embodiments. It will be apparent, however, to one skilled in the art that one or more other embodiments may be practiced without some of these specific details. It should also be understood that, in this specification, references to "an embodiment," an embodiment with an ordinal designation, mean that a particular feature, structure, or characteristic can be included in the practice of the invention. It will be further understood that in this specification, for the purpose of streamlining the invention and to assist in understanding its various aspects, various features are sometimes grouped together in the illustrations or descriptions of a single embodiment, and Where appropriate, one or more features or specific details from one embodiment may be practiced with one or more features or specific details from another embodiment in the practice of implementing the invention.
儘管已經結合示例性實施例描述了本發明,但應當理解,本發明不限於所公開的實施例,而是旨在覆蓋包括最廣泛的解釋之精神和範圍內的各種安排,以涵蓋所有此類修改和等效安排。While the present invention has been described in connection with the exemplary embodiments, it should be understood that the invention is not limited to the disclosed embodiments, but is intended to cover various arrangements within the spirit and scope of the broadest interpretation to encompass all such Modifications and Equivalent Arrangements.
惟以上所述者,僅為本發明的實施例而已,當不能以此限定本發明實施的範圍,凡是依本發明申請專利範圍及專利說明書內容所作的簡單的等效變化與修飾,皆仍屬本發明專利涵蓋的範圍內。However, the above are only examples of the present invention, and should not limit the scope of implementation of the present invention. Any simple equivalent changes and modifications made according to the scope of the patent application of the present invention and the contents of the patent specification are still included in the scope of the present invention. within the scope of the invention patent.
202:獲得多個層析成像圖的步驟
204:產生二維層析成像圖數據庫的步驟
206:建構一初始三維模型的步驟
208:建構該待查物件的該三維模型的步驟
208a:執行一自旋轉換在該初始三維模型的子步驟
208b:執行一空間轉換的子步驟
208c:取代該代替換的三維模型的一部分的子步驟
208d:執行一濾波雜訊操作在該等轉換後數據庫的子步驟
210:判定是否疊代的步驟
212:基於該疊代過程的一結果的步驟
110:層析成像儀
120:運算裝置
122:處理器
124:數據儲存器
126:通信單元
150:待查物件
202: Steps for obtaining multiple tomograms
204: Steps of generating a two-dimensional tomographic image database
206: Steps to construct an initial 3D model
208: the step of constructing the three-dimensional model of the object to be inspected
208a: Substep of performing a spin transformation on the
本發明的其他的特徵及功效,將於參照圖式的實施方式中清楚地呈現,其中:
圖1是一用於實施一種建構一根據本發明的一實施例之該待查物件150之三維模型的方法的系統的方塊圖;
圖2是一說明根據本發明的一實施例之建構該待查物件之三維模型的方法之步驟的流程圖;
圖3是是該待查物件之一示例的一正視圖;
圖4是是該待查物件之一示例的一正視圖;
圖5是一說明用於獲得該待查物件的多個示例層析成像圖;
圖6是一說明一相對於一水平方向的示例性剪切變換的示意圖;
圖7是一說明五個示例性轉換後影像被用來替換該代替換的三維模型的示意圖;
圖8是一說明該待查物件的該三維模型結果的一影像的一示意圖;
圖9是一該待查物件的該三維模型之一部分的示意性透視圖;及
圖10是的示例中,是一對應於該疊代過程的該初始三維模型之一部分的一示意圖。
Other features and effects of the present invention will be clearly presented in the embodiments with reference to the drawings, wherein:
1 is a block diagram of a system for implementing a method of constructing a three-dimensional model of the
206:建構一初始三維模型的步驟 206: Steps to construct an initial 3D model
208:建構該待查物件的該三維模型的步驟 208: the step of constructing the three-dimensional model of the object to be inspected
208a:執行一自旋轉換在該初始三維模型的子步驟 208a: Substep of performing a spin transformation on the initial 3D model
208b:執行一空間轉換的子步驟 208b: Substep of performing a spatial transformation
208c:取代該代替換的三維模型的一部分的子步驟 208c: Substep of replacing part of the 3D model replaced by this generation
208d:執行一濾波雜訊操作在該等轉換後數據庫的子步驟 208d: Substep of performing a noise filtering operation on the converted databases
210:判定是否疊代的步驟 210: The step of determining whether to iterate
Claims (9)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
TW110106913A TWI764593B (en) | 2021-02-26 | 2021-02-26 | Method of constructing three-dimensional model by tomographic reconstruction technology |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
TW110106913A TWI764593B (en) | 2021-02-26 | 2021-02-26 | Method of constructing three-dimensional model by tomographic reconstruction technology |
Publications (2)
Publication Number | Publication Date |
---|---|
TWI764593B true TWI764593B (en) | 2022-05-11 |
TW202234349A TW202234349A (en) | 2022-09-01 |
Family
ID=82594219
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
TW110106913A TWI764593B (en) | 2021-02-26 | 2021-02-26 | Method of constructing three-dimensional model by tomographic reconstruction technology |
Country Status (1)
Country | Link |
---|---|
TW (1) | TWI764593B (en) |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
TWI323425B (en) * | 2006-07-28 | 2010-04-11 | Univ Nat Cheng Kung | Method and system for reconstructing 3-d endoscopic images |
US8750615B2 (en) * | 2010-08-02 | 2014-06-10 | Case Western Reserve University | Segmentation and quantification for intravascular optical coherence tomography images |
CN109547769A (en) * | 2018-09-26 | 2019-03-29 | 武汉理工大学 | A kind of highway communication dynamic 3 D number scene acquisition building system and its working method |
CN112381916A (en) * | 2020-12-08 | 2021-02-19 | 西南石油大学 | Digital rock core three-dimensional structure reconstruction method using two-dimensional slice image |
-
2021
- 2021-02-26 TW TW110106913A patent/TWI764593B/en active
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
TWI323425B (en) * | 2006-07-28 | 2010-04-11 | Univ Nat Cheng Kung | Method and system for reconstructing 3-d endoscopic images |
US8750615B2 (en) * | 2010-08-02 | 2014-06-10 | Case Western Reserve University | Segmentation and quantification for intravascular optical coherence tomography images |
CN109547769A (en) * | 2018-09-26 | 2019-03-29 | 武汉理工大学 | A kind of highway communication dynamic 3 D number scene acquisition building system and its working method |
CN112381916A (en) * | 2020-12-08 | 2021-02-19 | 西南石油大学 | Digital rock core three-dimensional structure reconstruction method using two-dimensional slice image |
Also Published As
Publication number | Publication date |
---|---|
TW202234349A (en) | 2022-09-01 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11610346B2 (en) | Image reconstruction using machine learning regularizers | |
US11633146B2 (en) | Automated co-registration of prostate MRI data | |
CN108986115B (en) | Medical image segmentation method and device and intelligent terminal | |
CN109308728B (en) | Positron emission computed tomography image processing method and device | |
JP5543448B2 (en) | High efficiency computed tomography | |
Bade et al. | Comparison of fundamental mesh smoothing algorithms for medical surface models. | |
US7822254B2 (en) | Automatic positioning of matching multi-planar image reformatting (MPR) views of multiple 3D medical images | |
JP2009520558A (en) | Point-based adaptive elasticity image registration | |
US20090219289A1 (en) | Fast three-dimensional visualization of object volumes without image reconstruction by direct display of acquired sensor data | |
Wu et al. | Stabilizing deep tomographic reconstruction: Part A. Hybrid framework and experimental results | |
CN112541871B (en) | Training method of low-dose image denoising network and denoising method of low-dose image | |
CN108320314B (en) | Image processing method and device based on CT transverse image and display system | |
KR101885562B1 (en) | Method for mapping region of interest in first medical image onto second medical image and apparatus using the same | |
Wei et al. | 2-step sparse-view ct reconstruction with a domain-specific perceptual network | |
TWI764593B (en) | Method of constructing three-dimensional model by tomographic reconstruction technology | |
CN109685871A (en) | Image rebuilding method, computer equipment and computer readable storage medium | |
US11138736B2 (en) | Information processing apparatus and information processing method | |
US20220277513A1 (en) | Method for constructing a three-dimensional model using tomographic reconstruction technique | |
US20220292673A1 (en) | On-Site training of a machine-learning algorithm for generating synthetic imaging data | |
CN115761134A (en) | Twin model generation method, system, nuclear magnetic resonance device, and medium | |
Okamoto et al. | Patch-based artifact reduction for three-dimensional volume projection data of sparse-view micro-computed tomography | |
Hu et al. | Single image super resolution of 3D MRI using local regression and intermodality priors | |
Cui et al. | Wavelet-based joint CT-MRI reconstruction | |
CN105143865A (en) | Extended field iterative reconstruction technique (EFIRT) for correlated noise removal | |
CN113936068A (en) | Artifact correction method, artifact correction device and storage medium |