TW552131B - Real-time three-dimensional ultrasonic image system - Google Patents

Real-time three-dimensional ultrasonic image system Download PDF

Info

Publication number
TW552131B
TW552131B TW91119964A TW91119964A TW552131B TW 552131 B TW552131 B TW 552131B TW 91119964 A TW91119964 A TW 91119964A TW 91119964 A TW91119964 A TW 91119964A TW 552131 B TW552131 B TW 552131B
Authority
TW
Taiwan
Prior art keywords
image
dimensional
real
time
reconstruction
Prior art date
Application number
TW91119964A
Other languages
Chinese (zh)
Inventor
Luan-Jiau Chiou
Jiun-Tzai Lai
Sz-Lian Yu
Jin-Deng Gau
Original Assignee
Chung Shan Inst Of Science
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Chung Shan Inst Of Science filed Critical Chung Shan Inst Of Science
Priority to TW91119964A priority Critical patent/TW552131B/en
Application granted granted Critical
Publication of TW552131B publication Critical patent/TW552131B/en

Links

Abstract

The present invention relates to a real-time three-dimensional ultrasonic image system, particularly an ultrasonic three-dimensional image system comprising a rapid image retrieval/reconstruction card, an image graphing card, an image display card, a main control computer, and a database server. The real-time three-dimensional ultrasonic image system performs a rapid retrieval of two-dimensional analog or digital ultrasonic image data, a rapid reconstruction of a three-dimensional ultrasonic image, a depicting operation, and a real-time display on a computer screen, in order to provide functions such as a measurement on the volume of an object, for the purpose of medical review and diagnostic.

Description

A7 552131 五、發明說明(/ ) 本發明係爲~*種即時二維超音波影像系統,尤指一·種 可達到高速與即時效果的超音波影像系統以及立體顯像系 統,用以解決傳統超音波立體影像系統處理速度過於緩慢 的缺失。 早期受限於電腦技術之限制下,僅能以二維影像技術 呈現’然由於缺乏具像或具體的輪廓或形狀的現象下,現 已全然由立體影像技術取代,使得物品得以更真實地呈現 出’有利於定性或定量分析以及臨床診斷方面,而立體影 像技術方面,主要爲對逐次步階掃描或拍攝所得之連續且 大量的二維影像資料予以重疊處理,亦即爲依照相鄰掃描 資料之間的關係,重建出物品之立體影像輪廓,並依各位 置之影像深淺關係,建立權重(Weight)資料,組合出影像 外圍之立體影像者,而醫學上所使用的三維超音波系統, 即爲此類應用,然而受限於傳統的三維超音波系統,槪爲 採用低速之影像擷取(I MA Q )單元,擷取二維類比型 式之超音波視訊後,再運用軟體以依序讀入資料之串列方 式進行重疊運算處理,如眾所周知的是,以軟體對大量資 料進行運算處理,處理速度顯然不夠理想,就以處理一張 影像而論’約需數十秒鐘以上,此種立體影像之重建方 式’花費時間相當長,無法符合快速處理、描繪及顯示的 特性’而本發明人等欲提出一能符合即時處理效能之即時 三維超音波影像系統。 本發明之主要目的在於提供一種即時三維超音波影像 系統’以具高速運算之處理器及硬體管線(pipeline)平行處 3 ¥^尺¥適^?^國家標準(CNS)A4H (21〇 χ 的7 公)~— -- ---------------------訂--------•線 (請先閱讀背面之注意事項再填寫本頁) 552131 A7 --*--- ----B7 ---- 五、發明說明(么) 理能力之影像擷取/重建卡、影像描繪卡等,提供一種可 大幅提昇三維超音波影像顯示速度之影像系統者’俾便於 使用者可更快速地進行目標物影像分析及辨識作業。 本發明之次一目的在於提供一種即時三維超音波影像 系統,更提供三維超音波影像快速儲存與再使用之管理效 能’此影像系統除了包括有感測介面及三維影像處理機制 之外,更透過一快速匯流道(PCI-bus,compact PCI-bus或 PXI-bus等),而可輕易地與個人電腦銜接,提供影像顯市 及資料儲存以及轉存至資料伺服器中,構成一種便於儲存 與管理之架構。 本發明之另一目的在於提供一種即時三維超音波影像 系統,此超音波影像系統係以快速影像擷取/重建卡、影 像描繪卡、影像顯示卡、主控電腦以及資料庫伺服器所組 成,經由快速影像擷取/重建卡,對送入之二維超音波影 像進行快速擷取及建構成三維立體影像,再經由影像描繪 卡進行立體影像的快速描繪處理,而後,爲經影像顯示卡 及螢幕快速地顯示超音波立體影像,提供目標物的快速影 像分析及辨識效果,更經主控電腦以及資料伺服器進行資 料管理作業,建構出一完整的高速三維超音波影像系統。 爲使貴審查委員能夠進一步瞭解本發明之架構、特 徵及其他目的,茲附以圖式詳細說明如后: (一)·圖式部份: 第一圖:係本發明之結構方塊示意圖。 第二圖:係本發明之影像擷取/重建卡之內部方塊圖。 4 木紙張尺度適用中國國家標準(CNS)A4規格(210 X 297公釐) -------------裝--------訂---------線 (請先閱讀背面之注意事項再填寫本頁)A7 552131 V. Description of the invention (/) The present invention is a kind of real-time two-dimensional ultrasound imaging system, especially one kind of ultrasound imaging system and three-dimensional imaging system that can achieve high-speed and instant effects, to solve the traditional The lack of processing speed of ultrasonic stereo imaging system is too slow. Limited by computer technology in the early days, it can only be presented with two-dimensional imaging technology. However, due to the lack of representation or specific contours or shapes, it has now been completely replaced by three-dimensional imaging technology, which makes the objects more realistic. It is beneficial for qualitative or quantitative analysis and clinical diagnosis, while for stereoscopic imaging technology, it is mainly to superimpose continuous and large amounts of two-dimensional image data obtained by sequential step scanning or shooting, that is, according to adjacent scanning data The relationship between them is used to reconstruct the outline of the stereo image of the object, and the weight data is established according to the relationship between the depth of the image at each position, and the stereo image of the periphery of the image is combined. For this type of application, however, it is limited by the traditional three-dimensional ultrasound system. It uses a low-speed image capture (I MA Q) unit to capture two-dimensional analog ultrasound images, and then uses the software to read them sequentially. The data is input in a serial manner for overlapping calculation processing. As is well known, a large amount of data is calculated and processed by software. The speed is obviously not ideal, so in terms of processing an image, it takes' about tens of seconds or more. Such a stereo image reconstruction method 'takes a long time and cannot meet the characteristics of rapid processing, rendering and display.' I want to propose a real-time three-dimensional ultrasound imaging system that can meet real-time processing performance. The main purpose of the present invention is to provide a real-time three-dimensional ultrasound imaging system, which uses a processor with high-speed operation and a hardware pipeline in parallel. 3 National Standard (CNS) A4H (21〇χ 7 male) ~------------ order -------- • line (please read the precautions on the back before filling (This page) 552131 A7-* --- ---- B7 ---- V. Description of the Invention (Capture) Image acquisition / reconstruction card, image drawing card, etc. to provide a method that can greatly enhance three-dimensional ultrasound The image system speed of the image display speed is convenient for the user to analyze and identify the target image more quickly. A second object of the present invention is to provide a real-time three-dimensional ultrasound image system, and also provide management performance for rapid storage and reuse of three-dimensional ultrasound images. In addition to including a sensing interface and a three-dimensional image processing mechanism, A fast bus (PCI-bus, compact PCI-bus or PXI-bus, etc.), which can be easily connected to a personal computer, providing image display and data storage and transfer to a data server, forming a convenient storage and Management structure. Another object of the present invention is to provide a real-time three-dimensional ultrasound imaging system. The ultrasound imaging system is composed of a fast image acquisition / reconstruction card, an image drawing card, an image display card, a main control computer, and a database server. Quickly capture and construct the two-dimensional ultrasound image that is sent through the fast image capture / reconstruction card, and construct a three-dimensional stereo image, and then perform fast rendering processing of the stereo image through the image rendering card. The screen quickly displays the three-dimensional ultrasonic image, provides fast image analysis and identification of the target, and conducts data management operations through the host computer and data server to construct a complete high-speed three-dimensional ultrasonic image system. In order to enable your review committee to further understand the structure, features and other purposes of the present invention, detailed drawings are attached as follows: (I) Schematic part: The first figure: is a block diagram of the present invention. The second figure is an internal block diagram of the image capture / reconstruction card of the present invention. 4 Wood paper size is applicable to China National Standard (CNS) A4 (210 X 297 mm) ------------- Installation -------- Order ------- --Line (Please read the notes on the back before filling this page)

A7 552131 五、發明說明(3 ) 第三圖:係本發明之影像擷取/重建卡之內部方塊圖。 第四圖·係本發明之影像描繪卡的結構方塊圖。 第五圖:係本發明之影像描繪卡的實施例電路詳圖。 (二)·圖號部份: (1 0) ( 2 0 )超音波視訊 (3 0 )影像擷取/重建卡 (3 1 )資料擷取模組 (3 1 1 )視訊解碼器 (3 1 2 )轉換電路 (3 2)影像重建模組 (3 2 1 )資料流控制器與立體影像處理器 (3 2 2 ) ( 3 2 3 )緩衝記憶體 (4 0 )影像描繪卡 (4 1 )〜(4 1 η)立體像素記憶體 ( 4 1 0 ) ( 4 2 0 )記憶體介面 (4 2 )〜(4 2 η)二維像素記憶體 (4 3 )影像描繪處理器 (4 3 1 )〜(4 3 η )平行處理器 (4 3 1 1 )〜(4 3 1 5 )機制 (4 4)區段記憶體 (5 0 )影像顯示卡 (6 0 )電腦系統 (6 2 )快速匯流道 (7 0 )資料庫伺服器 (8 0 )網際網路 本發明之即時三維超#波影像系統,主要爲針對傳統 類比式超音波影像處理速度不佳之缺點而加以改進者,透 過高速影像擷取/重建卡、高速立體影像描繪卡、三維影 像顯不卡、電腦系統以及資料庫伺服器組成一^可大幅提昇 5 本紙張尺度適用中國國家標準(CNS)A4規格(210 X 297公釐) ---------------------訂·-------* (請先閱讀背面之注意事項再填寫本頁) A7 552131 五、發明說明(¥ ) 三維超音波影像重建、描繪處理及顯示之速度,形成一種 可達到即時地對目標物進彳了分析及辨識之即時二維超音波 影像系統。 如第一圖所示,本發明爲建構出一可便於與既有電腦 設備連線或整合之即時三維超音波影像系統’結構包括一 可接收類比式及數位式超音波視訊(10)(2 0)之三 維影像擷取/重建卡(3 0 )、三維影像描繪卡(4 0 )、三維影像顯示卡(5 0 ),搭配一電腦系統(6 〇)以及資料庫伺服器(7 〇 )而形成一具有快速即時顯 像以及具有資料管理效能之三維超音波影像系統’該透過 超音波感測儀器介面所取得之類比式或數位式超音波視訊 (1 0 )( 2 0 ),即藉由本發明之三維影像擷取/重建 卡(3 0 )對送入之二維超音波影像進行高速擷取及高速 轉換重建成三維超音波影像資料,其後,重建完成之三維 影像資料,則透過三維影像描繪卡(4 0 )進行立體影像 的描繪處理作業,最後,由三維影像顯示卡(5 0 )將三 維超音波影像顯示在電腦螢幕或顯示器上,由於本發明之 各部份爲使用高速管線(pipeline)之平行處理架構,獲致即 時影像處理與顯像的效果,而顯示之超音波立體影像可透 過電腦系統(6 0 )以及資料庫伺服器(7 0 )作長久保 存,或經網際網路(8 0 )傳送至遠端,形成一完整的超 音波三維轉換及儲存系統。 關於本發明各部位之詳細構造,首先如第二圖所示’ 圖面中央之三維影像擷取/重建卡(3 0 )設計成一可# 6 木紙張尺度適用中國國家標準(CNS)A4規格(210 X 297公釐) ---------------------訂---------線 (請先閱讀背面之注意事項再填寫本頁) 552131 A7 ____ B7_ 五、發明說明(f ) 插接在任何電腦系統(6 0 )(即:個人電腦、筆記型電 腦或類似設備)之快速匯流道(6 2 )(可爲pCI-Bus/ompact PCI,PXI-Bus 等擴充插槽) 上之型態 ,形成一 可供整合在電腦系統(6 0 )內之立體影像擷取/重建設 備,而可經由電腦系統(6 0 )儲存影像資料以及提供監 控與管理,而該影像擷取/重建卡(3 0 )的內部結構爲 由硬體結構所構成之視訊資料擷取模組(31)以及三維 影像重建模組(3 2 )所組成’各個模組(3 1 )( 3 2 )均爲高速架構,達到高速資料擷取以及高速影像轉 換,而該視訊資料擷取模組(3 1 )更爲一種可選擇性接 收外來的類比式超音波視訊(1 〇)或是數位式超音波視 訊(2 0 )的設計,使得視訊輸入源的適用性較佳,提供 良好的適用性。 如第三圖所示,爲前述影像擷取/重建卡(3 0 )之 細部結構方塊圖,其中,在圖面左方之視訊解碼器(3 1 1 )以及轉換電路(3 1 2 )爲形成資料擷取機制,視訊 解碼器(3 1 1 )爲對類比式視訊進行類比至數位的轉換 作業,而轉換電路(312)爲對LVDS (低電壓差動 型)的數位式視訊轉換爲T T L型態的數位型式,另以一 選擇訊號(MODE CONTROLLER)選擇由那一組訊號輸入, 圖面中央及右側之以一資料流控制器與立體影像處理器 (3 2 1 )與兩組緩衝記憶體(3 2 2 ) ( 3 2 3 )則形 成供影像重建用途,該資料流控制器與立體影像處理器 (3 2 1 )爲將送入之二維超音波視訊進行資料流的控制 7 本纸張尺度適用中國國家標準(CNS)A4規格(210 X 297公釐) ---------------------訂·-------I (請先閲讀背面之注意事項再填寫本頁) 552131 A7 _B7_ 五、發明說明(厶) 與立體影像之重建,並利用該兩組緩衝記憶體(3 2 2 ) (3 2 3 )進行資料交替不中斷之連續輸出,若送入的資 料爲數位訊號時,僅直接將訊號送入至快速匯流道(6 2 )即可,而對於類比視訊輸入時,爲達解決其非連續性 問題,故而透過該兩緩衝記憶體(3 2 2 )( 3 2 3 )進 行暫存,然後做交替連續輸出者,而整個影像流程控制、 產生同步訊號、自緩衝記憶體取得影像像素資訊等,均由 該資料流控制器與立體影像處理器(3 2 1 )完成。 如第四圖所示,爲三維超音波影像描繪卡的內部方塊 圖,係以三維影像描繪處理器(4 3 )爲控制中樞,經搭 配二維像素記憶體(4 2 )、立體像素記憶體(4 1 )以 及區段記憶體(4 4 )所組成,該影像描繪處理器(4 3 )係設計爲一訂製型積體電路(A S I C )型式,內部 爲採用管線平行處理架構,而經由快速匯流道(6 2 )送 入之立體影像爲送入至立體像素記憶體(4 1 ) (VOXEL MEMORY)中,經由影像描繪處理器(4 3 )進行快速的 描繪運算處理,該區段記憶體(4 4 )爲存放中間的媒介 値,以供處理器存取使用,經描繪完成的影像則存入像素 記憶體(4 2 ) (PIXEL MEMORY)中,影像顯示系統(三 維影像顯示卡)則透過快速匯流道(6 2 )將像素記憶體 (4 2)的影像顯示在電腦螢幕上。 關於此三維影像描繪卡之內部結構上,可配合參看第 五圖所示,該三維影像描繪處理器(4 3 )即以多個以管 線及迴圈連接之平行處理器(4 3 1 )〜(4 3 η )所組 8 衣紙張尺度適用中國國家標準(CNS)A4規格(210 χ 297公釐) ---------------------訂—-------- (請先閲讀背面之注意事項再填寫本頁) 552l3i A7 __B7___ &、發明說明(7 ) 成,而以位在上方及下方之記憶體介面(4 1 Ο ) ( 4 2 〇 )分別與立體像素記憶體(4 1 1 )〜(4 1 η )及二 維像素記憶體(4 2 1 )〜(4 2 η )連接,形成高速描 繪處理機制,而各個平行處理器(4 3 1 )〜(4 3 η ) 的內部,主要爲進行如第五圖右側之各項作業,首先爲對 欲處理的像素進行影像插補作業(4 3 1 .1 ) (Interpolation ),以三線段插補(Tri-linear interpolation) 法則選取八個最鄰近的立體像素(voxels)計算添入的値,然 後進行影像亮度梯階估算機制(4 3 1 2 ) (Gradient Estimation),計算影像亮度梯階度的値,以提供下一個影 像明暗處理之用(透過影像明暗處理及分級機制(4 3 1 3 )達成),並利用馮式影像亮度矯正法(Phong illumination)計算像素亮度値,影像分級處理(Classification) (經影像明暗處理及分級機制(4 3 1 3 )達成)爲利用 影像亮度矯正對應表查表找出每一對應點的顏色與不透明 度,最後進入影像綜整處理機制(4 3 1 4 ) (Composting) 綜合整理混合得到需要的像素値輸出至區段緩衝區機制 (4 3 1 5 )進行暫存處理,而該影像描繪處理器(4 3)內建有快速匯流道介面(第五圖左側)’可直接與系 統快速匯流道(32bit 66MHz)連接,快速匯流道的傳輸率需 達2 6 4Mbps以上(因各項資料均由此通道傳遞之故), 在系統具備3 Oframes/sec的快速處理能力’即每秒描繪 3 0個256x256x256的立方體像素(每秒處理500百萬以 上的像素)的特性下,本發明使用n條管線平行處理器, 9 ---------- ------------------------ ' 木紙張尺度適用中國國家標準(CNS)A4規格(210 X 297公釐) ----------------- (請先閱讀背面之注意事項再填寫本頁) --線 _ 552131 A7 _B7_ 五、發明說明(& ) 以.η個像素記憶體以加速處理速度,立體像素記憶體的存 取速度至少在1 3 3 ΜΗ ζ的情況下,每秒可輸出ηxl 3 3百萬個以上的像素,由此可顯示本發明已達可實施之階 段。 綜上所述,本發明爲提供一種以高速管線平行處理型 態之影像擷取/重建卡、影像描繪卡、影像顯示卡以及電 腦系統所組成之架構,形成一種即時效果之三維超音波影 像系統,相較於傳統以串列傳輸及軟體運算方式,確爲一 具提昇處理效益之設計,應符專利申請要件,爰依法提出 申請。 --------------裝—— (請先閱讀背面之注意事項再填寫本頁) 10 . 線- _ 衣紙張尺度適用中國國家標準(CNS)A4規格(210 X 297公釐)A7 552131 V. Description of the invention (3) The third picture: is the internal block diagram of the image capture / reconstruction card of the present invention. The fourth figure is a block diagram showing the structure of the video card of the present invention. Fig. 5 is a detailed circuit diagram of an embodiment of the image drawing card of the present invention. (II) · Picture part: (1 0) (2 0) Ultrasonic video (3 0) image capture / reconstruction card (3 1) data capture module (3 1 1) video decoder (3 1 2) Conversion circuit (3 2) Image reconstruction module (3 2 1) Data stream controller and stereo image processor (3 2 2) (3 2 3) Buffer memory (4 0) Image drawing card (4 1) ~ (4 1 η) stereo pixel memory (4 1 0) (4 2 0) memory interface (4 2) ~ (4 2 η) two-dimensional pixel memory (4 3) image rendering processor (4 3 1 ) ~ (4 3 η) Parallel processor (4 3 1 1) ~ (4 3 1 5) Mechanism (4 4) Section memory (50) Video display card (60) Computer system (62) Fast Confluence channel (7 0) database server (8 0) Internet The real-time three-dimensional ultra # wave imaging system of the present invention is mainly for improving the shortcomings of the poor processing speed of traditional analog ultrasonic images. Acquisition / reconstruction card, high-speed three-dimensional image rendering card, three-dimensional image display card, computer system, and database server ^ can greatly improve 5 paper sizes applicable to China National Standard (CNS) A4 specifications (210 X 297 Mm) --------------------- Order · ------- * (Please read the notes on the back before filling in this page) A7 552131 5 Explanation of the invention (¥) The speed of 3D ultrasound image reconstruction, rendering processing and display, forms a real-time 2D ultrasound image system that can analyze and identify the target in real time. As shown in the first figure, the present invention is to construct a real-time three-dimensional ultrasound image system that can be easily connected or integrated with existing computer equipment. The structure includes a receivable analog and digital ultrasound video (10) (2 0) three-dimensional image capture / reconstruction card (30), three-dimensional image rendering card (40), three-dimensional image display card (50), with a computer system (60) and a database server (70) To form a three-dimensional ultrasonic imaging system with fast real-time imaging and data management performance. The analog or digital ultrasonic video (1 0) (2 0) obtained through the interface of the ultrasonic sensing instrument. The three-dimensional image acquisition / reconstruction card (30) of the present invention performs high-speed acquisition and high-speed conversion on the two-dimensional ultrasonic image that is sent to reconstruct the three-dimensional ultrasonic image data. Thereafter, the reconstructed three-dimensional image data is transmitted through The three-dimensional image drawing card (40) performs the drawing processing operation of the three-dimensional image. Finally, the three-dimensional image display card (50) displays the three-dimensional ultrasonic image on the computer screen or display. In order to use the parallel processing architecture of the high-speed pipeline, real-time image processing and imaging effects are obtained, and the displayed ultrasonic stereo images can be stored for a long time through the computer system (60) and the database server (70). Or it is transmitted to the remote end via the Internet (80) to form a complete three-dimensional ultrasound conversion and storage system. Regarding the detailed structure of each part of the present invention, firstly, as shown in the second figure, the three-dimensional image capture / reconstruction card (30) in the center of the drawing is designed to be a # 6 wood paper scale applicable to the Chinese National Standard (CNS) A4 specification ( 210 X 297 mm) --------------------- Order --------- line (Please read the precautions on the back before filling this page ) 552131 A7 ____ B7_ V. Description of the invention (f) Plug in the fast bus (6 2) of any computer system (60) (ie: personal computer, notebook computer or similar device) (can be pCI-Bus / Ompact PCI, PXI-Bus and other expansion slots) form a stereo image capture / reconstruction device that can be integrated in a computer system (60), and can store image data through the computer system (60) And provide monitoring and management, and the internal structure of the image acquisition / reconstruction card (30) is composed of a video data acquisition module (31) and a three-dimensional image reconstruction module (3 2) composed of a hardware structure 'Each module (3 1) (3 2) has a high-speed architecture to achieve high-speed data acquisition and high-speed image conversion, and the video data acquisition module (3 1) A more selective design for receiving external analog ultrasonic video (100) or digital ultrasonic video (20), making the applicability of video input sources better and providing good applicability. As shown in the third figure, it is a detailed structure block diagram of the foregoing image capture / reconstruction card (30). Among them, the video decoder (3 1 1) and the conversion circuit (3 1 2) on the left of the figure are The data acquisition mechanism is formed. The video decoder (3 1 1) performs analog-to-digital conversion on the analog video, and the conversion circuit (312) converts LVDS (low-voltage differential) digital video to TTL. Type digital type, and a selection signal (MODE CONTROLLER) to select which set of signals to input, a data flow controller and a stereo image processor (3 2 1) and two sets of buffer memory in the center and right of the drawing The body (3 2 2) (3 2 3) is formed for image reconstruction. The data stream controller and the stereo image processor (3 2 1) control the data flow of the two-dimensional ultrasonic video that is sent in. Paper size applies to China National Standard (CNS) A4 (210 X 297 mm) --------------------- Order · ------- I (Please read the notes on the back before filling this page) 552131 A7 _B7_ V. Description of the invention (厶) and reconstruction of stereo images, and use the two sets of buffers The memory (3 2 2) (3 2 3) performs continuous output of data alternately without interruption. If the input data is a digital signal, only the signal is directly sent to the fast bus (6 2), and for the In the analog video input, in order to solve its discontinuity problem, the two buffer memories (3 2 2) (3 2 3) are used for temporary storage, and then alternately output continuously, and the entire image flow is controlled and synchronized. The signal and the image pixel information obtained from the buffer memory are completed by the data stream controller and the stereo image processor (321). As shown in the fourth figure, it is an internal block diagram of a three-dimensional ultrasonic image rendering card. The three-dimensional image rendering processor (4 3) is used as the control center, and the two-dimensional pixel memory (4 2) and the three-dimensional pixel memory are used. (4 1) and segment memory (4 4). The image drawing processor (4 3) is designed as a custom integrated circuit (ASIC) type. The internal structure is pipeline parallel processing. The three-dimensional image sent by the fast convergence channel (6 2) is sent to the three-dimensional pixel memory (4 1) (VOXEL MEMORY), and the rapid rendering calculation processing is performed by the image rendering processor (4 3). The body (4 4) is the intermediate medium for storage and access by the processor, and the image after the drawing is stored in the pixel memory (4 2) (PIXEL MEMORY). The image display system (three-dimensional image display card) The image of the pixel memory (4 2) is displayed on the computer screen through the fast bus (6 2). Regarding the internal structure of this three-dimensional image rendering card, it can be coordinated as shown in the fifth figure. The three-dimensional image rendering processor (4 3) is a plurality of parallel processors (4 3 1) connected by pipelines and loops. (4 3 η) Group 8 paper sizes are applicable to China National Standard (CNS) A4 (210 χ 297 mm) --------------------- Order— -------- (Please read the precautions on the back before filling this page) 552l3i A7 __B7___ & Invention Description (7), and the memory interface (4 1 Ο) above and below (4 2 〇) is connected with the three-dimensional pixel memory (4 1 1) ~ (4 1 η) and the two-dimensional pixel memory (4 2 1) ~ (4 2 η) respectively to form a high-speed rendering processing mechanism, and each is parallel The processors (4 3 1) to (4 3 η) are mainly used to perform various operations as shown on the right side of the fifth figure, and first perform image interpolation operations on the pixels to be processed (4 3 1 .1) (Interpolation ), Use the tri-linear interpolation rule to select the eight nearest voxels to calculate the added 値, and then perform the image brightness step estimation machine (4 3 1 2) (Gradient Estimation), calculates the 梯 of the brightness step of the image to provide the next image light and dark processing (through the image light and dark processing and grading mechanism (4 3 1 3)), and uses Feng style The image brightness correction method (Phong illumination) calculates the pixel brightness, and the image classification (achieved by the image light and dark processing and classification mechanism (4 3 1 3)) is to find each corresponding point by using the image brightness correction correspondence table lookup table. Color and opacity, and finally enter the image integration processing mechanism (4 3 1 4) (Composting) to comprehensively arrange and mix to get the required pixels, and output to the segment buffer mechanism (4 3 1 5) for temporary storage processing, and the The image rendering processor (4 3) has a built-in fast bus interface (left side of the fifth figure), which can be directly connected to the system fast bus (32bit 66MHz), and the transmission rate of the fast bus needs to be above 264 Mbps (for each The data are transmitted through this channel), the system has a fast processing capacity of 3 Oframes / sec ', that is, 30 cubic pixels of 256x256x256 can be drawn per second (processing more than 500 million per second Under the characteristics of), the present invention uses n pipeline parallel processors, 9 ---------- ----------------------- -'The size of wood paper is applicable to China National Standard (CNS) A4 (210 X 297 mm) ----------------- (Please read the precautions on the back before filling this page ) --Line _ 552131 A7 _B7_ V. Description of the invention (&) Use .η pixel memory to speed up the processing speed, and the access speed of the stereo pixel memory is at least 1 3 3 Μζ ζ, can be per second It can output ηxl 3 or more than 3 million pixels, thereby showing that the present invention has reached a stage where it can be implemented. In summary, the present invention is to provide a structure composed of an image capture / reconstruction card, an image drawing card, an image display card, and a computer system in a parallel processing mode with a high-speed pipeline to form a three-dimensional ultrasound image system with real-time effects. Compared with the traditional method of serial transmission and software operation, it is indeed a design that enhances the efficiency of processing. It should meet the requirements of patent application and apply according to law. -------------- Installation—— (Please read the precautions on the back before filling this page) 10. Thread-_ Applicable to China National Standard (CNS) A4 (210 X 297 mm)

Claims (1)

552131 A8 B8 C8 _ D8 六、申請專利範圍 1 ·—種即時二維超音波影像系統,包括: 一影像擷取/重建機制,以高速資料擷取機制以及管 線平行處理架構之影像擷取模組以及三維影像重建模組所 組成’對輸入端超音波視訊進行高速擷取以及重建成三維 立體影像資料; 一影像描繪機制,以管線平行處理器型態之影像描繪 處理器以及像素記憶體所構成,對立體影像資料進行像素 描繪處理; 一影像顯示機制,爲將影像描繪機制送入之像素資料 轉換爲顯示器所能接收的格式,令顯示器顯示三維超音波 影像, 一快速匯流道,爲與影像擷取/重建機制以及影像描 繪機制連接,作爲資料傳遞之通道; 一電腦系統,透過快速匯流道與前述各部份連結; 形成一種以快速處理機制所架構而成之立體影像擷取 及重建之方法。 2·如申請專利範圍第1項所述之即時三維超音波影 像系統,其中,該影像擷取/重建機制可接收低電壓差動 式(L V D S )之數位式超音波視訊以及類比式超音波視 訊者。 3 ·如申請專利範圍第1項所述之即時二維超音波影 像系統,其中,該影像擷取/重建機制爲包括有資料流控 制器與立體影像處理器者。 4·如申請專利範圍第3項所述之即時三維超音波影 11______ 本紙張尺度適用中國國家標準(CNS)A4規格(210 X 297公爱) (請先閲讀背面之注意事項再塡寫本頁) 裝 訂: 線 552131 A8 B8 C8 D8 六、申請專利範圍 像系統,其中,該影像擷取/重建機制更包括有兩組緩衝 記憶體,以提供交替進行影像資料不間斷地連續輸出者。 5·如申請專利範圍第1項所述之即時三維超音波影 像系統,其中,該影像描繪機制爲包括: 一影像描繪處理器,內部爲以多組平行處理器相互連 接形成管線處理型態,並設置有記憶體介面以及快速匯流 道介面,供與週邊溝通; 立體像素記憶體,與前述影像描繪處理器之其一記憶 體介面連接;及 二維像素記憶體,與前述影像描繪處理器之另一記憶 體介面連接者。 6·如申請專利範圍第5項所述之即時三維超音波影 像系統,其中,該影像描繪處理器之各組平行處理器爲包 括如下機制: 對影像進行插補處理之機制; 對影像進行梯階估算之機制; 對影像進行明亮處理及分級之機制;及 對影像進行綜合整理之處理機制。 7·如申請專利範圍第6項所述之即時三維超音波影 像系統,其中,該影像進行綜合處理完成後的像素輸出 値,更包括一送入區段緩衝區進行暫存之機制。 8·如申請專利範圍第1項所述之即時三維超音波影 像系統,其中,該電腦系統更可與資料庫伺服器連接,提 供影像資料之儲存管理者。 12 本紙張尺度適用中國國家標準(CNS)A4規格(210 X 297公釐) (請先閲讀背面之注意事項再塡寫本頁) :裝 、言 線 552131 A8 B8 C8 D8六、申請專利範圍9·如申請專利範圍第1或8項所述之即時三維超音 波影像系統,其中,該電腦系統更可連接網際網路,令影 像資料傳輸至遠端儲存者。 (請先閲讀背面之注意事項再填寫本頁) 裝 、-i'TJ 線 本紙張尺度適用中國國家標準(CNS)A4規格(210 X 297公釐)552131 A8 B8 C8 _ D8 VI. Patent application scope 1 · A real-time two-dimensional ultrasound imaging system, including: an image acquisition / reconstruction mechanism, an image acquisition module with a high-speed data acquisition mechanism and a pipeline parallel processing architecture And a three-dimensional image reconstruction module composed of 'high-speed capture of the input end ultrasound video and reconstruction into three-dimensional three-dimensional image data; an image rendering mechanism, a pipeline parallel processor type image rendering processor and pixel memory To perform pixel rendering processing on stereoscopic image data; an image display mechanism is to convert the pixel data sent by the image rendering mechanism into a format that can be received by the display, so that the display displays a three-dimensional ultrasonic image, a fast convergence channel, and the image The acquisition / reconstruction mechanism and the image drawing mechanism are connected as a channel for data transmission; a computer system is connected to the foregoing parts through a fast convergence channel; a three-dimensional image acquisition and reconstruction system constructed by a rapid processing mechanism is formed method. 2. The real-time three-dimensional ultrasound imaging system as described in item 1 of the scope of the patent application, wherein the image capture / reconstruction mechanism can receive low-voltage differential (LVDS) digital ultrasound video and analog ultrasound video By. 3. The real-time two-dimensional ultrasound imaging system according to item 1 of the scope of patent application, wherein the image capture / reconstruction mechanism includes a data flow controller and a stereo image processor. 4 · The real-time three-dimensional ultrasound image described in item 3 of the scope of patent application 11______ This paper size is applicable to China National Standard (CNS) A4 specification (210 X 297 public love) (Please read the precautions on the back before writing this page ) Binding: Line 552131 A8 B8 C8 D8 VI. Patent application scope image system, in which the image capture / reconstruction mechanism also includes two sets of buffer memory to provide uninterrupted and continuous output of image data. 5. The real-time three-dimensional ultrasound imaging system according to item 1 of the scope of patent application, wherein the image rendering mechanism includes: an image rendering processor, which is internally connected to each other by a plurality of parallel processors to form a pipeline processing type, A memory interface and a fast bus interface are provided for communication with the surroundings; a three-dimensional pixel memory is connected to one of the memory interfaces of the aforementioned image rendering processor; and a two-dimensional pixel memory is connected to the aforementioned image rendering processor. Another memory interface connector. 6. The real-time three-dimensional ultrasound imaging system as described in item 5 of the scope of patent application, wherein each group of parallel processors of the image rendering processor includes the following mechanisms: a mechanism for performing interpolation processing on the image; and a ladder for the image Level estimation mechanism; bright processing and grading of images; and comprehensive processing of images. 7. The real-time three-dimensional ultrasound imaging system as described in item 6 of the scope of patent application, wherein the pixel output of the image after the comprehensive processing is completed 値, further includes a mechanism for sending into a section buffer for temporary storage. 8. The real-time three-dimensional ultrasound imaging system described in item 1 of the scope of patent application, wherein the computer system can be connected to a database server to provide a storage manager for image data. 12 This paper size is in accordance with China National Standard (CNS) A4 (210 X 297 mm) (Please read the precautions on the back before writing this page): Installation and speech lines 552131 A8 B8 C8 D8 VI. Patent application scope 9 The real-time three-dimensional ultrasound imaging system as described in item 1 or 8 of the scope of patent application, wherein the computer system can be connected to the Internet to transmit image data to remote storage. (Please read the precautions on the back before filling in this page) Assembling, -i'TJ line This paper size is applicable to China National Standard (CNS) A4 (210 X 297 mm)
TW91119964A 2002-09-02 2002-09-02 Real-time three-dimensional ultrasonic image system TW552131B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
TW91119964A TW552131B (en) 2002-09-02 2002-09-02 Real-time three-dimensional ultrasonic image system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TW91119964A TW552131B (en) 2002-09-02 2002-09-02 Real-time three-dimensional ultrasonic image system

Publications (1)

Publication Number Publication Date
TW552131B true TW552131B (en) 2003-09-11

Family

ID=31713676

Family Applications (1)

Application Number Title Priority Date Filing Date
TW91119964A TW552131B (en) 2002-09-02 2002-09-02 Real-time three-dimensional ultrasonic image system

Country Status (1)

Country Link
TW (1) TW552131B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI399195B (en) * 2008-12-16 2013-06-21 Ind Tech Res Inst Apparatus and method for providing a dynamic 3d ultrasound image

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI399195B (en) * 2008-12-16 2013-06-21 Ind Tech Res Inst Apparatus and method for providing a dynamic 3d ultrasound image

Similar Documents

Publication Publication Date Title
CN101336831B (en) Rebuilding method of real-time three-dimensional medical ultrasonic image
CN102834849B (en) Carry out the image displaying device of the description of three-dimensional view picture, image drawing method, image depiction program
JP7077118B2 (en) Methods and systems for shading 2D ultrasound images
CN102622979B (en) LCD (Liquid Crystal Display) controller and display control method thereof
CN101729919B (en) System for full-automatically converting planar video into stereoscopic video based on FPGA
CN103500465A (en) Ancient cultural relic scene fast rendering method based on augmented reality technology
CN1810212A (en) Stereoscopic three or four dimensional ultrasound imaging
CN103139509B (en) A kind of OSD based on AXI bus protocol controls display packing and device
KR20220047284A (en) Systems and methods for foveated rendering
Turchini et al. Three-dimensional pathology specimen modeling using “structure-from-motion” photogrammetry: a powerful new tool for surgical pathology
CN113544746A (en) Image processing apparatus, image processing method, and program
TW552131B (en) Real-time three-dimensional ultrasonic image system
CN104546006A (en) Accurately-positioning three-dimensional medical ultrasonic image workstation and system
WO2018006379A1 (en) Imaging method and system for converting 3d animation to holographic animated interface
CN206629210U (en) Video eyeglasses
CN101322650A (en) Ultrasound pattern display method
CN206691008U (en) A kind of vehicle-mounted viewing system and vehicle
CN108806775A (en) A kind of medical image display methods and device
Koulaouzidis et al. Use of enhancement algorithm to suppress reflections in 3-D reconstructed capsule endoscopy images
CN102724535A (en) Displaying method of stereo-scanning 3D (three-dimensional) display
Jerome et al. Visualisation of Ultrasound Computer Tomography Breast Dataset
Gove et al. Image computing requirements for the 1990s: from multimedia to medicine
TWI221589B (en) Real-time three-dimensional image acquisition and reconstruction method
TW201310968A (en) Portable device with single image capturing module to form stereo-image and the method thereof
Ran et al. Infocarve: A framework for volume visualization on commodity augmented reality displays

Legal Events

Date Code Title Description
GD4A Issue of patent certificate for granted invention patent
MK4A Expiration of patent term of an invention patent