WO2002041767A1 - Systeme et procede permettant d'afficher une endoscopie virtuelle et stockage de supports lisibles par ordinateur - Google Patents

Systeme et procede permettant d'afficher une endoscopie virtuelle et stockage de supports lisibles par ordinateur Download PDF

Info

Publication number
WO2002041767A1
WO2002041767A1 PCT/KR2001/002017 KR0102017W WO0241767A1 WO 2002041767 A1 WO2002041767 A1 WO 2002041767A1 KR 0102017 W KR0102017 W KR 0102017W WO 0241767 A1 WO0241767 A1 WO 0241767A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
path
endoscopy
volume rendering
virtual endoscopy
Prior art date
Application number
PCT/KR2001/002017
Other languages
English (en)
Inventor
Yun-Mo Koo
Yeong-Gil Shin
Jin-Wook Chung
Original Assignee
Infinitt Co., Ltd.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from KR10-2001-0024390A external-priority patent/KR100466409B1/ko
Application filed by Infinitt Co., Ltd. filed Critical Infinitt Co., Ltd.
Priority to AU2002222701A priority Critical patent/AU2002222701A1/en
Publication of WO2002041767A1 publication Critical patent/WO2002041767A1/fr

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—3D [Three Dimensional] image rendering
    • G06T15/08—Volume rendering
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/003—Navigation within 3D models or images

Definitions

  • the present invention relates to a virtual endoscopy system
  • the present invention relates to a virtual endoscopy system and method, which are capable of setting a path using a cross-
  • sectional image and a volume rendering image in a virtual endoscope and a computer readable recording medium for storing the method.
  • an image reconstruction system including a virtual endoscopy system has various application fields.
  • the image reconstruction system can be used in the medical image field for a three-
  • a 3D medical imaging technique involves generating a
  • CT Computed Tomography
  • MRI Magnetic Resonance Imaging
  • the 3D medical imaging technique is used, it is possible to find a particular position and to plan an operation method with the better sense of reality.
  • the path the efficiency of diagnoses can be improved.
  • readable recording medium for storing a program including the virtual endoscopy method.
  • endoscopy system comprising an input/storage unit for reading or
  • the 3D image so as to display it as a reference image, generating an endoscopy image along a predetermined path directly displayed on the reference image, and processing the endoscopy image so as to display it; a display for displaying the reference image and the endoscopy image along the path; and an input unit for letting a user designate the path from the reference image.
  • the endoscopy image processing unit comprises a reference image processor for generating the 3D reference image so as to display it from the volume data stored in the input/storage unit, receiving a
  • a path converter for determining the position of a voxel
  • the camera displays the volume rendering image, the axial image,
  • predetermined viewing vector updates the volume rendering image, the
  • volume rendering image an axial image, a virtual endoscopy image, and a path MPR image
  • updating display of the path MPR image as a path is set in either the axial image or a 3D volume rendering image according to the manipulation of a user
  • FIG. 1 shows a virtual endoscopy system according to an
  • FIG. 2 shows an example of a screen of a virtual endoscopy
  • FIG. 3 is a flowchart for explaining a virtual endoscopy method
  • FIG. 4 is a flowchart for explaining S400 of FIG. 3 in more detail
  • FIG. 5 is a flowchart for explaining S420 of FIG. 4 in more detail
  • FIG. 6 explains processes of searching for the position of an actual
  • FIG. 7 explains the generation of a cross-sectional reformation
  • FIG. 8 explains the generation of a cross-sectional reformation
  • FIG. 9 explains the three-dimensional controlling of a camera in
  • FIG. 10 shows a three-dimensional (3D) volume rendering image used as the reference image of the virtual endoscopy system according to
  • FIG. 1 1 shows an example of loading a screen provided by a
  • FIG. 12 shows a screen providing a function of arbitrarily modifying
  • the invention is capable of modification in
  • FIG. 1 shows a virtual endoscopy system according to an
  • FIG. 1 a virtual endoscopy system according to the
  • present invention includes an input/storage unit 10, an endoscopy image
  • the processing unit 20 a display 30, and an input unit 40.
  • the input/storage unit 10 reads or transfers the 3-dimensional
  • volume data from source devices into the target devices for further
  • CT computed tomography
  • the input storage unit can be any type of resonance imaging (MRI) section scanning
  • the input storage unit 10 can be formed of access hardware for reading data from storage apparatuses inside/outside the three-dimensional image processing system and a hard disk or a memory device for storing the data.
  • the endoscopy image processing unit 20 includes a reference image processor 22, a path converter 24, and a multi-planar reformation
  • the endoscopy image processing unit 20 analyzes and displays the spatial distribution of the characteristics as a 3D image on
  • the reference image processor 22 displays the
  • 3D reference image from the volume data stored in the input/storage unit 10 receives a predetermined path passing through an inner structure
  • the path converter 24 determines the position in the volume data
  • endoscopy image is to be seen from the path input to the reference image
  • the multi-planar reformation image composer 26 generates a
  • the endoscopy image processing unit 20 is a means for calculating
  • ASIC application-specific integrated circuit
  • the display 30 displays the reference image and displays the
  • the input unit 40 lets a user designate
  • FIG. 2 shows an example of a screen of the virtual endoscopy
  • the screen of the virtual endoscopy system includes the four viewers of a 3D volume
  • Volume rendering refers to the work of
  • volume data of a 3D space
  • volume rendering image 100 of a displayed screen the axial image 200
  • the path MPR image 400 is generated in connection with the path
  • the virtual endoscopy image 300 is generated, to
  • FIG. 3 is a flowchart for explaining a virtual endoscopy method
  • the 3D volume rendering image 100 is generated so that an
  • a corresponding path is set as a path set request, and is input
  • a path can be set or changed on the axial
  • An image is generated along the path set by mapping an axial
  • the path MPR image 400 shown in FIG. 2 will be preferably
  • the controlled camera is a kind of a virtual camera that moves on the
  • endoscopy image that is, the point of view of the eyes of the user. It is
  • rendering image is reformed from the primitive image data in connection
  • the axial image 200 and the virtual endoscopy image 300 are identical to each other.
  • FIG. 4 is a flowchart for explaining S400 of FIG. 3 in more detail. Referring to FIG. 4, as points are designated by the manipulation of the user on the axial image or the 3D volume rendering image for the
  • a path is generated using the formula of a 3D curved line (S430).
  • FIG. 5 is a flowchart for explaining S420 of FIG. 4 in more detail.
  • FIG. 6 explains processes of searching for the position of an
  • a predetermined ray is casted from the center of projection (S4240).
  • the casted ray is a virtual straight ray line from a virtual 3D space rather
  • outVolumePoint is output. It is possible to convert the point input from the volume rendering image into the center of the structure on the basis of the
  • a black voxel has the density value
  • a third point shows a state right after passing through the inside of the structure.
  • the reformation image including the path is shown as the reference image. Also, the image
  • FIG. 7 explains the generation of the cross-sectional reformation image including the path according to the present invention.
  • FIG. 8 explains the generation of the cross-sectional reformation image including the path according to the present invention.
  • including a straight or curved path can be formed by generating scan lines
  • a curved planar reformation is
  • a method of spreading the overall length of the anatomical structure desired to be seen by performing the curved planar reformation in the direction where the 3D image is observed will be realized as follows.
  • Information on a curved line path that follows the center of the structure is expressed as points separated from each other by one.
  • the points are stored as a 3D coordinate system value (x, y, z). Therefore, a curved planar reformation image is obtained following a straight line that passes one point on the path because one point on the path and the viewing vector are known.
  • a value corresponding to a pixel is obtained, while moving forward using a directional vector until getting out of the boundary of the volume
  • FIG. 7 shows
  • the normal vector value of each point that forms the path is a value
  • image is formed by a plane including a point on the path and a point on the
  • one plane is determined because a cross-sectional plane
  • FIG. 9 explains the 3D controlling of a camera in the axial image
  • the position to be observed can be designated
  • the virtual endoscopy viewing direction can be controlled to the planar direction of the x, y coordinate and the depth
  • the user can easily select and
  • the position and direction of the current camera are marked with
  • the position of the camera for example, the user clicks the left mouse
  • planar direction controlling can be performed.
  • a 3D manipulation can be performed on the axial image.
  • FIG. 10 shows the 3D volume rendering image used as the
  • classification is performed by the density value corresponding to the density value corresponding to the density value corresponding to the density value corresponding
  • the user is controlled.
  • FIG. 11 shows an example of loading a screen provided by a
  • FIG. 2 viewers shown in FIG. 2 are shown. The position of the camera is marked
  • reformation image including the path is generated in a MPR path viewer.
  • the position of the camera is displayed in the multi-planar reformation
  • planar reformation image including the path, the mouse is used in the
  • FIG. 12 shows a screen that provides a function of arbitrarily
  • 3D reference image are shown.
  • the path is modified by moving the point on the path with the mouse.
  • Equipment for measuring a length on the path created as such is included in the virtual endoscopy system according to the present invention
  • readable recording media for storing the method are not limited to the
  • a light pen for example, a light pen, the keyboard, and various input apparatuses as well as the mouse can be used as the input means.
  • the input means for example, a light pen, the keyboard, and various input apparatuses as well as the mouse can be used as the input means.
  • the user can easily define and modify the path using, the image generated by the volume rendering as the reference image without preprocessing on the 3D volume data.
  • the MPR image is generated along the set path. Accordingly, it is possible to more
  • the above-mentioned virtual endoscopy that is an integrated environment of various kinds of medical images is obtained by generalizing high technologies. According to the present invention, the virtual
  • endoscopy can be developed into an integrated system including various images and technologies.
  • the present invention is not inserted into a patient, it is possible to look at
  • the virtual endoscopy according to the present invention is very useful for diagnoses.
  • the virtual endoscopy system has not been widely used because it is difficult to manipulate the virtual endoscopy system due to the inefficiency of interface.
  • the user can easily manipulate the camera and various reference images can be shown. Accordingly, it is possible to improve the efficiency of the virtual

Abstract

L'invention concerne un système et un procédé d'endoscopie virtuelle et un support d'enregistrement lisible par ordinateur. Une image de rendu de volume correspondant à une partie à observer est générée à partir de données de volume tridimensionnel (3D). L'image de rendu de volume générée, une image axiale, une image d'endoscopie virtuelle et une image MPR de trajet sont affichées sur un écran. L'image MPR de trajet affichée est mise à jour au moment où un trajet est réglé par un utilisateur, soit dans l'image axiale, soit dans l'image de rendu de volume 3D. Quand il est nécessaire de changer la position de la caméra conformément à la manipulation de l'utilisateur, des données d'image d'endoscopie virtuelle sont générées conformément au changement de la position de la caméra. L'image d'endoscopie virtuelle et l'image axiale sont mises à jour en fonction des données d'image d'endoscopie virtuelle générées. Par conséquent, l'utilisateur peut facilement définir et modifier le trajet au moyen de l'image générée par le rendu de volume comme image de référence et peut commander de manière tridimensionnelle la direction de la caméra sur deux dimensions sans pré-traitement sur les données de volume 3D.
PCT/KR2001/002017 2000-11-25 2001-11-22 Systeme et procede permettant d'afficher une endoscopie virtuelle et stockage de supports lisibles par ordinateur WO2002041767A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
AU2002222701A AU2002222701A1 (en) 2000-11-25 2001-11-22 System and method for displaying a virtual endoscopy and computer readable medium storing thereof

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
KR2000/70725 2000-11-25
KR20000070725 2000-11-25
KR10-2001-0024390A KR100466409B1 (ko) 2000-11-25 2001-05-04 가상 내시경 시스템, 가상 내시경 디스플레이 방법과 그 방법을 컴퓨터 상에서 수행하는 프로그램을 저장한 컴퓨터가 판독 가능한 기록 매체
KR2001/24390 2001-05-04

Publications (1)

Publication Number Publication Date
WO2002041767A1 true WO2002041767A1 (fr) 2002-05-30

Family

ID=26638570

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2001/002017 WO2002041767A1 (fr) 2000-11-25 2001-11-22 Systeme et procede permettant d'afficher une endoscopie virtuelle et stockage de supports lisibles par ordinateur

Country Status (2)

Country Link
AU (1) AU2002222701A1 (fr)
WO (1) WO2002041767A1 (fr)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2004110266A1 (fr) * 2003-06-09 2004-12-23 Infraredx, Inc. Catheter de balayage dote d'un codeur de position
WO2013173574A1 (fr) * 2012-05-16 2013-11-21 The Johns Hopkins University Système d'imagerie et son procédé d'utilisation pour déterminer l'échelle métrique d'une anatomie corporelle imagée
US9508143B2 (en) 2014-01-02 2016-11-29 Samsung Electronics Co., Ltd. Apparatus and method for marking region of interest

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1998011524A1 (fr) * 1996-09-16 1998-03-19 The Research Foundation Of State University Of New York Systeme et procede permettant d'effectuer un examen virtuel en trois dimensions
US5986662A (en) * 1996-10-16 1999-11-16 Vital Images, Inc. Advanced diagnostic viewer employing automated protocol selection for volume-rendered imaging
US6083162A (en) * 1994-10-27 2000-07-04 Wake Forest University Method and system for producing interactive, three-dimensional renderings of selected body organs having hollow lumens to enable simulated movement through the lumen
WO2000055812A1 (fr) * 1999-03-18 2000-09-21 The Research Foundation Of State University Of New York Systeme et procede de realisation d'un examen virtuel en trois dimensions, d'une navigation et d'une visualisation

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6083162A (en) * 1994-10-27 2000-07-04 Wake Forest University Method and system for producing interactive, three-dimensional renderings of selected body organs having hollow lumens to enable simulated movement through the lumen
WO1998011524A1 (fr) * 1996-09-16 1998-03-19 The Research Foundation Of State University Of New York Systeme et procede permettant d'effectuer un examen virtuel en trois dimensions
US5986662A (en) * 1996-10-16 1999-11-16 Vital Images, Inc. Advanced diagnostic viewer employing automated protocol selection for volume-rendered imaging
WO2000055812A1 (fr) * 1999-03-18 2000-09-21 The Research Foundation Of State University Of New York Systeme et procede de realisation d'un examen virtuel en trois dimensions, d'une navigation et d'une visualisation

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2004110266A1 (fr) * 2003-06-09 2004-12-23 Infraredx, Inc. Catheter de balayage dote d'un codeur de position
US7292715B2 (en) 2003-06-09 2007-11-06 Infraredx, Inc. Display of diagnostic data
WO2013173574A1 (fr) * 2012-05-16 2013-11-21 The Johns Hopkins University Système d'imagerie et son procédé d'utilisation pour déterminer l'échelle métrique d'une anatomie corporelle imagée
US9367914B2 (en) 2012-05-16 2016-06-14 The Johns Hopkins University Imaging system and method for use of same to determine metric scale of imaged bodily anatomy
US9508143B2 (en) 2014-01-02 2016-11-29 Samsung Electronics Co., Ltd. Apparatus and method for marking region of interest

Also Published As

Publication number Publication date
AU2002222701A1 (en) 2002-06-03

Similar Documents

Publication Publication Date Title
US6049622A (en) Graphic navigational guides for accurate image orientation and navigation
JP6312898B2 (ja) 情報処理装置、情報処理方法及びプログラム
Mori et al. Virtualized Endoscope System--An Application of Virtual Reality Technology to Diagnostic Aid--
US7912264B2 (en) Multi-volume rendering of single mode data in medical diagnostic imaging
US6697067B1 (en) Method and system for storing information regarding a selected view of a three dimensional image generated from a multi-frame object
JP4377464B2 (ja) 像表示装置
JP5567502B2 (ja) 医療用訓練方法及び装置
JP4446663B2 (ja) 医療レポートを作成する方法、システム及びコンピュータプログラム
CN1771517B (zh) 实现虚拟内镜检查的系统和方法
US7450749B2 (en) Image processing method for interacting with a 3-D surface represented in a 3-D image
US20110236868A1 (en) System and method for performing a computerized simulation of a medical procedure
US20040109032A1 (en) 3 dimensional slab rendering system method and computer-readable medium
US20050237336A1 (en) Method and system for multi-object volumetric data visualization
EP1775685A1 (fr) Dispositif et programme de traitement d'informations
Tran et al. A research on 3D model construction from 2D DICOM
Williams et al. Volumetric curved planar reformation for virtual endoscopy
JP4896470B2 (ja) 画像処理装置、医用画像診断装置及び画像処理方法
JP2006000127A (ja) 画像処理方法および装置並びにプログラム
KR100466409B1 (ko) 가상 내시경 시스템, 가상 내시경 디스플레이 방법과 그 방법을 컴퓨터 상에서 수행하는 프로그램을 저장한 컴퓨터가 판독 가능한 기록 매체
JP2008067915A (ja) 医用画像表示装置
WO2002041767A1 (fr) Systeme et procede permettant d'afficher une endoscopie virtuelle et stockage de supports lisibles par ordinateur
Teistler et al. Simplifying the exploration of volumetric Images: development of a 3D user interface for the radiologist’s workplace
Schiemann et al. Definition of volume transformations for volume interaction
JP2006178772A (ja) 画像処理方法および装置並びにプログラム
EP4258216A1 (fr) Procédé d'affichage d'un modèle 3d d'un patient

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NO NZ PH PL PT RO RU SD SE SG SI SK SL TJ TM TR TT TZ UA UG US UZ VN YU ZA ZW

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
121 Ep: the epo has been informed by wipo that ep was designated in this application
REG Reference to national code

Ref country code: DE

Ref legal event code: 8642

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOST OF RIGHTS PURSUANT TO RULE 69(1) EPC, EPO FORM 1205A DATED 04.09.2003

122 Ep: pct application non-entry in european phase
NENP Non-entry into the national phase

Ref country code: JP

WWW Wipo information: withdrawn in national office

Country of ref document: JP