EP1794719A2 - Imaging system for displaying a structure of temporally changing configuration - Google Patents

Imaging system for displaying a structure of temporally changing configuration

Info

Publication number
EP1794719A2
EP1794719A2 EP05776677A EP05776677A EP1794719A2 EP 1794719 A2 EP1794719 A2 EP 1794719A2 EP 05776677 A EP05776677 A EP 05776677A EP 05776677 A EP05776677 A EP 05776677A EP 1794719 A2 EP1794719 A2 EP 1794719A2
Authority
EP
European Patent Office
Prior art keywords
image
configuration
changing
reference image
rendering
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP05776677A
Other languages
German (de)
French (fr)
Inventor
Olivier c/o Société Civile SPID GERARD
Chuan c/o Société Civile SPID Zheng
Pascal c/o Société Civile SPID Allain
Damien c/o Société Civile SPID Dolimier
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Koninklijke Philips NV
Original Assignee
Koninklijke Philips Electronics NV
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Koninklijke Philips Electronics NV filed Critical Koninklijke Philips Electronics NV
Publication of EP1794719A2 publication Critical patent/EP1794719A2/en
Withdrawn legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T13/00—Animation
    • G06T13/20—3D [Three Dimensional] animation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2210/00—Indexing scheme for image generation or computer graphics
    • G06T2210/41—Medical

Definitions

  • the present invention relates to an imaging system for use in monitoring a structure having a configuration which changes with time, such as for example a functioning heart.
  • LV Left Ventricle
  • Imaging technology enables static volume (3D) images and dynamic volume (4D) images to be generated.
  • Cardiac imaging systems such as Ultrasound, CT or MRI Imaging have been developed to image the LV during the cardiac cycle.
  • a specific ultrasound imaging technique is disclosed in WO2004003851.
  • the invention provides an imaging system for displaying image data representative of a structure of temporally changing configuration, the system comprising display rendering means for processing data representative of the changing configuration of the structure and rendering a display comprising a reference image of the structure in a predetermined configuration and superposing with the reference image a changing image of the structure which changes in configuration with respect to time.
  • the system includes data acquisition means for acquiring the data representative of the structure configuration as it varies with time.
  • the system may include ultrasound imaging apparatus for acquiring the data.
  • the acquisition means preferably acquires 3D volume, data for processing.
  • the invention provides a method of rendering image data representative of a structure of temporally changing configuration, the method comprising processing data representative of the changing configuration of the structure and rendering a display comprising a reference image of the structure in a predetermined configuration and superposing with the reference image a changing image of the structure which changes in configuration with respect to time.
  • the reference image is preferably a static image of the structure, remaining static whilst the configuration of the changing image changes with respect to time.
  • the system preferably comprises a 3D imaging system and the reference image and/or the changing image is beneficially a 3D rendered image.
  • the temporally changing structure typically changes in configuration cyclically and the changing image beneficially represents the cyclically changing 3D volume of the structure.
  • the reference image represents the maximum volume of the structure.
  • the structure monitored may comprise the Left Ventricle (LV) of a heart, in which case the reference image is beneficially representative of the LV End Diastole (ED).
  • LV Left Ventricle
  • ED LV End Diastole
  • the invention provides a method of imaging the Left Ventricle (LV) of a heart comprising rendering a display comprising a reference image of the LV in End Diastole and superposing with the reference image a changing image of the LV through the heart beating cycle.
  • LV Left Ventricle
  • the invention provides a computer program product comprising a set of instructions enabling performance of the method.
  • - Figure 1 is a schematic flowchart representing operation of a system in accordance with the present invention
  • - Figure 2 is an ultrasound image of the LV of a patient's heart showing the computer generated border
  • Figure 3 shows a series of 3D mesh frames of the LV at different time periods within the cardiac cycle, superposed with the 3D ED mesh
  • Figure 4 is a schematic representation of the data acquisition system.
  • figure 1 shows a flowchart of steps taken in a technique according to the invention to generate a visualisation of the LV beat.
  • the LV of a patient is initially monitored (block 100) using conventional monitoring techniques such as ultrasound imaging and or ECG, to ascertain the ED (end-diastole) phase (block 110) of the cardiac cycle.
  • conventional monitoring techniques such as ultrasound imaging and or ECG, to ascertain the ED (end-diastole) phase (block 110) of the cardiac cycle.
  • a 3D echocardiography system could be utilised.
  • the system having means for acquiring a digital image sequence, and is associated to a digital processing system for processing the acquired 3D volume data.
  • the examination system 550 shown in figure 4 comprises means for providing image data to the processing system which has at least one output 506 to provide image data to display and/or storage means 530,540.
  • the display and storage means may respectively be the screen and memory of a workstation 510.
  • the workstation 510 may also comprise a keyboard 531 and a mouse 532.
  • the image processing system 520 may be a suitably programmed computer of a workstation 510, or a special purpose processor having circuit means such as filters, logic operators, memories that are arranged to perform the functions of the method steps according to the invention.
  • the processing system 520 may use a computer program product having program instructions to be executed by the computing means of the processing system 520 in order to carry out the method steps.
  • the 3D image data corresponding to the LV at the ED phase of the cardiac cycle is processed to generate a computed border 400 of the LV, as seen in figure 2.
  • a computer algorithm then prompts a user to select a series of points (block 120) within the computer generated border and then uses the information to generate a 3D mesh (block 130) that completely covers the area of the image within the border and thus specifies the surface of the LV.
  • This segmentation technique is related to the Finite Element Method, which is one of several standard mathematical techniques used in the analysis of image data). In this manner, a reference mesh is obtained for the ED phase of the LV during the cardiac cycle. If necessary the computer generated mesh can be modified at this stage (block 140).
  • the ES (End-Systole) (block 200) phase of the LV is then ascertained in a similar manner with the border of the LV again being determined (block 210) and the corresponding mesh generated (block 230) through the user selecting a series of points (block 220). Again this mesh can be modified if necessary (block 240).
  • the border of the LV is determined from a sequence of 3D images within the cardiac cycle at selected time intervals (block 300) from ED to ES (block 310), and the corresponding mesh is generated automatically (block 320), which if necessary can be modified (block 330).
  • the system then renders an image display having a reference image of the structure in a preselected configuration (the ED phase of the LV), superposed with the changing image of the structure as it changes with respect to time.
  • the 3D LV border can be displayed as a live beating object and when displayed within the ED reference mesh, clear departures can be seen between the current frame and the reference frame 500 during the cardiac cycle (figure 3). Furthermore, the superposition of meshes also highlights any global movement the LV may undertake during for example, respiration.
  • Such visualisation images provide a collective account of the motion of the surface of the LV as it changes with respect to time and therefore, in contrast to the prior art in which only one frame time is shown, the visualisation illustrates the changes of the LV border over the whole heart cycle.
  • MRI Magnetic Resonance Imaging
  • CT Computed Tomography

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • General Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Ultra Sonic Daignosis Equipment (AREA)
  • Magnetic Resonance Imaging Apparatus (AREA)
  • Image Processing (AREA)
  • Apparatus For Radiation Diagnosis (AREA)

Abstract

The present invention relates to an imaging system for displaying image data representative of a structure of temporally changing configuration. The imaging system comprises display rendering means for processing data representative of the changing configuration of the structure and rendering a display comprising a reference image of the structure in a preselected configuration and superposing with the reference image a changing image of the structure which changes in configuration with respect to time.

Description

IMAGING SYSTEM FOR DISPLAYING A STRUCTURE OF TEMPORALLY CHANGING CONFIGURATION
FIELD OF THE INVENTION The present invention relates to an imaging system for use in monitoring a structure having a configuration which changes with time, such as for example a functioning heart.
BACKGROUND OF THE INVENTION
The stretching of the Left Ventricle (LV) during the cardiac cycle is known to be related to cardiac health. Imaging technology enables static volume (3D) images and dynamic volume (4D) images to be generated. Cardiac imaging systems such as Ultrasound, CT or MRI Imaging have been developed to image the LV during the cardiac cycle. A specific ultrasound imaging technique is disclosed in WO2004003851.
A useful modality of visualisation has now been devised.
SUMMARY OF THE INVENTION
It is an object of the present invention to provide a modality of visualisation enabling an observer to interact with and/or observe an image display providing useful technical understanding of how a structure changes in configuration over time.
According to a first aspect, the invention provides an imaging system for displaying image data representative of a structure of temporally changing configuration, the system comprising display rendering means for processing data representative of the changing configuration of the structure and rendering a display comprising a reference image of the structure in a predetermined configuration and superposing with the reference image a changing image of the structure which changes in configuration with respect to time.
The invention therefore enables the provision of a moving sequential image of the changing configuration structure with respect to a reference image. This aids in both qualitative and quantitative review. The invention has particular application in relation to cardiac evaluation, but the skilled addressee will readily appreciate that the invention has application in reviewing other structures that have a configuration that changes over time. Beneficially, the system includes data acquisition means for acquiring the data representative of the structure configuration as it varies with time. In one embodiment, the system may include ultrasound imaging apparatus for acquiring the data. The acquisition means preferably acquires 3D volume, data for processing.
According to another aspect, the invention provides a method of rendering image data representative of a structure of temporally changing configuration, the method comprising processing data representative of the changing configuration of the structure and rendering a display comprising a reference image of the structure in a predetermined configuration and superposing with the reference image a changing image of the structure which changes in configuration with respect to time.
The reference image is preferably a static image of the structure, remaining static whilst the configuration of the changing image changes with respect to time.
The system preferably comprises a 3D imaging system and the reference image and/or the changing image is beneficially a 3D rendered image.
The temporally changing structure typically changes in configuration cyclically and the changing image beneficially represents the cyclically changing 3D volume of the structure. Beneficially the reference image represents the maximum volume of the structure. For example, the structure monitored may comprise the Left Ventricle (LV) of a heart, in which case the reference image is beneficially representative of the LV End Diastole (ED).
The image reviewed is beneficially the boundary of the structure, and to this end the data represents the boundary of the structure.
In a specific realisation, the invention provides a method of imaging the Left Ventricle (LV) of a heart comprising rendering a display comprising a reference image of the LV in End Diastole and superposing with the reference image a changing image of the LV through the heart beating cycle.
According to a further aspect, the invention provides a computer program product comprising a set of instructions enabling performance of the method. These and other aspects of the invention will be apparent from and will be elucidated with reference to the embodiments described hereinafter.
BRIEF DESCRIPTION OF THE DRAWINGS
The present invention will now be described in more detail, by way of example, with reference to the accompanying drawings, wherein:
- Figure 1 is a schematic flowchart representing operation of a system in accordance with the present invention, - Figure 2 is an ultrasound image of the LV of a patient's heart showing the computer generated border,
Figure 3 shows a series of 3D mesh frames of the LV at different time periods within the cardiac cycle, superposed with the 3D ED mesh, Figure 4 is a schematic representation of the data acquisition system.
DETAILED DESCRIPTION OF THE INVENTION
Referring to the drawings, figure 1 shows a flowchart of steps taken in a technique according to the invention to generate a visualisation of the LV beat. The LV of a patient is initially monitored (block 100) using conventional monitoring techniques such as ultrasound imaging and or ECG, to ascertain the ED (end-diastole) phase (block 110) of the cardiac cycle.
In an exemplary technique a 3D echocardiography system could be utilised. The system having means for acquiring a digital image sequence, and is associated to a digital processing system for processing the acquired 3D volume data. The examination system 550 shown in figure 4 comprises means for providing image data to the processing system which has at least one output 506 to provide image data to display and/or storage means 530,540. The display and storage means may respectively be the screen and memory of a workstation 510. The workstation 510 may also comprise a keyboard 531 and a mouse 532.
The image processing system 520 may be a suitably programmed computer of a workstation 510, or a special purpose processor having circuit means such as filters, logic operators, memories that are arranged to perform the functions of the method steps according to the invention. The processing system 520 may use a computer program product having program instructions to be executed by the computing means of the processing system 520 in order to carry out the method steps.
Following the 3D volume acquisition, the 3D image data corresponding to the LV at the ED phase of the cardiac cycle is processed to generate a computed border 400 of the LV, as seen in figure 2.
A computer algorithm then prompts a user to select a series of points (block 120) within the computer generated border and then uses the information to generate a 3D mesh (block 130) that completely covers the area of the image within the border and thus specifies the surface of the LV. (This segmentation technique is related to the Finite Element Method, which is one of several standard mathematical techniques used in the analysis of image data). In this manner, a reference mesh is obtained for the ED phase of the LV during the cardiac cycle. If necessary the computer generated mesh can be modified at this stage (block 140).
The ES (End-Systole) (block 200) phase of the LV is then ascertained in a similar manner with the border of the LV again being determined (block 210) and the corresponding mesh generated (block 230) through the user selecting a series of points (block 220). Again this mesh can be modified if necessary (block 240).
Following the determination of the ED (block 100) and ES (block 200) phases of the cardiac cycle, the border of the LV is determined from a sequence of 3D images within the cardiac cycle at selected time intervals (block 300) from ED to ES (block 310), and the corresponding mesh is generated automatically (block 320), which if necessary can be modified (block 330).
In accordance with the invention, the system then renders an image display having a reference image of the structure in a preselected configuration (the ED phase of the LV), superposed with the changing image of the structure as it changes with respect to time.
Thus, by playing the acquired mesh frames in succession, the 3D LV border can be displayed as a live beating object and when displayed within the ED reference mesh, clear departures can be seen between the current frame and the reference frame 500 during the cardiac cycle (figure 3). Furthermore, the superposition of meshes also highlights any global movement the LV may undertake during for example, respiration. Such visualisation images provide a collective account of the motion of the surface of the LV as it changes with respect to time and therefore, in contrast to the prior art in which only one frame time is shown, the visualisation illustrates the changes of the LV border over the whole heart cycle.
It is to be understood that whilst the image visualisation has been presented here in the form of a mesh, further visual remedies are also possible which do not depart from the scope of the invention. Thus, it should be realised that the reference mesh and temporally changing mesh are simply representative of an image. The data could equally be manipulated to generate other representations of the surface of the LV.
It is also to be understood that whilst an ultrasound imaging technique has been primarily described, the invention can be used to manipulate and display image data obtained using other techniques such as for example Magnetic Resonance Imaging (MRI) or Computed Tomography (CT).
It should be noted that the above-mentioned embodiments illustrate rather than limit the invention, and that those skilled in the art will be capable of designing many alternative embodiments without departing from the scope of the invention as defined by the appended claims. In the claims, any reference signs placed in parentheses shall not be construed as limiting the claims. The word "comprising" and "comprises", and the like, does not exclude the presence of elements or steps other than those listed in any claim or the specification as a whole. The singular reference of an element does not exclude the plural reference of such elements and vice-versa. The invention may be implemented by means of hardware comprising several distinct elements, and by means of a suitably programmed computer. In a device claim enumerating several means, several of these means may be embodied by one and the same item of hardware. The mere fact that certain measures are recited in mutually different dependent claims does not indicate that a combination of these measures cannot be used to advantage.

Claims

1. An imaging system for displaying image data representative of a structure of temporally changing configuration, the system comprising display rendering means for processing data representative of the changing configuration of the structure and rendering a display comprising a reference image of the structure in a preselected configuration and superposing with the reference image a changing image of the structure which changes in configuration with respect to time.
2. A system according to claim 1, wherein the reference image is a static image of the structure, remaining static whilst the configuration of the changing image changes with respect to time.
3. A system according to claim 1, wherein the system comprises a 3D imaging system and the reference image and/or the changing image is a 3D rendered image.
4. A system according to claim 1, wherein the temporally changing structure changes in configuration cyclically and the changing image represents the cyclically changing 3D volume of the structure.
5. A system according to claim 1, wherein the reference image represents the maximum volume of the structure.
6. A system according to claim 1, wherein the structure comprises the Left Ventricle (LV) of a heart.
7. A system according to claim 6, wherein the reference image is representative of the LV End Diastole (ED).
8. A system according to claim 1, wherein the data represents the boundary of the structure.
9. A system according to claim 1 including means for acquiring the data representative of the structure.
10. A system according to claim 9, including ultrasound apparatus for acquiring the data.
11. A method of rendering image data representative of ,a structure of temporally changing configuration, the method comprising processing data representative of the changing configuration of the structure and rendering a display comprising a reference image of the structure in a preselected configuration and superposing with the reference image a changing image of the structure which changes in configuration with respect to time.
12. A method of imaging the Left Ventricle (LV) of a heart comprising rendering a display comprising a reference image of the LV in End Diastole and superposing with the reference image a changing image of the LV through the heart beating cycle.
13. A computer program product comprising a set of instructions for carrying out a method according to claim 11 or claim 12.
EP05776677A 2004-08-31 2005-08-26 Imaging system for displaying a structure of temporally changing configuration Withdrawn EP1794719A2 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US60580804P 2004-08-31 2004-08-31
PCT/IB2005/052803 WO2006025005A2 (en) 2004-08-31 2005-08-26 Imaging system for displaying a structure of temporally changing configuration

Publications (1)

Publication Number Publication Date
EP1794719A2 true EP1794719A2 (en) 2007-06-13

Family

ID=35677551

Family Applications (1)

Application Number Title Priority Date Filing Date
EP05776677A Withdrawn EP1794719A2 (en) 2004-08-31 2005-08-26 Imaging system for displaying a structure of temporally changing configuration

Country Status (3)

Country Link
EP (1) EP1794719A2 (en)
JP (1) JP2008511368A (en)
WO (1) WO2006025005A2 (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102006020864A1 (en) * 2006-05-04 2007-11-08 Siemens Ag Method for determining and displaying at least one information about a target volume
CN102272795B (en) * 2009-01-13 2014-09-10 皇家飞利浦电子股份有限公司 Image based clinical trial assessment
JP5408400B1 (en) * 2012-04-04 2014-02-05 コニカミノルタ株式会社 Image generating apparatus and program

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
FR2545349B1 (en) * 1983-05-04 1986-09-26 Duret Francois PROCESS FOR INPUT OF THE FORM OF HUMAN ORGANS OR PATHOLOGICAL ABNORMALITIES AND DEVICE FOR IMPLEMENTING SAME
JP3713329B2 (en) * 1996-06-04 2005-11-09 株式会社東芝 Ultrasonic Doppler diagnostic device
JPH11290325A (en) * 1998-04-09 1999-10-26 Hitachi Medical Corp Ultrasonic diagnostic system
JP4763883B2 (en) * 2000-09-18 2011-08-31 株式会社東芝 Ultrasonic diagnostic equipment
EP1527422B1 (en) 2002-06-28 2019-05-22 Koninklijke Philips N.V. Image processing method for displaying information relating to wall motions of a deformable 3-d object
JP4041391B2 (en) * 2002-12-19 2008-01-30 アロカ株式会社 Ultrasonic diagnostic equipment

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
None *
See also references of WO2006025005A2 *

Also Published As

Publication number Publication date
WO2006025005A2 (en) 2006-03-09
JP2008511368A (en) 2008-04-17
WO2006025005A3 (en) 2006-05-11

Similar Documents

Publication Publication Date Title
US11610346B2 (en) Image reconstruction using machine learning regularizers
US9020235B2 (en) Systems and methods for viewing and analyzing anatomical structures
US20180330525A1 (en) Advanced medical image processing wizard
RU2497194C2 (en) Method and device for 3d visualisation of data sets
JP6396310B2 (en) Method and apparatus for displaying to a user a transition between a first rendering projection and a second rendering projection
CN111540025B (en) Predicting images for image processing
JP5481069B2 (en) A reconstruction unit that reconstructs a detailed reproduction of at least part of an object
US8805034B2 (en) Selection of datasets from 3D renderings for viewing
CN108876794A (en) Aneurysm in volumetric image data with carry being isolated for tumor blood vessel
JP2008526382A (en) Blood flow display method and system
US20170262978A1 (en) Medical image data processing system and method
JP2008509773A (en) Flexible 3D rotational angiography-computed tomography fusion method
EP2144199A1 (en) Method and apparatus for multimodal visualization of volume data sets
Frakes et al. New techniques for the reconstruction of complex vascular anatomies from MRI images
US7355605B2 (en) Method and system for automatic orientation of local visualization techniques for vessel structures
JP6564075B2 (en) Selection of transfer function for displaying medical images
JPH0838433A (en) Medical image diagnostic device
WO2006025005A2 (en) Imaging system for displaying a structure of temporally changing configuration
US20090027379A1 (en) Imaging system
EP3828836B1 (en) Method and data processing system for providing a two-dimensional unfolded image of at least one tubular structure
EP2143067B1 (en) Automatic display of symmetric anatomical structure
JP2001184491A (en) Three-dimensional image display device
EP3896658A1 (en) Creating a synthetic medical image
JPH05307580A (en) Picture processor
US20090141953A1 (en) Imaging system

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20070402

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC NL PL PT RO SE SI SK TR

17Q First examination report despatched

Effective date: 20070730

DAX Request for extension of the european patent (deleted)
RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: KONINKLIJKE PHILIPS N.V.

RIC1 Information provided on ipc code assigned before grant

Ipc: G06T 19/00 20110101AFI20190123BHEP

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

INTG Intention to grant announced

Effective date: 20190402

RIN1 Information on inventor provided before grant (corrected)

Inventor name: DOLIMIER, DAMIEN

Inventor name: ZHENG, CHUAN

Inventor name: ALLAIN, PASCAL

Inventor name: GERARD, OLIVIER

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN

18D Application deemed to be withdrawn

Effective date: 20190813