WO2018055026A1 - Method and apparatus for correcting dynamic models obtained by tracking methods - Google Patents

Method and apparatus for correcting dynamic models obtained by tracking methods Download PDF

Info

Publication number
WO2018055026A1
WO2018055026A1 PCT/EP2017/073880 EP2017073880W WO2018055026A1 WO 2018055026 A1 WO2018055026 A1 WO 2018055026A1 EP 2017073880 W EP2017073880 W EP 2017073880W WO 2018055026 A1 WO2018055026 A1 WO 2018055026A1
Authority
WO
WIPO (PCT)
Prior art keywords
images
time
dynamic model
time section
representation
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/EP2017/073880
Other languages
English (en)
French (fr)
Inventor
Marcus Schreckenberg
Alexander Rossmanith
Daniel Stapf
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tomtec Imaging Systems GmbH
Original Assignee
Tomtec Imaging Systems GmbH
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tomtec Imaging Systems GmbH filed Critical Tomtec Imaging Systems GmbH
Priority to EP17777529.3A priority Critical patent/EP3516620B1/en
Priority to US16/335,757 priority patent/US10922861B2/en
Priority to CN201780058492.1A priority patent/CN109791690B/zh
Priority to JP2019536697A priority patent/JP7337694B2/ja
Publication of WO2018055026A1 publication Critical patent/WO2018055026A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/0002—Inspection of images, e.g. flaw detection
    • G06T7/0012—Biomedical image inspection
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/00—2D [Two Dimensional] image generation
    • G06T11/20—Drawing from basic elements, e.g. lines or circles
    • G06T11/206—Drawing of charts or graphs
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/00—2D [Two Dimensional] image generation
    • G06T11/60—Editing figures and text; Combining figures or text
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/20—Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/20—Linear translation of whole images or parts thereof, e.g. panning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/60—Rotation of whole images or parts thereof
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2200/00—Indexing scheme for image data processing or generation, in general
    • G06T2200/24—Indexing scheme for image data processing or generation, in general involving graphical user interfaces [GUIs]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10016—Video; Image sequence
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10132—Ultrasound image
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20092—Interactive image processing based on input by user
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30004—Biomedical image processing
    • G06T2207/30048—Heart; Cardiac

Definitions

  • the moving structure can be - in the case of medical images - a moving organ, for example the human or animal heart, but also other moving organs, such as blood vessels, lung, chest, or else moving surgical instruments, e.g. a catheter.
  • the invention can also be applied to the analysis of moving structures or objects in video sequences; in this case, the moving structures are e.g. other road users.
  • a "moving structure" may optionally also be a static object which, however, moves relative to the camera.
  • the dynamic model is registered to the images, i.e. the position of the model in relation to the image coordinates is known for every image in the series.
  • the invention provides a simplified correction option by virtue of a position time section, in particular a one-dimensional position time section, being determined in the images of the time series.
  • a position time section in particular a one-dimensional position time section, being determined in the images of the time series.
  • this is brought about by a user in e.g. the first image of the time series; however, this can also be effectuated automatically.
  • the position time section can have the same image coordinates in all images of the time series (i.e., the same position time section is used, as it were, for all images); however, the position can also be different for different images, as will still be explained in more detail below.
  • the position time section is one-dimensional, e.g.
  • This position-time representation permits a comparison of the computer graphical object or objects with the surrounding image content, i.e. with the (optionally interpolated) image values of the position time section, in particular by a user. As a result of this comparison, it is possible to ascertain the accuracy of the dynamic model, not only in a single image of a time series but also immediately in all images of the time series.
  • the tracked dynamic model is plotted in these images schematically by dots and provided with a reference sign 4. Further, a position time section h - a straight line in this case - can be seen in the first image B1 and in the last image BN of the time series, said position time section being plotted, for example, by a user in these two images. This line hi and hN, respectively, intersects the model 4 at the point 12.
  • Figure 4 shows the resulting temporal profile of the image content along the position time line h of figure 2 in a position-time representation.
  • the upper point of intersection of the position time line h with the epicardium 25 is represented here by the line 35, with the lower point of intersection 27 being represented by the line 37.
  • the amplitude of the signal profile of line 37 can be used within the scope of a TAPSE analysis for estimating the right ventricular function.
  • Figures 7 and 8 present the case where the dynamic model 4 does not have a good correspondence with the image content in at least one image, which is depicted in figure 7.
  • image content and tracked model do not move synchronously with one another.
  • the lower point of intersection 27 of the position time line h with the dynamic model 4 clearly does not correspond to the tricuspid annulus, which is denoted by 27a. Instead, the model 4 would have to be extended downward in this image along the arrow 28; see figure 7.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Radiology & Medical Imaging (AREA)
  • Quality & Reliability (AREA)
  • Health & Medical Sciences (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Medical Informatics (AREA)
  • General Health & Medical Sciences (AREA)
  • Multimedia (AREA)
  • Architecture (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • General Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Ultra Sonic Daignosis Equipment (AREA)
  • Image Processing (AREA)
  • Image Analysis (AREA)
PCT/EP2017/073880 2016-09-22 2017-09-21 Method and apparatus for correcting dynamic models obtained by tracking methods Ceased WO2018055026A1 (en)

Priority Applications (4)

Application Number Priority Date Filing Date Title
EP17777529.3A EP3516620B1 (en) 2016-09-22 2017-09-21 Method and apparatus for correcting dynamic models obtained by tracking methods
US16/335,757 US10922861B2 (en) 2016-09-22 2017-09-21 Method and apparatus for correcting dynamic models obtained by tracking methods
CN201780058492.1A CN109791690B (zh) 2016-09-22 2017-09-21 用于校正通过跟踪方法获得的动态模型的方法和装置
JP2019536697A JP7337694B2 (ja) 2016-09-22 2017-09-21 追跡方法によって取得された動的モデルを補正するための方法及び装置

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
DE102016117889.6A DE102016117889B3 (de) 2016-09-22 2016-09-22 Verfahren und Vorrichtung zur Korrektur von durch Tracking-Verfahren ermittelten dynamischen Modellen
DE102016117889.6 2016-09-22

Publications (1)

Publication Number Publication Date
WO2018055026A1 true WO2018055026A1 (en) 2018-03-29

Family

ID=59997335

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/EP2017/073880 Ceased WO2018055026A1 (en) 2016-09-22 2017-09-21 Method and apparatus for correcting dynamic models obtained by tracking methods

Country Status (6)

Country Link
US (1) US10922861B2 (enExample)
EP (1) EP3516620B1 (enExample)
JP (1) JP7337694B2 (enExample)
CN (1) CN109791690B (enExample)
DE (1) DE102016117889B3 (enExample)
WO (1) WO2018055026A1 (enExample)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2020199167A (ja) * 2019-06-12 2020-12-17 ザイオソフト株式会社 医用画像処理装置、医用画像処理方法、及び医用画像処理プログラム

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6835587B2 (ja) * 2014-02-19 2021-02-24 コーニンクレッカ フィリップス エヌ ヴェＫｏｎｉｎｋｌｉｊｋｅ Ｐｈｉｌｉｐｓ Ｎ．Ｖ． 医用４ｄイメージングにおける動き適応型可視化
KR102617888B1 (ko) 2014-08-18 2023-12-22 마우이 이미징, 인코포레이티드 네트워크-기반 초음파 이미징 시스템
KR102681141B1 (ko) 2015-03-30 2024-07-02 마우이 이미징, 인코포레이티드 오브젝트 모션을 검출하기 위한 초음파 이미징 시스템들 및 방법들
WO2017132517A1 (en) 2016-01-27 2017-08-03 Maui Imaging, Inc. Ultrasound imaging with sparse array probes
EP3526799B1 (en) * 2018-01-08 2020-03-04 Brainlab AG Optimizing an atlas
CN111462177B (zh) * 2020-03-14 2023-04-07 华中科技大学 一种基于多线索的在线多目标跟踪方法和系统
US12109059B2 (en) * 2020-05-19 2024-10-08 Konica Minolta, Inc. Dynamic analysis system, correction apparatus, storage medium, and dynamic imaging apparatus
US20230380805A1 (en) * 2020-10-21 2023-11-30 Maui Imaging, Inc. Systems and methods for tissue characterization using multiple aperture ultrasound
CN113850837B (zh) * 2021-11-25 2022-02-08 腾讯科技（深圳）有限公司 视频处理方法、装置、电子设备、存储介质及计算机产品

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050074153A1 (en) * 2003-09-30 2005-04-07 Gianni Pedrizzetti Method of tracking position and velocity of objects' borders in two or three dimensional digital images, particularly in echographic images
JP5842039B1 (ja) * 2014-08-15 2016-01-13 日立アロカメディカル株式会社 超音波画像処理装置

Family Cites Families (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4306051B2 (ja) 1999-10-27 2009-07-29 株式会社日立メディコ 超音波診断装置
CN100393283C (zh) * 2002-09-12 2008-06-11 株式会社日立医药 生物体组织动状态跟踪方法、使用该方法的图像诊断装置
JP4300460B2 (ja) 2003-02-25 2009-07-22 株式会社日立メディコ 超音波診断装置
US7421101B2 (en) * 2003-10-02 2008-09-02 Siemens Medical Solutions Usa, Inc. System and method for local deformable motion analysis
US7951083B2 (en) * 2004-02-05 2011-05-31 Siemens Medical Solutions Usa, Inc. Motion analysis improvements for medical diagnostic ultrasound
EP1722333B1 (en) * 2005-05-13 2007-10-24 TomTec Imaging Systems GmbH Method and device for reconstructing two-dimensional sectional images
EP1780672A1 (en) * 2005-10-25 2007-05-02 Bracco Imaging, S.P.A. Method of registering images, algorithm for carrying out the method of registering images, a program for registering images using the said algorithm and a method of treating biomedical images to reduce imaging artefacts caused by object movement
US8538103B2 (en) * 2009-02-10 2013-09-17 Hitachi Medical Corporation Medical image processing device, medical image processing method, medical image diagnostic apparatus, operation method of medical image diagnostic apparatus, and medical image display method
US20110262018A1 (en) * 2010-04-27 2011-10-27 MindTree Limited Automatic Cardiac Functional Assessment Using Ultrasonic Cardiac Images
JP5438722B2 (ja) 2011-06-03 2014-03-12 富士フイルム株式会社 超音波診断装置
CN105105775B (zh) * 2011-07-19 2018-11-09 东芝医疗系统株式会社 心肌运动解析装置
JP6511050B2 (ja) * 2013-07-23 2019-05-08 コーニンクレッカ フィリップス エヌ ヴェＫｏｎｉｎｋｌｉｊｋｅ Ｐｈｉｌｉｐｓ Ｎ．Ｖ． イメージング装置を追跡装置と位置合わせする位置合わせシステム、イメージングシステム、介入システム、位置合わせ方法、イメージングシステムの作動方法、位置合わせコンピュータプログラム、及びイメージングコンピュータプログラム
US10806367B2 (en) * 2013-10-01 2020-10-20 Koninklijke Philips N.V. System and method for myocardial perfusion pathology characterization
EP3066643B1 (en) * 2013-11-05 2020-05-27 Koninklijke Philips N.V. Automated segmentation of tri-plane images for real time ultrasonic imaging
US9972069B2 (en) * 2014-10-06 2018-05-15 Technion Research & Development Foundation Limited System and method for measurement of myocardial mechanical function

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050074153A1 (en) * 2003-09-30 2005-04-07 Gianni Pedrizzetti Method of tracking position and velocity of objects' borders in two or three dimensional digital images, particularly in echographic images
JP5842039B1 (ja) * 2014-08-15 2016-01-13 日立アロカメディカル株式会社 超音波画像処理装置

Non-Patent Citations (4)

* Cited by examiner, † Cited by third party
Title
AUGER, DOMINIQUE ET AL.: "Three-dimensional imaging in cardiac resynchronization therapy", REVISTA ESPANOLA DE CARDIOLOGIA, vol. 64, no. 11, 2011, pages 1035 - 1044, XP028319922, DOI: doi:10.1016/j.rec.2011.06.015
DOMINIQUE AUGER ET AL: "Three-dimensional Imaging in Cardiac Resynchronization Therapy", REVISTA ESPANOLA DE CARDIOLOGIA, vol. 64, no. 11, 1 November 2011 (2011-11-01), pages 1035 - 1044, XP028319922, ISSN: 1885-5857, [retrieved on 20110728], DOI: 10.1016/J.REC.2011.06.015 *
LORSAKUL A ET AL: "Parameterization of real-time 3D speckle tracking framework for cardiac strain assessment", ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY,EMBC, 2011 ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE, IEEE, 30 August 2011 (2011-08-30), pages 2654 - 2657, XP032319300, ISBN: 978-1-4244-4121-1, DOI: 10.1109/IEMBS.2011.6090730 *
LORSAKUL, AURANUCH ET AL.: "Parameterization of real-time 3D speckle tracking framework for cardiac strain assessment", ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY, EMBC, 2011 ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE. IEEE, 2011, 2011

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2020199167A (ja) * 2019-06-12 2020-12-17 ザイオソフト株式会社 医用画像処理装置、医用画像処理方法、及び医用画像処理プログラム
JP7283985B2 (ja) 2019-06-12 2023-05-30 ザイオソフト株式会社 医用画像処理装置、医用画像処理方法、及び医用画像処理プログラム

Also Published As

Publication number Publication date
JP2019534764A (ja) 2019-12-05
US20190251724A1 (en) 2019-08-15
JP7337694B2 (ja) 2023-09-04
US10922861B2 (en) 2021-02-16
CN109791690A (zh) 2019-05-21
EP3516620B1 (en) 2020-04-08
DE102016117889B3 (de) 2018-03-15
CN109791690B (zh) 2023-07-14
EP3516620A1 (en) 2019-07-31

Similar Documents

Publication Publication Date Title
EP3516620B1 (en) Method and apparatus for correcting dynamic models obtained by tracking methods
JP4060615B2 (ja) 画像処理装置及び超音波診断装置
JP5108905B2 (ja) ３ｄデータセット中の画像ビューを自動的に特定する方法および装置
US5889524A (en) Reconstruction of three-dimensional objects using labeled piecewise smooth subdivision surfaces
JP5596063B2 (ja) 心臓ｍモード像の自動分析
JP7528082B2 (ja) 腔内プローブ処置を計画するための方法、デバイス及びシステム
US10660613B2 (en) Measurement point determination in medical diagnostic imaging
JP6293495B2 (ja) 動いている器官の標的エリア内のオブジェクトを追跡するための方法および装置
JP3725442B2 (ja) 医用画像診断装置及びその方法
JP6441335B2 (ja) リアルタイム超音波イメージングのトリプレーン画像の自動セグメント化
US9179890B2 (en) Model-based positioning for intracardiac echocardiography volume stitching
EP3003161B1 (en) Method for 3d acquisition of ultrasound images
US11445994B2 (en) Non-invasive electrophysiology mapping based on affordable electrocardiogram hardware and imaging
JP5271262B2 (ja) 三次元超音波イメージングのための方法、装置及びコンピュータプログラム
JP2003508139A (ja) 非剛体運動画像解析
CN110458872A (zh) 使用超声弹性成像执行生物力学驱动的图像配准的系统和方法
US9814439B2 (en) Tissue motion comparison display
Kiss et al. Fusion of 3D echo and cardiac magnetic resonance volumes during live scanning
JP7132996B2 (ja) 単一自由度の心腔セグメント化による心臓性能の超音波診断
CN115517699A (zh) 使用4d超声导管重建器官的体积的4D壳体
Peressutti et al. A framework for automatic model-driven 2D echocardiography acquisition for robust respiratory motion estimation in image-guided cardiac interventions
Hautvast Analysis of cardiac magnetic resonance images: towards quantification in clinical practice

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17777529

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2019536697

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 2017777529

Country of ref document: EP

Effective date: 20190423

ENP Entry into the national phase

Ref document number: 2017777529

Country of ref document: EP

Effective date: 20190423