JP2017127623A5 - - Google Patents

Download PDF

Info

Publication number
JP2017127623A5
JP2017127623A5 JP2016207259A JP2016207259A JP2017127623A5 JP 2017127623 A5 JP2017127623 A5 JP 2017127623A5 JP 2016207259 A JP2016207259 A JP 2016207259A JP 2016207259 A JP2016207259 A JP 2016207259A JP 2017127623 A5 JP2017127623 A5 JP 2017127623A5
Authority
JP
Japan
Prior art keywords
image
deformation
displacement field
image processing
region
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
JP2016207259A
Other languages
Japanese (ja)
Other versions
JP2017127623A (en
JP6905323B2 (en
Filing date
Publication date
Application filed filed Critical
Priority to EP18191466.4A priority Critical patent/EP3444781B1/en
Priority to EP16002762.9A priority patent/EP3206189B1/en
Priority to US15/400,074 priority patent/US10417777B2/en
Publication of JP2017127623A publication Critical patent/JP2017127623A/en
Publication of JP2017127623A5 publication Critical patent/JP2017127623A5/ja
Application granted granted Critical
Publication of JP6905323B2 publication Critical patent/JP6905323B2/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Claims (25)

被検体を異なる条件で撮像することにより得られた第１の画像と第２の画像を取得するデータ取得手段と、
前記第１の画像内の関心領域を取得する関心領域取得手段と、
前記第１の画像と前記第２の画像の間の第１の変形変位場を取得する第１の変形取得手段と、
前記関心領域における前記第１の変形変位場を、前記第１の変形変位場より自由度が少ない近似変換モデルを用いて近似して近似変位場を生成する変形近似手段と、
前記関心領域に関して、前記第１の画像と、前記第１の画像が前記近似変位場に基づいて変位される画像との間の対応情報を生成する対応情報生成手段と、
前記対応情報を用いて、前記第１の画像と前記第２の画像の間の第２の変形変位場を取得する第２の変形取得手段と、
を備えることを特徴とする画像処理装置。 Data acquisition means for acquiring a first image and a second image obtained by imaging the subject under different conditions;
A region of interest acquisition means for acquiring a region of interest in the first image;
First deformation acquisition means for acquiring a first deformation displacement field between the first image and the second image;
Deformation approximating means for generating an approximate displacement field by approximating the first deformation displacement field in the region of interest using an approximate transformation model having a lower degree of freedom than the first deformation displacement field;
Correspondence information generating means for generating correspondence information between the first image and an image in which the first image is displaced based on the approximate displacement field with respect to the region of interest;
Second deformation acquisition means for acquiring a second deformation displacement field between the first image and the second image using the correspondence information;
An image processing apparatus comprising: 前記第１の変形取得手段は、前記第１の変形変位場に基づいて、前記第１の画像を変位させた第１の変形画像を生成し、
前記第２の変形取得手段は、前記第２の変形変位場に基づいて、前記第１の画像を変位させた第２の変形画像を生成することを特徴とする請求項１に記載の画像処理装置。 The first deformation acquisition means generates a first deformation image obtained by displacing the first image based on the first deformation displacement field,
The image processing according to claim 1, wherein the second deformation acquisition unit generates a second deformed image obtained by displacing the first image based on the second deformation displacement field. apparatus. 前記対応情報は、前記関心領域上に設定された複数の代表点と、該代表点の夫々を前記近似変位場を用いて変位させた複数の代表点とに基づいて取得される、仮想的な対応点であることを特徴とする請求項２に記載の画像処理装置。   The correspondence information is acquired based on a plurality of representative points set on the region of interest and a plurality of representative points obtained by displacing each of the representative points using the approximate displacement field. The image processing apparatus according to claim 2, wherein the image processing apparatus is a corresponding point. 前記設定された複数の代表点と、前記変位させた複数の代表点との位置関係は一致することを特徴とする請求項３に記載の画像処理装置。   The image processing apparatus according to claim 3, wherein a positional relationship between the set representative points and the displaced representative points coincides. 前記変位させた複数の代表点は、前記関心領域の面上に沿って動くことが許容されることを特徴とする請求項３に記載の画像処理装置。   The image processing apparatus according to claim 3, wherein the plurality of displaced representative points are allowed to move along a surface of the region of interest. 前記対応情報は、前記関心領域上に設定された領域と、該設定された領域を前記近似変位場を用いて変位させた領域とに基づいて取得される、仮想的な形状であることを特徴とする請求項２に記載の画像処理装置。   The correspondence information is a virtual shape acquired based on a region set on the region of interest and a region obtained by displacing the set region using the approximate displacement field. The image processing apparatus according to claim 2. 前記関心領域の性質に応じて、前記近似変位場を生成するために用いられる近似変換モデルを選択する近似変換モデル選択手段を更に備えることを特徴とする請求項１から６のいずれか１項に記載の画像処理装置。   The approximate transformation model selection means for selecting an approximate transformation model used for generating the approximate displacement field according to the property of the region of interest is further provided. The image processing apparatus described. 前記関心領域が複数存在する場合は、前記近似変換モデル選択手段は、それぞれの前記関心領域の性質に応じて、前記近似変位場を生成するために用いられる近似変換モデルを選択することを特徴とする請求項７に記載の画像処理装置。   When there are a plurality of the regions of interest, the approximate conversion model selection unit selects an approximate conversion model used for generating the approximate displacement field according to the property of each region of interest. The image processing apparatus according to claim 7. 前記関心領域に関しての前記第１の変形変位場から前記第２の変形変位場への変化の程度を示す形状維持度を取得する形状維持度取得手段を更に備え、
前記対応情報生成手段は、前記第１の画像と、前記第１の画像が前記近似変位場と前記形状維持度とに基づいて変位される画像との間の対応情報を生成することを特徴とする請求項１から８のいずれか１項に記載の画像処理装置。 A shape maintenance degree acquisition means for acquiring a shape maintenance degree indicating a degree of change from the first deformation displacement field to the second deformation displacement field with respect to the region of interest;
The correspondence information generating means generates correspondence information between the first image and an image in which the first image is displaced based on the approximate displacement field and the shape maintenance degree. The image processing apparatus according to any one of claims 1 to 8. 前記関心領域に関しての前記第１の変形変位場から前記第２の変形変位場への変化は線形であることを特徴とする請求項９に記載の画像処理装置。   The image processing apparatus according to claim 9, wherein a change from the first deformation displacement field to the second deformation displacement field with respect to the region of interest is linear. 前記関心領域に関しての前記第１の変形変位場から前記第２の変形変位場への変化は非線形であることを特徴とする請求項９に記載の画像処理装置。   The image processing apparatus according to claim 9, wherein a change from the first deformation displacement field to the second deformation displacement field with respect to the region of interest is nonlinear. 前記第１の変形変位場は、前記第１の画像と前記第２の画像との間で実際に対応する実対応点の位置の誤差の評価に基づいて算出され、
前記第２の変形変位場は、前記実対応点の位置の誤差と前記仮想的な対応点の位置の誤差の評価とに基づいて算出されることを特徴とする請求項３に記載の画像処理装置。 The first deformation displacement field is calculated based on an error evaluation of a position of an actual corresponding point that actually corresponds between the first image and the second image,
The second variant displacement field, the image processing according to claim 3, characterized in that calculated on the basis of the the actual error in the position of the corresponding points and the evaluation of the position of the virtual corresponding point error apparatus. 前記第１の画像に描出された前記被検体の第１の表面形状を取得し、前記第２の画像に描出された該被検体の第２の表面形状を取得する表面形状取得手段をさらに備え、
前記実対応点は、前記第１の表面形状と前記第２の表面形状との間で対応する表面対応点であることを特徴とする請求項１２に記載の画像処理装置。 Surface shape acquisition means is further provided for acquiring a first surface shape of the subject depicted in the first image and obtaining a second surface shape of the subject depicted in the second image. ,
The image processing apparatus according to claim 12, wherein the actual corresponding point is a surface corresponding point that corresponds between the first surface shape and the second surface shape. 前記実対応点の位置の誤差の評価は、前記第１の表面形状と前記第２の表面形状の何れか一方の曲面の法線方向の位置の誤差は大きく評価し、該曲面に沿った方向の位置の誤差は小さく評価することを特徴とする請求項１３に記載の画像処理装置。   The error of the position of the actual corresponding point is evaluated by greatly evaluating the position error in the normal direction of the curved surface of either the first surface shape or the second surface shape, and the direction along the curved surface. The image processing apparatus according to claim 13, wherein the position error is evaluated to be small. 前記近似変換モデルは剛体変換モデルであることを特徴とする請求項１から１４のいずれか１項に記載の画像処理装置。   The image processing apparatus according to claim 1, wherein the approximate conversion model is a rigid body conversion model. 前記関心領域取得手段は、ユーザによる操作に基づいて前記関心領域を取得することを特徴とする請求項１から１５のいずれか１項に記載の画像処理装置。 The image processing apparatus according to claim 1, wherein the region of interest acquisition unit acquires the region of interest based on an operation by a user. 前記第１の変形画像と前記第２の変形画像を表示部に表示させるための制御を行う表示制御手段を更に備えることを特徴とする請求項２から６のいずれか１項に記載の画像処理装置。 The image processing according to any one of claims 2 to 6 , further comprising display control means for performing control for displaying the first modified image and the second modified image on a display unit. apparatus. 被検体を異なる条件で撮像することにより得られた第１の画像と第２の画像を取得するデータ取得手段と、
前記第１の画像に描出された前記被検体の第１の表面形状を取得し、前記第２の画像に描出された該被検体の第２の表面形状を取得する表面形状取得手段と、
前記第１の表面形状と前記第２の表面形状との間の誤差の評価に基づいて、前記第１の画像と前記第２の画像の間の変形変位場を取得する変形取得手段とを備え、
前記誤差の評価は、前記第１の表面形状と前記第２の表面形状の何れか一方の曲面の法線方向の位置の誤差は大きく評価し、該曲面に沿った方向の位置の誤差は小さく評価することを特徴とする画像処理装置。 Data acquisition means for acquiring a first image and a second image obtained by imaging the subject under different conditions;
Surface shape obtaining means for obtaining a first surface shape of the subject depicted in the first image and obtaining a second surface shape of the subject depicted in the second image;
Deformation acquisition means for acquiring a deformation displacement field between the first image and the second image based on evaluation of an error between the first surface shape and the second surface shape. ,
In the evaluation of the error, the position error in the normal direction of one of the first surface shape and the second surface shape is greatly evaluated, and the position error in the direction along the curved surface is small. An image processing apparatus characterized by being evaluated. 第１の変形状態における被検体の第１の表面形状を取得する第１の形状取得手段と、
第２の変形状態における前記被検体の第２の表面形状を取得する第２の形状取得手段と、
前記第１の表面形状に関する表面上の第１の法線方向を取得する法線方向取得手段と、
前記第１と第２の表面形状との間の複数の位置の対応関係を取得する対応関係取得手段と、
前記複数の位置の対応関係の前記第１の法線方向に基づいて算出される距離を指標として、前記被検体に関する前記第１の変形状態と前記第２の変形状態との間の座標変換を算出する算出手段と、
を備える画像処理装置。 First shape acquisition means for acquiring a first surface shape of the subject in the first deformation state;
Second shape acquisition means for acquiring a second surface shape of the subject in a second deformation state;
Normal direction acquisition means for acquiring a first normal direction on the surface related to the first surface shape;
A correspondence acquisition means for acquiring a correspondence of a plurality of positions between the first and second surface shapes;
Using the distance calculated based on the first normal direction of the correspondence between the plurality of positions as an index, coordinate conversion between the first deformation state and the second deformation state related to the subject is performed. A calculating means for calculating;
An image processing apparatus comprising: 前記第１の形状取得手段は、前記第１の変形状態で前記被検体を撮影した第１の画像に基づいて第１の表面形状を取得し、
前記第２の形状取得手段は、前記第２の変形状態で前記被検体を撮影した第２の画像に基づいて第２の表面形状を取得し、
前記算出手段が算出した座標変換に基づいて、前記第１の画像または第２の画像を変形させた変形画像を生成する生成手段、
を備えることを特徴とする前記請求項１９に記載の画像処理装置。 The first shape acquisition means acquires a first surface shape based on a first image obtained by imaging the subject in the first deformation state,
The second shape acquisition means acquires a second surface shape based on a second image obtained by imaging the subject in the second deformation state,
Generating means for generating a deformed image obtained by deforming the first image or the second image based on the coordinate transformation calculated by the calculating means;
The image processing apparatus according to claim 19, further comprising: 前記法線方向取得手段は、さらに、前記第２の表面形状に関する第２の法線方向を取得し、
前記算出手段は、前記法線方向取得手段が算出した前記第２の法線方向にさらに基づいて前記座標変換を算出することを特徴とする前記請求項１９に記載の画像処理装置。 The normal direction acquisition means further acquires a second normal direction related to the second surface shape,
The image processing apparatus according to claim 19, wherein the calculation unit calculates the coordinate transformation based further on the second normal direction calculated by the normal direction acquisition unit. 前記算出手段は、前記第１の法線方向および前記第２の法線方向の夫々に関する信頼度を取得し、前記信頼度にさらに基づいて前記座標変換を算出することを特徴とする前記請求項２１に記載の画像処理装置。   The said calculation means acquires the reliability regarding each of the said 1st normal line direction and the said 2nd normal line direction, and calculates the said coordinate transformation further based on the said reliability. The image processing apparatus according to 21. 第１の変形状態における被検体の第１の表面形状を取得する第１の形状取得工程と、
第２の変形状態における前記被検体の第２の表面形状を取得する第２の形状取得工程と、
前記第１の表面形状に関する表面上の第１の法線方向を取得する法線方向取得工程と、
前記第１と第２の表面形状との間の複数の位置の対応関係を取得する対応関係取得工程と、
前記複数の位置の対応関係の前記第１の法線方向に基づいて算出される距離を指標として、前記被検体に関する前記第１の変形状態と前記第２の変形状態との間の座標変換を算出する算出工程と
を備える画像処理方法。 A first shape acquisition step of acquiring a first surface shape of a subject in a first deformation state;
A second shape acquisition step of acquiring a second surface shape of the subject in a second deformation state;
A normal direction acquisition step of acquiring a first normal direction on the surface with respect to the first surface shape;
A correspondence acquisition step of acquiring a correspondence of a plurality of positions between the first and second surface shapes;
Using the distance calculated based on the first normal direction of the correspondence between the plurality of positions as an index, coordinate conversion between the first deformation state and the second deformation state related to the subject is performed. An image processing method comprising a calculation step of calculating. 被検体を異なる条件で撮像することにより得られた第１の画像と第２の画像を取得するデータ取得工程と、
前記第１の画像内の関心領域を取得する関心領域取得工程と、
前記第１の画像と前記第２の画像の間の第１の変形変位場を取得する第１の変形取得工程と、
前記関心領域における前記第１の変形変位場を、前記第１の変形変位場より自由度が少ない近似変換モデルを用いて近似して近似変位場を生成する変形近似工程と、
前記関心領域に関して、前記第１の画像と、前記第１の画像が前記近似変位場に基づいて変位される画像との間の対応情報を生成する対応情報生成工程と、
前記対応情報を用いて、前記第１の画像と前記第２の画像の間の第２の変形変位場を取得する第２の変形取得工程と、
を備えることを特徴とする画像処理方法。 A data acquisition step of acquiring a first image and a second image obtained by imaging the subject under different conditions;
A region of interest acquisition step of acquiring a region of interest in the first image;
A first deformation acquisition step of acquiring a first deformation displacement field between the first image and the second image;
A deformation approximation step of generating an approximate displacement field by approximating the first deformation displacement field in the region of interest using an approximate transformation model having a lower degree of freedom than the first deformation displacement field;
A correspondence information generating step for generating correspondence information between the first image and an image in which the first image is displaced based on the approximate displacement field with respect to the region of interest;
Using the correspondence information, a second deformation acquisition step of acquiring a second deformation displacement field between the first image and the second image;
An image processing method comprising: コンピュータを、請求項１から２２のいずれか１項に記載の画像処理装置として機能させるためのプログラム。   A program for causing a computer to function as the image processing apparatus according to any one of claims 1 to 22.
JP2016207259A 2016-01-15 2016-10-21 Image processing equipment, image processing methods, and programs Active JP6905323B2 (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
EP18191466.4A EP3444781B1 (en) 2016-01-15 2016-12-29 Image processing apparatus and image processing method
EP16002762.9A EP3206189B1 (en) 2016-01-15 2016-12-29 Image processing apparatus, image processing method, and program
US15/400,074 US10417777B2 (en) 2016-01-15 2017-01-06 Image processing apparatus, image processing method, and non-transitory computer-readable storage medium

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2016006556 2016-01-15
JP2016006556 2016-01-15

Publications (3)

Publication Number Publication Date
JP2017127623A JP2017127623A (en) 2017-07-27
JP2017127623A5 true JP2017127623A5 (en) 2019-11-07
JP6905323B2 JP6905323B2 (en) 2021-07-21

Family

ID=59394203

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2016207259A Active JP6905323B2 (en) 2016-01-15 2016-10-21 Image processing equipment, image processing methods, and programs

Country Status (1)

Country Link
JP (1) JP6905323B2 (en)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP7179521B2 (en) * 2018-08-02 2022-11-29 キヤノンメディカルシステムズ株式会社 MEDICAL IMAGE PROCESSING APPARATUS, IMAGE GENERATION METHOD, AND IMAGE GENERATION PROGRAM
KR20210146283A (en) * 2018-12-28 2021-12-03 액티브 서지컬, 인크. Generation of synthetic three-dimensional imaging from partial depth maps
DE102019109789A1 (en) * 2019-04-12 2020-10-15 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Method and computer program for time-resolved calculation of a deformation of a body
CN114111610A (en) * 2020-08-26 2022-03-01 Ykk株式会社 Method and computer system for dynamically measuring deformation of conveyed fabric
CN114187338B (en) * 2021-12-08 2023-04-28 卡本(深圳)医疗器械有限公司 Organ deformation registration method based on estimated 2d displacement field

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7239321B2 (en) * 2003-08-26 2007-07-03 Speech Graphics, Inc. Static and dynamic 3-D human face reconstruction
WO2005059831A1 (en) * 2003-12-11 2005-06-30 Philips Intellectual Property & Standards Gmbh Elastic image registration
JP5159301B2 (en) * 2007-12-28 2013-03-06 株式会社東芝 Medical image display apparatus and image display method
GB0913930D0 (en) * 2009-08-07 2009-09-16 Ucl Business Plc Apparatus and method for registering two medical images
JP5586917B2 (en) * 2009-10-27 2014-09-10 キヤノン株式会社 Information processing apparatus, information processing method, and program
US8675944B2 (en) * 2012-01-12 2014-03-18 Kabushiki Kaisha Toshiba Method of registering image data
US9384555B2 (en) * 2012-07-02 2016-07-05 Kabushiki Kaisha Toshiba Motion correction apparatus and method
CN104603836A (en) * 2012-08-06 2015-05-06 范德比尔特大学 Enhanced method for correcting data for deformations during image guided procedures
CN103854276B (en) * 2012-12-04 2018-02-09 东芝医疗系统株式会社 Image registration and segmenting device and method, and medical image equipment
US20160117797A1 (en) * 2013-06-06 2016-04-28 Hitachi, Ltd. Image Processing Apparatus and Image Processing Method
US9547894B2 (en) * 2013-10-08 2017-01-17 Toshiba Medical Systems Corporation Apparatus for, and method of, processing volumetric medical image data
JP6182045B2 (en) * 2013-10-11 2017-08-16 キヤノン株式会社 Image processing apparatus and method
JP6208535B2 (en) * 2013-10-25 2017-10-04 株式会社日立製作所 Radiotherapy apparatus and system and method

Similar Documents

Publication Publication Date Title
JP2017127623A5 (en)
JP2020005192A5 (en)
JP2018126857A5 (en) Control methods, robot systems, article manufacturing methods, programs and recording media
JP2019087229A5 (en)
US9974618B2 (en) Method for determining an imaging specification and image-assisted navigation as well as device for image-assisted navigation
JP2013178636A5 (en)
JP2013186088A5 (en)
JP6383189B2 (en) Image processing apparatus, image processing method, and program
JP2010134649A5 (en)
JP2008261755A5 (en)
JP2018004541A5 (en) INFORMATION PROCESSING APPARATUS, CONTROL METHOD FOR INFORMATION PROCESSING APPARATUS, AND PROGRAM
JP2015212644A5 (en)
JP2012161595A5 (en)
JP2016087109A5 (en)
JP2018038609A5 (en)
JP2014203463A5 (en)
JP2017191492A5 (en)
JP2014069272A5 (en)
JP2014120068A5 (en)
JP2019124539A5 (en)
JP6238755B2 (en) Information processing apparatus, information processing method, and program
JP2013045334A5 (en)
JP2014530055A5 (en)
JP2018036813A5 (en)
JP2015035231A5 (en)