JP2006149446A - Medical image display device - Google Patents

Medical image display device Download PDF

Info

Publication number
JP2006149446A
JP2006149446A JP2004340841A JP2004340841A JP2006149446A JP 2006149446 A JP2006149446 A JP 2006149446A JP 2004340841 A JP2004340841 A JP 2004340841A JP 2004340841 A JP2004340841 A JP 2004340841A JP 2006149446 A JP2006149446 A JP 2006149446A
Authority
JP
Japan
Prior art keywords
region
extracted
psoas muscle
psoas
spine
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
JP2004340841A
Other languages
Japanese (ja)
Other versions
JP4514039B2 (en
Inventor
Yoshihiro Goto
良洋 後藤
Kuniyoshi Nakajima
邦佳 中島
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hitachi Healthcare Manufacturing Ltd
Original Assignee
Hitachi Medical Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hitachi Medical Corp filed Critical Hitachi Medical Corp
Priority to JP2004340841A priority Critical patent/JP4514039B2/en
Publication of JP2006149446A publication Critical patent/JP2006149446A/en
Application granted granted Critical
Publication of JP4514039B2 publication Critical patent/JP4514039B2/en
Anticipated expiration legal-status Critical
Active legal-status Critical Current

Links

Images

Landscapes

  • Image Processing (AREA)
  • Image Analysis (AREA)
  • Apparatus For Radiation Diagnosis (AREA)

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image processing technique capable of accurately extracting a major psoas muscle region. <P>SOLUTION: A vertebra region is extracted (S21) by a binarization processing from a medical image which is a tomographic image photographed at the navel position of a testee body, in which a navel region, soft tissue including the major psoas muscle and the vertebra region are photographed. A prescribed threshold is set so as to extract the soft tissue including the major psoas muscle and it is extracted by the binarization processing (S22). A symmetry center line which divides the tomographic image in the left and right directions of the testee body is set and only pixel points present at symmetrical positions with the symmetry center line as a reference are extracted (S23). Approximate major psoas muscle regions are extracted as regions present on the left and right of the vertebra region (S24). On the basis of the approximate major psoas muscle regions, the entire major psoas muscle region including the pixel points present at asymmetrical positions with the symmetry center line as a reference is extracted from binary medical images (S25). <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

本発明は、医用画像診断表示装置に係り、特に、被検体の断層像から大腰筋領域を抽出する技術に関する。   The present invention relates to a medical image diagnostic display apparatus, and more particularly to a technique for extracting a psoas muscle region from a tomographic image of a subject.

大腰筋の体積は年齢と共に縮小し、わずかな突起にもつまずいてころぶようになる。縮小した場合は受診者に知らせ、リハビリを促す必要がある。この場合、CT画像を用いて大腰筋領域を抽出するのが便利であり、医師要求が高い。なお、大腰筋の体積は、へその写っているスライス画像の大腰筋面積と相関があり、医師はこの面積測定で代用する場合が多い。   The volume of the psoas muscle decreases with age, and it begins to fall on a small protrusion. If it shrinks, it is necessary to inform the patient and encourage rehabilitation. In this case, it is convenient to extract the psoas muscle region using a CT image, and doctor demands are high. Note that the volume of the psoas muscle correlates with the psoas muscle area of the slice image in which the navel is reflected, and doctors often substitute this area measurement.

ここで、大腰筋について図17に基づき説明する。大腰筋は、脊椎を挟んで左右に位置する。この左右の大腰筋A、Bは他の周辺の臓器A、B(例えば腎臓)と接触していているため、単純なしきい値処理では抽出できない。   Here, the psoas major will be described with reference to FIG. The psoas major is located on the left and right sides of the spine. Since the left and right psoas major muscles A and B are in contact with other surrounding organs A and B (for example, kidneys), they cannot be extracted by simple threshold processing.

そこで、医用画像から大腰筋領域を抽出する技術の一つとして、例えば特許文献1には、二値化画像の部分的な出っ張り領域を削除する画像処理技術が開示されている。特許文献1の画像処理技術は、図18(a)のように、複数の画素点からなるx軸に平行な点列a1、a2、a3、a4、a5を設定し、a1=a5=0 ならa2=a3=a4=0とする。また、複数の画素点からなるy軸に平行な点列b1、b2、b3、b4を設定し、b1=b4=0ならb2=b3=0とする。これにより、点列a1、a2、a3、a4、a5及び点列b1、b2、b3、b4を切断または削除し、二値化画像の部分的な出っ張り領域を削除する。
特開2002-325761号公報
Thus, as one technique for extracting the psoas major region from a medical image, for example, Patent Document 1 discloses an image processing technique for deleting a partial protruding region of a binarized image. As shown in FIG. 18A, the image processing technique of Patent Document 1 sets point sequences a1, a2, a3, a4, and a5 that are parallel to the x-axis and that are a plurality of pixel points, and if a1 = a5 = 0. It is assumed that a2 = a3 = a4 = 0. In addition, point sequences b1, b2, b3, and b4 made up of a plurality of pixel points parallel to the y-axis are set. If b1 = b4 = 0, b2 = b3 = 0. Thereby, the point sequence a1, a2, a3, a4, a5 and the point sequence b1, b2, b3, b4 are cut or deleted, and a partial protruding area of the binarized image is deleted.
JP 2002-325761 A

しかし、特許文献1の画像処理技術により二値化画像の部分的な出っ張り領域を削除すると、図18(b)に示すように、切断個所が直線状になるという問題があった。   However, when a partial protruding area of the binarized image is deleted by the image processing technique of Patent Document 1, there is a problem that the cut portion becomes a straight line as shown in FIG.

本発明は、このような事情に鑑みてなされたもので、大腰筋領域を精度良く抽出することができる画像処理技術を提供することを目的とする。   The present invention has been made in view of such circumstances, and an object thereof is to provide an image processing technique capable of accurately extracting a psoas major region.

前記目的を達成するために本発明に係る医用画像表示装置は、被検体のへそ位置で撮影した断層像であって、へそ領域、大腰筋を含む軟部組織、及び脊椎領域が撮影された医用画像を取得する画像取得手段と、前記取得された医用画像に所定の閾値を設定して前記大腰筋を含む軟部組織を抽出した抽出画像を生成する手段と、前記抽出画像を所望に分割する対称中心線を設定する手段と、前記抽出画像において、前記対称中心線を基準に対称となる位置に存在する画素点のみを抽出することによって近似的大腰筋領域を抽出する第一抽出手段と、前記近似的大腰筋領域に基づいて、前記抽出画像から前記対称中心線を基準として非対称となる位置に存在する画素点を含む全大腰筋領域を抽出する第二抽出手段と、前記第二抽出手段によって抽出された前記全大腰筋領域を表示する表示手段と、を備える。   In order to achieve the above object, a medical image display device according to the present invention is a tomographic image taken at a navel position of a subject, and a medical image in which a navel region, a soft tissue including a psoas major muscle, and a spine region are imaged. Image acquiring means for acquiring an image, means for generating an extracted image obtained by extracting a soft tissue including the psoas muscle by setting a predetermined threshold value for the acquired medical image, and dividing the extracted image as desired Means for setting a symmetric center line; and first extraction means for extracting an approximated psoas muscle region by extracting only pixel points existing at positions symmetrical with respect to the symmetric center line in the extracted image; A second extracting means for extracting, based on the approximate psoas muscle region, all psoas muscle regions including pixel points existing at positions that are asymmetric with respect to the symmetry center line from the extracted image; Extract by two extraction means Comprising a display means for displaying the total O Goshi muscle region that is, a.

また、前記第二抽出手段は、前記近似的大腰筋領域の輪郭線の形状に沿って1ラインずつ拡張し、前記ライン上の画素点が前記所定の閾値を満たす場合には前記画素点を大腰筋領域として抽出する。   The second extraction means expands line by line along the shape of the outline of the approximate psoas muscle region, and if the pixel point on the line satisfies the predetermined threshold, the pixel point is Extract as large psoas muscle region.

また、前記表示手段に表示された前記抽出画像のうち所定の領域を領域指定するための位置座標入力手段を、更に備える。   Further, the apparatus further comprises position coordinate input means for designating a predetermined area of the extracted image displayed on the display means.

また、前記第二抽出手段によって抽出された前記対称中心線によって分割される全大腰筋領域の面積を算出して比較し、面積の差が所望の範囲にあるか否かを判定する面積差判定手段と、前記面積差判定手段が、前記面積の差が所望の範囲に無いと判定した場合に前記面積の差が所望の範囲に無い旨を通知する通知手段と、を更に備え、前記通知がされた場合に、前記位置座標入力手段により前記抽出画像に含まれる大腰筋領域を指定して抽出する。   Further, an area difference for determining whether or not the difference in area is within a desired range by calculating and comparing the areas of all psoas muscle regions divided by the symmetrical centerline extracted by the second extraction means And a notification means for notifying that the area difference is not in the desired range when the area difference determination means determines that the area difference is not in the desired range. In the case where it is done, the position coordinate input means designates and extracts the psoas muscle region included in the extracted image.

上述の「第二抽出手段」は、前記抽出画像において大腰筋領域が隣り合う軟部組織と接している場合に、前記近似的大腰筋領域の傾き角度を算出し、前記二値化画像に含まれる大腰筋領域の輪郭線上の任意の2点を通り、かつ前記傾き角度に基づいて決定された傾き角度を有する線分を設定し、該線分の長さが極小となる位置を算出し、該位置より前記大腰筋領域の外側であって前記傾き角度を有する所定の傾斜領域を削除して抽出してもよい。   The above-mentioned “second extraction means” calculates an inclination angle of the approximate psoas muscle region when the psoas muscle region is in contact with an adjacent soft tissue in the extracted image, and outputs the binarized image to the binarized image. Set a line segment that passes through any two points on the outline of the contained psoas muscle region and has an inclination angle determined based on the inclination angle, and calculates the position where the length of the line segment is minimal Then, a predetermined slope area outside the greater psoas muscle area than the position and having the slope angle may be deleted and extracted.

また「第二抽出手段」は、前記抽出画像において大腰筋領域が隣り合う軟部組織と接している場合に、前記大腰筋領域に接する軟部組織の重心から同心円を設定し、該同心円上の任意の2点において画素値が0となる場合に前記任意の2点を結ぶ円弧上の画素点の画素値を0にすることにより前記軟部組織と前記大腰筋領域と分離し、更に、前記近似的大腰筋領域の傾き角度を算出し、前記分離された大腰筋領域の輪郭線上の任意の2点を通り、かつ前記傾き角度に基づいて決定された傾き角度を有する線分を設定し、該線分上において前記閾値を満たす画素点を大腰筋領域として抽出してもよい。   Further, the “second extraction means” sets a concentric circle from the center of gravity of the soft tissue in contact with the psoas muscle region when the psoas muscle region is in contact with the adjacent soft tissue in the extracted image, and When the pixel value at any two points is 0, the pixel value of the pixel point on the arc connecting the two arbitrary points is set to 0 to separate the soft tissue and the psoas muscle region, and The inclination angle of the approximate psoas muscle region is calculated, and a line segment passing through any two points on the outline of the separated psoas region and having an inclination angle determined based on the inclination angle is set. Then, pixel points that satisfy the threshold on the line segment may be extracted as the psoas muscle region.

また「医用画像表示装置」は、前記医用画像から脊椎領域を抽出する脊椎抽出手段を更に備えてもよい。そして、「第一抽出手段」は、前記対称中心線を基準に対称となる位置に存在する画素点のうち、脊椎抽出手段が抽出した脊椎領域の両側に位置する画素点を近似的大腰筋領域として抽出してもよい。   The “medical image display device” may further include spine extraction means for extracting a spine region from the medical image. Then, the “first extraction means” uses the approximated psoas major as the pixel points located on both sides of the spine region extracted by the spine extraction means among the pixel points that are symmetric with respect to the symmetry center line. It may be extracted as a region.

更に、脊椎領域抽出手段により抽出された前記脊椎領域が所望の条件を満たさない場合に、前記画像取得手段は、前記断層像に相当する被検体の部位付近を撮影した他の医用画像を取得し、該他の医用画像に基づいて全大腰筋領域の抽出処理を行ってもよい。   Furthermore, when the spine region extracted by the spine region extraction unit does not satisfy a desired condition, the image acquisition unit acquires another medical image obtained by photographing the vicinity of the part of the subject corresponding to the tomographic image. The whole psoas muscle region may be extracted based on the other medical image.

また、前記脊椎領域抽出手段により抽出された前記脊椎領域が所望の条件を満たさない場合に、前記位置座標入力手段により前記抽出画像に含まれる脊椎領域を指定して抽出してもよい。   Further, when the spine region extracted by the spine region extraction unit does not satisfy a desired condition, the spine region included in the extracted image may be specified and extracted by the position coordinate input unit.

また、前記脊椎領域抽出手段により抽出された前記脊椎領域が所望の条件を満たさない場合に、前記画像取得手段に前記被検体の断層像を撮影した他の医用画像を取得させ該他の医用画像に基づいて脊椎領域を抽出する処理を行なうか、又は前記位置座標入力手段により前記抽出画像に含まれる脊椎領域を指定して抽出するか、を操作者に選択させるための選択手段を更に備えてもよい。   When the spine region extracted by the spine region extraction unit does not satisfy a desired condition, the image acquisition unit acquires another medical image obtained by capturing a tomographic image of the subject. And a selection means for causing the operator to select whether to perform a process of extracting a spine area based on the position, or to specify and extract a spine area included in the extracted image by the position coordinate input means. Also good.

また、前記脊椎領域抽出手段により抽出された前記脊椎領域が所望の条件を満たさず、大腰筋領域が脊椎領域の一部と隣接して広領域を形成する場合に、前記脊椎抽出手段が抽出した脊椎領域の重心及び前記断層像に写ったへそ領域の重心を通る直線または前記断層像における体表輪郭線の中心線上にあって、前記脊椎抽出手段が抽出した脊椎領域の重心から所定の範囲にある画素点を仮中心点として抽出し、該仮中心点から前記広範囲領域の輪郭線上の画素点までの距離を算出することにより前記広範囲領域の重心を算出し、該広範囲領域の重心を本中心点とする同心円を設定し、該同心円上にある任意の2点の画素値が0である場合に、前記任意の2点を結ぶ円弧上の画素点の画素値を0にすることにより、前記大腰筋領域と前記脊椎領域の一部とを分離する脊椎領域分離手段を更に備えてもよい。   Further, when the spine region extracted by the spine region extraction unit does not satisfy a desired condition and the psoas major region forms a wide region adjacent to a part of the spine region, the spine extraction unit extracts A predetermined range from the center of gravity of the spine region extracted by the spine extraction means, on the straight line passing through the center of gravity of the spine region and the center of the body surface contour line in the tomographic image shown in the tomogram Is extracted as a temporary center point, the center of gravity of the wide area is calculated by calculating the distance from the temporary center point to the pixel point on the outline of the wide area, and the center of gravity of the wide area is By setting a concentric circle as the center point, and when the pixel value of any two points on the concentric circle is 0, by setting the pixel value of the pixel point on the arc connecting the two arbitrary points to 0, The psoas major region and the spinal territory Spinal region separating means for separating a portion of may further include a.

また、前記脊椎領域抽出手段により抽出された前記脊椎領域が所望の条件を満たさず、大腰筋領域が脊椎領域の一部と隣接して広領域を形成する場合に、前記第一抽出手段が抽出した前記近似的大腰筋領域の傾き角度を算出し、前記広範囲領域の輪郭線上の任意の2点を通りかつ前記傾き角度に基づいて決定される傾き角度を有する線分を設定し、該線分の長さが極小となる位置において前記広範囲領域を分割することにより前記大腰筋領域と前記脊椎領域の一部とを分離する脊椎領域分離手段を更に備えてもよい。   When the spine region extracted by the spine region extraction unit does not satisfy a desired condition and the psoas muscle region forms a wide region adjacent to a part of the spine region, the first extraction unit includes Calculating an inclination angle of the extracted approximate psoas muscle region, setting a line segment passing through any two points on the outline of the wide area region and having an inclination angle determined based on the inclination angle; A spinal region separation means for separating the psoas muscle region and a part of the spine region by dividing the wide area at a position where the length of the line segment is minimal may be further provided.

また、前記第二抽出手段が抽出した前記全大腰筋領域から、該全大腰筋領域に含まれる脂肪領域の面積を算出する脂肪面積算出手段を更に備えてもよい。   Moreover, you may further provide the fat area calculation means which calculates the area of the fat area | region contained in this all psoas muscle area from the all psoas muscle area extracted by said 2nd extraction means.

また、前記第二抽出手段が抽出した前記全大腰筋領域の面積を算出し、該全大腰筋領域の面積から前記脂肪面積算出手段が算出した前記脂肪領域の面積を減算処理し、減算後の大腰筋領域の面積を算出する大腰筋面積算出手段を更に備えてもよい。   Further, the area of the entire psoas muscle region extracted by the second extraction unit is calculated, and the area of the fat region calculated by the fat area calculation unit is subtracted from the area of the total psoas muscle region, and subtraction is performed. A psoas major area calculation means for calculating the area of the subsequent psoas major region may be further provided.

本発明によれば、大腰筋の非対称性を利用して近似的大腰筋領域を算出し、更に近似的大腰筋領域に基づいて医用画像に含まれる大腰筋領域を精度良く抽出することができる。そして、抽出した大腰筋領域を利用して、大腰筋の面積を求めることができる。   According to the present invention, the approximate psoas muscle region is calculated using the asymmetry of the psoas muscle, and the psoas muscle region included in the medical image is accurately extracted based on the approximate psoas region. be able to. Then, the area of the psoas muscle can be obtained using the extracted psoas muscle region.

以下、添付図面に従って本発明に係る医用画像表示装置の好ましい実施の形態について詳説する。なお、発明の実施の形態を説明するための全図において、同一機能を有するものは同一符号を付け、その繰り返しの説明は省略する。   Hereinafter, preferred embodiments of a medical image display apparatus according to the present invention will be described in detail with reference to the accompanying drawings. Note that components having the same function are denoted by the same reference symbols throughout the drawings for describing the embodiment of the invention, and the repetitive description thereof is omitted.

図1は、発明の一実施の形態に係る医用画像表示システム1の構成を示すハードウェア構成図である。   FIG. 1 is a hardware configuration diagram showing a configuration of a medical image display system 1 according to an embodiment of the invention.

図1の医用画像表示システム1は、X線CT装置2と、MR装置3と、X線CT装置2及びMR装置3が撮影して得た医用画像を格納する画像データベース4と、医用画像を表示する医用画像表示装置10とを備え、X線CT装置2、MR装置3、画像データベース4、及び医用画像表示装置10は、LAN5等のネットワークにより互いに接続される。   The medical image display system 1 in FIG. 1 includes an X-ray CT apparatus 2, an MR apparatus 3, an image database 4 that stores medical images obtained by the X-ray CT apparatus 2 and the MR apparatus 3, and medical images. The X-ray CT apparatus 2, the MR apparatus 3, the image database 4, and the medical image display apparatus 10 are connected to each other via a network such as a LAN 5.

医用画像表示装置10は、主として各構成要素の動作を制御する中央処理装置(CPU)11と、装置の制御プログラムが格納されたり、プログラム実行時の作業領域となったりする主メモリ12と、オペレーティングシステム(OS)、周辺機器のデバイスドライブ、医用画像から大腰筋領域を抽出する処理等を行うためのプログラムを含む各種アプリケーションソフト等が格納される磁気ディスク13と、表示用データを一時記憶する表示メモリ14と、この表示メモリ14からのデータに基づいて画像を表示するCRTモニタや液晶モニタ等のモニタ15と、キーボード16と、位置座標入力装置としてのマウス17と、マウス17の状態を検出してモニタ15上のマウスポインタの位置やマウス17の状態等の信号をCPU11に出力するコントローラ18と、上記各構成要素を接続する共通バス19とを備える。   The medical image display apparatus 10 includes a central processing unit (CPU) 11 that mainly controls the operation of each component, a main memory 12 that stores a control program for the apparatus and that serves as a work area when the program is executed, and an operating system. System (OS), device drive of peripheral device, magnetic disk 13 storing various application software including a program for extracting the psoas muscle region from medical images, etc. and display data are temporarily stored. A display memory 14, a monitor 15 such as a CRT monitor or a liquid crystal monitor for displaying an image based on data from the display memory 14, a keyboard 16, a mouse 17 as a position coordinate input device, and a state of the mouse 17 are detected. And outputs signals such as the position of the mouse pointer on the monitor 15 and the state of the mouse 17 to the CPU 11. It includes a controller 18 for, and a common bus 19 for connecting the above components.

本実施の形態においては、医用画像表示装置10は、LAN5を介して画像データベース4から医用画像を読み出すが、医用画像表示装置10に接続された記憶装置、例えばFDD、CD−RWドライブ、MOドライブ、ZIPドライブ等から医用画像を読み込んでも良い。また、LAN5を経由してX線CT装置2やMR装置3から直接医用画像を取得してもよい。   In the present embodiment, the medical image display device 10 reads a medical image from the image database 4 via the LAN 5, but a storage device connected to the medical image display device 10, such as an FDD, CD-RW drive, or MO drive A medical image may be read from a ZIP drive or the like. Alternatively, a medical image may be acquired directly from the X-ray CT apparatus 2 or the MR apparatus 3 via the LAN 5.

次に、図2乃至5、図15及び16に基づいて、本実施の形態に係る医用画像表示装置10を用いて医用画像から大腰筋領域を抽出する手順について説明する。図2は、大腰筋領域の抽出手順を示すフローチャートである。図3は、ステップS23の処理結果画像であって、二値化画像に対称中心線を設定し、対称性を満たした画素のみを残す処理により残った領域を示す模式図である。図4(a)はステップS24の処理結果画像であって、脊椎の左右に隣接領域として、近似的大腰筋領域を抽出した状態を示す模式図であり、図4(b)は図4(a)の近似的大腰筋領域に領域拡張法を適用して大腰筋領域を求める方法を示す模式図である。図5(a)は、大腰筋領域と脊椎領域とを分離するための第一の処理方法をしめす模式図であり、図5(b)は大腰筋領域と脊椎領域とを分離するための第二の処理方法をしめす模式図である。図15は、脊椎領域が鮮明に写った原画像例、図16は、脊椎領域が不鮮明に写った原画像例を示す。以下図2の各ステップ順に説明する。   Next, a procedure for extracting a psoas muscle region from a medical image using the medical image display apparatus 10 according to the present embodiment will be described based on FIGS. 2 to 5, 15 and 16. FIG. 2 is a flowchart showing a procedure for extracting the psoas muscle region. FIG. 3 is a schematic diagram showing a region left after the process of setting the symmetry center line in the binarized image and leaving only the pixels satisfying the symmetry, which is the processing result image in step S23. FIG. 4A is a processing result image of step S24, and is a schematic diagram showing a state where an approximated psoas muscle region is extracted as an adjacent region on the left and right of the spine, and FIG. It is a schematic diagram which shows the method of calculating | requiring a psoas muscle area | region by applying the area | region expansion method to the approximate psoas muscle area of a). FIG. 5A is a schematic diagram showing a first processing method for separating the psoas muscle region and the spine region, and FIG. 5B is a diagram for separating the psoas region and the spine region. It is a schematic diagram which shows the 2nd processing method. FIG. 15 shows an example of an original image in which the spine region is clearly shown, and FIG. 16 shows an example of an original image in which the spine region is shown unclearly. In the following, description will be given in the order of each step in FIG.

(ステップS21)
原画像(例えば図15、16に示す被検体のへそ位置で撮影した断層像を示す医用画像)から脊椎のCT値に基づいて閾値(例えば、CT値がt2より大)を設定して閾値処理し、脊椎領域を二値化抽出する(S21)。予め、脊椎の一部を囲む矩形で領域を限定しておくと処理が少なくなる。
(Step S21)
Threshold processing is performed by setting a threshold (for example, CT value is larger than t2) based on the CT value of the spine from the original image (for example, a medical image showing a tomographic image taken at the navel position of the subject shown in FIGS. 15 and 16). Then, the spinal region is binarized and extracted (S21). If the area is limited in advance by a rectangle surrounding a part of the spine, processing is reduced.

このとき、抽出された脊椎領域の面積は所定の範囲内か否かを、また脊椎領域の重心座標は所定の範囲内にあるか否を判定するための自動チェック処理を行なう。これは、例えば図15に示す原画像150には高濃度の脊椎151が写っているが、図16に示す原画像には、撮影スライス位置が骨の間に位置したため、大部分の領域161が低濃度で写っており、閾値処理だけでは脊椎領域の全部を抽出できない場合があるためである。この脊椎領域の自動チェック処理については図6に基づいて後述する。   At this time, an automatic check process is performed to determine whether the area of the extracted spine region is within a predetermined range and whether the barycentric coordinates of the spine region are within the predetermined range. For example, the high-concentration spine 151 is shown in the original image 150 shown in FIG. 15, but since the imaging slice position is located between the bones in the original image shown in FIG. This is because the image is captured at a low density, and the entire spine region may not be extracted only by threshold processing. This automatic spine region check process will be described later with reference to FIG.

(ステップS22)
原画像から大腰筋のCT値に基づいて閾値を設定して閾値処理し、大腰筋を含む軟部組織領域を二値化抽出する(S22)。
(Step S22)
A threshold value is set from the original image based on the CT value of the psoas muscle and threshold processing is performed, and the soft tissue region including the psoas muscle is binarized and extracted (S22).

(ステップS23)
対称中心線40を設定し、その対称中心線40を基準として対称に存在する画素のみを残す(S23)。
(Step S23)
A symmetric center line 40 is set, and only pixels that exist symmetrically with respect to the symmetric center line 40 are left (S23).

対称中心線40は、(1)脊椎領域の重心とへそ位置(へそを示す凹部領域の重心)とを通る直線、(2)へそが写ってない場合は、脊椎領域よりも背中側に位置する筋肉(図17における筋肉A,B)の両端を検出し、筋肉A,Bの両端を結ぶ線分の中点を通り、かつ垂直方向な直線、又は(3)脊椎と被検体の体組織領域の重心を通る直線を設定することにより求める。   The symmetry center line 40 is (1) a straight line passing through the center of gravity of the spine region and the navel position (the center of gravity of the recessed region indicating the navel), and (2) when the navel is not reflected, is located on the back side of the spine region. Detecting both ends of the muscle (muscles A and B in FIG. 17), passing through the midpoint of the line segment connecting both ends of the muscles A and B, and (3) the spine and the body tissue region of the subject It is obtained by setting a straight line passing through the center of gravity.

そして、ステップS22でもとめた軟部組織領域のうち、対称中心線40を基準として対称となる位置に存在する画素のみを残す。このステップS23の処理結果を図3に示す。図3に示すように、大腰筋30A,30B、他の臓器31A,31B、筋肉32など、対称中心線40に対して対称な画素点のみが抽出される。また、脊椎のCT値が高い場合には脊椎領域は抽出されない。   And only the pixel which exists in the position which becomes symmetrical with respect to the symmetry center line 40 is left among the soft tissue regions stopped in step S22. The processing result of this step S23 is shown in FIG. As shown in FIG. 3, only pixel points that are symmetric with respect to the symmetric center line 40, such as the psoas major muscles 30A and 30B, the other organs 31A and 31B, and the muscle 32, are extracted. Further, when the CT value of the spine is high, the spine region is not extracted.

通常、人体の構成は、対称中心線40に対して完全に対称な位置に大腰筋や他の臓器、筋肉などが位置せず、また各大腰筋や臓器、筋肉の形状は非対称形をなしている。一方、ステップS23では、対称中心線40を挟んで対称な画素のみを抽出するため、ステップS23で結果抽出される領域は、隣り合う臓器から分離されて(接していない状態で)抽出される。   Normally, the human body is configured such that the psoas major muscles, other organs, muscles, etc. are not located at positions completely symmetrical with respect to the symmetry center line 40, and the shape of each psoas major muscle, organ, muscle is asymmetric. There is no. On the other hand, in Step S23, since only the symmetric pixels are extracted with the symmetry center line 40 interposed therebetween, the region extracted as a result in Step S23 is extracted from the adjacent organs (in a non-contact state).

(ステップS24)
脊椎領域の左右に存在する領域のみを抽出することにより、図4(a)に示すように近似的大腰筋領域30A、30Bを求める(S24)。このとき、近似的大腰筋領域30A、30Bの面積は所定の範囲内か否かを、また近似的大腰筋領域30A、30Bの重心座標は所定の範囲内にあるか否を判定するための自動チェック処理を行なう。これにより、正しく近似的大腰筋領域30A、30Bを抽出しているか否か、例えば図3に示す二値化画像において、近似的大腰筋領域30A、30Bに隣接する臓器領域31A、31Bを誤って近似的大腰筋領域として抽出していないかどうかをチェックすることができる。
(Step S24)
By extracting only the regions present on the left and right of the spine region, approximated psoas muscle regions 30A and 30B are obtained as shown in FIG. 4A (S24). At this time, in order to determine whether the areas of the approximate psoas muscle regions 30A, 30B are within a predetermined range, and whether the barycentric coordinates of the approximate psoas muscle regions 30A, 30B are within a predetermined range. Perform automatic check processing. Accordingly, whether or not the approximate psoas muscle regions 30A and 30B are correctly extracted, for example, in the binarized image shown in FIG. 3, the organ regions 31A and 31B adjacent to the approximate psoas region 30A and 30B are extracted. It can be checked whether or not it has been erroneously extracted as an approximate psoas muscle region.

この自動チェック処理については図12に基づいて後述する。   This automatic check process will be described later with reference to FIG.

(ステップS25)
ステップS24で求めた近似的大腰筋領域30A、30Bの情報をもとに高精度の大腰筋領域抽出処理を行なう(S25)。すなわち、近似的大腰筋領域30A、30Bは、大腰筋領域のうち対称中心線40を基準として左右対称に位置する画素点のみを抽出している。そのため、実際の大腰筋領域よりも小さく抽出している。そこで、対称中心線40を基準として非対称に位置する画素点も抽出して、大腰筋領域を構成する画素点を全て抽出する。
(Step S25)
Based on the information of the approximated psoas muscle regions 30A and 30B obtained in step S24, a high-precision psoas region extraction process is performed (S25). That is, the approximate psoas muscle regions 30A and 30B extract only pixel points located symmetrically with respect to the symmetry center line 40 in the psoas muscle region. Therefore, it is extracted smaller than the actual psoas muscle region. Therefore, pixel points located asymmetrically with respect to the symmetry center line 40 are also extracted, and all the pixel points constituting the psoas muscle region are extracted.

そのための一つの方法として、図4(b)のように、近似的大腰筋領域30A、30Bを領域拡張することによって非対称な画素を含む大腰筋領域を高精度に抽出する方法がある。より詳細には、ステップS23で抽出した二値化された近似的大腰筋領域30A、30Bの輪郭線の形状に沿って1ラインずつ拡張し(ライン41)、このライン41上の画素点のうち近似的大腰筋領域30A、30Bを抽出するために設定した閾値の条件を満たす画素点を抽出する。そして、ライン41の長さが極小となる位置で領域拡張処理を止める。   As one method for this purpose, as shown in FIG. 4B, there is a method of extracting the psoas muscle region including asymmetric pixels with high accuracy by expanding the approximate psoas region 30A, 30B. More specifically, one line is expanded along the contour shape of the binarized approximated psoas muscle regions 30A and 30B extracted in step S23 (line 41), and the pixel points on the line 41 are expanded. Among these, pixel points that satisfy the threshold conditions set for extracting the approximated psoas muscle regions 30A and 30B are extracted. Then, the region expansion process is stopped at a position where the length of the line 41 is minimized.

また、他の方法として、例えば図5のように、近似的大腰筋領域30A、30Bの情報をもとに、ステップS22で作成した二値化画像から大腰筋以外の領域を削除して目的とする大腰筋領域のみを残す方法がある。   As another method, for example, as shown in FIG. 5, based on the information of the approximate psoas muscle regions 30A and 30B, the region other than the psoas muscle is deleted from the binarized image created in step S22. There is a method of leaving only the desired psoas muscle region.

図5(a)では、ステップS24で算出した近似的大腰筋領域30A、30Bの輪郭線上の2点のうち最も距離が長い2点を求める。そしてその2点の座標を基に、二値化画像における大腰筋領域50A、50Bの傾き角度を求める。そして、その傾き角度をもち、かつ大腰筋領域50A、50Bの輪郭線上の2点を結ぶ線分D1を設定する。その線分D1を1ラインずつ大腰筋領域50A、50Bの外側にずらし、線分D1の長さが0となる位置を求める。そして、この線分D1の長さが0となる位置よりも大腰筋領域50A、50Bの外側であり、かつ大腰筋領域50A、50Bの傾き角度と同じ傾斜角度を有する所定領域を削除領域53として設定する。この削除領域53を削除することにより、大腰筋領域50A、50Bのみを抽出し、隣接する臓器領域51A、51Bから分離する。   In FIG. 5A, two points having the longest distance are obtained from the two points on the outline of the approximated psoas muscle regions 30A and 30B calculated in step S24. Based on the coordinates of the two points, the inclination angles of the psoas major regions 50A and 50B in the binarized image are obtained. And the line segment D1 which has the inclination angle and connects two points on the outline of the psoas major region 50A, 50B is set. The line segment D1 is shifted line by line to the outside of the psoas major regions 50A and 50B, and the position where the length of the line segment D1 becomes 0 is obtained. Then, a predetermined region that is outside the greater psoas region 50A, 50B than the position where the length of the line segment D1 becomes 0 and has the same tilt angle as that of the psoas region 50A, 50B is deleted. 53 is set. By deleting the deletion region 53, only the psoas major regions 50A and 50B are extracted and separated from the adjacent organ regions 51A and 51B.

図5(b)では、近似的大腰筋領域30A、30Bに基づいてステップS22で作成した二値化画像における大腰筋領域50A、50Bを特定する。そして、例えば、大腰筋領域50Aに隣接する他の臓器領域51Aの重心51Apを算出する。この重心51Apを中心とする円を設定し、円周上の2点p1、p2点で画素値が0の場合、円弧p1p2をゼロクリアすることにより、他の臓器領域51Aを大腰筋領域50Aから分離する。その後、ステップS24で抽出した近似的大腰筋領域30Aの中心点(重心点)を開始点とする領域拡張方法などにより、大腰筋領域50Aのみを残す。他の大腰筋領域50Bについても同様である。   In FIG. 5B, the psoas major regions 50A and 50B in the binarized image created in step S22 based on the approximate psoas major regions 30A and 30B are specified. Then, for example, the center of gravity 51Ap of another organ region 51A adjacent to the psoas major region 50A is calculated. When a circle centered on the center of gravity 51Ap is set, and the pixel value is 0 at two points p1 and p2 on the circumference, the arc p1p2 is cleared to zero so that the other organ region 51A is removed from the psoas muscle region 50A. To separate. Thereafter, only the psoas major region 50A is left by a region expansion method using the center point (center of gravity) of the approximate psoas major region 30A extracted in step S24 as a starting point. The same applies to the other psoas muscle region 50B.

上記図4(b)、図5(a)、又は図5(b)による近似的大腰筋領域の情報に基づく高精度の大腰筋領域の抽出処理が終了すると、図2に示す大腰筋抽出処理を終了する。   When the high-precision psoas muscle region extraction process based on the approximate psoas region information shown in FIG. 4 (b), FIG. 5 (a), or FIG. 5 (b) is finished, the large hips shown in FIG. The muscle extraction process ends.

次に図6に基づいて、上記ステップS21で行なう脊椎領域が抽出されているか否かの自動チェック処理について説明する。   Next, based on FIG. 6, the automatic check process for determining whether or not the spine region is extracted in step S21 will be described.

(ステップS61)
ステップS21で抽出した脊椎領域の面積を算出し、その面積が所定の範囲にあるか否かを判定する(S61)。所定の範囲にある場合にはステップS62へ、所定の範囲に無い場合にはステップS63へ進む。
(Step S61)
The area of the spine region extracted in step S21 is calculated, and it is determined whether or not the area is within a predetermined range (S61). If it is within the predetermined range, the process proceeds to step S62. If it is not within the predetermined range, the process proceeds to step S63.

(ステップS62)
ステップS21で抽出した脊椎領域の重心座標を算出し、その重心座標が所定の範囲にあるか否かを判定する(S62)。所定の範囲にある場合には、脊椎領域が正しく抽出できたと判定して、自動チェック処理を終了する。所定の範囲に無い場合にはステップS63へ進む。
(Step S62)
The barycentric coordinates of the spine region extracted in step S21 are calculated, and it is determined whether or not the barycentric coordinates are within a predetermined range (S62). If it is within the predetermined range, it is determined that the spine region has been correctly extracted, and the automatic check process is terminated. If it is not within the predetermined range, the process proceeds to step S63.

(ステップS63)
ステップS21では抽出できなかった脊椎領域の一部について脊椎抽出処理を行なう(S63)。この脊椎領域の一部について抽出するための第一の処理方法を図7、図8に基づいて説明する。図7は、脊椎が鮮明に写っておらず、しきい値処理では抽出できない場合に行う第一の脊椎分離処理方法の手順を示すフローチャートである。図8は、脊椎が鮮明に写っておらず、しきい値処理では抽出できない場合に行う第一の脊椎分離処理方法を示す模式図である。
(Step S63)
A spine extraction process is performed on a part of the spine region that could not be extracted in step S21 (S63). A first processing method for extracting a part of the spine region will be described with reference to FIGS. FIG. 7 is a flowchart showing the procedure of the first spine separation processing method performed when the spine is not clearly visible and cannot be extracted by threshold processing. FIG. 8 is a schematic diagram showing a first spine separation processing method performed when the spine is not clearly visible and cannot be extracted by threshold processing.

(ステップS71)
ステップS22と同様、原画像160に対して大腰筋領域を抽出するための閾値を設定して二値化処理を行なう(S71)。この結果、脊椎も骨と骨の間の場合はCT値が低く大腰筋のCT値に近いため、図8に示すように同時に抽出される。そのため、以下では、脊椎領域と大腰筋領域とを分離する処理を行う。なお、脊椎領域を含む矩形領域90を設定することにより、より処理速度を向上させることができる。
(Step S71)
Similar to step S22, a threshold value for extracting the psoas major region is set for the original image 160, and binarization processing is performed (S71). As a result, if the spine is between bones, the CT value is low and close to the CT value of the psoas muscle, so that the spines are extracted simultaneously as shown in FIG. Therefore, below, the process which isolate | separates a spine area | region and a psoas muscle area | region is performed. Note that the processing speed can be further improved by setting the rectangular region 90 including the spine region.

(ステップS72)
ステップS23と同様、背中側の三角状の脊椎領域83の一部(例えば重心)とへそ位置(へそ領域81の重心)とを結ぶ対称中心線Lを設定し、この対称中心線Lを基準として対称な画素だけを残す(S72)。一般に、大腰筋面積の測定はへそ領域81が写っているスライスを用いる習慣になっている。そのため、へそ領域81の重心を算出して、対称中心線Lを設定するために用いることができる。脊椎領域83とへそ位置81とを結ぶ直線の代わりに、体表輪郭の中心線(脊椎領域83の重心と体組織の重心とを結ぶ直線)を用いてもよい。
(Step S72)
Similar to step S23, a symmetric center line L that connects a part (for example, the center of gravity) of the triangular spine region 83 on the back side and the navel position (the center of gravity of the navel region 81) is set, and this symmetric center line L is used as a reference. Only symmetrical pixels are left (S72). In general, the measurement of the psoas major area is a habit of using a slice in which the navel region 81 is reflected. Therefore, the center of gravity of the navel region 81 can be calculated and used to set the symmetric center line L. Instead of the straight line connecting the spine region 83 and the navel position 81, the center line of the body surface contour (the straight line connecting the center of gravity of the spine region 83 and the center of gravity of the body tissue) may be used.

(ステップS73)
距離変換(エッジまでの最短距離をその点での濃度とする)で大腰筋領域と脊椎領域とからなる広領域の中心を求める(S73)。
(Step S73)
The center of a wide region composed of the psoas major region and the spine region is obtained by distance conversion (the shortest distance to the edge is the density at that point) (S73).

円形な脊椎領域82は、解剖学的にみると、背中側の三角状の脊椎領域83の一部(重心)とへそ位置(へそ領域81の重心)とを結ぶ直線(本実施の形態においてはステップS72で算出した対称中心線Lに一致する)上であって、背中側の三角状の脊椎領域83から一定割合の点(C1、C2…、Cnとする)に位置する。このC1、C2…、Cn点から広領域のエッジ(輪郭線上の画素点)までの最短距離を算出し、この最短距離をC1、C2…、Cn点における濃度(画素値)とする。そして、上記C1、C2…、Cn点全てについて最短のエッジまでの距離を濃度に変換する処理を行い、最も濃度が濃い点を広領域の中心C点とする。   From a anatomical point of view, the circular spine region 82 is a straight line (in this embodiment) that connects a part (center of gravity) of the triangular spine region 83 on the back side to the navel position (center of gravity of the navel region 81). It coincides with the symmetry center line L calculated in step S72) and is located at a certain percentage of points (referred to as C1, C2,..., Cn) from the triangular spine region 83 on the back side. The shortest distance from the points C1, C2,..., Cn to the edge of the wide area (pixel point on the contour line) is calculated, and this shortest distance is defined as the density (pixel value) at the points C1, C2,. Then, the process of converting the distance to the shortest edge into the density is performed on all the points C1, C2,...

(ステップS74)
広領域間の境界、すなわち円形の脊椎領域82と大腰筋領域50A、50Bとを切断する(S74)。
(Step S74)
The boundary between the wide regions, that is, the circular spine region 82 and the psoas muscle regions 50A and 50B are cut (S74).

ステップS73で求めた広領域の中心C点から同心円を拡張しながら描き、同心円上の任意の2点p1、p2の画素値が共に0であれば、円弧p1p2上の画素点の画素値に0を格納する。これにより、円形の脊椎領域82と大腰筋領域50A、50Bとを分離する。   If the concentric circle is drawn from the center C point of the wide area obtained in step S73 and drawn, and if the pixel values of any two points p1 and p2 on the concentric circle are both 0, the pixel value of the pixel point on the arc p1p2 is 0. Is stored. As a result, the circular spine region 82 and the psoas muscle regions 50A and 50B are separated.

(ステップS75)
円形の脊椎領域82を、大腰筋領域50A、50Bとの接触から防ぐため、削除する(S75)。なお、脊椎領域82を削除する代わりに、大腰筋領域50A、50Bに数値1を記録し、脊椎領域82に数値2を記録するなどすれば区別してもよい。そして、脊椎領域の一部についての抽出処理を終了する。その後、ステップS24へ進み近似的大腰筋領域を求め、更にステップS25へ進み高精度の大腰筋領域抽出を行う。
(Step S75)
The circular spine region 82 is deleted to prevent contact with the psoas muscle regions 50A and 50B (S75). Note that instead of deleting the spine region 82, the numerical value 1 may be recorded in the psoas major regions 50A and 50B, and the numerical value 2 may be recorded in the spine region 82. And the extraction process about a part of spine area | region is complete | finished. Thereafter, the process proceeds to step S24 to obtain an approximate psoas muscle region, and further proceeds to step S25 to perform high-accuracy psoas muscle region extraction.

ステップS21では抽出できなかった脊椎領域の一部を抽出するための第二の処理方法を図9乃至図13に基づいて説明する。以下、図9のステップ順に沿って説明する。図9は、脊椎が鮮明に写っておらず、しきい値処理では抽出できない場合に行う第二の脊椎分離処理方法の手順を示すフローチャートである。図10脊椎が鮮明に写っておらず、しきい値処理では抽出できない場合に行う第二の脊椎分離処理方法を示す模式図である。図11は、脊椎領域が正しく抽出されていない場合に、操作者に処理を選択させるための表示を示す画面表示例である。図12は、近似的大腰筋領域が正しく抽出されたかを自動チェックする手順を示すフローチャートである。図13は、大腰筋領域から不必要な突起を削除する方法を示す模式図である。   A second processing method for extracting a part of the spine region that could not be extracted in step S21 will be described with reference to FIGS. In the following, description will be given in the order of steps in FIG. FIG. 9 is a flowchart showing the procedure of the second spine separation processing method performed when the spine is not clearly visible and cannot be extracted by the threshold processing. 10 is a schematic diagram showing a second spine separation processing method performed when the spine is not clearly visible and cannot be extracted by threshold processing. FIG. 11 is a screen display example showing a display for allowing the operator to select a process when the spine region is not correctly extracted. FIG. 12 is a flowchart showing a procedure for automatically checking whether or not the approximate psoas muscle region is correctly extracted. FIG. 13 is a schematic diagram showing a method for deleting unnecessary protrusions from the psoas muscle region.

以下図9の各ステップ順に沿って説明する。   In the following, description will be given along the order of steps in FIG.

(ステップS91及びS92)
ステップS71及びS72と同様、原画像から大腰筋領域を抽出するために二値化し(S91)、脊椎領域83とへそ領域81とを結ぶ対称中心線Lに対称な画素のみを残す(S91乃至S92)。
(Steps S91 and S92)
As in steps S71 and S72, binarization is performed in order to extract the psoas muscle region from the original image (S91), and only the pixels that are symmetric with respect to the symmetric center line L connecting the spine region 83 and the navel region 81 are left (S91 through S91). S92).

(ステップS93)
大腰筋領域50A及び50Bの傾き角度と平行で、円形の脊椎領域82のエッジ上の2点を通る線分D2を設定し、その線分D2の長さを算出する。線分D2を大腰筋領域50A又は50Bに向かって1ラインずつ拡張し、その都度長さDを算出する。
(Step S93)
A line segment D2 passing through two points on the edge of the circular spine region 82 is set in parallel with the inclination angles of the psoas muscle regions 50A and 50B, and the length of the line segment D2 is calculated. The line segment D2 is expanded line by line toward the psoas major region 50A or 50B, and the length D is calculated each time.

(ステップS94)
ステップS93で求めた線分D2の長さが極小となる箇所で線分D2上の画素点に画素値0を格納することにより、広領域間すなわち円形の脊椎領域82と大腰筋領域50A又は50Bとを切断する(S94)。
(Step S94)
By storing the pixel value 0 at the pixel point on the line segment D2 at the position where the length of the line segment D2 obtained in step S93 is minimal, the wide spine region 82 and the psoas muscle region 50A or 50B is cut (S94).

(ステップS95)
ステップS75と同様、脊椎領域82を削除または大腰筋領域50A及び50Bと区別する処理を行なう(S95)。その後、脊椎抽出処理を終了し、ステップS64へ進む。
(Step S95)
Similar to step S75, the spine region 82 is deleted or distinguished from the psoas muscle regions 50A and 50B (S95). Thereafter, the spine extraction process is terminated, and the process proceeds to step S64.

(ステップS64)
ステップS63により脊椎領域が抽出できたか否かを判定する(S64)。
(Step S64)
It is determined whether or not the spine region has been extracted in step S63 (S64).

脊椎領域82が抽出できた場合には、自動チェック処理を終了する。脊椎領域93が抽出できなった場合には、ステップS65へ進む。   If the spine region 82 can be extracted, the automatic check process is terminated. If the spine region 93 cannot be extracted, the process proceeds to step S65.

(ステップS65)
マウス17で脊椎領域82をトレースして脊椎領域82を抽出する。又は代用する画像を選択する(S65)。付近の画像(隣のスライス画像)には、骨の隙間から外れて脊椎領域が鮮明に写っている場合が多い。そこで、両付近の画像を用いて、MIP(最大値投影)画像を作っても良い。上述の例では、ステップS61又はS62において脊椎領域が正しく抽出されていないと判定された場合に、脊椎領域の自動抽出処理(S63)を行い、それでも自動抽出ができない場合にマウス17を用いるトレース、または代用する医用画像の取り込み(S65)を行うように順番を予め決め、自動的に順次処理した。しかし、図11のように、モニタ15に代用する医用画像の取り込みを選択するためのメッセージ111、例えば「隣のスライスを使います」と、マウス17でトレースをすることを選択するためのメッセージ112、例えば「マウスでトレースします」と、脊椎領域の中心を指定するためのメッセージ113、例えば「脊椎中心を指示します」と、を表示して操作者に選択させてもよい。
(Step S65)
The spine region 82 is extracted by tracing the spine region 82 with the mouse 17. Alternatively, a substitute image is selected (S65). There are many cases where the spine region is clearly shown in the nearby image (adjacent slice image) outside the gap between the bones. Therefore, an MIP (maximum value projection) image may be created using images near both. In the above-described example, when it is determined in step S61 or S62 that the spine region has not been correctly extracted, the spine region automatic extraction process (S63) is performed. Alternatively, the order was determined in advance so as to capture a substitute medical image (S65), and the processing was automatically performed sequentially. However, as shown in FIG. 11, a message 111 for selecting capturing of a medical image to be substituted for the monitor 15, for example, “Use the adjacent slice” and a message 112 for selecting tracing with the mouse 17 are used. For example, a message 113 for designating the center of the spine region, for example, “indicates the center of the spine”, may be displayed and “operate with the mouse” may be displayed.

次にステップS24で行なう近似的大腰筋領域が正しく抽出できているか否かの自動チェック処理を図12に基づいて説明する。図12は、近似的大腰筋領域が正しく抽出されたかを自動チェックする手順を示すフローチャートである。以下、図12のステップ順に沿って説明する。   Next, an automatic check process for determining whether or not the approximate psoas muscle region is correctly extracted in step S24 will be described with reference to FIG. FIG. 12 is a flowchart showing a procedure for automatically checking whether or not the approximate psoas muscle region is correctly extracted. In the following, description will be given in the order of steps in FIG.

(ステップS1201)
ステップS24で抽出した左右の近似的大腰筋領域30A、30Bの面積は所定の範囲内にあるか否かを判定する(S1201)。所定の範囲にある場合には、ステップS1202へ、所定の範囲に無い場合にはステップS1203へ進む。
(Step S1201)
It is determined whether the areas of the left and right approximated psoas muscle regions 30A and 30B extracted in step S24 are within a predetermined range (S1201). If it is within the predetermined range, the process proceeds to step S1202, and if it is not within the predetermined range, the process proceeds to step S1203.

(ステップS1202)
左右各々の近似的大腰筋領域30A、30Bの面積の重心座標は、所定の範囲にあるか否かを判定する(S1202)。所定の範囲としては、例えば脊椎領域の重心座標からみた角度及び距離に基づいて設定してもよい。所定の範囲にある場合には、近似的大腰筋領域が正しく抽出されたとして自動チェック処理を終了する。所定の範囲に無い場合にはステップS1203へ進む。
(Step S1202)
It is determined whether or not the barycentric coordinates of the areas of the left and right approximate psoas muscle regions 30A and 30B are within a predetermined range (S1202). The predetermined range may be set based on, for example, an angle and a distance viewed from the barycentric coordinates of the spinal region. If it is within the predetermined range, it is determined that the approximate psoas muscle region has been correctly extracted, and the automatic check process is terminated. If it is not within the predetermined range, the process proceeds to step S1203.

(ステップS1203)
大腰筋領域が抽出できないため、操作者にマウス17でトレースを促すメッセージを表示する。そして、操作者が大腰筋領域をマウス17でトレースすることにより大腰筋領域を抽出する(S1203)。そして、近似的大腰筋領域の自動チェック処理を終了する。
(Step S1203)
Since the psoas major region cannot be extracted, a message prompting the operator to trace with the mouse 17 is displayed. Then, the operator extracts the psoas muscle region by tracing the psoas muscle region with the mouse 17 (S1203). Then, the automatic check process for the approximate psoas muscle region is terminated.

なお、上記実施の形態で抽出した大腰筋領域に不自然な突起などが残る場合は、図13に示すように大腰筋領域の輪郭線上に点列P1、P2、P3と点列Q1、Q2、Q3とを設定し、点列P1、P2、P3と点列Q1、Q2、Q3との間をスプライン補間して、補間した曲線で切断してもよい。これにより、大腰筋領域から不必要な突起を曲線状に切断処理することができる。   If unnatural protrusions or the like remain in the psoas muscle region extracted in the above embodiment, point sequences P1, P2, P3 and a point sequence Q1, on the outline of the psoas region as shown in FIG. Q2 and Q3 may be set, and spline interpolation may be performed between the point sequence P1, P2, and P3 and the point sequence Q1, Q2, and Q3, and the interpolated curve may be cut. Thereby, an unnecessary processus | protrusion can be cut | disconnected in a curvilinear form from the psoas major region.

大腰筋領域が抽出できたら、左右の大腰筋領域の面積をそれぞれ算出し、面積の差を計算する。そして、面積の差が所望する範囲外であれば、その旨を伝えるメッセージを表示し、操作者にマウス17を用いて大腰筋領域を手動入力させても良い。   Once the psoas muscle region is extracted, the areas of the left and right psoas muscle regions are calculated, and the difference in area is calculated. If the area difference is outside the desired range, a message to that effect may be displayed, and the operator may manually input the psoas muscle region using the mouse 17.

上記により、大腰筋領域が正常に抽出できると、大腰筋領域を指定して脂肪組織に沿ったCT値に基づいて閾値を設定して抽出処理を行うことにより、脂肪領域を抽出することができる。そして、抽出した脂肪領域及び大腰筋領域の面積をそれぞれ算出し、大腰筋領域の面積から脂肪領域の面積を減算処理することにより、大腰筋領域のうち筋肉領域のみの面積を算出することができる。この大腰筋領域のうち筋肉領域のみの面積が所定値以下である場合には、図14に示すように、リハビリを促すメッセージ141を表示させてもよい。更に、抽出した脂肪領域の面積142及び大腰筋面積143を表示させてもよい。   When the psoas muscle region can be normally extracted as described above, the fat region is extracted by specifying the psoas muscle region and setting the threshold based on the CT value along the adipose tissue. Can do. Then, the areas of the extracted fat region and psoas muscle region are respectively calculated, and the area of the psoas muscle region is subtracted from the area of the psoas muscle region, thereby calculating the area of only the muscle region in the psoas muscle region. be able to. When the area of only the muscle region of the psoas muscle region is less than or equal to a predetermined value, a message 141 that prompts rehabilitation may be displayed as shown in FIG. Furthermore, the area 142 and the psoas major area 143 of the extracted fat region may be displayed.

また、被検体の大腰筋領域を体軸方向に沿って複数枚撮影して得た各断層像について、上記実施の形態に係る大腰筋領域の抽出処理及び大腰筋面積の算出処理を行い、その面積を体軸方向に積算することによって大腰筋領域の体積を算出してもよい。   Further, for each tomographic image obtained by imaging a plurality of large psoas muscle regions of the subject along the body axis direction, the large psoas muscle region extraction processing and large psoas muscle area calculation processing according to the above embodiment are performed. The volume of the psoas muscle region may be calculated by performing the integration and integrating the areas in the body axis direction.

医用画像表示システムの構成を示すハードウェア構成図。The hardware block diagram which shows the structure of a medical image display system. 大腰筋領域の抽出手順を示すフローチャート。The flowchart which shows the extraction procedure of a psoas muscle area. ステップS23の処理結果画像であって、二値化画像に対称中心線を設定し、対称性を満たした画素のみを残す処理により残った領域を示す模式図。The schematic diagram which shows the area | region which remained after the process which is a process result image of step S23, sets a symmetrical centerline to a binarized image, and leaves only the pixel which satisfy | filled symmetry. 図4(a)はステップS24の処理結果画像であって、脊椎の左右に隣接領域として、近似的大腰筋領域を抽出した状態を示す模式図、図4(b)は図4(a)の近似的大腰筋領域に領域拡張法を適用して大腰筋領域を求める方法を示す模式図。FIG. 4A is a processing result image of step S24, and is a schematic diagram showing a state where an approximated psoas muscle region is extracted as adjacent regions on the left and right sides of the spine, and FIG. 4B is a diagram showing FIG. The schematic diagram which shows the method of calculating | requiring a psoas muscle region by applying the area expansion method to the approximate psoas muscle region. 図5(a)は、大腰筋領域と脊椎領域とを分離するための第一の処理方法をしめす模式図、図5(b)は大腰筋領域と脊椎領域とを分離するための第二の処理方法をしめす模式図。FIG. 5A is a schematic diagram showing a first processing method for separating the psoas muscle region and the spine region, and FIG. 5B is a diagram for separating the psoas muscle region and the spine region. The schematic diagram which shows the 2nd processing method. ステップS22で行なう脊椎領域が正しく抽出されたかを自動チェックする処理の手順を示すフローチャート。The flowchart which shows the procedure of the process which automatically checks whether the spine area | region performed correctly by step S22 was extracted. 脊椎が鮮明に写っておらず、しきい値処理では抽出できない場合に行う第一の脊椎分離処理方法の手順を示すフローチャート。The flowchart which shows the procedure of the 1st spine isolation | separation processing method performed when the spine is not clear and cannot be extracted by threshold processing. 脊椎が鮮明に写っておらず、しきい値処理では抽出できない場合に行う第一の脊椎分離処理方法を示す模式図。The schematic diagram which shows the 1st spine isolation | separation processing method performed when the spine is not reflected clearly and cannot be extracted by threshold processing. 脊椎が鮮明に写っておらず、しきい値処理では抽出できない場合に行う第二の脊椎分離処理方法の手順を示すフローチャート。The flowchart which shows the procedure of the 2nd spine isolation | separation processing method performed when the spine is not reflected clearly and cannot be extracted by threshold processing. 脊椎が鮮明に写っておらず、しきい値処理では抽出できない場合に行う第二の脊椎分離処理方法を示す模式図。The schematic diagram which shows the 2nd spine isolation | separation processing method performed when the spine is not reflected clearly and cannot be extracted by threshold processing. 脊椎領域が正しく抽出されていない場合に、操作者に処理を選択させるための表示を示す画面表示例。The example of a screen display which shows the display for making an operator select a process when the spine area | region is not extracted correctly. 近似的大腰筋領域が正しく抽出されたかを自動チェックする手順を示すフローチャート。The flowchart which shows the procedure which automatically checks whether the approximated psoas muscle region was correctly extracted. 大腰筋領域から不必要な突起を削除する方法を示す模式図。The schematic diagram which shows the method of deleting an unnecessary processus | protrusion from a psoas muscle area | region. 大腰筋領域から脂肪領域を抽出してメッセージを表示した画面表示例を示す模式図。The schematic diagram which shows the example of a screen display which extracted the fat area | region from the psoas muscle area | region, and displayed the message. 脊椎領域が鮮明に写った原画像例。Example of original image with clear spine area. 脊椎領域が不鮮明に写った原画像例。An example of an original image in which the spine region is blurred. 被検体の断層像における大腰筋領域の位置を示す模式図。The schematic diagram which shows the position of the psoas major region in the tomogram of a subject. 先行技術による大腰筋領域処理を説明する模式図。The schematic diagram explaining the psoas muscle region process by a prior art.

符号の説明Explanation of symbols

1…医用画像表示システム、2…X線CT装置、3…MR装置、4…画像データベース、5…LAN、10…医用画像表示装置、11…CPU、12…主メモリ、13…磁気ディスク、14…表示メモリ、15…モニタ、16…キーボード、17…マウス、18…コントローラ、19…共通バス DESCRIPTION OF SYMBOLS 1 ... Medical image display system, 2 ... X-ray CT apparatus, 3 ... MR apparatus, 4 ... Image database, 5 ... LAN, 10 ... Medical image display apparatus, 11 ... CPU, 12 ... Main memory, 13 ... Magnetic disk, 14 ... display memory, 15 ... monitor, 16 ... keyboard, 17 ... mouse, 18 ... controller, 19 ... common bus

Claims (4)

被検体のへそ位置で撮影した断層像であって、へそ領域、大腰筋を含む軟部組織、及び脊椎領域が撮影された医用画像を取得する画像取得手段と、
前記取得された医用画像に所定の閾値を設定して前記大腰筋を含む軟部組織を抽出した抽出画像を生成する手段と、
前記抽出画像を所望に分割する対称中心線を設定する手段と、
前記抽出画像において、前記対称中心線を基準に対称となる位置に存在する画素点のみを抽出することによって近似的大腰筋領域を抽出する第一抽出手段と、
前記近似的大腰筋領域に基づいて、前記抽出画像から前記対称中心線を基準として非対称となる位置に存在する画素点を含む全大腰筋領域を抽出する第二抽出手段と、
前記第二抽出手段によって抽出された前記全大腰筋領域を表示する表示手段と、
を備えることを特徴とする医用画像表示装置。
An image acquisition means for acquiring a medical image in which a tomographic image is taken at the navel position of a subject and the navel region, soft tissue including the psoas major muscle, and the spinal region are imaged;
Means for generating an extracted image obtained by extracting a soft tissue including the psoas muscle by setting a predetermined threshold value in the acquired medical image;
Means for setting a symmetric center line for dividing the extracted image as desired;
In the extracted image, a first extracting means for extracting an approximated psoas muscle region by extracting only pixel points existing at positions symmetrical with respect to the symmetry center line;
Based on the approximate psoas muscle region, a second extraction means for extracting all psoas muscle regions including pixel points existing at positions that are asymmetric with respect to the symmetry center line from the extracted image;
Display means for displaying the entire psoas muscle region extracted by the second extraction means;
A medical image display device comprising:
前記第二抽出手段は、前記近似的大腰筋領域の輪郭線の形状に沿って1ラインずつ拡張し、前記ライン上の画素点が前記所定の閾値を満たす場合には前記画素点を大腰筋領域として抽出する、
ことを特徴とする請求項1に記載の医用画像表示装置。
The second extraction means expands one line at a time along the shape of the outline of the approximate psoas muscle region, and if the pixel point on the line satisfies the predetermined threshold, the pixel point is Extract as a muscle region,
The medical image display apparatus according to claim 1.
前記表示手段に表示された前記抽出画像のうち所定の領域を領域指定するための位置座標入力手段を更に備える、
ことを特徴とする請求項1又は2の一つに記載の医用画像表示装置。
A position coordinate input unit for designating a predetermined region of the extracted image displayed on the display unit;
The medical image display device according to claim 1, wherein the medical image display device is a medical image display device.
前記第二抽出手段によって抽出された前記対称中心線によって分割される全大腰筋領域の面積を算出して比較し、面積の差が所望の範囲にあるか否かを判定する面積差判定手段と、
前記面積差判定手段が、前記面積の差が所望の範囲に無いと判定した場合に前記面積の差が所望の範囲に無い旨を通知する通知手段と、を更に備え、
前記通知がされた場合に、前記位置座標入力手段により前記抽出画像に含まれる大腰筋領域を指定して抽出する、
ことを特徴とする請求項3に記載の医用画像表示装置。
Area difference determining means for calculating and comparing areas of all psoas major areas divided by the symmetrical centerline extracted by the second extracting means and determining whether or not the difference in area is within a desired range When,
A notification means for notifying that the difference in area is not in the desired range when the area difference determination means determines that the difference in area is not in the desired range;
When the notification is given, the position coordinate input means specifies and extracts the psoas muscle region included in the extracted image,
The medical image display apparatus according to claim 3.
.
JP2004340841A 2004-11-25 2004-11-25 Medical image display device Active JP4514039B2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2004340841A JP4514039B2 (en) 2004-11-25 2004-11-25 Medical image display device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2004340841A JP4514039B2 (en) 2004-11-25 2004-11-25 Medical image display device

Publications (2)

Publication Number Publication Date
JP2006149446A true JP2006149446A (en) 2006-06-15
JP4514039B2 JP4514039B2 (en) 2010-07-28

Family

ID=36628431

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2004340841A Active JP4514039B2 (en) 2004-11-25 2004-11-25 Medical image display device

Country Status (1)

Country Link
JP (1) JP4514039B2 (en)

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2008125687A (en) * 2006-11-20 2008-06-05 Hitachi Medical Corp Medical image diagnosing support apparatus, its method, and program
JP2009095644A (en) * 2007-04-12 2009-05-07 Fujifilm Corp Apparatus, method, and program for determining image recognition results
JP2009153750A (en) * 2007-12-27 2009-07-16 Techmatrix Corp Medical image display apparatus and medical image display method
JP2009247534A (en) * 2008-04-04 2009-10-29 Ge Medical Systems Global Technology Co Llc Image processing apparatus, magnetic resonance imaging apparatus, and image processing method
JP2010246662A (en) * 2009-04-14 2010-11-04 Hitachi Medical Corp Image processor
DE112009001015T5 (en) 2008-04-30 2011-02-24 J. Morita Manufacturing Corporation Medical X-ray CT imaging device
DE112009000999T5 (en) 2008-05-01 2011-05-19 J.Morita Manufacturing Corp., KYOTO-SHI Medical X-ray CT imaging device, medical X-ray CT image display device and medical X-ray CT display method
JP2012521590A (en) * 2009-03-26 2012-09-13 コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ Perfusion image
JP2013118914A (en) * 2011-12-07 2013-06-17 Hitachi Medical Corp Medical image diagnosis support device and method of operating the same
US8497227B2 (en) 2008-07-28 2013-07-30 Nicca Chemical Co., Ltd. Diphenylsulfone bridged compound, color forming substance for thermal recording and thermal recording material

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100865648B1 (en) 2004-03-11 2008-10-29 가부시키가이샤 에이피아이 코포레이션 Developer mixture for thermal recording materials and thermal recording materials
CN103108755B (en) * 2010-09-17 2015-08-05 山本化成株式会社 Temperature-sensitive color forming composition and the thermal recording medium using said composition to be formed
KR101936506B1 (en) * 2017-06-01 2019-01-09 서울대학교병원 Method for calculating amount of muscles from CT images automatically

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2001029343A (en) * 1999-07-19 2001-02-06 Yuji Matsuzawa Body fat measuring instrument
JP2004173748A (en) * 2002-11-25 2004-06-24 Hitachi Medical Corp Generation method for similar medical image database, searching method for similar medical image database and similar medical image and device used for the same
JP2004535874A (en) * 2001-07-18 2004-12-02 コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ Magnetic resonance angiography and apparatus therefor

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2001029343A (en) * 1999-07-19 2001-02-06 Yuji Matsuzawa Body fat measuring instrument
JP2004535874A (en) * 2001-07-18 2004-12-02 コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ Magnetic resonance angiography and apparatus therefor
JP2004173748A (en) * 2002-11-25 2004-06-24 Hitachi Medical Corp Generation method for similar medical image database, searching method for similar medical image database and similar medical image and device used for the same

Cited By (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2008125687A (en) * 2006-11-20 2008-06-05 Hitachi Medical Corp Medical image diagnosing support apparatus, its method, and program
JP2009095644A (en) * 2007-04-12 2009-05-07 Fujifilm Corp Apparatus, method, and program for determining image recognition results
JP2009153750A (en) * 2007-12-27 2009-07-16 Techmatrix Corp Medical image display apparatus and medical image display method
JP2009247534A (en) * 2008-04-04 2009-10-29 Ge Medical Systems Global Technology Co Llc Image processing apparatus, magnetic resonance imaging apparatus, and image processing method
US8401267B2 (en) 2008-04-30 2013-03-19 J. Morita Manufacturing Corporation Medical X-ray CT imaging apparatus
DE112009001015B4 (en) 2008-04-30 2024-05-23 J. Morita Manufacturing Corporation Medical X-ray CT imaging device
DE112009001015T5 (en) 2008-04-30 2011-02-24 J. Morita Manufacturing Corporation Medical X-ray CT imaging device
DE112009000999T5 (en) 2008-05-01 2011-05-19 J.Morita Manufacturing Corp., KYOTO-SHI Medical X-ray CT imaging device, medical X-ray CT image display device and medical X-ray CT display method
US8538110B2 (en) 2008-05-01 2013-09-17 J. Morita Manufacturing Corporation Medical X-ray CT imaging apparatus, medical X-ray CT image display device, and medical X-ray CT image display method
DE112009000999B4 (en) 2008-05-01 2024-05-23 J.Morita Manufacturing Corp. Medical X-ray CT imaging apparatus, medical X-ray CT image display device and medical X-ray CT display method
US8497227B2 (en) 2008-07-28 2013-07-30 Nicca Chemical Co., Ltd. Diphenylsulfone bridged compound, color forming substance for thermal recording and thermal recording material
JP2012521590A (en) * 2009-03-26 2012-09-13 コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ Perfusion image
US8965080B2 (en) 2009-03-26 2015-02-24 Koninklijke Philips N.V. Perfusion imaging
JP2010246662A (en) * 2009-04-14 2010-11-04 Hitachi Medical Corp Image processor
JP2013118914A (en) * 2011-12-07 2013-06-17 Hitachi Medical Corp Medical image diagnosis support device and method of operating the same

Also Published As

Publication number Publication date
JP4514039B2 (en) 2010-07-28

Similar Documents

Publication Publication Date Title
US6608916B1 (en) Automatic detection of spine axis and spine boundary in digital radiography
JP5643304B2 (en) Computer-aided lung nodule detection system and method and chest image segmentation system and method in chest tomosynthesis imaging
JP4514039B2 (en) Medical image display device
CN107194909B (en) Medical image processing apparatus and medical image processing method
JP2011160882A (en) Medical image display apparatus, medical image display method, and program
JPWO2014065317A1 (en) Image processing apparatus and spinal canal evaluation method
JP2005169118A (en) Method for segmenting tomographic image data and image processing system
JP2011224128A (en) Spine disease diagnosis support device and spine disease diagnosis support program
JP5194138B2 (en) Image diagnosis support apparatus, operation method thereof, and image diagnosis support program
JP6407718B2 (en) Image processing apparatus and image processing method
JP2004057275A (en) Image diagnostic device
US20070133849A1 (en) Method and apparatus for visualisation of a tubular structure
EP3047455B1 (en) Method and system for spine position detection
JP2014188378A (en) Medical image processing apparatus and medical image processing method
JP2007152105A (en) Method and apparatus for calculating volume of cerebral hemorrhage site
JP4849449B2 (en) Medical image diagnosis support device
JP2014221201A (en) Imaging controller, medical image diagnostic apparatus and imaging control method
JP5536644B2 (en) Medical image processing apparatus, medical image processing method, and medical image processing program
JP6687395B2 (en) Medical image processing apparatus, medical image processing method, and medical imaging apparatus
JP2007105264A (en) Medical picture judgment apparatus, medical picture judgment method, and program thereof
JP7382059B2 (en) Image processing device, image processing method, and program
JP4738236B2 (en) Image display device
JP6085435B2 (en) Image processing apparatus and region of interest setting method
JP6200618B1 (en) Medical image diagnosis support system and apparatus, and program
KR100921722B1 (en) Apparatus and method for evaluating artificial intervertebral disc

Legal Events

Date Code Title Description
A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20071009

RD02 Notification of acceptance of power of attorney

Free format text: JAPANESE INTERMEDIATE CODE: A7422

Effective date: 20090717

RD04 Notification of resignation of power of attorney

Free format text: JAPANESE INTERMEDIATE CODE: A7424

Effective date: 20090721

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20100408

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20100506

A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20100506

R150 Certificate of patent or registration of utility model

Ref document number: 4514039

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

Free format text: JAPANESE INTERMEDIATE CODE: R150

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20130521

Year of fee payment: 3

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20130521

Year of fee payment: 3

S111 Request for change of ownership or part of ownership

Free format text: JAPANESE INTERMEDIATE CODE: R313111

S533 Written request for registration of change of name

Free format text: JAPANESE INTERMEDIATE CODE: R313533

R350 Written notification of registration of transfer

Free format text: JAPANESE INTERMEDIATE CODE: R350

S111 Request for change of ownership or part of ownership

Free format text: JAPANESE INTERMEDIATE CODE: R313111

R350 Written notification of registration of transfer

Free format text: JAPANESE INTERMEDIATE CODE: R350

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

S111 Request for change of ownership or part of ownership

Free format text: JAPANESE INTERMEDIATE CODE: R313111

R350 Written notification of registration of transfer

Free format text: JAPANESE INTERMEDIATE CODE: R350