JP5155622B2 - Method for extracting specific region of medical image and medical image processing apparatus - Google Patents

Method for extracting specific region of medical image and medical image processing apparatus Download PDF

Info

Publication number
JP5155622B2
JP5155622B2 JP2007218095A JP2007218095A JP5155622B2 JP 5155622 B2 JP5155622 B2 JP 5155622B2 JP 2007218095 A JP2007218095 A JP 2007218095A JP 2007218095 A JP2007218095 A JP 2007218095A JP 5155622 B2 JP5155622 B2 JP 5155622B2
Authority
JP
Japan
Prior art keywords
value
region
area
pixel
medical image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
JP2007218095A
Other languages
Japanese (ja)
Other versions
JP2009050356A (en
Inventor
良洋 後藤
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hitachi Healthcare Manufacturing Ltd
Original Assignee
Hitachi Medical Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hitachi Medical Corp filed Critical Hitachi Medical Corp
Priority to JP2007218095A priority Critical patent/JP5155622B2/en
Publication of JP2009050356A publication Critical patent/JP2009050356A/en
Application granted granted Critical
Publication of JP5155622B2 publication Critical patent/JP5155622B2/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Description

本発明は、コンピュータを利用しての画像上の特定領域、例えば医用画像の特定臓器の抽出方法に関する。   The present invention relates to a method for extracting a specific region on an image, for example, a specific organ of a medical image, using a computer.

従来の特定臓器抽出方法には、特許文献1がある。
特開2005−296479公報
There is Patent Document 1 as a conventional specific organ extraction method.
JP 2005-296479 A

特許文献1は、画素単位ではなく、ある広がりを持った領域単位に臓器抽出を行う。ここで、ある広がりとは、予め設定した円(他には球、円錐など)図形(これをセンス図形と呼ぶ)で定まるセンス領域を指す。例えば、画面上の特定臓器と思われる画像の一点(例えば臓器の中心近傍の座標)を指定し、この一点を中心点として半径Rの円図形を設定する。円図形内の画素群の属性値Viを求め、予め定めた抽出判定値である基準属性値Vthと比較する。属性値とは、画素濃度(画素値)の平均値とか標準偏差とかであり、基準属性値とは、特定臓器内であるか否かの基準閾値である。この基準属性値を満足(Vi<Vthとか逆にVi>VthとかVth1<V<Vth2とか。ここでVth、Vth1、Vth2は閾値である。)すれば、その円図形内の画素群は特定臓器を示す領域と判定する。特定臓器を示す領域と判定すると、その円図形内のすべての画素群をその特定臓器内の画素と認定抽出する。またその円図形よりも若干小さい円図形を設定し、この設定した小さい円図形内の画素群を特定臓器の画素群に仕分け(抽出)する。若干小さい円図形の設定理由は、本来の円図形そのものでは余りに粗く、それよりも小さい円を設定することで、確実に臓器内画素群として選択できるようにしたことによる。
以上は、中心点からその半径Rが特定臓器か否かのチェック法であり、この円の中心点を移動させ、その各移動点毎に同一の円図形を設定して同様の臓器内か否かのチェックを行う。
In Patent Document 1, organ extraction is performed not on a pixel basis but on an area unit having a certain spread. Here, a certain spread refers to a sense area determined by a preset circle (others, such as a sphere, a cone, etc.) figure (this is called a sense figure). For example, a point of an image that seems to be a specific organ on the screen (for example, coordinates near the center of the organ) is designated, and a circular figure with a radius R is set with this point as the center point. An attribute value Vi of a pixel group in the circular figure is obtained and compared with a reference attribute value Vth that is a predetermined extraction determination value. The attribute value is an average value or standard deviation of pixel density (pixel value), and the reference attribute value is a reference threshold value indicating whether or not the pixel is in a specific organ. If this reference attribute value is satisfied (Vi <Vth or conversely Vi> Vth or Vth1 <V <Vth2, where Vth, Vth1, and Vth2 are threshold values), the pixel group in the circle is a specific organ. It is determined that the area indicates. If it is determined that the region indicates a specific organ, all the pixel groups in the circular figure are recognized and extracted as pixels in the specific organ. Further, a circular figure slightly smaller than the circular figure is set, and the pixel group in the set small circular figure is sorted (extracted) into the pixel group of the specific organ. The reason for setting a slightly smaller circular figure is that the original circular figure itself is too coarse, and by setting a smaller circle, it can be surely selected as an intra-organ pixel group.
The above is a method for checking whether or not the radius R is a specific organ from the center point. The center point of this circle is moved, and the same circular figure is set for each movement point to determine whether or not the same organ is in the same organ. Check that.

中心点の移動は、抽出した特定領域としての既抽出の円図形の領域を基準とする。例えば、円図形の円周上の一点に、中心点を設定し、各中心点の円図形をもとに、上述のやり方で特定臓器抽出を行う。こうして円周上に次々に中心点を設定し臓器抽出を行う。かくして、最初の中心点をもとに、最初の特定臓器の抽出がなされると、この抽出した臓器を基準にしてその周囲の領域に検索領域が拡張される。次々にこの手法がとられて、臓器領域は拡張的に抽出されてゆく。特定臓器でない領域にぶつかれば、基準属性値を満足しないことになり、拡張は停止する。   The movement of the center point is based on the area of the extracted circular figure as the extracted specific area. For example, a central point is set at one point on the circumference of a circular figure, and a specific organ is extracted in the above-described manner based on the circular figure at each central point. In this way, organ points are extracted by setting center points one after another on the circumference. Thus, when the first specific organ is extracted based on the first center point, the search area is expanded to the surrounding area based on the extracted organ. This technique is taken one after another, and organ regions are extracted in an expanded manner. If a region that is not a specific organ is hit, the reference attribute value is not satisfied, and the expansion stops.

円図形は、半径Rの他に、2つの半径R1、R2を与えておき、R1<R<R2なる円図形とする例もある。   In addition to the radius R, there are also examples in which two radii R1 and R2 are given and the circle figure is R1 <R <R2.

特許文献1は、円図形内の属性値を求めて、基準属性値との間での比較を行う。然るに特定臓器領域はある大きさを持ち、属性値の算出源とする画素濃度はその領域の中で種々ばらつきがあり、上記の抽出法ではそうした画素濃度のばらつきにより、臓器内の画素群を臓器外の画素群としたり(いわゆる拡張漏れ)、臓器外の画素群を臓器内の画素群としたり(いわゆる拡張しすぎ)することが発生しうる。   Patent Document 1 obtains an attribute value in a circular figure and compares it with a reference attribute value. However, the specific organ region has a certain size, and the pixel density used as the attribute value calculation source varies in the region. In the extraction method described above, the pixel group in the organ is changed to the organ due to the variation in the pixel concentration. It may occur that the pixel group is outside (so-called expansion leakage), or the pixel group outside the organ is made a pixel group inside the organ (so-called overexpansion).

抽出すべき臓器は、画素濃度に種々ばらつきがあっても、ばらつきの仕方は、近接する画素濃度から比較的連続性が高いという特徴がある。   The organ to be extracted has a feature that even if there are various variations in pixel density, the variation method has relatively high continuity from adjacent pixel densities.

そこで、本発明の目的は、近くの画素濃度を用いることで拡張漏れや拡張しすぎのない精度の高い臓器抽出を可能とする抽出方法を提供するものである。   Therefore, an object of the present invention is to provide an extraction method that enables highly accurate organ extraction that does not cause expansion omission or overexpansion by using nearby pixel densities.

本発明は、コンピュータを用いて、医用画像の中の既抽出領域をその周囲に拡張する場合に、抽出判定値を設定し、既抽出領域の境界付近に所定図形を設定し、所定図形の周辺又は内部画素群を既抽出領域に属するものと未抽出領域に属するものとに分割し、既抽出領域に属するものとして分けられた画素群の画素属性値と、未抽出領域に属するものとして分けられた画素群の画素属性値と、の差分である差分画素属性値を求め、差分画素属性値と抽出判定値との比較に基づき、未抽出領域に属するものとして分けられた画素群を既抽出領域に追加する拡張を行うことを特徴とする。
好ましくは、前記所定図形の移動経路として設定された直線状の経路上での該所定図形の移動による、上記分割から拡張までの試行に基づいて抽出判定値が設定される。
The present invention sets an extraction judgment value when a computer is used to extend an already extracted area in a medical image to the periphery thereof, sets a predetermined figure near the boundary of the already extracted area, Or, the internal pixel group is divided into those belonging to the already extracted region and those not belonging to the unextracted region, and the pixel attribute values of the pixel group divided as belonging to the already extracted region and those belonging to the unextracted region are divided. A difference pixel attribute value that is a difference between the pixel attribute value of the selected pixel group and a pixel group that has been classified as belonging to the unextracted area based on a comparison between the difference pixel attribute value and the extraction determination value. It is characterized by performing an extension to be added.
Preferably, according to the movement of the predetermined shape on said predetermined graphic path straight set as the moving path of the extraction decision value based on the attempt to extend from the division is set.

更に本発明は、抽出判定値を決定する抽出判定値決定方法において、
仮抽出判定値を設定するステップと、
抽出判定値決定用の医用画像の中に前記と同一のセンス図形の、試行移動範囲を、設定するステップと、
この試行移動範囲の各位置におけるセンス図形について既抽出領域に属する画素群とそれぞれの画素属性値との差分画素属性値を求め、この差分画素属性値と前記仮抽出判定値との比較を行って差分画素属性値が仮抽出判定値を満足するか否かの判定を行い、満足すれば試行移動範囲の中の次の位置にセンス図形を移動させ、満足しなければその位置で移動停止をさせるステップと、
上記移動により、抽出判定値用の医用画像の抽出すべき特定領域の境界にてセンス図形が停止したか否かを監視し、その境界にて停止すれば上記仮抽出判定値を、本来の抽出判定値として決定出力し、その境界にて停止せずにその内部又は外部で停止であれば上記仮抽出判定値は誤りのある値として出力するステップと、
を備える特定領域抽出法における抽出判定値決定方法を開示する。
Furthermore, the present invention provides an extraction determination value determination method for determining an extraction determination value.
Setting a temporary extraction judgment value;
Setting a trial movement range of the same sense figure in the medical image for determining the extraction determination value;
A difference pixel attribute value between a pixel group belonging to the already extracted region and each pixel attribute value is obtained for the sense figure at each position in the trial movement range, and the difference pixel attribute value is compared with the provisional extraction determination value. It is determined whether or not the difference pixel attribute value satisfies the provisional extraction determination value. If satisfied, the sense figure is moved to the next position in the trial movement range, and if not satisfied, the movement is stopped at that position. Steps,
By the above movement, it is monitored whether or not the sense figure is stopped at the boundary of the specific region to be extracted of the medical image for the extraction determination value, and if the stop is stopped at the boundary, the temporary extraction determination value is A decision value is output as a decision value, and the temporary extraction decision value is outputted as an erroneous value if it is stopped inside or outside without stopping at the boundary; and
An extraction determination value determination method in a specific region extraction method comprising:

更に本発明は、コンピュータを用いて、医用画像の中の既に抽出された既抽出領域をその周囲に拡張するか否かの判定を、複数画素群サイズのセンス図形を用いて、抽出判定値と比較して行う特定領域抽出法における抽出判定値決定方法において、
抽出判定値決定用の医用画像の中に前記と同一の複数画素群サイズのセンス図形の試行移動範囲を設定するステップと、
この試行移動範囲の中の各位置におけるセンス図形について画素属性値を求めるステップと、
この求めた画素属性値を抽出判定値決定用の医用画像に重ねて、移動範囲に沿ってトレンド表示させるステップと、
この表示した移動範囲に沿う画素属性値のトレンド内容から特定領域抽出用の抽出判定値を決定入力するステップと、
を備える特定領域抽出法における抽出判定値決定方法を開示する。
Furthermore, the present invention uses a computer to determine whether or not to expand an already extracted extracted area in a medical image to the surrounding area, using a sense graphic having a plurality of pixel group sizes as an extraction determination value. In the extraction determination value determination method in the specific region extraction method to be compared,
Setting a trial movement range of a sense figure having the same multiple pixel group size as described above in a medical image for determining an extraction determination value;
Obtaining pixel attribute values for sense figures at each position within the trial movement range;
The obtained pixel attribute value is superimposed on the medical image for determining the extraction determination value, and a trend is displayed along the movement range.
Determining and inputting an extraction determination value for extracting a specific region from the trend content of the pixel attribute value along the displayed movement range;
An extraction determination value determination method in a specific region extraction method comprising:

本発明によれば、近接する既抽出領域の画素値と未抽出領域の画素値との差分により、未抽出領域が臓器領域に属するか否かを精度よく判別でき、センス図形による特定領域の拡張抽出が可能となる。   According to the present invention, it is possible to accurately determine whether or not an unextracted region belongs to an organ region based on a difference between a pixel value of an adjacent already extracted region and a pixel value of an unextracted region. Extraction is possible.

図2は、本発明の臓器領域抽出法を実現するシステム図の一例を示す。このシステムは、CPU1、主メモリ2、磁気ディスク3、表示メモリ4、CRT(液晶表示装置等を含む)5、コントローラ6、マウス7、キーボード8、及びそれらを結ぶ共通バス9、並びにCT装置11、LAN10、より成る。機器1〜8及びバス9とは、いわゆるコンピュータシステムを構成し、CPU1が主メモリ2や磁気ディスク3のプログラムやデータを用い手臓器領域の抽出を行う。それらの支援のための手段が、表示メモリ4を含む5〜8である。表示メモリ4は、CRT5に表示するためのデータを一時格納し、CRT5への表示を行う。マウス7は、CRT5上の画面の指示であり、コントローラ6を介してバス9につながる。キーボード8は、各種の入力設定やデータ入力、操作指示を行う。   FIG. 2 shows an example of a system diagram for realizing the organ region extraction method of the present invention. This system includes a CPU 1, a main memory 2, a magnetic disk 3, a display memory 4, a CRT (including a liquid crystal display device) 5, a controller 6, a mouse 7, a keyboard 8, and a common bus 9 connecting them, and a CT device 11. , LAN10. The devices 1 to 8 and the bus 9 constitute a so-called computer system, and the CPU 1 extracts a hand organ region using programs and data in the main memory 2 and the magnetic disk 3. The means for supporting them is 5 to 8 including the display memory 4. The display memory 4 temporarily stores data to be displayed on the CRT 5 and performs display on the CRT 5. The mouse 7 is an instruction on the screen on the CRT 5 and is connected to the bus 9 via the controller 6. The keyboard 8 performs various input settings, data input, and operation instructions.

CT装置11は、被検体からの透影データを取得し、CT断層画像データを得る。LAN10は、共通バス9につながり、CT装置11と共通バス9を介してコンピュータシステムとの間で相互通信を行う。   The CT apparatus 11 acquires the transmission data from the subject and obtains CT tomographic image data. The LAN 10 is connected to a common bus 9 and performs mutual communication between the CT apparatus 11 and the computer system via the common bus 9.

CT装置11は、CT断層画像を得るとしたが、透影データを取得するまでの機能とし、共通バス9につながるコンピュータシステムがCT断層画像を得る画像処理機能を持つ処理配分例もありうる。この場合、LAN10は、透影データを伝送することになる。   Although the CT apparatus 11 obtains a CT tomographic image, there may be a processing distribution example in which the computer system connected to the common bus 9 has an image processing function for obtaining a CT tomographic image as a function until obtaining the shadow data. In this case, the LAN 10 transmits the shadow data.

図2でCT装置11の代わりに、超音波装置やMRI装置をつなげば、超音波断層画像、MRI断層画像が対象となる。   In FIG. 2, if an ultrasonic apparatus or an MRI apparatus is connected instead of the CT apparatus 11, an ultrasonic tomographic image and an MRI tomographic image are targeted.

図1は、臓器領域抽出の処理フロー例であり、図1でのコンピュータシステムによる処理に相当する。フローF1にて、未抽出領域の抽出判定をする判定値である差分基準属性値台を設定する。未抽出領域とは、これから臓器として抽出すべきCT断層画像上の一部であり、基準属性値は、基準となるべき属性値のことであり、経験的に求めた値、又は計算により求めた値であり、例えば平均CT画素値、標準偏差値、最大画素値、最小画素値等種々の値であり、これらの中の1つの値、又は2つ以上の値の設定例(例えばCT画素値と標準偏差値とか)がある。差分とは、未抽出領域の属性値と近々の既抽出領域の属性値との差分である。また基準属性値は、1つの値の他に、大小2つの値で幅として与える例もある。   FIG. 1 is an example of a processing flow for organ region extraction, which corresponds to the processing by the computer system in FIG. In the flow F1, a difference reference attribute value base that is a determination value for performing extraction determination of an unextracted region is set. The unextracted region is a part on the CT tomographic image to be extracted as an organ from now on, and the reference attribute value is an attribute value to be used as a reference. Various values such as an average CT pixel value, a standard deviation value, a maximum pixel value, a minimum pixel value, and a setting example of one value or two or more values (for example, a CT pixel value) And standard deviation value). The difference is a difference between the attribute value of the unextracted area and the attribute value of the previously extracted area. In addition, there is an example in which the reference attribute value is given as a width with two values of large and small other than one value.

フローF2は、既抽出領域が存在するとの前提に立つ処理であり、既抽出領域の境界付近、例えば境界線上に円図形の中心点を設定する。この設定は、CT断層画像のCRT5への表示/その画像上での既抽出領域の表示/画面の一部に中心点設定メニューの表示、という表示状態下で、マウス7にてこのメニューをクリックし且つ既抽出領域の境界上の操作者が指定した一点を中心点として入力させることで、実現する。   The flow F2 is processing based on the premise that an already extracted region exists, and sets the center point of a circular figure near the boundary of the already extracted region, for example, on the boundary line. This setting is made by clicking the menu with the mouse 7 under the display state of displaying the CT tomographic image on the CRT 5 / displaying the extracted area on the image / displaying the center point setting menu on a part of the screen. In addition, it is realized by inputting one point designated by the operator on the boundary of the already extracted region as the center point.

かかる中心点設定入力をうけて、コンピュータは、既抽出領域の境界線上の中心点を中心にしての円図形をデータとして作成する。   Upon receiving such center point setting input, the computer creates a circular figure centered on the center point on the boundary line of the extracted region as data.

フローF3は、データ処理にて円図形が既抽出領域とその外側の非抽出領域との両者にまたがることから、この両者を区分けする。既抽出領域が定まり、円図形が定まっている故に、両者の重複領域を既抽出領域とし、そうでない残りの円図形の領域を未抽出領域とすることで、区分けが可能となる。   In the flow F3, since the circular figure extends over both the already extracted area and the non-extracted area outside the area in the data processing, the flow F3 is divided. Since the already extracted area is determined and the circular figure is determined, the overlapping area between the two is set as the already extracted area, and the remaining circular figure area is set as the unextracted area.

既抽出領域の管理は表示画像データに対応した画像サイズのメモリ領域中に既抽出を“1”、未抽出を“0”として持つ抽出管理領域を持たせることで実現できる。または画素値データに既抽出か否かのフラグを付加するやり方もある。   The management of the already extracted area can be realized by providing an extraction management area having “1” for already extracted and “0” for not extracted in a memory area having an image size corresponding to the display image data. Alternatively, there is a method of adding a flag indicating whether or not the pixel value data has already been extracted.

フローF4は、フローF3で区分けした既抽出領域E1と未抽出領域E2とのそれぞれで、各領域内の画素値の属性値を求める。属性値は、例えば以下の如きものがある。
(1)領域E1とE2とのそれぞれのCT画素値の平均値a1、a2
(2)領域E1とE2とのそれぞれのCT画素値の標準偏差値b1、b2
(3)領域E1とE2とのそれぞれのCT画素値の最大値c1、c2
(4)領域E1とE2とのそれぞれのCT画素値の最小値d1、d2
等、抽出領域の特徴を示す値である。
In the flow F4, the attribute value of the pixel value in each area is obtained in each of the already extracted area E1 and the unextracted area E2 divided in the flow F3. Examples of attribute values are as follows.
(1) Average values a1 and a2 of the CT pixel values of the regions E1 and E2
(2) Standard deviation values b1 and b2 of the CT pixel values of the regions E1 and E2
(3) Maximum values c1 and c2 of the CT pixel values of the regions E1 and E2
(4) Minimum values d1 and d2 of the CT pixel values of the areas E1 and E2
It is a value indicating the characteristics of the extraction area.

次に、かくして求めた領域E1、E2とのそれぞれの属性値の差分rを求める。平均値であれば(c1−c2)、標準偏差値であれば(b1−b2)、等となる。フローF1での判定値としての基準属性値r0とは、この差分属性値rに対応しており、そこで、フローF4では、上記算出した差分属性値rとフローF1で設定された基準属性値r0との比較を行う。そしてこの比較の結果、判定値としての基準属性値rにに対して満足するものであれば、その未抽出領域E2は、抽出臓器の一部を構成すると判定する。ここで、満足するとは、例えば(a1−a2)>r0とか(a1−a2)<r0とか事前に決定した条件に従う。2つの基準属性値r1とr2とを与えて、r1<(a1−a2)<r2とかの例もある。   Next, the difference r between the attribute values of the areas E1 and E2 thus obtained is obtained. The average value is (c1-c2), the standard deviation value is (b1-b2), and so on. The reference attribute value r0 as the determination value in the flow F1 corresponds to the difference attribute value r. Therefore, in the flow F4, the calculated difference attribute value r and the reference attribute value r0 set in the flow F1. Compare with. As a result of the comparison, if the reference attribute value r as the determination value is satisfied, it is determined that the unextracted region E2 constitutes a part of the extracted organ. Here, satisfying is in accordance with a condition determined in advance such as (a1-a2)> r0 or (a1-a2) <r0. There is also an example in which two reference attribute values r1 and r2 are given and r1 <(a1-a2) <r2.

領域E2は、その内部の画素群すべて(正確には、内部の既抽出領域として確定した画素群以外の未抽出領域の全画素群)を抽出臓器の一部とみなす。この他にセンス領域としての円図形が大きいときには、その円図形よりも小さい、例えば7分とか半分程度とかの半径の円図形を新しく設定し、この新しい円図形の領域を、抽出臓器として特定する。   In the area E2, all of the internal pixel groups (more precisely, all the pixel groups in the unextracted area other than the pixel group determined as the internal already extracted area) are regarded as a part of the extracted organ. In addition to this, when the circular figure as the sense area is large, a new circular figure with a radius smaller than the circular figure, for example, about 7 minutes or about half, is set, and this new circular figure area is specified as the extracted organ. .

上記フローF4での属性値の算出は、エリアE1とE2とのそれぞれの全領域の全画素に基づくものであるが、処理を簡単化するため、全画素ではなく、幾つかの代表点を選び、その代表点に基づき属性値を求めるやり方もある。更に、この考え方の1つとして、既抽出領域内の円図形の円周ライン上の各点、未抽出領域としての円図形の円周ライン上の各点に基づいての属性値の算出の仕方もある。   The calculation of the attribute value in the flow F4 is based on all the pixels in each of the areas E1 and E2, but in order to simplify the processing, some representative points are selected instead of all the pixels. There is also a method of obtaining the attribute value based on the representative point. Furthermore, as one of the ideas, how to calculate the attribute value based on each point on the circumferential line of the circular figure in the already extracted area and each point on the circumferential line of the circular figure as the unextracted area There is also.

フローF3での抽出領域と未抽出領域とに分けるやり方としては、抽出領域が確定し、円図形の中心点とその半径とが確定している故に、円図形内(円周上を含む)のデータとしてオール“1”を与えて、抽出領域を含む円図形データとの論理積をとれば、既抽出領域だけのデータが残る。そしてこの既抽出領域以外の円図形の残りの領域が未抽出領域として自動的に定まる。   As a method of dividing the extracted area and the unextracted area in the flow F3, since the extracted area is fixed and the center point and the radius of the circular figure are fixed, the inside of the circular figure (including the circumference) is included. If all “1” is given as data and the logical product with the circular graphic data including the extraction area is taken, data of the already extracted area remains. The remaining area of the circular figure other than the already extracted area is automatically determined as the unextracted area.

フローF2での円図形の半径Rは、原点としての最初の中心点での半径に比して、拡張されて外部に行く程に小さな値となるようにする例がある。これは原点から離れるに従って連続的に−定値−ΔRを差し引くやり方、ある程度の距離まではRで固定し、ある距離を超えると、R’<RなるR’を選択設定するやり方、このR’を遠くになるに従って徐々に小さくするやり方、がある。かかる外部への拡張が進む程に円図形の半径Rを小さくすることで、抽出領域のエッジ部分の凹凸が少なくなり、より精度のよい臓器領域の抽出が可能となる。   There is an example in which the radius R of the circular figure in the flow F2 is set to be smaller as it goes to the outside as compared with the radius at the first center point as the origin. This is a method of continuously subtracting −constant value−ΔR as it is away from the origin, fixing it to R up to a certain distance, and selecting and setting R ′ <R where R ′ <R after exceeding a certain distance. There is a way to make it gradually smaller as it gets farther away. By reducing the radius R of the circular figure as the extension to the outside progresses, the unevenness of the edge portion of the extraction region is reduced, and the organ region can be extracted with higher accuracy.

尚、図の処理フローは、既抽出領域の存在を前提とするものであるので、最初の抽出処理がすでになされていることになる。この最初の抽出処理は、CT画像内の任意の位置、例えば中央に開始点を設定し、この開始点を中心として円図形を設定する。次に、この円図形内のCT画素値の平均値、標準偏差値、最大CT画素値、最小CT画素値、の少なくとも1つをデータ処理にて求め、事前に定めた判定値との比較を行い、臓器内か否かを判定する。臓器内であれば、それが最初の抽出領域となる。これを見つけるまで、行う。かくして、最初の抽出領域が確定し、図1の処理に移る。   Note that the processing flow in the figure is based on the premise of the existence of an already extracted region, and therefore the first extraction process has already been performed. In this first extraction process, a starting point is set at an arbitrary position in the CT image, for example, the center, and a circular figure is set around the starting point. Next, at least one of an average value, a standard deviation value, a maximum CT pixel value, and a minimum CT pixel value of the CT pixel values in the circular figure is obtained by data processing, and compared with a predetermined determination value. And determine whether it is inside the organ. If it is in an organ, it becomes the first extraction region. Do until you find this. Thus, the first extraction area is determined and the process proceeds to FIG.

図3は、図1のフローF1での判定値としての基準属性値が正しいか否かのチェックフロー図又は正しい基準属性値を事前に求めるための処理フロー図である。判定値としての基準属性値は臓器領域抽出の重要なファクタであり、誤りがあると抽出失敗を招くので、事前に試行して求めておくことが必要となる。図3がその時のフローである。   FIG. 3 is a flow chart for checking whether or not the reference attribute value as the determination value in the flow F1 in FIG. 1 is correct, or a processing flowchart for obtaining the correct reference attribute value in advance. The reference attribute value as a determination value is an important factor for organ region extraction, and if there is an error, it will cause extraction failure. Therefore, it is necessary to try and obtain it in advance. FIG. 3 shows the flow at that time.

図3のフローF1は、先ず最適とオペレータが思われ、又は経験的に認知している、判定値としての差分属性値を、キーボードやカーソルにて設定する。。   In the flow F1 of FIG. 3, first, a difference attribute value as a determination value, which the operator seems to be optimal or is empirically recognized, is set with a keyboard or a cursor. .

フローF2は、半径Rの円図形を、判定値抽出用の画像の臓器内の任意の開始点を中心点として設定すると共に、この円図形を、中心点をずらすことで臓器内を移動し、臓器外に出るように図形移動させる。例えば、中心点を外方向に向けて直線移動させる。そしてフローF3で各中心点毎に領域抽出を行い、その抽出した領域をフローF4にて表示させる。   The flow F2 sets a circular figure with a radius R as a central point at an arbitrary starting point in the organ of the image for extracting the judgment value, and moves the circular figure within the organ by shifting the central point. Move the figure so that it goes out of the organ. For example, the center point is linearly moved outward. Then, region extraction is performed for each center point in the flow F3, and the extracted region is displayed in the flow F4.

図4は、この中心点の直線移動例を示す。図4は、CRT5の表示画面を示し、試行用のCT画像を表示しておく。臓器Aが抽出すべきもの、臓器Bが非抽出のもので、両者は一部に互いに接触した個所を持つ例とした。   FIG. 4 shows an example of linear movement of this center point. FIG. 4 shows a display screen of the CRT 5 and displays a trial CT image. In this example, the organ A is to be extracted, the organ B is not extracted, and both have a part in contact with each other.

最初に開始点に設定される円図形が図形21であり、この円図形21にて開始用の判定値をもとに臓器A内であるか否かを判定する。A内であれば、最初の臓器領域が抽出されたことになる。次に、直線移動方向に沿って中心点をずらして次の円図形を作り、今度は、図1の処理と同じ処理に従って臓器領域の抽出処理を行う。このときの判定値は、即抽出領域と未抽出領域の差分としての属性値である。そして臓器領域が抽出できれば、次の中心点へ移動し、同様の処理を行う。こうして次々に直線上を中心点を移動させながら、判定値としての差分属性値に従って判定を行う。同一臓器内であって、且つ判定値としての差分属性値が正しい判定値であれば、当該臓器のエッジまで円図形は進む。そして、このエッジでの円図形23が停止し、それ以上進行しない状態であれば、判定値としての差分属性値は、正しく値であることがわかる。   The circle figure initially set as the start point is the figure 21, and it is determined whether or not the circle figure 21 is in the organ A based on the start determination value. If it is within A, the first organ region has been extracted. Next, the center point is shifted along the linear movement direction to create the next circular figure, and this time, organ region extraction processing is performed according to the same processing as in FIG. The determination value at this time is an attribute value as a difference between the immediately extracted region and the unextracted region. If the organ region can be extracted, the next center point is moved and the same processing is performed. In this way, the determination is performed according to the difference attribute value as the determination value while moving the center point on the straight line one after another. If it is within the same organ and the difference attribute value as the determination value is the correct determination value, the circle graphic advances to the edge of the organ. Then, if the circular figure 23 at this edge stops and does not proceed any further, it can be seen that the difference attribute value as the determination value is a correct value.

一方、円図形が更に進行し、臓器B内に入り込んだときは、判定値としての差分属性値は誤ってることがわかる。このときには、新たな差分属性値を判定値として設定し、再び図3、図4による処理を行う。かくしてこうした試行することでエッジ部で停止する属性値を見つける。   On the other hand, when the circular figure further advances and enters the organ B, it can be seen that the difference attribute value as the determination value is incorrect. At this time, a new difference attribute value is set as a determination value, and the processes shown in FIGS. 3 and 4 are performed again. Thus, such an attempt finds an attribute value that stops at the edge.

図4では、操作画面(GUI)24を表示させて、処理パラメータの入力に使う。処理パラメータには、円の直径(2R)又は半径(R)、差分平均CT値、差分標準偏差値(STD)の2つを差分属性値として設定できる例を示した。更に、テストランの指示、設定及び終了の指示メニューを表示してある。表示画面24上の各種クリックはマウス7、パラメータはキーボード8にて行う。
こうした操作画面を利用することで、迅速、適格に試行処理が実現できる。
In FIG. 4, an operation screen (GUI) 24 is displayed and used to input processing parameters. In the processing parameter, two examples of a circle diameter (2R) or radius (R), a difference average CT value, and a difference standard deviation value (STD) can be set as difference attribute values. In addition, a test run instruction, setting and termination instruction menu is displayed. Various clicks on the display screen 24 are performed with the mouse 7 and parameters with the keyboard 8.
By using such an operation screen, trial processing can be realized quickly and appropriately.

センス図形としての円図形を直線移動としたが、抽出臓器の形状や部位によっては、円形運動や放物線移動の例もある。   Although the circular figure as the sense figure is linearly moved, there are examples of circular movement and parabolic movement depending on the shape and part of the extracted organ.

尚、判定値としての属性値は、図1で示す差分属性値としたが、差分ではなく、円図形のみから得られる属性値の判定を行う判定値に対しても、図3、図4は適用できる。   Although the attribute value as the determination value is the difference attribute value shown in FIG. 1, FIG. 3 and FIG. 4 also show the determination value for determining the attribute value obtained only from the circular figure, not the difference. Applicable.

図5は、かかる円図形のみから得られる属性値を利用するときの、判定値としての基準属性値を得るための処理フローを示す。   FIG. 5 shows a processing flow for obtaining a reference attribute value as a determination value when an attribute value obtained only from such a circular graphic is used.

図5のフローF1では図3と同様に直線方向の設定を行う。図3と異なる点は、中心点の移動の中で、抽出領域の判定を行っていないことである。代わりに、各移動中心点毎に、円図形における画素に基づく属性値(平均値とか標準偏差値とか)を求め、これを画面に表示させる。表示画面から未抽出領域の抽出のための判定値としての属性値を求める。かかる処理を実現したのが、図5のフローF2、F3である。   In the flow F1 of FIG. 5, the linear direction is set as in FIG. The difference from FIG. 3 is that the extraction area is not determined during the movement of the center point. Instead, for each moving center point, an attribute value (average value or standard deviation value) based on the pixels in the circular figure is obtained and displayed on the screen. An attribute value is obtained as a determination value for extracting an unextracted area from the display screen. Such processing is realized by the flows F2 and F3 in FIG.

図6の表示画面では、円の直線移動に伴うトレンドグラフ画面25を表示する。各中心点の円図形毎に平均CT値標準偏差値(STD)を求めて表示した。この表示画面から、抽出すべき臓器Aの抽出に適する判定値としての属性値を選ぶ。例えばm1〜m2の範囲の値を抽出臓器の判定値として選ぶ。   On the display screen of FIG. 6, a trend graph screen 25 associated with the linear movement of the circle is displayed. An average CT value standard deviation value (STD) was obtained and displayed for each circle figure at each center point. From this display screen, an attribute value is selected as a judgment value suitable for extraction of the organ A to be extracted. For example, a value in the range of m1 to m2 is selected as a judgment value for the extracted organ.

図7は、図1の処理フローの処理中に表示される表示画面例であり、臓器Aに対して既抽出領域30が既に存在し、この領域の境界線の一点P1に半径Rの円図形31を設定したときの画像である。図7(a)が円図形31設定例であり、図7(b)がその円図形31の全領域32を、臓器領域と認定した画像である。
この図7(b)から明らかなように、円図形31により新たな抽出領域の確定がなされる。
FIG. 7 is an example of a display screen displayed during the processing of the processing flow of FIG. 1. An already extracted area 30 already exists for the organ A, and a circular figure with a radius R at one point P1 of the boundary line of this area. This is an image when 31 is set. FIG. 7A shows an example of setting a circular figure 31, and FIG. 7B shows an image in which the entire area 32 of the circular figure 31 is recognized as an organ area.
As is apparent from FIG. 7B, a new extraction area is determined by the circular figure 31.

図8は、既抽出領域30の境界線上に沿って複数の円図形31を次々に形成しながら、抽出領域の拡張を行ったときの表示画面の模式図である。図8(a)がその円図形31の移動例、図8(b)が抽出領域内と判定した後の拡張例32、を示す。
かくして、境界線上を円図形を移動させることで、抽出領域が次々に得られることがわかる。
FIG. 8 is a schematic diagram of a display screen when the extraction region is expanded while forming a plurality of circular figures 31 one after another along the boundary line of the already extracted region 30. FIG. 8A shows an example of movement of the circular figure 31, and FIG. 8B shows an extension example 32 after it is determined that it is within the extraction region.
Thus, it can be seen that the extraction regions are obtained one after another by moving the circular figure on the boundary line.

以上の実施例は円図形を抽出拡張に利用したが、それ以外に、球図形、円錐などの図形を利用することも可能である。更に、X線CT装置の例としたが、MRIや超音波の各断層画像に対しても利用可能である。   In the above embodiment, a circular figure is used for extraction expansion, but other figures such as a spherical figure and a cone can be used. Further, although an example of the X-ray CT apparatus is described, the present invention can also be used for MRI and ultrasonic tomographic images.

既抽出領域をセンス図形の周ラインを含む内部画像群としたが、近接する既抽出領域であってセンス図形の近傍外部とすることも可能である。   Although the already extracted area is an internal image group including the peripheral line of the sense graphic, it may be an adjacent extracted area and outside the sense graphic.

本発明の臓器抽出の処理フロー例図である。It is a processing flow example figure of organ extraction of the present invention. 本発明の臓器抽出の処理システム例図である。It is an example figure of a processing system of organ extraction of the present invention. 本発明の判定値の決定のための処理フロー例図である。It is a processing flow example figure for determination value determination of the present invention. 図3の処理における表示画面例図である。FIG. 4 is an example of a display screen in the process of FIG. 3. 本発明の判定値の決定のための他の処理フロー例図である。It is another example of processing flow for determination value determination of the present invention. 図5の処理における表示画面例図である。FIG. 6 is an example of a display screen in the process of FIG. 本発明の臓器領域拡張抽出を示す表示画面例図である。It is an example of a display screen showing organ region expansion extraction of the present invention. 本発明の臓器領域拡張抽出を連続的に行ったときの表示画面模式例図である。It is a display screen model example figure when organ area | region expansion extraction of this invention is performed continuously.

符号の説明Explanation of symbols

1 CPU
2 メモリ
3 補助メモリ
4 表示メモリ
5 CRT
11 CT装置
1 CPU
2 Memory 3 Auxiliary memory 4 Display memory 5 CRT
11 CT equipment

Claims (8)

コンピュータを用いて、医用画像の中の既抽出領域をその周囲に拡張する特定領域抽出方法であって、
抽出判定値を設定するステップと、
前記既抽出領域の境界付近に所定図形を設定する設定ステップと、
前記所定図形の周辺又は内部画素群を前記既抽出領域に属するものと未抽出領域に属するものとに分ける分割ステップと、
前記既抽出領域に属するものとして分けられた画素群の画素属性値と、前記未抽出領域に属するものとして分けられた画素群の画素属性値と、の差分である差分画素属性値を求める算出ステップと、
前記差分画素属性値と前記抽出判定値との比較に基づき、前記未抽出領域に属するものとして分けられた画素群を前記既抽出領域に追加する拡張ステップと、
を備える医用画像の特定領域抽出方法において、
前記設定ステップでは、前記所定図形の移動経路として設定された直線状の経路上での所定図形の移動による、前記分割ステップから前記拡張ステップまでの試行に基づいて前記抽出判定値が設定されることを特徴とする医用画像の特定領域抽出方法。
A method for extracting a specific area by using a computer to extend an already extracted area in a medical image to the periphery thereof,
Setting an extraction judgment value;
A setting step for setting a predetermined figure near the boundary of the extracted area;
A division step of dividing the surrounding or internal pixel group of the predetermined figure into those belonging to the already extracted region and those belonging to the unextracted region;
A calculation step for obtaining a difference pixel attribute value that is a difference between a pixel attribute value of the pixel group divided as belonging to the already extracted area and a pixel attribute value of the pixel group divided as belonging to the unextracted area When,
Based on the comparison between the difference pixel attribute value and the extraction determination value, an extension step of adding a pixel group that is divided as belonging to the unextracted region to the already extracted region;
In a method for extracting a specific region of a medical image comprising:
In the setting step, the extraction determination value is set based due to the movement of the predetermined shape in the set straight on the path, the attempts from the dividing step to said expansion step as the movement path of the predetermined graphic A method for extracting a specific area of a medical image.
前記経路は、第1の臓器領域と第2の臓器領域に跨る経路であり、
前記設定ステップでは、前記経路上で前記所定図形を移動させて、試行用抽出判定値を変えて前記試行を繰り返し、一方の領域の境界で前記拡張ステップが終了する試行用抽出判定値を前記抽出判定値とする請求項1に記載の医用画像の特定領域抽出方法。
The path is a path that spans the first organ region and the second organ region,
In the setting step, the predetermined figure is moved on the route, the trial extraction determination value is changed, the trial is repeated, and the trial extraction determination value at which the expansion step ends at one region boundary is extracted. The method for extracting a specific region of a medical image according to claim 1, wherein the specific value is a determination value.
前記所定図形は、円図形又は球図形、円錐図形のいずれかとする請求項1又は2に記載の医用画像の特定領域抽出方法。   The method for extracting a specific area of a medical image according to claim 1, wherein the predetermined graphic is any one of a circular graphic, a spherical graphic, and a conical graphic. 前記各画素属性値とは、画素群の平均値又は標準偏差値、最大画素値、最小画素値の少なくともいずれか1つとし、差分画素属性値とはそれらの差分値とする請求項1乃至3のいずれか一項に記載の医用画像の特定領域抽出方法。   4. Each pixel attribute value is at least one of an average value or standard deviation value of a pixel group, a maximum pixel value, and a minimum pixel value, and a difference pixel attribute value is a difference value thereof. The specific region extraction method for medical images according to any one of the above. 前記試行により抽出された領域を表示する表示ステップを有することを特徴とする請求項1乃至4のいずれか一項に記載の医用画像の特定領域抽出方法。   The method for extracting a specific area of a medical image according to any one of claims 1 to 4, further comprising a display step of displaying an area extracted by the trial. 医用画像の中の既抽出領域をその周囲に拡張する医用画像処理装置であって、
抽出判定値の設定と、前記既抽出領域の境界付近に配置する所定図形の設定と、を受け付ける入力部と、
前記所定図形の周辺又は内部画素群を前記既抽出領域に属するものと未抽出領域に属するものとに分割し、前記既抽出領域に属するものとして分けた画素群の画素属性値と、前記未抽出領域に属するものとして分けた画素群の画素属性値と、の差分である差分画素属性値を算出し、前記差分画素属性値と前記抽出判定値との比較に基づき、前記未抽出領域に属するものとして分けた画素群を前記既抽出領域に追加して拡張する演算部と、
を備える医用画像処理装置であって、
前記入力部には、前記所定図形の移動経路として設定された直線状の経路上での前記所定図形の移動による、前記分割から前記拡張までの試行に基づく抽出判定値が入力されることを特徴とする医用画像処理装置。
A medical image processing apparatus that extends an already extracted region in a medical image to the periphery thereof,
An input unit that accepts the setting of the extraction determination value and the setting of a predetermined graphic placed near the boundary of the extracted region;
A pixel attribute value of a pixel group divided around the predetermined figure or belonging to the already extracted area and divided to belong to the already extracted area, and the unextracted pixel group A difference pixel attribute value that is a difference between a pixel attribute value of a pixel group divided as belonging to an area and a difference between the difference pixel attribute value and the extraction determination value is calculated, and the difference attribute value belongs to the unextracted area A calculation unit that adds and expands the pixel group divided as
A medical image processing apparatus comprising:
The input unit, characterized in that the by the movement of the predetermined shape in the predetermined shapes on a linear path that is set as the travel route, extraction determination value based on the attempt to the extension from the division is input A medical image processing apparatus.
前記経路は、第1の臓器領域と第2の臓器領域に跨る経路であり、
前記入力部には、前記経路上で前記所定図形を移動させて、試行用抽出判定値を変えて前記試行を繰り返し、一方の領域の境界で前記拡張が終了する試行用抽出判定値を前記抽出判定値として入力される請求項6に記載の医用画像処理装置。
The path is a path that spans the first organ region and the second organ region,
The input unit moves the predetermined figure on the path, changes the trial extraction judgment value, repeats the trial, and extracts the trial extraction judgment value at which the expansion ends at one region boundary. The medical image processing apparatus according to claim 6, which is input as a determination value.
前記試行により抽出された領域を表示する表示部を有する請求項6又は7に記載の医用画像処理装置。   The medical image processing apparatus according to claim 6, further comprising a display unit configured to display a region extracted by the trial.
JP2007218095A 2007-08-24 2007-08-24 Method for extracting specific region of medical image and medical image processing apparatus Expired - Fee Related JP5155622B2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2007218095A JP5155622B2 (en) 2007-08-24 2007-08-24 Method for extracting specific region of medical image and medical image processing apparatus

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2007218095A JP5155622B2 (en) 2007-08-24 2007-08-24 Method for extracting specific region of medical image and medical image processing apparatus

Publications (2)

Publication Number Publication Date
JP2009050356A JP2009050356A (en) 2009-03-12
JP5155622B2 true JP5155622B2 (en) 2013-03-06

Family

ID=40501990

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2007218095A Expired - Fee Related JP5155622B2 (en) 2007-08-24 2007-08-24 Method for extracting specific region of medical image and medical image processing apparatus

Country Status (1)

Country Link
JP (1) JP5155622B2 (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104599239A (en) * 2013-10-31 2015-05-06 通用电气公司 Medical image metal artifact eliminating method and device
WO2016189601A1 (en) * 2015-05-22 2016-12-01 株式会社島津製作所 Image processing device and image processing program

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3380609B2 (en) * 1993-12-24 2003-02-24 コニカ株式会社 Radiation image field extraction device
JP4549082B2 (en) * 2004-03-17 2010-09-22 キヤノン株式会社 Image processing apparatus and method
JP4538260B2 (en) * 2004-04-15 2010-09-08 株式会社日立メディコ Specific area extraction method and apparatus

Also Published As

Publication number Publication date
JP2009050356A (en) 2009-03-12

Similar Documents

Publication Publication Date Title
US20090202137A1 (en) Method and apparatus for image generation
US9183622B2 (en) Image processing apparatus
JP5651428B2 (en) Pattern measuring method, pattern measuring apparatus, and program using the same
JP5202110B2 (en) Pattern shape evaluation method, pattern shape evaluation device, pattern shape evaluation data generation device, and semiconductor shape evaluation system using the same
KR102065197B1 (en) Electron beam drawing device, electron beam drawing method, and recrding media
US10095811B2 (en) Three-dimensional model generating method, three-dimensional model generating system, and a three-dimensional model generating program
JP2011165479A (en) Pattern inspection method, pattern inspection program, electronic device inspection system
JP5364528B2 (en) Pattern matching method, pattern matching program, electronic computer, electronic device inspection device
JP2010108236A (en) Method and program for drawing data point distribution area in scatter diagram
JP2009211626A (en) Image processing device and method
US8538165B2 (en) Image measuring apparatus, program, and teaching method of image measuring apparatus
US20220215521A1 (en) Transmission image-based non-destructive inspecting method, method of providing non-destructive inspection function, and device therefor
JP5155622B2 (en) Method for extracting specific region of medical image and medical image processing apparatus
US9978558B2 (en) Scanning-electron-microscope image processing device and scanning method
JP2006310551A (en) Inspection supporting system and method therefor
CN104502359A (en) Method for accurately detecting bottle blank and bottle opening defects
CN107506538B (en) Pretreatment method of optical proximity correction process
JP2004117204A (en) Pattern measurement method, manufacturing method of semiconductor device using it, program and computer-readable storage medium, and pattern measuring device
CN104978752A (en) Method for dividing area of interest for chip defect scanning
TWI812461B (en) Method, system and non-transitory computer readable medium for determining a critical dimension variation of a pattern
US7730442B2 (en) Apparatus for designing circuit and method for designing circuit according to clearance required between wirings therein
US20110280464A1 (en) Image Processing Method and Computer Program
JP6018802B2 (en) Dimension measuring device and computer program
CN104361605A (en) Method for detecting outer contour defects of blank bottle mouths
JP5374225B2 (en) Wafer inspection condition determination method, wafer inspection condition determination system, and wafer inspection system

Legal Events

Date Code Title Description
RD04 Notification of resignation of power of attorney

Free format text: JAPANESE INTERMEDIATE CODE: A7424

Effective date: 20100223

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20100824

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20120328

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20120402

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20120530

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20120731

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20120828

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20120918

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20121031

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20121119

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20121207

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20151214

Year of fee payment: 3

R150 Certificate of patent or registration of utility model

Ref document number: 5155622

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

Free format text: JAPANESE INTERMEDIATE CODE: R150

S111 Request for change of ownership or part of ownership

Free format text: JAPANESE INTERMEDIATE CODE: R313111

S533 Written request for registration of change of name

Free format text: JAPANESE INTERMEDIATE CODE: R313533

R350 Written notification of registration of transfer

Free format text: JAPANESE INTERMEDIATE CODE: R350

LAPS Cancellation because of no payment of annual fees