JP4626984B2 - Difference image generating apparatus and method - Google Patents

Difference image generating apparatus and method Download PDF

Info

Publication number
JP4626984B2
JP4626984B2 JP2005044184A JP2005044184A JP4626984B2 JP 4626984 B2 JP4626984 B2 JP 4626984B2 JP 2005044184 A JP2005044184 A JP 2005044184A JP 2005044184 A JP2005044184 A JP 2005044184A JP 4626984 B2 JP4626984 B2 JP 4626984B2
Authority
JP
Japan
Prior art keywords
medical image
pixel value
image
difference
pixel
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
JP2005044184A
Other languages
Japanese (ja)
Other versions
JP2006223739A (en
Inventor
邦佳 中島
良洋 後藤
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hitachi Healthcare Manufacturing Ltd
Original Assignee
Hitachi Medical Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hitachi Medical Corp filed Critical Hitachi Medical Corp
Priority to JP2005044184A priority Critical patent/JP4626984B2/en
Publication of JP2006223739A publication Critical patent/JP2006223739A/en
Application granted granted Critical
Publication of JP4626984B2 publication Critical patent/JP4626984B2/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Apparatus For Radiation Diagnosis (AREA)
  • Image Processing (AREA)
  • Image Analysis (AREA)

Description

本発明は、差分画像生成装置に係り、特に、経時差分画像の生成に際し、より偽像が少ない差分画像を生成する差分画像生成装置に関する。   The present invention relates to a difference image generation apparatus, and more particularly to a difference image generation apparatus that generates a difference image with fewer false images when generating a time-dependent difference image.

特許文献1には、過去画像と現在画像とを差分して差分画像を生成する差分画像生成装置が開示されている。具体的には、入力画像In1(x,y)と入力画像In2(x,y)の間の形状変化を検出するために、差分画像S(x,y)を得る方法において、各画像に、形状変化が無いとみなす基準領域を設定して、この基準領域の画素値の平均値ave1、ave2を求め、差分画像S(x,y)を、S(x,y)=In1(x,y)−In2(x,y)−(ave1−ave2)として得て、これを表示する。
特開2002−190010号公報
Patent Document 1 discloses a differential image generation apparatus that generates a differential image by subtracting a past image and a current image. Specifically, in order to detect a shape change between the input image In1 (x, y) and the input image In2 (x, y), in the method of obtaining the difference image S (x, y), A reference area regarded as having no shape change is set, and average values ave1 and ave2 of the pixel values of the reference area are obtained, and a difference image S (x, y) is obtained as S (x, y) = In1 (x, y ) -In2 (x, y)-(ave1-ave2) and display this.
Japanese Patent Laid-Open No. 2002-190010

特許文献1の差分画像生成装置は、過去画像と現在画像との間で画素値の変化量が小さい領域を基準領域として定める。そのため、この基準領域を設定するために、過去画像と現在画像とを位置合わせをして差分処理を行う必要がある。その後、この基準領域を用いて過去画像の画素値を補正し、補正後の過去画像と現在画像とを再度差分処理を行うため、差分処理を最低2回行う必要がある。   The differential image generation apparatus of Patent Literature 1 determines an area where the amount of change in pixel value is small between a past image and a current image as a reference area. Therefore, in order to set the reference area, it is necessary to perform a difference process by aligning the past image and the current image. After that, the pixel value of the past image is corrected using the reference area, and the difference process is performed again between the corrected past image and the current image, so that the difference process needs to be performed at least twice.

また、基準領域を設定するための位置合わせ処理、差分処理を行わない場合には、予め基準領域を設定する箇所として、呼吸による変動が少ない部位、例えば、縦隔付近を基準領域に設定するという情報を差分画像生成装置に入力しておく必要がある。その場合、基準領域は、呼吸による画素値の変化量が小さい領域として縦隔付近の1箇所に限定される。基準領域を縦隔付近にのみ設定した場合、縦隔付近は画素値が高いため、他の画素値が低い箇所、例えば肺野領域や肋骨領域は濃度値の補正が十分にできない。すなわち、肺野領域及び肋骨領域と縦隔領域ではコントラストが異なるため、縦隔領域付近の平均値を使って肋骨領域や肺野領域を補正しきれない場合が生じる。更に、基準領域を予め設定しておく特許文献1の差分画像生成装置では、異なる被検体間の個体差や、同一被検体における脂肪のつき具合などの経年変化、また撮影時の呼吸や姿勢(装置への密着度)の差による画素値の変位に対し、必要な濃度補正が行えない。その結果、経時変化がない部位でも差分値が出力されて、差分画像に偽像が発生することがある。   In addition, when the alignment process and the difference process for setting the reference area are not performed, a part where the fluctuation due to respiration is small, for example, the vicinity of the mediastinum is set as the reference area as a part where the reference area is set in advance. It is necessary to input information to the difference image generation apparatus. In this case, the reference region is limited to one location near the mediastinum as a region where the amount of change in pixel value due to respiration is small. When the reference area is set only in the vicinity of the mediastinum, since the pixel values are high in the vicinity of the mediastinum, correction of the density value cannot be sufficiently performed in other parts where the pixel values are low, such as lung field areas and rib areas. That is, since the contrast is different between the lung field region and the rib region and the mediastinum region, the rib region and the lung field region may not be corrected using the average value near the mediastinum region. Furthermore, in the differential image generating apparatus of Patent Document 1 in which a reference region is set in advance, individual differences between different subjects, secular changes such as fat condition in the same subject, breathing and posture at the time of imaging ( Necessary density correction cannot be performed for the displacement of the pixel value due to the difference in the degree of adhesion to the apparatus. As a result, a difference value may be output even in a part that does not change with time, and a false image may occur in the difference image.

そこで本発明は、経時変化がない部位では差分値が出力されにくく、より偽像の発生を防ぐことができる差分画像生成装置を提供することを目的とする。   Accordingly, an object of the present invention is to provide a differential image generation apparatus that is unlikely to output a differential value at a portion that does not change with time, and that can prevent generation of a false image.

前記目的を達成するために、本発明にかかる差分画像生成装置は、被検体の同一部位を異なる日時に撮影した第一医用画像及び第二医用画像を取得する医用画像取得手段と、前記第一医用画像に対し、前記第一医用画像に撮影された部位毎に局所領域を設定するとともに、前記第二医用画像に対し前記部位に対応する領域に局所領域を設定する局所領域設定手段と、前記第一医用画像に含まれる前記局所領域を代表する画素値及び前記第二医用画像に含まれる前記局所領域を代表する画素値を算出する画素値算出手段と、前記第二医用画像に含まれる前記局所領域を代表する画素値に、その局所領域に対応する前記第一医用画像の局所領域を代表する画素値が近づくように、前記第一医用画像における局所領域を代表する画素値を補正する補正手段と、前記補正手段により補正された前記第一医用画像と前記第二医用画像とを差分して差分画像を生成する差分画像生成手段と、前記差分画像を表示する表示手段と、を備える。   In order to achieve the above object, a difference image generating apparatus according to the present invention includes a first medical image and a second medical image obtained by capturing the same part of a subject at different dates and times, For the medical image, a local region is set for each region photographed in the first medical image, and a local region setting means for setting a local region in a region corresponding to the region for the second medical image; Pixel value calculating means for calculating a pixel value representative of the local region included in the first medical image and a pixel value representative of the local region included in the second medical image; and the pixel value calculating means included in the second medical image. A correction for correcting a pixel value representing the local area in the first medical image so that a pixel value representing the local area of the first medical image corresponding to the local area approaches a pixel value representing the local area. And means, wherein the difference image generation means for generating a difference image by subtracting the corrected said the first medical image second medical image by correcting means, and display means for displaying the difference image.

また、前記画素値算出手段は、前記第一医用画像及び前記第二医用画像に含まれる前記局所領域を構成する画素のうち所定条件下における最大画素値を算出し、前記補正手段は、前記第一医用画像に含まれる前記局所領域の前記最大画素値と前記第二医用画像に含まれる前記局所領域の前記最大画素値との差に基づいて画素値補正曲線を算出し、該画素値補正曲線に基づいて前記第一医用画像の局所領域の画素値を補正する。   The pixel value calculating means calculates a maximum pixel value under a predetermined condition among pixels constituting the local region included in the first medical image and the second medical image, and the correcting means Calculating a pixel value correction curve based on a difference between the maximum pixel value of the local region included in one medical image and the maximum pixel value of the local region included in the second medical image; Based on the above, the pixel value of the local region of the first medical image is corrected.

ここでいう「所定条件下における最大画素値」とは、画像データに対してノイズを除去する処理を行ったあとの最大画素値、また、ノイズを除去したあとの画像データにおいて、所定の画素値をもつ画素が所定数以上ある場合にのみ最大画素値とみなすという条件をみたす画素の画素値をいう。   The “maximum pixel value under a predetermined condition” as used herein refers to the maximum pixel value after performing noise removal processing on the image data, or the predetermined pixel value in the image data after noise removal. The pixel value of a pixel that satisfies the condition that it is regarded as the maximum pixel value only when there are a predetermined number or more of pixels having.

また、前記医用画像取得手段は、異なる日時に撮影した同一被検体の肺野領域を撮影した第一医用画像及び第二医用画像を取得し、前記局所領域設定手段は、前記第一医用画像及び前記第二医用画像に含まれる肋骨領域を抽出し、該肋骨領域に沿って前記局所領域を設定する。   In addition, the medical image acquisition unit acquires a first medical image and a second medical image obtained by imaging lung field regions of the same subject taken at different dates and times, and the local region setting unit includes the first medical image and A rib area included in the second medical image is extracted, and the local area is set along the rib area.

また、前記医用画像取得手段は、異なる日時に撮影した同一被検体の肺野領域を撮影した第一医用画像及び第二医用画像を取得し、前記局所領域設定手段は、前記第一医用画像及び前記第二医用画像に対し矩形状の局所領域を設定する、又は前記第一医用画像及び前記第二医用画像に含まれる左右の肺野領域を抽出し、左肺領域を2分割し、右肺領域を3分割して局所領域を設定する、とともに前記局所領域から前記被検体の肋骨領域及び肺野領域を抽出し、前記補正手段は、前記抽出された肋骨領域及び肺野領域毎に画素値の補正を行う。   In addition, the medical image acquisition unit acquires a first medical image and a second medical image obtained by imaging lung field regions of the same subject taken at different dates and times, and the local region setting unit includes the first medical image and A rectangular local region is set for the second medical image, or left and right lung field regions included in the first medical image and the second medical image are extracted, the left lung region is divided into two, and the right lung A region is divided into three to set a local region, and a rib region and a lung field region of the subject are extracted from the local region, and the correction unit is configured to generate a pixel value for each of the extracted rib region and lung field region. Perform the correction.

また、被検体の同一部位を異なる日時に撮影した第一医用画像及び第二医用画像を得する医用画像取得工程と、前記第一医用画像に対し、前記第一医用画像に撮影された部位毎に局所領域を設定するとともに、前記第二医用画像に対し前記部位に対応する領域に局所領域を設定する局所領域設定工程と、前記第一医用画像に含まれる前記局所領域を代表する画素値及び前記第二医用画像に含まれる前記局所領域を代表する画素値を算出する画素値算出工程と、前記第二医用画像に含まれる前記局所領域を代表する画素値に、その局所領域に対応する前記第一医用画像の局所領域を代表する画素値が近づくように、前記第一医用画像における局所領域を代表する画素値を補正する補正工程と、前記補正工程により補正された前記第一医用画像と前記第二医用画像とを差分して差分画像を生成する差分画像生成工程と、前記差分画像を表示する表示工程と、を含む、差分画像生成方法でもよい。   In addition, a medical image acquisition step for obtaining a first medical image and a second medical image obtained by photographing the same part of the subject at different dates, and for each part photographed in the first medical image with respect to the first medical image A local region setting step for setting a local region and setting a local region in a region corresponding to the part with respect to the second medical image, a pixel value representing the local region included in the first medical image, and the second medical image A pixel value calculating step for calculating a pixel value representative of the local area included in the second medical image; and a pixel value representative of the local area included in the second medical image; A correction step of correcting a pixel value representative of the local region in the first medical image so that a pixel value representative of the local region of one medical image approaches, and the first medical image corrected by the correction step; A difference image generation step of generating a difference image and a serial second medical image and differences, including a display step of displaying the difference image may be a difference image generation method.

本発明によれば、局所領域毎に濃度値補正をした医用画像と、他の医用画像との差分画像を生成するため、経時変化がない部位では差分値が出力されにくく、より偽像の発生を防ぐことができる差分画像生成装置を提供することができる。   According to the present invention, since a difference image between a medical image whose density value has been corrected for each local region and another medical image is generated, the difference value is less likely to be output at a portion where there is no change over time, and more false images are generated. It is possible to provide a differential image generation apparatus that can prevent the above-described problem.

以下、添付図面に従って本発明にかかる差分画像生成装置の実施の形態を説明する。なお、発明の実施の形態を説明するための全図において、同一機能を有するものは同一符号を付け、その繰り返しの説明は省略する。   Hereinafter, embodiments of a differential image generating apparatus according to the present invention will be described with reference to the accompanying drawings. Note that components having the same function are denoted by the same reference symbols throughout the drawings for describing the embodiment of the invention, and the repetitive description thereof is omitted.

本実施の形態にかかる差分画像生成装置は、同一被検体の同一部位を時間をあけて撮影した過去画像と現在画像を読みこみ、過去画像と現在画像とを差分処理して差分画像を生成する。この差分画像は、同一被検体における同一部位のうち、経時変化があった部位を描出する。   The difference image generation apparatus according to the present embodiment reads a past image and a current image obtained by photographing the same part of the same subject at intervals, and generates a difference image by performing a difference process between the past image and the current image. . This difference image depicts a portion of the same portion of the same subject that has changed over time.

[第一実施形態]
図1は、発明の一実施の形態に係る差分画像生成装置の構成を示すハードウェア構成図である。
[First embodiment]
FIG. 1 is a hardware configuration diagram showing a configuration of a difference image generation apparatus according to an embodiment of the invention.

図1の差分画像生成装置10は、X線CT装置やMR装置、X線装置、DR装置等の医用画像撮影装置1と、医用画像撮影装置1が撮影して得た医用画像を格納する画像データベース2と、二枚の医用画像を差分して差分画像を生成し、表示する差分画像生成装置10とを備え、医用画像撮影装置1と、画像データベース(画像DB)2と、差分画像生成装置10とは、LAN3等のネットワークにより互いに接続される。   The differential image generation apparatus 10 in FIG. 1 stores medical image imaging apparatuses 1 such as an X-ray CT apparatus, an MR apparatus, an X-ray apparatus, and a DR apparatus, and an image that stores medical images obtained by the medical image imaging apparatus 1. A database 2 and a difference image generation apparatus 10 that generates and displays a difference image by subtracting two medical images, and includes a medical image photographing apparatus 1, an image database (image DB) 2, and a difference image generation apparatus 10 are connected to each other by a network such as LAN3.

差分画像生成装置10は、主として各構成要素の動作を制御する中央処理装置(CPU)11と、装置の制御プログラムが格納されたり、プログラム実行時の作業領域となったりする主メモリ12と、オペレーティングシステム(OS)、周辺機器のデバイスドライブ、二枚の医用画像を差分処理することにより差分画像を生成して表示するプログラムを含む各種アプリケーションソフト等が格納される磁気ディスク13と、表示用データを一時記憶する表示メモリ14と、この表示メモリ14からのデータに基づいて画像を表示するCRTモニタや液晶モニタ等のモニタ15と、キーボード16と、位置座標入力装置としてのマウス17と、マウス17の状態を検出してモニタ15上のマウスポインタの位置やマウス17の状態等の信号をCPU11に出力するコントローラ18と、上記各構成要素を接続する共通バス19とを備える。   The difference image generation apparatus 10 mainly includes a central processing unit (CPU) 11 that controls the operation of each component, a main memory 12 that stores a control program for the apparatus and that serves as a work area when the program is executed, and an operating system. A system (OS), a device drive of a peripheral device, a magnetic disk 13 storing various application software including a program for generating and displaying a difference image by differentially processing two medical images, and display data A display memory 14 for temporary storage, a monitor 15 such as a CRT monitor or a liquid crystal monitor for displaying an image based on data from the display memory 14, a keyboard 16, a mouse 17 as a position coordinate input device, and a mouse 17 Signals such as the position of the mouse pointer on the monitor 15 and the state of the mouse 17 are detected. It includes a controller 18 for outputting to PU11, and a common bus 19 for connecting the above components.

本実施の形態においては、差分画像生成装置10は、LAN3を介して画像データベース2から医用画像を読み出すが、差分画像生成装置10に接続された記憶装置、例えばFDD、CD−RWドライブ、MOドライブ、ZIPドライブ等から医用画像を読み込んでも良い。また、LAN3を経由して医用画像撮影装置1から直接医用画像を取得してもよい。   In the present embodiment, the differential image generation apparatus 10 reads a medical image from the image database 2 via the LAN 3, but a storage device connected to the differential image generation apparatus 10, for example, an FDD, a CD-RW drive, an MO drive A medical image may be read from a ZIP drive or the like. Alternatively, a medical image may be acquired directly from the medical image photographing apparatus 1 via the LAN 3.

次に、図2に基づいて、本実施の形態に係る差分画像生成装置10を用いて差分画像を生成して表示する手順について説明する。図2は、差分画像の生成及び表示処理の手順を示すフローチャートである。以下、図2の各ステップ順に説明する。   Next, a procedure for generating and displaying a difference image using the difference image generating apparatus 10 according to the present embodiment will be described with reference to FIG. FIG. 2 is a flowchart showing a procedure of difference image generation and display processing. In the following, description will be given in the order of each step in FIG.

(ステップS1)
差分画像生成装置10が、医用画像撮影装置1又は画像データベース2から同一被検体の同一部位を写した過去画像及び現在画像を取得する。そして、過去画像及び現在画像から輪郭線抽出処理等により肺野領域を抽出する(S1)。
(Step S1)
The difference image generation device 10 acquires a past image and a current image in which the same part of the same subject is copied from the medical image capturing device 1 or the image database 2. Then, a lung field region is extracted from the past image and the current image by outline extraction processing or the like (S1).

(ステップS2)
現在画像を基準として、過去画像に対し平行移動処理や回転処理、拡大・縮小処理を行い、現在画像と過去画像(以下「位置合わせ画像」という。)との位置合わせ処理を行う(S2)。位置合わせ処理は、ステップS1で抽出した現在画像及び位置合わせ画像の輪郭線情報を用い、現在画像及び位置合わせ画像の輪郭線を一致させることにより行う。
(Step S2)
Using the current image as a reference, the past image is subjected to parallel movement processing, rotation processing, enlargement / reduction processing, and alignment processing between the current image and the past image (hereinafter referred to as “alignment image”) is performed (S2). The alignment process is performed by matching the contour lines of the current image and the alignment image using the contour information of the current image and the alignment image extracted in step S1.

(ステップS3)
ステップS2で位置合わせ処理のために平行移動処理や回転処理等を行った位置合わせ画像及び現在画像に対し局所領域を設定する。そして、位置合わせ画像に対して設定した局所領域を構成する画素の画素値(以下「濃度値」という。)と、現在画像に対して設定した対応する局所領域の濃度値とが近づくように、位置合わせ画像の局所領域の濃度値を補正する処理を行う(S3)。この局所濃度値補正処理の詳細については後述する。
(Step S3)
In step S2, a local region is set for the alignment image and the current image that have undergone parallel movement processing, rotation processing, and the like for alignment processing. Then, the pixel value (hereinafter referred to as “density value”) of the pixels constituting the local area set for the alignment image and the density value of the corresponding local area set for the current image are close to each other. Processing for correcting the density value of the local region of the alignment image is performed (S3). Details of the local density value correction processing will be described later.

(ステップS4)
ステップS3で局所濃度値の補正を行った位置合わせ画像と、現在画像とを差分処理して差分画像を生成する(S4)。そして、差分画像をモニタ15上に表示する。
(Step S4)
A difference image is generated by performing a difference process between the alignment image in which the local density value has been corrected in step S3 and the current image (S4). Then, the difference image is displayed on the monitor 15.

次に図3乃至図8に基づいて局所領域補正処理について説明する。図3は、局所濃度値補正処理の内容を示す模式図である。図4は、局所濃度値補正処理の流れを示すフローチャートである。図5は、局所領域の設定例を示す模式図である。図6(a)は局所領域の平均最大濃度値の差を体軸方向に沿ってプロットした図、図6(b)は、濃度値補正曲線の一例を示す図である。図7及び図8は、局所領域の他の設定例を示す模式図である。   Next, local region correction processing will be described with reference to FIGS. FIG. 3 is a schematic diagram showing the content of the local density value correction process. FIG. 4 is a flowchart showing a flow of local density value correction processing. FIG. 5 is a schematic diagram illustrating an example of setting a local region. FIG. 6A is a diagram in which the difference between the average maximum density values in the local region is plotted along the body axis direction, and FIG. 6B is a diagram illustrating an example of the density value correction curve. 7 and 8 are schematic diagrams illustrating other setting examples of the local region.

図3(a)は、実線で現在画像の濃度プロファイルを示し、点線で位置合わせ画像の濃度プロファイルを示す。濃度プロファイルとは、横軸に画素を、縦軸に画素をとり、医用画像を構成する画素を対応する座標にプロットしたものである。
In FIG. 3A, the density profile of the current image is indicated by a solid line, and the density profile of the alignment image is indicated by a dotted line. The density profile is obtained by plotting the pixels constituting the medical image on the corresponding coordinates, with the pixel value on the horizontal axis and the number of pixels on the vertical axis.

位置合わせ画像と現在画像とは、同一被検体の同一部位を撮影したものであるため、本来であれば、濃度プロファイルがほぼ一致するはずである。しかし、撮影時の撮影条件の違い(例えば、アキシャル像ではX線撮影装置に被検体が撮影部位を密着させたときの密着度や、過去画像と現在画像とを撮影したときの被検体の体型変化など)に由来し、本来、経時変化がなく、画素の濃度値も不変であるはずの領域にも差分値が発生することがある。これが図3(a)における現在画像の濃度プロファイルと位置合わせ画像の濃度プロファイルとにおける画素数のピーク値(最頻値)及び濃度値の最大値の隔たりとして現れる。   Since the alignment image and the current image are obtained by photographing the same part of the same subject, the density profiles should substantially match. However, the difference in imaging conditions at the time of imaging (for example, in the case of an axial image, the degree of adhesion when the subject is brought into close contact with the X-ray imaging apparatus, or the shape of the subject when the past image and the current image are taken) The difference value may also occur in an area that originally does not change with time and the density value of the pixel should be unchanged. This appears as a difference between the peak value (mode) of the number of pixels and the maximum value of the density value in the density profile of the current image and the density profile of the alignment image in FIG.

そこで、局所領域濃度補正処理を位置合わせ画像に対して行うことにより、図3(b)に示すように位置合わせ画像の濃度プロファイルを現在画像の濃度プロファイルに近づけるように、位置合わせ画像のベースラインをかさ上げまたはかさ下げする処理を行う。以下、図4の各ステップに沿って局所領域補正処理を説明する。   Therefore, by performing the local area density correction processing on the alignment image, as shown in FIG. 3B, the baseline of the alignment image is set so that the density profile of the alignment image approaches the density profile of the current image. The process of raising or lowering is performed. Hereinafter, the local region correction processing will be described along each step of FIG.

(ステップS3)
局所領域濃度値補正処理を開始する。
(Step S3)
The local area density value correction process is started.

(ステップS31)
位置合わせ画像及び現在画像に対して局所領域を設定する(S31)。局所領域の設定処理は、例えば図5に示すように位置合わせ画像及び現在画像のそれぞれから肋骨領域を抽出し、肋骨に沿って領域を設定してもよい。図5では、右肺領域にR1、R2…、R13、左肺領域にL1、L2…、L13の各局所領域を設定する。図5では、添え字が偶数の局所領域(R2、L2、R4、L4、…、R12、L12)が肋骨領域、奇数の局所領域(R1、L1、R3、L3、…R13、L13)が肺野領域を示す。また、局所領域の設定例として、図7に示すように、幾何学的に矩形状の局所領域R71、R72、…R715、L71、L72、…L715を設定してもよい。この場合、矩形状の各局所領域R71、R71、…R75、L71、L72、…L715について、肋骨領域と肺野領域とを抽出する。そして、各局所領域から肋骨領域及び肺野領域を抽出し、各局所領域の肋骨領域及び肺野領域の濃度値を以下の処理によりそれぞれ補正する。また図8に示すように、解剖学的見地に沿って左肺野領域を2分割、右肺野領域を3分割して各分割領域を局所領域として設定してもよい。この場合にも、左上局所領域L81、左下局所領域L82、右上局所領域R81、右中局所領域R82、右下各局所領域R83のそれぞれについて肋骨領域及び肺野領域を抽出し、その肋骨領域及び肺野領域の濃度値を以下の処理によりそれぞれ補正する。
(Step S31)
A local region is set for the alignment image and the current image (S31). In the local region setting process, for example, as shown in FIG. 5, the rib region may be extracted from each of the alignment image and the current image, and the region may be set along the rib. In FIG. 5, local regions R1, R2,..., R13 are set in the right lung region, and L1, L2,. In FIG. 5, local regions with even subscripts (R2, L2, R4, L4,..., R12, L12) are rib regions, and odd local regions (R1, L1, R3, L3,... R13, L13) are lungs. Indicates the field. Further, as an example of setting the local region, as shown in FIG. 7, geometrically rectangular local regions R71, R72,... R715, L71, L72,. In this case, the rib region and the lung field region are extracted for each of the rectangular local regions R71, R71,... R75, L71, L72,. Then, the rib area and the lung field area are extracted from each local area, and the density values of the rib area and the lung field area of each local area are corrected by the following processing. Further, as shown in FIG. 8, the left lung field region may be divided into two and the right lung field region may be divided into three along the anatomical viewpoint, and each divided region may be set as a local region. Also in this case, the rib region and the lung field region are extracted for each of the upper left local region L81, the lower left local region L82, the upper right local region R81, the right middle local region R82, and the lower right local region R83. The density value of the field area is corrected by the following processing.

(ステップS32)
ステップS31で設定した各局所領域の平均最大濃度値を算出する(S32)。ここでいう「平均最大濃度値」とは、局所領域を構成する画素のうち、画素値が大きいものから順にn個の画素を抽出し、そのn個の画素の画素値の平均値をいう。
(Step S32)
The average maximum density value of each local area set in step S31 is calculated (S32). Here, the “average maximum density value” refers to an average value of pixel values of n pixels, in which n pixels are extracted in descending order of pixel values from among pixels constituting the local region.

Figure 0004626984
Figure 0004626984

但し、P:局所領域の平均最大濃度値
:各局所領域を構成する画素のうち最大画素値に対応する画素から順にi番目の画素の画素値
なお、ノイズの影響を除去するために、n個の画素をカウントする際に閾値処理を行い、ある濃度値をもつ画素が所定数、例えば10画素以上ある場合にのみ、平均最大濃度値を算出するための画素としてカウントする。数1式では、濃度値Pに対応する画素が10画素以上存在する。
Where P: the average maximum density value of the local region
P i : The pixel value of the i-th pixel in order from the pixel corresponding to the maximum pixel value among the pixels constituting each local region. Note that threshold processing is performed when n pixels are counted in order to remove the influence of noise. The pixel is counted as a pixel for calculating the average maximum density value only when there are a predetermined number of pixels having a certain density value, for example, 10 pixels or more. In Equation 1, there are 10 or more pixels corresponding to the density value P.

(ステップS33)
ステップS32で算出した位置合わせ画像及び現在画像の各局所領域の平均最大濃度値の差を、体軸方向に沿って並べ替える。そして各点を補間する曲線である濃度補正曲線を生成する。補間曲線の生成には、線形関数、非線型関数、最小二乗法、スプライン曲線などを適宜用いる。その濃度補正曲線を用いて、数2式に従って位置合わせ画像の濃度値を補正する(S33)。
(Step S33)
The difference between the average maximum density values of the local areas of the alignment image and the current image calculated in step S32 is rearranged along the body axis direction. Then, a density correction curve that is a curve for interpolating each point is generated. For the generation of the interpolation curve, a linear function, a nonlinear function, a least square method, a spline curve, or the like is appropriately used. Using the density correction curve, the density value of the alignment image is corrected according to Equation 2 (S33).

[数2]
P’(x,y)=P(x,y)+D(y)
P(x,y):補正処理前の位置合わせ画像の画素値
P’(x,y):補正処理後の位置合わせ画像の画素値
D(y):濃度値補正曲線
図6は、濃度補正曲線の例を示す。横軸は、体軸方向の位置(頭を基点とし、足に向かう方向の距離)、縦軸は、各位置に対応する平均最大画素値を示す。図6の各点は、各局所領域(例えばR1、R2、…R13)の体軸方向の位置とそれに対応する位置合わせ画像の平均最大画素値と現在画像の平均最大画素値との差をプロットした点である。この各点を補間する曲線を生成し、点線に示す濃度補正曲線を算出する。この濃度補正曲線を位置合わせ画像の濃度値に足し合わせて、連続する局所領域を滑らかに濃度値補正する。これにより、図3(b)に示すように位置合わせ画像の局所領域毎に濃度プロファイルのベースラインをかさ上げ又はかさ下げし、位置合わせ画像と現在画像とのベースラインを合わせることができる。
[Equation 2]
P ′ (x, y) = P (x, y) + D (y)
P (x, y): Pixel value of the alignment image before correction processing P ′ (x, y): Pixel value of the alignment image after correction processing
D (y): Density Value Correction Curve FIG. 6 shows an example of the density correction curve. The horizontal axis indicates the position in the body axis direction (distance in the direction from the head toward the foot), and the vertical axis indicates the average maximum pixel value corresponding to each position. Each point in FIG. 6 plots the difference between the position of each local region (for example, R1, R2,... R13) in the body axis direction and the average maximum pixel value of the corresponding alignment image and the average maximum pixel value of the current image. This is the point. A curve for interpolating each point is generated, and a density correction curve indicated by a dotted line is calculated. The density correction curve is added to the density value of the alignment image to smoothly correct the density value of a continuous local region. Thereby, as shown in FIG. 3B, the baseline of the density profile can be raised or lowered for each local region of the alignment image, and the baseline of the alignment image and the current image can be aligned.

濃度値補正曲線を生成せずに、ステップS32で算出した平均最大画素値を用いて濃度値補正を行ってもよいが、濃度値補正曲線を用いて濃度値補正を行うと、連続する領域に対しより滑らかな濃度値補正を行うことができる。   The density value correction may be performed using the average maximum pixel value calculated in step S32 without generating the density value correction curve. However, if the density value correction is performed using the density value correction curve, a continuous area is displayed. On the other hand, smoother density value correction can be performed.

本実施の形態にかかる差分画像生成装置によれば、位置合わせ画像(過去画像)の画素値を被検体の体軸方向に沿って局所領域毎に濃度値補正をしてから、現在画像と差分する。これにより、位置合わせ画像と現在画像との撮影条件の違い、被検体における経年変化、撮影時の姿勢の装置等による濃度値の差を被検体の部位毎に補正してから差分することができ、経時変化がない部位は差分画像により映りにくく、より偽像が発生しにくくなる。その結果、経時変化がある部位のみを明瞭に描出することができる。   According to the difference image generation apparatus according to the present embodiment, the pixel value of the alignment image (past image) is corrected for the density value for each local region along the body axis direction of the subject, and then the difference from the current image. To do. As a result, differences in imaging conditions between the alignment image and the current image, secular changes in the subject, and differences in density values due to posture devices at the time of imaging can be corrected for each region of the subject. A part that does not change with time is not easily reflected by the difference image, and a false image is less likely to occur. As a result, it is possible to clearly depict only a portion having a change with time.

差分画像生成装置の構成を示すハードウェア構成図Hardware configuration diagram showing the configuration of the difference image generation device 差分画像生成方法の処理手順を示すフローチャートThe flowchart which shows the process sequence of the difference image generation method 局所領域補正処理の内容を示す模式図Schematic diagram showing the contents of local area correction processing 局所領域補正処理の流れを示すフローチャートFlowchart showing the flow of local area correction processing 局所領域の設定例を示す模式図Schematic diagram showing an example of setting a local region 濃度値補正曲線の生成処理を示す模式図であって、図6(a)は局所領域の平均最大濃度値の差を体軸方向に沿ってプロットした図、図6(b)は、濃度値補正曲線の一例を示す図FIG. 6A is a schematic diagram illustrating a generation process of a density value correction curve, in which FIG. 6A is a diagram in which a difference between average maximum density values in a local region is plotted along a body axis direction, and FIG. Diagram showing an example of a correction curve 局所領域の他の設定例を示す模式図Schematic diagram showing another setting example of the local region 局所領域の他の設定例を示す模式図Schematic diagram showing another setting example of the local region

符号の説明Explanation of symbols

1…医用画像撮影装置、2…画像データベース、3…LAN、10…差分画像生成装置、11…CPU、12…主メモリ、13…磁気ディスク、14…表示メモリ、15…モニタ、16…キーボード、17…マウス、18…コントローラ、19…共通バス DESCRIPTION OF SYMBOLS 1 ... Medical imaging device, 2 ... Image database, 3 ... LAN, 10 ... Difference image generation apparatus, 11 ... CPU, 12 ... Main memory, 13 ... Magnetic disk, 14 ... Display memory, 15 ... Monitor, 16 ... Keyboard, 17 ... Mouse, 18 ... Controller, 19 ... Common bus

Claims (4)

被検体の同一部位を異なる日時に撮影した第一医用画像及び第二医用画像を取得する医用画像取得手段と、
前記第一医用画像に対し、前記第一医用画像に撮影された部位毎に局所領域を設定するとともに、前記第二医用画像に対し前記部位に対応する領域に局所領域を設定する局所領域設定手段と、
前記第一医用画像に含まれる前記局所領域を代表する画素値及び前記第二医用画像に含まれる前記局所領域を代表する画素値を算出する画素値算出手段と、
前記第二医用画像に含まれる前記局所領域を代表する画素値と、その局所領域に対応する前記第一医用画像の局所領域を代表する画素値と、の差分を求め、前記局所領域の位置と、各位置における前記代表する画素値の差分と、に基づいて、画素位置に対応した画素値の補正値を定めた補正曲線を算出し、当該補正曲線を用いて、補正対象となる画素の画素位置に対応する画素値の補正値を求め、その補正値を、前記第一医用画像の画素値に加算することにより、画素値を補正する補正手段と、
前記補正手段により補正された前記第一医用画像と前記第二医用画像とを差分して差分画像を生成する差分画像生成手段と、
前記差分画像を表示する表示手段と、
を備えることを特徴とする差分画像生成装置。
Medical image acquisition means for acquiring a first medical image and a second medical image obtained by imaging the same part of the subject at different dates and times;
A local area setting unit that sets a local area for each part imaged in the first medical image for the first medical image and sets a local area in an area corresponding to the part for the second medical image When,
Pixel value calculating means for calculating a pixel value representative of the local region included in the first medical image and a pixel value representative of the local region included in the second medical image;
A difference between a pixel value representative of the local area included in the second medical image and a pixel value representative of the local area of the first medical image corresponding to the local area; and a position of the local area; Based on the difference between the representative pixel values at each position, a correction curve that determines a correction value of the pixel value corresponding to the pixel position is calculated, and the pixel of the pixel to be corrected is calculated using the correction curve. Correction means for correcting the pixel value by obtaining a correction value of the pixel value corresponding to the position and adding the correction value to the pixel value of the first medical image ;
Difference image generation means for generating a difference image by subtracting the first medical image and the second medical image corrected by the correction means;
Display means for displaying the difference image;
A difference image generation apparatus comprising:
前記画素値算出手段は、前記第一医用画像及び前記第二医用画像に含まれる前記局所領域を構成する画素のうち、画素値が大きいものから順に所定数の画素を抽出し、当該所定数の画素の画素値の平均値である平均最大画素値を算出し、
前記補正手段は、前記局所領域を代表する画素値として、前記平均最大画素値を用いる、ことを特徴とする請求項1に記載の差分画像生成装置。
The pixel value calculating means extracts a predetermined number of pixels in order from the pixel value having the largest pixel value among the pixels constituting the local region included in the first medical image and the second medical image, and the predetermined number Calculate the average maximum pixel value, which is the average of the pixel values of the pixels,
The difference image generation apparatus according to claim 1, wherein the correction unit uses the average maximum pixel value as a pixel value representing the local region .
前記画素値算出手段は、前記所定数の画素を抽出する際に、同一の画素値を持つ画素が予め定められた数以上ある場合にのみ、前記平均最大画素値を算出するための画素として抽出する、
ことを特徴とする請求項2に記載の差分画像生成装置。
The pixel value calculation unit extracts the predetermined maximum number of pixels as a pixel for calculating the average maximum pixel value only when there are a predetermined number or more of pixels having the same pixel value. To
The difference image generation apparatus according to claim 2 , wherein
被検体の同一部位を異なる日時に撮影した第一医用画像及び第二医用画像を取得する医用画像取得工程と、A medical image acquisition step of acquiring a first medical image and a second medical image obtained by imaging the same part of the subject at different dates and times;
前記第一医用画像に対し、前記第一医用画像に撮影された部位毎に局所領域を設定するとともに、前記第二医用画像に対し前記部位に対応する領域に局所領域を設定する局所領域設定工程と、A local region setting step of setting a local region for each part photographed in the first medical image for the first medical image and setting a local region in a region corresponding to the part for the second medical image When,
前記第一医用画像に含まれる前記局所領域を代表する画素値及び前記第二医用画像に含まれる前記局所領域を代表する画素値を算出する画素値算出工程と、A pixel value calculating step for calculating a pixel value representative of the local region included in the first medical image and a pixel value representative of the local region included in the second medical image;
前記第二医用画像に含まれる前記局所領域を代表する画素値と、その局所領域に対応する前記第一医用画像の局所領域を代表する画素値と、の差分を求め、前記局所領域の位置と、各位置における前記代表する画素値の差分と、に基づいて、画素位置に対応した画素値の補正値を定めた補正曲線を算出し、当該補正曲線を用いて、補正対象となる画素の画素位置に対応する画素値の補正値を求め、その補正値を、前記第一医用画像の画素値に加算することにより、画素値を補正する補正工程と、A difference between a pixel value representative of the local area included in the second medical image and a pixel value representative of the local area of the first medical image corresponding to the local area; and a position of the local area; Based on the difference between the representative pixel values at each position, a correction curve that determines a correction value of the pixel value corresponding to the pixel position is calculated, and the pixel of the pixel to be corrected is calculated using the correction curve. A correction step of correcting the pixel value by obtaining a correction value of the pixel value corresponding to the position and adding the correction value to the pixel value of the first medical image;
前記補正工程により補正された前記第一医用画像と前記第二医用画像とを差分して差分画像を生成する差分画像生成工程と、A difference image generation step of generating a difference image by subtracting the first medical image and the second medical image corrected by the correction step;
前記差分画像を表示する表示工程と、A display step of displaying the difference image;
を含むことを特徴とする差分画像生成方法。The difference image generation method characterized by including.
JP2005044184A 2005-02-21 2005-02-21 Difference image generating apparatus and method Expired - Fee Related JP4626984B2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2005044184A JP4626984B2 (en) 2005-02-21 2005-02-21 Difference image generating apparatus and method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2005044184A JP4626984B2 (en) 2005-02-21 2005-02-21 Difference image generating apparatus and method

Publications (2)

Publication Number Publication Date
JP2006223739A JP2006223739A (en) 2006-08-31
JP4626984B2 true JP4626984B2 (en) 2011-02-09

Family

ID=36985601

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2005044184A Expired - Fee Related JP4626984B2 (en) 2005-02-21 2005-02-21 Difference image generating apparatus and method

Country Status (1)

Country Link
JP (1) JP4626984B2 (en)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5019205B2 (en) * 2007-01-30 2012-09-05 株式会社東芝 Ultrasonic diagnostic equipment
JP5361327B2 (en) * 2008-10-24 2013-12-04 富士フイルムRiファーマ株式会社 ECG synchronized image processing apparatus, method, and computer program
JP6145874B2 (en) 2013-07-23 2017-06-14 富士フイルム株式会社 Radiation image processing apparatus and method
JP6300977B2 (en) * 2017-03-09 2018-03-28 キヤノン株式会社 Subject information acquisition apparatus and subject information acquisition method
JP7140475B2 (en) 2017-08-03 2022-09-21 キヤノン株式会社 IMAGE PROCESSING APPARATUS, IMAGE PROCESSING METHOD, IMAGE PROCESSING SYSTEM AND PROGRAM

Citations (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH04141154A (en) * 1990-10-03 1992-05-14 Konica Corp Radiation image processor
JPH05304605A (en) * 1991-10-31 1993-11-16 Arch Dev Corp Method and system for correcting film picture
JPH07271972A (en) * 1994-03-29 1995-10-20 Fuji Photo Film Co Ltd Image processing method and device therefor
JPH0877329A (en) * 1994-09-02 1996-03-22 Konica Corp Display device for time-sequentially processed image
JPH0876741A (en) * 1994-09-02 1996-03-22 Konica Corp Image display device
JP2591788B2 (en) * 1988-04-27 1997-03-19 株式会社日立メディコ Method for extracting organ region from MRI image
JP2867036B2 (en) * 1989-06-26 1999-03-08 富士写真フイルム株式会社 Abnormal shadow detector
JP2000276605A (en) * 1999-03-19 2000-10-06 Canon Inc Device, system and method for processing image and storage medium
JP2001209785A (en) * 1999-11-19 2001-08-03 Fujitsu Ltd Device and method for image processing and image processing program storage medium
JP2001266147A (en) * 2000-03-15 2001-09-28 Fuji Photo Film Co Ltd Method and device for processing picture
JP2002077728A (en) * 2000-08-25 2002-03-15 Fuji Photo Film Co Ltd Method for processing time base subtracted image and device for the same
JP2002109538A (en) * 2000-10-03 2002-04-12 Fuji Photo Film Co Ltd Method and device for aligning image
JP2002190010A (en) * 2000-12-22 2002-07-05 Mitsubishi Space Software Kk Method and device for correcting difference image for detecting shape change
JP2002325761A (en) * 2000-06-30 2002-11-12 Hitachi Medical Corp Image diagnosis supporting device
JP2004048587A (en) * 2002-07-15 2004-02-12 Mitsubishi Space Software Kk Computer-assisted diagnostic method and system therefor
JP2004186873A (en) * 2002-12-02 2004-07-02 Fuji Photo Film Co Ltd Image processing apparatus
JP3577680B2 (en) * 1995-04-27 2004-10-13 コニカミノルタホールディングス株式会社 Image processing device
WO2005009242A1 (en) * 2003-07-28 2005-02-03 Hitachi Medical Corporation Medical image processing device and method

Patent Citations (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2591788B2 (en) * 1988-04-27 1997-03-19 株式会社日立メディコ Method for extracting organ region from MRI image
JP2867036B2 (en) * 1989-06-26 1999-03-08 富士写真フイルム株式会社 Abnormal shadow detector
JPH04141154A (en) * 1990-10-03 1992-05-14 Konica Corp Radiation image processor
JPH05304605A (en) * 1991-10-31 1993-11-16 Arch Dev Corp Method and system for correcting film picture
JPH07271972A (en) * 1994-03-29 1995-10-20 Fuji Photo Film Co Ltd Image processing method and device therefor
JPH0877329A (en) * 1994-09-02 1996-03-22 Konica Corp Display device for time-sequentially processed image
JPH0876741A (en) * 1994-09-02 1996-03-22 Konica Corp Image display device
JP3577680B2 (en) * 1995-04-27 2004-10-13 コニカミノルタホールディングス株式会社 Image processing device
JP2000276605A (en) * 1999-03-19 2000-10-06 Canon Inc Device, system and method for processing image and storage medium
JP2001209785A (en) * 1999-11-19 2001-08-03 Fujitsu Ltd Device and method for image processing and image processing program storage medium
JP2001266147A (en) * 2000-03-15 2001-09-28 Fuji Photo Film Co Ltd Method and device for processing picture
JP2002325761A (en) * 2000-06-30 2002-11-12 Hitachi Medical Corp Image diagnosis supporting device
JP2002077728A (en) * 2000-08-25 2002-03-15 Fuji Photo Film Co Ltd Method for processing time base subtracted image and device for the same
JP2002109538A (en) * 2000-10-03 2002-04-12 Fuji Photo Film Co Ltd Method and device for aligning image
JP2002190010A (en) * 2000-12-22 2002-07-05 Mitsubishi Space Software Kk Method and device for correcting difference image for detecting shape change
JP2004048587A (en) * 2002-07-15 2004-02-12 Mitsubishi Space Software Kk Computer-assisted diagnostic method and system therefor
JP2004186873A (en) * 2002-12-02 2004-07-02 Fuji Photo Film Co Ltd Image processing apparatus
WO2005009242A1 (en) * 2003-07-28 2005-02-03 Hitachi Medical Corporation Medical image processing device and method

Also Published As

Publication number Publication date
JP2006223739A (en) 2006-08-31

Similar Documents

Publication Publication Date Title
US20190355174A1 (en) Information processing apparatus, information processing system, information processing method, and computer-readable recording medium
JP5665903B2 (en) Image processing apparatus and method, image processing system, and program
JP4104054B2 (en) Image alignment apparatus and image processing apparatus
JP5722414B1 (en) Osteoporosis diagnosis support device
JP5210615B2 (en) Medical image diagnosis support apparatus and medical image diagnosis support program
US7406187B2 (en) Method and system for processing an image
JP4626984B2 (en) Difference image generating apparatus and method
EP3201876B1 (en) Medical image processing apparatus, medical image processing method
US20180342079A1 (en) Image processing apparatus, image processing method, and computer readable recording medium
US20150243027A1 (en) Image processing device, image processing method, and program
CN110876627B (en) X-ray imaging apparatus and X-ray image processing method
JP4849449B2 (en) Medical image diagnosis support device
JP4416823B2 (en) Image processing apparatus, image processing method, and computer program
JP2009075846A (en) Outline extraction device and program
JP2007209583A (en) Medical image processor
JP4201939B2 (en) Image processing apparatus and radiation therapy planning system
JP2005270635A (en) Method for processing image and device for processing image
JP6371515B2 (en) X-ray image processing apparatus, X-ray image processing method, and program
JP2001291087A (en) Method and device for positioning image
JP2005136594A (en) Image processing apparatus and control method thereof
JP7387280B2 (en) Image processing device, image processing method and program
JP2004152043A (en) Method for correcting difference image, and image processor
JP4967967B2 (en) Image diagnosis support apparatus and program
JP6167841B2 (en) Medical image processing apparatus and program
JP2006026396A (en) Image processing system and method, control program, and storage medium

Legal Events

Date Code Title Description
A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20071210

RD02 Notification of acceptance of power of attorney

Free format text: JAPANESE INTERMEDIATE CODE: A7422

Effective date: 20090717

RD04 Notification of resignation of power of attorney

Free format text: JAPANESE INTERMEDIATE CODE: A7424

Effective date: 20090721

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20100420

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20100422

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20100609

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20101102

A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20101102

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20131119

Year of fee payment: 3

R150 Certificate of patent or registration of utility model

Free format text: JAPANESE INTERMEDIATE CODE: R150

S111 Request for change of ownership or part of ownership

Free format text: JAPANESE INTERMEDIATE CODE: R313111

S533 Written request for registration of change of name

Free format text: JAPANESE INTERMEDIATE CODE: R313533

R350 Written notification of registration of transfer

Free format text: JAPANESE INTERMEDIATE CODE: R350

LAPS Cancellation because of no payment of annual fees