JP5789211B2 - Similar image retrieval apparatus, method and program - Google Patents

Description

  The present invention relates to a similar image retrieval apparatus, method, and program, and more particularly to a technique for retrieving a desired medical image from medical images such as case images registered in a database.

  In Patent Document 1, a region of interest (ROI) is provided for an image to be diagnosed, and a similar image having similar features on the ROI image and information such as a diagnosis result of the similar image are retrieved from a database and displayed. An image search system is described.

  Patent Document 2 describes a three-dimensional similar image search device that extracts a region of interest from a diagnostic image and performs a similar search using a feature amount of the region of interest.

  Patent Document 3 describes a disease candidate information output system that searches for a similar case from a database based on information obtained by image analysis of an image to be diagnosed and disease state information.

  Patent Documents 4 and 5 describe an example of a technique for automatically extracting a lesion area.

  Patent Document 6 describes an example of a technique for recognizing a positional relationship (imaging direction) of a human body, or an imaging direction and an imaging region.

  Patent Documents 7 and 8 describe examples of techniques for recognizing blood vessels and organs based on feature amounts such as image contours and pixel values.

  Non-Patent Document 1 describes an example of a technique for extracting a region based on position information of a region of interest. The user designates the position, detects the contour of the designated region, and if there is a correction, the user corrects the contour, so that highly accurate region extraction can be obtained by inputting position information several times.

  Non-Patent Document 2 describes an example of a technique for obtaining shape information and texture information of an ROI lesion.

JP 2004-5364 A JP 2001-117936 A JP 2003-325458 A JP 2005-198887 A Japanese Patent Laid-Open No. 2005-246032 Japanese Patent No. 3766033 Japanese Patent Laid-Open No. 2004-230086 Japanese Patent No. 2845995

Lee, Hara, Ito, Shimura “Machine Learning Approach for Interactive Lesion Segmentation”, SPIE Minutes, Vol. 6512, 651246 (2007) (Y. Li, S. Hara, W. Ito, K. Shimura, “A Machine Learning approach for interactive lesion segmentation ”, Proceedings of the SPIE, Volume 6512, pp 651246 (2007) Couts, Edwards, Taylor, “Dynamic Appearance Model”, 5th Computer Vision European Conference Report, Germany, Springer, 1998, Vol. 2, 484-498 (TF Coootes, GJ Edwards, CJ Taylor “Active Appearance Models” , In Proc. 5th European Conference on Computer Vision, Springer)

  When searching for a case image or the like having a similar feature amount based on a feature amount calculated from an image of a predetermined extraction region of the diagnosis target image (similar image search), a similar image based on the diagnosis target image and this image If the image format and image type of the searched image do not match, there is a problem that a similar image search cannot be performed or a similar image search with high accuracy cannot be performed.

  For example, an original CT image captured by an X-ray CT apparatus has a pixel value represented by a CT value (16 bits: −1000 to 2000), while a CT image displayed on a display has its pixel value. The value is represented by a density value for display (8 bits: 0 to 255). Therefore, when a similar image is searched from the original CT images registered in the database using the CT image converted for display as an image to be diagnosed, the pixel values (dynamic range of the images) of both images are obtained. Since the images differ greatly from each other even in the case of images corresponding to the same disease, there arises a problem that a desired similar image search cannot be performed.

  Similarly, there is a problem in that appropriate similar image search cannot be performed between images (CT images, MRI images, X-ray images, ultrasonic images, endoscopic images, pathological images, etc.) having different imaging modalities (types of imaging devices). There is.

  Patent Document 1 and the like have a description regarding CT images and MRI images, but there is no description indicating the above problem.

  The present invention has been made in view of such circumstances, and provides a similar image search apparatus, method, and program capable of performing a similar image search well even between medical images having different image formats and imaging modalities. For the purpose.

In order to achieve the above object, a similar image search apparatus according to an aspect of the present invention provides a search calculated based on a first medical image and an image of a required region of interest included in the first medical image. An image for acquiring a second medical image to be diagnosed that is different from at least one of the dynamic range of the image and the type of the imaging device from the database registered in association with the feature amount for the first medical image An acquisition unit; an extraction unit that extracts an image of a required region of interest from the second medical image; and an image conversion that converts the image of the region of interest extracted by the extraction unit into an image of the same evaluation criterion as that of the first medical image Means, a first feature value calculating means for calculating a feature value relating to a pixel value of the image and a feature value relating to the shape of the attention area from the image of the attention area converted by the image conversion means, and an image conversion means. Second feature amount calculation means for calculating a feature amount related to the pixel value of the image and not dependent on the size of the pixel value and a feature amount related to the shape of the attention region from the converted image of the attention region A feature quantity calculated by the first feature quantity calculation means and a feature quantity calculated by the second feature quantity calculation means, and a search feature quantity registered in the database, Search means for searching for a similar first medical image based on the comparison between the first medical image and the second medical image, when the types of the imaging devices are different, the feature amount relating to the pixel value of the image If the feature value independent of the size of the pixel value and the feature value related to the shape of the attention area are selected as the search feature values and only the dynamic range is different, the feature value related to the pixel value of the image and the attention area In the shape of Search means for selecting as a feature for searching the feature amount, and a.
The similar image search device according to still another aspect of the present invention includes a first medical image and a search feature amount calculated based on a required image of a region of interest included in the first medical image. An image acquisition means for acquiring a second medical image to be diagnosed, wherein at least one of the dynamic range of the image and the type of the imaging device is different from the database registered in association with the first medical image; An image conversion means for converting the medical image of the first medical image into an image having the same evaluation criteria as the first medical image, an extraction means for extracting an image of a required region of interest from the second medical image converted by the image conversion means, A first feature amount calculating means for calculating a feature value related to a pixel value of the image and a feature value related to the shape of the attention area from the image of the attention area extracted by the means; and an image of the attention area extracted by the extraction means. Second feature value calculating means for calculating a feature value related to the pixel value of the image and not dependent on the size of the pixel value, and a feature value related to the shape of the region of interest, and a first feature value Similarity is based on a comparison between the feature quantity calculated by the calculation means and the feature quantity calculated by the second feature quantity calculation means and the feature quantity for search registered in the database. A search means for searching for a first medical image, wherein the first medical image and the second medical image are feature quantities relating to pixel values of the image when the types of the imaging devices are different, and the pixel values The feature quantity independent of the size and the feature quantity related to the shape of the attention area are selected as the search feature quantities. For search It includes search means for selecting as a symptom amount.
In order to achieve the above object, a similar image search apparatus according to an aspect of the present invention is calculated based on an original first medical image and an image of a required region of interest included in the first medical image. The database registered in association with the search feature amount and the first medical image acquire a second medical image to be diagnosed that differs in at least one of the dynamic range of the image and the type of the imaging device. An image acquisition unit, an extraction unit that extracts an image of a required region of interest from the second medical image, and a second medical image extracted by the extraction unit is converted into an image having the same evaluation criteria as the first medical image. An image converting unit; a first feature amount calculating unit that calculates an image feature amount from an image of a region of interest converted by the image converting unit; and a feature amount and database calculated by the first feature amount calculating unit Comprises a retrieval means for retrieving the first medical image similar based on a comparison between the feature quantity for registered search, the.

  According to one aspect of the present invention, an image of a region of interest extracted from a second medical image to be diagnosed is converted into an image with the same evaluation criteria as the first medical image registered in the database, and then the image Since the similar image search is performed based on the comparison between the calculated feature amount and the search feature amount registered in the database, the first medical image registered in the database is calculated. On the other hand, even if the dynamic range of the image of the second medical image to be diagnosed is different or the type of the imaging device is different, similar image search can be performed.

  The similar image inspection apparatus according to another aspect of the present invention associates an original first medical image with a feature value for search calculated based on an image of a required region of interest included in the first medical image. An image acquisition means for acquiring a second medical image to be diagnosed in which at least one of the dynamic range of the image and the type of the imaging device is different from the registered database and the first medical image; Image conversion means for converting a medical image into an image of the same evaluation standard as the first medical image, extraction means for extracting an image of a required region of interest from the second medical image converted by the image conversion means, and extraction means First feature amount calculating means for calculating the feature amount of the image from the image of the region of interest extracted by the above, a feature amount calculated by the first feature amount calculating means, and a search feature amount registered in the database of And a, a retrieving means for retrieving a first medical image similar based on compare.

  Other aspects of the present invention have the same configuration as the aspect of the present invention, except that the order of processing of the extraction means and the image conversion means is reversed.

  In the similar image search device according to still another aspect of the present invention, the first medical image is an image made up of CT values, the second medical image is an image made up of density values for display, and the image conversion means The image composed of display density values is converted into an image composed of CT values.

  In the similar image search device according to still another aspect of the present invention, the second medical image is a CT image composed of display density values, and additional information indicating a window center and a window width of the CT value, or a CT value A conversion table at the time of conversion from the image of FIG. 1 to the image of the density value for display, and the image conversion means converts the CT image composed of the density value for display into an image composed of the CT value based on the attached information or the conversion table. I try to convert it.

  In the similar image search device according to still another aspect of the present invention, the density values of two or more parts having stable CT values, such as air, water, fat, and bone, among the images composed of the density values for display are obtained by the user. Includes a manual designation means for designating from an image or an automatic designation means for designating by automatically estimating a part from an anatomical position, and the image conversion means includes the density values of two or more designated parts in the part. It is preferable to convert an image made up of display density values into an image made up of CT values so as to obtain corresponding CT values.

  In the similar image search device according to still another aspect of the present invention, the first feature amount calculating means includes a feature amount related to the pixel value of the image of the attention region and a feature amount related to the shape of the attention region based on the image of the attention region. Is preferably calculated.

  In the similar image search device according to still another aspect of the present invention, the feature amount related to the pixel value of the image of the region of interest is at least one of an average value, a maximum value, a minimum value, a luminance histogram, and a texture of the pixel value of the image. Preferably including one.

  In the similar image search device according to still another aspect of the present invention, the feature amount is related to the pixel value of the image of the attention area based on the image of the attention area extracted by the extraction unit, and is not dependent on the magnitude of the pixel value. And a second feature amount calculation unit that calculates a feature amount and a feature amount related to the shape of the region of interest, and the search unit is calculated by at least one of the first feature amount calculation unit and the second feature amount calculation unit. It is preferable to search for a similar first medical image based on a comparison between the obtained feature quantity and the search feature quantity registered in the database. For example, when the first medical image is a CT image, the first medical image has a CT value corresponding to the X-ray transmittance for each region. Therefore, the feature amount calculated by the first feature amount calculating unit is used, When the medical image is an MRI image, the same part has different pixel values depending on the imaging conditions. Therefore, the feature quantity calculated by the second feature quantity calculation means (feature quantity not affected by the magnitude of the pixel value) ).

  In the similar image search device according to still another aspect of the present invention, one feature amount of the feature amount calculated by the first feature amount calculation unit and the feature amount calculated by the second feature amount calculation unit is obtained. Selection means for selecting according to a selection instruction from a user, and the search means searches for a similar first medical image based on a comparison between the feature quantity selected by the selection means and the search feature quantity registered in the database. It is preferable to do.

  In the similar image search device according to still another aspect of the present invention, the feature quantity related to the pixel value of the image of the attention area and not depending on the size of the pixel value is the contrast between the attention area and the surrounding area, the attention area It is preferable that at least one of dispersion, deviation, and texture of pixel values of the image of the image is included.

  In the similar image search device according to still another aspect of the present invention, the feature amount related to the shape of the region of interest is at least one of the anatomical position, circularity, moment, radius, and area of the region of interest. It is preferable to include.

The similar image search method according to still another aspect of the present invention includes a first medical image and a search feature amount calculated based on an image of a required region of interest included in the first medical image. An image acquisition step of acquiring a second medical image to be diagnosed having a database registered in association with at least one of the dynamic range of the image and the type of the imaging device from the first medical image; An extraction step for extracting an image of a required region of interest from the second medical image, an image conversion step for converting the image of the region of interest extracted by the extraction step into an image having the same evaluation criteria as the first medical image, and an image A first feature amount calculating step for calculating a feature amount relating to a pixel value of the image of interest and a feature amount relating to the shape of the attention region from the image of the attention region converted by the conversion step; A second feature value for calculating a feature value related to the pixel value of the image and not dependent on the size of the pixel value, and a feature value related to the shape of the attention region from the image of the attention region converted by the step One of the feature quantity calculated by the calculation step, the feature quantity calculated by the first feature quantity calculation step and the feature quantity calculated by the second feature quantity calculation step, and the search feature registered in the database A search step for searching for a similar first medical image based on a comparison with a quantity, wherein the first medical image and the second medical image are related to pixel values of the image when the types of the imaging devices are different; A feature amount that does not depend on the size of the pixel value and a feature amount related to the shape of the region of interest are selected as search feature amounts, and if only the dynamic range is different, the pixel value of the image is related. A search step of selecting as a feature for searching the feature quantity relating to the shape of the feature region of interest that includes a.
The similar image search method according to still another aspect of the present invention includes a first medical image and a search feature amount calculated based on an image of a required region of interest included in the first medical image. An image acquisition step of acquiring a second medical image to be diagnosed having a database registered in association with at least one of the dynamic range of the image and the type of the imaging device from the first medical image; An image conversion step for converting the second medical image into an image having the same evaluation criteria as the first medical image, and an extraction step for extracting an image of a required region of interest from the second medical image converted by the image conversion step; A first feature amount calculating step for calculating a feature amount related to the pixel value of the image and a feature amount related to the shape of the attention region from the image of the attention region extracted in the extraction step; A second feature value for calculating a feature value related to the pixel value of the image and not dependent on the size of the pixel value, and a feature value related to the shape of the attention region One of the feature quantity calculated by the calculation step, the feature quantity calculated by the first feature quantity calculation step and the feature quantity calculated by the second feature quantity calculation step, and the search feature registered in the database A search step for searching for a similar first medical image based on a comparison with a quantity, wherein the first medical image and the second medical image are related to pixel values of the image when the types of the imaging devices are different; A feature quantity that does not depend on the size of the pixel value and a feature quantity related to the shape of the region of interest are selected as search feature quantities. If only the dynamic range is different, the feature value is related to the pixel value of the image. A search step of selecting the feature quantity relating to the shape of butterfly weight region of interest as the feature for search includes.
The similar image search method according to still another aspect of the present invention includes an original first medical image, and a search feature amount calculated based on an image of a required region of interest included in the first medical image. An image acquisition step of acquiring a second medical image to be diagnosed that has at least one of the dynamic range of the image and the type of the imaging device different from the first medical image; An extraction step of extracting an image of a required attention area from the second medical image, and an image conversion step of converting the second medical image extracted by the extraction step into an image having the same evaluation standard as that of the first medical image; A first feature amount calculation step for calculating a feature amount of the image from the image of the attention area converted by the image conversion step, and a feature amount calculated by the first feature amount calculation step. A first search step of searching a medical image similar based on a comparison between the feature quantity for searching registered in the database includes.

  The similar image search method according to still another aspect of the present invention includes an original first medical image, and a search feature amount calculated based on an image of a required region of interest included in the first medical image. An image acquisition step of acquiring a second medical image to be diagnosed that has at least one of the dynamic range of the image and the type of the imaging device different from the first medical image; An image conversion step for converting the second medical image into an image having the same evaluation standard as that of the first medical image, and an extraction step for extracting an image of a required attention area from the second medical image converted by the image conversion step A first feature amount calculating step for calculating a feature amount of the image of interest from the image of the region of interest extracted by the extraction step, and a feature amount calculated by the first feature amount calculating step It includes a searching step of searching the first medical image similar based on a comparison between the feature quantity for search is registered in the database.

  In the similar image search method according to still another aspect of the present invention, the first medical image is an image composed of CT values, the second medical image is an image composed of display density values, and the image conversion step comprises: The image composed of display density values is converted into an image composed of CT values.

  In the similar image search method according to still another aspect of the present invention, the second medical image is a CT image composed of density values for display, and additional information indicating a window center and a window width of the CT value, or a CT value A conversion table at the time of conversion from the image of FIG. 1 to the image of the density value for display, and the image conversion step converts the CT image composed of the density value for display into an image composed of the CT value based on the attached information or the conversion table. I try to convert it.

  In the similar image search method according to still another aspect of the present invention, the density values of two or more parts having stable CT values, such as air, water, fat, and bone, among the images composed of the density values for display are obtained by the user. Includes a manual designation step that designates from an image or an automatic designation step that designates by automatically estimating a part from an anatomical position, and the image conversion step includes the density values of two or more designated parts in the part. It is preferable to convert an image made up of display density values into an image made up of CT values so as to obtain corresponding CT values.

  In the similar image search method according to still another aspect of the present invention, the first feature value calculating step includes a feature value related to a pixel value of an image of the attention area and a feature value related to the shape of the attention area based on the image of the attention area. Are preferably calculated.

  In the similar image search method according to yet another aspect of the present invention, the feature amount related to the pixel value of the image of the region of interest is an average value, variance, maximum value, minimum value, luminance histogram, or texture of the pixel value of the image. It is preferable that at least one of these is included.

  In the similar image search method according to still another aspect of the present invention, the feature amount is related to the pixel value of the image of the attention area based on the image of the attention area extracted by the extraction step, and is not dependent on the size of the pixel value. And a second feature amount calculation step for calculating a feature amount relating to the shape of the region of interest, and the search step is calculated by at least one of the first feature amount calculation step and the second feature amount calculation step. It is preferable to search for a similar first medical image based on a comparison between the obtained feature quantity and the search feature quantity registered in the database.

  In the similar image search method according to still another aspect of the present invention, one of the feature amount calculated by the first feature amount calculation step and the feature amount calculated by the second feature amount calculation step is calculated. A selection step of selecting by a user selection instruction, wherein the search step searches for a similar first medical image based on a comparison between the feature quantity selected by the selection step and the search feature quantity registered in the database. It is preferable to do.

  In the similar image search method according to still another aspect of the present invention, the feature quantity related to the pixel value of the image of the attention area, which does not depend on the size of the pixel value, includes the contrast between the attention area and the surrounding area, and the attention area. It is preferable that at least one of dispersion, deviation, and texture of pixel values of the image of the image is included.

  In the similar image search method according to still another aspect of the present invention, the feature amount related to the shape of the region of interest is at least one of the anatomical position, the circularity, the moment, the radius, and the area of the region of interest. It is preferable to include.

  A similar image search program according to a twenty-third aspect is characterized in that the similar image detection device according to any one of the first to eleventh aspects is realized by a computer.

  According to the present invention, after converting the image of the region of interest extracted from the second medical image to be diagnosed into an image having the same evaluation criteria as the first medical image registered in the database, the feature amount of the image Since the similar image search is performed based on the comparison between the calculated feature quantity and the search feature quantity registered in the database, the first medical image registered in the database and the diagnosis target are calculated. Even if the second medical image has a different image format or imaging modality, a similar image search can be performed satisfactorily.

The block diagram which shows embodiment of the similar image search device which concerns on this invention Diagram showing an example of database structure The functional block diagram which shows the processing content in the similar image search device which concerns on this invention The figure which shows the relationship between the window center WC in the image which consists of CT values, window width WW, and the pixel value for a display The figure which shows the relationship between the pixel value and CT value of each site | part, such as fat in the display image, water, and a bone region The figure which shows an example of the feature-value for a search registered into a database The flowchart which shows the process sequence of the similar image search method which concerns on this invention. Chart indicating whether feature quantity A or feature quantity A2 is used as a search feature quantity in the relationship between the type of diagnostic image and the type of case image

  Embodiments of a similar image search device, method, and program according to the present invention will be described below with reference to the accompanying drawings.

<Device configuration>
FIG. 1 is a block diagram showing an embodiment of a similar image retrieval apparatus according to the present invention.

  This similar image search apparatus 1 is mainly composed of a similar image search apparatus main body 10 operated by an interpreting doctor, a clinician, and the like, a database 50, and a network 60 such as a hospital LAN connecting them. Note that imaging modalities such as an X-ray CT apparatus 70 and an MRI apparatus 72 are connected to the network 60.

  The similar image retrieval apparatus main body 10 is constituted by, for example, a personal computer (personal computer), and mainly stores a central processing unit (CPU) 12 that controls the operation of each component and a control program for the apparatus or executes a program. Main memory 14 serving as a working area, a graphic board 16 for controlling display on a monitor device 30 such as a liquid crystal display or a liquid crystal display, a communication interface (communication I / F) 18 connected to a network 60, a personal computer Operating system (OS), device drivers of peripheral devices connected to a personal computer, hard disk device 20 storing various application software including a similar image search program according to the present invention, CD-ROM drive 22, keyboard 32 key operations detected A keyboard controller 24 that outputs to the CPU 12 as an instruction input, and a mouse controller that detects the state of the mouse 34 as a position input device and outputs signals such as the position of the mouse pointer on the monitor device 30 and the state of the mouse 34 to the CPU 12. 26.

  The personal computer having the above-described configuration is well-known except for the similar image search program according to the present invention stored in the hard disk device 20, and a detailed description of each component will be omitted.

  In the database 50, as shown in FIG. 2, case images such as original CT images, MRI images, and display images that are search target images are associated with feature amount information for search.

  Case images may be classified and registered by imaging modality, or classified and registered by disease, and text-based diagnosis such as a diagnostic report created by an interpreting physician on the case image of each disease that has been confirmed. Information may be associated and registered.

The original CT image is a 16-bit black-and-white (grayscale) image representing a CT value calculated based on the X-ray absorption value of the human body. The original MRI image is a measurement of proton density and the like. It is a black and white image of 10 to 16 bits per pixel representing a value.
On the other hand, a display image (without an original image) acquired via a network or the like is an 8-bit monochrome image.

  The feature amount information for search is information on the feature amount calculated from the image of the lesion area of the case image, and relates to the feature amount relating to the pixel value of the lesion area (measured value in the imaging modality, etc.) and the shape of the lesion area. Contains feature information. Details of these feature amounts will be described later.

  The X-ray CT apparatus 70 and the MRI apparatus 72 capture a large number of slice images that are continuous along the body axis direction of the subject. The slice image group photographed by the X-ray CT apparatus 70 and the MRI apparatus 72 is, for example, an DICOM (Digital Image and Communication in Medicine) standard image file (patient identification information (patient ID), photographing date and time, etc. are described. As an image file having header information) via the network 60 and stored in the hard disk device 20 or a hospital database (not shown).

  The image interpretation doctor or clinician operates the similar image search device 1 to acquire a slice image group from the hard disk device 20, displays the slice image to be diagnosed on the monitor device 30, and interprets the image displayed on the monitor device 30. And create interpretation reports and medical records. At this time, the similar image retrieval apparatus 1 retrieves and presents a similar image from case images registered in the database 50 based on the image of the attention area of the slice image to be diagnosed, and performs image diagnosis support.

  In the embodiment shown in FIG. 1, the similar image search device main body 10 and the database 50 are connected via the network 60. However, the present invention is not limited to this, and the similar image search device main body 10 and the database 50 are connected. May be configured integrally.

<Similar image search>
FIG. 3 is a functional block diagram showing processing contents in the similar image search apparatus 1 according to the present invention.

  As shown in FIG. 3, the similar image search apparatus 1 includes an input unit 40 (image acquisition unit), an image analysis unit 42 (extraction unit), a feature amount conversion unit 44 (feature amount calculation unit, image conversion unit), A similar image search unit 46 (search means), a display unit 48, and a database 50 are included.

  The input unit 40 is a part for inputting image data to be diagnosed, and corresponds to a part for acquiring image data from the communication I / F 18 or the hard disk device 20 by operating the keyboard 32 or the mouse 34 in FIG. The image analysis unit 42, the feature amount conversion unit 44, and the similar image search unit 46 correspond to the CPU 12 that performs various processes according to the similar image search program, and the display unit 48 corresponds to the monitor device 30.

  The image data to be diagnosed input by the input unit 40 is added to the image analysis unit 42.

  The image analysis unit 42 obtains image data as image analysis information, extracts an attention area (abnormal shadow area), and analyzes the position of the attention area / area and the entire image.

  Extraction of a region of interest is performed automatically or semi-automatically using an image processing technique that uses known features such as the contour / pixel value and position information of an image (Patent Documents 1 to 3, JP 2009-153 A). No. publication).

  In addition, the image analysis unit 42 performs analysis of information necessary for creating a report, such as a region of interest, a region around the region, and a position analysis of the entire image. Examples include the following:

(a) Imaging Part of Region of Interest As an example of part recognition processing in the imaging part analysis unit, a known image processing technique using image contours / pixel values, characteristics of human body positional relationship, and the like as in Patent Document 6 Is applicable.

(b) Recognition of blood vessels around the region of interest and existing organs Processing for recognizing blood vessels and organs is performed on the image data. As an example of processing, a well-known image processing technique using image contours / pixel values, features of a human body's positional relationship, and the like as in Patent Document 7 for blood vessels and Patent Document 8 for organs can be applied.

  Next, the feature amount conversion unit 44 performs processing for converting the image of the region of interest (various images) extracted by the image analysis unit 42 into one evaluation criterion.

[Image consisting of density values for display (8 bits) → CT image consisting of CT values (16 bits)]
When the image data to be diagnosed is a CT image converted into an 8-bit display image, it is converted into the same dynamic range as the 16-bit original CT image. There are the following conversion methods.

  (a) A conversion table for creating a display image (8 bits) from an original CT image (16 bits), or a window center WC (Window center) and a window width WW in the CT image of the display image as shown in FIG. Save (Window Width) in association with the display image. You may preserve | save as header information of the file of the image for a display.

  The feature amount conversion unit 44 can convert the 8-bit display image into a CT image composed of 16-bit CT values if the conversion table, the window center WC, and the window width WW information can be acquired.

  (b) As shown in FIG. 5, conversion of pixel values for display and CT values from pixel values of each part where CT values are stable, such as air regions, water, fats, bone regions, etc. in the display image (8 bits) The characteristics are estimated and converted back into a CT image composed of CT values. There are a method in which the user determines the pixel value of each part of the display image by designating water, fat, bone region, etc. on the image, and a method in which the part is estimated by determining the part from the anatomical position. As an example of estimating a region, a known image processing technique using image contours / pixel values, characteristics of a human body's positional relationship, and the like as in Patent Document 7 for a blood vessel and Patent Document 8 for an organ can be applied. .

  The feature amount conversion unit 44 calculates various feature amounts for the image of the attention area whose dynamic range has been converted as described above. In addition, when the input image data to be diagnosed is other than a display image created from an original CT image (for example, an original CT image, an MRI image, a display image created from an MRI image, etc.). Without performing the dynamic range conversion, various feature amounts are calculated for the extracted image of the attention area.

  The following feature amounts are conceivable as the feature amount calculated by the feature amount conversion unit 44.

(a) The feature value related to the pixel value such as the average value, maximum value, minimum value, luminance histogram, contrast, variance, texture of the pixel value in the attention area, the anatomical position of the attention area, the circularity of the contour, the moment, Features related to shape such as radius and area
(b) Shape information and texture information of a lesion in a region of interest obtained by the method of Non-Patent Document 2 and various filter processes
(c) The output value of a function (or threshold) that discriminates a certain feature. The method for setting the discriminant function is not particularly limited. For example, a statistical method using known data (learning data) such as SVM (support vector machine) (for example, Nero Christianini, John -Linear or non-linear discriminant functions used for well-known class classification such as “Introduction to Support Vector Machine” by Taylor, etc.) can be used.

  Note that the feature quantity related to the shape such as the anatomical position of the region of interest, the circularity of the contour, the moment, the radius, and the area calculated by the feature quantity conversion unit 44 is less dependent on the imaging modality. Can be used for

  Also, information representing pixel values is converted into information such as contrast (difference in density between the region of interest and surroundings), variance (deviation), and texture, and normalized by the average and deviation determined for each modality.

  The information corresponding to the findings may use detection filters set for each modality such as ring-shaped changes, line structure strength, calcification, and cavities, and scores of functions (or threshold values) that distinguish features. . The method for setting the discriminant function is not particularly limited. For example, a statistical method using known data (learning data) such as SVM (support vector machine) (for example, Nero Christianini, John -Linear or non-linear discriminant functions used for well-known class classification such as “Introduction to Support Vector Machine” by Taylor, etc.) can be used.

  Normalization is performed when the score has a different value range for each modality.

  Note that the region of interest may be extracted from the data after conversion by the feature amount conversion unit 44 instead of the image analysis unit 42. That is, first, the entire image data to be diagnosed may be converted into one evaluation standard, and then the attention area may be extracted by the image analysis unit 42.

  The similar image search unit 46 calculates the feature amount calculated by the feature amount conversion unit 44 and the feature amount for search calculated from the lesion area image of the case image registered in the database 50 (calculated by the feature amount conversion unit 44). Similarity is calculated by comparison with the feature amount calculated in the same manner as the feature amount, a case image is determined, and is output to the display unit 48.

  Here, for example, the search feature quantities registered in the database 50 may be those shown in FIG. FIG. 6 shows feature amounts A (A1, A2) and B for search. These feature amounts A and B are associated with the case image by, for example, unique identification information (UID).

  Here, among the feature values A related to the pixel values, the feature values A1 such as the average value, the maximum value, the minimum value, and the luminance histogram of the pixel values in the attention area are feature values that depend on the difference in the image format and the imaging modality. The feature amount A2 such as contrast, variance (deviation), and texture is a feature amount that does not depend on the difference in image format and imaging modality.

  On the other hand, the feature quantity B relating to the shape such as the anatomical position of the region of interest, the circularity of the outline, the moment, the radius, and the area is a feature quantity that does not depend on the difference in image format and imaging modality.

  For calculating the similarity, a known method for calculating the similarity of multivalued data such as a difference in value between a feature value calculated from a diagnostic image and a feature value for search, a least square distance in the feature value space, a Mahalanobis distance, etc. Is used. When a discriminant function of a certain feature is used as a feature amount, processing such as narrowing down or prioritizing similar images having the same discrimination result may be performed. Processing such as narrowing down or prioritizing similar images having the same part / position information may also be performed.

[Similar image search method]
FIG. 7 is a flowchart showing the processing procedure of the similar image search method according to the present invention, and this processing is carried out by starting a similar image search program.

  The interpretation doctor operates the keyboard 32 and the mouse 34 of the similar image search apparatus main body 10 to input a patient name, an imaging date and time, an imaging region, and the like, and reads a desired diagnostic image from the hard disk device 20 based on the input information. Then, it is displayed on the monitor device 30 (step S10).

  The image analysis unit 42 extracts a region of interest from the diagnostic image and analyzes the position of the region of interest, the periphery of the region, and the entire image (step S12). Is calculated (see step S14, FIG. 6).

  When the input diagnostic image is a display image (8 bits) generated from a CT image, the feature amount conversion unit 44 stores the extracted image of the attention area (display image (8 bits)) in a database. 50, the image analysis unit 42 converts the feature amount A related to the pixel value based on the image of the attention area in which the dynamic range is converted. Calculate (step S14).

  Next, in the relationship between the type of input diagnostic image and the type of case image registered in the database 50, the feature amount A as the feature amount for search out of the feature amounts A related to the pixel values shown in FIG. A selection is made as to whether to use (A1 + A2) or the feature amount A2 (step S16).

  FIG. 8 is a chart showing whether the feature amount A or the feature amount A2 is used as the search feature amount in the relationship between the type of diagnosis image and the type of case image.

  As shown in FIG. 8, when the diagnostic image is an original CT image, among the case images in the database 50, the original CT image and the display image (CT) case image generated from the CT image are used. On the other hand, the feature quantity A is selected as the search feature quantity, and the feature quantity A2 is selected as the search feature quantity for case images of other images (images of other modalities).

  That is, when the case image is an original CT image or display image (CT), the search feature amount A1 registered in the database 50 in association with these images depends on the difference in image format and imaging modality. In the case of the above case image, the imaging modality is the same (CT apparatus) and the D range is calculated from the same image data. Can be used.

  On the other hand, the feature amount A1 for search registered in association with other images (case images having different imaging modalities) and the feature amount A1 depending on the difference in modalities calculated from the diagnostic image (original CT image) Means that the feature amount A1 is not used because the similarity of images cannot be determined by comparing these feature amounts A1. That is, only the feature amount A2 that does not depend on the difference between the image format and the imaging modality is selected.

  As shown in FIG. 8, when the diagnostic image is a display image (CT), the same feature amount is selected as when the diagnostic image is an original CT image.

  On the other hand, in the case where the diagnostic image is an original MRI image, the feature value A is used for retrieval for the case image in the database 50 that is the original MRI image and has the same imaging conditions. The feature amount is selected as a feature amount, and the feature amount A2 is selected as a feature amount for search for case images of other images.

  In the case where the diagnostic image is a display image (MRI) generated from an MRI image, among the case images in the database 50, the display image (MRI) has the same imaging conditions and D range. For an image, the feature quantity A is selected as a search feature quantity, and for other case images, the feature quantity A2 is selected as a search feature quantity.

  Returning to FIG. 7, the similarity of the image related to the pixel value is obtained by comparing the feature amount (A or A2) selected in step S16 with the feature amount (A or A2) related to the pixel value registered in the database 50. Calculate (step S18).

  Further, the similarity of the image related to the shape is calculated by comparing the feature value B related to the shape calculated in step S14 with the feature value B related to the shape registered in the database 50 (step S20). Note that the feature quantity B related to the shape does not depend on differences in modalities and the like, and therefore all the feature quantities B can be used for similar image search.

  Then, a similarity obtained by integrating the image similarity related to the pixel value calculated in step S18 and the image similarity related to the shape is calculated, and based on the calculation result, the image is similar to the image of the attention area of the diagnostic image. A case image having an image to be searched is searched (step S22).

  In this way, similar images (CT images and MRI images) are searched from the case images registered in the database 50 based on the feature amount of the attention area of the diagnostic image. The similar images (case images) searched in this way are displayed as thumbnail images in descending order of similarity, and the main image corresponding to the selected thumbnail image among the plurality of thumbnail images is displayed on the display unit 48. The text-based diagnosis information that is displayed and registered in association with the displayed case image of the main image is also displayed (step S24).

  Further, using the screen of the display unit 48 or the like, one of the feature quantities (A, B) or feature quantities (A2, B) shown in FIG. 6 is used as a search feature quantity. You may make it provide the selection means which a user can select arbitrarily. When the feature amount (A, B) is selected, the search range is narrowed, but a search result with high similarity may be obtained. When the feature amount (A2, B) is selected, In addition to the case images that can be similar-searched by the amounts (A, B), case images that cannot be similar-searched by the feature amounts (A, B) can also be searched, and the search range can be expanded.

  In this embodiment, the case where the CT image and the MRI image are registered in the database has been described. However, the present invention is not limited to this, and the present invention may be an X-ray image or an ultrasonic image captured by another imaging modality. Also, the present invention can be applied when an endoscopic image, a pathological image, or the like is registered.

  Moreover, it goes without saying that the present invention is not limited to the above-described embodiments, and various modifications can be made without departing from the spirit of the present invention.

  DESCRIPTION OF SYMBOLS 1 ... Similar image search device, 10 ... Similar image search device main body, 12 ... CPU (central processing unit), 14 ... Main memory, 16 ... Graphic board, 18 ... Communication interface, 20 ... Hard disk device, 22 ... CD-ROM drive 24 ... Keyboard controller, 26 ... Mouse controller, 30 ... Monitor device, 32 ... Keyboard, 34 ... Mouse, 40 ... Input unit, 42 ... Image analysis unit, 44 ... Feature amount conversion unit, 46 ... Similar image search unit, 48 ... Display unit, 50 ... Database, 70 ... X-ray CT apparatus, 72 ... MRI apparatus

Claims (19)

A first medical image, a database characteristic quantity for searching calculated based on the image of the desired region of interest contained in the first medical image and is registered in association with,
Image acquisition means for acquiring a second medical image to be diagnosed, wherein at least one of the dynamic range of the image and the type of the imaging device is different from the first medical image;
Extracting means for extracting an image of a required region of interest from the second medical image;
Image conversion means for converting the image of the region of interest extracted by the extraction means into an image of the same evaluation standard as the first medical image;
A first feature quantity calculating means for calculating a feature amount relating to the pixel values of the image from the image of the transformed region of interest, and a feature quantity relating to the shape of the target area by the image conversion means,
A feature amount related to a pixel value of the image that is independent of the size of the pixel value and a feature amount related to the shape of the attention region are calculated from the image of the attention region converted by the image conversion unit. Two feature amount calculation means;
Any one of the feature quantity calculated by the first feature quantity calculation means and the feature quantity calculated by the second feature quantity calculation means, and the search feature quantity registered in the database Search means for searching for a similar first medical image based on a comparison with the first medical image and the second medical image when the type of the imaging device is different. A feature quantity related to a pixel value that does not depend on the size of the pixel value and a feature quantity related to the shape of the region of interest are selected as the search feature quantities, and when only the dynamic range is different, the image Search means for selecting, as the search feature quantity, a feature quantity related to the pixel value of the image and a feature quantity related to the shape of the attention area
A similar image retrieval apparatus comprising: A first medical image, a database characteristic quantity for searching calculated based on the image of the desired region of interest contained in the first medical image and is registered in association with,
Image acquisition means for acquiring a second medical image to be diagnosed, wherein at least one of the dynamic range of the image and the type of the imaging device is different from the first medical image;
Image conversion means for converting the second medical image into an image of the same evaluation standard as the first medical image;
Extraction means for extracting an image of a required attention area from the second medical image converted by the image conversion means;
A first feature quantity calculating means for calculating a feature amount relating to the pixel values of the image from the image of the extracted region of interest, and a feature quantity relating to the shape of the area of interest by the extraction means,
A feature amount related to a pixel value of the image that is independent of the size of the pixel value and a feature amount related to the shape of the attention region are calculated from the image of the attention region extracted by the extraction unit. A feature amount calculating means;
Any one of the feature quantity calculated by the first feature quantity calculation means and the feature quantity calculated by the second feature quantity calculation means, and the search feature quantity registered in the database Search means for searching for a similar first medical image based on a comparison with the first medical image and the second medical image when the type of the imaging device is different. A feature quantity related to a pixel value that does not depend on the size of the pixel value and a feature quantity related to the shape of the region of interest are selected as the search feature quantities, and when only the dynamic range is different, the image Search means for selecting, as the search feature quantity, a feature quantity related to the pixel value of the image and a feature quantity related to the shape of the attention area
A similar image retrieval apparatus comprising: The first medical image is an image composed of CT values, and the second medical image is an image composed of density values for display;
The similar image search device according to claim 1, wherein the image conversion unit converts an image composed of the display density values into an image composed of CT values. The second medical image is a CT image made up of display density values, and is converted to additional information indicating the window center and window width of CT values, or from a CT value image to a display density value image. Conversion table,
The similar image search device according to claim 3, wherein the image conversion means converts a CT image made up of the display density values into an image made up of CT values based on the attached information or a conversion table. From manual specifying means or an anatomical position in which the user specifies from the image the density values of two or more parts with stable CT values, such as air, water, fat, and bone, among the images composed of the display density values. Automatic specifying means for specifying by automatically estimating the part,
The image conversion means converts an image made up of the display density values into an image made up of CT values so that the density values of the two or more designated parts become CT values corresponding to the parts. The similar image search device according to 3 or 4. The feature quantity related to the pixel value of the image of the region of interest includes at least one of an average value, variance, maximum value, minimum value, luminance histogram, and texture of the pixel value of the image . The similar image search device according to item 1 . A selection unit that selects one of the feature amount calculated by the first feature amount calculation unit and the feature amount calculated by the second feature amount calculation unit by a user's selection instruction;
7. The search unit according to claim 1, wherein the search unit searches for a similar first medical image based on a comparison between the feature amount selected by the selection unit and a search feature amount registered in the database . The similar image search device according to item 1 . The feature quantity related to the pixel value of the image of the attention area, which does not depend on the size of the pixel value, is the contrast between the attention area and the surrounding area, the variance, deviation, and texture of the pixel value of the image of the attention area The similar image search device according to claim 1, comprising at least one of the following. The feature quantity relating to the shape of the region of interest, the anatomical position of the noted region, circularity of the contour, the moment, the radius, and according to any one of claims 1 to 8 comprising at least one of the area Similar image search device. A first medical image, comprising a database and the feature quantity for search calculated based on the image of the desired region of interest is registered in association with that contained in the first medical image, the first An image acquisition step of acquiring a second medical image to be diagnosed, wherein at least one of the dynamic range of the image and the type of the imaging device is different from the medical image;
An extraction step of extracting an image of a required region of interest from the second medical image;
An image conversion step of converting the image of the region of interest extracted by the extraction step into an image of the same evaluation standard as the first medical image;
A feature amount relating to the pixel values of the image from the image conversion region of interest by the image conversion step, the first feature quantity calculating step of calculating a feature quantity relating to the shape of the region of interest,
A feature amount related to a pixel value of the image that is independent of the size of the pixel value and a feature amount related to the shape of the attention region are calculated from the image of the attention region converted by the image conversion step. 2 feature amount calculation steps;
Any one of the feature quantity calculated by the first feature quantity calculation step and the feature quantity calculated by the second feature quantity calculation step, and the search feature quantity registered in the database A search step for searching for a similar first medical image based on a comparison between the first medical image and the second medical image if the type of the imaging device is different. A feature quantity related to a pixel value that does not depend on the size of the pixel value and a feature quantity related to the shape of the region of interest are selected as the search feature quantities, and when only the dynamic range is different, the image A search step of selecting, as the search feature quantity, a feature quantity relating to the pixel value of the image and a feature quantity relating to the shape of the region of interest ;
Similar image search method including A first medical image, comprising a database and the feature quantity for search calculated based on the image of the desired region of interest is registered in association with that contained in the first medical image, the first An image acquisition step of acquiring a second medical image to be diagnosed, wherein at least one of the dynamic range of the image and the type of the imaging device is different from the medical image;
An image conversion step of converting the second medical image into an image of the same evaluation standard as the first medical image;
An extraction step of extracting an image of a required attention area from the second medical image converted by the image conversion step;
A feature amount relating to the pixel values of the image from the image of the extracted region of interest by the extraction step, the first feature quantity calculating step of calculating a feature quantity relating to the shape of the area of interest,
A feature amount related to a pixel value of the image that is independent of the size of the pixel value and a feature amount related to the shape of the attention region are calculated from the image of the attention region extracted in the extraction step. A feature amount calculating step;
Any one of the feature quantity calculated by the first feature quantity calculation step and the feature quantity calculated by the second feature quantity calculation step, and the search feature quantity registered in the database A search step for searching for a similar first medical image based on a comparison between the first medical image and the second medical image if the type of the imaging device is different. A feature quantity related to a pixel value that does not depend on the size of the pixel value and a feature quantity related to the shape of the region of interest are selected as the search feature quantities, and when only the dynamic range is different, the image A search step of selecting, as the search feature quantity, a feature quantity relating to the pixel value of the image and a feature quantity relating to the shape of the region of interest ;
Similar image search method including The first medical image is an image composed of CT values, and the second medical image is an image composed of density values for display;
Wherein the image conversion step, similar image searching method according to claim 1 0 or 1 1 which converts an image formed from the density values for the displayed image composed of CT values. The second medical image is a CT image made up of display density values, and is converted to additional information indicating the window center and window width of CT values, or from a CT value image to a display density value image. Conversion table,
Wherein the image conversion step, similar image searching method according to claim 1 2 for converting the CT image composed of density value for said display on the basis of the auxiliary information or conversion table to the image consisting of CT values. From a manual designation step or an anatomical position in which the user designates the density values of two or more parts having stable CT values, such as air, water, fat, and bone, among the images of the density values for display from the image. An automatic designating step for designating by automatically estimating the part;
The image conversion step converts the image composed of the display density values into an image composed of CT values so that the density values of the two or more designated parts are CT values corresponding to the parts. similar image searching method according to 1 2 or 1 3. Feature amount relating to the pixel values of the image of the region of interest, the average value of the pixel values of the image, dispersion, either the maximum value, minimum value, the luminance histogram, claim 1 0 comprising at least one of the texture 14 similar image retrieval method according to any one of claims. A selection step of selecting one of the feature amount calculated by the first feature amount calculation step and the feature amount calculated by the second feature amount calculation step by a user's selection instruction;
The search step is either claim 1 0 to 15 to find the first medical image similar based on a comparison between the feature quantity for searching registered in the database as selected feature amount by said selection step similar image retrieval method according to any one of claims. The feature amount related to the pixel value of the image of the region of interest and not depending on the size of the pixel value includes the contrast between the region of interest and the surroundings, the variance, deviation, texture of the pixel value of the image of the region of interest The similar image search method according to claim 10, comprising at least one of the following. Feature amount relating to the shape of the region of interest, the anatomical position of the noted region, circularity of the contour, the moment, the radius, and to any one of claims 1 0 to 17, including at least one of the area The similar image search method described. The similar image search program which implement | achieves the similar image search device of any one of Claim 1 to 9 by computer.

Images