JP5398791B2 - Medical image display device - Google Patents

Description

  The present invention relates to a medical image display apparatus for reading a medical image taken by a medical image diagnostic apparatus.

  Conventionally, an X-ray diagnostic apparatus, an X-ray CT (Computed Tomography) apparatus, an MRI (Magnetic Resonance Imaging) apparatus, a nuclear medicine diagnostic apparatus (PET (Positron Emission Computed Tomography), a SPECT (Single Phosphoresis), etc. 2. Description of the Related Art Medical image diagnostic apparatuses for taking medical images, such as sound wave diagnostic apparatuses, are widely used.

  The photographed medical image is displayed on a medical image display device for interpretation. A system configured to temporarily store a captured medical image in a database and download a desired medical image from the database to the medical image display apparatus is also operated.

  As a medical image display device, a device that can display only a two-dimensional medical image (2D viewer) and a device that can also display a three-dimensional medical image (3D viewer) are used. Here, the three-dimensional medical image means a pseudo three-dimensional image generated by performing rendering processing on volume data created by stacking tomographic images.

  Such a medical image display apparatus is equipped with various functions for improving the accuracy of interpretation and diagnosis and for facilitating work. For example, functions for displaying medical images in examination units, series units, and image units, functions for enlarging, reducing, rotating, and panning images, distances, areas, and angles (bones, lesions) in medical images Etc.) (for example, see Patent Document 1), and a function for inputting annotations (arrows, figures, characters, etc.) on medical images (for example, see Patent Document 1).

  In a system conforming to the DICOM (Digital Imaging and Communication in Medicine) standard for digital medical images, an “inspection (study)” in the upper hierarchy, a “series” in the middle hierarchy, and an “image” in the lower hierarchy. The medical images are managed hierarchically.

  In the 3D viewer, a function for adding rotation or the like to the volume data, a function for displaying an MPR (MultiPlanar Reconstruction) image based on the volume data (see, for example, Patent Document 2), and a volume data There are a function of displaying an oblique image (an image in an arbitrary cross-sectional direction inclined with respect to the slice plane) (see, for example, Patent Document 3), a function of capturing a display image as a two-dimensional image, and the like. The captured images are stored as a new series of the examination.

  These functions of the medical image display apparatus are selectively executed by the user operating various soft keys such as buttons displayed on the screen with a mouse or the like.

JP 2004-8535 A JP 2006-127 A JP-A-8-212391

  When performing interpretation on such a medical image display device, since the soft key is displayed on the same display screen as the medical image, when the medical image is displayed widely using the display screen, the soft key is displayed on the medical image. There is an inconvenience that a part of the image cannot be observed because of being superimposed on the screen.

  In order to avoid the superimposed display of soft keys, for example, it is necessary to arrange a soft key in the end area of the display screen and display medical images in other display areas. However, the display size of the medical image itself is reduced, resulting in inconvenience such as difficulty in observing the detailed portion of the medical image.

  Here, in order to secure a sufficient medical image display area in an area other than the soft key display area, it is also possible to take measures such as enlarging the display screen size or adopting a configuration that scrolls medical images. It is done. However, the former results in an increase in cost and the like, and the latter causes inconvenience such as complicated observation work. Therefore, these measures are not easily accepted solutions from the viewpoint of the user.

  It is also conceivable to hide the soft key during the interpretation work and display the soft key by performing a predetermined operation when the above function is used. (1) Display the soft key. It is necessary to take steps such as requesting the execution of the function (3) and (3) hiding the soft key. Therefore, the operation procedure becomes complicated as compared with the conventional configuration in which only the procedure (2) is performed.

  The present invention has been made to solve such a problem, and provides a medical image display device capable of eliminating inconveniences caused by soft keys on a display screen during observation of a medical image. Objective.

  Another object of the present invention is to provide a technique capable of avoiding complicated operation procedures of the medical image display apparatus.

In order to achieve the above object, the invention described in claim 1 is directed to display means for displaying a medical image display screen in which a plurality of image display areas are defined in advance, and image data storage for storing image data of medical images. Means for storing related information for associating the combination of the image display areas with the processing content of the image data of the medical image, operation means, and a different image display area among the plurality of image display areas. When the two displayed medical images are respectively designated using the operation means, the two medical images are displayed according to the related information with respect to at least one image data of the two medical images. Control means for executing processing indicated by the processing content associated with the combination of the image display areas that are present, and the control means includes the two medical images. When one medical image is designated, it is associated with the processing content by the related information as a combination with the image display area in which the one medical image is displayed among the plurality of image display areas. A medical image display device that displays an image display area and an unrelated image display area in an identifiable manner.
According to a second aspect of the present invention, there is provided display means for displaying a medical image display screen in which a plurality of image display areas are defined in advance, image data storage means for storing image data of medical images, and the image display area. Related information storage means for storing related information for associating the combination of the image data and the processing content for the image data of the medical image, operation means, and two medical images displayed in different image display areas of the plurality of image display areas However, when each of the two medical images is designated by using the operation means, the combination of the image display areas in which the two medical images are displayed according to the related information with respect to at least one image data of the two medical images. Control means for executing a process indicated by the associated process content, and the related information is a predetermined image of the plurality of image display areas. Two or more of the processing contents are associated with a combination of display areas, and the control means is configured when the medical image displayed in one image display area of the combination of the predetermined image display areas is specified. And displaying the process selection information presenting the two or more process contents in a selectable manner on the display means, and causing the operation means to execute a process indicated by the process contents selected from the two or more process contents. This is a medical image display device characterized by the above .

According to a twenty-fifth aspect of the present invention, there is provided display means for displaying a medical image display screen in which a plurality of image display areas are defined in advance, image data storage means for storing image data of medical images, and the image display area. Related information storage means for storing related information for associating the combination of the above and the processing content for the image data of the medical image, an operating means, and a medical image displayed in the first image display area of the plurality of image display areas And the second image display area are designated by using the operation means, the first image display area and the second image data of the designated medical image are designated by the related information. Control means for executing processing indicated by the processing content associated with the combination of the image display areas, wherein the control means is configured to display a medical image displayed in the first image display area as a previous image. When designated, an image display area associated with the processing content by the related information as a combination with the first image display area of the plurality of image display areas, and an image display not associated with the image display area A medical image display device characterized in that an area is displayed in an identifiable manner.
According to a twenty-sixth aspect of the present invention, there is provided display means for displaying a medical image display screen in which a plurality of image display areas are defined in advance, image data storage means for storing image data of medical images, and the image display area. Related information storage means for storing related information for associating the combination of the above and the processing content for the image data of the medical image, an operating means, and a medical image displayed in the first image display area of the plurality of image display areas And the second image display area are designated by using the operation means, the first image display area and the second image data of the designated medical image are designated by the related information. Control means for executing processing indicated by the processing content associated with the combination of the image display areas, wherein the related information includes the first image display area and the second image display area. Two or more of the processing contents are associated with the combination, and the control means can select the two or more processing contents when the medical image displayed in the first image display area is designated. The medical image display apparatus is characterized in that the process selection information to be presented is displayed on the display means, and the process shown in the process contents selected from the two or more process contents is executed using the operation means .

The medical image display device according to the present invention is a combination of display means for displaying a medical image display screen in which a plurality of image display areas are predefined, image data storage means for storing image data of medical images, and an image display area. Related information storage means for storing related information for associating the processing contents for the image data of the medical image, operation means, and two medical images displayed in different image display areas among the plurality of image display areas Processing contents associated with a combination of image display areas in which the two medical images are displayed by related information with respect to at least one image data of the two medical images, respectively, when designated by means Control means for executing the processing shown in FIG. Furthermore, the present invention has the following configuration (1) or (2) .
(1) When one medical image of two medical images is designated, the control means is associated as a combination with an image display area in which one of the medical images is displayed. The image display area associated with the processing content by the information and the image display area not associated with the information are displayed in an identifiable manner.
(2) The control means, when the medical image displayed in one image display area of the combination of the predetermined image display areas is specified, presents two or more process contents in a selectable manner. The information is displayed on the display means, and the process shown in the process content selected from the two or more process contents is executed using the operation means .

  Therefore, processing that has been conventionally performed by operating a soft key can be executed by designating a medical image. Therefore, a soft key for requesting execution of the processing is displayed on the medical image display screen. There is no need to let them.

  Thereby, the inconvenience due to the soft key being displayed on the medical image display screen can be solved. In particular, it is possible to avoid a situation in which a part of the medical image cannot be observed with the soft key, and it is not necessary to reduce the display size of the medical image so as not to overlap the soft key. In addition, since a desired process can be executed only by performing a simple operation of designating a medical image, the operability is not complicated.

In addition, the medical image display device according to the present invention includes a display unit that displays a medical image display screen in which a plurality of image display regions are defined in advance, an image data storage unit that stores image data of medical images, and an image display region. Related information storage means for storing related information for associating the combination of the above and the processing content for the image data of the medical image, an operating means, and a medical image displayed in the first image display area of the plurality of image display areas When the second image display area is designated using the operation means, the image data of the designated medical image is associated with the combination of the first and second image display areas by related information. Control means for executing the processing indicated in the processing content. Furthermore, the present invention has the following configuration (4) or (5) .
(4) When the medical image displayed in the first image display area is designated, the control means performs processing based on the related information as a combination with the first image display area among the plurality of image display areas. The image display area associated with the image display area and the image display area not associated therewith are displayed in an identifiable manner.
(5) The related information associates two or more processing contents with the combination of the first image display area and the second image display area, and the control means displays the medical image displayed in the first image display area. Is displayed, processing selection information for presenting two or more processing contents to be selectable is displayed on the display means, and processing indicated in the processing contents selected from the two or more processing contents is executed using the operation means make.

  Therefore, processing that has conventionally been performed by operating a soft key can be executed simply by specifying a medical image and an image display area. Therefore, a soft key for requesting execution of the processing is used as a medical key. There is no need to display on the display screen. Thereby, the inconvenience due to the soft key being displayed on the medical image display screen can be solved. In addition, since a desired process can be executed only by performing a simple operation of designating a medical image, the operability is not complicated.

It is a block diagram showing an example of the whole structure of suitable embodiment of the medical image display apparatus which concerns on this invention. It is a figure which shows an example of the information memorize | stored in the memory | storage part of suitable embodiment of the medical image display apparatus which concerns on this invention. It is a figure which shows an example of the processing content related information of suitable embodiment of the medical image display apparatus which concerns on this invention. It is a figure which shows an example of the display aspect of the medical image display screen by suitable embodiment of the medical image display apparatus which concerns on this invention. It is a flowchart which shows an example of the process which suitable embodiment of the medical image display apparatus which concerns on this invention performs. It is a figure which shows an example of the display aspect of the medical image display screen by suitable embodiment of the medical image display apparatus which concerns on this invention. It is a figure which shows an example of the display aspect of the medical image display screen by suitable embodiment of the medical image display apparatus which concerns on this invention. It is a figure which shows an example of the display aspect of the medical image display screen by suitable embodiment of the medical image display apparatus which concerns on this invention. It is a figure which shows an example of the display aspect of the medical image display screen by suitable embodiment of the medical image display apparatus which concerns on this invention. It is a figure which shows an example of the display aspect of the medical image display screen by suitable embodiment of the medical image display apparatus which concerns on this invention. It is a flowchart which shows an example of the process which suitable embodiment of the medical image display apparatus which concerns on this invention performs. It is a flowchart which shows an example of the process which suitable embodiment of the medical image display apparatus which concerns on this invention performs. It is a figure which shows an example of the display aspect of the medical image display screen by suitable embodiment of the medical image display apparatus which concerns on this invention. It is a flowchart which shows an example of the process which suitable embodiment of the medical image display apparatus which concerns on this invention performs. It is a figure which shows an example of the display aspect of the medical image display screen by suitable embodiment of the medical image display apparatus which concerns on this invention. It is a figure which shows an example of the display aspect of the medical image display screen by suitable embodiment of the medical image display apparatus which concerns on this invention. It is a flowchart which shows an example of the process which suitable embodiment of the medical image display apparatus which concerns on this invention performs. It is a figure which shows an example of the display aspect of the medical image display screen by suitable embodiment of the medical image display apparatus which concerns on this invention. It is a flowchart which shows an example of the process which suitable embodiment of the medical image display apparatus which concerns on this invention performs. It is a figure which shows an example of the display aspect of the medical image display screen by suitable embodiment of the medical image display apparatus which concerns on this invention. It is a block diagram showing an example of the whole structure of the modification of suitable embodiment of the medical image display apparatus concerning this invention. It is a figure which shows an example of the screen displayed by the modification of suitable embodiment of the medical image display apparatus concerning this invention. It is a flowchart which shows an example of the process which the modification of suitable embodiment of the medical image display apparatus which concerns on this invention performs. It is a figure which shows an example of the display aspect of the medical image display screen by the modification of suitable embodiment of the medical image display apparatus which concerns on this invention. It is a figure which shows an example of the display aspect of the medical image display screen by suitable embodiment of the medical image display apparatus which concerns on this invention.

  An example of a preferred embodiment of a medical image display apparatus according to the present invention will be described in detail with reference to the drawings.

[Device configuration]
An example of the overall configuration of the medical image display apparatus according to this embodiment is shown in FIG. A medical image display device 1 shown in FIG. 1 is used to interpret a medical image, and is a device generally called a medical image viewer. The medical image display apparatus 1 is connected to medical image diagnostic apparatuses (modalities) 1000A and 1000B and a medical image database 2000 via a network N such as a LAN (Local Area Network). The medical image display apparatus 1, the medical image diagnostic apparatuses 1000A and 1000B, and the medical image database 2000 form a system that complies with the DICOM standard, for example.

  The medical image diagnostic apparatuses 1000A and 1000B are each composed of an arbitrary medical image diagnostic apparatus used for taking a medical image, such as an X-ray diagnostic apparatus, an X-ray CT apparatus, an MRI apparatus, a nuclear medicine diagnostic apparatus, and an ultrasonic diagnostic apparatus. Is done. A composite modality such as PET-CT can also be used as the medical image diagnostic apparatuses 1000A and 1000B. The image data of the medical image acquired by the medical image diagnostic apparatuses 1000A and 1000B is transmitted to and stored in the medical image database 2000.

  The medical image database 2000 includes a storage device such as a large-capacity hard disk drive that stores image data of medical images, and application software that manages the image data stored in the storage device. As the medical image database 2000, a PACS (Picture Archiving and Communication System) is generally used. The medical image display apparatus 1 appropriately reads image data stored in the medical image database 2000 and displays a medical image.

  Next, the internal configuration of the medical image display apparatus 1 will be described. The medical image display apparatus 1 includes a control unit 2, a storage unit 3, a thumbnail image generation unit 4, a difference image generation unit 5, a tomographic image generation unit 6, a medical image association unit 7, an image position adjustment unit 8, and a display unit 9. The operation unit 10 and the communication unit 11 are included.

(Control part)
The control unit 2 controls each unit of the medical image display device 1 and includes, for example, a microprocessor such as a CPU (Central Processing Unit), a main storage device such as a RAM, and an external storage device such as a hard disk drive. Composed. The external storage device stores in advance a computer program (not shown) for causing the medical image display device 1 to execute processing characteristic of the present embodiment. The microprocessor controls each part of the apparatus by developing and executing this computer program in the main storage device. Such a control unit 2 corresponds to an example of the “control unit” of the present invention.

[Storage section]
The storage unit 3 includes a storage device such as a hard disk drive that stores various data. The storage unit 3 is provided with an image data storage unit 31 for storing image data of medical images and an information storage unit 32 for storing information used for processing by the medical image display device 1. Here, the image data storage unit 31 and the information storage unit 32 may be formed by different storage areas of a single storage device, or may be configured by individual storage devices. The image data storage unit 31 corresponds to an example of “image data storage unit” of the present invention, and the information storage unit 32 corresponds to an example of “related information storage unit” of the present invention.

  An example of data stored in the storage unit 3 is shown in FIG. The image data storage unit 31 of the storage unit 3 shown in the figure stores image data of medical images of series A, B, C, and D. The image data of the series A medical image corresponds to a series of medical images obtained by one scan by the medical image diagnostic apparatus 1000A (1000B), for example, and each image data of the series of medical images. A1, A2, A3,..., Am are included. Similarly, the image data of the series B medical image includes the respective image data B1, B2, B3,..., Bn of the series of medical images, and the image data of the series C medical image includes the series of medical images. , Cp, and the image data of the series D medical image includes the image data D1, D2, D3,..., Dq of the series of medical images. Contains.

  Further, the image data A1, A2, A3,..., Am of the series A are attached with supplementary information a1, a2, a3,. These supplementary information a1 to am are information attached to image data in the DICOM standard, for example, series ID information, medical image ID information, examination order information, modality type information, imaging date information, patient information, image position Information, shooting condition information, shooting time phase information, annotation information, measurement information, and the like are recorded.

  Here, the series ID information is information for identifying the series to which the medical image belongs. The medical image ID information is information for identifying the medical image. The examination order information is identification information when the medical image is ordered.

  The modality type information is information for identifying a modality obtained by imaging the medical image, such as an X-ray CT or an MRI apparatus. The shooting date / time information is information indicating the date / time when the medical image was shot. The patient information is information such as a patient ID for identifying a patient who is a subject of the medical image.

  The image position information is information indicating the shooting position of the medical image, and is generally information based on a coordinate system set for the medical image by the modality. For example, in the case of a tomographic image, the image position information includes cross-sectional position information indicating the cross-sectional position (coordinates) in the scanning direction and cross-sectional direction information indicating the cross-sectional direction. The tomographic image is not limited to a linearly arranged tomographic image obtained by a linear scan by a medical image diagnostic apparatus such as an X-ray CT apparatus, but a medical image diagnostic apparatus such as an ultrasonic diagnostic apparatus. For example, a tomographic image arranged along an arbitrary trajectory such as a circular shape obtained by circular scanning may be used. In the latter case, the “cross-sectional direction” corresponds to the arrangement direction of tomographic images (in the case of a circular arrangement, the tangential direction of the circular orbit).

  The imaging condition information is information indicating imaging conditions such as a scanning method, a slice thickness, a window level, and a window width when the medical image is captured. Further, the imaging time phase information is attached to a medical image that expresses temporal changes in the imaging region, for example, as in ECG synchronous imaging, and is information that indicates the time phase when the medical image is captured. .

  The annotation information is information related to annotations such as arrows, figures, and characters attached to the medical image. This annotation information includes, for example, annotation image data and text data (including information on the position and size of the annotation). Further, the measurement information is information (including information on the type of measurement and the position and size of the image of the measurement result) indicating the measurement result such as the distance, area, and angle performed on the medical image.

  The information storage unit 32 stores processing content related information 32a that associates the combination of image display areas on the medical image display screen P shown in FIG. 4 with the processing content for the image data of the medical image. An example of the processing content related information 32a is shown in FIG.

(About medical image display screen)
Before describing the processing content related information 32a, the configuration of the medical image display screen P will be described. The medical image display screen P includes a thumbnail image display area P1, an observation image display area P2, a thumbnail image display area P3, and an observation image display area P4. Here, the thumbnail image display areas P1 and P3 each correspond to an example of the “reduced image display area” of the present invention. One of the thumbnail image display areas P1 and P3 corresponds to an example of a “first reduced image display area”, and the other corresponds to an example of a “second reduced image display area”. Further, one of the observation image display areas P2 and P3 corresponds to an example of a “first observation image display area”, and the other corresponds to an example of a “second observation image display area”. In the medical image display screen P, a two-dimensional coordinate system is set in advance. Each display area P1 to P4 has a range and a position specified by the two-dimensional coordinate system.

  In the thumbnail image display area P1, for example, a thumbnail image g1 of a medical image included in the series that is the subject of the current interpretation is displayed. This thumbnail image g1 is a thumbnail image of a medical image (referred to as “representative image”) representing a series of medical images forming the series. As the representative image, a medical image taken first in a series of medical images, a medical image at a predetermined image position (cross-sectional position, etc.), or the like can be used. For example, when a thumbnail image representing the series A shown in FIG. 2 is displayed, a thumbnail image based on any one of the image data A1 to Am of the series A is displayed in the thumbnail image display area P1. become. Here, “representative” does not mean that a series of medical images is represented by some feature, but is simply selected arbitrarily from a series of medical images in order to generate image data of thumbnail images. Means.

  In the observation image display area P2, a medical image observation image G1 included in the series represented by the thumbnail image g1 displayed in the thumbnail image display area P1 is displayed. Further, by performing a predetermined operation using the operation unit 10, it is possible to sequentially display observation images of a plurality of medical images in the series. For example, in the series A of FIG. 2, images for observation based on the image data A1 to Am can be displayed sequentially. The observation image means an image displayed for a user (interpretation doctor) to observe a medical image.

  In the thumbnail image display area P3, for example, thumbnail images g2 and g3 of medical images representing a series to be compared with the series to be interpreted this time are displayed. The series to be compared includes, for example, medical images taken in the past for the same part as the series to be interpreted this time (in the case of follow-up observation, preoperative / postoperative observation, etc.).

  In the observation image display area P4, similarly to the observation image display area P2, the medical image included in the series represented by the thumbnail image g2 (and / or the thumbnail image g3) displayed in the thumbnail image display area P3 is observed. A work image G2 (and / or an observation image G3 (not shown)) is displayed.

  As described above, the medical image display screen P shown in FIG. 4 displays the medical image (thumbnail image, observation image) of the current interpretation target series on the left side of the screen and the series of medical images (comparison target) ( Thumbnail images and observation images) are displayed on the right side of the screen.

(About processing related information)
The processing content related information 32a in FIG. 3 will be described. This processing content related information 32a corresponds to an example of “related information” of the present invention, and includes a combination of a thumbnail image display area P1, an observation image display area P2, a thumbnail image display area P3, and an observation image display area P4. This is information for associating the contents of the processing to be executed on the image data of the medical image. Here, each display area P1-P4 is specified by the coordinate in the two-dimensional coordinate system set on the medical image display screen P (display screen of the display part 9).

  Note that the processing content related information 32a shown in FIG. 3 is used particularly when a mouse is provided as the operation unit 10 (when a medical image or a display area is designated by a drag and drop operation). Is. The display areas P1 to P4 (images displayed on the display areas P1 to P4) are specified by the coordinates of the position of the medical image display screen P designated by a mouse or the like.

  The contents defined in the processing content related information 32a will be specifically described. First, (1) display image switching processing and (2) parallel display processing are associated with a combination of thumbnail image display area P1 and observation image P2 (only in the order of P1 → P2).

  Further, (1) inter-series synchronization processing and (2) difference image generation processing are associated with the combination (in no particular order) of the thumbnail image display area P1 and the thumbnail image display area P3.

  Also, (1) tomographic image generation processing, (2) approximate cross-sectional image selection processing, and (3) fusion image generation processing are associated with the combination (in no particular order) of the thumbnail image display area P1 and the observation image display area P4. It has been.

  Further, (1) display image switching processing and (2) parallel display processing are associated with the combination of the thumbnail image display region P3 and the observation image display region P4 (only in the order of P3 → P4).

  Further, (1) annotation attachment processing and (2) measurement result attachment processing are associated with the combination of the observation image display region P4 and the observation image display region P2 (only in the order of P4 → P2). . Specific contents of these processes defined in the process contents related information 32a will be described later.

[Thumbnail image generator]
The thumbnail image generation unit 4 performs processing for generating image data of the thumbnail image of the medical image based on the image data of the medical image. As a thumbnail image generation method, any conventional method can be used as appropriate. The thumbnail image generation unit 4 corresponds to an example of the “reduced image generation unit” of the present invention, and includes a microprocessor that executes a predetermined computer program.

[Difference image generator]
The difference image generation unit 5 performs processing for generating image data of a difference image between the two medical images based on the image data of the two medical images. As a method for generating the difference image, any conventional method such as subtracting the pixel value of the other image data from the pixel value of the other image data can be appropriately used for each corresponding pixel. The difference image generation unit 5 corresponds to an example of the “difference image generation unit” of the present invention, and includes a microprocessor or the like that executes a predetermined computer program.

[Tomographic image generator]
The tomographic image generation unit 6 performs processing for generating tomographic image data in a cross-sectional direction different from the plurality of tomographic images based on the image data of the plurality of tomographic images of the subject. Examples of processing executed by the tomographic image generation unit 6 include MPR (Multiplanar Reconstruction) and oblique image generation processing. The tomographic image generator 6 corresponds to an example of the “tomographic image generator” of the present invention, and includes a microprocessor or the like that executes a predetermined computer program.

  MPR is processing for generating image data of tomographic images in other cross-sectional directions based on image data of a plurality of tomographic images in a certain cross-sectional direction. For example, it is a process of generating image data of a coronal image or image data of a sagittal image based on image data of a plurality of axial images of a subject. For example, when performing MPR on a tomographic image having a slice thickness larger than the pixel size in the slice plane, such as a CT image, first, interpolation processing is performed on image data of a plurality of tomographic images. It is desirable to generate volume data (voxel data) and generate image data of a target tomographic image based on the volume data.

  The oblique image generation process is a process of generating image data of a tomographic image in an arbitrary cross-sectional direction based on image data of a plurality of tomographic images in a certain cross-sectional direction. Also in this case, it is possible to generate the tomographic image data in the target cross-sectional direction after generating the volume data.

[Medical image support unit]
The medical image association unit 7 performs a process of associating a medical image belonging to a certain series with a medical image belonging to another series based on the supplementary information of these medical images.

  More specifically, the medical image association unit 7 refers to the image position information included in the supplementary information of each series of medical images, for example, so that the positions indicated in the image position information are substantially the same. The medical image of this series is associated with the medical image of the other series. In particular, when the medical image is a tomographic image, the medical image association unit 7 refers to the cross-sectional position information of the accompanying information of each series, and the one series of tomographic images and the other series whose cross-sectional positions are substantially the same. Tomographic images.

  Further, when each series of medical images is a time-lapse image such as an electrocardiogram synchronization image, the medical image association unit 7 refers to the imaging time phase information included in the supplementary information of each series of medical images. The medical images of one series and the medical images of the other series whose imaging time phases indicated in the imaging time phase information are substantially the same are associated with each other.

  Here, “substantially the same (substantially the same)” means a range that allows a deviation that does not hinder the accuracy in comparing and observing two associated medical images. This “substantially identical” range can be appropriately set according to various conditions such as the accuracy of the medical image and the observation site. In addition, a medical image closest to the image position or imaging time phase of this medical image may be selected from the medical images belonging to the other series and associated with one series of medical images (also in this case “abbreviated” Within the scope of “same”).

  Such a medical image association unit 7 corresponds to an example of the “medical image association unit” of the present invention, and includes a microprocessor or the like that executes a predetermined computer program. The medical image association unit 7 is included in the “control unit” of the present invention.

(Image position adjustment unit)
The image position adjustment unit 8 aligns these medical images based on the image data of different types of medical images and the image position information of each medical image.

  Here, “different types of medical images” indicate medical images captured by different modalities and medical images captured by different imaging methods. For example, a CT image taken with an X-ray CT apparatus and a PET image taken with PET are examples of medical images taken with different modalities. The image of the internal form of the subject by the MRI apparatus and the functional image of the subject are examples of medical images taken by different imaging methods.

  “Alignment of medical images” is executed so that the coordinates indicated in the image position information of each medical image are matched. If there is a common feature part in each medical image, the position may be adjusted so that the positions of the feature parts coincide.

  The control unit 2 causes the display unit 9 to display the medical image that has been aligned by the image position adjustment unit 8 in a superimposed manner. At this time, the control unit 2 displays an image in such a manner that both the image on the upper side and the image on the lower side can be visually recognized by adjusting the transparency value of the image to be superimposed from above. Such an image is called a “fusion image” or the like (see, for example, JP-A-2005-334634).

  Such an image position adjustment unit 8 corresponds to an example of the “image position adjustment unit” of the present invention, and includes a microprocessor or the like that executes a predetermined computer program.

[Display section]
The display unit 9 includes an arbitrary form of display device such as an LCD (Liquid Crystal Display) or a CRT (Cathode Ray Tube) display. The display unit 9 corresponds to an example of the “display unit” of the present invention.

[Operation section]
The operation unit 10 is configured by operation devices and input devices such as a mouse, a trackball, a keyboard, a control panel, and a joystick. The operation unit 10 corresponds to an example of the “operation unit” of the present invention.

  In this embodiment, the display unit and the operation unit are individually configured. However, a device in which the display unit and the operation unit are integrally formed, such as a touch panel type LCD, may be used.

[Communication Department]
The communication unit 11 performs information communication through the network N, and includes a communication device such as a LAN card or a modem. The communication unit 11 corresponds to an example of “communication means” of the present invention.

[Operation]
The operation of the medical image display apparatus 1 of the present embodiment having the above configuration will be described. 5 to 20 are diagrams for explaining an example of the operation of the medical image display apparatus 1.

  First, when the medical image display apparatus 1 (predetermined computer program) is started, the control unit 2 causes the display unit 9 to display a predetermined patient list screen (not shown). When the user (interpretation physician) operates the operation unit 10 to select a desired patient, the control unit 2 causes the display unit 9 to display a medical image display screen P related to the selected patient.

  The medical image display screen P displayed at this time may display only a thumbnail image, or may display an image for observation as shown in FIG. Here, description will be made assuming that the medical image display screen P shown in FIG. 4 is displayed.

[Display image switching processing, parallel display processing]
First, the image switching process and the parallel display process will be described with reference to the flowchart of FIG. 5 and the drawings showing the display modes of the medical image display screen P of FIGS. In these processes, as shown in the processing content related information 32a in FIG. 3, the thumbnail image displayed in the thumbnail image display area P1 (or P3) is dragged and dropped into the observation image display area P2 (or P4). It is a process executed by this.

  Here, a process when the thumbnail image g3 in the thumbnail image display area P3 is dragged and dropped into the observation image display area P4 in the display state shown in FIG. 4 will be described.

  First, on the medical image display screen P in the display state shown in FIG. 4, the mouse of the operation unit 10 is operated to place the mouse pointer MP on the thumbnail image g3 and dragging of the thumbnail image g3 is started (S11). ), The control unit 2 refers to the processing content related information 32a and displays the thumbnail image display area P3 in which the thumbnail image g3 is displayed (the medical pointer where the mouse pointer MP is located when dragging is started at this time). The display area associated with the thumbnail image display area P3 is specified by the coordinates on the image display screen P; the same applies to the following, and the display area not associated with each other is displayed in an identifiable display manner (S12). ).

  In the present embodiment, the display areas associated with the thumbnail image display area P3 are the thumbnail image display area P1 and the observation image display area P4, and the display areas not associated with each other are the observation image display area P2 and the thumbnail. This is the image display area P3. For example, as shown in FIG. 6, the control unit 2 displays a display area that is not associated with the thumbnail image display area P3 in a dark manner.

  In addition to the method of changing the brightness of the display, an arbitrary method such as changing the display color can be applied as a display mode that makes it possible to identify the presence or absence of association. It is also possible to display the display area (in this case, the thumbnail image display area P3) where the image to be dragged is displayed so that it can be identified (for example, displayed in a predetermined display color).

  Next, when the thumbnail image g3 is dragged to the observation image display area P4 (the observation image G2) (S13), the control unit 2 displays the thumbnail image display area P3 and the observation image as shown in FIG. A process selection dialog D1 that presents two process contents associated with the combination with the display area P4 in a selectable manner is displayed on the display unit 9 (S14). Note that the control unit 2 recognizes the display area of the drag destination based on the position of the mouse pointer MP on the display screen, for example.

  The process selection dialog D1 includes a tab (process) for selecting one of the display image switching process and the parallel display process associated with the combination of the thumbnail image display area P3 and the observation image display area P4. “1”, “2”) provided at the upper left corner of the selection dialog D1 are provided.

  The user, for example, rotates the mouse wheel of the mouse (rotation unit provided on the mouse) to switch the processing shown in the two tabs alternately and drop the thumbnail image g3 to display image switching processing. One of the parallel display processes is selected (S15).

  The process selection operation in the process selection dialog D1 can be configured to be performed by an arbitrary method. For example, processing may be selected by clicking a desired tab with a mouse, or processing may be switched by pressing a predetermined key (for example, a control key) on the keyboard. .

  FIG. 7 shows a state where the tab “1” is selected. The tab “1” corresponds to the display image switching process. When this tab “1” is selected, the explanation of the display image switching process “Drag and drop destination inspection image of series of drag and drop source” Is displayed in the processing selection dialog D1.

  FIG. 8 shows a state where the tab “2” is selected. The tab “2” corresponds to the parallel display process. When this tab “2” is selected, the explanation of the parallel display process “reduced the inspection image being displayed and the drag-and-drop source series is displayed. “Display inspection images side by side” is displayed in the process selection dialog D1.

  When the display image switching process of the tab “1” is selected (S16; image switching), the control unit 2 ends the display of the observation image G2 displayed in the observation image display area P4 and also displays the thumbnail image g3. The observation image G3 based on the image data of the medical image included in the series corresponding to (for example, the first medical image taken in the series) is displayed in the observation image display area P4 (S17). As a result, as shown in FIG. 9, the image displayed in the observation image display area P4 is switched from the observation image G2 to the observation image G3.

  On the other hand, when the parallel display process of the tab “2” is selected (S16; parallel display), the control unit 2 reduces the display size of the observation image G2 displayed in the observation image display region P4 and displays a thumbnail. An observation image G3 based on image data of a medical image included in a series corresponding to the image g3 (for example, a medical image taken first in the series) is displayed in the observation image display region P4 along with the observation image g2. (S18). As a result, as shown in FIG. 10, the observation image G2 and the observation image G3 are displayed in parallel in the observation image display region P4.

  When two or more thumbnail images are displayed in the thumbnail image display area P1, and an observation image corresponding to the one thumbnail image is displayed in the observation image display area P2, other thumbnail images are displayed. Even when dragging and dropping on the observation image display area P2 (observation image displayed on it), the same processing as that described above with reference to FIGS. 5 to 10 is executed.

[Inter-series synchronization processing, differential image generation processing]
Next, inter-series synchronization processing and difference image generation processing will be described with reference to the flowchart of FIG. As shown in FIG. 3, these processes are performed when the thumbnail image displayed in the thumbnail image display area P1 is dragged and dropped onto the thumbnail image display area P3 (the thumbnail image displayed in the thumbnail image display area P3), or the thumbnail image display is performed. This is a process executed when the thumbnail image displayed in the area P3 is dragged and dropped onto the thumbnail image display area P1 (the thumbnail image displayed in the area P3).

  Here, the processing when the thumbnail image g1 in the thumbnail image display area P1 is dragged and dropped onto the thumbnail image g2 displayed in the thumbnail image display area P3 in the display state shown in FIG. 4 will be described. The illustration of the mouse pointer MP will be omitted below.

  First, on the medical image display screen P in the display state shown in FIG. 4, the mouse of the operation unit 10 is operated to place the mouse pointer MP on the thumbnail image g1, and dragging of the thumbnail image g1 is started (S21). ), The control unit 2 refers to the processing content related information 32a, and displays the display area associated with the thumbnail image display area P1 in which the thumbnail image g1 is displayed and the display area not associated therewith. It is displayed in an identifiable display mode (S22).

  In the present embodiment, the display areas associated with the thumbnail image display area P1 are the observation image display area P2, the thumbnail image display area P3, and the observation image display area P4, and therefore only the thumbnail image display area P1 itself. Will be displayed darkly (not shown).

  Next, when the thumbnail image g1 is dragged to the thumbnail image display area P3 (the thumbnail image g2 thereof) (S23), the control unit 2 associates with the combination of the thumbnail image display area P1 and the thumbnail image display area P3. Then, a process selection dialog D2 that presents the inter-series synchronization process and the difference image generation process in a selectable manner is displayed on the display unit 9 (S24).

  Although not shown, the process selection dialog D2 has a tab for selecting one of the inter-series synchronization process and the difference image generation process, as in the process selection dialog D1 of FIGS. Is provided. When switching tabs with the mouse, explanation of synchronization processing between series corresponding to tab “1” “Synchronization function between series between two series of drag and drop source and drag and drop destination” and tab “2” The description of the difference image generation process corresponding to “Create a time-series difference image with the drag-and-drop source image and the drag-and-drop destination image” is displayed in the process selection dialog D2. The user selects one of the series synchronization process and the difference image generation process by the process selection dialog D2 (S25).

  When the inter-series synchronization processing of the tab “1” is selected (S26; inter-series synchronization), the medical image association unit 7 includes the medical image included in the series of medical images represented by the thumbnail image g1 and the thumbnail image g3. A process of associating medical images included in a series of medical images represented by, based on the accompanying information (S27).

  This correspondence processing will be described more specifically. A series of medical image data represented by the thumbnail image g1 is represented as series A in FIG. 2, and a series of medical image data represented by the thumbnail image g2 is represented as series B. The medical image association unit 7 associates the series A image data A1 to Am with the series B image data B1 to Bn with reference to the accompanying information a1 to am and the accompanying information b1 to bn.

  In each incidental information a1 to am and b1 to bn, image position information (described above) indicating the position of the medical image is recorded. The medical image association unit 7 associates the image data Ai (i = 1 to m) and the image data Bj (j = 1 to n) whose image positions indicated by the image position information are substantially the same. In particular, when the thumbnail images g1 and g3 are tomographic images, the medical image association unit 7 associates image data in which the cross-sectional position indicated by the cross-sectional position information and the cross-sectional direction indicated by the cross-sectional direction information are substantially the same. Operate.

  By such association processing, image data Ai1 and image data Bj1 are associated, image data Ai2 and image data Bj2 are associated,..., Image data Aik and image data Bjk are associated with each other. Suppose that

  When the user performs a predetermined operation with the operation unit 10 to display the observation image Gir based on the image data Air (r = 1 to k) in the observation image display region P2 (S28), the control unit 2 The observation image Gir ′ based on the image data Bir associated with the image data Air is displayed in the observation image display area P4 (S29). Conversely, when the user displays the observation image Gir ′ based on the image data Bir in the observation image display area P4, the observation image Gir based on the image data Air associated with the image data Bir is displayed. It is displayed in the area P2.

  In this way, in synchronization with switching of one observation image, the other observation image is automatically switched and displayed. The two observation images displayed in synchronization are medical images having substantially the same image position.

  On the other hand, when the difference image generation process of the tab “2” is selected (S26; difference image), the medical image association unit 7 executes the association process similar to the above (S30) and the difference image generation unit 5 generates image data of a difference image between the associated image data Air and image data Bir (S31). The control unit 2 displays this difference image on the display unit 9 (for example, the observation image display area P2) automatically or upon receiving a user request (S32). Here, image data of k difference images is generated in step S31. The control unit 2 sequentially displays these difference images based on, for example, an operation by the operation unit 10.

  Even when the thumbnail image displayed in the thumbnail image display area P3 is dragged and dropped onto the thumbnail image displayed in the thumbnail image display area P1, the same processing as described above is executed.

  Further, the inter-series synchronization process and the difference image generation process are executed only between series that can execute the processes. That is, the inter-series synchronization process is executed only when the image positions of each series can be associated. For example, an inter-series synchronization process can be executed between two series having the same cross-sectional direction, but cannot be executed between two different series. Similarly, the difference image generation process can be executed only between series in which difference images can be defined. In step S22, a thumbnail image that can be subjected to the inter-series synchronization process and the difference image generation process and a thumbnail image that cannot be performed may be displayed in an identifiable manner.

  In the above example, it is configured to associate medical images having substantially the same image position information in the auxiliary information. However, a series of medical images having substantially the same imaging time phase shown in the imaging time phase information described above is associated with the series. It is also possible to execute inter-synchronization processing and difference image generation processing. Such a configuration is effective for a series of medical images that express temporal changes in the imaging region, such as electrocardiographic synchronization imaging.

  For example, in the case where each of the series A and B represented by the thumbnail images g1 and g3 is composed of a plurality of medical images having different time phases obtained by electrocardiogram synchronous imaging, medical images having substantially the same imaging time phase are displayed. In addition to the association, the associated medical images can be displayed synchronously, or the image data of the difference image of the associated medical images can be generated.

[Tomographic image generation processing]
Next, tomographic image generation processing will be described with reference to FIGS. As shown in FIG. 3, the tomographic image generation processing is performed when the thumbnail image displayed in the thumbnail image display area P1 is dragged and dropped onto the observation image display area P4 (observation image displayed in), or This process is executed when the observation image displayed in the observation image display area P4 is dragged and dropped onto the thumbnail image display area P1 (the thumbnail image displayed in the thumbnail image display area P1).

  Here, a process when the observation image G3 displayed in the observation image display area P4 is dragged and dropped onto the thumbnail image g1 in the thumbnail image display area P1 in the display state shown in FIG. 10 will be described. The observation image G3 is a coronal image generated by performing cross-sectional transformation (MPR) on image data of a series of axial images (one of which is the observation image G2) represented by the thumbnail image g2. It is an image for observation based on the image data. A series of medical images represented by the thumbnail image g1 are axial images in the same cross-sectional direction as the thumbnail image g2.

  First, on the medical image display screen P in the display state shown in FIG. 10, when the mouse of the operation unit 10 is operated to place the mouse pointer MP on the observation image G3 and dragging of the observation image G3 is started. (S41) With reference to the processing content related information 32a, the control unit 2 displays a display area associated with the observation image display area P4 on which the observation image G3 is displayed, and a display area not associated with the display area P4. Are displayed in an identifiable display manner (S42).

  In the present embodiment, the display areas associated with the observation image display area P4 are the thumbnail image display area P1 and the observation image display area P2, and thus the thumbnail image display area P3 and the observation image display area P4. Will be displayed darkly (not shown).

  Next, when the observation image G3 is dragged to the thumbnail image display area P1 (its thumbnail image g1) (S43), the control unit 2 associates the observation image G3 with the combination of the observation image display area P4 and the thumbnail image display area P1. Dialog D3 with description of the processing content of the generated tomographic image generation process “Create MPR image from drag and drop destination series under the same conditions as MPR image of drag and drop source and register as new series” Is displayed on the display unit 9 (S44).

  Here, according to the processing content related information 32a of FIG. 3, the processing associated with the combination of the observation image display region P4 and the thumbnail image display region P1 is the tomographic image generation processing, approximate cross-sectional image selection processing, and fusion image. There are three generation processes. Among them, the tomographic image generation process is a process executed when the medical image of the drag and drop source and the medical image of the drag and drop destination have different cross-sectional directions, while the latter two processes are the drag and drop This is a process executed when an original medical image and a drag-and-drop destination medical image have the same cross-sectional direction. In step S44, the control unit 2 refers to the supplementary information of the drag-and-drop source medical image (observation image G3) and the supplementary information of the drag-and-drop destination medical image (thumbnail image g1). By recognizing that the cross-sectional directions are different, a dialog D3 regarding tomographic image generation processing is displayed. The dialog regarding the latter two processes will be described later.

  When the user operates the operation unit 10 to drop the observation image G3 on the thumbnail image g1 and requests execution of the tomographic image generation process (S45), the tomographic image generation unit 6 displays the thumbnail image g1 as a representative. Image data of a series of medical images (axial images), incidental information (cross-sectional position information, cross-sectional direction information) of the image data, and auxiliary information (cross-sectional position information, cross-sectional direction information) of the observation image G3 (coronal image) The MPR process is executed on the basis of the image data, and image data of an MPR image (coronal image) obtained by cross-sectional transformation of the series of axial images is generated (S46).

  The control unit 2 stores the image data of the generated coronal image (and its supplementary information) in the image data storage unit 31, registers it as a new series (S47), and controls the thumbnail image generation unit 4 to control it. Then, image data of the thumbnail image g3 ′ of this coronal image is generated, and this thumbnail image g3 ′ is displayed in the thumbnail image display area P1 (S48). The control unit 2 displays the coronal image for observation G3 ′ in the observation image display area P2 as shown in FIG. 13 automatically or upon request from the user (S49).

  In the above example, a case where a coronal image is acquired from an axial image has been described. However, another image can be acquired from one image among an axial image, a coronal image, and a sagittal image. It is also possible to acquire other arbitrary cross-sectional direction images (oblique images) based on a series of medical images in any cross-sectional direction.

[Approximate section image selection processing, fusion image generation processing]
Next, approximate sectional image selection processing and fusion image generation processing will be described with reference to FIG. As shown in FIG. 3, these processes are performed when the thumbnail image displayed in the thumbnail image display area P1 is dragged and dropped on the observation image display area P4 (observation image displayed in the observation image display area P4). This is a process executed when an observation image displayed in the image display area P4 is dragged and dropped onto the thumbnail image display area P1 (a thumbnail image displayed in the thumbnail image display area P1).

  Here, a process when the observation image G2 displayed in the observation image display area P4 is dragged and dropped onto the thumbnail image g1 in the thumbnail image display area P1 in the display state shown in FIG. 10 will be described. The observation image G2 is an observation image of a series of axial images represented by the thumbnail image g2. The thumbnail image g1 is a thumbnail image of an axial image in the same cross-sectional direction as the thumbnail image g2. In particular, it is sufficient that the tomographic image represented by the thumbnail image g1 and the observation image G2 are tomographic images in the same cross-sectional direction (can be determined by cross-sectional direction information), and the tomographic images obtained by different modalities, It may be a tomographic image obtained by a different examination method (the aforementioned “different types of medical images”).

  First, on the medical image display screen P in the display state shown in FIG. 10, when the mouse pointer MP is placed on the observation image G2 and dragging of the observation image G2 is started (S51), the control unit 2 performs processing. With reference to the content-related information 32a, the thumbnail image display area P3 and the observation image display area P4 that are not associated with the observation image display area P4 on which the observation image G2 is displayed are darkly displayed (S52).

  Next, when the observation image G2 is dragged to the thumbnail image display area P1 (the thumbnail image g1 thereof) (S53), the control unit 2 associates with the combination of the observation image display area P4 and the thumbnail image display area P1. The display section 9 displays the process selection dialog D4 that presents the selected approximate cross-section image selection process and fusion image generation process in a selectable manner (S54).

  Although not shown, the process selection dialog D4 includes a tab for selecting one of the approximate cross-section image selection process and the fusion image generation process, as in the process selection dialog D1 of FIGS. Is provided. Switching tabs with the mouse explains the approximate cross-section image selection process corresponding to the tab “1” “displays the drag-and-drop destination image having coordinates close to the drag-and-drop source image” and the tab “2”. The description of the fusion image generation process corresponding to “Create a fusion image having the same coordinates as the drag-and-drop source image” is switched to the process selection dialog D4. The user selects the approximate cross-section image selection process or the fusion image generation process through the process selection dialog D4 (S55).

  When the approximate cross-section image selection process of the tab “1” is selected (S56; approximate cross-section), the control unit 2 represents the auxiliary information (cross-section position information) of the observation image G2 (axial image) and the thumbnail image g1. Of the series of tomographic images (axial images), and from the series of tomographic images, the cross-sectional position substantially the same as the observation image G2 (mostly the observation image G2) is selected from the series of tomographic images. A tomographic image having a close cross-sectional position) is selected and displayed in the observation image display area P2 (S57). The selection of the tomographic image can be easily performed by searching for a cross-sectional position information of the series of tomographic images that is closest to the cross-sectional position of the observation image G2.

  On the other hand, when the fusion image generation process of the tab “2” is selected (S56; fusion), the control unit 2 displays the cross-sectional position information corresponding to the observation image G2 and a series of tomographic images represented by the thumbnail image g1. Based on the respective cross-sectional position information, a tomographic image having substantially the same cross-sectional position (cross-sectional position closest to the observation image G2) as the observation image G2 is selected from the series of tomographic images (S58). . Further, the control unit 2 controls the image position adjustment unit 8 to perform alignment between the tomographic image selected in step S58 and the observation image G2 (S59). This alignment process is performed, for example, by aligning the coordinates shown in the image position information of the selected tomographic image with the coordinates shown in the image position information of the observation image G2. It is also possible to perform alignment by matching the positions of the characteristic parts of the images.

  The control unit 2 causes the display unit 9 to display a fusion image obtained by superimposing the aligned tomographic image and the observation image G2 (S60).

  In the above example, a fusion image of two tomographic images is generated. For example, a fusion including a pseudo three-dimensional image based on volume data (an image obtained by rendering processing such as volume rendering or MIP (Maximum Intensity Projection)). It is also possible to generate an image or the like. Further, the number of medical images superimposed for generating a fusion image is not limited to two, and may be three or more.

[Annotation attachment processing, measurement result attachment processing]
Next, the annotation attachment process and the measurement result attachment process will be described with reference to FIGS. FIGS. 15 and 16 show examples of annotations (annotation images) and measurement results (measurement result images) attached to medical images, respectively.

  The annotation AN shown in FIG. 15 is composed of an elliptical image attached to the target region of the observation image G2. The annotation AN is displayed based on the annotation information (described above) recorded in the incidental information of the observation image G2 when the user performs a predetermined operation.

  Also, the measurement result M shown in FIG. 16 is an image showing the measurement result of the distance in the observation image G3, and has a straight line image showing the measurement site and an image of a numerical value “30 cm” showing the measured distance. doing. Note that the observation image display area P2 of FIG. 16 displays the observation image G3 ′ of the coronal image shown in FIG.

  As shown in FIG. 3, the annotation attachment process and the measurement result attachment process are performed by displaying the annotation or measurement result displayed in the observation image display area P4 on the observation image display area P2 (observation image displayed in the observation image). This process is executed when dragging and dropping. Note that the annotation attachment process and the measurement result attachment process may be executed by dragging and dropping the observation image with the annotation and the measurement result.

(Annotation attachment processing)
The annotation attachment process will be described with reference to FIGS. First, on the medical image display screen P in the display state shown in FIG. 15, the mouse pointer MP is placed on the annotation AN (or the observation image G2; the same applies hereinafter) and dragging of the annotation AN is started (S61). The control unit 2 refers to the processing content related information 32a and darkly displays the thumbnail image display region P3 and the observation image display region P4 that are not associated with the observation image display region P4 on which the annotation AN is displayed ( S62).

  Next, when the annotation AN is dragged to the observation image display region P2 (the observation image G1) (S63), the control unit 2 changes the combination of the observation image display region P4 and the observation image display region P2 to a combination. A dialog D5 presenting the associated description of the processing content of the annotation attachment processing “Enter an annotation of the same shape as the drag and drop source in the same coordinates on the drag and drop destination image” is displayed on the display unit 9 (S64). ). At this time, the control unit 2 recognizes that the dragged image is an annotation with reference to the incidental information of the observation image G2.

  When the user operates the operation unit 10 to request the execution of annotation attachment processing by dropping the annotation AN on the observation image G1 (S65), the control unit 2 uses the annotation information related to the annotation AN. Then, as shown in FIG. 18, the observation image G1 in which the annotation AN ′ corresponding to the display position and the display size is attached to the annotation AN is displayed in the observation image display area P2 (S66).

  At this time, the annotation AN ′ may be superimposed on the already displayed observation image G1, or new image data in which the image data of the annotation AN ′ is superimposed on the image data of the observation image G1. It may be generated and a target image may be displayed based on the new image data.

  The control unit 2 also determines the position and annotation to superimpose the annotation AN ′ on the observation image G1 based on the coordinates shown in the image position information of the observation image G1 and information on the position and size of the annotation AN shown in the annotation information. An AN display size (enlargement ratio / reduction ratio) is determined.

  In the above example, in response to the annotation AN being dragged and dropped onto the observation image G1, the same annotation AN ′ as the annotation AN is attached and displayed on the observation image G1. However, it can be configured to automatically shift to an annotation entry mode (annotation entry mode) for the observation image G1 in response to the operation (start up an annotation entry computer program). .) For example, a conventional arbitrary method can be used as a method for entering an annotation in the annotation entry mode.

  Although the annotation in the above example is a two-dimensional image, for example, an annotation made up of a three-dimensional image can be displayed. At this time, the observation image is a pseudo three-dimensional image based on volume data, for example. In addition, when an annotation is attached to the observation image of the tomographic image based on the volume data, a cross-sectional image of the three-dimensional annotation at the cross-sectional position of the tomographic image is attached to the observation image of the tomographic image and displayed. Can do.

(Measurement result attachment processing)
The measurement result attachment process will be described with reference to FIGS. 19 and 20. First, on the medical image display screen P in the display state shown in FIG. 16, the mouse pointer MP is placed on the measurement result M (or the observation image G3; the same applies hereinafter) and dragging of the measurement result M is started (S71). ) With reference to the processing content related information 32a, the control unit 2 darkens the thumbnail image display area P3 and the observation image display area P4 that are not associated with the observation image display area P4 on which the measurement result M is displayed. It is displayed (S72).

  Next, when the measurement result M is dragged to the observation image display area P2 (the observation image G3 ′) (S73), the control unit 2 sets the observation image display area P4 and the observation image display area P2 to each other. A dialog D6 presenting on the display unit 9 an explanation of the contents of the measurement result attachment process associated with the combination and presenting “Draw the measurement result of the same shape as the drag and drop source in the same coordinates on the drag and drop destination image” It is displayed (S74). At this time, the control unit 2 recognizes that the dragged image is a measurement result with reference to the incidental information of the observation image G3.

  When the user operates the operation unit 10 to request the execution of the measurement result attachment process by dropping the measurement result M on the observation image G3 ′ (S75), the control unit 2 relates to the measurement result M. Based on the measurement information, as shown in FIG. 20, an observation image G3 ′ in which the measurement result M ′ corresponding to the display position and the display size is attached to the measurement result M is displayed in the observation image display area P2 (see FIG. 20). S76).

  At this time, the measurement result M ′ may be superimposed on the already displayed observation image G3 ′, or a new image data of the measurement result M ′ may be superimposed on the image data of the observation image G3 ′. Image data may be generated and display processing may be performed based on the new image data.

  Further, the control unit 2 superimposes the measurement result M ′ on the observation image G3 ′ based on the coordinates shown in the image position information of the observation image G3 ′ and the information on the position and size of the measurement result M shown in the measurement information. The position and the display size (enlargement ratio / reduction ratio) are determined.

  In the above example, the measurement result M ′ is attached to the observation image G3 ′ and displayed in response to the measurement result M being dragged and dropped onto the observation image G3 ′. However, it can be configured to automatically shift to a mode (measurement result drawing mode) for drawing a measurement result for the observation image G3 ′ in response to the operation (starting a computer program for drawing the measurement result) ). As a drawing method of the measurement result, for example, any conventional method can be used.

  In the above example, measurement result attachment processing between tomographic images having the same cross-sectional position has been described. However, measurement result attachment processing can also be executed between tomographic images having different cross-sectional positions or cross-sectional directions.

  For example, when the cross-sectional positions of the observation images G3 and G3 ′ are different, the approximate cross-sectional image selection process of FIG. 14 is performed to select the tomographic image of the cross section closest to the observation image G3 from the series to which the observation image G3 ′ belongs. At the same time, the measurement result M ′ is attached to the observation image of the selected tomographic image and displayed.

  In the case where the cross-sectional directions are different, for example, the observation image G1 (axial image) in FIG. 15 is displayed in the observation image display region P2, and the observation image (coronal image) and the measurement result M in FIG. In response to dragging and dropping the measurement result M onto the observation image G1 when displayed in the image display area P4, the cross-sectional image generation processing of FIG. 12 is performed, and the series of thumbnail images g1 is representative. Based on a series of tomographic images (axial images), a coronal image at a cross-sectional position substantially the same as the observation image G3 is generated. Then, the measurement result M ′ is attached to the observation image of the coronal image and displayed.

[Action / Effect]
The operation and effect of the medical image display apparatus 1 according to the present embodiment as described above will be described.

  The medical image display device 1 includes a display unit 9 for displaying a medical image display screen P in which four image display regions P1 to P4 are defined in advance, an image data storage unit 31 for storing image data of medical images, and an image display region. An information storage unit 32 that stores processing content related information 32a that associates a combination of P1 to P4 with processing content for image data of a medical image, and an operation unit 10 are provided. In particular, a mouse is used as the operation unit 10.

  Further, the control unit 2 of the medical image display device 1 is configured to drag and drop one medical image to the other when two medical images displayed in different image display areas are designated using the operation unit 10. When this is done, a predetermined process is performed on one or both of the two medical images. This predetermined process is a process shown in the process content associated with the combination of the image display areas in which the two medical images are displayed by the process content related information 32a.

  That is, in the medical image display device 1, the processing content is defined for a combination of image display areas, and a medical image in a certain image display area is dragged and dropped onto a medical image in another image display area (that is, By designating two medical images), processing corresponding to these two image display areas is executed. As the processing content defined for the combination of image display areas, for example, as shown in FIG.

  (1) Display image switching process: A process executed when observing a medical image of an examination in which a plurality of series are registered. This process is executed when the thumbnail image displayed in the thumbnail image display area P1 (or P3) is dragged and dropped onto the observation image displayed in the observation image display area P2 (or P4). The display of the observation image at the drop and drop destination is terminated, and the observation image based on the image data that is the basis of the image data of the drag and drop source thumbnail image is displayed in the observation image display area P2 (or P4). Is.

  (2) Parallel display processing: processing executed when observing a medical image of an examination in which a plurality of series are registered. This process is executed when the thumbnail image displayed in the thumbnail image display area P1 (or P3) is dragged and dropped onto the observation image displayed in the observation image display area P2 (or P4). The observation image based on the image data that is the basis of the image data of the thumbnail image of the drop and drop source and the observation image of the drag and drop destination are displayed in the observation image display area P2 (or P4). .

  (3) Inter-series synchronization processing: processing performed when comparing two series of medical images. This process is executed when the thumbnail image displayed in the thumbnail image display area P1 (or P3) is dragged and dropped onto the thumbnail image displayed in the thumbnail image display area P3 (or P1). Based on the supplementary information, the medical image included in the series (first series) represented by the original thumbnail image and the medical image included in the series (second series) represented by the drag-and-drop destination thumbnail image Are associated with each other. This association is performed, for example, by associating medical images having substantially the same image position information (cross-section position information) and imaging time phase information. Furthermore, this processing is performed when the first series (or second series) medical image is displayed in the observation image display area P2 (or P4) using the operation unit 10 and is associated with this medical image. The obtained medical image is selected from the second series (or the first series), and the observation image is displayed in the observation image display area P4 (or P2).

  (4) Difference image generation process: This process is performed when two series of medical images are compared. This process is executed when the thumbnail image displayed in the thumbnail image display area P1 (or P3) is dragged and dropped onto the thumbnail image displayed in the thumbnail image display area P3 (or P1). Based on the supplementary information, the medical image included in the series (first series) represented by the original thumbnail image and the medical image included in the series (second series) represented by the drag-and-drop destination thumbnail image Are associated with each other, and image data of a difference image of the associated first and second series of medical images is generated. The association processing here is performed, for example, by associating medical images having substantially the same image position information (cross-section position information) and imaging time phase information.

  (5) Tomographic image generation process: a process performed when comparing medical images of two examinations, particularly a process performed to acquire a tomographic image in a cross-sectional direction not included in one examination. . This process is executed when the observation image of the tomographic image displayed in the observation image display area P4 is dragged and dropped onto the thumbnail image displayed in the thumbnail image display area P1, and the thumbnail of the drag and drop destination is displayed. Based on the image data of the series of tomographic images represented by the image and the accompanying information, new tomographic image data in the same cross-sectional direction as the observation image of the drag and drop source is generated. The obtained tomographic image is registered as a new series, and its thumbnail image (representing the series) is displayed. The tomographic image is displayed on the display unit 9 automatically or in response to a user request. In the tomographic image generation process, the thumbnail image displayed in the thumbnail image display area P1 is dragged and dragged to the observation image of the tomographic image displayed in the observation image display area P4, contrary to the drag and drop operation described above. Also executed when dropped. Further, when the observation image of the tomographic image displayed in the observation image display area P2 is dragged and dropped onto the thumbnail image displayed in the thumbnail image display area P3 (and vice versa) The same tomographic image generation processing can be performed with respect to the above case.

  (6) Approximate cross-sectional image selection process: This process is performed when two series of medical images having the same cross-sectional direction are compared, particularly when two series obtained by different modalities and examination methods are compared. It is used. This process is executed when the observation image of the tomographic image displayed in the observation image display area P4 is dragged and dropped onto the thumbnail image displayed in the thumbnail image display area P1, and based on the incidental information, A tomographic image at substantially the same cross-sectional position as the drag-and-drop source observation image is selected from the series represented by the drag-and-drop destination thumbnail image, and the observation image of the selected tomographic image is displayed in the observation image display region P2. Is displayed. In this process, contrary to the above drag and drop operation, the thumbnail image displayed in the thumbnail image display area P1 is dragged and dropped onto the observation image of the tomographic image displayed in the observation image display area P4. It is also executed when

  (7) Fusion image generation processing: This processing is performed when two series of medical images are compared, and is particularly used when two series obtained by different modalities and inspection methods are compared. This process is executed when the observation image of the tomographic image displayed in the observation image display area P4 is dragged and dropped onto the thumbnail image displayed in the thumbnail image display area P1, and the image position information of the incidental information Based on the above, a medical image at substantially the same position as the drag-and-drop source observation image is selected from the series represented by the drag-and-drop destination thumbnail image, and the selected medical image and the drag-and-drop source observation are selected. Alignment with the image for use is executed. The aligned medical image and observation image are displayed in the observation image display area P2 as a fusion image in which the other image is superimposed on one image. In this process, contrary to the above drag and drop operation, the thumbnail image displayed in the thumbnail image display area P1 is dragged and dropped onto the observation image of the tomographic image displayed in the observation image display area P4. It is also executed when

  (8) Annotation attachment processing: This processing is performed when two series of medical images are compared, and is particularly used when an annotation (image) is attached to one medical image. This processing is executed when an annotation attached to and displayed on the observation image displayed in the observation image display area P4 is dragged and dropped onto the observation image displayed in the observation image display area P2. Based on the annotation information of the annotation of the drag and drop source, the annotation is attached to the observation image of the drag and drop destination and displayed in the observation image display area P2. Instead of dragging and dropping the annotation, the observation image with the annotation may be dragged and dropped.

  (9) Measurement result attachment processing: This processing is performed when two series of medical images are compared, and particularly used when a measurement result (image) is attached to one medical image. This process is executed when a measurement result attached to the observation image displayed in the observation image display area P4 is dragged and dropped onto the observation image displayed in the observation image display area P2. Then, based on the measurement information of the measurement result of the drag and drop source, the measurement result is attached to the observation image of the drag and drop destination and displayed in the observation image display area P2. Instead of dragging and dropping the measurement result, the observation image to which the measurement result is attached may be dragged and dropped.

  Conventionally, such processing has been performed by operating a soft key arranged on the medical image display screen, so that the soft key is superimposed on the medical image and part of the image is hidden. Inconveniences such as a reduction in the display size of the medical image itself have occurred. According to the medical image display apparatus 1 according to the present embodiment, such a process can be executed only by performing a drag-and-drop operation between medical images (that is, a medical image specifying operation). There is no need to display a key, and the above inconvenience can be solved. In addition, since a desired process can be executed only by performing a simple operation of designating (drag and drop) a medical image, the operability is not complicated.

  The medical image display device 1 is associated with the processing content as a combination with the image display region by the processing content related information 32a in response to the start of the dragging of the medical image in a certain image display region. The image display area and the image display area that is not associated with each other act so as to be identifiable. Thereby, the user can easily identify an image display area that can be a drag-and-drop destination of the medical image and an image display area that cannot be the image display area. As described above, according to the medical image display apparatus 1, it is possible to improve the operability in the drag and drop operation for performing the various operations described above.

  When a medical image in a certain image display area is dragged to another image display area, a dialog (processing content information) explaining the processing contents associated with the combination of these image areas is displayed. By improving the operability in this way, the user can easily grasp the processing contents corresponding to the operation and can perform a desired process without making a mistake.

  In addition, when a medical image in a certain image display area is dragged to another image display area, when two or more processing contents are associated with these image display areas, the two or more processing contents can be selected. A process selection dialog (process selection information) to be presented is displayed. Accordingly, the user can first recognize that two or more processing contents are associated with the operation, and can easily select a desired one from the two or more processing contents. it can.

  Various configurations included in the present embodiment described above can be arbitrarily applied to modified examples described below.

[Modification]
The configuration described in detail above is merely a specific example for suitably implementing the medical image display apparatus according to the present invention, and arbitrary modifications within the scope of the gist of the present invention can be made as appropriate. It is. Hereinafter, modifications according to the above embodiment will be described.

[First Modification]
The first modification is a modification of the approximate cross-sectional image selection process. The medical image display apparatus according to this modification has the same configuration as that of the above embodiment (see FIG. 1). However, the tomographic image generation unit 6 in this modification executes processing (interpolation processing) for generating image data of a tomographic image having a cross-sectional position between two cross-sectional images having different cross-sectional positions. The tomographic image generator 6 corresponds to an example of the “interpolated tomographic image generator” of the present invention.

  Assume that the thumbnail image displayed in the thumbnail image display area P1 and the observation image displayed in the observation image display area P4 are tomographic images in the same cross-sectional direction. Here, for example, as shown in FIG. 4, a thumbnail image g1 representing a series of axial images is displayed in the thumbnail image display area P1, and an observation image G2 of the axial image is displayed in the observation image display area P4. Suppose that

  The series represented by the thumbnail image g1 does not include a tomographic image at the same cross-sectional position (slice position) as the observation image G2. The series of medical images represented by the thumbnail image g1 and the observation image G2 may be different types of medical images.

  The user operates the operation unit 10 to drag the observation image G2 displayed in the observation image display area P4 and drop it on the thumbnail image g1 (the reverse drag and drop operation may be used).

  Under the control of the control unit 2, the cross-sectional image generation unit 6 is based on the image data of the series of tomographic images represented by the thumbnail image g1 and the accompanying information, and the accompanying information of the image data of the observation image G2. Image data of a new tomographic image is generated at substantially the same cross-sectional position as the observation image G2.

  More specifically, the cross-sectional image generation unit 6 first specifies the cross-sectional position of the observation image G2 based on the cross-sectional position information of the auxiliary information of the observation image G2. Next, referring to the sectional position information of the incidental information of each tomographic image of the series represented by the thumbnail image g1, a tomographic image having a sectional position close to the sectional position of the observation image G2 is extracted. At this time, for example, two tomographic images having cross-sectional positions located so as to sandwich the cross-sectional position of the observation image G2 are extracted. Then, by executing a known interpolation process using the extracted tomographic image data, new tomographic image data having substantially the same cross-sectional position as the observation image G2 is generated.

  Based on the image data generated by the tomographic image generation unit 6, the control unit 2 displays an observation image of the new tomographic image in the observation image display region P2.

  According to the first modified example that operates in this manner, the process of generating an interpolated image having a specific cross-sectional position can also be executed by a drag-and-drop operation between medical images. The above-mentioned disadvantages are not incurred.

[Second Modification]
The medical image display apparatus according to the second modification is designed to increase the efficiency of the entire system together with the effects of the above-described embodiment by requesting an external apparatus (viewer or the like) to execute a predetermined process. is there.

  FIG. 21 shows an example of a medical image display apparatus according to this modification. The medical image display apparatus 100 shown in the figure includes a control unit 2, a storage unit 3, a thumbnail image generation unit 4, a medical image association unit 7, and a display unit 9, similarly to the medical image display device 1 of the above embodiment. An operation unit 10 and a communication unit 11 are provided. The communication unit 11 functions as an example of the “communication unit” of the present invention. The difference image generation unit 5, the tomographic image generation unit 6, and the image position adjustment unit 8 need not be provided.

  The medical image display apparatus 100 is connected to a computer 3000 via a network N. The computer 3000 is, for example, a server on the network N or a viewer for image interpretation. The computer 3000 is preferably a computer having a higher processing capability than the medical image display device 100. In that case, a plurality of devices similar to the medical image display device 100 may be connected. In FIG. 21, illustrations of the medical image diagnostic apparatuses 1000A and 1000B and the medical image database 2000 connected to the network N are omitted.

  The computer 3000 includes a control unit 3001, a display unit 3002, and an operation unit 3003 in the same manner as a normal computer. A storage device such as a hard disk drive of the computer 3000 stores a computer program that generates image data of a difference image, a computer program that generates image data of a tomographic image by MPR or the like, and a computer program that performs image alignment. Has been. The control unit 3001 includes communication devices such as a LAN card and a modem.

  The microprocessor of the computer 3000 functions as a difference image generation unit 3004, a tomographic image generation unit 3005, and an image position adjustment unit 3006 by executing these computer programs. The difference image generation unit 3004, the tomographic image generation unit 3005, and the image position adjustment unit 3006 operate in the same manner as the difference image generation unit 5, the tomographic image generation unit 6, and the image position adjustment unit 8 of the above embodiment, respectively. Note that the computer 3000 does not need to be configured by a single computer, and a configuration in which these functions are distributed to two or more computers can be applied.

  This modification provides each modification of the difference image generation process, the tomographic image generation process, and the fusion image generation process in the above embodiment.

(Modification of difference image generation processing)
First, a modification of the difference image generation process will be described with reference to FIG. In order to perform this process, the user operates the operation unit 10 (mouse) to drag the thumbnail image g1 displayed in the thumbnail image display area P1, and to the thumbnail image g2 displayed in the thumbnail image display area P3. Drop it. Note that the reverse drag-and-drop operation may be performed.

  When this drag and drop operation is performed, the medical image association unit 7 performs the medical image included in the series (first series) represented by the thumbnail image g1 and the thumbnail image g2 in the same manner as in the above embodiment. Are associated with medical images included in the series represented by (second series).

  The control unit 2 compares the medical image image data included in the first series of medical images and the medical image image data included in the second series of medical images together with the difference image of the medical images associated with each other. A signal (request information) for requesting generation of the image data is sent to the communication unit 11. The communication unit 11 transmits these data to the computer 3000 through the network N.

  The control unit 3001 of the computer 3000 receives data from the medical image display device 100 and sends it to the difference image generation unit 3004. The difference image generation unit 3004 generates image data of the difference image of the associated medical image based on these data. The generated image data is transmitted to the medical image display device 100 by the control unit 3001.

  The medical image display apparatus 100 receives image data transmitted from the computer 3000. The control unit 2 displays a difference image based on the image data in the observation image display area P2. This difference image can be displayed on the display unit 3002 of the computer 3000 as necessary.

(Modification of tomographic image generation processing)
Next, a modification of the tomographic image generation process will be described with reference to FIG. In order to perform this process, the user operates the operation unit 10 (mouse) to drag the observation image G3 of the tomographic image displayed in the observation image display region P4 and display it in the thumbnail image display region P1. Drop it on the thumbnail image g1. Note that the reverse drag-and-drop operation may be performed.

  When this drag-and-drop operation is performed, the control unit 2 has the same cross section as the observation image G3 together with the image data of the series of tomographic images represented by the thumbnail image g1 and the accompanying information, and the accompanying information of the observation image G3. A signal (request information) for requesting generation of image data of the tomographic image in the direction is sent to the communication unit 11. The communication unit 11 transmits these data to the computer 3000 through the network N.

  The control unit 3001 of the computer 3000 receives data from the medical image display apparatus 100 and sends it to the tomographic image generation unit 3005. The tomographic image generation unit 3005 generates image data of a target tomographic image based on these data. The generated image data is transmitted to the medical image display device 100 by the control unit 3001.

  The medical image display apparatus 100 receives image data transmitted from the computer 3000. The control unit 2 displays a tomographic image based on the image data in the observation image display area P2. This tomographic image can be displayed on the display unit 3002 of the computer 3000 as necessary.

(Modification of fusion image generation process)
Next, a modification of the fusion image generation process will be described with reference to FIG. In order to perform this process, the user operates the operation unit 10 (mouse) and drags the observation image G2 of the tomographic image displayed in the observation image display region P4, and is displayed in the thumbnail image display region P1. Drop it on the thumbnail image g1. Note that the reverse drag-and-drop operation may be performed.

  When this drag-and-drop operation is performed, the control unit 2 is based on the cross-sectional position information of the image position information of the series of tomographic images represented by the thumbnail image g1 and the cross-sectional position information of the image position information of the observation image G2. Thus, a tomographic image at substantially the same cross-sectional position as the observation image G2 is selected from the series.

  Next, the control unit 2 selects the image data and image position information of the selected tomographic image, the image data and image position information of the observation image G2, and a signal (request information) for requesting the alignment of these two images. To the communication unit 11. The communication unit 11 transmits these data to the computer 3000 through the network N.

  The control unit 3001 of the computer 3000 receives data from the medical image display apparatus 100 and sends it to the image position adjustment unit 3006. The image position adjustment unit 3006 aligns the tomographic image selected from the series represented by the thumbnail image g1 and the observation image G2 based on the image position information. The aligned image data is transmitted to the medical image display apparatus 100 by the control unit 3001.

  Note that this image data may be a single image data obtained by combining after positioning and adjusting the transparency value, or the image data of the selected tomographic image and the observation It may be data including image data of the image G2 and data (position of movement of coordinate values, etc.) indicating the alignment result of these two image data.

  The medical image display apparatus 100 receives image data transmitted from the computer 3000. The control unit 2 displays a fusion image based on the image data in the observation image display area P2. The fusion image can be displayed on the display unit 3002 of the computer 3000 as necessary.

[Third Modification]
The processing described in the above embodiment is executed when two medical images are specified. However, it may be configured to execute predetermined processing by specifying three or more medical images. Is possible. In the third modification, an example of a configuration for designating three or more medical images will be described.

  This modification is a modification of the difference image generation process in the above embodiment. In the interpretation of medical images, images of multiple examinations performed so far may be observed at once. In particular, images at the same site (for example, the same cross-sectional position) may be observed at a time. In such a case, these images are displayed side by side on the medical image display screen.

  In this modified example, although not shown in the figure, it is assumed that tomographic images at the same cross-sectional position respectively obtained by h times (h ≧ 3) inspections performed so far are displayed. As for display correspondence, the tomographic image G1 of the latest examination is displayed in the observation image display area P2 (on the left side) of the medical image display screen P of the above embodiment, and the tomographic images G2 of the previous examination are displayed. Gh can be displayed in the observation image display area P4 (on the right side). Further, a display area may be provided for each examination.

  When the user operates the operation unit 10 to specify these h pieces of tomographic images G1 to Gh, the difference image generation unit 5 generates image data of difference images for each combination of these tomographic images G1 to Gh. . That is, the image data of the difference image S (i, j) is generated for each pair (Gi, Gj) (i, j = 1 to h, i ≠ j) of h tomographic images.

  The thumbnail image generation unit 4 generates image data of the thumbnail image s (i, j) of each difference image S (i, j) based on the generated image data of the difference image S (i, j). The control unit 2 generates a list of difference images as shown in FIG. 22 based on the image data. In the list of difference images, thumbnail images s (i, j) corresponding to each pair (Gi, Gj) of tomographic images are arranged in a matrix. The user can display the difference image S (i, j) corresponding to the thumbnail image s (i, j) by clicking the desired thumbnail image s (i, j), for example.

[Fourth Modification]
In the fourth modification, the operability of the mouse as the operation unit 10 is improved. The mouse is used for various operations such as an operation for changing the gradation of the display image, an operation for enlarging, reducing, rotating, and panning the display image, and an operation for entering an annotation in the display image. Hereinafter, an example of a configuration for using one mouse for various operations will be described with reference to FIGS. 23 to 25.

  For example, when the user performs a predetermined operation on the operation unit 10 when the medical image display screen P is in the display state shown in FIG. 10 (S81), the control unit 2 displays a mouse mode menu MM as shown in FIG. It is displayed on the part 9 (S82).

  As the operation of step S81, for example, an operation of rotating the mouse wheel while pressing a control key of the keyboard, an operation of double clicking on the screen of the medical image display screen P, or the like can be applied. Here, the former operation is adopted.

  The mouse mode menu MM displayed in step S82 includes a plurality of (here, eight) icons corresponding to various operations performed with the mouse. These icons are arranged in a substantially circular shape. Among these icons, the icon in the “clock 12 o'clock direction” is the selected icon.

  The eight icons presented in the mouse mode menu MM will be described in the clockwise order from the icon in the “clock 12 o'clock direction” in FIG. 24: (1) The window level and window of the displayed medical image Icon corresponding to the width change operation, (2) Icon corresponding to the operation to enter the elliptical annotation, (3) Icon corresponding to the operation to enter the rectangular annotation, (4) Arrow-shaped annotation An icon corresponding to an operation to be performed, (5) an icon corresponding to an operation for designating a plurality of objects (medical images, etc.) on the display screen, (6) an icon corresponding to a drag operation, and (7) enlargement / reduction of the image Icon corresponding to the operation, (8) Icon corresponding to the operation of panning the image.

  When the user rotates the mouse wheel (S83; Y), the control unit 2 displays eight icons, for example, in a state where the icon is rotated clockwise according to the rotation angle (S84). The user rotates the mouse wheel so that the icon corresponding to the desired mouse operation is arranged in the “clockwise 12 o'clock direction”. FIG. 25 shows a display state when the icon is rotated clockwise by three icons from the icon arrangement state shown in FIG. In the display state of FIG. 25, the icon corresponding to the drag operation is selected.

  When the desired mouse operation icon is selected, the user performs an operation such as releasing the pressed state of the control key, and requests the end of the icon selection operation (S85; Y).

  The control unit 2 changes the setting of the operation mode of the mouse so that the operation corresponding to the selected icon can be performed with the mouse (S86).

  In the mouse operation mode changing process described above, icons corresponding to each operation mode are arranged in a circular shape to select a mode, but the icon arrangement form is arbitrary. Further, instead of using an icon, a mouse mode selection dialog such as the process selection dialog D1 shown in FIG. 7 can be displayed, and a desired one can be selected from the tabs corresponding to each operation mode. Moreover, it is possible to use an arbitrary method such as a pull-down menu or a soft key that presents a desired item from a plurality of operation content options. The information presented so that a plurality of mouse operation modes can be selected corresponds to “operation content selection information” of the present invention.

  Further, the operation method for selecting a desired operation mode is not limited to the above configuration, and any operation form using the operation unit 10 can be applied.

[Other variations]
In the above embodiment, a medical image designation operation is performed by dragging and dropping a medical image onto another medical image. However, the medical image designation method is not limited to this. For example, it can be configured to specify by clicking each medical image. The order in which the two medical images are designated can also be set as appropriate.

  In the above embodiment, by specifying two medical images, the processing associated with the image display area in which they are displayed is performed. However, the medical image to be processed and other medical images are processed. It is also possible to configure so as to perform the processing by designating an image display area in which is displayed. That is, when the user operates the operation unit 10 to specify the medical image displayed in the first image display region and the second image display region among the plurality of image display regions, the control unit 2 is configured to cause the processing shown in the processing content associated with the combination of the first image display region and the second image display region by the processing content related information 32a to be performed on the image data of the medical image. can do.

  For example, as a modification of the display image switching process, this observation corresponds to the designation of the thumbnail image displayed in the thumbnail image display area P1 (or P3) and the observation image display area P2 (or P4). The display of the observation image displayed in the image display area P2 (or P4) is terminated, and the observation image of the series of medical images represented by the designated thumbnail image is displayed in the observation image display area P2 (or P4). ) Can be configured to be displayed.

  Further, as a modification of the parallel display processing, the thumbnail image displayed in the thumbnail image display area P1 (or P3) and the observation image display area P2 (or P4) are designated and designated. The observation image of the series of medical images represented by the thumbnail image is displayed in the observation image display region P2 (or P4) together with the observation image already displayed in the observation image display region P2 (or P4). It can be constituted as follows.

  In the above-described embodiment, a thumbnail image is used as the “reduced image” of the present invention. However, an image obtained by simply reducing the observation image can be used as the “reduced image”.

DESCRIPTION OF SYMBOLS 1,100 Medical image display apparatus 2 Control part 3 Storage part 31 Image data storage part 32 Information storage part 32a Process content related information 4 Thumbnail image generation part 5 Difference image generation part 6 Tomographic image generation part 7 Medical image correspondence part 8 Image Position adjustment unit 9 Display unit 10 Operation unit 1000A, 1000B Medical image diagnostic apparatus 2000 Medical image database 3000 Computer 3004 Difference image generation unit 3005 Tomographic image generation unit 3006 Image position adjustment unit P Medical image display screen P1, P3 Thumbnail image display area P2 , P4 Observation image display areas g1, g2, g3, g3 ′ Thumbnail images G1, G2, G3, G3 ′ Observation images D1, D2 Processing selection dialog AN, AN ′ Annotation (image)
M, M 'Measurement result (image)
MM mouse mode menu

Claims (26)

Display means for displaying a medical image display screen in which a plurality of image display areas are predefined;
Image data storage means for storing image data of medical images;
Related information storage means for storing related information for associating the combination of the image display areas and the processing content for the image data of the medical image;
Operation means;
When two medical images displayed in different image display areas of the plurality of image display areas are respectively designated using the operation means, for at least one image data of the two medical images, Control means for executing a process indicated by a process content associated with a combination of image display areas in which the two medical images are respectively displayed according to the related information;
With
When the one medical image of the two medical images is designated, the control unit is configured as a combination with an image display area in which the one medical image is displayed among the plurality of image display areas. Displaying the image display area associated with the processing content by the related information and the image display area not associated with each other in an identifiable manner;
A medical image display device characterized by that. Display means for displaying a medical image display screen in which a plurality of image display areas are predefined;
Image data storage means for storing image data of medical images;
Related information storage means for storing related information for associating the combination of the image display areas and the processing content for the image data of the medical image;
Operation means;
When two medical images displayed in different image display areas of the plurality of image display areas are respectively designated using the operation means, for at least one image data of the two medical images, Control means for executing a process indicated by a process content associated with a combination of image display areas in which the two medical images are respectively displayed according to the related information;
With
The related information associates two or more processing contents with a combination of predetermined image display areas among the plurality of image display areas,
The control means includes
When the medical image displayed in one image display area of the combination of the predetermined image display areas is specified, processing selection information for presenting the two or more processing contents to be selectable is displayed on the display means. As well as display
Executing the process indicated by the process content selected from the two or more process contents using the operation means;
A medical image display device characterized by that. The image data storage means further stores additional information of medical images,
The control means causes the process to be executed based on the incidental information of the two specified medical images.
The medical image display device according to claim 1 or claim 2, characterized in that. Further comprising reduced image generation means for generating image data of a reduced image of the medical image based on the image data of the medical image stored in the image data storage means;
The plurality of image display areas include a reduced image display area in which a reduced image based on the generated image data is displayed, and an observation image display area in which an observation image of a medical image used for observation by a user is displayed. Including
The control means includes
When the reduced image displayed in the reduced image display area and the observation image displayed in the observation image display area are designated, the display of the designated observation image is terminated as the processing. As well as
Displaying an observation image based on the image data that is the basis of the image data of the designated reduced image in the observation image display area;
The medical image display device according to claim 1 or claim 2, characterized in that. Further comprising reduced image generation means for generating image data of a reduced image of the medical image based on the image data of the medical image stored in the image data storage means;
The plurality of image display areas include a reduced image display area in which a reduced image based on the generated image data is displayed, and an observation image display area in which an observation image of a medical image used for observation by a user is displayed. Including
The control means includes
When the reduced image displayed in the reduced image display area and the observation image displayed in the observation image display area are designated, the processing is performed based on the image data of the designated reduced image. Display the observation image based on the image data and the designated observation image in the observation image display area,
The medical image display device according to claim 1 or claim 2, characterized in that. Further comprising reduced image generation means for generating image data of a reduced image of the medical image based on the image data of the medical image stored in the image data storage means;
The plurality of image display areas are generated for a first reduced image display area in which the generated first reduced image is displayed for a representative image of a series of medical images and for a representative image of another series of medical images. A second reduced image display area in which the second reduced image is displayed, a first observation image display area in which observation images of the series of medical images used for observation by the user are displayed, A second observation image display area in which images for observation of the other series of medical images are displayed;
The control means includes
When the first reduced image and the second reduced image are designated, the processing includes a medical image included in the series of medical images and a medical image included in the other series of medical images. And a medical image corresponding means for associating based on the stored auxiliary information,
When one medical image of the series of medical images is displayed in the first observation image display area using the operation means, the medical image associated with the one medical image is displayed. Selecting from among the other series of medical images, and displaying the observation image of the selected medical image in the second observation image display area;
The medical image display apparatus according to claim 3 . Reduced image generation means for generating image data of a reduced image of the medical image based on the image data of the medical image stored in the image data storage means;
Difference image generation means for generating image data of a difference image of the two medical images based on image data of two different medical images;
Further comprising
The plurality of image display areas are generated for a first reduced image display area in which the generated first reduced image is displayed for a representative image of a series of medical images and for a representative image of another series of medical images. A second reduced image display area in which the second reduced image is displayed,
The control means includes
When the first reduced image and the second reduced image are designated, the processing includes a medical image included in the series of medical images and a medical image included in the other series of medical images. And a medical image corresponding means for associating based on the stored auxiliary information,
Controlling the difference image generation means to generate image data of a difference image between a medical image included in the associated series of medical images and a medical image included in the other series of medical images;
The medical image display apparatus according to claim 3 . Based on image data of two different medical images, connected to a computer having a difference image generating means for generating image data of a difference image of the two medical images via a network,
Reduced image generation means for generating image data of a reduced image of the medical image based on the image data of the medical image stored in the image data storage means;
Communication means for communicating with the computer over the network;
Further comprising
The plurality of image display areas are generated for a first reduced image display area in which the generated first reduced image is displayed for a representative image of a series of medical images and for a representative image of another series of medical images. A second reduced image display area in which the second reduced image is displayed,
The control means includes
When the first reduced image and the second reduced image are designated, the processing includes a medical image included in the series of medical images and a medical image included in the other series of medical images. And a medical image corresponding means for associating based on the stored auxiliary information,
Request to generate image data of medical images included in the series of medical images, image data of medical images included in the other series of medical images, and image data of difference images of the associated medical images. Causing the difference image generation means to generate image data of the difference image by causing the computer to transmit request information through the network.
The medical image display apparatus according to claim 3 . The incidental information includes image position information indicating a position of a medical image,
The association by the medical image association unit is performed by associating medical images having substantially the same position indicated by image position information with respect to the series of medical images and the other series of medical images.
The medical image display device according to any one of claims 6 to 8 , wherein the medical image display device is a medical image display device. The series of medical images is a series of tomographic images of a subject,
The other series of medical images is another series of tomographic images of the subject,
The image position information includes cross-sectional position information indicating a cross-sectional position of a tomographic image,
The association by the medical image association unit is performed by associating medical images having substantially the same cross-sectional position indicated in the cross-sectional position information with respect to the series of tomographic images and the other series of tomographic images.
The medical image display apparatus according to claim 9 . The incidental information includes photographing time phase information indicating a photographing time phase of the medical image,
The association by the medical image association unit is performed by associating medical images having substantially the same imaging time phase shown in the imaging time phase information with respect to the series of medical images and the other series of medical images.
The medical image display device according to any one of claims 6 to 8 , wherein the medical image display device is a medical image display device. The image data of the medical image stored in the image data storage means includes image data of a tomographic image of the subject,
Reduced image generating means for generating image data of a reduced image of the tomographic image based on the stored image data of the tomographic image;
Based on the stored tomographic image data, tomographic image generating means for generating tomographic image data in a cross-sectional direction different from the tomographic image;
Further comprising
The plurality of image display areas include a reduced image display area where the generated reduced image is displayed for a representative image of a series of tomographic images, and a cross-sectional direction different from the series of tomographic images used for observation by a user. An observation image display area in which an observation image of the tomographic image is displayed,
The control means performs the processing when the reduced image displayed in the reduced image display area and the observation image of the tomographic image displayed in the observation image display area are specified as the processing. Based on the image data of the tomographic image included in the series of tomographic images and the stored auxiliary information by controlling the generation unit, an image of a new tomographic image in the same cross-sectional direction as the designated observation image Generate data,
The medical image display apparatus according to claim 3 . Based on the image data of the tomographic image of the subject, connected to a computer having tomographic image generation means for generating tomographic image data in a cross-sectional direction different from that of the tomographic image, via a network,
The image data of the medical image stored in the image data storage means includes image data of a tomographic image of the subject,
Reduced image generating means for generating image data of a reduced image of the tomographic image based on the stored image data of the tomographic image;
Communication means for communicating with the computer over the network;
Further comprising
The plurality of image display areas include a reduced image display area where the generated reduced image is displayed for a representative image of a series of tomographic images, and a cross-sectional direction different from the series of tomographic images used for observation by a user. An observation image display area in which an observation image of the tomographic image is displayed,
The control means, as the processing, performs the communication means when the reduced image displayed in the reduced image display area and the observation image of the tomographic image displayed in the observation image display area are specified. The tomographic image data included in the series of tomographic images, the stored auxiliary information, and a new cross-sectional direction that is the same as the designated observation image based on the image data and the auxiliary information. Request information for requesting generation of image data of a tomographic image is transmitted to the computer through the network, thereby causing the tomographic image generation means to generate image data of the new tomographic image,
The medical image display apparatus according to claim 3 . The plurality of image display areas further include another observation image display area in which images for observation of the series of tomographic images are displayed,
The control means causes the observation image of the new tomographic image based on the image data generated by the tomographic image generation means to be displayed in the other observation image display area.
The medical image display device according to claim 12 or 13 , wherein the medical image display device is a medical image display device. The reduced image generating means generates image data of a reduced image of the new tomographic image based on the image data generated by the tomographic image generating means,
The control unit stores the image data of the new tomographic image in the image data storage unit, and displays the generated reduced image of the new tomographic image in the reduced image display area.
The medical image display device according to claim 12 or 13 , wherein the medical image display device is a medical image display device. Further comprising reduced image generation means for generating image data of a reduced image of the medical image based on the image data of the medical image stored in the image data storage means;
The medical image includes a tomographic image of a subject,
The plurality of image display areas display a reduced image display area in which the generated reduced image is displayed for a representative image of a series of tomographic images, and an image for observation of the series of tomographic images to be used for observation by a user. A first observation image display area, and a second observation image display area in which an observation image of a tomographic image in the same cross-sectional direction as the series of tomographic images is displayed,
The control means, when the reduced image displayed in the reduced image display area and the observation image of the tomographic image displayed in the second observation image display area are designated, Based on the stored auxiliary information, a tomographic image at a cross-sectional position substantially the same as the designated observation image is selected from the series of tomographic images, and an observation image of the selected tomographic image is selected from the first tomographic image. To be displayed in the observation image display area of
The medical image display apparatus according to claim 3 . The medical image includes a tomographic image of a subject,
Reduced image generation means for generating image data of a reduced image of the medical image based on the image data of the medical image stored in the image data storage means;
Interpolated tomographic image generation means for generating image data of a tomographic image having a cross-sectional position between two tomographic images having different cross-sectional positions;
Further comprising
The plurality of image display areas display a reduced image display area in which the generated reduced image is displayed for a representative image of a series of tomographic images, and an image for observation of the series of tomographic images to be used for observation by a user. A first observation image display area, and a second observation image display area in which an observation image of a tomographic image in the same cross-sectional direction as the series of tomographic images is displayed,
The control means, when the reduced image displayed in the reduced image display area and the observation image of the tomographic image displayed in the second observation image display area are designated, The interpolated tomographic image generation means is controlled, and based on the image data of the tomographic image included in the series of tomographic images and the stored auxiliary information, a new image at a substantially same cross-sectional position as the designated observation image is obtained. Generating image data of a tomographic image and displaying the observation image of the new tomographic image in the first observation image display area.
The medical image display apparatus according to claim 3 . The image data of the series of tomographic images and the image data of the tomographic images in the same cross-sectional direction are different types of medical images.
The medical image display device according to claim 16 or 17 , wherein the medical image display device is a medical image display device. The incidental information includes image position information indicating a position of a medical image,
The image data storage means stores two or more different types of medical images,
Reduced image generation means for generating image data of a reduced image of the medical image based on the image data of the medical image stored in the image data storage means;
Image position adjusting means for aligning different types of medical images based on the image data of the different types of medical images and the image position information;
Further comprising
The plurality of image display areas include a reduced image display area in which the generated reduced image is displayed with respect to a representative image of a series of medical images, and the same cross-sectional direction as the series of medical images used for observation by a user. And a series of medical images and an observation image display region in which observation images of different types of medical images are displayed,
The control means includes
When the reduced image displayed in the reduced image display area and the observation image of the medical image displayed in the observation image display area are designated, the stored image position information is used as the process. Based on the series of medical images, a medical image at substantially the same position as the designated observation image is selected,
Controlling the image position adjusting means to execute alignment between the designated observation image and the selected medical image;
The medical image display apparatus according to claim 3 . The incidental information includes image position information indicating a position of a medical image,
The image data storage means stores two or more different types of medical images,
Based on the image data of the different types of medical images and the image position information, the computer is connected via a network to a computer having image position adjustment means for aligning the different types of medical images,
Reduced image generation means for generating image data of a reduced image of the medical image based on the image data of the medical image stored in the image data storage means;
Communication means for communicating with the computer over the network;
Further comprising
The plurality of image display areas include a reduced image display area in which the generated reduced image is displayed with respect to a representative image of a series of medical images, and the same cross-sectional direction as the series of medical images used for observation by a user. And a series of medical images and an observation image display region in which observation images of different types of medical images are displayed,
The control means includes
When the reduced image displayed in the reduced image display area and the observation image of the medical image displayed in the observation image display area are designated, the stored image position information is used as the process. Based on the series of medical images, a medical image at substantially the same position as the designated observation image is selected,
The communication means is controlled, the image data of the designated observation image, the image data of the selected medical image, the stored image position information, and the registration of the observation image and the medical image Request information for requesting the image to be transmitted to the computer through the network, thereby causing the image position adjusting unit to execute alignment of the observation image and the medical image.
The medical image display apparatus according to claim 3 . The plurality of image display areas further include another observation image display area in which images for observation of the series of tomographic images are displayed,
The control means superimposes the designated observation image, which has been aligned by the image position adjustment means, with the observation image of the selected medical image, and displays it in the other observation image display area Let
The medical image display device according to claim 19 or 20 , wherein the medical image display device is a medical image display device. The incidental information includes annotation information related to an annotation image displayed attached to a medical image,
The plurality of image display areas include a first observation image display area in which an observation image of a medical image to be used for observation by a user is displayed, and a second image in which an observation image of another medical image is displayed. An image display area for observation,
The control means applies the observation image of the medical image displayed in the first observation image display area and the observation image of the other medical image displayed in the second observation image display area. When the annotation image to be attached and displayed is specified, as the processing, the specified observation with the specified annotation image added based on annotation information regarding the specified annotation image Displaying an image in the first observation image display area,
The medical image display apparatus according to claim 3 . The incidental information includes measurement information indicating a result of measurement performed on the medical image,
The plurality of image display areas include a first observation image display area in which an observation image of a medical image to be used for observation by a user is displayed, and a second image in which an observation image of another medical image is displayed. An image display area for observation,
The control means applies the observation image of the medical image displayed in the first observation image display area and the observation image of the other medical image displayed in the second observation image display area. When the measurement result image based on the measurement information attached and displayed is designated, the measurement result image is attached based on the measurement information corresponding to the designated measurement result image as the processing. Displaying the designated observation image in the first observation image display area;
The medical image display apparatus according to claim 3 . The operating means includes a mouse,
The designation is performed by dragging and dropping one medical image of the two medical images to the other medical image using the mouse.
The medical image display device according to claim 1 or claim 2, characterized in that. Display means for displaying a medical image display screen in which a plurality of image display areas are predefined;
Image data storage means for storing image data of medical images;
Related information storage means for storing related information for associating the combination of the image display areas and the processing content for the image data of the medical image;
Operation means;
When the medical image displayed in the first image display area of the plurality of image display areas and the second image display area are specified using the operation means, the specified medical image is displayed. Control means for executing the processing shown in the processing content associated with the combination of the first image display area and the second image display area by the related information with respect to the image data;
With
When the medical image displayed in the first image display area is designated, the control means includes the related information as a combination with the first image display area among the plurality of image display areas. To display the image display area associated with the processing content and the image display area not associated with each other in an identifiable manner.
A medical image display device characterized by that. Display means for displaying a medical image display screen in which a plurality of image display areas are predefined;
Image data storage means for storing image data of medical images;
Related information storage means for storing related information for associating the combination of the image display areas and the processing content for the image data of the medical image;
Operation means;
When the medical image displayed in the first image display area of the plurality of image display areas and the second image display area are specified using the operation means, the specified medical image is displayed. Control means for executing the processing shown in the processing content associated with the combination of the first image display area and the second image display area by the related information with respect to the image data;
With
The related information associates two or more processing contents with a combination of the first image display area and the second image display area,
The control means includes
When the medical image displayed in the first image display area is specified, the display means displays processing selection information that presents the two or more processing contents in a selectable manner, and
Executing the process indicated by the process content selected from the two or more process contents using the operation means;
A medical image display device characterized by that.

Images