JP2004160103A - Medical image compound observation apparatus - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image diagnosis apparatus for overcoming the difficulty of displaying all images at the same time due to increase in image data to be obtained and the difficulty in associating a three-dimensional image with a two-dimensional image. <P>SOLUTION: A plurality of high-precise image display devices disposed adjacently to each other are functioned as one very high precise image display device, and selection and image processing for the image data and alteration of a display parameter can be operated with one operating device. This apparatus includes a planning thumbnail panel for specifying image processing for the image data and specifying an image display area. The apparatus further includes a means for interpolating the image data set, thereby grasping the whole image of the image data and synchronously displaying an image position between a plurality of modalities. The apparatus further includes a means for distributing operation record of a diagnostic reading doctor together with a report thereof, thereby reproducing the operation of the diagnostic reading doctor while reading the report. The operation record is used as a template to be used for diagnostic reading operation of similar image data. Thus, this medical image compound observation apparatus for facilitating image comprehension is realized. <P>COPYRIGHT: (C)2004,JPO

Description

[0001]
[Technology to which the Invention belongs]
The present invention displays a three-dimensional image and a two-dimensional image set created from a plurality of medical image data sets on a plurality of display areas of one ultra-high-definition image display device, and displays the three-dimensional image and the two-dimensional image set. The present invention relates to a combined medical image observation apparatus that facilitates understanding of medical image data by associating the same and enhances the efficiency of a diagnostic process and its transmission.
[0002]
[Prior art]
An X-ray CT apparatus can obtain accurate cross-sectional image data representing physical properties of a human body. In the initial X-ray CT, the number of cross-sectional image data collected in one examination for one subject was 10 to 20. This cross-sectional image data is displayed on an image display device such as a CRT after performing image processing such as window processing for displaying an optimum image. In a conventional method, images displayed on the image display device are sequentially printed on a film. Since about 12 images can be printed on one film, 20 images collected in one inspection can be printed on two films. In a conventional image data interpretation method, a doctor in charge of image interpretation attaches these two films to a light box and interprets 20 images collected in one examination. In addition, a film in which image data collected in a past inspection is burned is attached to a light box at the same time, and the images are compared for image reading.
[0003]
In recent years, with the technological advancement of X-ray CT systems, helical scan X-ray CT systems and multi-row detector X-ray CT systems have been put into practical use. It has become possible to acquire various image data. In addition, due to the technical progress of the X-ray CT apparatus, the X-ray dose to patients has been greatly reduced. As a result, the number of image data collected in one inspection has increased significantly, and may be, for example, 1000.
[0004]
In addition, technological advances in X-ray CT apparatuses have made it possible to collect image data in a short period of time, and to obtain high-quality images of pulsating organs such as the heart. Along with this, four-dimensional acquisition for acquiring image data in each phase obtained by dividing the heartbeat into ten is also performed. As a result, the number of image data items collected in one inspection is greatly increased, and may be, for example, 4,000.
[0005]
With the large increase in image data, the conventional method of printing images on film requires an enormous number of films on which images collected in a single inspection were burned, and all of these films were light-boxed. It is becoming difficult to attach and interpret images.
[0006]
Due to the large increase in image data, it has become difficult to attach a film in which a conventional image is imprinted to a light box and read the image. A so-called electronic light box has been attempted in which a plurality of image display devices are arranged and sequentially display images collected in one inspection. However, the number of images that can be displayed on one high-definition image display device is at most about 24, and even if four of them are arranged, the number of images that can be displayed at one time is about 100. For this reason, there is a demand for a method of displaying 1000 to 4000 images efficiently and interpreting the images.
[0007]
Since accurate cross-sectional image data representing the physical properties of the human body has been obtained with an X-ray CT apparatus, it has been necessary to reconstruct a three-dimensional image using a plurality of cross-sectional image data taken at different cross-sectional positions. Has been done. Particularly, recently, a helical scan X-ray CT apparatus and a multi-row detector X-ray CT apparatus have been put into practical use, so that a more precise three-dimensional image can be reconstructed.
[0008]
Surface display method (surface rendering method), which extracts the boundary surface of the object that constitutes the subject and displays the shape of the boundary surface, and supports the subject in terms of physical properties There is a volume rendering method that treats the data as a three-dimensional array of voxels having the specified values. In the case of displaying a three-dimensional image, generally, the larger the number of cross-sectional image data used for displaying the three-dimensional image, the more precise a three-dimensional image can be created. Technical advances in X-ray CT equipment have resulted in the use of a greater number of cross-sectional image data to create more precise three-dimensional images.
[0009]
However, it is often difficult for a doctor who interprets medical image data to interpret X-ray CT image data only by displaying a three-dimensional image, even for a precise three-dimensional image. This is because the training so far has been performed on two-dimensional images, and the window level setting may affect the shape on three-dimensional images. Therefore, interpretation of X-ray CT image data requires not only three-dimensional image display but also two-dimensional image display.
[0010]
For this purpose, a light box is installed adjacent to the three-dimensional image display device to perform three-dimensional image display and image interpretation using a film. In addition, a two-dimensional image display device, a so-called electronic light box, is installed adjacent to the three-dimensional image display device, and performs three-dimensional image display and interpretation using the two-dimensional image displayed on the electronic light box. However, in these cases, the synergy between the three-dimensional image and the two-dimensional image cannot be expected because the three-dimensional image and the two-dimensional image displayed on the three-dimensional image display device are not well linked.
[0011]
In the interpretation of medical images obtained by medical image examinations such as X-ray examinations, X-ray CT examinations, and MRI examinations, it is important to find findings regarding the secular change of the subject from medical images acquired by past image examinations. is there. For this reason, the medical image collected by the medical image inspection performed this time and the medical image collected by the past inspection are compared side by side. In the conventional reading method in which films are arranged in a light box, it is relatively easy to compare the current image and the past image by rearranging the films. However, when interpreting with a two-dimensional image display device, it is difficult to freely change the layout, and it is quite difficult to compare the present and past images. With the recent increase in the number of images in X-ray CT examinations and MRI examinations, comparative reading has become more difficult in practice.
[0012]
In medical image diagnosis, diagnosis is improved by performing image inspections using multiple modalities and comparing findings obtained by interpretation of those image inspections, rather than by performing image inspections of a single modality. Can be. For this reason, it is required to simultaneously display and compare medical images obtained by medical image examinations such as an X-ray examination, an X-ray CT examination, and an MRI examination. For this reason, it is necessary to compare the X-ray CT image acquired by the X-ray CT examination and the MRI image acquired by the MRI examination, side by side. In a conventional reading method in which films are arranged in a light box, it is relatively easy to compare images of two types of inspection by rearranging films. However, when interpreting with a two-dimensional image display device, it is difficult to freely change the layout, and it is very difficult to compare and refer to multi-modalities. In addition, in order to perform accurate comparative reading using multi-modalities, it is required that the image positions of the respective modalities match. However, image positions are usually different depending on the modality, and comparison and reference between multi-modalities is quite difficult.
[0013]
[Problems to be solved by the invention]
The three-dimensional image display device is widely used because grasping the three-dimensional structure of the subject using the three-dimensional image is easier than grasping the two-dimensional image. There is a request to use an image. Conventionally, there has been insufficient cooperation between the three-dimensional image displayed on the three-dimensional image device and the two-dimensional image displayed on the two-dimensional image display device. It has been difficult to specify a region of interest found in a three-dimensional image on a two-dimensional image displayed on a two-dimensional image display device.
[0014]
Advances in X-ray CT technology have increased the number of image data acquired in a single inspection, making it impossible to arrange all films at once on a light box. Further, even when displaying a two-dimensional image on the two-dimensional image display device, it is impossible to arrange all the images at once. For this reason, how to handle this huge two-dimensional image is an important issue.
[0015]
In interpreting a medical image collected by a medical image inspection, it is important to find a change with time of the subject from a medical image collected by a past image inspection. For this reason, side-by-side comparison of medical images collected by the current medical image examination and medical images collected by past examinations has been performed. It has become difficult to carry out efficiently.
[0016]
In medical image diagnosis, image inspection using a plurality of modalities is performed, and the diagnosis efficiency can be improved by comparing findings obtained by interpretation of these image inspections. For this reason, it is required to simultaneously display and compare medical images obtained by image inspections using a plurality of modalities. However, image positions often differ depending on the modality, and it is quite difficult to compare and refer to images of a plurality of modalities.
[0017]
[Means for Solving the Problems]
SUMMARY OF THE INVENTION The present invention has been devised to solve the above-described problem. A plurality of adjacent high-definition image display devices function as a single ultra-high-definition image display device, and this ultra-high-definition image display is performed. The device can be operated with one man-machine interface. A three-dimensional image is constructed using a medical image data set composed of a plurality of two-dimensional image data collected by the medical image diagnostic apparatus, and the three-dimensional image is displayed in a three-dimensional image display area of the ultra-high definition image display device. Further, image processing is performed on the two-dimensional image data constituting the medical image data set, and this is displayed in the two-dimensional image display area of the ultra-high definition image display device. Selection of one or more medical image data sets to be displayed on the medical image composite observation apparatus, designation of the type of image processing to be performed on the selected medical image data sets, layout of an image display area for displaying the result of the image processing, tertiary Selection of a medical image data set for creating the original image, image processing of the three-dimensional image displayed in the three-dimensional image display area, change of image display parameters, two-dimensional image data from the two-dimensional image data constituting the medical image data set The selection of two-dimensional image data to be displayed in the image display area, the image processing of the two-dimensional image displayed in the two-dimensional image display area, and the change of image display parameters can be operated with one man-machine interface.
[0018]
Selection of medical image data set, designation of image processing to be performed on the selected medical image data set, designation of which screen area of the medical image composite observation device to display the result of image processing, display of three-dimensional images Processing, selection of two-dimensional image data to be displayed in the two-dimensional image display area, and two-dimensional image display-related processing can be interactively operated with one man-machine interface, so that the same medical image data set Display of 3D images and 2D images created from images, association of 3D images with 2D images, simultaneous display of 3D images created from different medical image datasets, simultaneous display of 2D images, 3D image A medical image combined observation device that enables association between images and between two-dimensional images and facilitates image understanding of medical image data has been realized.
[0019]
In particular, means for enabling a screen area for displaying a result of image processing performed on one or more medical image data sets selected for display on the medical image composite observation apparatus to have an arbitrary layout; Means are provided for editing and saving the configured layout, and for enabling the saved layout to be read and reused.
[0020]
When the image data set displayed on the medical image combined observation device is displayed again, a mechanism for applying the previously selected and specified contents edited and saved is selected. The same medical image data set as the previous one is selected, and the same By performing image processing, displaying in the same image display area as the previous time, and applying the same image processing and image display parameters as in the previous time, it has become possible to reproduce the same state as in the previous time.
[0021]
When displaying a medical image data set of a site similar to the previously displayed image data set on the medical image compound observation apparatus, a mechanism for applying the previously edited and saved specified contents is provided, and a medical image similar to the previous one is provided. Similar to the previous display by performing the same image processing on the dataset as the previous display, displaying it in the same image display area as the previous display, and applying the same image processing and image display parameters as the previous display. It is possible to reproduce the state that was done.
[0022]
Means for enabling selection of a range of image data to be displayed in the two-dimensional image display area from the medical image data set, wherein the number of selected image data is the number of display screens allocated to the medical image data set If the number of display screens is larger than the number of display screens, a unit is provided for creating display medical image data corresponding to the number of display screens allocated by interpolation such as averaging of medical image data.
[0023]
Means for selecting a range of image data to be displayed in a two-dimensional image display area from a medical image data set by an image number or an image position for a plurality of examinations by the same modality or a plurality of modalities; Means for creating medical image data for display at a designated image position by interpolation such as averaging of image data, and displaying images while synchronizing the image position between the display image data created for the plurality of examinations A means was provided to enable observation of the image of the region of interest of the subject while synchronizing between multiple modalities.
[0024]
The same image display parameters as the means for setting image display parameters such as window level, window width, enlargement, panning, etc. for each piece of medical image data displayed on the medical image compound observation device Means that can be set for the entire image data included in the same medical image data set, and that the same parameter can be set for the entire image data included in a plurality of medical image data sets Means for storing the image display parameter set, and means for applying the stored image display parameter set when displaying the medical image data set on the medical image combined observation apparatus. With.
[0025]
Means for sequentially recording operation parameters performed when a doctor interprets a medical image data set using the medical image composite observation apparatus; means for editing the sequentially recorded operation parameters; and means for displaying an image of medical image data. Means for applying the stored operation parameters at times, enabling the image display operation to be reproduced using the sequentially recorded operation parameters, and for transmitting the medical image data set to the medical image composite observation apparatus next time. When displaying, it is now possible to reproduce the same display state and display process as before.
[0026]
For a medical image data set to be displayed on the medical image composite observation apparatus, various parameter sets saved with the image interpretation report created by the medical image composite observation apparatus or independently of the image interpretation report are transmitted via a network, or The system is provided with a means for distributing by a file, so that a doctor who refers to the interpretation report can easily reproduce a state in which the interpretation doctor has created the interpretation report.
[0027]
Means for applying various stored parameter sets to a similar medical image data set for a medical image data set to be displayed on the medical image compound observation apparatus, and displaying the similar image data set on the medical image compound observation apparatus In this case, the same display state can be realized.
[0028]
A means for supporting the creation of an interpretation report on a medical image data set and a means for displaying this in the interpretation report display area of the ultra-high-definition image display device are provided for comprehending the image of the medical image data set and creating the interpretation reporter. Made easy.
[0029]
Means for setting a region of interest on a three-dimensional image displayed in a three-dimensional image display area, thereby enabling selection of a range of two-dimensional image data to be displayed in the two-dimensional image display area from medical image data By moving the region of interest on the three-dimensional image, it is possible to select two-dimensional image data to be displayed in the two-dimensional image display region from medical image data.
[0030]
By setting a region of interest on the three-dimensional image displayed in the three-dimensional image display area, a corresponding two-dimensional image is selected from the two-dimensional images displayed in the two-dimensional image display area, and the interest in the three-dimensional image is displayed. Means for enabling a region of interest corresponding to the region to be displayed on the two-dimensional image, and displaying the region of interest at a corresponding position on the two-dimensional image corresponding to the region of interest set on the three-dimensional image This makes it easier to understand the image of medical image data.
[0031]
The medical image compound observation apparatus is configured to select medical image data, select three-dimensional image processing and image display parameters, select two-dimensional image display image data, select two-dimensional image processing and image display parameters based on man-machine interface operations. A means for issuing via a network is provided. A high-speed image processing device is installed near the network of the medical image diagnostic device or the medical image storage communication system (PACS), and medical image data is acquired based on instructions issued by the medical image compound observation device. And a means for performing three-dimensional image processing and image display processing, two-dimensional image processing and image display processing, and transmitting a result of the image processing to a medical image combined observation apparatus via a network. This has made it possible to reduce network traffic and make effective use of image processing functions.
[0032]
BEST MODE FOR CARRYING OUT THE INVENTION
Hereinafter, the medical image composite observation apparatus according to the present invention will be described. FIG. 1 is a schematic diagram showing a configuration of an embodiment of the present invention. Reference numeral 101 denotes an ultra-high-definition image display device which is a main body of the medical image composite observation device, and is constituted by a plurality of high-definition image display devices. Reference numerals 111, 112, 113, 114, 115, 116, 117 and 118 denote a plurality of high-definition image display devices constituting an ultra-high-definition image display device. For example, 112, 113, 114, 116, 117 and 118 are used for a two-dimensional image display area, 111 is used for a three-dimensional image display area, and 115 is used for an image data set setting area and a report creation area. Reference numeral 201 denotes a man-machine interface for operating the medical image composite observation apparatus. This may be independent or integrated into the medical image combined observation apparatus 101. Reference numeral 202 denotes a personal computer, which supplies video signals to a plurality of high-definition image displays constituting the medical image composite observation apparatus main body, and controls the man-machine interface 201. Reference numeral 203 denotes an instruction from the man-machine interface to the high-speed image processing apparatus. A high-speed image processing apparatus 301 performs three-dimensional image processing and two-dimensional image processing of medical image data. Reference numeral 302 denotes a display three-dimensional image or a display two-dimensional image processed by the high-speed image processing apparatus. Reference numeral 401 denotes a medical diagnostic device that generates medical image data such as an X-ray CT device, and 402 denotes an image database such as a PACS that stores medical image data. 403 is a network.
[0033]
The medical image composite observation apparatus main body 101 is composed of, for example, eight high-definition image display devices having 1536 × 2048 pixels. For example, six of them are used as a two-dimensional image display area. In an X-ray CT image having 512 × 512 pixels, 12 images can be displayed on an image display device having 1536 × 2048 pixels, and thus 72 images can be displayed at a time with six devices. For example, one high-definition image display device having 1536 × 2048 pixels is assigned to the three-dimensional image display area and the image data set setting area / report creation area.
[0034]
The user operates the man-machine interface 201 to inquire, for example, the PACS image database 402 of the subject's image examination data to be observed by the medical image composite observation apparatus, specifying the subject's name and the examination date. The PACS image database 402 returns information on the corresponding image inspection. This includes information related to the examination performed on the designated examination date of the subject, and indicates, for example, that the X-ray CT examination, the MRI examination, and the X-ray imaging have been performed. The user selects image inspection data to be observed by the medical image combined observation apparatus from the information, and requests the PACS image database 402 for the image inspection data. The PACS image database 402 transmits the image inspection data to the high-speed image processing device 301.
[0035]
The user operates the man-machine interface 201 to create an interpretation plan for image inspection data to be observed by the medical image composite observation apparatus 101. For example, the contents of the image processing for the X-ray CT image data set of the X-ray CT examination acquired from the PACS image database 402, the MRI image data set of the MRI examination, and the CR image data set of the X-ray imaging, and the result of the image processing are referred to as medical images. Plan on how to display on the compound viewing device.
[0036]
The high-speed image processing apparatus 301 performs the specified image processing based on the interpretation plan created by the user, and transmits the result 302 of the image processing to the personal computer 202. The personal computer 202 displays the image processing result 302 received from the high-speed image processing apparatus in a planned screen area of the medical image composite observation apparatus 101 based on the interpretation plan created by the user. For example, the three-dimensional image created from the X-ray CT image data set is displayed on the screen 111, the two-dimensional image is displayed on the screens 112, 113, 114, the two-dimensional image generated from the MRI image data set is displayed on the screens 116, 117, 118, and the CR. The screen 115 is used for displaying the CR image created from the image data set, and in the image data set setting area / report creation area.
[0037]
The user operates the man-machine interface 201 to select the screen 111 displaying the three-dimensional image, and changes parameters related to the three-dimensional image processing. This change instruction is transmitted to the high-speed image processing device 301 via the personal computer 202. The high-speed image processing device 301 performs image processing based on the three-dimensional image processing parameters sent by the new instruction 203, and sends the result 302 to the personal computer 202. The personal computer 202 updates the image displayed on the screen 111.
[0038]
The user operates the man-machine interface 201 to select the screen 112 or 113 or 114 displaying the two-dimensional image of the X-ray CT, and changes parameters relating to the two-dimensional image processing. This includes two-dimensional image processing such as window level, window width, pan, zoom, and the like. Further, the image data displayed on the screens 112, 113, 114 is changed. For example, if there are 90 pieces of X-ray CT image data, the number of images displayed on the screens 112, 113, and 114 is 36 in this example. An operation such as displaying the 1st to 36th sheets for the first time, the 37th to 72th sheets for the second time, and displaying the 73th to 90th sheets for the third time is required. This change instruction is transmitted to the high-speed image processing device 301 via the personal computer 202. The high-speed image processing device 301 performs image processing based on the two-dimensional image processing parameters sent by the new instruction 203, and sends the result 302 to the personal computer 202. The personal computer 202 updates the images displayed on the screens 112, 113, 114.
[0039]
Since the number of displayed images is large in a two-dimensional image, if the user operates the man-machine interface 201 to change the parameters relating to the processing of one displayed two-dimensional image, all of the parameters are changed. A mechanism is provided that enables the application to two-dimensional images. That is, when the user changes the parameters relating to the processing of one 2D image displayed on the 2D image, the high-speed image processing apparatus 301 is displayed on the screens 112, 113, 114 based on the new 2D image processing parameters. The image processing is performed on all the image data, and the result 302 is transmitted to the personal computer 202. The personal computer 202 updates all the images displayed on the screens 112, 113, 114.
[0040]
The user operates the man-machine interface 201 to select the screen 116 or 117 on which the two-dimensional image of MRI is displayed, and by changing the parameters relating to the two-dimensional image processing, the image selected in the same manner. Alternatively, all of the images displayed on the screens 116 and 117 can be updated.
[0041]
The user operates the man-machine interface 201 to select the screen 115 on which the CR image is displayed, and by changing parameters related to the two-dimensional image processing, the image displayed on the screen 115 or the image displayed on the screen 115 is similarly selected. You can update all of the images you have.
[0042]
The user operates the man-machine interface 201 to create a report using the screen 115 assigned to the report creation area. The created report is stored in the personal computer 202 or the high-speed image processing device 301 together with information on the image used in preparing the report, and is transmitted to an external database such as the PACS image database 402 and stored.
[0043]
An interpretation plan for image examination data to be observed by the medical image compound observation apparatus 101 created by the user operating the man-machine interface 201, that is, an X-ray CT image data set of an X-ray CT examination acquired from the PACS image database 402, Information on MRI image data set of MRI examination, CR image data set of X-ray imaging, plan of how to display the contents of image processing and the result of image processing on them on medical image compound observation device, and actually As the information on the content of the image processing performed, all information at the final point or all information including a change with time is recorded and stored.
[0044]
The information recorded and stored over time can be edited. Using this information, for the same image data set as when this information was recorded, the selection of the image data set when this information was recorded, the details of the image processing, and the display of the result of the image processing are reproduced. be able to.
[0045]
This function makes it possible, for example, to instantly reproduce the final state of image processing and image display performed by the interpreting physician when preparing the report when the referring doctor of the request department reads the report. In addition, the doctor reviewing the report can sequentially reproduce the progress of image processing and image display performed by the radiologist when preparing the report.
[0046]
In addition, using this information, for an image data set similar to the image data set when this information was recorded, image processing having the same contents as when this information was recorded, and displaying the result of the image processing. Can be realized.
[0047]
This function can be used, for example, as a template for an examination of the same part in which an X-ray CT examination, an MRI examination, and a CR examination are set, and can greatly improve a report creation workflow.
[0048]
In the above description, an example in which an X-ray CT examination, an MRI examination, and a CR examination included in an examination on the same examination day are interpreted has been described. It is effective to compare the obtained images. However, for example, the image position of the image data of the chest X-ray CT examination inspected one year ago and the image position of the image data of the chest X-ray CT examination inspected this time often do not coincide.
[0049]
The medical image composite observation apparatus according to the present invention constructs voxel data from an image data set of an X-ray CT examination or an MRI examination, sets two points in the body axis direction, and equally divides the two points into two-dimensional images. The function to find the set of was provided. For example, using voxel data created from an image data set of a chest X-ray CT examination inspected one year ago and voxel data created from an image data set of a chest X-ray CT examination examined this time, By creating the cross-sectional data of the position in the integral axial direction, it is possible to obtain an image in which the image positions completely match. This improves the accuracy of comparative image interpretation. This cross-sectional data is obtained by performing interpolation and averaging on voxels in the range of the cross-sectional interval in the body axis direction.
[0050]
In a medical image composite observation apparatus, the number of two-dimensional image data included in an image data set is generally larger than the number of two-dimensional image display screens that can be assigned to the image data set. Although it is difficult to observe a two-dimensional image at a time, it is possible to create the same number of cross-sectional images as the number of two-dimensional image display screens from the data set of the region of interest in the image data set by using this function. ， It becomes easy to grasp the entire region of interest. Since this cross-sectional image is obtained by performing interpolation and averaging of image data in the range of the cross-sectional interval, an image with no information loss and little noise unlike the so-called thinning-out can be obtained.
[0051]
By using this function, it is possible to create a cross-sectional image of not only a cross section orthogonal to the body axis direction but also a cross section inclined in the body axis direction. This is particularly useful for comparison between multiple modalities, such as when comparing MRI image data and X-ray CT image data.
[0052]
A means is provided for creating medical image data for display at a designated image position within a designated range from a medical image data set for a plurality of examinations by the same modality or a plurality of modalities. This makes it possible to display images while synchronizing the image positions between the display image data. As an example, 24 screens for displaying 110 image data of the current X-ray CT examination, 24 screens for displaying 100 image data of the previous X-ray CT examination, 90 screens for the current MRI examination 24 screens are allocated for the display of the image data, and the upper and lower limits of the image position in the body axis direction of the region of interest of the subject are designated, and the display images are created at 50 equally divided positions. This display image can be observed while synchronizing between multiple inspections and multiple modalities.
[0053]
FIG. 2 is an explanatory diagram showing a display screen of the medical image combined observation apparatus main body according to the embodiment of the present invention. It is used for the description of FIG.
[0054]
FIG. 3 is an explanatory diagram illustrating the allocation of image data sets in the medical image combined observation apparatus according to the embodiment of the present invention. The user operates the man-machine interface 201 to specify a patient name and an examination date, obtain a list of image data sets to be displayed on the medical image combined observation apparatus from the image database 402, and display the list in the 501 image data set allocation table. . 511 is the reference number of the image data set, 512 is the patient name, 513 is the examination number, 514 is the series number, 515 is the modality, 516 is the image number, 517 is the display format, and 518 is the first image number or image of the image averaging. Position, 519 is a column indicating the last image number or image position of the image averaging. Reference numerals 521, 522, and 523 denote setting examples of thumbnails of the medical image combined observation apparatus screen setting panel.
[0055]
In the example of FIG. 3, 110 images of the X-ray CT examination, 90 images of the MRI examination, one image of the CR examination, and the X-ray CT examination of the previous examination B5678, which were examined with the examination number A1234 of the patient name AAA. Plan to display 100 images. Reference numerals 521, 522, and 523 denote setting examples of a medical image combined observation apparatus screen setting panel that is a thumbnail (reduced image) of the display screen of the medical image combined observation apparatus illustrated in FIG. Reference numeral 521 denotes a three-dimensional image created from the image data set of the X-ray CT examination of the serial number 1 on the 111 screen 1 in FIG. 2, and a two-dimensional image from the image data set of the X-ray CT examination of the serial number 1 in FIG. On screens 112 and 116, two-dimensional images from the X-ray CT image data set of reference number 2 are displayed on screens 113 and 117 of FIG. Are displayed on screens 114 and 118 of FIG. Further, a two-dimensional image created from the image data set of the CR inspection with the reference number 4 is displayed on the 115 screen 5 in FIG. The 115 screen 5 is also used for preparing and displaying the report of the reference number 5.
[0056]
522 is another setting example. The three-dimensional image created from the image data set of the X-ray CT examination with the reference number 1 is displayed on the 111 screen 1 in FIG. The two-dimensional images from the image data set of the X-ray CT examination of the serial number 1 are shown in 134 columns 4, 137 rows 7 and 140 columns 10 of FIG. The images are displayed in columns 135, 5, 138, 8 and 141 in FIG. 2 and the two-dimensional images from the image data set of the MRI examination with reference number 3 are displayed in columns 136, 6, 139, 9 and 142 in FIG. are doing. Further, a two-dimensional image created from the image data set of the CR inspection with the reference number 4 is displayed on the 115 screen 5 in FIG. The 115 screen 5 is also used for preparing and displaying the report of the reference number 5.
[0057]
523 is another setting example. A three-dimensional image created from the image data set of the X-ray CT examination with the reference number 1 is displayed on the 111 screen 1 in FIG. Using the six screens 112 screen 2, 113 screen 3, 114 screen 4, 116 screen 6, 117 screen 7, and 118 screen 8, a two-dimensional image created from the image data set of the X-ray CT examination of reference number 1 is In the six screens, 151-line 1, 153-row 3, and 155-row 5, two-dimensional images from the image data set of the X-ray CT examination with reference number 2 are stored in these six screens as 152 rows 2, 154 rows 4, 156 rows 6 In addition, a two-dimensional image from the image data set of the MRI examination with the reference number 3 is displayed on the 157th row and the 1158th row of the six screens. Further, a two-dimensional image created from the image data set of the CR inspection with the reference number 4 is displayed on the 115 screen 5 in FIG. The 115 screen 5 is also used for preparing and displaying the report of the reference number 5.
[0058]
As described above, the layout of the image data set to be displayed on the display screen of the medical image composite observation apparatus is achieved by using the medical image composite observation apparatus screen setting panel which is a thumbnail (reduced image) of the display screen of the medical image composite observation apparatus. Can be planned in advance.
[0059]
Means for enabling a user to select a range of image data to be displayed in the two-dimensional image display area from the medical image data set, wherein the number of the selected image data is When the number is larger than the number, a means is provided for creating medical image data for display corresponding to the number of display screens to which medical image data is allocated by interpolation such as averaging. In FIG. 3, reference numeral 518 denotes a first image number or image position of image averaging, and 519 denotes a last image number or image position of image averaging.
[0060]
The medical image combined observation apparatus according to the present invention constructs voxel data from an image data set of an X-ray CT examination or an MRI examination, sets two points in the body axis direction, and equally divides the two points into two-dimensional images. The function to find the set of was provided. For example, using voxel data created from an image data set of a chest X-ray CT examination inspected one year ago and voxel data created from an image data set of a chest X-ray CT examination examined this time, By creating the cross-sectional data of the position in the integral axial direction, it is possible to obtain an image in which the image positions completely match. This improves the accuracy of comparative image interpretation. This cross-sectional data is obtained by performing interpolation and averaging on voxels in the range of the cross-sectional interval in the body axis direction.
[0061]
In a medical image composite observation apparatus, the number of two-dimensional image data included in an image data set is generally larger than the number of two-dimensional image display screens that can be assigned to the image data set. Although it is difficult to observe a two-dimensional image at a time, it is possible to create the same number of cross-sectional images as the number of two-dimensional image display screens from the data set of the region of interest in the image data set by using this function. ， It becomes easy to grasp the entire region of interest. Since this cross-sectional image is obtained by performing interpolation and averaging of image data in the range of the cross-sectional interval, an image with no information loss and little noise unlike the so-called thinning-out can be obtained.
[0062]
【Example】
In the above description, the personal computer 202 and the high-speed image processing device 301 in FIG. 1 have been described as being independent, but the personal computer 202 and the high-speed image processing device 301 can be integrated. Further, the ultra-high definition image display device 101 and the personal computer 202 can be integrated. Further, the ultra-high definition image display device 101, the personal computer 202, and the high-speed image processing device 301 can be integrated. The man-machine interface 201 for operating the medical image composite observation apparatus 101 can be independent of the medical image composite observation apparatus 101, or can be integrated with the medical image composite observation apparatus 101.
[0063]
The same image data set by enabling the selection of medical image data sets, the creation and display-related processing of three-dimensional images, and the creation and display-related processing of two-dimensional images from a single man-machine interface Simultaneous display of 3D images and 2D image sets created from images, association of 3D images with 2D image sets, association between 3D images and 2D image sets created from multiple image data sets, Easy to understand medical image data.
[0064]
Means for enabling a screen area for displaying a result of image processing performed on one or more medical image data sets selected for display on the medical image composite observation apparatus to have an arbitrary layout; and There are provided means for editing the saved layout and saving it as a thumbnail (reduced image), and means for reading out the saved thumbnail (reduced image) so that it can be reused.
[0065]
When the image data set displayed on the medical image combined observation device is displayed again, a mechanism for applying the previously selected and specified contents edited and saved is selected. The same medical image data set as the previous one is selected, and the same By performing image processing, displaying in the same image display area as the previous time, and applying the same image processing and image display parameters as in the previous time, it has become possible to reproduce the same state as in the previous time.
[0066]
When displaying a medical image data set of a site similar to the previously displayed image data set on the medical image combined observation apparatus, the medical image combined observation apparatus includes means for applying the previously edited and saved specification contents, and By performing the same image processing as the previous display on the image dataset, displaying it in the same image display area as the previous display, and applying the same image processing and image display parameters as the previous display, It is possible to reproduce a similar state.
[0067]
Using a means that allows the range of image data to be displayed in the two-dimensional image display area from the medical image data set to be selected by the image number or the image position, and an interpolation means such as averaging the medical image data Means for generating medical image data for display corresponding to the number of display screens assigned by the user.
[0068]
Means for selecting a range of image data to be displayed in a two-dimensional image display area from a medical image data set by an image number or an image position for a plurality of examinations by the same modality or a plurality of modalities; Means for creating display medical image data at a designated image position using interpolation means such as averaging of image data, and synchronizing the image position between the display image data created for the plurality of examinations. A means for displaying an image while capturing is provided, so that an image of the region of interest of the subject can be observed while being synchronized between a plurality of modalities.
[0069]
The same image display parameters as the means for setting image display parameters such as window level, window width, enlargement, panning, etc. for each piece of medical image data displayed on the medical image compound observation device Means that can be set for the entire image data included in the same medical image data set, and that the same parameter can be set for the entire image data included in a plurality of medical image data sets Means, means for storing the image display parameter set, and means for applying the stored image display parameter set when displaying the medical image data set on the medical image composite observation apparatus. Equipped.
[0070]
Means for sequentially recording operation parameters performed when a doctor interprets a medical image data set using the medical image composite observation apparatus; means for editing the sequentially recorded operation parameters; and means for displaying an image of medical image data. Means for applying the stored operation parameters at times, so that it is possible to reproduce the image display operation using the sequentially recorded operation parameters, and to use the medical image compound observation apparatus When displaying on a, it is possible to reproduce the same display state and display process as before.
[0071]
For the medical image data set to be displayed on the medical image composite observation apparatus, various parameter sets saved with the image interpretation report created by the medical image composite observation apparatus or independently of the image interpretation report can be transmitted via a network or a file. This makes it possible for a doctor who refers to the interpretation report to easily reproduce the state in which the interpretation doctor has created the interpretation report.
[0072]
Means for applying various stored parameter sets to a similar medical image data set for a medical image data set to be displayed on the medical image combined observation apparatus, and displaying the similar image data set on the medical image combined observation apparatus In this case, the same display state can be realized.
[0073]
A means for supporting the creation of an interpretation report on a medical image data set and a means for displaying the report in an interpretation report display area of an ultra-high definition image display device are provided. Made it easier.
[0074]
【The invention's effect】
The present invention enables a plurality of adjacent high-definition image display devices to function as a single ultra-high-definition image display device, and enables a large number of medical images to be displayed thereon. It is possible to construct a three-dimensional image using medical image data collected by the medical image diagnostic apparatus, display the three-dimensional image in the three-dimensional image display area of the ultra-high-definition image display device, and Image processing is performed on a plurality of constituted two-dimensional medical image data, which can be displayed in a two-dimensional image display area of an ultra-high definition image display device. Selection of medical image data, image processing of the three-dimensional image displayed in the three-dimensional image display area and change of image display parameters, selection of image data to be displayed from two-dimensional image data constituting medical image data, two-dimensional image display area It is possible to operate the image processing and change the image display parameters of the two-dimensional image displayed on a single man-machine interface. This makes it possible to display three-dimensional images and two-dimensional images at the same time, to associate three-dimensional images with two-dimensional images, and to provide a medical image compound observation device that facilitates image understanding of medical image data. Could be realized.
[0075]
Selection of medical image data set, designation of image processing to be performed on the selected medical image data set, designation of which screen area of the medical image composite observation device to display the result of image processing, display of three-dimensional images Processing, selection of 2D image data to be displayed in the 2D image display area, and 2D image display-related processing can be interactively operated with one man-machine interface, so that the same medical image data Simultaneous display of 3D images and 2D images created from sets, association of 3D images with 2D images, simultaneous display of 3D images created from different medical image data sets, simultaneous display of 2D images, 3D A medical image combined observation device that enables association between images and between two-dimensional images and facilitates image understanding of medical image data has been realized. In particular, means for enabling a screen area for displaying a result of image processing performed on one or more medical image data sets selected for display on the medical image composite observation apparatus to have an arbitrary layout; Means are provided for editing and saving the configured layout, and for enabling the saved layout to be read and reused.
[0076]
When the image data set displayed on the medical image combined observation device is displayed again, a mechanism for applying the previously selected and specified contents edited and saved is selected. The same medical image data set as the previous one is selected, and the same By performing image processing, displaying the image in the same image display area as the previous time, and applying the same image processing and image display parameters as in the previous time, the same state as the previous time can be instantaneously reproduced by a simple procedure.
[0077]
When displaying a medical image data set of a site similar to the previously displayed image data set on the medical image compound observation apparatus, a mechanism for applying the previously edited and saved specified contents is provided, and a medical image similar to the previous one is provided. Similar to the previous display by performing the same image processing on the dataset as the previous display, displaying it in the same image display area as the previous display, and applying the same image processing and image display parameters as the previous display. It is possible to reproduce the state that was done.
[0078]
Means for enabling a user to select a range of image data to be displayed in the two-dimensional image display area from the medical image data set, wherein the number of the selected image data is If the number is larger than the number, a means is provided for creating medical image data for display corresponding to the number of assigned display screens by averaging the medical image data.
[0079]
Means for selecting a range of image data to be displayed in a two-dimensional image display area from a medical image data set by an image number or an image position for a plurality of examinations by the same modality or a plurality of modalities; Means for creating display medical image data at a designated image position using interpolation means such as averaging of image data, and synchronizing the image position between the display image data created for the plurality of examinations. A means for displaying an image while capturing the image is provided so that the image of the region of interest of the subject can be observed while being synchronized between a plurality of modalities.
[0080]
The same image display parameters as the means for setting image display parameters such as window level, window width, enlargement, panning, etc. for each piece of medical image data displayed on the medical image compound observation device Means that can be set for the entire image data included in the same medical image data set, and that the same parameter can be set for the entire image data included in a plurality of medical image data sets Means for storing the image display parameter set, and means for applying the stored image display parameter set when displaying the medical image data set on the medical image combined observation apparatus. Was provided.
[0081]
Means for sequentially recording operation parameters performed when a doctor interprets a medical image data set using the medical image composite observation apparatus; means for editing the sequentially recorded operation parameters; and means for displaying an image of medical image data. Means for applying the stored operation parameters at times, so that it is possible to reproduce the image display operation using the sequentially recorded operation parameters, and to use the medical image compound observation apparatus When displaying on the, it was possible to reproduce the same display state as the previous time.
[0082]
For the medical image data set to be displayed on the medical image composite observation device, various parameter sets saved together with the image interpretation report created by the medical image composite observation device or independently of the image interpretation report can be transmitted via a network or a file. This makes it possible for a doctor who refers to the interpretation report to easily reproduce the state in which the interpretation doctor has created the interpretation report.
[0083]
Means for applying various stored parameter sets to a similar medical image data set for a medical image data set to be displayed on the medical image combined observation apparatus, and displaying the similar image data set on the medical image combined observation apparatus In this case, the same display state can be realized.
[0084]
The medical image composite observation apparatus is provided with means for supporting creation of an interpretation report on medical image data and displaying the report in an interpretation report display area of the ultra-high definition image display device. Since the three-dimensional image display of the medical data and the two-dimensional image display could be associated with each other, the understanding of the image of the medical image data was facilitated, and the creation of the interpretation report was facilitated.
[Brief description of the drawings]
FIG. 1 is a schematic diagram showing the configuration of an embodiment according to the present invention.
FIG. 2 is a schematic diagram of a medical image combined observation apparatus main body according to an embodiment of the present invention.
FIG. 3 is an explanatory view of an embodiment according to the present invention.
[Explanation of symbols]
101 Medical Image Composite Observation Device Main Body
111 Screen 1 of the medical image combined observation device
112 Screen 2 of the medical image combined observation device
113 Screen 3 of the medical image combined observation device
114 Screen 4 of the medical image combined observation apparatus
115 Screen 5 of the medical image combined observation apparatus
116 Screen 6 of the medical image combined observation apparatus
117 Screen 7 of the medical image combined observation device
118 Screen 8 of the medical image combined observation apparatus
131 Row 1 of screen of medical image combined observation device
132 Column 2 of the screen of the medical image combined observation apparatus
133 Screen 3 of the medical image combined observation device
134 Row 4 of Screen of Medical Image Composite Observation Apparatus
135 Row 5 of screen of medical image combined observation device
136 Row 6 of screen of medical image combined observation device
137 Row 7 of Screen of Medical Image Composite Observation Apparatus
138 Row 8 of screen of medical image combined observation device
139 Row 9 of screen of medical image combined observation device
140 Row 10 of Screen of Medical Image Composite Observation Apparatus
141 Screen row 11 of the medical image combined observation apparatus
142 Row 12 of Screen of Medical Image Composite Observation Apparatus
151 Line 1 on the screen of the medical image combined observation device
152 Line 2 on the screen of the medical image combined observation device
153 Line 3 of screen of medical image combined observation device
154 Line 4 on the screen of the medical image combined observation device
155 Line 5 of screen of medical image combined observation device
156 Line 6 on screen of medical image combined observation device
157 Line 7 on screen of medical image combined observation device
158 Line 8 of screen of medical image combined observation device
201 Man-machine interface
202 Personal computer
203 Instruction issued by personal computer
301 High-speed image processing device
302 Processing result of high-speed image processing device
401 Image diagnostic device
402 Image database such as PACS
403 Network
501 Image data set allocation table
511 Image data set reference number
512 Image dataset patient name
513 Image data set inspection number
514 Image dataset series number
515 Image Dataset Modality
516 Image data set image number
517 Image data set display format
518 Image data set display start image number or image position
519 Image data set display end image number or image position
521 Medical Image Composite Observation Device Screen Setting Panel Thumbnail Setting Example
522 Medical Image Composite Observation Apparatus Screen Setting Panel Thumbnail Setting Example
523 Medical Image Composite Observation Screen Setting Panel Thumbnail Setting Example

Claims (12)

Means for causing a plurality of adjacent high-definition image displays to function as one ultra-high-definition image display, means for operating the ultra-high-definition image display with a single man-machine interface, A means for selecting one or more medical image data sets to be displayed on the image composite observation apparatus, a means for displaying a three-dimensional image created by image processing of the medical image data set in a three-dimensional image display area, and a medical image data set Means for displaying the two-dimensional image set created by the image processing in the two-dimensional image display area, means for specifying the type of image processing to be performed on the selected medical image data set, and means for displaying the image created by the image processing. A means for specifying an image display area to be displayed, a means for specifying image processing and image display parameters, and a means for editing and saving these selections and specification contents. Medical image composite observation apparatus provided with the and. 2. A means according to claim 1, wherein said means for enabling selection of a medical image data set, creation and display-related processing of a three-dimensional image, and creation and display-related processing of a two-dimensional image with a single man-machine interface. Simultaneous display of three-dimensional images and two-dimensional image sets created from the same image data set, association of three-dimensional images with two-dimensional image sets, inter- and three-dimensional images created from multiple image data sets A medical image combined observation device that enables association between sets and facilitates understanding of medical image data. A screen area for displaying a result of image processing performed on one or more medical image data sets selected for display on the medical image combined observation apparatus according to claim 1 and 2, is configured with an arbitrary layout. And a means for editing and saving the configured layout, and a means for reading out and reusing the saved layout. 4. The medical image data set according to claim 3, further comprising means for applying the previously selected and specified contents edited and stored when the image data set displayed on the medical image combined observation apparatus is displayed again. Select, perform the same image processing as before, display it in the same image display area as before, and apply the same image processing and image display parameters as before to make it possible to reproduce the same state as before Compound observation device. 4. The method according to claim 3, further comprising the step of applying the previously edited and saved specified contents when displaying a medical image data set of a site similar to the previously displayed image data set on the medical image combined observation apparatus. By performing the same image processing as the previous display on the medical image dataset similar to the previous one, displaying it in the same image display area as the previous display, and applying the same image processing and image display parameters as the previous display , A medical image combined observation apparatus capable of realizing a state similar to the previous display. In claim 1, claim 2, claim 3, claim 4, or claim 5, a range of image data to be displayed in a two-dimensional image display area is selected from a medical image data set by an image number or an image position. And a means for generating medical image data for display corresponding to the number of display screens allocated by using interpolation means such as averaging medical image data. In claim 1, claim 2, claim 3, claim 4, claim 5, or claim 6, a two-dimensional image display area is selected from a medical image data set for a plurality of examinations using the same modality or a plurality of modalities. Means for selecting the range of image data to be displayed by image number or image position, and display medical image data at the specified image position using interpolation means such as averaging medical image data. Means for creating images and means for displaying images while synchronizing image positions between display image data created for the plurality of examinations, and synchronizing images of the region of interest of the subject among a plurality of modalities. A medical image composite observation device that enables observation while moving. In claim 1, claim 2, claim 3, claim 4, claim 5, claim 6, and claim 7, a window level and a window level are set for the medical image data displayed on the medical image compound observation apparatus. A means for setting image display parameters such as width, enlargement, panning, etc. for each image, and the same image display parameter for all image data included in the same medical image data set Means for setting the same parameters for the entire image data included in the plurality of medical image data sets, means for storing the image display parameter set, and means for storing the image display parameter sets. Means for applying the stored image display parameter set when displaying the data set on the medical image combined observation apparatus. Composite observation device. 9. The medical image processing apparatus according to claim 8, wherein a means for sequentially recording operation parameters performed when the doctor interprets the medical image data set using the medical image compound observation apparatus, a means for editing the sequentially recorded operation parameters, Means for applying the stored operation parameters at the time of displaying the image of the data, enabling the image display operation to be reproduced using the sequentially recorded operation parameters, and the medical image data set to be used next time. A medical image composite observation apparatus that can reproduce the same display state and display process as before when displaying on a medical image composite observation apparatus. The medical image data set to be displayed on the medical image combined observation apparatus according to claim 9, together with the interpretation report created by the medical image combined observation apparatus or independently of the interpretation report. A means for distributing the set of parameters via a network or by a file enables doctors who refer to the radiology report to easily reproduce the progress and / or final state of the radiology doctor's creation of the radiology report. Medical image composite observation device. In claim 1, claim 2, claim 3, claim 4, claim 5, claim 6, claim 7, claim 8, and claim 9, the medical image data set displayed on the medical image combined observation apparatus is On the other hand, various parameter sets stored in claim 1 and claim 2, claim 3, claim 4, claim 5, claim 5, claim 6, claim 7, claim 8, and claim 9 are medical images similar to each other. A medical image combined observation apparatus comprising: means for applying to a data set, wherein a similar display state can be realized when a similar image data set is displayed on the medical image combined observation apparatus. A medical image data set according to claim 1, claim 2, claim 3, claim 4, claim 5, claim 6, claim 7, claim 8, claim 9, claim 10, and claim 11. A medical device that has a means for supporting the creation of an interpretation report and a means for displaying the same in the interpretation report display area of the ultra-high definition image display device, thereby facilitating image understanding of a medical image data set and creation of an interpretation reporter. Image composite observation device.

Images