JP2009128053A - Medical treatment image display device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To easily check relations among various data as to diagnosis using the various data including image data such as a tomographic image. <P>SOLUTION: A medical treatment image display device for displaying three-dimensional medical images is equipped with a storage part, a display part, and a display control part. The storage part is for storing respective sets of data comprising image data on the medical images acquired by diagnostic apparatuses, internal organ data acquired by discriminating internal organs from the image data by image processing, and analysis data acquired from the image data through automatic diagnosis processing. The display part displays the image data, the organ data, and the analysis data. The control part selectively displays the image data, the organ data, and the analysis data stored in the storage part on the display part. The control part extracts three-dimensional image data from the storage part to display them on the display part with reference ID used as an index, the three-dimensional image data corresponding to letters designated on the display part, while extracting letter data from the storage part to display them on the display part, the letter data corresponding to the three-dimensional image data designated on the display part. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a medical image diagnosis, and more particularly, a diagnosis support apparatus and a diagnosis support system for supporting a diagnosis performed by a medical professional by interpreting various multimedia data such as numerical data and character string data in addition to medical image data. The present invention relates to a medical image display device that can be applied.

  In general, attempts have been made to substitute a computer for a diagnosis process performed by a doctor using medical test data (Non-Patent Document 1), but it is difficult to relate the complexity of the human body and the test data to medical knowledge. So, it is not effective.

  In addition, it is difficult to put a diagnosis into practice using a computer using a method different from a diagnostic method by a doctor from the viewpoint of reliability. Therefore, in diagnosis support, the use of a computer is generally auxiliary such as image conversion and image processing.

  In addition, a method for diagnosing in-vivo information represented by CT, MRI, and PET using a tomographic image has been proposed. In the medical field, for example, it is known to perform a medical diagnosis using a tomographic image obtained by a tomographic imaging apparatus such as a PET image. In medical diagnosis using image data such as tomographic images and numerical data, medical experts interpret captured images and extract and infer suspicious areas by comparing them with specialized knowledge and experience.

  For example, in cancer diagnosis using whole body FDG-PET (FDG-Positron Emission Tomography) images, radioactive fluorine (f-18) is labeled and radioactive glucose similar to glucose called FDG (fluorodeoxyglucose) is labeled. A drug is introduced into the body, and its distribution in the body is photographed to obtain an FDG-PET image. The degree of accumulation of FDG is represented by a value called SUV, and the part where there is a cancer shows a high SUV value.

  In whole body PET diagnosis, tomographic imaging from the thigh to the top of the head is performed at intervals of about 3 mm in the body axis direction, and about 300 tomographic images (slice images) are taken for each patient. In this whole-body PET diagnosis, since the SUV value appears high even in the absence of cancer in an inflamed site or an organ / tissue (such as kidney, bladder, liver, etc.) that is likely to take up FDG, the diagnostician correctly diagnoses It takes a lot of burden to do.

  While group screening based on whole-body PET diagnosis is being considered, interpretation of tomographic images requires a long time and a great amount of labor as described above, and it is expected that it cannot cope with the diagnosis of a large number of people.

  As a technique for reducing the burden on the diagnostician related to the interpretation of the tomographic image, it is conceivable to cause the computer to perform a diagnosis based on the interpretation of the tomographic image performed by the diagnostician.

  As a diagnostic method using this computer, it is conceivable to use an existing program language such as FORTRAN or Pascal, and incorporate diagnostic techniques and knowledge into the program by procedural programming. It is also conceivable to construct an inference engine that executes diagnosis inference by combining knowledge with a knowledge base in which specialized knowledge is expressed by simple rules.

  However, in order for the diagnosis to be performed by a computer, it is necessary to grasp what kind of processing the doctor performs on the tomographic image to derive information, but this image processing is mostly empirical and subjective. For this reason, it is difficult to describe in a programming language, and execution on a computer is difficult.

  In general, in cancer screening by whole body PET diagnosis, it is said that almost 80% of the subjects show clearly normal results in which no cancer is seen. If an expert such as a doctor can diagnose only a tomographic image that requires interpretation, it is expected to reduce the burden on the expert such as a doctor.

Therefore, the inventor of the present application has a hierarchical structure of multimedia data including image data, and performs data processing for performing a predetermined operation on the multimedia data to reconstruct the hierarchical structure, thereby enabling diagnosis by an expert. A patent application has been filed that reduces the amount of image data diagnosed by an expert by dividing it into unnecessary data and data that requires expert diagnosis (see Patent Document 1).
EH Shortliffe, “Computer based Medical Consultations: MYCIN”, American: Elsevier, 1976 JP 2006-247164 A

  With computer-based diagnostic methods, for example, in procedural programming, it is difficult to describe the estimation process performed by specialists such as doctors in existing programming languages, and the reasoning performed by experts may not be sufficiently reflected. There is a problem in terms of reliability.

  In addition, when an inference engine is configured, for example, expert knowledge can be described piecewise by a method of describing knowledge as rules in IF-THEN format, but the user can check the written rule part. However, there is a problem that it is difficult to grasp what reasoning process the system or apparatus performs diagnosis and to evaluate the appropriateness of the processing.

  In this way, although it is expected to reduce the burden on specialists such as doctors by using various data such as diagnostics and numerical data, diagnostics using computers at the present stage Various data include points that should be considered in terms of reliability and validity.

  In diagnosis by an expert such as a doctor, or automatic diagnosis, the diagnosis part is pointed out based on various data such as image data such as tomographic images and numerical data, and a comment comment is expressed. When referring to the indication of the diagnosis part and the comment of the observation, if the display part on the image that is the basis for expressing the diagnosis part or the comment of the indication indicated can be referred, It will be easier to understand the contents of the comments and findings and the intention of the diagnosis.

  For example, if the accumulation of a high SUV value in the liver is pointed out in the indication of the diagnosis part or the observation comment, if the accumulation position can be displayed on the image, the accumulation position will be the center side of the liver. If it is possible to simultaneously grasp the spatial information such as whether or not it is near the boundary of the right kidney, it becomes easy to understand the intention of the diagnosis part and the intention of the comment comment more accurately.

  Therefore, when referring to a diagnosis part or finding comment sentence pointed out by an expert such as a doctor or automatic diagnosis, the position of the organ or accumulation that is the basis for creating the indication of the diagnosis part or finding comment sentence If the relationship can be visually and intuitively confirmed on the display screen as spatial information, it is expected that the intention of the existing diagnosis can be understood quickly and accurately.

  In addition, when a position is designated on the display screen, it is expected that the existing diagnosis result can be quickly understood if the observation comment sentence given to the designated position can be easily referred to.

  Therefore, the present invention solves the above-mentioned conventional problems, displays an image such as a tomographic image, and refers to an existing diagnosis part or finding comment sentence already obtained on the diagnosis part or display screen. It is an object of the present invention to make it easy to refer to an observation comment sentence given to a diagnostic part or a part at a designated position from a designated position and to refer to a diagnostic part on a display screen from the observation comment.

  It is another object of the present invention to facilitate a quick understanding of existing diagnosis results by facilitating cross-reference between diagnosis parts and designated positions and observation comments.

  In the present invention, when various types of data including image data such as tomographic images are displayed on the display unit, data related to each other in the diagnosis can be extracted from one another and displayed between them, thereby allowing the data to be displayed. It is easy to confirm the relevance of.

  The medical image display device of the present invention is a medical image display device that displays a three-dimensional medical image, and includes a storage unit, a display unit, and a display control unit.

  The storage unit of the present invention stores original data of medical images obtained by a diagnostic device, organ data obtained by identifying an organ from image data by image processing, and analysis data obtained from the original image data To do.

  The display unit of the present invention displays original image data, organ data, and analysis data.

  The display control unit of the present invention selectively displays the original image data, organ data, and analysis data stored in the storage unit on the display unit.

  The organ data stored in the storage unit of the present invention includes three-dimensional image data and character data related to the organ region. The analysis data stored in the storage unit of the present invention includes three-dimensional image data related to the analysis region in the organ and character data of the diagnosis result of the analysis region. The organ data and analysis data form a tree-like data structure with the organ data as the upper node and the analysis data as the lower node.

  The display control unit mutually extracts one from the other between the three-dimensional image data of the organ or analysis region and the character data of the diagnosis result of the organ or analysis region so that the display can be freely performed. The display control unit extracts the three-dimensional image data corresponding to the character designated on the display unit from the storage unit and displays it on the display unit. The display control unit extracts character data corresponding to the three-dimensional image designated on the display unit from the storage unit and displays the character data on the display unit.

  With this configuration, it is possible to read and display the other by designating one of the three-dimensional image data of the organ or analysis region and the character data of the diagnosis result, displaying an image such as a tomographic image, When referring to existing diagnostic parts and observation comments that have already been obtained, refer to the observation comment text given to the diagnostic part or specified part from the specified part on the diagnostic part or display screen. In addition, it is possible to easily refer to the diagnosis part on the display screen from the observation comments, and to facilitate the cross-reference between the diagnosis part and the specified position and the observation comments, so that the existing diagnosis result can be understood quickly. Can assist.

  In the medical image display apparatus of the present invention, data obtained by identifying an organ by performing image processing on the CT image data of the original image data is used as organ data, and FDG (fluorodeoxyglucose) of the PET image data of the original image data is used. ) Can be used as position data and shape data of an integrated region obtained by image processing.

  The integrated region included in the analysis data of the present invention has an island integrated region in which FDG is integrated and an integrated group region including a plurality of island integrated regions, where the integrated group region is an upper node and the island integrated region is a lower node. Configure the data structure.

  The display control unit extracts three-dimensional image data of the accumulated group area corresponding to the character designated on the display unit from the storage unit and displays the data on the display unit. Further, character data corresponding to the three-dimensional image of the integrated group area designated on the display unit is extracted from the storage unit and displayed on the display unit.

  The display control unit also extracts the three-dimensional image data of the island accumulation region corresponding to the character specified on the display unit from the storage unit and displays the island accumulation region on the display unit in the same manner as the accumulation group region. The character data corresponding to the three-dimensional image of the island accumulation area designated on the display unit is extracted from the storage unit and displayed on the display unit.

  The display control unit of the present invention reads the original image data and the three-dimensional image data included in the organ data and analysis data from the storage unit, and displays one image of the original image, the organ region image, and the analysis region image In addition, by displaying at least two images superimposed on the display unit, the position of the diagnostic site in the organ can be grasped.

  The analysis data includes determination value data obtained by digitizing the diagnosis determination result, and the display control unit extracts and displays the three-dimensional image data of the diagnosis region based on the determination value data. In addition, the diagnosis result is displayed in stages by the numerical value of the diagnosis determination result, and the three-dimensional image data of the diagnosis part corresponding to the step display is extracted and displayed. It can be used as a basis for evaluating reliability and validity.

  The medical image display apparatus of the present invention has a three-dimensional image data structure that facilitates handling of an organ having a three-dimensional shape and an analysis region. The three-dimensional image data structure includes a three-dimensional area composed of a plurality of blocks that store bit data. The three-dimensional area is defined by a single point of coordinate data that defines a reference position of the three-dimensional area and the size of the three-dimensional area. It is defined by a three-dimensional region size that defines the thickness.

  According to this three-dimensional image data structure, the position in the three dimensions can be specified by the coordinate data, the size of the three-dimensional area is determined by the three-dimensional area size, and the shape is approximated by a rectangular parallelepiped. It can be easily identified.

  The organ data includes a three-dimensional area composed of a plurality of blocks that store bit data. The three-dimensional area is defined by one point of coordinate data that defines the reference position of the three-dimensional area and a three-dimensional area size that determines the size of the three-dimensional area, and bit data is assigned to each block of the three-dimensional area. Thus, three-dimensional image data representing the shape of the organ is constructed. With the configuration of the three-dimensional image data, the three-dimensional shape of the organ can be easily expressed.

  On the other hand, the analysis data includes a three-dimensional area composed of a plurality of blocks that store bit data. The three-dimensional area is defined by one point of coordinate data that defines the reference position of the three-dimensional area and a three-dimensional area size that determines the size of the three-dimensional area, and bit data is assigned to each block of the three-dimensional area. Thus, three-dimensional image data representing the shape of the analysis data area is constructed. With the configuration of the three-dimensional image data, the three-dimensional shape of the diagnostic part can be easily expressed.

  In addition, the medical image display device of the present invention includes an area setting unit that sets an area including the designated position with respect to the designated position designated on the display unit. The display control unit reads at least one of image data, organ data, and analysis data included in the region set by the region setting unit from the storage unit, and displays the data on the display unit.

  The area setting unit sets an area using position data for determining the position of the area and size data for determining the size of the area as input data. The display control unit reads image data from the storage unit following the position data and size data, and sequentially displays the read image data on the display unit.

  According to this area setting unit, if there is data related to the vicinity of an arbitrary position on the display unit, it can be extracted and displayed. This neighborhood can be specified by area, the position of the area can be specified by position data, and the size of the area can be specified by size data. By changing the position data, the position where the related data is extracted can be changed, and by changing the size data, the range where the related data is extracted can be changed.

  As described above, according to the present invention, when displaying an image such as a tomographic image and referring to an already obtained existing diagnosis part or finding comment text, the position specified on the diagnosis part or the display screen Therefore, the comment comment given to the diagnosis part or the part at the designated position can be easily referred to. In addition, the diagnosis part can be easily referred to on the display screen from the observation comment.

  Further, according to the present invention, it is possible to facilitate quick understanding of the existing diagnosis result by facilitating cross-reference between the diagnosis site and the designated position and the observation comment.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

  FIG. 1 is a diagram for explaining the outline of a medical image display apparatus of the present invention. In FIG. 1, the medical image display device 1 includes a display unit 2, a display control unit 3, an input unit 4, and a storage unit 5.

  The display unit 2 displays original image data, organ data, and analysis data related to a medical image.

  The display control unit 3 selectively displays the original image data, organ data, and analysis data stored in the storage unit 5 on the display unit 2.

  The input unit 4 selects an image target for specifying a person to be displayed to be displayed on the display unit 2, selects original image data to be stored in the storage unit 5 for the selected image target, and a position on the image displayed on the display unit 2. In addition to inputting character data associated with creation of various documents such as designation of diagnosis and diagnostic reports, it is used for input operations performed when operating the medical image display device 1. Any input device can be applied to the input means included in the input unit 4. For example, as means for specifying a position on the display screen with a cursor or the like, hardware such as a cursor or a touch panel, and the position of the input position Various operations on an input device having software for processing data, hardware such as a keyboard for inputting character data, an input device having software for processing input character data, and the medical image display device 1 There are input devices including hardware such as buttons and a touch panel for selecting and inputting, and software for processing input operation data. Note that these input means are merely examples, and the present invention is not limited to these.

  The storage unit 5 stores original image data of medical images obtained by a diagnostic device, organ data obtained by identifying an organ from image data by image processing, and analysis data obtained from original image data by automatic diagnosis processing. Remember.

  The storage unit 5 constitutes a database and stores, for example, medical chart and X-ray image data, PET image data, CT image data, MRI image data, etc. in medical fields and other fields as original image data of medical images. . Further, the storage unit 5 can obtain organ data relating to the shape and distribution state of the organ identified by performing image processing on each of the above-described image data, and obtain these image data as a result of diagnosis by automatic diagnosis processing or diagnosis by a specialist. Analysis data relating to the shape and state of the diagnostic region is stored. The organ data and analysis data store character data and the like regarding diagnosis results.

  The organ data and the analysis data constitute a tree-like data structure in which the three-dimensional image data and character data such as a comment of a diagnosis result relating to this part are composed of the organ data as an upper node and the analysis data as a lower node. Furthermore, the analysis data of the present invention includes an island accumulation region where FDG is accumulated and an accumulation group region including a plurality of island accumulations, and is tree-like data in which the accumulation group region is an upper node and the island accumulation region is a lower node. Configure the structure.

  The database of the storage unit 5 stores the character data of the observation comments of the diagnosis results in each organ data and each analysis data, and also classifies the observation comments of the diagnosis results, and stores a template sentence of the diagnosis comments of the diagnosis results. You can also keep it.

  According to the configuration for storing the template sentence of the comment of the findings of the diagnosis result, the storage unit 5 uses the diagnosis part address assigned to identify the template for the diagnosis result, thereby obtaining the template of the diagnosis result. By storing the data so as to be readable from the database and incorporating data unique to each diagnosis into the read-out diagnosis result template, the diagnosis result can be displayed on the display unit. In addition, for each diagnosis target person, it is not necessary to store character data of diagnosis results, and the storage capacity required for each diagnosis target person can be reduced.

  Here, the organ data can be obtained, for example, by identifying the organ by performing image processing on the CT image data of the original image data. The analysis data can be obtained by automatic diagnosis processing or diagnosis by an expert using the SUV value obtained based on the FDG (fluorodeoxyglucose) accumulation state of the PET image data of the original image data.

  The analysis data includes three-dimensional image data of the analysis part and character data of a finding comment based on the analysis result of the analysis part.

  The organ data and analysis data can be specified by a unique reference ID (Ref-ID), and the relevance can be specified by making the data structure a tree structure.

  The display control unit 3 extracts, from the storage unit 5, three-dimensional image data corresponding to the character specified in the observation comment displayed on the display unit 2 in the organ data or analysis data specified by the same reference ID. Then, the character data of the observation comment corresponding to the three-dimensional image designated on the display unit 2 is extracted from the storage unit 5 and displayed on the display unit 2.

  FIG. 2 is a flowchart for explaining an operation procedure of the medical image display apparatus 1 of the present invention.

  The medical image display device 1 displays an initial screen on the display unit 2. In the initial screen, bibliographic items about the diagnosis target specified by the input unit 4, medical record and X-ray image data, PET image data, CT image data, MRI image data, and findings of diagnosis results obtained by automatic diagnosis Display comments etc. Which of these data is to be displayed can be set in advance (S1).

  The user refers to the image displayed on the display unit 2 and the text of the diagnostic comment of the diagnosis result, and the character in the text of the diagnostic comment of the diagnostic result described in the part of the image, Specify the part.

  On the display screen of the display unit 2, the text of the observation comment of the diagnosis result obtained by automatic diagnosis or the like is displayed. The diagnosis result is not limited to the diagnosis result obtained by the automatic diagnosis, but can be the diagnosis result obtained by the diagnosis by the specialist or the diagnosis result obtained by adding the consideration of the specialist to the diagnosis result obtained by the automatic diagnosis. .

  The text of the comment on the findings of the diagnosis result can be formed by combining, for example, a template of the text of the typed diagnosis result and characters and numerical values unique to the diagnosis, and the entire sentence or a specific in the sentence It may be formed by associating the part image data of the corresponding part with the character (S2).

  When the entire observation comment of the diagnosis result displayed on the display screen or the character in the sentence is designated by the input unit 4 (S3), the display control unit 3 uses the same reference ID (Ref-ID) as an index to the storage unit 5 The image data associated with the entire observation comment of the diagnosis result designated from the above or the character in the text is read (S4), and the read image data is displayed on the display screen of the display unit 2. In this display, for example, by displaying the organ and the accumulation site on the original image, the positional relationship between the organ and the accumulation site can be confirmed, and the accumulation site is displayed on the image representing the organ. Thus, the positional relationship between the organ and the accumulation site can be confirmed (S5).

  When a specific part is designated on the image displayed on the display screen (an image for displaying an organ or an image for displaying an accumulation part) by the input unit 4 (S6, 7), the display control unit 3 is designated. Using the reference ID assigned to the image data as an index, the character data of the observation comment of the diagnosis result associated with the site designated from the storage unit 5 is read (S8), and the diagnosis result based on the read character data is read. The observation comment is displayed on the display screen of the display unit 2. Also in this display, for example, the positional relationship with the organ can be confirmed by displaying the image in a superimposed manner on the image representing the organ (S9).

  Next, acquisition of image data and analysis data used in the medical image display apparatus 1 of the present invention will be described with reference to FIGS.

  Hereinafter, an example in which medical diagnosis is performed using a tomographic image such as a CT image, an MRI image, or a PET image as a diagnosis target image will be described. Note that this medical diagnosis is not limited to the medical field, and can be applied to any field as long as it is a field that performs a diagnostic operation having a series of operations for performing an estimation operation based on a predetermined determination method and determination criteria.

  In a diagnosis using a tomographic image such as a PET image, a large number of (for example, 300) tomographic images are obtained for the whole body, and these tomographic images are visually read by a doctor or other specialist to determine whether there is an abnormality. Make a diagnosis.

  When diagnosing a tomographic image of the whole body, for example, each part is interpreted in order from the lower side to the upper side. In each part, diagnosis is performed by making a judgment on diagnostic elements characteristic of the part.

  After acquiring image data of tomographic images such as CT images, MRI images, and PET images (FIG. 3A), each organ is recognized by image data processing, etc. Image data processing is, for example, binary for image data. Comparison processing with a threshold value such as conversion processing, edge detection processing, averaging processing, maximum value / minimum value detection processing, etc. Organ recognition is performed by, for example, an image obtained from a CT image. This can be done using the data (FIG. 3 (b)).

  Next, for each organ, a diagnostic site is extracted by recognizing FDG accumulation. In cancer diagnosis using whole body FDG-PET (FDG-Positron Emission Tomography) images, radioactive fluorine (f-18) is labeled and a radioactive drug similar to glucose called FDG (fluorodeoxyglucose) is used. The FDG-PET image is obtained by putting it into the body and photographing the distribution in the body. The degree of accumulation of FDG is represented by a value called SUV, and the part where there is a cancer shows a high SUV value.

  Therefore, the degree of FDG accumulation is recognized based on the SUV value (FIG. 3C), and automatic diagnosis is performed using the SUV value (FIG. 4).

  Automatic diagnosis using the SUV value or the like can be performed as follows.

  Diagnosis using a tomographic image of the whole body is performed from the lower side to the upper side of the body. For example, it recognizes the thigh from the body based on the tomographic image, recognizes the accumulation of the drug that serves as a diagnostic index for the recognized thigh, and based on the data such as the accumulation of the reagent up to the thigh The abnormality is determined, the body is recognized from the body, each organ (for example, bladder, kidney,...) Provided in the body is recognized, the accumulation of the index in the recognized organ is recognized, and the determination is made from the accumulated amount. Do.

  For example, in a process corresponding to a unit for recognizing a thigh region, a thigh region image is generated, and an FDG (fluorodeoxyglucose) that serves as a diagnosis index of a region up to the thigh in the accumulated region image. ) And the like are accumulated, and an abnormality up to the thigh is determined based on various determination data.

  If no abnormality is recognized in this determination, a region image of the torso is generated as processing corresponding to the unit that recognizes the region of the torso, and a region image of the bladder is processed as processing corresponding to the unit that recognizes the region of the bladder. Generating and calculating the bladder volume as a process corresponding to the unit for diagnosing the bladder region, calculating the maximum SUV value in the bladder, generating a region image of accumulation up to the bladder, calculating the maximum SUV value, An abnormality up to the bladder is determined based on the determination data.

  If no abnormality is found in this determination, the same processing is performed for the kidney region, and then the brain region is processed corresponding to the unit that recognizes each organ from the tomographic image, and the accumulation as an index for the recognized organ The process corresponding to the unit that recognizes the process, the process corresponding to the unit that calculates the recognized accumulation value, and the process corresponding to the unit that performs the determination based on the accumulation and other detection data are performed.

  In the process corresponding to each determination unit, whether or not there is a possibility of abnormality is determined in each part, and if it is not determined as abnormal in the abnormality determination of the part up to the last brain, it is normally distributed.

  As a result, the tomographic images can be classified into those that require expert diagnosis and those that do not require expert diagnosis, and the expert does not perform diagnosis on tomographic images that do not require diagnosis. By diagnosing only the tomographic images that require the above, the burden can be reduced, and sufficient time can be taken for the diagnosis of each tomographic image.

  In the processing corresponding to each unit described above, in the image generation processing, the generated new image is added to the original tomographic image as additional information. Further, in the volume and SUV value calculation processing, the calculated value is further added as additional information to the original tomographic image and additional information obtained during the processing.

  For example, in lung diagnosis, a unit that recognizes the torso, a unit that recognizes the lung in the recognized torso, and an accumulation of drugs such as FDG (fluorodeoxyglucose) that serve as a diagnostic index in the recognized lung And a unit for determining an abnormality up to the lung.

  Corresponding to each unit, the process of recognizing the torso using patient information and tomographic images as input data, and the process of recognizing the lung using the image information of the torso obtained by the torso recognition process as additional information Using the right and left lung image information obtained in the lung recognition processing as additional information, the processing for recognizing accumulation in the lung is performed, and the accumulated information obtained in the accumulation recognition processing is used as additional information to the lung. Judgment processing is performed to determine the abnormality.

  In the processing in the lung region, the lung region recognition processing acquires a right lung region image and a left lung region image by using a tomographic image and a trunk region image as input data. In addition to the tomographic image and the torso region image, the lung region accumulation recognition process uses the right lung region image and the left lung region image obtained by the previous lung region recognition processing as input data. The left lung volume, maximum SUV value, and average SUV value are calculated and acquired.

  Further, the abnormal accumulation determination process in the lung region is performed by using the output data of the preprocessing as input data, the abnormal accumulation region image, the ID of the integrated region (integrated 1), the volume of the integrated region, the maximum USV value, and the average USV value In addition to obtaining and obtaining information about the organ in which the left lung internal guns 1 is obtained.

  Also in the organs of other organs, processing for calculating images and detection values necessary for diagnosis of the organs is performed, and abnormality determination is performed based on the acquired images and detection values.

  Next, organ data and analysis data provided in the present invention will be described with reference to FIGS.

  The present invention includes organ data and analysis data, and has a tree-like data structure in which the organ data is an upper node and the analysis data is a lower node. Further, the analysis data includes an accumulation group including an island accumulation and a plurality of island accumulations, and has a tree-like data structure in which the accumulation group is an upper node and the island accumulation is a lower node.

  The island accumulation is a minimum unit of a site where abnormality is required, and the accumulation group is a set of island accumulations existing in the same organ. For example, a plurality of related island accumulations are collectively set as an accumulation group. In addition, this accumulation group can be set not only in one but in multiple in one organ.

  FIG. 5 is a schematic structural diagram for explaining a tree structure of organ data and integrated data. Here, the organ data of the organ A includes three accumulation groups a, b, c and a single island accumulation 9, the accumulation group a has three island accumulations 1, 2, 3, and the accumulation group b is There are four island accumulations 3, 4, 5, and 6, and the accumulation group c has two island accumulations 7 and 8. Similarly, the organ data of the organ B includes two accumulation groups d and e and a single island accumulation 15, and the accumulation group d has three island accumulations 10, 11, and 12, and the accumulation group e has three accumulation groups. It has island accumulations 12, 13, and 14. Note that the island accumulation 3 is included in both the accumulation group a and the accumulation group b, and the island accumulation 12 is included in both the accumulation group d and the accumulation group e.

  FIG. 6 shows data examples of organ data, accumulation group data, and island accumulation data.

  FIG. 6A shows an example of organ data obtained by the above-described processing for authenticating an organ. In this organ data example, the name of the organ, the reference ID (Ref-ID) for identifying the organ data, the organ ID for identifying the organ type, the display name for display on the display screen, and the organ on the display screen Image data for display (hereinafter, this image data is referred to as mask data), findings including comments on diagnosis results attached to this organ and data including other data (hereinafter, these data are referred to as annotation data) Prepare.

  The mask data is the coordinate data for specifying the position where the organ exists in the image data, the area size data indicating the size of the area occupied by the organ, and whether the organ actually exists in the area occupied by the organ. It is provided with area data indicating whether or not.

  The annotation data is obtained by determination based on the SUVmax intensity data of the maximum value of the SUV value in the organ, the SUV average intensity data of the average value of the SUV value in the organ, the volume of the organ, the SUV value, and other determination conditions. A determination value (risk value) representing the degree of risk of the site diagnosed based on the evaluation value SUV value obtained by quantifying the determination result, an SUV distribution pattern representing the distribution state of the SUV value in the organ, and created for the organ Provided with diagnostic report data describing comments on the findings of diagnostic results.

  FIG. 7A shows an example of organ mask data. In FIG. 7A, organ mask data includes the above-described coordinate data and region size data in order to represent the three-dimensional position of the organ. The coordinate data P [xp, yp, zp] represents the reference position of the organ region. The region size data X = Sx, Y = Sy, and Z = Sz indicate the size when the outermost shell region where the organ exists in the image data is represented by a quadrangular prism. Therefore, the organ exists in a quadrangular prism region determined by the coordinate data and the region size data.

  In an organ whose outermost shell shape is represented by a quadrangular prism, the actual organ shape is divided into a plurality of blocks, and region data for determining whether or not an organ exists in the divided blocks is given. Can be represented by For example, when “1” is assigned to a block where an organ exists and “0” is assigned to a block where an organ does not exist, the three-dimensional position of the organ is represented by a collection of blocks assigned “1”. Can do.

  FIG. 6B shows an example of the accumulation group data of the analysis data obtained by the abnormal accumulation determination process in the organ region described above. Similar to the organ data described above, this integrated group data includes a reference ID (Ref-ID) for specifying the integrated group data, a display name for displaying the integrated group on the display screen, and this integrated group on the display screen. Image data for display (hereinafter, this image data is referred to as mask data), data including observation comments and other data of diagnosis results attached to this integrated group (hereinafter, these data are referred to as annotation data) Is provided.

  The mask data includes coordinate data for specifying the position where the integrated group exists in the image data, area size data indicating the size of the area occupied by the integrated group, and the integrated group in the area occupied by the integrated group. Region data indicating whether or not exists.

  The annotation data is determined based on the SUVmax intensity data of the maximum value of the SUV value in the accumulation group, the SUV average intensity data of the average value of the SUV value in the accumulation group, the volume of the accumulation group, the SUV value, and other determination conditions. The determination value (risk value) representing the degree of risk of the site diagnosed based on the evaluation value SUV value obtained by quantifying the obtained determination result, the SUV distribution pattern representing the distribution state of the SUV value in the accumulation group, and the accumulation group Diagnostic report data describing the findings comments of the diagnostic results created for the data is provided.

  FIG. 6C shows an example of the accumulation group related data related to the island accumulation included in the accumulation group. In this accumulation group related data, with respect to a reference ID (Ref-ID) that identifies the accumulation group data, the number of island accumulations included in the accumulation group, and a reference ID (Ref-ID) that identifies the included island accumulation Etc. are registered.

  By referring to this accumulation group-related data, in addition to searching for accumulation groups based on the number of island accumulations, such as “an accumulation group having three or more island accumulations”, an accumulation group including a specific island accumulation is searched. Can do.

  FIG. 6D shows an example of island accumulation data of analysis data obtained by the abnormal accumulation determination process in the organ region described above. This island accumulation data is similar to the organ data described above, the reference ID (Ref-ID) for specifying the island accumulation data, the display name for displaying the island accumulation on the display screen, and the island accumulation on the display screen. Image data for display (hereinafter, this image data is referred to as mask data), data including observation comments and other data of diagnosis results attached to this island accumulation (hereinafter, these data are referred to as annotation data) Is provided.

  The mask data includes coordinate data for specifying the position where the island accumulation exists in the image data, area size data indicating the size of the area occupied by the island accumulation, and the island accumulation actually in the area occupied by the island accumulation. Region data indicating whether or not exists.

  The annotation data is determined based on the SUVmax intensity data of the maximum SUV value during the island accumulation, the SUV average intensity data of the average value of the SUV values during the island accumulation, the volume of the island accumulation, the SUV value and other determination conditions. The determination value (risk value) representing the degree of risk of the site diagnosed based on the evaluation value SUV value obtained by quantifying the obtained determination result, the SUV distribution pattern representing the distribution state of the SUV value in the island accumulation, and the island accumulation Diagnostic report data describing the findings comments of the diagnostic results created for the data is provided.

  FIG. 6E is an example of diagnosis report data, in which character data of a comment of a diagnosis result is stored. For example, the character data “localized strong accumulation is recognized inside the lung. SUVmax [SUVmax intensity data] and high value, and *** is strongly suspected.” Is stored in the storage unit.

  The [SUVmax intensity data] and “***” part of the diagnosis report can be incorporated using data such as SUVmax intensity data and SUV distribution patterns in the annotation data of the analysis data.

  FIG. 7B is a diagram for explaining an accumulation group of accumulated data and an island accumulation region. Here, coordinate data and area size data are provided in the same manner as the organ area in order to represent a three-dimensional position of the accumulation group and island accumulation. The coordinate data Q [xq, yq, zq] represents the reference position of the accumulation group and the island accumulation region. The region size data X = Sx, Y = Sy, and Z = Sz indicate the size when the outermost shell region where the accumulation group and the island accumulation region exist in the image data is represented by a square pole. Therefore, the accumulation group and the island accumulation area exist in a quadrangular prism area determined by the coordinate data and the area size data. The general shape of the accumulation group and the island accumulation region can be specified by X = Sx, Y = Sy, Z = Sz.

  In the diagnostic part whose outermost shell shape is represented by a quadrangular prism, the actual diagnostic part shape is divided into a plurality of blocks, and the area data that determines whether or not there is a diagnostic part in the divided blocks Can be expressed by giving For example, when “1” is assigned to a block in which a diagnostic site exists and “0” is assigned to a block in which a diagnostic site does not exist, the three-dimensional position of the diagnostic site is determined by the collection of blocks to which “1” is assigned. Can be expressed.

  FIG. 8 shows the relationship between the diagnostic region and the diagnostic region. FIG. 8A shows an example of a diagnostic part, and FIG. 8B shows an example of a diagnostic part region. In FIG. 8B, “1” or “0” is assigned to each block constituting the diagnostic region. For example, the diagnosis region can be represented by a block to which “1” is added. “1” or “0” in each block corresponds to the area data in the mask data.

  Each block of the diagnostic region can be described in a form having a numerical value indicating the position of each block and the presence or absence of the diagnostic region in the block. For example, it can be represented by area data in mask data of [1, 1, 1, 1], [2, 1, 1, 1],. The third data (1, 1, 1) and (2, 1, 1) from the beginning of this area data represent the positions of the blocks in the x, y and z directions, and the fourth (1), (1 ) Represents the presence or absence of a diagnostic site in each block.

  In another notation form of each block of the diagnostic region, the order of designating the blocks in the X, Y, and Z directions is determined in advance for all the blocks of the diagnostic region, and according to this order, Only data on the presence / absence of a diagnostic site may be written. The above-described example is an example and is not limited to the above.

  Next, an example in which a quadrangular prism region determined by the coordinate data and the region size data described above, and an organ region or a diagnostic region that is defined by a plurality of blocks in the region is specified by a three-dimensional designated position. 9 will be used for explanation.

  In FIG. 9, for example, the diagnostic region can be defined by coordinate data Q [xq, yq, zq] and region size data [Sx, Sy, Sz]. Here, the region range of the region determined by the coordinate data Q [xq, yq, zq] and the region size data [Sx, Sy, Sz] is calculated, and R [xr, yr, zr] is within the calculated region range. When the designated position R is within the area, it is judged that the designated position R has designated the area. When the designated position R is outside the area, the designated position R is It is determined that the area is not designated and another area is designated.

  FIG. 10 is a diagram for explaining the relationship between organ data and accumulation data and the relationship between island accumulation and accumulation group in the accumulation data. The example shown in FIG. 10 is based on the tree structure shown in FIG.

  For example, the organ data specified by the reference ID of Ref-A is specified by the three collection groups specified by the reference IDs of Ref-a, Ref-b, and Ref-c, and the reference ID of Ref-9. Including a single island accumulation. In addition, the accumulation group of Ref-a includes three island accumulations identified by the reference IDs of Ref-1, Ref-2, and Ref-3, and the accumulation group of Ref-b includes Ref-3, Ref-4, Four island clusters specified by each reference ID of Ref-5 and Ref-6 are included, and a cluster group of Ref-c includes two island clusters specified by each reference ID of Ref-7 and Ref-8. .

  In addition, the organ data specified by the reference ID of Ref-B includes two accumulation groups specified by the reference IDs of Ref-d and Ref-e, and a single island specified by the reference ID of Ref-15. Includes agglomeration. In addition, the accumulation group of Ref-d includes three island accumulations identified by the reference IDs of Ref-10, Ref-11, and Ref-12, and the accumulation group of Ref-e is Ref-12, Ref-13, Includes three island clusters identified by each reference ID of Ref-14.

  Next, referring to FIG. 11, an image representing an organ (hereinafter referred to as an organ image), an image representing an island accumulation (referred to as an island accumulation image), and an image representing an accumulation group (referred to as an accumulation group image), and each portion The mutual display in which one is specified and the other is displayed between the comments of the diagnosis report set to “1” will be described.

  FIG. 11A shows a case where an observation comment in the diagnosis report is designated and a part corresponding to the designation is displayed, and FIG. 11B designates an observation comment in the diagnosis report and corresponds to this designation. The case where a part is displayed is shown.

  In FIG. 11A, when “... three accumulations ...” described in the observation comment in the diagnosis report identified by the reference ID Ref-d is designated, this “... three accumulations…” is supported. The accumulation group to be displayed is displayed on the display screen. The image data of the corresponding integrated group can be read out from the storage unit using the same reference ID (Ref-d) as an index.

  In addition, in FIG. 11A, when “... SUV maximum integration…” described in the observation comment in the diagnosis report identified by the reference ID Ref-15 is designated, this “… SUV maximum integration” is designated. The island accumulation corresponding to “...” is displayed on the display screen. The corresponding island accumulation image data can be read out from the storage means using the same reference ID (Ref-15) as an index.

  In FIG. 11B, when an accumulation group whose reference ID is specified by Ref-e is designated on the display screen, the observation comments in the diagnosis report corresponding to the accumulation group are displayed on the display screen.

  The corresponding finding comment character data can be read from the storage means using the same reference ID (Ref-e) as an index.

  Further, in FIG. 11B, when an island accumulation whose reference ID is specified by Ref-14 is designated on the display screen, the observation comments in the diagnosis report corresponding to this island accumulation are displayed on the display screen.

  This corresponding finding comment character data can be read from the storage means using the same reference ID (Ref-14) as an index.

  Hereinafter, an example of an operation function by the medical image display apparatus of the present invention will be described. The operation function example described below is a first operation function example that designates the position of an image displayed on the display screen and displays the text of the diagnostic report set in the portion corresponding to the position. A second operation function example that designates the text of the diagnostic report displayed on the screen and displays the position of the diagnostic part corresponding to the document on the display screen, designates a point on the display screen, and is in the vicinity of the designated position In a third operation function example for displaying related image data on the display screen, and a fourth operation function example for designating an SUV value, extracting image data related to the SUV value, and displaying the extracted image data on the display screen. is there.

  According to the first operation function example and the second operation function example, it is possible to alternately display an image having a relationship with each other on the display screen and a sentence of the diagnosis report, and a position is designated in the image. Thus, the corresponding sentence can be extracted and displayed, and the corresponding image can be extracted and displayed by designating the sentence or the sentence in the sentence.

  According to the first operation function, when an image displayed on the display screen is observed, it is possible to refer to a diagnosis report attached to a place that requires more detailed observation. In addition, it is possible to confirm the reason for determination of diagnosis.

  Further, according to the second operation function, it is possible to confirm the relationship between the determination location stored in the diagnosis report and the organ or the diagnosis site on the display screen.

  According to the third operation function, it is possible to observe a tomographic image in the vicinity of a site designated for an image on the display screen.

  According to the fourth operation function, it is possible to observe the distribution of SUV values in the vicinity of the site designated for the image on the display screen.

  Hereinafter, a first operation function example will be described with reference to FIGS. FIG. 12 is a diagram illustrating a configuration example for performing the first operation function example, FIG. 13 is a diagram illustrating a display example of the first operation function example, and FIG. 14 is a display control for performing the first operation function example. FIG. 15 is a flowchart for explaining the operation of the first operation function example.

  FIG. 12 shows an example of displaying, as organ data, a tomographic image in the vertical direction when the body is viewed from the front side and the side surface, and a tomographic image in the horizontal direction of the body. Is displayed. Note that the layout of images and sentences on the display screen can be arbitrarily set without being limited to the arrangement example of the figure.

  FIG. 12A shows an initial display state. The storage unit 5 stores, for each subject, bibliographic items, measurement image data such as medical record and X-ray image data, PET image data, CT image data, and MRI image data as original image data. The organ data and analysis data generated based on these original image data are stored. In the analysis report of analysis data, character data of a comment of a diagnosis result obtained by automatic diagnosis or diagnosis by an expert is stored. In addition, although the target person A-the target person C are shown as a target person in FIG. 12, it is only an example and is not restricted to this.

  When the target person A is specified from the input device 4, as an initial state, the display control unit 3 reads out the measurement image data and organ data image data related to the specified target person A from the storage unit 5 and displays the image on the display unit 2. In addition, the character data of the diagnostic report is read from the analysis data in the storage unit 5 and the text of the observation comment is displayed on the display unit 2.

  FIG. 12B shows a state in which a position is specified in an image displayed on the display screen, and a sentence in a diagnostic report related to the position is read from the storage unit 5 and displayed on the display screen.

  The image displayed on the display screen of the display unit 2 is referred to, and the position on the screen is designated by the input unit 4. The display control unit 3 extracts a part corresponding to the designated position, reads out the character data of the finding comment of the diagnostic report from the analysis data stored in the storage unit 5 using the reference ID for specifying the part, and displays it. It is displayed on the display screen of part 2.

  As a result, the image of the subject and the comment of the diagnosis report related to the site at the position specified in the image are displayed on the display screen, and the image and the text can be referred to simultaneously.

  FIG. 13 shows the designation of the designated position and the display of the observation comment of the diagnostic report corresponding to the designated position. FIG. 13A shows an example in which a position is designated on an image showing a cross section in the lateral direction of the lung, and an observation comment of a diagnosis report related to a part at this position is displayed. FIG. 13B shows an example in which a position is designated on an image showing a longitudinal section of the lung, and an observation comment of a diagnostic report related to a part at this position is displayed. In FIG. 13, the designated position is indicated by “+”.

  Next, a configuration example and an operation example of the display control unit will be described with reference to FIGS. FIG. 14 is a diagram for explaining a configuration example of the display control unit, and FIG. 15 is a flowchart for explaining an operation example of the display control unit.

  In the configuration diagram shown in FIG. 14, the display control unit 3 includes a part determination unit 3 c that specifies the presence / absence of a part corresponding to the designated position input by the input unit 4 and a part, and a region where the part exists to specify the part. An area generating unit 3d for generating area data, a processing memory 3e for temporarily storing the generated area data, a reading unit 3b for reading image data of an image displayed on the display unit 2 and character data of a diagnostic report, and reading Display signal generating means 3a for generating a display signal for displaying an image or a character on the display unit 2 using the image data or character data read by the means 3b is provided.

  In the flowchart of FIG. 15, in the initial state, the reading unit 3b reads the original image data of the designated person from the storage unit 5 (S11), generates an image signal using the acquired original image data, and displays the display unit 2 (S12).

  Further, the mask data is fetched from the organ data or the analysis data having the same reference ID as the reference ID (Ref-ID) attached to the original image data being displayed from the storage unit 5 to the region generating means 3d (S21), Using this coordinate data and region size data, region data for specifying the region of the organ or analysis site is generated and stored in the processing memory 3e together with the reference ID (S22).

  The image displayed on the display screen of the display unit 2 is referred to, and the position on the screen is designated by the input unit 4 (S23). The part determination means 3e acquires the position data of the designated position (S24), and specifies the part by comparing with the area data generated by the area generation means 3d and stored in the processing memory 3e (S25). The reading means 3b inputs the reference ID from the processing memory 3e, and reads the character data of the finding comment of the corresponding diagnosis report from the storage unit 5 using this reference ID (S26). The display signal generating means 3a generates a display signal to be displayed on the display unit 2 using the character data of the observation comment of the diagnostic report read from the storage unit 5 (S27), and the diagnostic comment of the diagnostic report is displayed on the display unit 2. Is displayed (S28).

  Hereinafter, a second operation function example will be described with reference to FIGS. FIG. 16 is a diagram illustrating a configuration example for performing the second operation function example, FIG. 17 is a diagram illustrating a display example of the second operation function example, and FIG. 18 is a display control for performing the second operation function example. FIG. 19 is a flowchart for explaining the operation of the second operation function example.

  FIG. 16 shows an example of displaying, as organ data, a tomographic image in the vertical direction when the body is viewed from the front side and the side surface, and a tomographic image in the horizontal direction of the body. Is displayed. Note that the layout of images and sentences on the display screen can be arbitrarily set without being limited to the arrangement example of the figure.

  FIG. 16A shows an initial display state. The storage unit 5 stores, for each subject, bibliographic items, measurement image data such as medical record and X-ray image data, PET image data, CT image data, and MRI image data as original image data. In addition, organ data and analysis data generated based on these original image data are stored. The analysis data stores character data of a diagnosis report of an automatic diagnosis or a diagnosis result obtained by a specialist. In addition, although the subject person A-the subject person C are shown as a subject in FIG. 16, it is only an example and is not restricted to this.

  When the target person A is designated from the input device 4, the display control unit 3 reads the measurement image data and the original image data of the organ data related to the designated subject A from the storage unit 5 and displays the image on the display unit 2. The character data of the observation comment of the diagnostic report is read from the analysis data in the storage unit 5 and the text of the diagnostic report is displayed on the display unit 2.

  FIG. 16B shows the text of the observation comment in the diagnostic report displayed on the display screen, or the character in the text, and reads out the image data of the part corresponding to this text or character on the display screen. Indicates the state to be displayed.

  The comment of the diagnosis report displayed on the display screen of the display unit 2 is referred to, and the sentence of the comment of the diagnosis report or the characters in the sentence is designated by the input unit 4. The display control unit 3 extracts a part corresponding to the designated sentence or character, reads out the image data of the corresponding part from the analysis data stored in the storage unit 5 using the part address specifying the part, and displays it. It is displayed on the display screen of part 2.

  As a result, an image of the subject and a diagnostic report related to the site at the position specified in the image are displayed on the display screen, and the image and the text can be referred to at the same time.

  FIG. 17 shows designation of a designated position and display of a comment comment of a diagnostic report corresponding to the designated position. FIG. 17A displays an image of the lung and a diagnosis report related to the lung. FIG. 17B shows an example in which a character portion of “localized strong accumulation” described in the observation comment of the diagnosis report is designated and a portion related to the character portion is displayed on the image. In FIG. 17, the designated position is indicated by “+”.

  Note that FIG. 17B shows an example in which characters that can be specified in the observation comments of the diagnostic report are set in advance and are displayed so as to be distinguishable from the character portions that cannot be specified. There is no limit.

  Next, a configuration example and an operation example of the display control unit will be described with reference to FIGS. 18 is a diagram for explaining a configuration example of the display control unit, and FIG. 19 is a flowchart for explaining an operation example of the display control unit.

  In the configuration diagram shown in FIG. 18, the display control unit 3 uses a reading unit 3 b that reads image data of an image displayed on the display unit 2 and character data of a diagnostic report, and uses the image data and character data read by the reading unit 3 b. The display unit 2 includes a display signal generation unit 3 a that generates a display signal for displaying an image or a character on the display unit 2.

  In the flowchart of FIG. 19, in the initial state, the reading unit 3 b reads image data such as the original image data and organ data of the designated person from the storage unit 5, and generates an image signal using the acquired image data. Displayed on the display unit 2.

  Further, the reading unit 3b acquires annotation data in the organ data or analysis data for the designated person from the storage unit 5 (S31), reads out character data of the diagnostic report from the acquired annotation data, and acquires the acquired character data. Is used to generate a display signal and display it on the display unit 2 (S32).

  The image displayed on the display screen of the display unit 2 and the diagnostic report are referred to, and the text of the diagnostic report or characters in the text are designated by the input unit 4 (S33). The reading means 3b uses the reference ID (Ref-ID) for specifying the diagnostic report in which the designated sentence or character is described (S34), and acquires the mask data corresponding to this reference ID (S35).

  The reading unit 3b reads the image data of the part from the acquired mask data from the storage unit 5, and the display signal generating unit 3a generates an image signal from the read image data (S36), and the image of the part is displayed on the display unit 2. Display (S37).

  Hereinafter, a third operation function example will be described with reference to FIGS. 20 is a diagram illustrating a configuration example for performing the third operation function example, FIG. 21 is a diagram illustrating a display example of the third operation function example, and FIG. 22 is a display control for performing the third operation function example. FIG. 23 is a flowchart for explaining the operation of the third operation function example, and FIG. 24 is a diagram for explaining the relationship between the designated position and the neighborhood region.

  FIG. 20 shows an example of displaying a tomographic image in the vertical direction when the body is viewed from the front side and the side surface as the organ data, and a tomographic image in the horizontal direction of the body. Is displayed. Note that the layout of images and sentences on the display screen can be arbitrarily set without being limited to the arrangement example of the figure.

  FIG. 20A shows an initial display state. The storage unit 5 stores, for each subject, bibliographic items, measurement image data such as medical record and X-ray image data, PET image data, CT image data, and MRI image data as original image data. In addition, organ data and analysis data generated based on these original image data are stored. In the analysis data, text data of sentences is stored as diagnosis comments of diagnosis reports based on diagnosis results obtained by automatic diagnosis or diagnosis by experts. In addition, although the target person A-the target person C are shown as a target person in FIG. 20, it is only an example and is not restricted to this.

  When the target person A is specified from the input device 4, the display control unit 3 reads out the original image data of the measurement image data, the organ data, or the image data of the analysis data related to the specified target person A from the storage unit 5 and displays it on the display unit 2. In addition to displaying an image, the character data of the diagnostic report is read from the annotation data of the organ data or analysis data, and the text of the diagnostic report is displayed on the display unit 2.

  FIG. 20B shows a state in which a position is designated in an image displayed on the display screen, and an image in the vicinity of the designated position is read from the storage unit 5 and displayed on the display screen.

  With reference to the image displayed on the display screen of the display unit 2, the input unit 4 designates an area having a spread at a position where it is determined that observation is required in the image. The display control unit 3 reads the image data of the designated area from the storage unit 5 and displays it on the display screen of the display unit 2.

  Thereby, it is possible to easily refer to the image related to the observation region having the spread on the display screen.

  FIG. 21 shows the position designation on the displayed screen, the area designation in the vicinity of the designated position, and the display of the image in the designated neighborhood area. FIG. 21A shows the designated position R designated on the display screen, and FIG. 21B shows the vicinity area S of the area having a certain extent around the designated position R. The magnitude representing the extent of the vicinity region can be set from the input unit 2. FIG. 21C shows an image of the designated neighboring region S as a tomographic image T.

  In FIG. 21, the designated position is indicated by “+”. In addition, although the shape of the neighborhood region is shown as a quadrangular column, the shape representing the neighborhood region S is not limited to a square column and may be a sphere or the like, and can be selected and changed.

  Next, a configuration example and an operation example of the display control unit will be described with reference to FIGS. FIG. 22 is a diagram for explaining a configuration example of the display control unit, and FIG. 23 is a flowchart for explaining an operation example of the display control unit.

  In the configuration diagram shown in FIG. 22, the display controller 3 includes a neighborhood area setting unit 3g for setting the neighborhood area, and a memory 3f for storing default values of area data relating to the shape of the neighborhood area and the initial size. Reading means 3b for reading image data of an image displayed on the display unit 2 and character data of a diagnostic report, and a display for displaying images and characters on the display unit 2 using the image data and character data read by the reading unit 3b Display signal generating means 3a for generating a signal is provided.

  In the flowchart of FIG. 23, the image data is acquired from the storage unit 5 and displayed on the display unit 2 by the reading unit 3 b.

  After setting the image display mode for designating the vicinity area (S41), the position is designated on the display image (S42).

  The neighboring area setting unit 3g acquires the coordinates of the designated position (S43), reads the default value of the neighboring area from the memory 3f, and sets the neighboring area S (S44). The reading unit 3b reads out the image data included in the vicinity region S from the storage unit 5 (S45), and the display signal generating unit 3a generates an image signal from this image data and displays it on the display unit 2 (S46).

  When the designated position of the neighboring area S or the size or shape of the area is changed (S47), the position is reset from the input unit 4, or the size or shape is set (S48).

  On the display unit 2, an image of the designated neighboring area is displayed by a plurality of tomographic screens T. When a specific screen is designated from these tomographic screens (S49), the designated screen is displayed (S50).

  FIG. 24 shows an example of the neighborhood region S. FIG. 24A shows an example in which the neighboring region is represented by a quadrangular prism shape. In this case, for example, the center position O (xo, yo, zo) and the size [LX, LY, LZ] in the x, y, and z directions are set.

  The position of the neighboring region S is set by changing the center position O (xo, yo, zo), and the shape and size of the neighboring region S are set by changing the size [LX, LY, LZ].

  FIG. 24B shows an example in which the neighboring region is represented by a spherical shape. In this case, for example, the center position O (xo, yo, zo) and the radius r are set.

  The position of the neighboring region S is set by changing the center position O (xo, yo, zo), and the size of the neighboring region S is set by changing the radius r.

  Hereinafter, a fourth operation function example will be described with reference to FIGS. FIG. 25 is a diagram illustrating a configuration example for performing the fourth operation function example, FIG. 26 is a diagram illustrating a display example for the fourth operation function example, and FIG. 24 is a display control for performing the fourth operation function example. FIG. 28 is a flowchart for explaining the operation of the fourth operation function example.

  FIG. 25 shows an example of displaying a tomographic image in the vertical direction when the body is viewed from the front side and the side as the organ data, and a tomographic image in the horizontal direction of the body. Is displayed. Note that the layout of images and sentences on the display screen can be arbitrarily set without being limited to the arrangement example of the figure.

  FIG. 25A shows an initial display state. The storage unit 5 stores, for each subject, bibliographic items, measurement image data such as medical record and X-ray image data, PET image data, CT image data, and MRI image data as original image data. In addition, organ data and analysis data generated based on these original image data are stored. In the analysis data, character data of a sentence of a diagnosis report of a diagnosis result obtained by automatic diagnosis or diagnosis by a specialist is stored. In addition, although the target person A-the target person C are shown as an object in FIG. 25, it is only an example and is not restricted to this.

  When the target person A is specified from the input device 4, the display control unit 3 reads out the measurement image data, organ data, or analysis data image data related to the specified target person A from the storage unit 5 and displays the image on the display unit 2. In addition, the character data of the diagnostic report is read from the annotation data in the analysis data of the storage unit 5 and the text of the diagnostic report is displayed on the display unit 2.

  26B and 26C show a state in which a position is specified in an image displayed on the display screen, and the distribution of SUV values in the vicinity of the specified position is read from the storage unit 5 and displayed on the display screen. Show. FIG. 26B shows the distribution of SUV values in the whole body, and FIG. 26C shows the distribution of SUV values in a region near a specific part in the body.

  The SUV value or the range of SUV values is designated from the input unit 4, and the display control unit 3 reads out the designated SUV value or the distribution image of the range of SUV values from the storage unit 5 and displays it on the display screen of the display unit 2. The designation of the range of the SUV value can be performed by setting a numerical value range determined by, for example, a set value or more, an installation value or less, or an upper limit value and a lower limit value. Thereby, the distribution image of the SUV value can be referred to on the display screen.

  Further, it is also possible to display the distribution of determination levels in the same manner using determination levels representing diagnosis results. In this case, the determination level value or the range of the determination level value is specified from the input unit 4, and the display control unit 3 reads out the distribution image of the specified determination level value or the range of the determination level value from the storage unit 5 and displays it. It is displayed on the display screen of part 2. The specification of the determination level range can be performed by, for example, setting a range determined by a certain determination level value or more, a certain determination level value or less, or a range determined by an upper limit value and a lower limit value of the determination level value. Thereby, it is possible to refer to a distribution image of determination level values on the display screen.

  Also, the neighborhood area can be determined by specifying the position, the shape and range of the neighborhood area, using the setting method described in the third operation function.

  Next, a configuration example and an operation example of the display control unit will be described with reference to FIGS. FIG. 27 is a diagram for explaining a configuration example of the display control unit, and FIG. 28 is a flowchart for explaining an operation example of the display control unit.

  In the configuration diagram shown in FIG. 27, the display control unit 3 is similar to the third operation function example, the neighborhood region setting means 3g for setting the neighborhood region, and the region data relating to the shape of the neighborhood region and the initial size. The memory 3f for storing the default value of the image, the reading unit 3b for reading the image data of the image displayed on the display unit 2 and the character data of the diagnostic report, and the display unit 2 using the image data and the character data read by the reading unit 3b Display signal generating means 3a for generating a display signal for displaying images and characters.

  In the neighborhood area setting means 3g, in addition to setting the neighborhood area by designating the position and area, the readout means 3b uses the range or determination level of the SUV value input by the input section 4 to respond from the storage section 5. Extract the distribution area.

  In the flowchart of FIG. 28, the image data is acquired from the storage unit 5 by the reading unit 3 b and displayed on the display unit 2.

  After setting the distribution display mode of the SUV value and determination level value for specifying the neighboring region (S51), it is determined whether or not the SUV value or the numerical value or range of the determination level value is specified (S52).

  When the numerical value or range of the SUV value or judgment level value is designated, the designated SUV value or judgment level value or range is set (S53), and the numerical value or range of the SUV value or judgment level value is set. If not specified, the default value is read from the memory 3f, and the read SUV value or the value or range of the judgment level value is set (S54).

  The reading unit 3b reads the distribution data of the SUV value or the determination level value from the storage unit 5 based on the set numerical value or range of the SUV value or the determination level value, and generates the distribution image data by the display signal generation unit 3a. Then, distribution display is performed using the generated distribution image data (S56).

  In the extraction of distribution data, the whole body can be used as the search range, and the designated area can be used as the search range. As the region for defining the search range, the above-described neighboring region can be used. When the designated position of the neighboring area S or the size or shape of the area is changed (S57), the position is reset from the input unit 4 or the size or shape is set (S58).

  The display unit 2 displays the distribution image of the designated neighboring area on a plurality of tomographic screens. When a specific screen is designated from these tomographic screens (S59), the designated screen is displayed (S60).

  The technique using extraction and display of related data related to the medical image display device of the present invention is not limited to the medical field, but a field for performing a diagnostic operation having a series of operations for performing an estimation operation based on a predetermined determination method and determination criteria. Can be applied to.

  For example, non-destructive structural inspection using tomographic image data of structures, meteorological analysis for analyzing tomographic image data such as atmospheric pressure and temperature, fluid analysis for analyzing tomographic image data of three-dimensional fluid flow, etc. be able to.

It is a figure for demonstrating the outline of the medical image display apparatus of this invention. It is a flowchart for demonstrating the operation | movement procedure of the medical image display apparatus of this invention. It is a figure for demonstrating acquisition of the image data and analysis data which are used for the medical image display apparatus of this invention. It is a figure for demonstrating acquisition of the image data and analysis data which are used for the medical image display apparatus of this invention. FIG. 3 is a structural diagram schematically showing a tree structure of organ data and integrated data according to the present invention. It is a figure which shows each data example of the organ data of this invention, accumulation group data, and island accumulation data. It is a figure for demonstrating the example of the organ area | region and diagnostic region of this invention. It is a figure for demonstrating the example of the diagnostic region of this invention. It is a figure for demonstrating an example which specifies the organ area | region or diagnostic region | part area | region of this invention by the three-dimensional designation | designated position. It is a figure for demonstrating the relationship between the organ data and accumulation | storage data of this invention, and the relationship between the island accumulation | storage and accumulation group in accumulation data. It is a figure for demonstrating the mutual display between an image and a diagnostic report. It is a figure which shows the structural example which performs the 1st operation | movement function example of this invention. It is a figure which shows the example of a display of the 1st operation | movement function example of this invention. It is a figure which shows the structural example of the display control part which performs the 1st operation | movement function example of this invention. It is a flowchart for demonstrating operation | movement of the 1st operation | movement function example of this invention. It is a figure which shows the structural example which performs the 2nd operation function example of this invention. It is a figure which shows the example of a display of the 2nd operation function example of this invention. It is a figure which shows the structural example of the display control part which performs the 2nd example of an operation function of this invention. It is a flowchart for demonstrating operation | movement of the 2nd operation | movement function example of this invention. It is a figure which shows the structural example which performs the 3rd operation function example of this invention. It is a figure which shows the example of a display of the 3rd example of an operation function of this invention. It is a figure which shows the structural example of the display control part which performs the 3rd example of an operation function of this invention. It is a flowchart for demonstrating operation | movement of the 3rd operation function example of this invention. It is a figure for demonstrating the relationship between the designation | designated position and neighborhood area | region of the 3rd operation function example of this invention. It is a figure which shows the structural example which performs the 4th operation function example of this invention. It is a figure which shows the example of a display of the 4th example of an operation function of this invention. It is a figure which shows the structural example of the display control part which performs the 4th operation function example of this invention. It is a flowchart for demonstrating operation | movement of the 4th operation function example of this invention.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 ... Medical image display apparatus 2 ... Display part 3 ... Display control part 3a ... Display signal production | generation means 3b ... Reading means 3c ... Site determination means 3d ... Area | region production | generation means 3e ... Memory for processing 3f ... Memory 3g ... Neighborhood area setting means 4 ... Input unit 5 ... Storage unit

Claims (12)

A medical image display device for displaying a three-dimensional medical image,
A storage unit that stores original image data of a medical image obtained by a diagnostic device, organ data obtained by identifying an organ from the original image data by image processing, and analysis data obtained from the original image data ,
A display unit for displaying the original image data, organ data, and analysis data;
A display control unit that selectively displays original image data, organ data, and analysis data stored in the storage unit on the display unit,
The organ data includes three-dimensional image data and character data related to the region of the organ,
The analysis data includes three-dimensional image data and character data related to the analysis region in the organ,
The organ data and the analysis data constitute a tree-like data structure in which the organ data is an upper node and the analysis data is a lower node,
The display control unit extracts three-dimensional image data corresponding to a character designated on the display unit from the storage unit and displays the data on the display unit.
A medical image display device, wherein character data corresponding to a three-dimensional image designated on the display unit is extracted from a storage unit and displayed on the display unit. The three-dimensional image data of the organ data is organ position data and shape data identified by image processing of CT image data of the original image data,
The three-dimensional image data of the analysis data is integration region position data and shape data obtained by performing image processing on the FDG (fluorodeoxyglucose) integration state of the PET image data of the original image data. The medical image display device according to claim 1. The integrated region has an island integrated region where the FDG is integrated, and an integrated group region including a plurality of the island integrated regions,
3. The medical image display device according to claim 2, wherein a tree-like data structure is configured with the integrated group region as an upper node and the island integrated region as a lower node. The display control unit extracts the three-dimensional image data of the accumulation group region corresponding to the character designated on the display unit from the storage unit and displays it on the display unit,
4. The medical image display apparatus according to claim 3, wherein character data corresponding to a three-dimensional image of the integrated group area designated on the display unit is extracted from the storage unit and displayed on the display unit. The display control unit extracts the three-dimensional image data of the island accumulation region corresponding to the character designated on the display unit from the storage unit and displays the data on the display unit.
The medical image display device according to claim 3, wherein character data corresponding to a three-dimensional image of the island accumulation region designated on the display unit is extracted from the storage unit and displayed on the display unit.   The display control unit reads the original image data and the three-dimensional image data included in the organ data and the analysis data from the storage unit, and displays one image of the original image, the organ region image, and the analysis region image. Or a medical image display device according to any one of claims 1 to 5, wherein at least two images are superimposed on the display unit. The analysis data includes determination value data obtained by quantifying a diagnosis determination result,
The medical image display device according to any one of claims 1 to 6, wherein the display control unit extracts and displays three-dimensional image data of a diagnostic region based on the determination value data. The organ data includes a three-dimensional area composed of a plurality of blocks for storing bit data,
The three-dimensional area is defined by one-point coordinate data that defines a reference position of the three-dimensional area and a three-dimensional area size that determines the size of the three-dimensional area
The medical image display device according to any one of claims 1 to 7, wherein three-dimensional image data representing the shape of an organ is configured by assigning bit data to each block of the three-dimensional region. The analysis data includes a three-dimensional area composed of a plurality of blocks that store bit data,
The three-dimensional area is defined by one-point coordinate data that defines a reference position of the three-dimensional area and a three-dimensional area size that determines the size of the three-dimensional area
The medical image display device according to any one of claims 1 to 7, wherein three-dimensional image data representing a shape of an analysis region is configured by assigning bit data to each block of the three-dimensional region. . For a designated position designated on the display unit, an area setting unit for setting an area including the designated position is provided.
The display control unit reads at least one of the image data, the organ data, and the analysis data included in the region set by the region setting unit from the storage unit, and displays the read data on the display unit. The medical image display device according to claim 1. A medical image display device for displaying a three-dimensional medical image,
A storage unit that stores original image data of a medical image obtained by a diagnostic device, organ data obtained by identifying an organ from the original image data by image processing, and analysis data obtained from the original image data ,
A display unit for displaying the original image data, organ data, and analysis data;
A display control unit that selectively displays original image data, organ data, and analysis data stored in the storage unit on the display unit;
An area setting unit for setting an area including the specified position for the specified position specified on the display unit;
The display control unit reads at least one of the image data, the organ data, and the analysis data included in the region set by the region setting unit from the storage unit, and displays the read data on the display unit. A medical image display device. The region setting unit sets a region using as input data position data for determining the position of the region and size data for determining the size of the region,
12. The display control unit according to claim 10 or 11, wherein the display control unit reads image data from the storage unit in accordance with the position data and size data, and sequentially displays the read image data on the display unit. Medical image display device.