JPH0575145B2 - - Google Patents

Description

DETAILED DESCRIPTION OF THE INVENTION [Object of the Invention] (Industrial Application Field) The present invention relates to a medical image database system that stores medical information on the human body and performs searches, displays, etc. of the medical information.

(Prior Art) There is a deep-rooted desire for a medium that can systematically view various images such as photographed images, anatomical diagrams, three-dimensional diagrams, cross-sectional diagrams, etc. of various parts and organs of the human body.

A collection of medical images is desired in which various detailed images can be easily searched, associated, displayed, and observed for use in image-based diagnosis and as materials for medical education such as anatomy.

Furthermore, with the recent spread of X-ray CT (an imaging device for the distribution of X-ray attenuation coefficients in human body cross sections) and MRI (magnetic resonance imaging), the types and quantities of medical images that can be searched and observed are increasing. Both are rapidly increasing. In addition, the content is not limited to simple multi-slice images, but also requires morphological coronal sections, sagittal sections, and arbitrary oblique sections (oblique sections), resulting in extremely complex and sophisticated demands. ing.

In comparison to such demands, conventional books such as anatomical books and data books have been available as systematic collections of various medical images of various parts and organs of the human body. It is also possible to simply use a large number of CTs or
Devices that collect MRI images and display them on a TV monitor have existed in the past, but they have not been systematically integrated and managed.

(Problem to be solved by the invention) However, there are naturally limits to the collection and organization of various medical images using books such as anatomical books and data books, and it is difficult to collect and organize such large amounts of image information and complex cross-sectional views. It is not possible to meet such demands. Therefore, there has been a desire to develop a medium that can systematically store a large amount of image information and allow any type of image of any part, organ, etc. to be obtained easily and quickly.

Due to these conventional circumstances, in addition to the various images and medical information contained in anatomy books and databooks, images and information collected by X-ray CT, MRI, etc. We aim to create a medical image database system that can systematically organize and integrate medical images and information in a format that is easy to use for clinicians, medical educators, etc., and we are particularly focused on building a systematic database. This is the object of this invention.

[Structure of the Invention] (Means for Solving the Problems) In order to achieve the above object, the present invention searches for a schematic image of each part of a part or all of the human body in a substantially continuous region. an index memory that stores a search code for distinguishing an arbitrary part of the search image from other parts in correspondence with the search image; an anatomical diagram creating means for obtaining image data and creating an anatomical diagram of the relevant region based on the image data; an anatomical diagram storage means for storing the anatomical diagram in correspondence with the search code; The present invention is characterized in that it includes a stereoscopic image creation means for creating a stereoscopic image, and a stereoscopic image storage means for storing the stereoscopic image in correspondence with the search code.

(Function) In a medical image database system having such a configuration, any part of a substantially continuous search image of a part or all of a human body, which is stored in the search image memory and displayed by the display means, can be A search code to be distinguished from the part is stored in the index memory in correspondence with the search image, and medical information regarding the arbitrary part corresponding to each search code is stored in the medical information memory. , it becomes easy to retrieve and associate the medical information stored in this medical information memory,
Even large amounts of medical information such as image data of multiple types can be stored systematically, and any type of image data of any part or organ, especially anatomical diagrams and 3D images, can be easily and easily stored. It becomes possible to take out and display quickly.

(Example) Below, an example of the medical image database system according to the present invention will be described in detail based on the drawings.

FIG. 1 is a block diagram of the main parts of a medical image database system according to an embodiment of the present invention.

There is an integrated control unit 10 that performs integrated control of this entire database system.

Input devices include an image capturing device 11 such as an X-ray CT (hereinafter abbreviated as CT) or MRI, a film digitizer 12 that converts image film, etc. into digital values, and inputs numerical values, characters, etc., and keys. A keyboard 13 for giving instructions, etc., and a tablet 1 for inputting traces of output images, etc.
4. There is a track ball 15 for inputting position specifications and the like.

An image input section 16, a numerical value input section 17, an instruction input section 18, and a trace input section 19 are provided to control input from each of these input devices.

The image input unit 16 may be connected online to the CT or MRI apparatus 11 to directly receive captured images, or input the captured images via the film digitizer 12, and either configuration is possible.

Further, as output devices, there is a monitor TV 21 that displays images, numerical information, etc. on a screen, and, for example, a laser printer 22 that outputs images and numerical information on paper. In addition,
The printer 22 may be any output device capable of outputting images, and of course does not need to be a laser printer.

An image display unit 23 for the monitor TV 21 that sends out images, numerical values, etc. while controlling these output devices.
and a numerical display section 24, an image output section 25 of the laser printer 22, and a numerical output section 26 are provided, respectively.

The medical information such as medical images stored in this embodiment system includes various images and numerical information described in ordinary anatomy books, data books, etc., and images obtained by the apparatus 11 such as MRI and CT. Two-dimensional image information such as the examiner's multi-slice image, human anatomy diagram based on this, three-dimensional image information for each organ, etc., as well as the anatomical name and CT value at the time of image capture,
There is non-image information (code information) consisting of numerical values such as T1 value and T2 value and character information.

This medical information is classified into segments according to body parts and organs, and each segment is further divided into detailed parts, and a search code is assigned to each part to distinguish it from other parts, and an index that holds this search code is used. We are building a system that is systematically organized and integrated into files and can be provided in a format that is easy to use for clinicians, medical educators, etc.

Although it is ideal that the target human body parts cover the entire body, it is also possible to construct this database system partially.

The two-dimensional image information is stored in an original image storage unit 33 that stores original images obtained by a device 11 such as CT or MRI.
and an anatomical diagram storage unit 32 that stores anatomical diagrams created by extracting outlines of constituent systems such as blood vessels and bones, organs, etc. from these original images. There is a 2D index holding unit 31 that holds both of the above search codes, and each of these storage units 3
3, 32 and the information in the holding unit 31
A 2D image management section 30 is provided.

The three-dimensional image information is stored in a three-dimensional image storage unit 42 that stores three-dimensional images of each organ, body part, etc. constructed based on the above-mentioned anatomical diagram, etc., and is stored in a three-dimensional image storage unit 42 that stores three-dimensional images of each organ, part, etc. based on the above-mentioned anatomical diagram, etc. A 3D image management section 40 is provided.

Furthermore, there is a code information storage section 52 for storing code information which is non-image information, a code index holding section 51 for searching the code information, and a code information management section 50 for managing the code information.

The anatomical chart creation section 61 includes a device 11 such as CT or MRI.
Extract the contour from the original image by image processing,
There are methods for creating anatomical diagrams, but they can be created manually, or extracted from a book or the like and inputted from a film digitizer 12, or the original image is displayed on a monitor TV 21 and then used with a tablet 14 or track ball 15. monitor tv
A creation/input method such as inputting via the trace input section 19 while drawing an outline on the screen of 21 is also possible.

There is also a stereoscopic image construction unit 62 that constructs stereoscopic image information from a plurality of anatomical charts created based on multi-slice images and the like.

Furthermore, there is a code information creation section 63 that receives and edits non-image information such as part names and CT values corresponding to each image information to form code information.

On the other hand, a search image storage unit 75 stores a schematic image of the whole and/or a specific part for searching.
There is a search control unit 74 which extracts search images as appropriate from the search engine and displays them on the monitor TV 21, and accepts position designations and display information designations using the keyboard 13, tablet 14, trackball 15, etc. via the instruction input unit 18. .

Then, according to the output selection data from the search control unit 74, the original image or anatomical diagram is selectively retrieved using the search code via the 2D image management unit 30 and displayed on the monitor TV 21 or output to the laser printer 22, etc. 2D image selection section 71
Similarly, a stereoscopic image creation/display unit 72 selectively extracts stereoscopic image information via the 3D image management unit 40, creates, displays, and outputs a stereoscopic display image according to an instructed viewpoint; 3D
A cross-sectional image creation/display unit 76 selectively extracts cross-sectional images in accordance with the instructed cross-section through the image management unit 40, and displays and outputs the cross-sectional images; A code information selection section 73 is provided for selectively extracting, displaying and outputting the code information.

Next, regarding each operation of this example system,
I will explain them one by one.

First, the operation during system construction will be explained based on FIG. 2.

First, original images (axial, sagittal, coronal, oblique, etc.) obtained by a CT or MRI apparatus 11 of a subject are collected (step 201 in FIG. 2). Please note that this image collection is
The CT, MRI device, etc. 11 and the image input unit 16 may be connected online to directly capture image data, or the image data obtained by the device 11 may be configured using a film digitizer 12 or the like for image reading. It is also possible to configure the device to read and input a captured image.

The image data thus collected is divided into segments and registered while performing segment analysis to assign search codes (step 205).

Next, an anatomical diagram is created based on the original image (step 203).

The procedure for creating an anatomical diagram is shown in detail in Figure 3. first
An original image obtained by CT, MRI, etc. 11 is corrected to the original size or a certain magnification and outputted to the laser printer 22 (step 301 in FIG. 3). Basic tracing is then performed to extract and trace all the major contours of this output image (step 303). Next, this traced image is divided appropriately according to organs, organs, parts, etc. (step 305).
The trace is re-traced for each divided organ, etc. (step 307). Finally, input is made via the trace input section 19 while tracing using the tablet 14 or the like (step 309) to create a detailed anatomical diagram in the form of line drawings (binarized images).

Note that this anatomical diagram may be created by displaying the original image on the screen of the monitor TV 21 and inputting it while tracing it with, for example, a track ball 15 or a light pen (not shown), or by using the anatomical diagram creating section 61. It is also possible to extract the contour by image processing using the image processing method, and then correct and input the contour while viewing the extracted image.

For each anatomical chart created in this way, a search code is assigned and registered for each segment while considering the anatomical name, etc. (Step 205 in Figure 2), and an anatomical chart system is constructed together with the original image ( Step 207).

Furthermore, three-dimensional images are constructed for each organ etc. from the systematic anatomical diagram group obtained in this way, and are registered in the system while being segmented in the same way (step 209).

In addition, the CT value at the time of taking each of the above images,
Numerical information such as T1 and T2 values, non-image information (code information) such as anatomical names and related disease names are also registered in a systematic manner through segmentation (step
211).

An integrated database of medical images is thus formed (step 213), and it becomes possible to search and display image and non-image information for diagnosis, education, etc. (step 215).

An example of the operation at the time of search and display in this medical image database system will be described in detail with reference to a flowchart shown in FIG.

First, the search control unit 74 retrieves a schematic image of the entire human body or a specific part from the search image storage unit 75, and displays it at a predetermined position (for example, the upper left) of the monitor TV 21 via the image display unit 23 (FIG. 4). (Step 401).

The operator specifies the desired part of the image using the keyboard 13, tablet 14, trackball 15, etc. (step 403).
This instruction data is transmitted to the search control section 74 via the instruction input section 18. In the search control unit 74,
It is determined whether the above instruction is a site instruction (step 405).

If the region is specified (Yes in step 405), the search control section 74 selects a search code corresponding to the specified region and transmits it to the 2D image selection section 71 and the stereoscopic image creation/display section 72. 2D image selection section 7
1, the anatomical diagram and original image corresponding to the above search code are accessed via the 2D image management unit 30 to the 2D index holding unit 31 to read their memory addresses, and then the original image storage unit 33 and the anatomical diagram are respectively accessed. It is taken out from the storage section 32 and displayed at a predetermined position on the monitor TV 21 (steps 411 and 413). Furthermore, in the stereoscopic image creation and display section 72, the image similarly passes through the 3D image management section 40 and the 3D index holding section 41.
The stereoscopic image information corresponding to the above search code is retrieved from the stereoscopic image storage unit 42, a stereoscopic image from a predetermined viewpoint (held as an initial value) is created, and the stereoscopic image is displayed on the monitor TV.
21 (step 415). When this display is completed, the process returns to inputting instructions by the operator (arrow A; step 403).

If the instruction input by the operator is not to specify a part, if the part has never been specified (step 405 negative (1)), return to instruction input (arrow A; step 403), and specify the part at least once. If the designation has been made (step 405 negative (2)), it is determined whether the above instruction input is a sectional view request (step 405).
406).

If the cross-sectional view is requested (step 406 affirmative),
The cross-sectional image creation and display section 76 similarly retrieves the three-dimensional image information corresponding to the search code from the three-dimensional image storage section 42 via the 3D image management section 40 and the 3D index holding section 41, and generates a cross-section corresponding to the designated cross-section. An image is created and displayed on the monitor TV 21 (step 441). When this display is completed, the operator returns to input instructions (arrow A; step
403).

If it is not a sectional view request (step 406 negative), it is further determined whether it is a code information request (step 407).

If it is a code information request (Yes at step 407), the 2D image selection unit 71 sends non-image information corresponding to the current search code to the code information management unit 50 and stores it in the code index holding unit 51. After accessing the memory address, it is taken out from the code information storage section 52 and displayed on the monitor TV 21 through the image display section 23 and the numerical display section 24 (step 431). Thereafter, the process returns to inputting the next instruction (arrow A; step 403).

If it is not a code information request (step
407 (No), it is checked whether or not there is a request to rotate the stereoscopic image (Step 409), and if not (Step 409, No), the process returns to the next instruction input (arrow A; Step 403).

If it is a request to rotate a 3D image (step
409 (Yes), the stereoscopic image creation/display unit 72 creates a stereoscopic image based on the new viewpoint based on the rotation instruction from the information of the currently displayed stereoscopic image (step 421), and similarly displays it on the monitor TV 21 (step 421).
415). Then, the process returns to the original instruction input (arrow A; step 403).

In this way, the desired image is searched and displayed.

In the above description, the case of displaying on the monitor TV 21 was taken as an example, but the procedure is substantially the same when outputting to the laser printer 22 or the like. Therefore, its explanation will be omitted.

Next, examples of display/output in this database system are shown in Figures 5 to 10.
Give an explanation.

Two-dimensional image information consists of source images such as CT and MRI and anatomical diagrams.

First, an example of a display in screen search is shown in FIG. A schematic overall diagram (or a diagram of a specific part) for searching shown in the upper left of the display screen of the monitor TV 21
, keyboard 13 or tablet 1
4 or a line cursor that is a straight line (or curved line or a combination thereof) that can be moved using a trackball 15 or the like. Then, the anatomical diagram of the designated region is displayed at the top right of the screen, the original image from the CT or MRI device 11 is displayed at the bottom left of the screen, and the 3D image from a predetermined viewpoint after initialization is displayed at the bottom left of the screen.

Note that the display position of each image is, of course, not specified as the above-mentioned position, and the four images are not always displayed by dividing the display screen as described above. That is, as will be described later, it is of course possible to display only one image or other number of images on the display screen, and it is also possible to display multiple images on the display screen.
It is also possible to display images separately using a TV or the like.

The three-dimensional image information stored in the three-dimensional image storage unit 42 consists of three-dimensional image information of major organs constituted by an anatomical diagram system and a group of segmented divided anatomical diagrams.

FIGS. 7 to 10 show stereoscopic images of the thorax, the vascular system in the chest, and the trachea.

FIG. 7 shows three-dimensional images of the thorax viewed from four different viewpoints simultaneously displayed on the screen of one monitor TV 21. The form, arrangement, composition, etc. of each part of the thorax can be clearly recognized.

FIG. 8 shows a three-dimensional image of the vascular system in the chest using only one image with the viewpoint placed in front of it. Furthermore, FIGS. 9 and 10 are three-dimensional images of the trachea that are individually displayed as images viewed from different viewpoints. In both cases, the structure etc. are very easy to understand.

Further, code information (non-image data) is stored in the code information storage section. That is, anatomical names, numerical information such as CT values, T1 and T2 values, and related disease names are stored for each segmented information group.

FIG. 6 shows an example of a display regarding the brain cortex. For example, the anatomical name of the portion specified by the position specifying means such as the trackball 15 is displayed.

Each image/non-image information code index holding section 31, 41, 51 is stored in the image information storage section,
Information for efficiently searching for target data from the code information storage unit and the like is stored.

By adding a knowledge index file, it is possible to add an inference function to the search algorithm, and by adding a means of managing knowledge data to this database system, it is possible to make it more than just digitizing anatomical charts. It is also possible to develop it into a disease simulation system or a diagnostic support system.

As described above, the present invention is not limited to the above-mentioned embodiment system, and by making appropriate additions, deletions, or changes to the above-mentioned example,
It can also be used as a medical image database system of various sizes, or for more general purpose or limited use.

[Effects of the Invention] As explained above in detail, the medical image database system according to the present invention makes it possible to construct a database system that can systematically store medical information such as image data. Even if it is medical information such as image data, which has a wide variety of types, it can be
The effect is that it becomes possible to easily and quickly retrieve and display image data of any part of an organ or the like, and any type of image data, especially anatomical charts and stereoscopic images.

[Brief explanation of the drawing]

FIG. 1 is a block diagram of the main parts of a medical image database system according to an embodiment of the present invention, FIG. 2 is a block flow diagram of the main operations of the system, and FIG.
The figure shows a block flow diagram of a partial anatomical chart creation operation example in Figure 2, Figure 4 is a flowchart of an example of image search and display operation, and Figure 5 shows an example of the display of the basic search screen of the system. 6 are diagrams showing display examples of code information of the same system, and FIGS. 7 to 10 are photographs showing the forms of living things (human bodies) as display examples of stereoscopic images of the same system. 10... Integrated control unit, 11... CT, MRI device, 12... Film digitizer, 13... Keyboard, 14... Tablet, 15... Trackball, 16... Image input unit, 17... Numerical input unit , 18... Instruction input section, 19... Trace input section, 21... Monitor TV, 22... Laser printer, 23... Image display section, 24... Numerical display section,
25... Image output section, 26... Numerical output section, 30
...2D image management unit, 31...2D index holding unit, 32...Anatomical diagram storage unit, 33...Original image storage unit, 40...3D image management unit, 41...3D index holding unit, 42... 3D image storage unit, 50
...Code information management unit, 51...Code index holding unit, 52...Code information storage unit, 61...
...Anatomical chart creation section, 62...Three-dimensional image construction section, 63
...Code information creation section, 71...2D image selection section,
72...Stereoscopic image creation/display unit, 73...Code information selection unit, 74...Search control unit, 75...Search image storage unit, 76...Cross-sectional image creation unit.

Claims (1)

[Scope of Claims] 1. A search image memory that stores a schematic image of each part of a part or all of the human body as a search image for a part or all of a substantially continuous area; An anatomical system that obtains medical image data of a part that is common to a part of the region and creates an anatomical diagram of the part based on this. diagram creation means; anatomical diagram storage means for storing the anatomical diagram in correspondence with the search code; stereoscopic image creation means for creating a stereoscopic image from a plurality of the anatomical diagrams; A medical image database system comprising: a stereoscopic image storage means for storing a stereoscopic image.