JPS60140466A - Picture retrieval device - Google Patents

Abstract

PURPOSE:To attain picture retrieval in response to the request of each operation by allowing the operator to place the priority on additional information of medical picture to a picture device storing various medical pictures. CONSTITUTION:The additional information data of picture is stored in a table form in an additional information storage circuit 91. An input signal B transmitted from a retrieval hierarchy input means 92 and an input signal A transmitted from the additional information storage circuit 91 are both inputted to a retrieval hierarchy decision circuit of a retrieval operation support means 93 and the sequence of the additional information data is changed. The content after change is stored in an rearranging additional information storage circuit of the retrieval operation support means 93. The additional information to the picture number is obtained by scanning the content of the rearranging additional informations storage circuit and it is used as a signal E and transmitted to an additional information picture display device 96.

Description

Detailed Description of the Invention [Technical Field of the Invention] The present invention relates to an image storage device for storing various medical images such as an X-ray diagnostic device, XIICT, NMR-0, ultrasound diagnostic device, nuclear medicine diagnostic device, etc. This invention relates to an image retrieval device that allows an operator to perform an image search according to each operator's request by assigning priorities to supplementary information of medical images (for example, date of imaging, body part, imaging modality, etc.). It is.

[Technical Background of the Invention ■] A search for a general character and numerical database is performed by keying in a preset symbol string from a keyboard or the like.

On the other hand, for databases that handle image data such as various medical images, the following search method provides an identifier to each image data in advance, and the operator inputs the identifier from a keyboard etc. to retrieve the image data. Perform a search.

(2) Search method ■ (Search method using supplementary information) As shown in FIG. 1, an original image storage device that stores the image number of each image, its supplementary information, and the address in the original image storage circuit as tabular information 121. 122 and the original image display device 12
3 and a keyboard 120, into which the operator inputs incidental information of the image desired to be searched.

Based on the input supplementary information, the address on the original image storage device 122 of the image that satisfies this condition is determined, and predetermined image data is sent from the original image storage device 122 to the original image display device 123 to display the image. be exposed.

(3) Search method ■ (Search method using hierarchical structure) 2nd
As shown in the figure, images are stored in a predetermined hierarchical structure, and this image is displayed on an original image display device having a touch panel.

Based on the positional relationship in the hierarchical structure between the currently displayed image and the desired image, the operator moves on the FM layer structure while applying pressure to a predetermined area of the touch panel with a finger or the like to search for and display a predetermined image. .

In other words, among the image numbers 1 to 11 in O in FIG. 2, the image with image number 3 is being displayed on the original image display device, and it is desired to change it to the image with image number 8. , pressure is applied with a finger or the like to the operation area on the touch panel to perform an operation of moving downward on the hierarchical structure.

[Problems with back cutting technology]

Since all of the information in general character and numeric data is abstracted, there are few operational obstacles to a search method in which a symbol string such as a search key is input from a keyboard or the like.

However, it is not possible to abstract all of the information in image data such as medical images, and the information can only be abstracted through the human visual function.

In the case of the above-mentioned search methods (1) and (2), the search methods for general character and numerical data are simply applied to image data.

In the case of search method (2), the operator is required to memorize the identifier of each image, which increases the burden on the operator.

Furthermore, in the case of search method (2), the number of key-ins from a keyboard or the like increases, which poses a problem in terms of operability.

Furthermore, if there are multiple images that satisfy the input conditions, the display order of the images on the original image display device 123 is determined one-dimensionally, and the multiple images are not necessarily displayed in the order desired by the operator. Not necessarily.

In the case of search method (2), the operator operates the touch panel while looking at the displayed image, so the operability is good.

However, if the currently displayed image and the new image to be displayed are located at separate positions in the hierarchical structure, the desired image cannot be obtained on the original image display device unless the touch panel is pressed many times.

For example, when it is desired to compare image number 5 or image number 11 shown in circles in FIG. 2, many touch operations are required to change the search position, making it impossible to perform a quick image search.

This is because operators want to compare a plurality of images, but the comparison items differ from time to time for each operator, or even for a single operator.

In other words, sometimes there is a request to compare images taken by multiple modalities (models) of the same region, and at other times there is a request to compare images taken of different parts obtained by the same modality. Requirements change depending on the situation. When a hierarchical structure is predetermined as in search method (2), there is a drawback that it is not possible to respond flexibly to such requests.

[Object of the Invention] The present invention has been made in view of the above circumstances, and includes an X-ray diagnostic apparatus e1. For the original image storage device that stores various medical images such as XIICT, NMR-CT, ultrasonic diagnostic equipment, nuclear medicine diagnostic equipment, etc., additional information of the medical images (date of removal, region of imaging, imaging modality) The object of the present invention is to provide an image retrieval device that can respond to operator requests and perform flexible image retrieval operations by prioritizing images.

[Summary of the Invention] The summary of the present invention for achieving the above object is to provide original images for storing various medical images such as X-ray diagnostic equipment, X-ray CT, NMR-CT, ultrasound diagnostic equipment, nuclear medicine diagnostic equipment, etc. An image search device for a storage device, which includes an incidental information storage circuit that stores incidental information of various medical images, a search hierarchy WJ expansion input means for setting a search hierarchical structure, and a search hierarchical structure input means. a search hierarchical structure determination circuit that determines a search hierarchical structure based on a signal from the search hierarchical structure; a search position selection means that selects a search position on the search hierarchical structure; and a search position that determines the search position based on the selection result. a means of determining;
a search hierarchical structure image creation circuit for creating an image showing the search hierarchical structure at the search position; a search display image selection means for changing and displaying images belonging to the same search position; The present invention is characterized by comprising a display image determining circuit that determines a display image, an additional information image creation circuit that creates an additional information image of the display image, and display devices for each of the hierarchical structure image and the additional information image.

[Embodiments of the Invention] The principle of the present invention and embodiments for realizing the principle will be described in detail below.

3 to 5 illustrate the principle of the present invention, and for convenience of explanation, a case where a plurality of images of a human patient are handled will be described here.

For example, the images represented by the nine image numbers 1 to 9 shown in FIG. 3 are handled, and the accompanying information is the date of shooting.

There are three types: imaged area and imaging modality. Furthermore, the head,
The chest region code is 10.20, respectively, and X-ray CT, N
Each modality code of MR-CT is 10.20.

When trying to search and compare images of various modalities by body part and date of photography, the above nine images are
It is considered appropriate to manage them under a hierarchical structure as shown in the figure.

In the figure, D1 to D9 are called directories and are information that determines the hierarchical structure. Further, the numbers 1 to 9 in circles indicate image numbers.

Level values are given to the three levels of the hierarchy shown in the figure, and these are set to 0.1.2 in order from the top level. In this example, the incidental information at level O is the patient name (same person), the information at level 1 is the site of imaging, and the information at level 2 is the date of imaging.

The means for classifying and managing the above-mentioned nine images first by the photographed region and then by positive date is called a search hierarchical structure.

In addition, in FIG. 4, an arbitrary directory D2, for example,
and images belonging to this are collectively called a node.

It is assumed that the relationship between each node in the search hierarchical structure is defined as shown in FIG. That is, a certain node
The parent node for is a node that is one level lower in the relationship in the search hierarchy, and its older brother node has the same parent node in the search hierarchy.

Further, under similar conditions, the th node is a node located on the right side of one of the X nodes, and the child node is a node located on the leftmost side among the nodes that are one level higher in relation in the search hierarchical structure.

In this way, by creating a search hierarchical structure according to the operator's requests and performing operations such as moving on this search hierarchical structure, it is possible to perform operations faster than in the case of the conventional hierarchical structure shown in Figure 2. Image searches can be performed.

Next, a configuration example of an image retrieval device for realizing the principle of the present invention described above will be explained with reference to FIGS. 6 and 7.

In FIG. 6, reference numeral 61 denotes an additional information image display device (for example, a kanji graphic display), which displays additional information of the image to be displayed, directory information, etc.

Reference numeral 62 denotes a search hierarchical structure input means for determining supplementary information of the search hierarchical structure. For example, when dealing with images having keys and supplementary information as shown in FIG. An item image 71 as shown in FIG. 7(a) indicating the item number is displayed on the supplementary information image display device 61. In this item image 71, the item number (1) is the date of imaging, the item number (2) is the region to be imaged, and the item number (3) is the imaging modality.

When the operator wants to classify the nine images shown in FIG. 3 first by imaged region and then by imaged date, the operator inputs the item number (2) from the search hierarchical structure input means 62. , then input the item number (1).

In this way, different search hierarchical structures can be created by changing the input order of item numbers (1), (2), and (3) as necessary.

Reference numeral 63 denotes a search position selection means, which can be composed of, for example, a touch panel.

An operation area 64 is provided on the search position selection means 63. The UP area of the operation button ti164 contains the incidental information of the parent node, the BEF'ORE area the incidental information of the older node, the NEXT area the incidental information of the second node, and the DOWN area.
In the area, additional information of the child node or, if the child node is not a directory but an original image, its image number is displayed.

For example, when the operator is searching the directory D5 shown in FIG. 4, information indicating the photographing date as shown in FIG. 7(b) is displayed on the supplementary information image display device 61.

The image representing the information shown in FIG. 7(b) is the hierarchical structure image 7.
It is called 2.

The operator changes the search position by applying pressure with a finger or the like to the operation area 64 of the search position selection means 63 corresponding to the search position to which the operator wants to move in accordance with the display of the hierarchical structure image 72.

Note that the END area is used when changing the search hierarchical structure shown in FIG. 4.

65 is an original image display device that displays the searched image. This original image display device 65 is provided with search display image selection means (for example, a touch panel) 66 having an operation area 67 .

When pressure is applied to the BEFOR area of the operation area 67, the image of the older node is displayed on the original image display device 65, and when pressure is applied to the NEXT area, the image of the second node is displayed on the original image display device 65.

Further, when pressure is applied to the UP area, the search position moves to the parent node, and the search position can be changed again via the search position selection means 63.

For example, if pressure is applied to the DOWN area while the hierarchical structure image 72 is being displayed on the operation area 64 of the supplementary information display device 61, the image with image number 4 will be displayed on the original image display device 65. At this time, all the supplementary information of image number 4 as shown in FIG. 7(C) is displayed on the supplementary information image display device 61.

An image including such additional information is referred to as an additional information image 73.

Next, when the UP area of the operation area 68 is input, the display content of the additional information image display device 61 returns to the item image 71.

The operator's operating procedure described above is shown in the flowchart of FIG. That is, the operator's operation procedure for the image search device described above can be roughly divided into the following three steps.

Step 1: Input additional information for each hierarchical level from the inspection hierarchical structure input means 62 to set the inspection hierarchical structure.

Step 2: Operate the search position selection means 63 to select a search position.

Step 3: Operate the search display image selection means 66 to select an image to be displayed.

Next, an example of the circuit configuration of the image search device and its operation will be described with reference to FIGS. 9 and 10.

In FIG. 9, 91 is an additional information storage circuit, and this additional information storage circuit 91 stores the additional information data 111 of the nine images described above in a tabular structure as shown in FIG. 11<a>. has been done. In FIG. 11(a), a to i indicate addresses within the original image storage circuit of the original image storage device. Reference numeral 92 denotes a hierarchical structure input means for inspection, which corresponds to the hierarchical structure input means 62 for search. When this hierarchical structure for search is input, the display image determining circuit 107 scans the contents of the directory information storage circuit 103 according to the signal F and the image number of the current display image storage register 106.
A new display image number is determined and stored in the display image storage register 106.

As described above, the display image determining circuit 107 and the original image storage device M98. The supplementary information image creation circuit 108 operates, and the new image and its supplementary information are displayed by the original image display device 99 and the supplementary information image display device 96, respectively.

If the content of signal F corresponds to the operation of the UP area, the display image determination circuit 107 to the hierarchical structure determination circuit 105
A reset signal R2 is sent to the
2, the contents of the display image storage register 106 are reset, and the hierarchical structure image creation circuit 105 creates a hierarchical structure image corresponding to the contents of the search position storage register 104 and outputs this as a signal C. , will begin to accept signals again.

FIG. 13 shows another example of the hierarchical structure for searching images represented by the nine image numbers shown in FIG. In this case, each imaging modality is set to level 1, and each imaging region is set to level 2, and the search hierarchical structure input means 6 shown in FIG.
2 is created when the supplementary information is input in the order of item numbers (3) and (2).

Such a search hierarchical structure is suitable when it is desired to search and compare images in order of each imaging modality, each imaging region, and each imaging date.

Although the embodiments of the present invention have been described in detail above, the present invention is not limited to the above embodiments, and various modifications can be made within the scope of the gist.

For example, although we have described only various medical grayscale images as search targets, document images such as electrocardiograms, medical records, and various clinical chemistry tests can also be binarized and input into the original image storage device from a facsimile, etc., and then searched. It can also be targeted.

In addition, although we have explained that only one image is displayed on the image display device, all images belonging to a certain hierarchy can be displayed in a multi-format format on the image display device, and you can search for and display images or display images from the touch panel. It is also possible to display only that image by direct instruction.

Furthermore, a light pen, joystick, etc. can also be used instead of the touch panel.

[Effects of the invention 1 According to the present invention described in detail above, the X-ray diagnostic device] η.

A search hierarchical structure that can be changed at any time can be formed for image storage devices that store various medical images such as X-ray CT, NMR-CT, ultrasound diagnostic equipment, and medical diagnostic equipment.
Therefore, it is possible to provide an image retrieval device that can perform flexible image retrieval in response to operator requests.

[Brief explanation of drawings]

Fig. 1 is an explanatory diagram showing a conventional image retrieval method, Fig. 2 is an explanatory diagram showing a hierarchical structure in another example of the conventional image retrieval method, and Fig. 3 is an explanatory diagram showing nine image numbers to be searched and their ancillary information. FIG. 4 is an explanatory diagram showing the W3 layer structure for searching in the embodiment of the present invention, FIG. 4 is an explanatory diagram showing the relationship between name nodes in the hierarchical structure for searching, and FIG. FIG. 7 is an explanatory diagram showing the configuration and operation area of the embodiment of the invention (
a) is an explanatory diagram showing the item image, FIG. 7(b) is an explanatory diagram showing the hierarchical structure image, FIG. 7(C) is an explanatory diagram showing the supplementary information image, and FIG. 8 is a flowchart showing the operator's procedure. , FIG. 9 is a block diagram showing a specific circuit configuration of an embodiment of the present invention, FIG. 10 is a block diagram showing an example of a specific circuit configuration of the search operation support means shown in FIG. 9, and FIG. 11 (
a) is an explanatory diagram showing supplementary information data in table format, No. 11
FIG. 12 is an explanatory diagram showing directory information data, and FIG. 13 is an explanatory diagram showing another example of the search hierarchical structure. be. 61.96... Additional information image display device, 62.92.
...LiI layer structure input means for search, 63.95...Search position selection means, 65.99...Original image display device, 66.97...Search display image selection means, 91...Additional information Memory circuit, 93...Search operation support means, 94...Hierarchical structure image display device, 96...Additional information image display device, 98...Original image storage device, 101-...Hierarchical structure for search Decision circuit, 105...
Hierarchical structure image creation circuit, 107...Display image determination circuit, 108...Additional information image creation circuit. Agent Patent attorney Noriyuki Chika (1 person) Condolences 6 Figure 64 67 Condolences 7 ＾ dar (0) 111 (b) 12

Claims (1)

[Claims] X-ray diagnostic equipment, Xi! C; T, NMR
-CT, mN An image retrieval device for an original image storage device storing various medical images of a device to be diagnosed, a nuclear medicine diagnostic device, etc., comprising an ancillary information storage circuit for storing ancillary information of various medical images, and a retrieval device. A search hierarchical structure input means for setting a hierarchical structure; a search hierarchical structure determining circuit for determining a search hierarchical structure based on a signal from the search hierarchical structure input means; and a search hierarchical structure determining circuit for searching on the search hierarchical structure. A search position selection means for selecting a position, a search position determination means for determining a search position based on the selection result, and a search hierarchical structure image creation circuit for creating an image showing a search 1 hierarchical structure at the search position. , search display image selection means for changing and displaying images belonging to the same search position;
An image retrieval device comprising an additional information image creation circuit and display devices for the hierarchically structured image and the additional information image.