JP2022041454A - Information processing apparatus - Google Patents

Abstract

To support appropriate determination of a medical treatment policy.SOLUTION: An information processing apparatus according to an embodiment comprises an acquisition unit and a search unit. The acquisition unit acquires a plurality of images of a first analyte obtained at a plurality of different time points and medical information indicating a medical practice conducted to the first analyte between the plurality of time points. The search unit searches for case information on a second analyte by using the plurality of images and the medical information. The search unit searches, as the case information, for a first image and a second image corresponding to two images, respectively, which are included in the plurality of images, a third image that is obtained temporally later than the first image and the second image, first medical information indicating a medical practice conducted to the second analyte from when the first image is obtained until when the second image is obtained, and second medical information indicating a medical practice conducted to the second analyte from when the second image is obtained until when the third image is obtained.SELECTED DRAWING: Figure 1

Description

The embodiments disclosed in the present specification and the drawings relate to an information processing apparatus.

Conventionally, in general, in brain tumor medical care, image diagnosis is performed as a follow-up examination on a regular basis from the initial diagnosis. In this follow-up examination, for example, the treatment policy is determined by measuring the change in tumor size based on an image, but the optimal treatment policy for the change in tumor size is not defined, and it is direct. It is difficult to determine the medical treatment policy.

In such a case, for example, by referring to a conventional case, there is a possibility that a more appropriate medical treatment policy can be examined. However, the commonly used similar case search technique searches for an image at a certain time point, does not consider the change in the image as described above, and does not necessarily consider cases with similar progression. I can't search.

There is also a technique for predicting changes in the area of interest, but when deciding on a medical treatment policy, it is necessary to consider not only the changes in the image but also the clinical symptoms of the subject in the next treatment. Therefore, it is still difficult to properly determine the medical treatment policy.

It should be noted that such a situation can occur not only in the medical treatment of brain tumors but also in the medical treatment of other parts.

Japanese Unexamined Patent Publication No. 2014-233611 International Publication No. 2008/041401 Japanese Unexamined Patent Publication No. 2007-287018 Japanese Unexamined Patent Publication No. 2009-0451121 Japanese Unexamined Patent Publication No. 2010-172559

Wen, et al. Updated Response Assessment Criteria for High-Grade Gliomas: Response Assessment in Neuro-Oncology Working Group, Journal of Clinical Oncology, Vol. 28, No. 11, 2010

One of the challenges that the embodiments disclosed in the specification and drawings seek to solve is to support the appropriate determination of clinical policy. However, the problems to be solved by the embodiments disclosed in the present specification and the drawings are not limited to the above problems. It is also possible to position the problem corresponding to each effect by each configuration shown in the embodiment described later as another problem.

The information processing apparatus according to the embodiment includes an acquisition unit, a search unit, and a display control unit. The acquisition unit acquires a plurality of images of the first subject obtained at a plurality of different time points and medical information indicating the medical treatment performed on the first subject during the plurality of time points. .. The search unit searches for case information regarding the second subject by using the plurality of images and the medical information. The display control unit causes the display unit to display the case information. Here, as the case information, the search unit performs the first image and the second image corresponding to the two images included in the plurality of images, respectively, and the first image and the second image later in time. The obtained third image, the first medical information indicating the medical practice performed on the second subject between the time when the first image is obtained and the time when the second image is obtained, and the above-mentioned The second medical information indicating the medical practice performed on the second subject between the time when the second image is obtained and the time when the third image is obtained is searched.

FIG. 1 is a diagram showing a configuration example of a medical information processing system including an information processing device according to the present embodiment. FIG. 2 is a flowchart showing a processing procedure of processing performed by the acquisition function, the search function, and the display control function according to the present embodiment. FIG. 3 is a flowchart showing a processing procedure of processing performed by the acquisition function, the search function, and the display control function according to the first embodiment. FIG. 4 is a diagram showing an example of case information displayed by the display control function according to the first embodiment. FIG. 5 is a flowchart showing a processing procedure of processing performed by the acquisition function, the search function, and the display control function according to the second embodiment. FIG. 6 is a flowchart showing a processing procedure of processing performed by the acquisition function, the search function, and the display control function according to the third embodiment. FIG. 7 is a flowchart showing a processing procedure of processing performed by the acquisition function, the search function, and the display control function according to the fourth embodiment. FIG. 8 is a flowchart showing a processing procedure of processing performed by the acquisition function, the search function, and the display control function according to the fifth embodiment. FIG. 9 is a flowchart showing a processing procedure of processing performed by the acquisition function, the search function, and the display control function according to the sixth embodiment. FIG. 10 is a flowchart showing a processing procedure of processing performed by the acquisition function, the search function, and the display control function according to the seventh embodiment. FIG. 11 is a diagram for explaining the derivation of the tendency of changes in image features performed by the search function according to the seventh embodiment. FIG. 12 is a diagram for explaining the correction of the tendency of the change in the image feature performed by the search function according to the eighth embodiment. FIG. 13 is a flowchart showing a processing procedure of processing performed by the acquisition function, the search function, and the display control function according to the first example of the ninth embodiment. FIG. 14 is a flowchart showing a processing procedure of processing performed by the acquisition function, the search function, and the display control function according to the second example of the ninth embodiment. FIG. 15 is a diagram for explaining a case search performed by the search function according to the ninth embodiment. FIG. 16 is a diagram showing an example of case information displayed by the display control function according to the tenth embodiment.

Hereinafter, embodiments of the information processing apparatus will be described in detail with reference to the drawings.

(Embodiment)
FIG. 1 is a diagram showing a configuration example of a medical information processing system including an information processing device according to the present embodiment.

For example, as shown in FIG. 1, the medical information processing system 100 includes a medical image diagnostic device 110, a medical image storage device 120, an electronic medical record system 130, and an information processing device 140. Here, the devices are connected to each other so as to be able to communicate with each other via a network 150 such as a hospital LAN (Local Area Network).

The medical diagnostic imaging apparatus 110 collects various images related to a subject (patient or the like). Specifically, the medical diagnostic imaging apparatus 110 collects images ordered by a doctor or the like when an examination of a subject is performed. Further, the medical image diagnosis device 110 transmits the collected images to the medical image storage device 120 each time the examination of the subject is performed. For example, the medical image diagnostic apparatus 110 includes a magnetic resonance imaging (MRI) apparatus, an X-ray CT (Computed Tomography) apparatus, an ultrasonic diagnostic apparatus, a PET (Positron Emission Tomography) apparatus, and a SPECT (Single Photon Emission Computed Tomography) apparatus. ) Equipment, etc. The medical image diagnostic device 110 is also called a modality.

The medical image storage device 120 stores various images related to the subject. Specifically, the medical image storage device 120 receives the image transmitted from the medical image diagnosis device 110, and stores the received image in the storage circuit of the own device. For example, the medical image storage device 120 is realized by computer equipment such as a server and a workstation. Further, for example, the medical image storage device 120 is realized by a PACS (Picture Archiving and Communication System) or the like, and stores images in a format compliant with DICOM (Digital Imaging and Communications in Medicine).

The electronic medical record system 130 stores various medical information including attribute information and medical records related to the subject. Specifically, the electronic medical record system 130 generates medical information about the subject based on the information input by the operator and the information transmitted from other devices, and stores the generated medical information in the storage circuit in the own system. To memorize. For example, the electronic medical record system 130 is realized by a computer device such as a server or a workstation.

The information processing apparatus 140 performs various information processing using various images and medical information related to the subject. Specifically, the information processing apparatus 140 acquires an image related to the subject from the medical image diagnostic device 110 or the medical image storage device 120, acquires medical information about the subject from the electronic medical record system 130, and acquires the acquired image and medical treatment. Various types of information processing are performed using information. For example, the information processing apparatus 140 is realized by computer equipment such as a server, a workstation, a personal computer, and a tablet terminal.

Specifically, the information processing apparatus 140 has a network (NetWork: NW) interface 141, a storage circuit 142, an input interface 143, a display 144, and a processing circuit 145.

The NW interface 141 controls the transmission and communication of various information transmitted and received between the information processing apparatus 140 and another apparatus connected via the network 150. Specifically, the NW interface 141 is connected to the processing circuit 145, and transmits various information to other devices in response to a command from the processing circuit 145. Further, the NW interface 141 receives various information transmitted from other devices in response to a command from the processing circuit 145, and outputs the received information to the processing circuit 145. For example, the NW interface 141 is realized by a network card, a network adapter, a NIC (Network Interface Controller), or the like.

The storage circuit 142 stores various information and various programs. Specifically, the storage circuit 142 is connected to the processing circuit 145 and stores various information in response to a command from the processing circuit 145. Further, the storage circuit 142 reads out the stored information and outputs it to the processing circuit 145 in response to a command from the processing circuit 145. For example, the storage circuit 142 is realized by a RAM (Random Access Memory), a semiconductor memory element such as a flash memory, a hard disk, an optical disk, or the like.

The input interface 143 receives various instructions and input operations of various information from the operator. Specifically, the input interface 143 is connected to the processing circuit 145, converts the input operation received from the operator into an electric signal, and outputs the input operation to the processing circuit 145. For example, the input interface 143 is a trackball, a switch button, a mouse, a keyboard, a touch pad for performing an input operation by touching an operation surface, a touch screen in which a display screen and a touch pad are integrated, and a non-optical sensor. It is realized by a contact input interface, a voice input interface, and the like. In the present specification, the input interface 143 is not limited to the one provided with physical operating parts such as a mouse and a keyboard. For example, an example of the input interface 143 includes an electric signal processing circuit that receives an electric signal corresponding to an input operation from an external input device provided separately from the device and outputs the electric signal to a control circuit.

The display 144 displays various information. Specifically, the display 144 is connected to the processing circuit 145 and displays various information in response to a command from the processing circuit 145. For example, the display 144 is realized by a liquid crystal monitor, a CRT (Cathode Ray Tube) monitor, a touch panel, or the like.

The processing circuit 145 controls the operation of the information processing apparatus 140 according to the input operation received from the operator via the input interface 143. For example, the processing circuit 145 controls the NW interface 141 to transmit and receive various information to and from other devices. Further, for example, the processing circuit 145 stores various information received from other devices via the NW interface 141 in the storage circuit 142. Further, for example, the processing circuit 145 reads various information requested by the operator from the storage circuit 142 and displays it on the display 144.

The configuration example of the medical information processing system 100 including the information processing device 140 according to the present embodiment has been described above.

Under such a configuration, the information processing apparatus 140 according to the present embodiment is used, for example, in a follow-up examination of a brain tumor to determine a medical treatment policy.

Generally, in brain tumor medical care, image diagnosis is performed as a follow-up examination on a regular basis from the initial diagnosis. In this follow-up examination, for example, the treatment policy is determined by measuring the change in tumor size based on an image, but the optimal treatment policy for the change in tumor size is not defined, and it is direct. It is difficult to determine the medical treatment policy.

In such a case, for example, by referring to a conventional case, there is a possibility that a more appropriate medical treatment policy can be examined. However, the commonly used similar case search technique searches for an image at a certain time point, does not consider the change in the image as described above, and does not necessarily consider cases with similar progression. I can't search.

There is also a technique for predicting changes in the area of interest, but when deciding on a medical treatment policy, it is necessary to consider not only the changes in the image but also the clinical symptoms of the subject in the next treatment. Therefore, it is still difficult to properly determine the medical treatment policy.

Therefore, the information processing apparatus 140 according to the present embodiment is configured to be able to support an appropriate determination of a medical treatment policy.

Specifically, the processing circuit 145 has an acquisition function 145a, a search function 145b, and a display control function 145c.

The acquisition function 145a is a medical treatment showing a plurality of images of a target subject (first subject) obtained at a plurality of different time points, and medical treatment performed on the target subject during the plurality of time points. Get information. Here, the acquisition function 145a is an example of the acquisition unit.

The search function 145b searches for case information regarding another subject (second subject) by using a plurality of images and medical information of the target subject acquired by the acquisition function 145a. Here, the search function 145b is an example of a search unit.

Specifically, the search function 145b provides case information regarding other subjects, such as a first image and a second image corresponding to two images included in a plurality of images of the target subject, and a first image and a first image, respectively. The third image obtained later in time than the second image is searched.

At this time, the search function 145b, as the first image and the second image, is a plurality of images similar to the changes between the plurality of images of the target subject and the images and the medical practices performed between the time when each image was obtained. Search for images.

Further, the search function 145b is used as case information regarding the other subject, and further, medical treatment performed on the other subject between the acquisition of the first image and the acquisition of the second image. The first medical information indicating the above and the second medical information indicating the medical treatment performed on the other subject between the time when the second image is obtained and the time when the third image is obtained are searched.

The display control function 145c causes the display 144 to display the case information searched by the search function 145b. Here, the display control function 145c is an example of the display control unit. The display 144 is an example of a display unit.

Hereinafter, the processing performed by each of the above-mentioned processing functions will be described in detail.

FIG. 2 is a flowchart showing a processing procedure of processing performed by the acquisition function 145a, the search function 145b, and the display control function 145c according to the present embodiment.

For example, as shown in FIG. 2, in the present embodiment, the acquisition function 145a determines a plurality of target follow-up examination times each time the follow-up examination of the target subject is performed (step S11).

For example, the acquisition function 145a has a plurality of target follow-up test times, the latest follow-up test times performed on the target subject and a predetermined number of follow-up test times performed immediately before that. May be determined as. Further, for example, the acquisition function 145a may determine a plurality of follow-up inspection times designated by the operator as a plurality of target follow-up inspection times.

After that, the acquisition function 145a acquires a plurality of images of the target subject obtained in the determined follow-up examination times from the medical image storage device 120 (step S12).

For example, when a follow-up examination of a brain tumor is performed, the acquisition function 145a acquires an MR image of the head collected by the MRI apparatus from the medical image storage apparatus 120.

Further, the acquisition function 145a acquires medical information indicating the medical practice performed on the target subject during each of the determined follow-up examination times from the electronic medical record system 130 (step S13).

For example, the acquisition function 145a acquires information indicating a treatment method as medical information. For example, the acquisition function 145a acquires information about a drug administered to a subject as medical information.

Subsequently, the search function 145b derives a change between the images from the plurality of images of the target subject acquired by the acquisition function 145a (step S14).

After that, the search function 145b searches for a plurality of images of the target subject and a plurality of images similar to the medical practice performed between the time when the images were obtained and the changes between the images, and the other subjects. Search for case information related to the sample (step S15).

Specifically, the search function 145b provides case information such as a first image and a first image in which changes between a plurality of images of a target subject and the images and medical actions performed between the time when each image is obtained are similar. The two images and the first image and the third image obtained in time after the second image are searched from the medical image storage device 120. In addition, the search function 145b further serves as case information, and further, first medical information indicating medical actions performed on the other subject between the time when the first image is obtained and the time when the second image is obtained. And the second medical information indicating the medical practice performed on the other subject between the time when the second image is obtained and the time when the third image is obtained are searched from the electronic medical record system 130.

Subsequently, the display control function 145c causes the case information searched by the search function 145b to be displayed on the display 144 (step S16).

The processing functions of the processing circuit 145 of the information processing apparatus 140 according to the present embodiment have been described above. Here, for example, the processing circuit 145 is realized by a processor. In that case, each of the above-mentioned processing functions is stored in the storage circuit 142 in the form of a program that can be executed by a computer. Then, the processing circuit 145 realizes a function corresponding to each program by reading and executing each program stored in the storage circuit 142. In other words, the processing circuit 145 has each processing function shown in FIG. 1 in a state where each program is read out.

For example, the processing of steps S11 to S13 shown in FIG. 2 is realized by the processing circuit 145 reading a program corresponding to the acquisition function 145a from the storage circuit 142 and executing the processing. Further, the processing of steps S14 to S15 is realized by the processing circuit 145 reading a program corresponding to the search function 145b from the storage circuit 142 and executing the processing. Further, the process of step S16 is realized by the processing circuit 145 reading a program corresponding to the display control function 145c from the storage circuit 142 and executing the program.

As described above, according to the present embodiment, an operator such as a doctor can appropriately determine a treatment policy by referring to similar past cases. For example, an operator such as a doctor can make the next treatment policy decision with reference to past cases that have achieved a course similar to the current case.

Therefore, according to this embodiment, it is possible to support an appropriate decision of a medical treatment policy.

Although the embodiment of the information processing apparatus 140 has been described above, the above-described embodiment can be implemented by appropriately changing the method of searching for similar case information, the method of displaying the searched case information, and the like. Therefore, in the following, some application examples relating to the above-described embodiment will be described as examples. In the following examples, the points different from the above-described embodiments will be mainly described, and detailed description of the contents overlapping with the contents already described will be omitted.

(First Example)
First, the first embodiment will be described. In this embodiment, the search function 145b, as the first image and the second image, is similar to a plurality of images of the target subject, changes in image characteristics, and medical practices performed during the time when each image is obtained. Search for multiple images.

FIG. 3 is a flowchart showing a processing procedure of processing performed by the acquisition function 145a, the search function 145b, and the display control function 145c according to the first embodiment.

For example, as shown in FIG. 3, in this embodiment, the acquisition function 145a determines a plurality of target follow-up test times each time the follow-up test of the target subject i is performed. (Step S21).

Here, it is assumed that the acquisition function 145a determines the target follow-up inspection times to be the n-1th time and the nth time. For example, the nth time is the latest follow-up inspection time.

After that, the acquisition function 145a acquires the n-1st and nth images of the subject i from the medical image storage device 120 (step S22). Further, the acquisition function 145a acquires medical information indicating the medical practice performed on the subject i from the n-1st time to the nth time from the electronic medical record system 130 (step S23).

Subsequently, the search function 145b derives a change in image characteristics from the n-1st and nth images of the subject i acquired by the acquisition function 145a (step S24).

For example, the search function 145b derives the image features of the tumor region from each of the n-1st image and the nth image, and derives the amount of change thereof.

After that, the search function 145b searches for a plurality of images similar to the n-1st and nth images of the subject i, changes in image features, and medical practices performed between the time when each image was obtained. Therefore, the case information regarding the subject j is searched (step S25).

Specifically, the search function 145b was performed as case information regarding the subject j between the n-1st and nth images of the subject i, the change in image characteristics, and the time when each image was obtained. The m-1st and mth images and the m + 1st image having similar medical practices are searched from the medical image storage device 120. Further, the search function 145b further, as case information regarding the subject j, further includes the first medical information indicating the medical practice performed on the subject j from the m-1st time to the mth time, and from the mth time. The electronic medical record system 130 searches for the second medical information indicating the medical practice performed on the subject j up to the m + 1st time.

Here, various methods can be used as a method for the search function 145b to determine the similarity of changes in image features.

For example, the search function 145b may use the volume of the tumor as an index value indicating the image feature. In that case, for example, the search function 145b sets the tumor volumes in the n-1th and nth images of the subject i to Vi (n-1) and Vi (n), respectively, and sets the m- of the subject j to m-. When the tumor volumes in the first and mth images are Vj (m-1) and Vj (m), respectively, (Vi (n-1) -Vi (n))-(Vj (m-1)). If the value of −Vj (m)) is equal to or higher than a predetermined threshold value, it is determined that they are not similar, and if it is equal to or lower than the threshold value, it is determined that they are similar. Alternatively, for example, in the search function 145b, the value of Vi (n-1) -Vj (m-1) is equal to or less than a predetermined threshold value, and (Vi (n-1) -Vi (n))-(Vj). If the value of (m-1) −Vj (m)) is equal to or less than a predetermined threshold value, it may be determined that they are similar, and if it is not, it may be determined that they are not similar.

Further, for example, the search function 145b may use the major axis length and the minor axis length of the tumor as index values indicating image features. In that case, for example, the search function 145b sets the major axis lengths of the tumors in the n-1th and nth images of the subject i to Li (n-1) and Li (n), respectively, and sets the minor axis lengths. Let these be lil (n-1) and lil (n), respectively, and let the major axis lengths of the tumors in the m-1st and mth images of the subject j be Lj (m-1) and Lj (m), respectively. , (Li (n) -Li (n-1))-(Lj (m) -Lj (m-1)) when the minor axis lengths are lj (m-1) and lj (m), respectively. If the value of (li (n) -li (n-1))-(lj (m) -lj (m-1)) is equal to or higher than a predetermined threshold value, it is determined that they are not similar. If it is equal to or less than the threshold value, it is judged to be similar. Alternatively, for example, in the search function 145b, the value of Li (n-1) -Lj (m-1) and the value of Li (n) -Lj (m) are each equal to or less than a predetermined threshold value, and further, (Li (n) n) -Li (n-1))-(Lj (m) -Lj (m-1)) values and (li (n) -li (n-1))-(lj (m) -lj (m) If the values of -1)) are equal to or less than a predetermined threshold value, it may be determined that they are similar, and if they are not, it may be determined that they are not similar.

Further, for example, the search function 145b may use the value of the texture obtained by the texture analysis as the index value indicating the image feature. In that case, for example, the search function 145b sets the texture values in the n-1st and nth images of the subject i to ti (n-1) and ti (n), respectively, and sets the m- of the subject j to m-. When the texture values in the first and mth images are tj (m-1) and tj (m), respectively, (ti (n) -ti (n-1))-(tj (m) -tj. If the value of (m-1)) is equal to or less than a predetermined threshold value, it is determined that they are similar, and if it is equal to or more than the threshold value, it is determined that they are not similar. Alternatively, for example, in the search function 145b, the value of ti (n-1) -tj (m-1) is equal to or less than a predetermined threshold value, and (ti (n-1) -ti (n))-(tj). If the value of (m-1) −tj (m)) is equal to or less than a predetermined threshold value, it may be determined that they are similar, and if it is not, it may be determined that they are not similar.

In each of the above-mentioned examples, the difference value may be an absolute value of the difference or a ratio.

Here, for example, the search function 145b may determine the similarity by using only one of the above-mentioned various index values, or may determine the similarity by combining a plurality of index values. At this time, for example, the search function 145b may derive a plurality of index values and then determine the similarity using one index value having the highest importance. Further, for example, when the search function 145b determines the similarity by combining a plurality of index values, the search function 145b may determine the similarity by using an evaluation function using a plurality of predefined index values as parameters. ..

Further, various methods can be used as a method for the search function 145b to determine the similarity of medical practices.

For example, the search function 145b determines that medical practices are similar when the name of the procedure, the name of the drug, the components of the drug, and the like can be regarded as the same or equivalent.

Subsequently, the display control function 145c causes the case information searched by the search function 145b to be displayed on the display 144 (step S26).

Specifically, the display control function 145c provides case information regarding the subject j, such as the m-1st and mth images, the m + 1st image, and the subject j between the m-1st and mth times. The display 144 displays the first medical information indicating the medical treatment performed on the subject j and the second medical information indicating the medical treatment performed on the subject j from the mth time to the m + 1th time. At this time, the display control function 145c may further display the clinical information obtained in the m + 1st examination as the case information regarding the subject j. For example, the display control function 145c displays KPS (Karnofsky Performance Status) as clinical information.

FIG. 4 is a diagram showing an example of case information displayed by the display control function 145c according to the first embodiment.

For example, for the subject i, which is the target subject, the target follow-up examination times are the second and third times, and the third and fourth images of the subject j are searched as similar case information. do.

In that case, for example, as shown in FIG. 4, the display control function 145c was performed between the second image and the third image and the second to third times as case information regarding the subject i. "Treatment A" indicating the treatment method is displayed on the display 144.

Further, the display control function 145c is performed on the subject j between the third image, the fourth image, the fifth image, and the third to the fourth times as case information regarding the subject j. "Treatment A" indicating the treatment method, "Treatment B" indicating the treatment method performed on the subject j between the 4th and 5th times, and "KPS: 10" indicating the 5th KPS. And are displayed.

Here, for example, the processing of steps S21 to S23 shown in FIG. 3 is realized by the processing circuit 145 reading the program corresponding to the acquisition function 145a from the storage circuit 142 and executing the processing. Further, the processing of steps S24 to S25 is realized by the processing circuit 145 reading a program corresponding to the search function 145b from the storage circuit 142 and executing the processing. Further, the process of step S26 is realized by the processing circuit 145 reading a program corresponding to the display control function 145c from the storage circuit 142 and executing the program.

In this embodiment, an example in which the display control function 145c displays the m-1st, mth, and m + 1th information on the display 144 as the case information regarding the subject j has been described. Is not limited to this. For example, the display control function 145c may further display the information after the m + second time and the information before the m-1th time on the display 144.

Further, in this embodiment, an example in which the cases corresponding to the n-1st and nth images of the subject i are the m-1st and mth images of the subject j has been described. , The m-2nd and mth images of the subject j may be obtained. In that case, the medical practice performed on the subject j between the m-2nd and the m-1st times, and the medical treatment performed on the subject j between the m-1st time and the mth time. Each of the medical practices is similar to the medical practices performed on the subject i between the n-1th and nth times. Further, for example, the case corresponding to the n-2nd and nth images of the subject i may be the m-3rd and mth images of the subject j as well.

(Second Example)
Next, a second embodiment will be described. In this embodiment, the search function 145b, as the first image and the second image, is similar to a plurality of images of the target subject, the characteristics of the image change, and the medical treatment performed during the time when each image is obtained. Search for multiple images.

For example, in the first embodiment described above, image features are derived for each image, but in the second embodiment, a process of first performing arithmetic processing between images and then obtaining features from the calculated images. It has become.

FIG. 5 is a flowchart showing a processing procedure of processing performed by the acquisition function 145a, the search function 145b, and the display control function 145c according to the second embodiment.

For example, as shown in FIG. 5, in this embodiment, the acquisition function 145a performs the same processing as the processing of steps S21 to S23 shown in FIG. 3 (steps S31 to S33).

Subsequently, the search function 145b derives the characteristics of the image change from the n-1st and nth images of the subject i acquired by the acquisition function 145a (step S34).

For example, the search function 145b derives the image change of the tumor region from the n-1st image and the nth image by the difference processing, and derives the feature thereof. Here, the difference image obtained by the difference processing is, for example, an image obtained by binary processing (if the difference value is lower than a predetermined threshold value, the pixel value is 0, and if the difference value is higher (= there is a difference), the pixel value is 1. ) May be.

Here, an example in which the search function 145b derives an image change by difference processing will be described, but the method for deriving the image change is not limited to this. For example, the search function 145b may derive an image change by other inter-image arithmetic processing such as multiplication processing and division processing.

Further, the characteristics of the image change (difference image, etc.) derived by the search function 145b are obtained by, for example, the volume, the major axis length, the body axis length, and the texture analysis of the tumor, as in the first embodiment. Texture values and the like are used.

After that, the search function 145b searches for a plurality of images similar to the n-1st and nth images of the subject i, the characteristics of the image change, and the medical practice performed during the time when each image was obtained. Therefore, the case information regarding the subject j is searched (step S35).

Specifically, the search function 145b was performed as case information regarding the subject j between the n-1st and nth images of the subject i, the characteristics of the image change, and the time when each image was obtained. The m-1st and mth images and the m + 1st image having similar medical practices are searched from the medical image storage device 120. Further, the search function 145b further, as case information regarding the subject j, further includes the first medical information indicating the medical practice performed on the subject j from the m-1st time to the mth time, and from the mth time. The electronic medical record system 130 searches for the second medical information indicating the medical practice performed on the subject j up to the m + 1st time.

At this time, for example, the search function 145b refers to the images of other subjects stored in the medical image storage device 120, and for each subject, a plurality of images obtained by the follow-up examination of the subject. Is used to derive the difference image and its features every two consecutive tests. Then, each time the search function 145b derives the characteristics of the difference image, the characteristics of the difference image and the medical practice performed during the two examinations are the n-1th and nth times of the subject i. The characteristics of the difference image derived from the image and whether or not it is similar to the medical practice performed during the n-1st and nth examinations are determined. By sequentially performing these processes using the images of each subject, the search function 145b can be used between the n-1st and nth images of the subject i, the features of the difference image, and the time when each image is obtained. Identify the m-1st and mth images of subject j that are similar to the medical practice performed in.

Subsequently, the display control function 145c causes the display 144 to display the case information searched by the search function 145b in the same manner as the process of step S26 shown in FIG. 3 (step S36).

Here, for example, the processing of steps S31 to S33 shown in FIG. 5 is realized by the processing circuit 145 reading the program corresponding to the acquisition function 145a from the storage circuit 142 and executing the processing. Further, the processing of steps S34 to S35 is realized by the processing circuit 145 reading a program corresponding to the search function 145b from the storage circuit 142 and executing the processing. Further, the process of step S36 is realized by the processing circuit 145 reading a program corresponding to the display control function 145c from the storage circuit 142 and executing the process.

(Third Example)
Next, a third embodiment will be described. In this embodiment, the search function 145b, as the first image and the second image, has a plurality of images of the target subject and a plurality of similar medical actions performed during the time when the image change and each image are obtained. Search for images.

For example, in the second embodiment described above, the feature amount of the difference image is used, but in the third embodiment, the process of obtaining the similarity between the difference images is performed.

FIG. 6 is a flowchart showing a processing procedure of processing performed by the acquisition function 145a, the search function 145b, and the display control function 145c according to the third embodiment.

For example, as shown in FIG. 6, in this embodiment, the acquisition function 145a performs the same processing as the processing of steps S21 to S23 shown in FIG. 3 (steps S41 to S43).

Subsequently, the search function 145b derives an image change from the n-1st and nth images of the subject i acquired by the acquisition function 145a (step S44).

For example, the search function 145b derives the image change of the tumor region from the n-1st image and the nth image by the difference processing, as in the second embodiment. Here, the difference image obtained by the difference processing may be, for example, a binary processed image.

Here, an example in which the search function 145b derives an image change by difference processing will be described, but the method for deriving the image change is not limited to this. For example, the search function 145b may derive an image change by other inter-image arithmetic processing such as multiplication processing and division processing.

After that, the search function 145b searches for a plurality of images similar to the n-1st and nth images of the subject i, the image change, and the medical practice performed between the time when each image was obtained. , Search for case information regarding subject j (step S45).

Specifically, the search function 145b is a medical practice performed between the n-1st and nth images of the subject i, the image change, and the time when each image is obtained as the case information regarding the subject j. The m-1st and mth images and the m + 1st image similar to each other are searched from the medical image storage device 120. Further, the search function 145b further, as case information regarding the subject j, further includes the first medical information indicating the medical practice performed on the subject j from the m-1st time to the mth time, and from the mth time. The electronic medical record system 130 searches for the second medical information indicating the medical practice performed on the subject j up to the m + 1st time.

At this time, for example, the search function 145b refers to the images of other subjects stored in the medical image storage device 120, and for each subject, a plurality of images obtained by the follow-up examination of the subject are displayed. It is used to derive a difference image for every two consecutive tests. Then, each time the search function 145b derives the difference image, the difference image and the medical practice performed during the two examinations are derived from the n-1st and nth images of the subject i. It is determined whether or not the difference image is similar to the medical practice performed during the n-1st and nth examinations. By sequentially performing these processes using the images of each subject, the search function 145b is performed between the n-1st and nth images of the subject i and the difference image and the time when each image is obtained. The m-1st and mth images of the subject j having similar medical practices are identified.

Here, various methods can be used as a method for the search function 145b to determine the similarity of image changes. For example, the search function 145b derives index values such as SSD (Sum of Squared Difference), SAD (Sum of Absolute Difference), and NCC (Normalized Cross Correlation) to obtain similarity of image changes (difference images, etc.). You may judge.

Subsequently, the display control function 145c causes the display 144 to display the case information searched by the search function 145b in the same manner as the process of step S26 shown in FIG. 3 (step S46).

Here, for example, the processing of steps S41 to S43 shown in FIG. 6 is realized by the processing circuit 145 reading the program corresponding to the acquisition function 145a from the storage circuit 142 and executing the processing. Further, the processing of steps S44 to S45 is realized by the processing circuit 145 reading the program corresponding to the search function 145b from the storage circuit 142 and executing the processing. Further, the process of step S46 is realized by the processing circuit 145 reading a program corresponding to the display control function 145c from the storage circuit 142 and executing the program.

(Fourth Example)
Next, a fourth embodiment will be described. In this embodiment, the search function 145b, as the first image and the second image, has a plurality of images of the target subject, image features, and a plurality of medical practices similar to those performed during the time when each image was obtained. Search for images.

For example, in the second embodiment described above, case information having similar image change characteristics is searched, but in the fourth example, case information having similar image characteristics in each follow-up examination is searched. It is a process.

FIG. 7 is a flowchart showing a processing procedure of processing performed by the acquisition function 145a, the search function 145b, and the display control function 145c according to the fourth embodiment.

For example, as shown in FIG. 7, in this embodiment, the acquisition function 145a performs the same processing as the processing of steps S21 to S23 shown in FIG. 3 (steps S51 to S53).

Subsequently, the search function 145b derives image features from the n-1st and nth images of the subject i acquired by the acquisition function 145a (step S54).

Here, as the image features derived by the search function 145b, for example, the volume of the tumor, the length of the major axis, the length of the body axis, the value of the texture obtained by the texture analysis, and the like are used as in the first embodiment. Be done.

After that, the search function 145b searches for a plurality of images similar to the n-1st and nth images of the subject i, the image features, and the medical practice performed during the time when each image was obtained. , Search for case information regarding subject j (step S55).

Specifically, the search function 145b is a medical practice performed between the n-1st and nth images of the subject i, image features, and the time when each image is obtained as case information regarding the subject j. The m-1st and mth images and the m + 1st image similar to each other are searched from the medical image storage device 120. Further, the search function 145b further, as case information regarding the subject j, further includes the first medical information indicating the medical practice performed on the subject j from the m-1st time to the mth time, and from the mth time. The electronic medical record system 130 searches for the second medical information indicating the medical practice performed on the subject j up to the m + 1st time.

Subsequently, the display control function 145c causes the display 144 to display the case information searched by the search function 145b in the same manner as the process of step S26 shown in FIG. 3 (step S56).

Here, for example, the processing of steps S51 to S53 shown in FIG. 7 is realized by the processing circuit 145 reading the program corresponding to the acquisition function 145a from the storage circuit 142 and executing the processing. Further, the processing of steps S54 to S55 is realized by the processing circuit 145 reading a program corresponding to the search function 145b from the storage circuit 142 and executing the processing. Further, the process of step S56 is realized by the processing circuit 145 reading a program corresponding to the display control function 145c from the storage circuit 142 and executing the program.

(Fifth Example)
Next, a fifth embodiment will be described. In this embodiment, the search function 145b, as the first image and the second image, has a plurality of images of the target subject and a plurality of similar medical actions performed during the time when the images themselves and each image are obtained. Search for images.

For example, in the third embodiment described above, similar case information is searched by the similarity of the difference images, but in the fifth example, case information in which the images of each follow-up examination times are similar is searched. It is a process to do.

FIG. 8 is a flowchart showing a processing procedure of processing performed by the acquisition function 145a, the search function 145b, and the display control function 145c according to the fifth embodiment.

For example, as shown in FIG. 8, in this embodiment, the acquisition function 145a performs the same processing as the processing of steps S21 to S23 shown in FIG. 3 (steps S61 to S63).

Subsequently, the search function 145b is similar to the n-1st and nth images of the subject i acquired by the acquisition function 145a and the medical practice performed between the images themselves and the time when each image was obtained. By searching a plurality of images, case information regarding the subject j is searched (step S64).

Specifically, the search function 145b is a medical practice performed between the n-1st and nth images of the subject i, the image itself, and the time when each image is obtained as case information regarding the subject j. The m-1st and mth images and the m + 1st image similar to each other are searched from the medical image storage device 120. Further, the search function 145b further, as case information regarding the subject j, further includes the first medical information indicating the medical practice performed on the subject j from the m-1st time to the mth time, and from the mth time. The electronic medical record system 130 searches for the second medical information indicating the medical practice performed on the subject j up to the m + 1st time.

Here, various methods can be used as a method for the search function 145b to determine the similarity of images. For example, the search function 145b may determine the similarity of images by deriving index values such as SSD, SAD, and NCC, as in the third embodiment.

Subsequently, the display control function 145c causes the display 144 to display the case information searched by the search function 145b in the same manner as the process of step S26 shown in FIG. 3 (step S65).

Here, for example, the processing of steps S61 to S63 shown in FIG. 8 is realized by the processing circuit 145 reading the program corresponding to the acquisition function 145a from the storage circuit 142 and executing the processing. Further, the process of step S64 is realized by the processing circuit 145 reading a program corresponding to the search function 145b from the storage circuit 142 and executing the program. Further, the process of step S65 is realized by the processing circuit 145 reading a program corresponding to the display control function 145c from the storage circuit 142 and executing the program.

(Sixth Example)
Next, a sixth embodiment will be described. In this embodiment, the search function 145b uses the search function 145b as the first image and the second image during a plurality of images of the target subject, changes in image characteristics, time intervals at which the images are obtained, and the time when each image is obtained. Search for multiple images with similar medical practices performed.

For example, in the first embodiment described above, similar case information is searched for on the condition of the n-1th time and the nth time, but in the sixth example, the period from the n-1st time to the nth time is further extended. In addition to the conditions, it is a process of searching for similar case information.

FIG. 9 is a flowchart showing a processing procedure of processing performed by the acquisition function 145a, the search function 145b, and the display control function 145c according to the sixth embodiment.

For example, as shown in FIG. 9, in this embodiment, the acquisition function 145a performs the same processing as the processing of steps S21 to S23 shown in FIG. 3 (steps S71 to S73).

Subsequently, the search function 145b specifies the time interval from the n-1st follow-up test to the nth follow-up test of the subject i (step S74).

After that, the search function 145b derives a change in image characteristics from the n-1st and nth images of the subject i acquired by the acquisition function 145a (step S75).

For example, the search function 145b derives a change in image features, as in the first embodiment.

After that, the search function 145b is used to perform medical actions performed during the n-1st and nth images of the subject i, changes in image features, time intervals at which the images were obtained, and the time when each image was obtained. By searching for a plurality of similar images, case information regarding the subject j is searched (step S76).

Specifically, the search function 145b obtains the n-1st and nth images of the subject i, changes in image features, time intervals at which the images were obtained, and each image as case information regarding the subject j. The m-1st and mth images and the m + 1st images having similar medical practices performed during the above time points are searched from the medical image storage device 120. Further, the search function 145b further, as case information regarding the subject j, further includes the first medical information indicating the medical practice performed on the subject j from the m-1st time to the mth time, and from the mth time. The electronic medical record system 130 searches for the second medical information indicating the medical practice performed on the subject j up to the m + 1st time.

For example, the search function 145b determines the similarity of changes in image features, as in the first embodiment.

Subsequently, the display control function 145c causes the display 144 to display the case information searched by the search function 145b in the same manner as the process of step S26 shown in FIG. 3 (step S77).

Here, for example, the processing of steps S71 to S73 shown in FIG. 9 is realized by the processing circuit 145 reading the program corresponding to the acquisition function 145a from the storage circuit 142 and executing the processing. Further, the processing of steps S74 to S76 is realized by the processing circuit 145 reading the program corresponding to the search function 145b from the storage circuit 142 and executing the processing. Further, the process of step S77 is realized by the processing circuit 145 reading a program corresponding to the display control function 145c from the storage circuit 142 and executing the program.

According to this embodiment, by further adding the time interval in which the images are obtained to the search conditions, it becomes possible to search for cases with higher similarity.

(7th Example)
Next, a seventh embodiment will be described. In this embodiment, the search function 145b, as the first image and the second image, is a medical practice performed during the time when a plurality of images of the target subject, a tendency of change in image characteristics, and each image are obtained. Search for similar images.

For example, in the above-mentioned first example, the target follow-up test times are n-1 and nth, but in the seventh example, similar cases are obtained for three or more follow-up test times. It is a process of searching for information.

FIG. 10 is a flowchart showing a processing procedure of processing performed by the acquisition function 145a, the search function 145b, and the display control function 145c according to the seventh embodiment.

For example, as shown in FIG. 10, in this embodiment, the acquisition function 145a determines a plurality of target follow-up test times each time the follow-up test of the target subject i is performed. (Step S81).

Here, the acquisition function 145a targets a plurality of follow-up inspection times for the np, np + 1, ..., N-1st and nth times (hereinafter referred to as np to nth times). Suppose that it is decided as. For example, the nth time is the latest follow-up inspection time.

After that, the acquisition function 145a acquires the np to nth images of the subject i from the medical image storage device 120 (step S82). Further, the acquisition function 145a acquires medical information indicating the medical practice performed on the subject i from the nth time to the nth time from the electronic medical record system 130 (step S83).

Subsequently, the search function 145b derives the tendency of the change in the image feature from the np to nth images of the subject i acquired by the acquisition function 145a (step S84).

For example, the search function 145b derives the image features of the tumor region from each of the np to nth images, and derives the tendency of the amount of change in the derived image features.

FIG. 11 is a diagram for explaining the derivation of the tendency of the change in the image feature performed by the search function 145b according to the seventh embodiment.

For example, as shown in FIG. 11, in the search function 145b, the number of follow-up inspections is x (horizontal axis shown in FIG. 11), the value indicating the image feature is y (vertical axis shown in FIG. 11), and y = f ( By finding the function of x), the tendency of change in image features is derived.

After that, the search function 145b displays a plurality of images similar to the n-1st and nth images of the subject i, the tendency of the change in image characteristics, and the medical treatment performed during the time when each image was obtained. By searching, the case information regarding the subject j is searched (step S85).

Specifically, the search function 145b is performed as case information regarding the subject j between the n-1st and nth images of the subject i, the tendency of change in image characteristics, and the time when each image is obtained. The m-1st and mth images and the m + 1st image having similar medical practices are searched from the medical image storage device 120. Further, the search function 145b further, as case information regarding the subject j, further includes the first medical information indicating the medical practice performed on the subject j from the m-1st time to the mth time, and from the mth time. The electronic medical record system 130 searches for the second medical information indicating the medical practice performed on the subject j up to the m + 1st time.

At this time, the search function 145b determines that the medical practice is similar even if the medical practice changes between the n-p + 1 and the nth times, if the medical practice also changes. (For example, see the ninth embodiment and the tenth embodiment described later).

Subsequently, the display control function 145c causes the display 144 to display the case information searched by the search function 145b in the same manner as the process of step S26 shown in FIG. 3 (step S86).

Here, for example, the processing of steps S81 to S83 shown in FIG. 10 is realized by the processing circuit 145 reading the program corresponding to the acquisition function 145a from the storage circuit 142 and executing the processing. Further, the processing of steps S84 to S85 is realized by the processing circuit 145 reading a program corresponding to the search function 145b from the storage circuit 142 and executing the processing. Further, the processing of step S86 is realized by the processing circuit 145 reading a program corresponding to the display control function 145c from the storage circuit 142 and executing the processing.

(8th Example)
Next, the eighth embodiment will be described. The eighth embodiment is a modification of the seventh embodiment. In this embodiment, the search function 145b searches for case information having a similar tendency of change in image features, as in the seventh embodiment, but as a tendency of changes in image features, the time interval at which images are obtained is used. Use the corrected tendency based on.

FIG. 12 is a diagram for explaining the correction of the tendency of the change in the image feature performed by the search function 145b according to the eighth embodiment.

Here, FIG. 12 shows an example when the tendency of the change of the image feature shown in FIG. 11 is corrected.

For example, as shown in FIG. 12, in the search function 145b, the date and time of the follow-up inspection is t (horizontal axis shown in FIG. 12), the value indicating the image feature is y (vertical axis shown in FIG. 12), and FIG. 11 shows. By finding the function of y = f (t) instead of the function of y = f (x) as shown, the tendency of the change of the image feature is derived.

(9th Example)
Next, a ninth embodiment will be described. The ninth embodiment is a modification of the eighth embodiment. In this embodiment, as in the eighth embodiment, the search function 145b uses the tendency of the image feature to be corrected based on the time interval in which the image is obtained.

Then, for example, as a first example, the search function 145b may be used in the case where the medical treatment performed in each of the plurality of sections divided at the plurality of time points in which the image of the target subject is obtained is different. As the second image, a plurality of images having similar trends in changes in image features and medical practices in each of the plurality of sections are searched.

FIG. 13 is a flowchart showing a processing procedure of processing performed by the acquisition function 145a, the search function 145b, and the display control function 145c according to the first example of the ninth embodiment.

For example, as shown in FIG. 13, in this example, the acquisition function 145a performs the same processing as the processing of steps S81 to S83 shown in FIG. 10 (steps S91 to S93).

Subsequently, the search function 145b derives a tendency of change in image characteristics from the np to nth images of the subject i acquired by the acquisition function 145a for each of a plurality of sections having different medical practices (step). S94).

For example, the search function 145b derives the image features of the tumor region from a plurality of images obtained in each section for each section in which the medical practice is the same, and derives the tendency of the amount of change in the derived image features.

After that, the search function 145b searches for case information regarding the subject j by searching for a plurality of images having similar trends in changes in image features and medical practices in each of the plurality of sections (step S95).

Specifically, the search function 145b provides case information regarding the subject j with the m-1st and mth images and the m + 1th image in which the tendency of change in image characteristics and medical practice are similar in each of the plurality of sections. The image is searched from the medical image storage device 120. Further, the search function 145b further, as case information regarding the subject j, further includes the first medical information indicating the medical practice performed on the subject j from the m-1st time to the mth time, and from the mth time. The electronic medical record system 130 searches for the second medical information indicating the medical practice performed on the subject j up to the m + 1st time.

Subsequently, the display control function 145c causes the display 144 to display the case information searched by the search function 145b in the same manner as the process of step S26 shown in FIG. 3 (step S96).

Here, for example, the processing of steps S91 to S93 shown in FIG. 13 is realized by the processing circuit 145 reading the program corresponding to the acquisition function 145a from the storage circuit 142 and executing the processing. Further, the processing of steps S94 to S95 is realized by the processing circuit 145 reading a program corresponding to the search function 145b from the storage circuit 142 and executing the processing. Further, the process of step S96 is realized by the processing circuit 145 reading a program corresponding to the display control function 145c from the storage circuit 142 and executing the program.

Further, for example, as a second example, the search function 145b may be used for the first image and when the medical treatment performed in each of the plurality of sections divided at the plurality of time points when the image of the target subject is obtained is different. As the second image, a plurality of images in which the tendency of the change in image characteristics is similar in the entire section including the plurality of sections and the medical practice is similar in each of the plurality of sections may be searched.

FIG. 14 is a flowchart showing a processing procedure of processing performed by the acquisition function 145a, the search function 145b, and the display control function 145c according to the second example of the ninth embodiment.

For example, as shown in FIG. 14, in this example, the acquisition function 145a performs the same processing as the processing of steps S81 to S83 shown in FIG. 10 (steps S101 to S103).

Subsequently, the search function 145b, as in the first example, has image features for each of the plurality of sections having different medical practices from the np to nth images of the subject i acquired by the acquisition function 145a. Derivation of the trend of change (step S104).

After that, the search function 145b searches for a plurality of images in which the tendency of the change in the image feature is similar in the entire section including the plurality of sections and the medical practice is similar in each of the plurality of sections. The case information regarding the sample j is searched (step S105).

Specifically, the search function 145b has similar tendency of change in image features in the entire section including the plurality of sections as case information regarding the subject j, and similar medical practices in each of the plurality of sections. The m-1st and mth images and the m + 1st image are searched from the medical image storage device 120. Further, the search function 145b further, as case information regarding the subject j, further includes the first medical information indicating the medical practice performed on the subject j from the m-1st time to the mth time, and from the mth time. The electronic medical record system 130 searches for the second medical information indicating the medical practice performed on the subject j up to the m + 1st time.

Subsequently, the display control function 145c causes the display 144 to display the case information searched by the search function 145b in the same manner as the process of step S26 shown in FIG. 3 (step S106).

Here, for example, the processing of steps S101 to S103 shown in FIG. 14 is realized by the processing circuit 145 reading the program corresponding to the acquisition function 145a from the storage circuit 142 and executing the processing. Further, the processing of steps S104 to S105 is realized by the processing circuit 145 reading a program corresponding to the search function 145b from the storage circuit 142 and executing the processing. Further, the process of step S106 is realized by the processing circuit 145 reading a program corresponding to the display control function 145c from the storage circuit 142 and executing the process.

For example, in this embodiment, when the search function 145b has three or more follow-up test times determined as a target and the drugs used are different in the two sections separated at those time points, as follows. Search for similar case information.

FIG. 15 is a diagram for explaining a case search performed by the search function 145b according to the ninth embodiment.

For example, as shown on the left side of FIG. 15, follow-up tests have been performed 11 times (t1 to t11), of which drug A was used between the first and third times (t1 to t3), 4 It is assumed that the drug B was used from the 6th time to the 6th time (t4 to t6), and the drug C was used from the 7th time to the 11th time (t7 to t11).

In that case, for example, the search function 145b divides the period from the first time to the eleventh time into three sections for each drug used, and derives image features in each section.

Then, for example, in the first example, as shown in FIG. 15A, the search function 145b searches for image features and drugs in each section, and case information in which the image features and drugs are similar in all sections. To search for. At this time, for example, when the drug D is used between the drug A and the drug B, the search function 145b ignores the section of the drug D, and the drug A, the drug B, and the drug C are used. The similarity is judged only in the section.

Further, for example, in the second example, the search function 145b analyzes the tendency in all the sections, searches for case information having a similar tendency, and further, as shown in FIG. 15 (b). Search for case information in which the same drug was used.

(10th Example)
Next, a tenth embodiment will be described. The tenth embodiment is a modification common to each of the above-described embodiments. In this embodiment, the display control function 145c provides information indicating the time interval from the time when the first image is obtained to the time when the second image is obtained, and the third image from the time when the second image is obtained. Information indicating the time interval up to the time when is obtained is further displayed on the display 144.

FIG. 16 is a diagram showing an example of case information displayed by the display control function 145c according to the tenth embodiment.

For example, as in the example shown in FIG. 4, the target follow-up test times are the second and third times for the target subject i, and as similar case information, the subject j 3 It is assumed that the images of the 4th time and the 4th time are searched.

In that case, for example, as shown in FIG. 16, the display control function 145c indicates, in addition to the information shown in FIG. 4, the time interval from the second to the third time as case information regarding the subject i "2". "Month" is displayed further.

Further, the display control function 145c has "2 months" indicating the time interval from the 3rd to the 4th time and "3 months" indicating the time interval from the 4th to the 5th time as the case information regarding the subject j. Is displayed further.

According to this embodiment, the treatment period can also be considered by further displaying the time interval (follow-up period) at which the image was obtained.

(11th Example)
Next, the eleventh embodiment will be described. The eleventh embodiment is a modification common to each of the above-described embodiments. In this embodiment, the search function 145b, as the first image and the second image, has a plurality of similar medical actions performed between the plurality of images and the change of the region of interest between the images and the time when each image is obtained. Search for images in.

For example, the search function 145b segments tumor regions from images of one protocol of interest and searches for similar images.

Alternatively, for example, when the search function 145b includes a plurality of slice images in the target protocol, the representative slice image among the plurality of slice images (for example, the 15th slice image of the contrast T1W). Tumor areas may be segmented from to search for similar images.

Alternatively, for example, the search function 145b segments the tumor region from a specific slab (eg, the 15th to 20th slice images of contrast T1W) when the protocol of interest contains multiple slice images. You may search for similar images.

Alternatively, for example, the search function 145b may segment the tumor region from all slice images (eg, all slice images of contrast-enhanced T1W) when the target protocol contains a plurality of slice images. You may search for similar images.

Alternatively, for example, the search function 145b searches for similar images by dividing the tumor region (for example, dividing it into a contrast area and a necrotic area) from the image of the target protocol and segmenting it in each of the above-mentioned examples. You may.

Alternatively, for example, the search function 145b may search for similar images by using images of a plurality of protocols (for example, contrast medium T1W, FLAIR (Fluid Attenuated Inversion Recovery), etc.) and combining the above-mentioned examples. ..

In this case, for example, the search function 145b analyzes each image individually and searches for similar images. For example, when it is desired to search for cases in which the changes in the contrast area, the necrotic area, and the high-intensity area of the FLAIR are similar, the search function 145b has similar changes in the image features of the contrast area of the contrast T1W and the contrast T1W. Search for cases with similar necrotic regions and similar changes in the high-intensity region of FLAIR.

In addition, for example, when searching for a case in which the images themselves are similar as in the fifth embodiment, the search function 145b derives the similarity with respect to the entire image without segmenting the tumor region. May be good.

(Other Examples)
Next, as another embodiment, various modifications relating to each of the above-described embodiments will be described.

For example, in each of the above-mentioned examples, the display control function 145c is determined to display the m + 1st information as the case information regarding the subject j (see FIGS. 4 and 16), but the examples are limited to this. I can't. For example, the display control function 145c may display all the information after the m + 1th time as the case information regarding the subject j.

Further, in each of the above-described examples, the display control function 145c is determined to display the case information regarding the subject j, but the examples are not limited to this. For example, in each of the above-mentioned examples, the search function 145b may search for case information regarding a plurality of subjects as similar cases. In that case, for example, the display control function 145c may display all the searched case information, display a list of the searched case information, and select from the list by the operator. Case information may be displayed.

Here, for example, when displaying the list of case information, the display control function 145c may sort and rearrange the case information according to a predetermined priority. At this time, for example, the higher the similarity of the images, the higher the priority may be, or the higher the similarity of the time interval in which the images are obtained, the higher the priority may be.

Further, in each of the above-described examples, the display control function 145c is determined to display images, time intervals at which images are obtained, clinical information, etc. as similar case information, but the examples are not limited to this. .. For example, the display control function 145c may further display information indicating blood pressure, information on the discontinuation of drugs other than therapeutic drugs (drugs that suppress side effects, drugs that regulate blood pressure, drugs for diabetes, etc.).

Further, for example, the display control function 145c further obtains index values (tumor volume, major axis length and body axis length, texture values obtained by texture analysis, etc.) indicating image features derived by the search function 145b. It may be displayed. At this time, for example, when a plurality of index values are derived by the search function 145b, all of the plurality of index values may be displayed, or the index value having the highest importance among the plurality of index values may be displayed. You may.

Further, in each of the above-described embodiments, the acquisition function 145a acquires and retrieves an image from the medical image storage device 120, but the embodiment is not limited to this. For example, the acquisition function 145a may acquire and search for an image from the medical image diagnosis device 110.

Further, in the above-described embodiment, when the follow-up examination of the brain tumor is performed, the acquisition function 145a is determined to acquire the MR image of the head collected by the MRI apparatus, but the embodiment is limited to this. do not have. For example, when a follow-up examination such as a bone fracture is performed, the acquisition function 145a may acquire a CT image collected by an X-ray CT apparatus. In that case, the search function 145b derives an image change of the bone region by generating a difference image of the CT image of the bone obtained at a plurality of time points. As described above, the information processing apparatus 140 according to the above-described embodiment can be used not only in the medical treatment of brain tumors and bones, but also in the medical treatment of various other parts.

Further, the configuration of the information processing device 140 described in the above-described embodiment can be applied to the console device of the medical image diagnostic device 110 and the medical image storage device 120. In that case, the same functions as the above-mentioned acquisition function 145a, search function 145b, and display control function 145c are added to the processing circuit included in the console device of the medical image diagnostic device 110 and the processing circuit included in the medical image storage device 120. Will be implemented.

Further, in each of the above-described embodiments, an example is described in which the acquisition unit, the search unit, and the display control unit in the present specification are realized by the acquisition function 145a, the search function 145b, and the display control function 145c of the processing circuit 145, respectively. However, the embodiment is not limited to this. For example, the acquisition unit, the search unit, and the display control unit in the present specification are realized by the acquisition function 145a, the search function 145b, and the display control function 145c described in the embodiment, as well as hardware only, software only, or display control unit. The same function may be realized by mixing hardware and software.

Further, in each of the above-described embodiments, the processing circuit 145 is realized by a single processor, but the embodiment is not limited to this. For example, the processing circuit 145 may be configured by combining a plurality of independent processors, and each processor may realize each processing function by executing a program. Further, each processing function of the processing circuit 145 may be appropriately distributed or integrated into a single processing circuit or a plurality of processing circuits. Further, each processing function of the processing circuit 145 may be realized by mixing hardware such as a circuit and software. Further, here, an example in which a program corresponding to each processing function is stored in a single storage circuit 142 has been described, but the embodiment is not limited to this. For example, a program corresponding to each processing function may be stored in a distributed manner in a plurality of storage circuits, and the processing circuit 145 may read each program from each storage circuit and execute the program.

Further, in the above description, an example in which the "processor" reads a program corresponding to each processing function from the storage circuit and executes the program has been described, but the embodiment is not limited to this. The word "processor" is used, for example, a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), an application specific integrated circuit (ASIC), and a programmable logic device (for example, a simple programmable logic device (Simple Programmable)). It means a circuit such as a Logic Device (SPLD), a complex programmable logic device (CPLD), and a field programmable gate array (FPGA). When the processor is, for example, a CPU, the processor realizes each processing function by reading and executing a program stored in a storage circuit. On the other hand, when the processor is an ASIC, the processing function is directly incorporated as a logic circuit in the circuit of the processor instead of storing the program in the storage circuit. In addition, each processor of the present embodiment is a single processor for each processor. Not limited to the case of being configured as a circuit, a plurality of independent circuits may be combined to be configured as one processor to realize the processing function. Further, a plurality of components in FIG. 1 may be integrated into one processor to realize the processing function.

Here, the program executed by the processor is provided by being incorporated in a ROM (Read Only Memory), a storage circuit, or the like in advance. This program is a file in a format that can be installed or executed on these devices, such as CD (Compact Disk) -ROM, FD (Flexible Disk), CD-R (Recordable), DVD (Digital Versatile Disk), etc. It may be recorded and provided on a non-transient storage medium that can be read by a computer. Further, this program may be stored on a computer connected to a network such as the Internet, and may be provided or distributed by being downloaded via the network. For example, this program is composed of modules including each of the above-mentioned processing functions. As actual hardware, the CPU reads a program from a storage medium such as a ROM and executes the program, so that each module is loaded on the main storage device and generated on the main storage device.

Further, in the above-described embodiment, each component of each of the illustrated devices is a functional concept, and does not necessarily have to be physically configured as shown in the figure. That is, the specific form of distribution or integration of each device is not limited to the one shown in the figure, and all or part of them may be functionally or physically dispersed or physically distributed in arbitrary units according to various loads and usage conditions. Can be integrated and configured. Further, each processing function performed by each device may be realized by a CPU and a program analyzed and executed by the CPU, or may be realized as hardware by wired logic.

Further, among the processes described in the above-described embodiment, all or part of the processes described as being automatically performed can be manually performed, or the processes described as being manually performed. It is also possible to automatically perform all or part of the above by a known method. In addition, the processing procedure, control procedure, specific name, and information including various data and parameters shown in the above document and drawings can be arbitrarily changed unless otherwise specified.

The various data handled in this specification are typically digital data.

According to at least one embodiment described above, it is possible to support appropriate determination of medical treatment policy.

Although some embodiments have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These embodiments can be implemented in various other embodiments, and various omissions, replacements, changes, and combinations of embodiments can be made without departing from the gist of the invention. These embodiments and variations thereof are included in the scope of the invention described in the claims and the equivalent scope thereof, as are included in the scope and gist of the invention.

140 Information processing device 145 Processing circuit 145a Acquisition function 145b Search function 145c Display control function

Claims (10)

An acquisition unit that acquires a plurality of images of the first subject obtained at a plurality of different time points, and medical information indicating the medical treatment performed on the first subject during the plurality of time points.
A search unit for searching case information regarding the second subject using the plurality of images and the medical information, and a search unit.
It is equipped with a display control unit that displays the case information on the display unit.
The search unit uses the case information as the case information.
The first image and the second image corresponding to the two images included in the plurality of images, respectively,
The first image and the third image obtained in time after the second image,
The first medical information indicating the medical treatment performed on the second subject between the time when the first image is obtained and the time when the second image is obtained, and
Search for the second medical information indicating the medical practice performed on the second subject between the time when the second image is obtained and the time when the third image is obtained.
Information processing equipment. The acquisition unit acquires information about the drug administered to the subject as the medical information.
The information processing apparatus according to claim 1. As the first image and the second image, the search unit searches for a plurality of images similar to the changes between the plurality of images and the images and the medical practices performed between the time when each image was obtained. ,
The information processing apparatus according to claim 1 or 2. As the first image and the second image, the search unit searches for a plurality of images having similar image features and medical practices to the plurality of images.
The information processing apparatus according to claim 3. As the first image and the second image, the search unit searches for a plurality of images having similar image change features and medical practices to the plurality of images.
The information processing apparatus according to claim 3. As the first image and the second image, the search unit searches for a plurality of images having similar image changes and medical practices to the plurality of images.
The information processing apparatus according to claim 3. As the first image and the second image, the search unit searches for a plurality of images having similar image features and medical practices to the plurality of images.
The information processing apparatus according to claim 3. The search unit searches for the plurality of images, the images themselves, and a plurality of images similar to the medical practice as the first image and the second image.
The information processing apparatus according to claim 3. As the first image and the second image, the search unit searches for a plurality of images similar to the plurality of images, changes in image features, time intervals at which the images were obtained, and the medical practice.
The information processing apparatus according to claim 3. As the first image and the second image, the search unit searches for a plurality of images having the same tendency of change in image features and the medical practice as the plurality of images.
The information processing apparatus according to claim 3.

Images