WO2019198627A1 - 画像処理装置、画像処理装置の制御方法、及びプログラム - Google Patents

画像処理装置、画像処理装置の制御方法、及びプログラム Download PDF

Info

Publication number
WO2019198627A1
WO2019198627A1 PCT/JP2019/015074 JP2019015074W WO2019198627A1 WO 2019198627 A1 WO2019198627 A1 WO 2019198627A1 JP 2019015074 W JP2019015074 W JP 2019015074W WO 2019198627 A1 WO2019198627 A1 WO 2019198627A1
Authority
WO
WIPO (PCT)
Prior art keywords
image processing
image
examinations
examination
inspection
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2019/015074
Other languages
English (en)
French (fr)
Japanese (ja)
Inventor
格 音丸
俊瑞 山根
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Canon Inc
Original Assignee
Canon Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Canon Inc filed Critical Canon Inc
Publication of WO2019198627A1 publication Critical patent/WO2019198627A1/ja
Priority to US17/061,030 priority Critical patent/US11557039B2/en
Anticipated expiration legal-status Critical
Priority to US18/060,478 priority patent/US12094120B2/en
Priority to US18/809,184 priority patent/US20240412372A1/en
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/0002—Inspection of images, e.g. flaw detection
    • G06T7/0012—Biomedical image inspection
    • G06T7/0014—Biomedical image inspection using an image reference approach
    • G06T7/0016—Biomedical image inspection using an image reference approach involving temporal comparison
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/14—Display of multiple viewports
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/74—Details of notification to user or communication with user or patient; User input means
    • A61B5/742—Details of notification to user or communication with user or patient; User input means using visual displays
    • A61B5/7425—Displaying combinations of multiple images regardless of image source, e.g. displaying a reference anatomical image with a live image
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
    • A61B6/02—Arrangements for diagnosis sequentially in different planes; Stereoscopic radiation diagnosis
    • A61B6/03—Computed tomography [CT]
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H30/00—ICT specially adapted for the handling or processing of medical images
    • G16H30/20—ICT specially adapted for the handling or processing of medical images for handling medical images, e.g. DICOM, HL7 or PACS
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H30/00—ICT specially adapted for the handling or processing of medical images
    • G16H30/40—ICT specially adapted for the handling or processing of medical images for processing medical images, e.g. editing
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H40/00—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices
    • G16H40/60—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H50/00—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
    • G16H50/20—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for computer-aided diagnosis, e.g. based on medical expert systems
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10072—Tomographic images
    • G06T2207/10081—Computed x-ray tomography [CT]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10072—Tomographic images
    • G06T2207/10088—Magnetic resonance imaging [MRI]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10072—Tomographic images
    • G06T2207/10101—Optical tomography; Optical coherence tomography [OCT]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10072—Tomographic images
    • G06T2207/10104—Positron emission tomography [PET]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10072—Tomographic images
    • G06T2207/10108—Single photon emission computed tomography [SPECT]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10132—Ultrasound image
    • G06T2207/10136—3D ultrasound image
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30004—Biomedical image processing
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2370/00—Aspects of data communication
    • G09G2370/02—Networking aspects
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2380/00—Specific applications
    • G09G2380/08—Biomedical applications

Definitions

  • the present invention relates to an image processing apparatus, a control method for the image processing apparatus, and a program.
  • Non-Patent Document 1 discloses a technique for deforming and aligning two images (a set of images). By performing the deformation position alignment, it is possible to generate a difference image that emphasizes the change in properties between the two images.
  • Patent Document 1 discloses a technique for searching for past images of the same patient using the patient ID of the currently selected image as a key.
  • the image processing apparatus has the following configuration. That is, the image processing apparatus includes a selection unit that selects one or a plurality of examinations to which the medical image belongs, a determination unit that determines an examination of an image processing candidate based on the selected one or a plurality of examinations, and the determination An image for executing image processing using a display control unit that displays a medical image belonging to the examination of the image processing candidate that has been displayed on the display unit, and a plurality of medical images selected by the user from among the displayed medical images Processing means, and when the one examination is selected, the determination means is one or more obtained by a search based on the selected examination and the selected examination. Inspection is determined as the inspection of the image processing candidate, and when a plurality of inspections are selected, the plurality of selected inspections are determined as inspections of the image processing candidate.
  • the image processing apparatus changes the image selection screen according to the number of examinations selected by the operator (user).
  • the image processing apparatus searches the data server, acquires examinations that are candidates for image processing (hereinafter, examinations of candidate processes), and displays them on the image selection screen. To reflect.
  • the number of examinations selected by the operator is two or more, the search is not performed, and the information of the selected examination group is reflected on the image selection screen as it is as the examination of the process candidate.
  • the operator uses the image selection screen to select two images to be processed from the images belonging to the processing candidate examination. Then, the image processing apparatus performs predetermined image processing using the two images narrowed down as input.
  • a case where a three-dimensional X-ray CT image is targeted will be described as an example, but the application range of the present invention is not limited to a three-dimensional X-ray CT image.
  • a two-dimensional image such as a simple X-ray image or an ultrasound (US) image may be used.
  • US ultrasound
  • the two images used for image processing one is a two-dimensional image and the other is a three-dimensional image. It may be.
  • the three-dimensional image is not limited to the X-ray CT image, and any image such as an MRI image, a three-dimensional US image, an optical ultrasonic tomography image, a PET / SPECT image, or an OCT image may be used.
  • FIG. 1 shows an example of the hardware configuration of the image processing apparatus 100 according to the present embodiment. Note that the hardware configuration of the image processing apparatus 100 illustrated in FIG. 1 is merely an example, and is not limited thereto.
  • the image processing apparatus 100 includes a control unit 101, a ROM (Read Only Memory) 102, a RAM (Random Access Memory) 103, a storage unit 104, a communication interface (communication IF) 105, and a display control unit 106. These hardware are connected to the system bus. In addition, an operation unit 110 and a display unit 120 are connected to the image processing apparatus 100. Any hardware may be provided at least one.
  • the image processing apparatus 100 is connected to the data server 200 via the communication IF 105.
  • the control unit 101 is a processor such as a CPU (Central Processing Unit), for example, and comprehensively controls each hardware connected to the system bus.
  • the ROM 102 is configured by a nonvolatile memory or the like, and stores various programs.
  • the RAM 103 is configured by a volatile memory or the like, and is hardware that temporarily stores various information as data as the main memory, work area, and the like of the control unit 101.
  • the storage unit 104 is a storage device such as an HDD (Hard Disk Drive) or an SSD (Solid State Drive).
  • the communication IF 105 is, for example, a LAN (Local Area Network) card or the like, and realizes communication between an external device (for example, a data server) and the image processing apparatus 100 via a network.
  • LAN Local Area Network
  • the display control unit 106 is a control unit that displays various types of information on the display unit 120.
  • the display control unit 106 corresponds to, for example, a graphic controller (GPU or the like). Note that the display control unit 106 may not be provided, and the control unit 101 may have the function of the display control unit 106.
  • the operation unit 110 includes a keyboard, a mouse, a touch panel, and the like, and is a device for inputting an instruction from the operator to the image processing apparatus 100.
  • the display unit 120 is a display device (for example, a liquid crystal display) for displaying various information instructed by the display control unit 106.
  • the case where the data server 200 is an apparatus different from the image processing apparatus 100 is described as an example. However, even though a partial area in the storage unit 104 is allocated, the data server 200 can be regarded as a data server. Good.
  • the case where the image processing apparatus 100 is a single apparatus is described as an example. However, arbitrary hardware resources such as the control unit 101 and the storage unit 104 are transferred via the Internet by cloud computing. The form to utilize may be sufficient.
  • FIG. 2 shows an example of the system configuration of the image processing system and the functional configuration of the image processing apparatus 100 according to the present embodiment. Note that the various configurations shown in FIG. 2 are merely examples, and are not limited thereto. As shown in the figure, the image processing apparatus 100 in this embodiment is connected to a data server 200, an operation unit 110, and a display unit 120.
  • the data server 200 holds all examination information that may be an image processing target of the image processing apparatus 100 and all image information belonging to each examination. It is assumed that each image included in each examination is a three-dimensional image configured as a set of two-dimensional tomographic images. Assume that the position and orientation of each two-dimensional tomographic image are stored in the data server 200 after being converted into a reference coordinate system (a coordinate system in a space with the subject as a reference). Inspection information and image information held by the data server 200 are input to the image processing apparatus 100 via the data acquisition unit 210.
  • the operation unit 110 receives an operation input such as pressing of a mouse, a keyboard, and a touch panel by an operator, and inputs various types of information to the image processing apparatus 100 via the selection inspection reception unit 216 and the processing target image selection unit 218. .
  • the display unit 120 displays an image selection screen and a processing result image generated by the image processing apparatus 100.
  • the image selection screen is a graphical user interface (GUI) for listing information on all images included in the examination group and selecting two images used for image processing.
  • the processing result image is a three-dimensional image, and when displayed on the display unit 120, a two-dimensional cross-sectional image selected by the operator is displayed.
  • the display unit 120 also displays a GUI for acquiring various instructions from the operator, such as activation of image processing.
  • the image processing apparatus 100 is composed of the elements described below.
  • the data acquisition unit 210 acquires inspection information and image information from the data server 200.
  • the selected inspection receiving unit 216 receives information on the inspection selected by the operator and acquires it.
  • the candidate determination unit 212 determines the processing candidate examination based on the examination information selected by the operator, and acquires the examination.
  • the processing target image selection unit 218 acquires two images to be subjected to image processing from the processing candidate examinations based on the selection of the operator.
  • the image processing unit 214 performs predetermined image processing on the two images selected by the operator.
  • the display control unit 106 acquires information from the candidate determination unit 212 and the image processing unit 214 and causes the display unit 120 to display an image selection screen and a processing result image.
  • FIG. 3 is a flowchart showing an overall processing procedure performed by the image processing apparatus 100.
  • step S3000 the selection inspection receiving unit 216 receives the inspection (group) selection information by the operator and acquires it. That is, the selected examination receiving unit 216 corresponds to an example of a selection unit that selects one or more examinations to which the medical image belongs. Here, it is assumed that the number of examinations (groups) selected by the operator is an arbitrary number of 1 or more. Information (for example, examination ID) of the selected examination (group) is temporarily held in the RAM 103 in the image processing apparatus 100.
  • the inspection can be selected by an operator using a GUI from an inspection list displayed on a selection screen (not shown), for example.
  • a configuration in which the operator directly inputs the inspection ID may be used.
  • step S3010 the candidate determination unit 212 uses the inspection selection information acquired in step S3000 to determine a test that is a processing candidate. That is, the candidate determination unit 212 corresponds to an example of a determination unit that determines an inspection of an image processing candidate based on one or more selected inspections. Then, the information (for example, inspection ID) indicating the determined processing candidate inspection is output to the display control unit 106.
  • the method for determining the examination of the processing candidate is specifically described.
  • the method for determining the examination of the processing candidate is changed depending on whether the number of examinations (group) selected by the operator in step S3000 is one, or two or more. Specifically, when two or more selected examinations are selected, the candidate determining unit 212 determines the examination group selected by the operator as the examination of the process candidate as it is. On the other hand, when the number of selected examinations is one, the candidate determining unit 212 searches the data server 200 based on the selected examination to determine the examination of the processing candidate. That is, when one examination is selected, the candidate determination unit 212 examines one selected examination and one or a plurality of examinations obtained by a search based on the selected examination as an image processing candidate examination. It is equivalent to an example of a determination means characterized by determining as The candidate determination unit 212 corresponds to an example of a determination unit that determines a plurality of selected examinations as examinations of image processing candidates when a plurality of examinations are selected.
  • the candidate determination unit 212 acquires inspection attribute information (accompanying information) from the inspection selected by the operator.
  • the examination attribute information is information such as a patient ID, a modality type, and a target part.
  • the candidate determination unit 212 determines an examination (group) that matches the examination for which the attribute information is selected as an examination of a processing candidate.
  • the attribute information serving as a search key is a combination of a plurality of attribute information such as “patient ID / modality type” or “patient ID / modality type”. In this way, the candidate determination unit 212 can acquire a test group in which the attribute information of the test selected by the operator is the same.
  • the search method is not limited to the method described above, and a search method suitable for image processing executed by the image processing unit 214 can be used.
  • the search condition can be “modality type different from the examination selected by the operator”. That is, for example, when the modality of the examination selected by the operator is CT, the candidate determination unit 212 searches for an examination whose modality type is MRI.
  • step S ⁇ b> 3020 the display control unit 106 performs control to display information on the examination of the processing candidate determined in step S ⁇ b> 3010 on the display unit 120. That is, the display control unit 106 corresponds to an example of a display control unit that displays on the display unit a medical image belonging to the determined examination of the image processing candidate.
  • FIG. 4 shows an example of the display form of the image group.
  • FIG. 4 is an example of an image selection screen.
  • thumbnails of image groups included in the processing candidate examination acquired in step S3010 are arranged.
  • two examinations “Study: 1001” and “Study: 1231” are calculated as examinations of processing candidates, and each examination has two images 402 and 403, and 404 and 405, respectively. It is shown. Further, when the thumbnails of the image group cannot fit on one screen, the thumbnails outside the screen can be moved into the screen by operating the scroll bar 406.
  • the display control unit 106 reads a three-dimensional image corresponding to the selected thumbnail and displays it in the detailed display area.
  • the image displayed in the detailed display area can be observed in detail by various image observation assist functions such as slice advancement, window width and window level change, and enlargement ratio change.
  • the list display of the image group is provided by the thumbnail display, and a case where an arbitrary image is observed in detail by dragging and dropping the mouse has been described as an example.
  • other display modes and operation modes are described. Can be taken.
  • thumbnail display a character string representing image attribute information such as the imaging date and the number of slices may be displayed, or a combination of thumbnail display and character string display may be used.
  • it can be set as the form which implement
  • step S3030 the processing target image selection unit 218 obtains the processing target image selection result input by the operator.
  • the selection result of the processing target image is a selection result indicating which image and which image are the two images (processing target image) that are input to the image processing.
  • the input of the selection result by the operator is performed on the image selection screen generated in step S3020.
  • step S3020 An example of a method for acquiring the selection result of the processing target image will be described with reference to FIG.
  • step S3020 thumbnails of all examinations and all images that are candidates for processing are displayed on the left side (401) of the display screen. Then, as described in step S3020, it is possible to observe an image in detail by dragging and dropping an arbitrary thumbnail to one of the detailed image display areas 407 and 408.
  • the operator searches for two images suitable for image processing while repeating drag-and-drop of thumbnails and detailed observation of images on a trial and error basis.
  • the operator presses a “Start Processing” button (409).
  • the processing target image selection unit 218 acquires two images read in the detailed image display areas 407 and 408 as processing target image selection results. Then, the process proceeds to step S3040.
  • the processing target image selection unit 218 sets the image specified in the detailed image display area 407 as the first input image (hereinafter also referred to as a reference image), and sets the image specified in the detailed image display area 408 as the second image.
  • Input image hereinafter also referred to as a comparative image
  • step S3040 the image processing unit 214 performs predetermined image processing using the two images selected in step S3030 as inputs. That is, the image processing unit 214 corresponds to an example of an image processing unit that performs image processing using a plurality of medical images selected by the user among the displayed medical images.
  • image difference processing in which the difference between the images is calculated and the difference image is generated after the two images are deformed and aligned using the technique disclosed in Non-Patent Document 1.
  • the image processing result is one three-dimensional image (difference image).
  • difference image in general, after the comparison image is deformed with the reference image fixed and the two images are aligned, a difference image in the same space as the reference image is generated.
  • the image processing is a method using two images as inputs, any processing according to the purpose of the image processing apparatus can be used.
  • arbitrary image processing such as pasting (stitching) of overlapping regions and super-resolution image processing for restoring a high-resolution image from two similar images can be used.
  • the process performed between the images of different modalities may be sufficient.
  • a process (fusion process) in which a functional image such as a PET image and a morphological image such as a CT image are aligned and functional information is superimposed on the morphological image may be used.
  • the CT image and the MRI image are aligned, and an image that can simultaneously observe the bone region that is well depicted on the CT image and the muscle region that is well depicted on the MRI image is generated. It may be a process to do.
  • step S3050 the image processing unit 214 temporarily writes the image processing result (processing result image) calculated in step S3040 to the RAM 103 for image display, and registers it in the data server 200.
  • the display control unit 106 performs control to display the image processing result on the display unit 120.
  • the display control unit 106 connects the detailed image display areas 407 and 408 in FIG. 4 into one display area, and displays the image processing result in the display area. Note that it is not always necessary to perform both processes for storing and displaying the image processing result, and a configuration in which only the display is performed or a configuration in which only the storage is performed may be employed.
  • the present embodiment it is possible to select a suitable image reflecting the operator's intention when selecting a target image for image processing. That is, when only one examination is selected in advance by the operator, it means that a rough policy such as “Which patient should be subject to image processing” has been determined, but has not been narrowed down yet. For example, this corresponds to the case where the examination to be diagnosed is the latest examination, but the past examination to be compared is not decided. Therefore, it is preferable that the image processing apparatus 100 search the database and present candidates. On the other hand, when two or more examinations are selected by the operator, it means that the examinations to be subjected to image processing are narrowed down to some extent.
  • this corresponds to the case where the examination to be diagnosed is the latest examination and the past examination to be compared with it is the previous examination. Therefore, it is preferable that the image processing apparatus 100 presents image candidates within the range of the input examination group rather than adding new candidates any more.
  • the user interface for image selection can be switched seamlessly according to the intention of the operator.
  • step S3000 what the operator designates in step S3000 is an examination, not an image.
  • the operator may specify the image itself, not the examination.
  • the designated image is regarded as one inspection, and the series of processes in the first embodiment described above may be performed.
  • the image processing apparatus In addition to the functions of the image processing apparatus 100 in the first embodiment, the image processing apparatus according to the present embodiment provides an image selection screen that more matches the intention of the operator.
  • the configuration of the image processing apparatus according to the present embodiment is the same as that in the case of the first embodiment (FIGS. 1 and 2), and a description thereof will be omitted.
  • the overall processing procedure performed by the image processing apparatus 100 according to this embodiment is the same as that in the case of the first embodiment (FIG. 3). However, the processing contents of steps S3000, S3010, S3020, and S3030 are different.
  • step S3000 the selection inspection accepting unit 216 performs the same processing as in the first embodiment, receives inspection (group) selection information by the operator, and acquires it. Further, when the number of selected examinations (groups) is two or more, the following processing is performed. In other words, the selected inspection accepting unit 216 sets the first, that is, the first selected inspection as “reference inspection” (diagnosis target inspection), and the second and subsequent inspections as “comparison inspection (group)”.
  • the image (group) belonging to the reference examination is an image (group) that is a candidate for the first input image (reference image) in the subsequent image processing.
  • the image (group) belonging to the comparative examination (group) is an image (group) that is a candidate for the second input image (comparison image) in the subsequent image processing.
  • the case where the reference inspection and the comparative inspection (group) are identified by the order in which the inspections are selected is described as an example. It may be in the form of designating “inspection” or “this inspection is a comparative inspection”. In this case, since the reference inspection and the comparison inspection can be designated without depending on the selection order, it is possible to provide a more flexible operation form.
  • step S3010 the candidate determination unit 212 performs the same process as step S3010 in the first embodiment, and determines a process candidate inspection. Furthermore, when the number of examinations (groups) selected in step S3000 is one, the following processing is performed. That is, when the number of examinations (groups) selected in step S3000 is one, the candidate determining unit 212 sets the selected examination as a “reference examination”. Then, the examination (group) acquired from the data server 200 by the processing of this step is referred to as “comparison examination (group)”.
  • the reference inspection and the comparative inspection are performed regardless of whether the number of inspections selected by the operator is one or two or more. Are selected in a distinguished state.
  • step S3020 (Display of processing candidate examination)
  • the display control unit 106 performs control to display the image group calculated in step S3010 on the display unit 120.
  • FIG. 5 shows an example of a display form of an image group.
  • the display screen has two thumbnail display areas, a left thumbnail display area (501) and a right thumbnail display area (510). Then, thumbnails of images belonging to the comparison examination (group) are displayed in the left thumbnail display area (second display area), and images belonging to the reference examination are displayed in the right thumbnail display area (first display area). A thumbnail of is displayed.
  • the thumbnail display area is configured such that thumbnails are arranged horizontally, and the thumbnail display area 501 is displayed in association with the upper or lower part of the detailed image display area 407, and the thumbnail display area 510 is displayed in association with the upper or lower part of the detailed image display area 408. It may be configured to. By arranging the corresponding thumbnail display area and the detailed image display area close to each other, there is an advantage that the operator can intuitively understand the operation.
  • the detailed image display areas 407 and 408 are further displayed. May be displayed.
  • “when possible” refers to a case where there is only one inspection belonging to the reference inspection or the comparison inspection, and there is only one image in the inspection. For example, when only one image is registered in the reference inspection, the first input image (reference image) is uniquely determined without selection. In such a case, not only displaying thumbnails but also reading into the detailed image display area (407 or 408) in this step makes it possible to reduce the labor of the operator.
  • step S3030 the processing target image selection unit 218 obtains the processing target image selection result input by the operator.
  • the input of the selection result by the operator is performed on the image selection screen generated in step S3020.
  • step S3020 An example of a method for acquiring the selection result of the processing target image will be described with reference to FIG.
  • the thumbnail (510) of the image (group) belonging to the reference examination is displayed on the right side of the screen, and the thumbnail (501) of the image (group) belonging to the comparative examination is displayed on the left side of the screen.
  • the image is displayed in the detailed image display area (407 or 408) by dragging and dropping the thumbnail image, as in the first embodiment.
  • the thumbnail (510) of the image (group) belonging to the reference examination can be dropped only in the right detailed image display area (408) (third display area).
  • the thumbnail (501) of the image (group) belonging to the comparative examination can be dropped only in the left detailed image display area (407) (fourth display area).
  • the image in the right detailed image display area (408) is the first input image (reference image)
  • the image in the left detailed image display area (407) is the second input image (comparison image).
  • the operator can select an image by clearly distinguishing the reference inspection and the comparison inspection (group).
  • the image processing is “temporal image difference processing” for obtaining a difference in temporal change of the same subject.
  • a typical use example of the temporal image difference processing is “when an image of a subject is captured, the subject image (current image), and an image at any time in the past (past image) of the same subject. This is the case of taking the difference.
  • the inspection to which the current image belongs is the reference inspection.
  • the operation is to search for a comparison inspection from inspections to which the past image group belongs.
  • the image processing apparatus 100 provides an image selection function suitable for such a case.
  • the method for specifying the reference test and the comparison test (group) is as follows. 1. According to the order specified by the operator (first reference inspection and second and subsequent comparison inspections (groups)); There were two types, the operator explicitly specifying. On the other hand, the reference inspection and the comparison inspection (group) may be designated in consideration of “imaging date and time” which is one of inspection attribute information.
  • step S3000 when the number of designated examinations is two or more, the selective examination accepting unit 216 sets the examination with the latest imaging date (closest to the current date) as the reference examination, and other examinations. Can be a comparative test (group).
  • the image processing is a time-lapse image difference process for obtaining a difference in change over time of the same subject.
  • a typical use example of the temporal image difference processing is “to take a difference between the current image (that is, the image with the latest imaging date and time) and the image at any time in the past”. . Therefore, when a plurality of inspections are selected in step S3000, it is possible to save the operator from explicitly specifying the reference inspection by setting the inspection with the newest imaging date and time as the reference inspection.
  • the candidate determining unit 212 can set the inspection as a reference inspection regardless of the imaging date and time. That is, even if a test having a new (future) imaging date and time than the designated test is picked up as a result of the search, the test may not be switched to the reference test.
  • the operator designates only one examination, there is an intention to use the examination as a reference examination. Thus, selection according to the intention of the operator is performed.
  • the designated inspection is one, the latest inspection obtained as a result of the search may be used as the reference inspection.
  • step S3000 when the number of inspections specified in step S3000 is two or more, the display of the processing candidate inspection in S3020 performs the reference inspection and the comparative inspection according to the display form of the first embodiment (FIG. 4). Display without distinction.
  • the display of examinations of candidate processes in S3020 follows the display form (FIG. 5) of the second embodiment.
  • the case where the information acquired in step S3000 is inspection information has been described as an example.
  • the acquired information is not an examination but an “image”.
  • FIG. 6 is a flowchart showing an example of the entire processing procedure performed by the image processing apparatus 100 in the present embodiment. Steps S6020 to S6050 are the same as the processing of steps S3020 to S3050 in FIG.
  • step S6000 the data acquisition unit 210 acquires the selection information of the image (group) by the operator via the selection inspection reception unit 216.
  • the number of images (groups) selected by the operator is an arbitrary number of 1 or more.
  • Information on the selected image (group) is temporarily held in the RAM 103 in the image processing apparatus 100.
  • the ID of the examination to which each image belongs is also acquired and held in the RAM 103.
  • step S6010 the candidate determination unit 212 calculates an image candidate group that may be an image processing target using the image selection information acquired in step S6000.
  • the image candidate group calculation method is 3: 2 when the number of images specified in step S6000 is 1: 1, 2: 2 or more, and all these images belong to the same examination. If it is more than one and spans more than one test, it will vary.
  • a method for calculating the image candidate group will be specifically described.
  • the candidate determining unit 212 performs an examination on the data server 200 in which examination attribute information such as patient ID, modality type, and target part matches the designated image. Search by. At this time, the examination to which the designated image belongs is excluded from the search target. Then, the candidate determining unit 212 picks up all the images belonging to the searched examination (group) to make a candidate image group. In other words, when one medical image is selected, the candidate determination unit 212 displays one selected medical image and one or a plurality of medical images obtained by a search based on the selected one medical image. This corresponds to an example of a determination unit that determines a process candidate test.
  • the candidate determining unit 212 indicates that the examination attribute information such as the patient ID, the modality type, and the target part
  • the data server 200 is searched for an examination that matches the two designated images.
  • the examination to which the designated image belongs is excluded from the search target.
  • the candidate determining unit 212 picks up all the images belonging to the searched examination (group) to make a candidate image group. That is, when a plurality of medical images belonging to the same examination are selected, the candidate determination unit 212 selects one or a plurality of medical images obtained by a search based on the selected plurality of medical images and the selected plurality of medical images. This corresponds to an example of a determination unit that determines a medical image as an examination of an image processing candidate.
  • the candidate determining unit 212 does not perform a search on the data server 200 and uses the designated image group as it is. Let it be a candidate image group. Note that the case where two or more examinations are spanned is, for example, the case where the selected image A belongs to the examination A but the selected image B belongs to the examination B. That is, the candidate determination unit 212 corresponds to an example of a determination unit that determines a plurality of selected medical images as examinations of image processing candidates when a plurality of medical images belonging to different examinations are selected.
  • the candidate determination unit 212 determines whether all the images (groups) designated by the operator belong to the same examination or span two or more examinations. In response to this, whether to search the data server 200 is switched.
  • the present invention can take an embodiment as a system, apparatus, method, program, storage medium, or the like. Specifically, the present invention may be applied to a system composed of a plurality of devices by distributing the functions of the image processing apparatus, or may be applied to an apparatus composed of a single device. Further, since the functions and processes of the present invention are implemented by a computer, the program code installed in the computer also implements the present invention. Further, the scope of the present invention includes a computer program itself for realizing the functions and processes shown in the above-described embodiments.
  • the embodiment of the embodiment is implemented in cooperation with an OS or the like running on the computer based on an instruction of the program.
  • a function may be realized.
  • the OS or the like performs part or all of the actual processing, and the functions of the above-described embodiments are realized by the processing.
  • the program read from the recording medium is written in a memory provided in a function expansion board inserted into the computer or a function expansion unit connected to the computer, so that part or all of the functions of the above-described embodiments are realized. May be.
  • the scope of the present invention is not limited to the embodiment described above. It is also possible to combine at least two of the plurality of modifications described above.

Landscapes

  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Medical Informatics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Public Health (AREA)
  • Physics & Mathematics (AREA)
  • Biomedical Technology (AREA)
  • Radiology & Medical Imaging (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Theoretical Computer Science (AREA)
  • Pathology (AREA)
  • Epidemiology (AREA)
  • General Physics & Mathematics (AREA)
  • Primary Health Care (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Molecular Biology (AREA)
  • Surgery (AREA)
  • Animal Behavior & Ethology (AREA)
  • Biophysics (AREA)
  • Veterinary Medicine (AREA)
  • Optics & Photonics (AREA)
  • High Energy & Nuclear Physics (AREA)
  • General Engineering & Computer Science (AREA)
  • Quality & Reliability (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Human Computer Interaction (AREA)
  • Databases & Information Systems (AREA)
  • Computer Hardware Design (AREA)
  • Business, Economics & Management (AREA)
  • Data Mining & Analysis (AREA)
  • General Business, Economics & Management (AREA)
  • Medical Treatment And Welfare Office Work (AREA)
  • Apparatus For Radiation Diagnosis (AREA)
  • Measuring And Recording Apparatus For Diagnosis (AREA)
PCT/JP2019/015074 2018-04-12 2019-04-05 画像処理装置、画像処理装置の制御方法、及びプログラム Ceased WO2019198627A1 (ja)

Priority Applications (3)

Application Number Priority Date Filing Date Title
US17/061,030 US11557039B2 (en) 2018-04-12 2020-10-01 Image processing apparatus, method for controlling image processing apparatus, and non-transitory computer-readable storage medium
US18/060,478 US12094120B2 (en) 2018-04-12 2022-11-30 Determine image processing candidate medical images based on a number of the selected one or more medical images
US18/809,184 US20240412372A1 (en) 2018-04-12 2024-08-19 Image processing apparatus, method for controlling image processing apparatus, and non-transitory computer-readable storage medium

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2018-077138 2018-04-12
JP2018077138A JP7237454B2 (ja) 2018-04-12 2018-04-12 画像処理装置、画像処理装置の制御方法、及びプログラム

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US17/061,030 Continuation US11557039B2 (en) 2018-04-12 2020-10-01 Image processing apparatus, method for controlling image processing apparatus, and non-transitory computer-readable storage medium

Publications (1)

Publication Number Publication Date
WO2019198627A1 true WO2019198627A1 (ja) 2019-10-17

Family

ID=68163117

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2019/015074 Ceased WO2019198627A1 (ja) 2018-04-12 2019-04-05 画像処理装置、画像処理装置の制御方法、及びプログラム

Country Status (3)

Country Link
US (3) US11557039B2 (https=)
JP (3) JP7237454B2 (https=)
WO (1) WO2019198627A1 (https=)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20240347174A1 (en) * 2023-04-12 2024-10-17 Canon Medical Systems Corporation Medical image processing apparatus and recording medium

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2007282656A (ja) * 2006-04-12 2007-11-01 Toshiba Corp 医用画像表示装置
JP2008173213A (ja) * 2007-01-17 2008-07-31 Hitachi Medical Corp 医用画像診断支援装置
JP2013128725A (ja) * 2011-12-22 2013-07-04 Hitachi Medical Corp 検査情報表示装置及びシステム
JP2016035717A (ja) * 2014-08-04 2016-03-17 株式会社東芝 医用画像管理システム、医用画像観察装置、及び医用画像保管装置
JP2018033545A (ja) * 2016-08-29 2018-03-08 キヤノン株式会社 画像処理装置、画像処理方法およびプログラム
JP2019058374A (ja) * 2017-09-27 2019-04-18 富士フイルム株式会社 位置合わせ装置、方法およびプログラム

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002200066A (ja) * 2000-12-27 2002-07-16 Mitsubishi Space Software Kk 画像表示制御装置
JP2006026396A (ja) 2004-06-14 2006-02-02 Canon Inc 画像処理装置及び方法、制御プログラム並びに記憶媒体
US7885440B2 (en) * 2004-11-04 2011-02-08 Dr Systems, Inc. Systems and methods for interleaving series of medical images
US7859549B2 (en) * 2005-03-08 2010-12-28 Agfa Inc. Comparative image review system and method
JP6230787B2 (ja) * 2010-03-31 2017-11-15 株式会社日立製作所 検査情報表示装置及び方法
JP2012223470A (ja) 2011-04-22 2012-11-15 Hitachi Medical Corp 医用画像データの削除処理方法、医用画像診断装置
JP5745444B2 (ja) * 2012-03-05 2015-07-08 富士フイルム株式会社 医用画像表示装置および医用画像表示方法、並びに、医用画像表示プログラム
US9600882B2 (en) * 2012-10-01 2017-03-21 Koninklijke Philips N.V. Multi-study medical image navigation
WO2015019556A1 (ja) * 2013-08-07 2015-02-12 パナソニックＩｐマネジメント株式会社 症例表示装置、症例表示方法およびプログラム
JP6301277B2 (ja) * 2015-03-20 2018-03-28 富士フイルム株式会社 診断補助画像生成装置および診断補助画像生成方法、並びに、診断補助画像生成プログラム
US10275877B2 (en) * 2015-06-12 2019-04-30 International Business Machines Corporation Methods and systems for automatically determining diagnosis discrepancies for clinical images
US10065049B2 (en) * 2016-01-25 2018-09-04 Accuray Incorporated Presenting a sequence of images associated with a motion model
WO2018107371A1 (zh) * 2016-12-13 2018-06-21 上海联影医疗科技有限公司 图像搜索系统及方法

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2007282656A (ja) * 2006-04-12 2007-11-01 Toshiba Corp 医用画像表示装置
JP2008173213A (ja) * 2007-01-17 2008-07-31 Hitachi Medical Corp 医用画像診断支援装置
JP2013128725A (ja) * 2011-12-22 2013-07-04 Hitachi Medical Corp 検査情報表示装置及びシステム
JP2016035717A (ja) * 2014-08-04 2016-03-17 株式会社東芝 医用画像管理システム、医用画像観察装置、及び医用画像保管装置
JP2018033545A (ja) * 2016-08-29 2018-03-08 キヤノン株式会社 画像処理装置、画像処理方法およびプログラム
JP2019058374A (ja) * 2017-09-27 2019-04-18 富士フイルム株式会社 位置合わせ装置、方法およびプログラム

Also Published As

Publication number Publication date
US12094120B2 (en) 2024-09-17
JP7237454B2 (ja) 2023-03-13
US20230095776A1 (en) 2023-03-30
US11557039B2 (en) 2023-01-17
JP2019180949A (ja) 2019-10-24
JP2023075195A (ja) 2023-05-30
JP2025023324A (ja) 2025-02-14
US20210019888A1 (en) 2021-01-21
US20240412372A1 (en) 2024-12-12

Similar Documents

Publication Publication Date Title
US8929627B2 (en) Examination information display device and method
CN104516627B (zh) 显示设备和使用所述显示设备的图像显示方法
US10222954B2 (en) Image display apparatus, display control apparatus and display control method using thumbnail images
CN106999145B (zh) 用于上下文成像工作流的系统和方法
CN100506155C (zh) 医用图像显示装置
JP6711676B2 (ja) 医用レポート作成装置及びその制御方法、医用レポート作成システム、並びに、プログラム
JP5927591B2 (ja) 症例表示装置、症例表示方法およびプログラム
JP4401741B2 (ja) 画像表示装置、画像表示方法及びそのプログラム
JP2009086765A (ja) 医用レポートシステム、医用レポート作成装置、及び医用レポート作成方法
JP2016189813A (ja) 検査画像閲覧支援装置、その作動方法及び作動プログラム
JP5355782B2 (ja) 制御装置及び方法
US20100082365A1 (en) Navigation and Visualization of Multi-Dimensional Image Data
JP5355111B2 (ja) 診断支援装置及び診断支援方法
JP7246912B2 (ja) 医用情報処理装置及び医用情報処理システム
JP7071441B2 (ja) 装置、方法、システム及びプログラム
US10324582B2 (en) Medical image display apparatus, method for controlling the same
JP4179510B2 (ja) 検査支援装置および検査支援プログラム
JP6440386B2 (ja) 情報処理装置及びプログラム
JP2025023324A (ja) 画像処理装置、画像処理装置の制御方法、及びプログラム
JP5363962B2 (ja) 診断支援システム、診断支援プログラムおよび診断支援方法
JP5784082B2 (ja) 診断支援装置及び診断支援方法
JP7109910B2 (ja) 読影レポート作成支援装置及び読影レポート作成支援方法
JP7094761B2 (ja) 情報処理装置、情報処理装置の制御方法、及びプログラム
JP6841136B2 (ja) 医用画像表示装置及びプログラム
JP2020181425A (ja) 医用画像処理装置、方法及びシステム

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19784365

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19784365

Country of ref document: EP

Kind code of ref document: A1