WO2013105042A2 - Image processing apparatus - Google Patents
Image processing apparatus Download PDFInfo
- Publication number
- WO2013105042A2 WO2013105042A2 PCT/IB2013/050210 IB2013050210W WO2013105042A2 WO 2013105042 A2 WO2013105042 A2 WO 2013105042A2 IB 2013050210 W IB2013050210 W IB 2013050210W WO 2013105042 A2 WO2013105042 A2 WO 2013105042A2
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- medical
- image
- data
- view
- field
- Prior art date
Links
Classifications
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H30/00—ICT specially adapted for the handling or processing of medical images
- G16H30/20—ICT specially adapted for the handling or processing of medical images for handling medical images, e.g. DICOM, HL7 or PACS
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T15/00—3D [Three Dimensional] image rendering
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/0002—Inspection of images, e.g. flaw detection
- G06T7/0012—Biomedical image inspection
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/30—Determination of transform parameters for the alignment of images, i.e. image registration
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30004—Biomedical image processing
- G06T2207/30061—Lung
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2210/00—Indexing scheme for image generation or computer graphics
- G06T2210/41—Medical
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2219/00—Indexing scheme for manipulating 3D models or images for computer graphics
- G06T2219/008—Cut plane or projection plane definition
Definitions
- the invention relates to an image processing apparatus and a method of processing a medical image.
- the invention further relates to a workstation and an imaging apparatus comprising the image processing apparatus set forth, and to a computer program product for causing a processor system to perform the method set forth.
- Fig. 1 shows a volume data set being displayed on a display, titled "3D view” in Fig. 1.
- a slice through the volume data set is displayed, titled "2D view” in Fig. 1.
- the "3D view” further shows a cutting plane graphically representing said slice.
- a first aspect of the invention provides an image processing apparatus for processing a medical image, comprising an input for obtaining the medical image and medical data, the medical image constituting a field of view in three-dimensional [3D] patient data, and the medical data showing an anatomical context of a content of the field of view, an output for providing an output image comprising the medical image and a visualization of the medical data, the medical data constituting non- patient specific medical data, and the imaging processing apparatus further comprising a processor for (i) performing an image alignment between the medical image and the medical data for obtaining a transformation providing a position of the content with respect to its anatomical context, and (ii) using the transformation for establishing a graphical
- a workstation and an imaging apparatus comprising the image processing apparatus set forth.
- a method for processing a medical image comprising obtaining the medical image and medical data, the medical image constituting a field of view in three-dimensional [3D] patient data, and the medical data showing an anatomical context of a content of the field of view, providing an output image comprising the medical image and a visualization of the medical data, the medical data constituting non-patient specific medical data, and the method further comprising performing an image alignment between the medical image and the medical data for obtaining a transformation providing a position of the content with respect to its anatomical context, and using the transformation for establishing a graphical representation of the field of view in the visualization of the medical data at said position.
- a computer program product comprises instructions for causing a processor system to perform the method set forth.
- the input obtains a medical image which constitutes a field of view in 3D patient data.
- the term field of view refers to an extent to which the 3D patient data is visible in the medical image, and typically corresponds to a portion of the 3D patient data.
- the content of the field of view i.e., what is shown in the field of view, may be a body part, an organ, a part of the organ, a tissue, etc.
- the input further obtains medical data which provides an anatomical context of the content of the field of view.
- the medical data allows the content to be placed within a greater anatomy.
- the content may be a part of an organ, and the medical data may provide the entire organ as the anatomical context.
- the content may be a body part, and the medical data may provide an entire body as the anatomical context.
- the output provides an output image in which the medical image is shown as well as a visualization of the medical data.
- the output image thus shows the content of the field of view as well as separately the anatomical context of the content. A user can view both simultaneously by viewing the output image on a display.
- the medical data constitutes non-patient specific medical data. Therefore, whereas the field of view of the medical image shows content of a particular patient, the medical data is non-patient specific.
- the medical data may be a medical atlas showing a reference human body, thereby omitting any patient-specific details or variations.
- the anatomical context is a non-patient specific context, i.e., it differs from the anatomical context that is or may be provided by the 3D patient data itself.
- the processor obtains a transformation that provides a position of the content with respect to the anatomical context shown in the medical data.
- the transformation may take the form of a transformation matrix, as known from the field of linear algebra, or a transformation function, and enables the processor to position the content of the field of view at an anatomically correct position within the medical data anatomical context.
- the processor performs an image alignment which matches the medical image to the medical data.
- Image alignment is known per se from the field of image alignment, and may involve matching image structures, e.g., edges or corners in the medical image, to similar image structures in the medical data.
- image alignment may involve matching landmarks, e.g., automatically or manually annotated points in the medical image, to corresponding landmarks in the medical data. It is noted that image alignment is frequently also referred to as image registration.
- the processor uses the transformation to generate a graphical representation of the field of view in the visualization of the medical data at said position.
- the field of view in the 3D patient data as is shown by the medical image, is graphically illustrated in the visualization of the medical data in the output image.
- the graphical representation of the field of view in the 3D patient data is graphically illustrated in the visualization of the medical data in the output image.
- the user is provided with a visualization in the output image that omits patient-specific details or variations.
- a transformation between the medical image and the medical data the content of the field of view of a particular patient can nevertheless be placed in the non- patient specific anatomical context.
- a position of the field of view, and thus of its content is visualized within the non-patient specific anatomical context.
- the invention is partially based on the recognition that it is convenient for a user to obtain an anatomical context when viewing a medical image of 3D patient data, but that 3D patient data is typically unsuitable for providing said anatomical context.
- 3D patient data typically contains patient specific details or variations, which may confuse or distract the user.
- 3D patient data may, by its nature, be intended for medical diagnosis by a clinician, and hence be unsuitable for, e.g., a non-expert user.
- the 3D patient data may contain too much detail, lack clearly defined structures, etc.
- a user may therefore fail to recognize the anatomical context provided by the 3D patient data.
- the present invention uses medical data that provides a non- patient specific anatomical context for the content of the field of view. The medical data therefore omits patient- specific details or variations. As a result, a user can easily learn or obtain the anatomical context from the output image. It is noted that also an expert user benefits from being able to easily learn or obtain the anatomical context.
- the medical data may be specifically optimized for easy viewing by a non-expert user, as the medical data does not need to be used for medical diagnosis.
- the output image can simultaneously show an actual content of the field of view to the user, e.g., a broken bone or a malignant growth, as well as its anatomical context in an easy and understandable manner by means of the medical data.
- the user may more easily understand the medical image.
- a clinician may need less or no explanation of the anatomical context of said content.
- the processor is arranged for establishing the graphical user interface
- a surface is well suitable for graphically representing the field of view provided by a medical image, as the field of view of the medical image is typically predominantly defined by the width and height of the field of view, rather than having a depth.
- the field of view provided by the medical image extends predominantly along the width and height of the slice, with the depth being limited to the slice thickness, i.e., being typically thin. The field of view may therefore not extend significantly out of the medical image plane.
- a surface visually resembles said field of view, and thus provides a well-fitting graphical representation.
- the field of view extends along a depth in the 3D patient data
- the processor is arranged for (i) obtaining the depth and (ii) establishing a thickness of the surface in the visualization of the medical data for visualizing said depth.
- the field of view may have a certain depth.
- a slice may have a slice thickness, which may be typically thin but in some situations may be thick.
- the medical image is a DICOM-encoded medical image
- the processor is arranged for obtaining the depth based on a DICOM data element of the
- DICOM-encoded medical image is a standard for handling, storing, printing, and transmitting information in medical imaging.
- a DICOM data element may provide direct information on, or may be indicative of, the depth of the field of view.
- a DICOM data element may comprise a slice thickness.
- a DICOM data element may also be indicative of the type of medical image, e.g., a cardiac or a brain image, with the type of medical image being indicative of said depth. The processor exploits this information by establishing the depth of the field of view based on the DICOM data element.
- the medical image is one of a plurality of medical images together constituting a medical volume, the medical volume providing a further field of view in the 3D patient data, and wherein the processor is arranged for using the transformation for establishing a further graphical representation of the further field of view in the visualization of the medical data.
- the plurality of medical images together provides a further field of view in the 3D patient data.
- the further field of view encompasses the field of view provided by the medical image, as the medical image is one of the plurality of medical images.
- the processor uses the transformation to establish a further graphical representation of the further field of view in the visualization of the medical data. The user is thus provided with a visualization of the further field of view within the anatomical context of the medical data.
- a user may easily learn or obtain the anatomical context of the further field of view.
- the user is provided with a visualization of a relative position of the field of view with respect to the further field of view.
- a user may easily learn said relative position by comparing the graphical representation with the further graphical representation in the output image.
- the processor is arranged for performing the image alignment between the medical volume and the medical data for obtaining the transformation.
- the medical volume provides a larger field of view than the field of view of only the medical image. Performing the image alignment is therefore facilitated, as a larger field of view provides more information that may be used by the image alignment.
- a larger field of view allows the medical volume to be more uniquely matched to the medical data compared to the image alignment matching only the medical image.
- occurrences of erroneous image alignment due to ambiguities in the matching are reduced.
- a more accurate transformation is obtained.
- the processor is arranged for (i) obtaining a non-angle preserving transformation between the medical volume and the medical data, and (ii) using the non- angle preserving transformation to deform the medical data for establishing the medical data in the block shape as corresponding to the further field of view.
- An angle-preserving linear transformation also known as a conformal map in the field of mathematics, may be unsuitable or insufficient for mapping the medical volume to the medical data.
- an orientation of body parts may locally differ from that of the 3D patient data.
- the patient may have differently positioned arms in the 3D patient data than the human body in the medical data.
- an accurate graphical representation of the further field of view may have a non-block shape in the medical data.
- Said non-block shape may be difficult to interpret for a user.
- the non-angle preserving transformation to deform the medical data for establishing the medical data in the block shape as corresponding to the further field of view, the medical data is deformed such that the medical data in the aforementioned block shape corresponds to the further field of view of the medical volume. Therefore, the block shape remains an accurate representation of the field of view in the medical data.
- a user is not confused by the further field of view being represented by a non-block shape in the visualization of the medical data.
- the processor is arranged for (i) obtaining a non-angle preserving transformation between the medical volume and the medical data, and (ii) using the non- angle preserving transformation to reformat the plurality of medical images for establishing the further field of view as corresponding to the medical data in the block shape.
- the non-angle preserving transformation may be used to reformat the medical volume so as to correspond to the medical data in the block shape.
- a reformatted medical volume is obtained.
- a user is not confused by the further field of view being represented by a non-block shape in the visualization of the medical data.
- the medical image is a DICOM-encoded medical image
- the processor is arranged for using a DICOM data element of the DICOM-encoded medical image for initializing and/or optimizing the image alignment.
- DICOM data elements may be advantageously used in performing the image alignment, as they provide information of the anatomical context of the medical image, e.g., which type of content is shown within the field of view. Hence, obtaining the transformation that places the content with respect to its anatomical context is facilitated.
- the image alignment is more accurate.
- the workstation set forth comprises a display for displaying the output image and a user input for enabling the user to navigate through the 3D patient data by modifying the field of view in the 3D patient data, and the processor is arranged for updating the graphical representation of the field of view, based on said modifying.
- the user is therefore continuously, i.e., during said navigation, provided with a position of the content of the current field of view with respect to its anatomical context.
- navigating through the 3D patient data is more convenient for a user.
- Fig. 1 shows an image processing apparatus according to the present invention connected to a display for displaying an output image
- Fig. 3 shows a computer program product according to the present invention
- Fig. 4b shows the graphical representation, being a surface having a thickness
- Fig. 5a shows a plurality of medical images and a further graphical representation of a further field of view provided by said medical images
- Fig. 5b shows the further graphical representation having a sheared non-block shape
- Fig. 5c shows the further graphical representation having a block shape and a result of the medical data being deformed.
- visualization data 142 may comprise or be the output image 160.
- the processor 140 may generate the output image 160.
- the visualization data 142 may relate to the graphical representation and the output 130 may be arranged for obtaining the output image 160 from elsewhere within the apparatus 110, e.g., from another processor.
- the output 130 is shown to be connected to a display 150 for displaying the output image 160 on said display.
- the display 150 is shown to be an external display, i.e., not being part of the apparatus 110. Alternatively, the display 150 may be part of the apparatus 110.
- the apparatus 110 and the display 150 may be part of, or form, a workstation 100.
- the apparatus 110 may further comprise a user input 150 for obtaining navigation data 152 from a user.
- the user input 150 may be connected to a user interface means (not shown in Fig. 1) such as a mouse, keyboard, touch screen, etc, for receiving navigation commands from the user via the user interface means.
- Fig. 2 shows a method 200 for processing a medical image, comprising, in a first step titled "OBTAINING THE MEDICAL IMAGE AND IMAGE DATA", obtaining 210 the medical image and medical data, the medical image constituting a field of view in three-dimensional [3D] patient data, and the medical data showing an anatomical context of a content of the field of view.
- the method 200 further comprises, in a second step titled "PROVIDF G AN OUTPUT IMAGE", providing 220 an output image comprising the medical image and a visualization of the medical data.
- the medical data constitutes non- patient specific medical data.
- the method 200 further comprises, in a third step titled
- the method 200 further comprises, in a fourth step titled "ESTABLISHING A GRAPHICAL REPRESENTATION", using the transformation for establishing 240 a graphical representation of the field of view in the visualization of the medical data at said position. It is noted that the above steps of the method 200 may be performed in any suitable order. In particular, the second step of providing 220 the output image may be performed last as part of the method 200.
- the method 200 may correspond to an operation of the apparatus 110, and henceforth will be further discussed in reference to said operation of the apparatus 110. It is noted, however, that the method 200 may also be performed in separation of said apparatus 110, e.g., using a different image processing apparatus or a workstation.
- Fig. 4a shows the output image 160.
- the output image 160 comprises a medical image 171 constituting a field of view in 3D patient data.
- the medical image 171 is shown to be an axial slice through 3D patient data comprising an upper body of the patient.
- the medical image 171 shows, as part of its field of view in the upper body of the patient, a part of the patient's lungs.
- the content of the field of view provided by the medical image 171 thus is a part of the patient's lungs.
- the output image 160 comprises a visualization of medical data 180.
- the medical data differs from the 3D patient data in that the medical data constitutes non-patient specific medical data, i.e., is neither of the same patient as the 3D patient data nor any other specific patient.
- the medical data shows an anatomical context of the content of the field of view. In the example of Figs 4a - 5b, the medical data shows a schematic
- Fig. 4a shows a result of the processor 140 being arranged for performing an image alignment between the medical image 171 and the medical data to obtain a
- the processor 140 is arranged for using the transformation to establish a graphical representation 182 of the field of view in the visualization of the medical data 180 at said position.
- the graphical representation 182 is shown in Fig. 4a to be a surface 182 intersecting the visualization of the medical data 180 at the aforementioned position.
- the surface 182 therefore intersects the upper body through the part of the upper body that corresponds to the part of the lungs shown in the medical image 171.
- the term corresponds refers to being an anatomically or computationally closest match.
- the surface 182 visualizes the field of view provided by the medical image 171, in that a position as well as an extent of the field of view is graphically represented by the surface 182.
- the term extent here refers to a width and a height of the field of view, which is graphically represented by a corresponding width and height of the surface 182.
- the user can thus gather, from the surface 182 in the visualization of the medical data 180, the position and the width and the height of the field of view with respect to the medical data.
- the surface 182 may also graphically represent a depth of the field of view, i.e., the extent of the field of view in a direction that is perpendicular to the medical image surface.
- the thickness of the surface 182 is shown to be limited, i.e., the surface 182 is a thin surface. This may be the result of the depth of the field of view being equally thin.
- this may be the result of the surface 182 not graphically representing said depth of the field of view. Also, this may be the result of the surface 182 not graphically representing the extent of the field of view at all, i.e., neither its width, height nor depth. Rather, the surface 182 may solely graphically represent the position of the field of view.
- Fig. 4b shows a cut-out version of the visualization of the medical data 180.
- the field of view extending along a depth in the 3D patient data
- the processor 140 being arranged for (i) obtaining the depth and (ii) establishing a thickness 185 of the surface 184 in the visualization of the medical data 180 for visualizing said depth.
- the field of view may extend in the aforementioned depth direction in the 3D patient data.
- the medical image 171 may represent a slice through the 3D patient data having a certain slice thickness.
- the depth of the field of view may correspond to the slice thickness.
- the processor 140 then visualizes said slice thickness by establishing the thickness 185 of the surface 184 accordingly.
- Obtaining said depth may involve, when the medical image 171 is a DICOM- encoded medical image, obtaining the depth based on, or directly from, a DICOM data element of the DICOM-encoded medical image.
- Said DICOM data element may be indicative of the depth of the field of view, e.g., the DICOM data element may directly comprise the aforementioned slice thickness.
- the graphical representation of the field of view may take any other suitable form.
- the surface may be partially translucent or transparent.
- only an outline of a surface may be shown, e.g., indicating a width and a height of the field of view.
- the graphical representation may also involve a modification of the medical data, e.g., increase the brightness of a portion of the medical data.
- said portion of the medical data may constitute the graphical representation of the field of view.
- the graphical representation may also be a symbol, e.g., a camera symbol facing a portion of the medical data that corresponds to the field of view of the medical image 171.
- the medical image 171 is one of a plurality of medical images 170-172 together constituting a medical volume 170-172, with the medical volume 170-172 providing a further field of view in the 3D patient data.
- the plurality of medical images may, e.g., correspond to a series of slices through the 3D patient data.
- the processor 140 may be arranged for using the transformation to establish a further graphical representation 186 of the further field of view in the visualization of the medical data 180.
- the processor 140 may be arranged for performing the image alignment between the medical volume 170-172 and the medical data for obtaining the transformation.
- the processor 140 may perform the image alignment between one of the plurality of medical images 170-172 and the medical data, and may apply said transformation to the others of said medical images 170-172.
- Fig. 5a shows the further graphical representation 186 of the further field of view having a block shape, i.e., being a wireframe block or slab.
- Said shape may be the result of the further field of view also having a block shape within the 3D patient data.
- said further field of view may be block-shaped.
- the further graphical representation 186 may graphically represent a width, a height and a depth of the further field of view due to a width, height and depth of the wireframe block 186 being chosen accordingly.
- the further graphical representation 186 may take any other suitable form.
- the further graphical representation 186 may comprise a plurality of surfaces, with each of the plurality of surfaces graphically
- the surface 182 graphically representing the field of view of the medical image 171 is shown as well. From the relative positions of the surface 182 and the wireframe block 186, it can be seen that the field of view of the medical image 171 is located in the middle of the further field of view of the plurality of medical images 170-172, e.g., may be a middle slice.
- Said relative position of the surface 182 may correspond to a relative position of a currently shown medical image with respect to the plurality of medical images 170-172, i.e., the surface 182 being located in the middle of the wireframe block 186 may be indicative of the currently shown medical image being a middle one 171 of the plurality of medical images 170-172. It is noted that this is not shown in Fig. 5a, where, for sake of explanation, the plurality of medical images 170-172 are shown as a stack showing a first one 170 of the medical images on top instead of the middle one 171 of the medical images.
- the processor 140 may be arranged for obtaining an angle -preserving transformation between the medical volume 170-172 and the medical data.
- An angle-preserving transformation may involve any or all of: rotation, scaling, or translation.
- the processor 140 may obtain an angle-preserving transformation matrix which is indicative of a transformation of a point in a coordinate system of the plurality of medical images 170-172 to a point in the coordinate system of the medical data, or of the visualization of the medical data 180.
- Such matrices, as well as other angle-preserving transformation functions, are known from the fields of image alignment and linear algebra.
- the processor 140 may be arranged for using the angle- preserving transformation for establishing the further graphical representation 186 having a block shape in the visualization of the medical data 180.
- the aforementioned wireframe block 186 may be obtained, as shown in Fig. 5a.
- the non-angle preserving transformation may take into account the aforementioned shearing, perspective distortions, non-linear distortions, etc, of the medical volume 170-172 with respect to the 3D medical data, or vice versa.
- the processor 140 may be arranged for using the non-angle preserving transformation to establish the further graphical representation 186 in the visualization of the medical data 180, e.g., by applying the non-angle preserving transformation to an initial block shape defined in the coordinate system of the medical volume 170-172.
- a non-block shape may be automatically obtained in the visualization of the medical data 180.
- Fig. 5b where a sheared non-block shape 187 is shown as well as the surface 183.
- the edges or lines of the block shape 187 may be transformed into curves. In the example of Fig. 5b, however, the transformation does not comprise non-linear components.
- sheared non-block shape 187 may be difficult to interpret for a user.
- the processor 140 may be arranged for
- the further graphical representation does not accurately represent the further field of view, but confusion of a user due to the sheared non-block shape 187 may be avoided.
- the processor 140 may be arranged for using the non-angle preserving transformation to deform the medical data for establishing the medical data in the block shape 186 as corresponding to the further field of view.
- An example of this is shown in Fig. 5c, where the deformation of the medical data is schematically indicated by means of arrows. It is noted that in the example of Fig. 5c, the non-angle preserving transformation is assumed to obtain otherwise the sheared non-block shape 187 of Fig. 5b. Hence, the deformation of the medical data essentially corresponds to the deformation needed for deforming the sheared non-block shape 187 of Fig. 5b into the block shape 186 of Fig. 5c.
- Deforming the medical data may involve, e.g., adjusting coordinates of vertices when the medical data is 3D graphics data, or adjusting values or positions of voxels when the medical data is volumetric data. It is noted that such techniques are known per se from the fields of image alignment and image processing. As a result, the medical data in the block shape 186 corresponds to the further field of view after said deformation. Here, the term corresponds refers to being an anatomically or computationally close or closest match. Consequently, the block shape 186 provides an accurate graphical representation of the further field of view.
- the processor 140 may be arranged for using the non-angle preserving transformation to reformat the plurality of medical images 170-172 for establishing the further field of view as corresponding to the medical data in the block shape 186.
- a new plurality of medical images is obtained, of which the further field of view corresponds to the medical data in the block shape 186. Consequently, the block shape 186 provides an accurate graphical representation of its further field of view.
- reformatting techniques are known per se from the field of medical imaging. Reformatting may comprise generating a new plurality of slices intersecting the 3D patient data.
- the output image 160 may comprise a side-by-side visualization of the medical image 171 and the visualization of the medical data 180.
- the visualization may be interactive, i.e., the user may navigate through the 3D patient data, and as a result, a different medical image may be displayed.
- the different medical image may be a different one of the aforementioned plurality of medical images 170-172.
- the processor may be arranged for updating the graphical representation 182 of the field of view, based on the navigation. Hence, a change in field of view due to a change in medical image may result in a change in position and/or shape of the graphical representation 182 of the field of view.
- the apparatus 110 may comprise a user input 150, as shown in Fig. 1.
- the apparatus 110 and the display 150 may be part of, or together form, a workstation 100 that enables the user to navigate through the 3D patient data.
- the graphical representation may be a planar surface.
- the graphical representation may also be a non-planar surface, e.g., a curved surface, when the
- the transformation between medical image and medical data comprises non-linear components.
- the graphical representation may be based on computer graphics, i.e., may be comprised of vertices, edges, etc.
- the graphical representation may also be pixel-based or voxel-based.
- the further graphical representation may be a block shape such as a wireframe block or slab.
- the further graphical representation may also be a translucent or semi-translucent block.
- the image alignment may be based on any suitable technique from the field of image alignment.
- multi-modality methods may be used to compensate for a difference in modality or type between the 3D patient data and the medical data.
- the processor may be arranged for using a DICOM data element of the DICOM-encoded medical image for initializing and/or optimizing the image alignment. For example, angulations and positioning information may be used.
- the 3D patient data may be from various acquisition modalities such as, but not limited to, standard X-ray Imaging, Computed Tomography (CT), Magnetic Resonance Imaging (MRI), Ultrasound (US), Positron Emission Tomography (PET), Single Photon Emission Computed Tomography (SPECT), and Nuclear Medicine (NM).
- CT Computed Tomography
- MRI Magnetic Resonance Imaging
- US Ultrasound
- PET Positron Emission Tomography
- SPECT Single Photon Emission Computed Tomography
- NM Nuclear Medicine
- the 3D patient data may be part of 4D patient data.
- a dimension may relate to time, e.g., the 4D patient data may be a time-series of 3D images.
- the plurality of medical images may together constitute the 3D patient data.
- the plurality of medical images may be a plurality of slices, together constituting a medical volume as well as all of the 3D patient data.
- the medical volume i.e., the plurality of medical images, may
- the medical data may be based on acquired medical data in which patient- specific details or variations have been removed, e.g., by averaging.
- the medical data may also be automatically or manually generated data, e.g., a 3D computer graphics model or a 2D drawing.
- the medical data may be 2D or 3D medical atlas data.
- the invention also applies to computer programs, particularly computer programs on or in a carrier, adapted to put the invention into practice.
- the program may be in the form of a source code, an object code, a code intermediate source and object code such as in a partially compiled form, or in any other form suitable for use in the implementation of the method according to the invention.
- a program may have many different architectural designs.
- a program code implementing the functionality of the method or system according to the invention may be sub-divided into one or more sub-routines. Many different ways of distributing the functionality among these sub-routines will be apparent to the skilled person.
- the subroutines may be stored together in one executable file to form a self-contained program.
- Such an executable file may comprise computer-executable instructions, for example, processor instructions and/or interpreter instructions (e.g. Java interpreter instructions).
- one or more or all of the sub-routines may be stored in at least one external library file and linked with a main program either statically or dynamically, e.g. at run-time.
- the main program contains at least one call to at least one of the sub-routines.
- the sub-routines may also comprise function calls to each other.
- An embodiment relating to a computer program product comprises computer-executable instructions corresponding to each processing step of at least one of the methods set forth herein. These instructions may be sub-divided into subroutines and/or stored in one or more files that may be linked statically or dynamically.
- Another embodiment relating to a computer program product comprises computer-executable instructions corresponding to each means of at least one of the systems and/or products set forth herein. These instructions may be sub-divided into sub-routines and/or stored in one or more files that may be linked statically or dynamically.
- the carrier of a computer program may be any entity or device capable of carrying the program.
- the carrier may include a storage medium, such as a ROM, for example, a CD ROM or a semiconductor ROM, or a magnetic recording medium, for example, a hard disk.
- the carrier may be a transmissible carrier such as an electric or optical signal, which may be conveyed via electric or optical cable or by radio or other means.
- the carrier may be constituted by such a cable or other device or means.
- the carrier may be an integrated circuit in which the program is embedded, the integrated circuit being adapted to perform, or to be used in the performance of, the relevant method.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Medical Informatics (AREA)
- General Health & Medical Sciences (AREA)
- Computer Graphics (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Radiology & Medical Imaging (AREA)
- Computer Vision & Pattern Recognition (AREA)
- General Engineering & Computer Science (AREA)
- Computer Hardware Design (AREA)
- Software Systems (AREA)
- Public Health (AREA)
- Primary Health Care (AREA)
- Epidemiology (AREA)
- Quality & Reliability (AREA)
- Apparatus For Radiation Diagnosis (AREA)
- Measuring And Recording Apparatus For Diagnosis (AREA)
- Magnetic Resonance Imaging Apparatus (AREA)
- Processing Or Creating Images (AREA)
- Image Processing (AREA)
Abstract
Description
Claims
Priority Applications (5)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201380008419.5A CN104412305B (en) | 2012-01-10 | 2013-01-10 | Image processing apparatus |
BR112014016816A BR112014016816A8 (en) | 2012-01-10 | 2013-01-10 | image processing apparatus for processing a medical image; workstation; imaging apparatus; method of processing a medical image; and computer program product |
JP2014551709A JP6467227B2 (en) | 2012-01-10 | 2013-01-10 | Image processing device |
EP13708901.7A EP2803044B1 (en) | 2012-01-10 | 2013-01-10 | Image processing apparatus |
US14/371,182 US9767594B2 (en) | 2012-01-10 | 2013-01-10 | Image processing apparatus |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201261584844P | 2012-01-10 | 2012-01-10 | |
US61/584,844 | 2012-01-10 |
Publications (2)
Publication Number | Publication Date |
---|---|
WO2013105042A2 true WO2013105042A2 (en) | 2013-07-18 |
WO2013105042A3 WO2013105042A3 (en) | 2014-10-30 |
Family
ID=47846086
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/IB2013/050210 WO2013105042A2 (en) | 2012-01-10 | 2013-01-10 | Image processing apparatus |
Country Status (6)
Country | Link |
---|---|
US (1) | US9767594B2 (en) |
EP (1) | EP2803044B1 (en) |
JP (1) | JP6467227B2 (en) |
CN (1) | CN104412305B (en) |
BR (1) | BR112014016816A8 (en) |
WO (1) | WO2013105042A2 (en) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2015150325A (en) * | 2014-02-18 | 2015-08-24 | 株式会社東芝 | Medical image processing apparatus and medical image processing method |
CN106548010A (en) * | 2016-08-10 | 2017-03-29 | 贵阳朗玛信息技术股份有限公司 | A kind of method and device of DICOM images remote browse |
Families Citing this family (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2013105042A2 (en) | 2012-01-10 | 2013-07-18 | Koninklijke Philips Electronics N.V. | Image processing apparatus |
EP2922477B1 (en) * | 2012-11-20 | 2018-01-10 | Koninklijke Philips N.V. | Automatic positioning of standard planes for real-time fetal heart evaluation |
US20150007087A1 (en) * | 2013-06-28 | 2015-01-01 | Silicon Graphics International Corp. | Rotation and translation of graphical scenes using virtual track ball |
US20150007096A1 (en) * | 2013-06-28 | 2015-01-01 | Silicon Graphics International Corp. | Rotation of graphical scenes |
US11144184B2 (en) | 2014-01-23 | 2021-10-12 | Mineset, Inc. | Selection thresholds in a visualization interface |
US20180357819A1 (en) * | 2017-06-13 | 2018-12-13 | Fotonation Limited | Method for generating a set of annotated images |
CN108542351A (en) * | 2018-01-26 | 2018-09-18 | 徐州云联医疗科技有限公司 | A kind of synchronous display system of medical image faultage image and 3 D anatomical image |
CN109003471A (en) * | 2018-09-16 | 2018-12-14 | 山东数字人科技股份有限公司 | A kind of 3 D human body supersonic anatomy tutoring system and method |
Family Cites Families (15)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH07508449A (en) | 1993-04-20 | 1995-09-21 | ゼネラル・エレクトリック・カンパニイ | Computer graphics and live video systems to better visualize body structures during surgical procedures |
CA2161126C (en) | 1993-04-22 | 2007-07-31 | Waldean A. Schulz | System for locating relative positions of objects |
AU2002218556A1 (en) | 2000-11-25 | 2002-06-03 | Jin-Wook Chung | 3 dimensional slab rendering system, method and computer-readable medium |
JP2004089599A (en) * | 2002-09-04 | 2004-03-25 | Hitachi Medical Corp | Image display device |
US7197170B2 (en) * | 2003-11-10 | 2007-03-27 | M2S, Inc. | Anatomical visualization and measurement system |
CN1981307A (en) * | 2004-05-17 | 2007-06-13 | 皇家飞利浦电子股份有限公司 | A medical imaging system for mapping a structure in a patient's body |
JP2008520312A (en) * | 2004-11-23 | 2008-06-19 | コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ | Image processing system and method for image display during intervention procedures |
US20080074422A1 (en) * | 2006-09-22 | 2008-03-27 | Doron Dekel | Method, system and computer program product for providing user-customizable standardized anatomical viewing protocols for volumetric data |
US7978191B2 (en) * | 2007-09-24 | 2011-07-12 | Dolphin Imaging Systems, Llc | System and method for locating anatomies of interest in a 3D volume |
JP5478328B2 (en) | 2009-09-30 | 2014-04-23 | 富士フイルム株式会社 | Diagnosis support system, diagnosis support program, and diagnosis support method |
US8860757B2 (en) | 2009-12-14 | 2014-10-14 | Smith & Nephew, Inc. | Visualization guided ACL localization system |
US20110161854A1 (en) | 2009-12-28 | 2011-06-30 | Monica Harit Shukla | Systems and methods for a seamless visual presentation of a patient's integrated health information |
JP5575491B2 (en) * | 2010-01-14 | 2014-08-20 | 株式会社東芝 | Medical diagnostic imaging equipment |
US10580325B2 (en) | 2010-03-24 | 2020-03-03 | Simbionix Ltd. | System and method for performing a computerized simulation of a medical procedure |
WO2013105042A2 (en) | 2012-01-10 | 2013-07-18 | Koninklijke Philips Electronics N.V. | Image processing apparatus |
-
2013
- 2013-01-10 WO PCT/IB2013/050210 patent/WO2013105042A2/en active Application Filing
- 2013-01-10 JP JP2014551709A patent/JP6467227B2/en active Active
- 2013-01-10 BR BR112014016816A patent/BR112014016816A8/en not_active IP Right Cessation
- 2013-01-10 CN CN201380008419.5A patent/CN104412305B/en active Active
- 2013-01-10 EP EP13708901.7A patent/EP2803044B1/en active Active
- 2013-01-10 US US14/371,182 patent/US9767594B2/en active Active
Non-Patent Citations (2)
Title |
---|
J.B.A. MAINTZ ET AL.: "An Overview of Medical Image Registration Methods", UU-CS-1998, 22 August 1998 (1998-08-22) |
MICHAEL TEISTLER: "Explore in 3D: a new virtual image navigation tool", SPIE NEWSROOM, 7 December 2011 (2011-12-07), Retrieved from the Internet <URL:http://spire.org/documents/Newsroom/Imported/222/2006070222.pdf> |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2015150325A (en) * | 2014-02-18 | 2015-08-24 | 株式会社東芝 | Medical image processing apparatus and medical image processing method |
CN106548010A (en) * | 2016-08-10 | 2017-03-29 | 贵阳朗玛信息技术股份有限公司 | A kind of method and device of DICOM images remote browse |
CN106548010B (en) * | 2016-08-10 | 2019-02-22 | 贵阳朗玛信息技术股份有限公司 | A kind of method and device of DICOM image remote browse |
Also Published As
Publication number | Publication date |
---|---|
US9767594B2 (en) | 2017-09-19 |
US20150015570A1 (en) | 2015-01-15 |
BR112014016816A2 (en) | 2017-06-13 |
BR112014016816A8 (en) | 2017-07-04 |
EP2803044B1 (en) | 2020-09-30 |
JP6467227B2 (en) | 2019-02-06 |
WO2013105042A3 (en) | 2014-10-30 |
CN104412305B (en) | 2018-07-17 |
JP2015511826A (en) | 2015-04-23 |
EP2803044A2 (en) | 2014-11-19 |
CN104412305A (en) | 2015-03-11 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP2803044B1 (en) | Image processing apparatus | |
US9956054B2 (en) | Dynamic minimally invasive surgical-aware assistant | |
EP2765776B1 (en) | Graphical system with enhanced stereopsis | |
US8977018B2 (en) | Multi-modality breast imaging | |
EP2923337B1 (en) | Generating a key-image from a medical image | |
JP5838215B2 (en) | Image and annotation display | |
JP6517953B2 (en) | Interactive mesh editing system and method | |
US9691157B2 (en) | Visualization of anatomical labels | |
EP2380140A2 (en) | Generating views of medical images | |
US9585569B2 (en) | Virtual endoscopic projection image generating device, method and program | |
CN108573514B (en) | Three-dimensional fusion method and device of images and computer storage medium | |
US20200118319A1 (en) | Visualization of anatomical cavities | |
JP2023004884A (en) | Rendering device for displaying graphical representation of augmented reality |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 13708901 Country of ref document: EP Kind code of ref document: A2 |
|
ENP | Entry into the national phase |
Ref document number: 2014551709 Country of ref document: JP Kind code of ref document: A |
|
WWE | Wipo information: entry into national phase |
Ref document number: 14371182 Country of ref document: US |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2013708901 Country of ref document: EP |
|
REG | Reference to national code |
Ref country code: BR Ref legal event code: B01A Ref document number: 112014016816 Country of ref document: BR |
|
ENP | Entry into the national phase |
Ref document number: 112014016816 Country of ref document: BR Kind code of ref document: A2 Effective date: 20140708 |