US20160019690A1 - System and method for aligning mammography images - Google Patents
System and method for aligning mammography images Download PDFInfo
- Publication number
- US20160019690A1 US20160019690A1 US14/334,522 US201414334522A US2016019690A1 US 20160019690 A1 US20160019690 A1 US 20160019690A1 US 201414334522 A US201414334522 A US 201414334522A US 2016019690 A1 US2016019690 A1 US 2016019690A1
- Authority
- US
- United States
- Prior art keywords
- mammography
- image
- images
- viewport
- boundary
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000009607 mammography Methods 0.000 title claims abstract description 191
- 238000000034 method Methods 0.000 title claims abstract description 52
- 210000000481 breast Anatomy 0.000 claims description 78
- 230000002123 temporal effect Effects 0.000 claims description 8
- 238000010586 diagram Methods 0.000 description 25
- 238000003384 imaging method Methods 0.000 description 8
- 238000004590 computer program Methods 0.000 description 4
- 238000009877 rendering Methods 0.000 description 4
- 230000005540 biological transmission Effects 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 238000004422 calculation algorithm Methods 0.000 description 2
- 210000002445 nipple Anatomy 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 238000012552 review Methods 0.000 description 2
- 230000005856 abnormality Effects 0.000 description 1
- 238000004458 analytical method Methods 0.000 description 1
- 210000004556 brain Anatomy 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 229940079593 drug Drugs 0.000 description 1
- 239000003814 drug Substances 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 238000010191 image analysis Methods 0.000 description 1
- 238000007726 management method Methods 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 210000000779 thoracic wall Anatomy 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/0002—Inspection of images, e.g. flaw detection
- G06T7/0012—Biomedical image inspection
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
- A61B6/50—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment specially adapted for specific body parts; specially adapted for specific clinical applications
- A61B6/502—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment specially adapted for specific body parts; specially adapted for specific clinical applications for diagnosis of breast, i.e. mammography
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
- A61B6/46—Arrangements for interfacing with the operator or the patient
- A61B6/461—Displaying means of special interest
- A61B6/463—Displaying means of special interest characterised by displaying multiple images or images and diagnostic data on one display
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
- A61B6/52—Devices using data or image processing specially adapted for radiation diagnosis
- A61B6/5211—Devices using data or image processing specially adapted for radiation diagnosis involving processing of medical diagnostic data
- A61B6/5229—Devices using data or image processing specially adapted for radiation diagnosis involving processing of medical diagnostic data combining image data of a patient, e.g. combining a functional image with an anatomical image
- A61B6/5235—Devices using data or image processing specially adapted for radiation diagnosis involving processing of medical diagnostic data combining image data of a patient, e.g. combining a functional image with an anatomical image combining images from the same or different ionising radiation imaging techniques, e.g. PET and CT
-
- G06K9/4604—
-
- G06K9/52—
-
- G06K9/6267—
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformations in the plane of the image
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/30—Determination of transform parameters for the alignment of images, i.e. image registration
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H30/00—ICT specially adapted for the handling or processing of medical images
- G16H30/40—ICT specially adapted for the handling or processing of medical images for processing medical images, e.g. editing
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H40/00—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices
- G16H40/60—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices
- G16H40/63—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices for local operation
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H50/00—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
- G16H50/20—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for computer-aided diagnosis, e.g. based on medical expert systems
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
- A61B6/48—Diagnostic techniques
- A61B6/486—Diagnostic techniques involving generating temporal series of image data
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10116—X-ray image
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30004—Biomedical image processing
- G06T2207/30068—Mammography; Breast
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V2201/00—Indexing scheme relating to image or video recognition or understanding
- G06V2201/03—Recognition of patterns in medical or anatomical images
Definitions
- the embodiments described herein relate to a system and method for image analysis and in particular to a system and method for the alignment of a plurality of physically scaled mammography images.
- Medical personnel examine mammography images to identify various abnormalities in a breast.
- the task of analyzing mammography images in a digital mammography system typically comprises of using a digital workstation with a display or viewport to align a pair of breast images acquired during a mammography study and comparing breast tissue images of the same side (left/right breast only) or symmetric sides (left and right breasts).
- the images used for comparison, while of the same object, may be acquired at different times, acquired with different imaging systems and/or acquired using different display settings.
- medical personnel desire mammography systems that facilitate efficient diagnostic reviews of mammography images, regardless of its provenance, so as to allow them to quickly compare and detect differences between mammographic images and report their findings within clinically acceptable time frames.
- one alignment protocol for images in the cranio-caudal (“CC”) view may involve placing the left and right CC breast views next to each other so that the chest walls will meet on the central vertical axis of the viewport. Similar arrangements, known to those skilled in the art, also exist for medio-lateral oblique (“MLO”) views.
- Other image alignment strategies include alignment based on anatomical features of the breast.
- CC images for example, the nipple located in each pair of images may be positioned so that they are horizontally aligned, that is, at the same height.
- MLO images either the nipple or pectoralis may be chosen as features used for alignment.
- the requirements with respect to mammographic images comparison are: 1) aligning the breast view so as to make the image comparison process easier and more efficient; 2) displaying mammographic images in the same physical scale such that a corresponding real object in each image is observed as the same size; and 3) ensuring that mammographic images are not panned so as to have image areas corresponding to breast tissue being partially outside the viewport or invisible to the examiner.
- a method and system for centering and aligning mammography images may provide greater symmetry is presented, thereby facilitating easier and faster side-by-side comparison.
- a method for aligning a plurality of physically scaled mammography images within at least one viewport comprising: categorizing each of the plurality of physically scaled mammography images based on a corresponding mammography view; determining image dimensions of each of the plurality of physically scaled mammography images based on pixel spacing; selecting a first mammography image from the plurality of physically scaled mammography images for each corresponding mammography view based on the image dimensions; centering the first mammography image within the at least one viewport; generating a virtual line across the at least one viewport based on a boundary of the first mammography image; and aligning each of the plurality of physically scaled mammography images corresponding to the mammography view such that a boundary of each of the plurality of physically scaled mammography images is aligned with the virtual line.
- the embodiments described herein provide in another aspect, the method wherein the first mammography is vertically centered within the viewport.
- the embodiments described herein provide in another aspect, the method wherein the virtual line is a horizontal virtual line.
- the boundary of the first mammography image consists of one of the following: a top boundary, a bottom boundary, a left boundary, and a right boundary.
- the boundary of each of the plurality of physically scaled images consists of one of the following: a top boundary, a bottom boundary, a left boundary, and a right boundary.
- the embodiments described herein provide in another aspect, the method wherein the plurality of physically scaled mammography images in the corresponding mammography view contains at least one right mammography image associated with at least one left mammography image, and wherein aligning each of the plurality of physically scaled mammography images further comprises aligning the at least one right mammography image with the at least one associated left mammography image.
- the embodiments described herein provide in another aspect, the method wherein the image dimensions are selected from a group consisting of: image height and image width.
- the embodiments described herein provide in another aspect, the method wherein the first mammography image is selected based on the largest image dimensions.
- the embodiments described herein provide in another aspect, the method wherein the plurality of mammography images each comprise a breast image region and wherein the image dimensions are determined based on the breast image region.
- the embodiments described herein provide in another aspect, the method wherein the plurality of mammography images include a first temporal image and an associated second temporal image, and wherein aligning each of the plurality of mammography images further comprises aligning the first temporal image with the associated second temporal image.
- the embodiments described herein provide in another aspect, the method wherein the pixel spacing is based on one of the following: a patient body coordinate system and a plate coordinate system.
- a physical non-transitory computer readable medium comprising instructions for aligning a plurality of physically scaled mammography images within at least one viewport, the instructions comprising: categorizing each of the plurality of physically scaled mammography images based on a corresponding mammography view; determining image dimensions of each of the plurality of physically scaled mammography images based on pixel spacing; selecting a first mammography image from the plurality of physically scaled mammography images for each corresponding mammography view based on the image dimensions; centering the first mammography image within the at least one viewport; generating a virtual line across the at least one viewport based on a boundary of the first mammography image; and aligning each of the plurality of physically scaled mammography images corresponding to the mammography view such that a boundary of each of the plurality of physically scaled mammography images is aligned with the virtual line.
- the embodiments described herein provide in another aspect, the physical non-transitory computer readable medium wherein the first mammography image is vertically centered within the viewport.
- the embodiments described herein provide in another aspect, the physical non-transitory computer readable medium wherein the virtual line is a horizontal virtual line.
- a system for aligning a plurality of physically scaled mammography images within at least one viewport comprising: a memory for the plurality of physically scaled breast images; a processor configured to: categorize each of the plurality of physically scaled mammography images based on a corresponding mammography view; determine image dimensions of each of the plurality of physically scaled mammography images based on pixel spacing; select a first mammography image from the plurality of physically scaled mammography images for each corresponding mammography view based on the image dimensions; center the first mammography image within the at least one viewport; generate a virtual line across the at least one viewport based on a boundary of the first mammography image; and align each of the plurality of physically scaled mammography images corresponding to the mammography view such that a boundary of each of the plurality of physically scaled mammography images is aligned with the virtual line.
- the embodiments described herein provide in another aspect, the system wherein the first mammography image is vertically centered within the viewport.
- the embodiments described herein provide in another aspect, the system wherein the virtual line is a horizontal virtual line.
- FIG. 1A is a block diagram of a mammography system.
- FIG. 1B is a flowchart diagram illustrating an alignment procedure.
- FIG. 1C is a schematic illustration of a plurality of mammographic images.
- FIG. 2A is a flowchart diagram detailing the alignment process.
- FIG. 2B is a flowchart diagram illustrating image categorization.
- FIG. 2C is a flowchart diagram illustrating the determination of image dimensions.
- FIGS. 3A-3D are schematic illustrations showing vertical centering and alignment of mammography images in the MLO view.
- FIGS. 4A-4D are schematic illustrations showing vertical centering and alignment of mammography images in the CC view.
- FIGS. 5A-5D are schematic illustrations showing horizontal centering and alignment of mammography images in the MLO view.
- FIGS. 6A-6D are schematic illustrations showing horizontal centering and alignment of mammography images in the CC view.
- the embodiments of the systems and methods described herein may be implemented in hardware or software, or a combination of both. However, preferably, these embodiments are implemented in computer programs executing on programmable computers each comprising at least one module component which comprises at least one processor (e.g. a microprocessor), a data storage system (including volatile and non-volatile memory and/or storage elements), at least one input device, and at least one output device.
- the programmable computers may be a personal computer, laptop, personal data assistant, and cellular telephone, smart-phone device, tablet computer, and/or wireless device.
- Program code is applied to input data to perform the functions described herein and generate output information.
- the output information is applied to one or more output devices, in known fashion.
- Each program is preferably implemented in a high level procedural or object oriented programming and/or scripting language to communicate with a computer system.
- the programs can be implemented in assembly or machine language, if desired. In any case, the language may be a compiled or interpreted language.
- Each such computer program is preferably stored on a storage media or a device (e.g. ROM, magnetic disk, optical disk) readable by a general or special purpose programmable computer, for configuring and operating the computer when the storage media or device is read by the computer to perform the procedures described herein.
- the subject system may also be considered to be implemented as a computer-readable storage medium, configured with a computer program, where the storage medium so configured causes a computer to operate in a specific and predefined manner to perform the functions described herein.
- the system, processes and methods of the described embodiments are capable of being distributed in a computer program product comprising a computer readable medium that bears computer usable instructions for one or more processors.
- the medium may be provided in various forms, including transitory and non-transitory forms, which include, but are not limited to, one or more diskettes, compact disks, tapes, chips, wireline transmissions, satellite transmissions, internet transmission or downloadings, magnetic and electronic storage media, digital and analog signals, and the like.
- the computer useable instructions may also be in various forms, including compiled and non-compiled code.
- an embodiment means “one or more (but not all) embodiments of the present invention(s),” unless expressly specified otherwise.
- FIG. 1A illustrates an example embodiment of a mammography system ( 100 A).
- Mammography system ( 100 A) may include any suitable processor ( 105 ) that is operatively coupled to memory ( 110 ).
- the memory ( 110 ) may store a plurality of physically scaled images ( 130 1 ) to ( 130 n ) (where ( 130 1 ) represents a first image and ( 130 n ) represents an nth image).
- the system ( 100 A) may include a rendering module ( 115 ) for rendering a plurality of images ( 130 1 ) to ( 130 n ), and a storage module (( 120 )) for storing a plurality of images ( 130 1 ) to ( 130 n ) and instructions for the processor ( 105 ) on a database ( 125 ).
- Images ( 130 1 ) to ( 130 n ) stored by the storage module ( 120 ) may be mammography images.
- the images themselves may be stored in the memory ( 110 ) or the database ( 125 ) or both.
- the images may be stored in computer readable storage media (not shown) such as magnetic or optical disc.
- the image metadata such as image headers may also be stored in the database ( 125 ) wherein client devices (e.g. a digital imaging work station) may query the database for metadata information.
- the images ( 130 1 ) to ( 130 n ) may be obtained from various imaging modalities, including an image projection on a single plane, overview images, rendered images (e.g. multi-planar reformatted images), or images derived from a series of spatially-related frames (e.g. in the case of a tomosynthesis image).
- database ( 125 ) is illustrated as residing in the memory ( 110 ) within the mammography system ( 100 A), it will be understood that database ( 125 ) may be stored and accessed remotely through a network connection, for example, using a Digital Imaging and Communications in Medicine (DICOM) protocol over a network communications protocols known to those skilled in the art (e.g. HTTP, FTP, SFTP).
- DICOM Digital Imaging and Communications in Medicine
- a network communications protocols e.g. HTTP, FTP, SFTP.
- the operations of the rendering module ( 115 ) and storage module ( 120 ) may be performed locally on the mammography system, remotely on the system where the database ( 125 ) resides, or on a third-party system configured to access database ( 125 ) and mammography system ( 100 ).
- FIG. 1B therein illustrated is a flowchart diagram ( 100 B) illustrating the overall image alignment procedure performed by the processor ( 105 ) of the mammography system ( 100 A).
- at least one property e.g. the mammographic view, image dimensions, etc.
- the processor ( 105 ) selects a first image ( 130 1 ) based on the chosen property and centers the image in the viewport at step ( 140 ).
- subsequent images are aligned to the first image along a chosen boundary of the first image.
- Images ( 130 1 ) to ( 130 n ) may comprise of images of the left breast, right breast, and both left and right breasts in the cranio-caudal (“CC”) and/or medio-lateral oblique (“MLO”) mammographic views. Additionally, images ( 130 1 ) to ( 130 n ) may represent a collection of images acquired from a variety of sources.
- the images may be digital scans of analog films, reconstructions of originally acquired images, and images acquired from a single imaging session and/or a series of imaging sessions spanning a defined period of time, wherein each imaging session may utilize a different image acquisition device.
- the images saved by the image acquisition device may include image header information containing image display settings associated with a specific display device or a common display device.
- Image dimensions associated with the images ( 130 1 ) to ( 130 n ) may be specified by referring to the image width ( 150 ) and image height ( 155 ) in association with the mammography image ( 160 ), or by referring to the breast image region width ( 170 ) or breast image region height ( 175 ) in association with the breast image region ( 180 ).
- the breast image region ( 180 ) maybe defined as the image region whose width and height is determined by the widest breast feature and the highest breast feature, respectively.
- the breast image region ( 180 ) may further be defined to encompass the largest frame of a multi-frame series of images such that the region encloses a projection of all frames onto a single parallel plane.
- the breast image region ( 180 ) may be defined as the sub-region of a mammography image ( 160 ) which contains all breast tissue such that the region maximizes breast tissue depiction.
- the boundaries of the mammography image or breast image region consist of a top boundary, a bottom boundary, a left boundary and a right boundary.
- the top boundary, bottom boundary, left boundary and right boundary may refer to the top, bottom, left and right sides of the image, respectively, as it would appear on a viewport after manipulation according to prescribed hanging protocol rules.
- FIGS. 2A to 2C are flowcharts illustrating in greater detail one embodiment of the image alignment process ( 200 ) performed by the mammography system ( 100 ).
- the process begins at step ( 210 ) upon the mammography system ( 100 ) receiving a plurality of physically scaled mammography images ( 130 1 ) to ( 130 n ).
- the processor ( 105 ) of the mammography system ( 100 ) categorizes the images ( 130 1 ) to ( 130 n ) based on a corresponding mammography view. In one embodiment, the processor ( 105 ) may categorize an image based on the mammographic view as either CC view or MLO view.
- the processor ( 105 ) determines the dimensions of the images ( 130 1 ) to ( 130 n ) based on pixel spacing, as illustrated in more detail in FIG. 2C .
- the processor ( 105 ) proceeds to align the images ( 130 1 ) to ( 130 n ) so as to allow comparison. Subsequent steps described in FIG. 2A , steps ( 240 ) to ( 270 ), are performed on each mammographic view.
- the processor ( 105 ) selects a first image on the basis of image dimension.
- image dimensions may be determined based on the image width ( 150 ) and image height ( 155 ), or breast image region width ( 170 ) and breast image region height ( 175 ).
- the first mammography image may be chosen from the collection of images on the basis that the chosen image has the largest width, height or both.
- the first mammography image ( 330 1 ) illustrated in FIG. 3A may be chosen on the basis that it has the largest image height ( 155 ).
- the first image ( 348 1 ) may be chosen on the basis that it has the largest breast image region height ( 175 ).
- step ( 250 ) the first mammography image is centered by the processor ( 105 ) within the viewport ( 332 ) and presented to the user by the rendering module ( 115 ). Centering of the first mammography image may be conducted with respect to either the horizontal axis or the vertical axis of the viewport ( 332 ).
- FIG. 3A provides an example of a vertically centered first image.
- FIG. 5A illustrates a horizontally centered first image.
- a virtual line is generated based on a boundary of the first mammography image.
- a virtual horizontal line may be generated along the top boundary of a vertically aligned image while a virtual vertical line maybe generated along the right boundary of a horizontally aligned image.
- FIG. 3A provides an example of a virtual horizontal line ( 334 A) generated along the top boundary ( 336 ) of the vertically centered first mammography image 330 1 .
- FIG. 5A provides an example of a virtual vertical line generated along the right boundary ( 556 ) of the horizontally centered first mammography image ( 530 1 ).
- subsequent images of the same category may be positioned with the first image such that a boundary of the subsequent image is aligned with the virtual line.
- the top boundary ( 344 ) of physically scaled mammography image ( 330 n ) may be aligned to the generated virtual horizontal line ( 334 A).
- the right boundary ( 564 ) of physically scaled mammography image ( 530 n ) is aligned to the generated virtual vertical line ( 554 A).
- step ( 220 ) of FIG. 2A therein illustrated is a flowchart diagram of the process referred to in step ( 220 ) of FIG. 2A to categorize mammography images based on mammographic view.
- the image header tags are extracted by the processor ( 105 ) after retrieving the images from the storage module ( 120 ).
- the processor ( 105 ) determines the mammography view (e.g. CC view or MLO view) based on the extracted tags.
- the processor ( 105 ) classifies the images according to the identified mammographic view.
- FIG. 2C therein illustrated is a flowchart diagram of the process referred to in step ( 230 ) of FIG. 2A to determine image dimensions (width and height) based on pixel spacing.
- the DICOM image format which is frequently used to digitally represent mammographic images, contain within the image header pixel spacing information.
- Pixel spacing may refer to the vertical spacing corresponding to the center-center distance between pixels of adjacent rows that belong to the same column, or horizontal spacing corresponding to the center-center distance between pixels of adjacent columns that belong to the same row.
- the pixel spacing may be specified with respect to the body coordinate system or the plate coordinate system.
- the body coordinate system reflects distances measured as if they were made on the patient body, while the plate coordinate system refers to distances as measured on the imaging plate.
- the mammographic system is configured to use the body coordinate system to represent image dimensions. Therefore images whose pixel spacing is based on plate coordinate system would require conversion to the body coordinate system before image comparisons can be made.
- the processor ( 105 ) extracts pixel spacing information from the image header for each image.
- the processor ( 105 ) determines whether the pixel spacing is based on the body coordinate system or plate coordinate system.
- the processor ( 105 ) For pixel spacing based on the body coordinate system, the processor ( 105 ) at step ( 233 ) counts the number of pixels in a row or column for each image. At step ( 234 ) the processor ( 105 ) determines the image dimensions by multiplying the pixel spacing by the number of pixels in a column or row corresponding to the mammography image or breast image region to determine the width or height, respectively.
- the processor ( 105 ) For pixel spacing based on the plate coordinate system, the processor ( 105 ) at step ( 235 ) counts the number of pixels in a row or column for each image. At step ( 236 ) the processor ( 105 ) determines the image dimensions by multiplying the pixel spacing by the number of pixels in a column or row corresponding to the mammography image or breast image region to determine image width or height, respectively. Finally, in step ( 237 ), the processor ( 105 ) converts the image dimensions from the plate coordinate system to the body coordinate system.
- FIGS. 3A-3D , 4 A- 4 D, 5 A- 5 D and 6 A- 6 D illustrate examples of positioning and displaying images.
- the examples show that the mammography image or breast image region may be centered in a viewport with respect to the viewport's horizontal axis or vertical axis. While the figures depict images positioned adjacent to each other, it is understood that such an arrangement is one of many ways aligned images may be presented for comparison.
- the plurality of images may be aligned and arranged in a stack within a viewport so that images may appear before or behind each other to allow the medical personnel to examine a series of aligned images by “scrolling” through a sequence of aligned images with a peripheral device such as a computer mouse.
- a combination of the previously mentioned arrangements may be used to facilitate image comparison. For instance, multiple viewports may be aligned according to a virtual line with each viewport presenting images arranged in stacks.
- FIGS. 3A and 3B illustrate vertical alignment of mammographic images in the MLO view.
- FIG. 3A therein illustrated is a schematic diagram of a first mammography image ( 330 1 ) in the MLO view vertically centered within the viewport ( 332 ).
- Vertically centering the first mammography image ( 330 1 ) may be accomplished by positioning the first mammography image ( 330 1 ) within the viewport ( 332 ) such that the vertical space above and below the first mammography image ( 330 1 ) within the viewport ( 332 ) are equal.
- a virtual horizontal line ( 334 A) may be generated corresponding to the top boundary ( 336 ) of the first physically scaled mammography image.
- FIG. 3B therein illustrated is a schematic diagram of a mammography image ( 330 n ) in the MLO view positioned within the viewport ( 332 ) adjacent to the first mammography image ( 3300 such that the top boundary ( 344 ) of the mammography image ( 330 n ) is aligned with the virtual horizontal line ( 334 A).
- FIGS. 3C and 3D illustrate vertical alignment of mammographic images in the MLO view based on the breast image region.
- FIG. 3C therein illustrated is a schematic diagram of a first breast image region ( 348 1 ) in the MLO view vertically centered within the viewport ( 332 ).
- Vertically centering the first breast image region ( 348 1 ) may be accomplished by positioning the first breast image region ( 348 1 ) within the viewport ( 332 ) such that the vertical space above and below the first breast image region ( 348 1 ) within the viewport ( 332 ) are equal.
- a virtual horizontal line ( 334 C) may be generated corresponding to the top boundary ( 338 ) of the first breast image region ( 3480 .
- FIG. 3D therein illustrated is a schematic diagram of a breast image region ( 348 n ) in the MLO view positioned within the viewport ( 332 ) adjacent to the first breast image region ( 348 1 ) such that the top boundary ( 346 ) of the breast image region ( 348 n ) is aligned with the virtual horizontal line ( 334 C).
- FIGS. 4A and 4B illustrate vertical alignment of mammographic images in the CC view.
- FIG. 4A therein illustrated is a schematic diagram of a first mammography image ( 430 1 ) in the CC view vertically centered within the viewport ( 332 ).
- Vertically centering the first mammography image ( 430 1 ) may be accomplished by positioning the first mammography image ( 430 1 ) within the viewport ( 332 ) such that the vertical space above and below the first mammography image ( 430 1 ) within the viewport ( 332 ) are equal.
- a virtual horizontal line ( 434 A) may be generated corresponding to the top boundary ( 436 ) of the first physically scaled mammography image.
- FIG. 4B therein illustrated is a schematic diagram of a mammography image ( 430 1 ) in the CC view positioned within the viewport ( 332 ) adjacent to the first mammography image 430 1 such that the top boundary ( 444 ) of the mammography image ( 430 1 ) is aligned with the virtual horizontal line ( 434 A).
- FIGS. 4C and 4D illustrate vertical alignment of mammographic images in the CC view based on the breast image region.
- FIG. 4C therein illustrated is a schematic diagram of a first breast image region ( 448 1 ) in the CC view vertically centered within the viewport ( 332 ).
- Vertically centering the first breast image region ( 448 1 ) may be accomplished by positioning the first breast image region ( 448 1 ) within the viewport ( 332 ) such that the vertical space above and below the first breast image region ( 448 1 ) within the viewport ( 332 ) are equal.
- a virtual horizontal line ( 434 C) may be generated corresponding to the top boundary ( 438 ) of the first breast image region ( 448 1 ).
- FIG. 4D therein illustrated is a schematic diagram of a breast image region ( 448 n ) in the CC view positioned within the viewport ( 332 ) adjacent to the first breast image region ( 448 1 ) such that the top boundary ( 446 ) of the breast image region ( 448 n ) is aligned with the virtual horizontal line ( 434 C).
- FIGS. 5A and 5B illustrate horizontal alignment of mammographic images in the MLO view.
- FIG. 5A therein illustrated is a schematic diagram of a first mammography image ( 530 1 ) in the MLO view horizontally centered within the viewport ( 332 ).
- Horizontally centering the first mammography image ( 530 1 ) may be accomplished by positioning the first mammography image ( 530 1 ) within the viewport ( 332 ) such that the horizontal space to the left and right the first mammography image ( 530 1 ) within the viewport ( 332 ) are equal.
- a virtual vertical line ( 554 A) may be generated corresponding to the right boundary ( 556 ) of the first physically scaled mammography image.
- FIG. 5B therein illustrated is a schematic diagram of a mammography image ( 530 n ) in the MLO view positioned within the viewport ( 332 ) adjacent to the first mammography image 530 1 such that the right boundary ( 564 ) of the mammography image ( 530 n ) is aligned with the virtual vertical line ( 554 A).
- FIGS. 5C and 5D illustrate horizontal alignment of mammographic images in the MLO view based on the breast image region.
- FIG. 5C therein illustrated is a schematic diagram of a first breast image region ( 548 1 ) in the MLO view horizontally centered within the viewport ( 332 ).
- Horizontally centering the first breast image region ( 548 1 ) may be accomplished by positioning the first breast image region ( 548 1 )within the viewport ( 332 ) such that the horizontal space to the left and right of the first breast image region ( 548 1 ) within the viewport ( 332 ) are equal.
- a virtual vertical line ( 554 C) may be generated corresponding to the right boundary ( 558 ) of the first breast image region ( 548 1 ).
- FIG. 5D therein illustrated is a schematic diagram of a breast image region ( 548 n ) in the MLO view positioned within the viewport ( 332 ) adjacent to the first breast image region ( 548 1 ) such that the right boundary ( 566 ) of the breast image region ( 548 n ) is aligned with the virtual vertical line ( 554 C).
- FIGS. 6A and 6B illustrate horizontal alignment of mammographic images in the CC view.
- FIG. 6A therein illustrated is a schematic diagram of a first mammography image ( 630 1 ) in the CC view horizontally centered within the viewport ( 332 ).
- Horizontally centering the first mammography image ( 630 1 ) may be accomplished by positioning the first mammography image ( 630 1 ) within the viewport ( 332 ) such that the horizontal space to the left and right of the first mammography image ( 630 1 ) within the viewport ( 332 ) are equal.
- a virtual vertical line ( 654 A) may be generated corresponding to the right boundary ( 656 ) of the first physically scaled mammography image.
- FIG. 6B therein illustrated is a schematic diagram of a mammography image ( 630 n ) in the CC view positioned within the viewport ( 332 ) adjacent to the first mammography image 630 1 such that the right boundary ( 664 ) of the mammography image ( 630 n ) is aligned with the virtual vertical line ( 654 A).
- FIGS. 6C and 6D illustrate horizontal alignment of mammographic images in the CC view based on the breast image region.
- FIG. 6C therein illustrated is a schematic diagram of a first breast image region ( 648 1 ) in the CC view horizontally centered within the viewport ( 332 ).
- Vertically centering the first breast image region ( 648 1 ) may be accomplished by positioning the first breast image region ( 648 1 ) within the viewport ( 332 ) such that the horizontal space to the left and right of the first breast image region ( 648 1 ) within the viewport ( 332 ) are equal.
- a virtual vertical line ( 654 C) may be generated corresponding to the right boundary ( 658 ) of the first breast image region ( 648 1 ).
- FIG. 6D therein illustrated is a schematic diagram of a breast image region ( 648 n ) in the CC view positioned within the viewport ( 332 ) adjacent to the first breast image region ( 648 1 ) such that the right boundary ( 666 ) of the breast image region ( 648 n ) is aligned with the virtual vertical line ( 654 C).
Landscapes
- Health & Medical Sciences (AREA)
- Engineering & Computer Science (AREA)
- Medical Informatics (AREA)
- Life Sciences & Earth Sciences (AREA)
- Public Health (AREA)
- Biomedical Technology (AREA)
- General Health & Medical Sciences (AREA)
- Physics & Mathematics (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Radiology & Medical Imaging (AREA)
- Pathology (AREA)
- Surgery (AREA)
- Optics & Photonics (AREA)
- Veterinary Medicine (AREA)
- Animal Behavior & Ethology (AREA)
- Epidemiology (AREA)
- Molecular Biology (AREA)
- Heart & Thoracic Surgery (AREA)
- Primary Health Care (AREA)
- Biophysics (AREA)
- High Energy & Nuclear Physics (AREA)
- Computer Vision & Pattern Recognition (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Business, Economics & Management (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Dentistry (AREA)
- General Business, Economics & Management (AREA)
- Databases & Information Systems (AREA)
- Data Mining & Analysis (AREA)
- Human Computer Interaction (AREA)
- Apparatus For Radiation Diagnosis (AREA)
- Quality & Reliability (AREA)
- Image Processing (AREA)
Abstract
Description
- 1. Field of the Invention
- The embodiments described herein relate to a system and method for image analysis and in particular to a system and method for the alignment of a plurality of physically scaled mammography images.
- 2. Description of the Related Art
- Medical personnel (e.g. radiologists) examine mammography images to identify various abnormalities in a breast. The task of analyzing mammography images in a digital mammography system typically comprises of using a digital workstation with a display or viewport to align a pair of breast images acquired during a mammography study and comparing breast tissue images of the same side (left/right breast only) or symmetric sides (left and right breasts). The images used for comparison, while of the same object, may be acquired at different times, acquired with different imaging systems and/or acquired using different display settings. As such, medical personnel desire mammography systems that facilitate efficient diagnostic reviews of mammography images, regardless of its provenance, so as to allow them to quickly compare and detect differences between mammographic images and report their findings within clinically acceptable time frames.
- Different types of image alignment protocols are employed for displaying mammography images of the breast for comparison. For example, one alignment protocol for images in the cranio-caudal (“CC”) view may involve placing the left and right CC breast views next to each other so that the chest walls will meet on the central vertical axis of the viewport. Similar arrangements, known to those skilled in the art, also exist for medio-lateral oblique (“MLO”) views. Other image alignment strategies include alignment based on anatomical features of the breast. In CC images, for example, the nipple located in each pair of images may be positioned so that they are horizontally aligned, that is, at the same height. For MLO images, either the nipple or pectoralis may be chosen as features used for alignment.
- In general, the requirements with respect to mammographic images comparison are: 1) aligning the breast view so as to make the image comparison process easier and more efficient; 2) displaying mammographic images in the same physical scale such that a corresponding real object in each image is observed as the same size; and 3) ensuring that mammographic images are not panned so as to have image areas corresponding to breast tissue being partially outside the viewport or invisible to the examiner.
- While currently employed alignment strategies satisfy the above listed requirements, these methods often result in reduced image symmetry, making image comparisons more time consuming. It is preferable to align images to achieve maximum symmetry so that they resemble mirrored images allowing the eyes and brain to quickly identify differences between images. Furthermore, breast features being obscured or missing due to the positioning of the breast during image acquisition may also make alignments relying on those features difficult or impossible. Consequently, a more robust and reliable alignment scheme is desirable. As described herein, a method and system for centering and aligning mammography images may provide greater symmetry is presented, thereby facilitating easier and faster side-by-side comparison.
- The following is a summary of the invention in order to provide a basic understanding of some aspects of the invention. This summary is not intended to identify key or critical elements of the invention or to delineate the scope of the invention. The sole purpose of this section is to present some concepts of the invention in a simplified form as a prelude to the more detailed description that is presented later.
- Because of these and other problems in the art, the embodiments described herein provide in one aspect, a method for aligning a plurality of physically scaled mammography images within at least one viewport. The method comprising: categorizing each of the plurality of physically scaled mammography images based on a corresponding mammography view; determining image dimensions of each of the plurality of physically scaled mammography images based on pixel spacing; selecting a first mammography image from the plurality of physically scaled mammography images for each corresponding mammography view based on the image dimensions; centering the first mammography image within the at least one viewport; generating a virtual line across the at least one viewport based on a boundary of the first mammography image; and aligning each of the plurality of physically scaled mammography images corresponding to the mammography view such that a boundary of each of the plurality of physically scaled mammography images is aligned with the virtual line.
- The embodiments described herein provide in another aspect, the method wherein the first mammography is vertically centered within the viewport.
- The embodiments described herein provide in another aspect, the method wherein the virtual line is a horizontal virtual line.
- The embodiments described herein provide in another aspect, the method wherein the boundary of the first mammography image consists of one of the following: a top boundary, a bottom boundary, a left boundary, and a right boundary.
- The embodiments described herein provide in another aspect, the method wherein the boundary of each of the plurality of physically scaled images consists of one of the following: a top boundary, a bottom boundary, a left boundary, and a right boundary.
- The embodiments described herein provide in another aspect, the method wherein the plurality of physically scaled mammography images in the corresponding mammography view contains at least one right mammography image associated with at least one left mammography image, and wherein aligning each of the plurality of physically scaled mammography images further comprises aligning the at least one right mammography image with the at least one associated left mammography image.
- The embodiments described herein provide in another aspect, the method wherein the image dimensions are selected from a group consisting of: image height and image width.
- The embodiments described herein provide in another aspect, the method wherein the first mammography image is selected based on the largest image dimensions.
- The embodiments described herein provide in another aspect, the method wherein the plurality of mammography images each comprise a breast image region and wherein the image dimensions are determined based on the breast image region.
- The embodiments described herein provide in another aspect, the method wherein the plurality of mammography images include a first temporal image and an associated second temporal image, and wherein aligning each of the plurality of mammography images further comprises aligning the first temporal image with the associated second temporal image.
- The embodiments described herein provide in another aspect, the method wherein the pixel spacing is based on one of the following: a patient body coordinate system and a plate coordinate system.
- The embodiments described herein provide in another aspect, a physical non-transitory computer readable medium comprising instructions for aligning a plurality of physically scaled mammography images within at least one viewport, the instructions comprising: categorizing each of the plurality of physically scaled mammography images based on a corresponding mammography view; determining image dimensions of each of the plurality of physically scaled mammography images based on pixel spacing; selecting a first mammography image from the plurality of physically scaled mammography images for each corresponding mammography view based on the image dimensions; centering the first mammography image within the at least one viewport; generating a virtual line across the at least one viewport based on a boundary of the first mammography image; and aligning each of the plurality of physically scaled mammography images corresponding to the mammography view such that a boundary of each of the plurality of physically scaled mammography images is aligned with the virtual line.
- The embodiments described herein provide in another aspect, the physical non-transitory computer readable medium wherein the first mammography image is vertically centered within the viewport.
- The embodiments described herein provide in another aspect, the physical non-transitory computer readable medium wherein the virtual line is a horizontal virtual line.
- The embodiments described herein provide in another aspect, a system for aligning a plurality of physically scaled mammography images within at least one viewport, the system comprising: a memory for the plurality of physically scaled breast images; a processor configured to: categorize each of the plurality of physically scaled mammography images based on a corresponding mammography view; determine image dimensions of each of the plurality of physically scaled mammography images based on pixel spacing; select a first mammography image from the plurality of physically scaled mammography images for each corresponding mammography view based on the image dimensions; center the first mammography image within the at least one viewport; generate a virtual line across the at least one viewport based on a boundary of the first mammography image; and align each of the plurality of physically scaled mammography images corresponding to the mammography view such that a boundary of each of the plurality of physically scaled mammography images is aligned with the virtual line.
- The embodiments described herein provide in another aspect, the system wherein the first mammography image is vertically centered within the viewport.
- The embodiments described herein provide in another aspect, the system wherein the virtual line is a horizontal virtual line.
- Further aspects and advantages of the embodiments described herein will appear from the following description taken together with the accompanying drawings.
- For a better understanding of the embodiments described herein and to show more clearly how they may be carried into effect, reference will now be made, by way of example only, to the accompanying drawings which show at least one exemplary embodiment.
-
FIG. 1A is a block diagram of a mammography system. -
FIG. 1B is a flowchart diagram illustrating an alignment procedure. -
FIG. 1C is a schematic illustration of a plurality of mammographic images. -
FIG. 2A is a flowchart diagram detailing the alignment process. -
FIG. 2B is a flowchart diagram illustrating image categorization. -
FIG. 2C is a flowchart diagram illustrating the determination of image dimensions. -
FIGS. 3A-3D are schematic illustrations showing vertical centering and alignment of mammography images in the MLO view. -
FIGS. 4A-4D are schematic illustrations showing vertical centering and alignment of mammography images in the CC view. -
FIGS. 5A-5D are schematic illustrations showing horizontal centering and alignment of mammography images in the MLO view. -
FIGS. 6A-6D are schematic illustrations showing horizontal centering and alignment of mammography images in the CC view. - The skilled person in the art will understand that the drawings, described below, are for illustration purposes only. The drawings are not intended to limit the scope of the applicants' teachings in anyway. Also, it will be appreciated that for simplicity and clarity of illustration, elements shown in the figures have not necessarily been drawn to scale. For example, the dimensions of some of the elements may be exaggerated relative to other elements for clarity. Further, where considered appropriate, reference numerals may be repeated among the figures to indicate corresponding or analogous elements.
- It will be appreciated that numerous specific details are set forth in order to provide a thorough understanding of the exemplary embodiments described herein. However, it will be understood by those of ordinary skill in the art that the embodiments described herein may be practiced without these specific details. In other instances, well-known methods, procedures and components have not been described in detail so as not to obscure the embodiments described herein. Furthermore, this description and the drawings are not to be considered as limiting the scope of the embodiments described herein in any way, but rather as merely describing the implementation of the various embodiments described herein. Where considered appropriate, for simplicity and clarity of illustration, reference numerals may be repeated among the figures to indicate corresponding or analogous elements or steps.
- The embodiments of the systems and methods described herein may be implemented in hardware or software, or a combination of both. However, preferably, these embodiments are implemented in computer programs executing on programmable computers each comprising at least one module component which comprises at least one processor (e.g. a microprocessor), a data storage system (including volatile and non-volatile memory and/or storage elements), at least one input device, and at least one output device. For example and without limitation, the programmable computers may be a personal computer, laptop, personal data assistant, and cellular telephone, smart-phone device, tablet computer, and/or wireless device. Program code is applied to input data to perform the functions described herein and generate output information. The output information is applied to one or more output devices, in known fashion.
- Each program is preferably implemented in a high level procedural or object oriented programming and/or scripting language to communicate with a computer system. However, the programs can be implemented in assembly or machine language, if desired. In any case, the language may be a compiled or interpreted language. Each such computer program is preferably stored on a storage media or a device (e.g. ROM, magnetic disk, optical disk) readable by a general or special purpose programmable computer, for configuring and operating the computer when the storage media or device is read by the computer to perform the procedures described herein. The subject system may also be considered to be implemented as a computer-readable storage medium, configured with a computer program, where the storage medium so configured causes a computer to operate in a specific and predefined manner to perform the functions described herein.
- Furthermore, the system, processes and methods of the described embodiments are capable of being distributed in a computer program product comprising a computer readable medium that bears computer usable instructions for one or more processors. The medium may be provided in various forms, including transitory and non-transitory forms, which include, but are not limited to, one or more diskettes, compact disks, tapes, chips, wireline transmissions, satellite transmissions, internet transmission or downloadings, magnetic and electronic storage media, digital and analog signals, and the like. The computer useable instructions may also be in various forms, including compiled and non-compiled code.
- The terms “an embodiment,” “embodiment,” “embodiments,” “the embodiment,” “the embodiments,” “one or more embodiments,” “some embodiments,” and “one embodiment” mean “one or more (but not all) embodiments of the present invention(s),” unless expressly specified otherwise.
- The terms “including,” “comprising” and variations thereof mean “including but not limited to,” unless expressly specified otherwise. A listing of items does not imply that any or all of the items are mutually exclusive, unless expressly specified otherwise. The terms “a,” “an” and “the” mean “one or more,” unless expressly specified otherwise.
- Further, although process steps, method steps, algorithms or the like may be described (in the disclosure and/or in the claims) in a sequential order, such processes, methods and algorithms may be configured to work in alternate orders. In other words, any sequence or order of steps that may be described does not necessarily indicate a requirement that the steps be performed in that order. The steps of processes described herein may be performed in any order that is practical. Further, some steps may be performed simultaneously.
- When a single device or article is described herein, it will be readily apparent that more than one device/article (whether or not they cooperate) may be used in place of a single device/article. Similarly, where more than one device or article is described herein (whether or not they cooperate), it will be readily apparent that a single device/article may be used in place of the more than one device or article.
-
FIG. 1A illustrates an example embodiment of a mammography system (100A). Mammography system (100A) may include any suitable processor (105) that is operatively coupled to memory (110). The memory (110) may store a plurality of physically scaled images (130 1) to (130 n) (where (130 1) represents a first image and (130 n) represents an nth image). The system (100A) may include a rendering module (115) for rendering a plurality of images (130 1) to (130 n), and a storage module ((120)) for storing a plurality of images (130 1) to (130 n) and instructions for the processor (105) on a database (125). - Images (130 1) to (130 n) stored by the storage module (120) may be mammography images. In some embodiments the images themselves may be stored in the memory (110) or the database (125) or both. In other embodiments, the images may be stored in computer readable storage media (not shown) such as magnetic or optical disc. In other embodiments, the image metadata such as image headers may also be stored in the database (125) wherein client devices (e.g. a digital imaging work station) may query the database for metadata information. The images (130 1) to (130 n) may be obtained from various imaging modalities, including an image projection on a single plane, overview images, rendered images (e.g. multi-planar reformatted images), or images derived from a series of spatially-related frames (e.g. in the case of a tomosynthesis image).
- While database (125) is illustrated as residing in the memory (110) within the mammography system (100A), it will be understood that database (125) may be stored and accessed remotely through a network connection, for example, using a Digital Imaging and Communications in Medicine (DICOM) protocol over a network communications protocols known to those skilled in the art (e.g. HTTP, FTP, SFTP). In this case, it will be further understood that the operations of the rendering module (115) and storage module (120) may be performed locally on the mammography system, remotely on the system where the database (125) resides, or on a third-party system configured to access database (125) and mammography system (100).
- Referring now to
FIG. 1B , therein illustrated is a flowchart diagram (100B) illustrating the overall image alignment procedure performed by the processor (105) of the mammography system (100A). At step (135), at least one property (e.g. the mammographic view, image dimensions, etc.) is determined for each of the images (130 1) to (130 n). The processor (105) then selects a first image (130 1) based on the chosen property and centers the image in the viewport at step (140). Lastly, at step (145), subsequent images are aligned to the first image along a chosen boundary of the first image. - Referring now to
FIG. 1C , therein illustrated is a schematic diagram (100C) of a plurality of images (130 1) to (130 n) stored by the storage module (120) in the database (125) within the mammography system (100A). Images (130 1) to (130 n) may comprise of images of the left breast, right breast, and both left and right breasts in the cranio-caudal (“CC”) and/or medio-lateral oblique (“MLO”) mammographic views. Additionally, images (130 1) to (130 n) may represent a collection of images acquired from a variety of sources. For example, the images may be digital scans of analog films, reconstructions of originally acquired images, and images acquired from a single imaging session and/or a series of imaging sessions spanning a defined period of time, wherein each imaging session may utilize a different image acquisition device. The images saved by the image acquisition device may include image header information containing image display settings associated with a specific display device or a common display device. - Image dimensions associated with the images (130 1) to (130 n) may be specified by referring to the image width (150) and image height (155) in association with the mammography image (160), or by referring to the breast image region width (170) or breast image region height (175) in association with the breast image region (180). In some embodiments, the breast image region (180) maybe defined as the image region whose width and height is determined by the widest breast feature and the highest breast feature, respectively. In another embodiment, the breast image region (180) may further be defined to encompass the largest frame of a multi-frame series of images such that the region encloses a projection of all frames onto a single parallel plane. In yet another embodiment, the breast image region (180) may be defined as the sub-region of a mammography image (160) which contains all breast tissue such that the region maximizes breast tissue depiction.
- The boundaries of the mammography image or breast image region consist of a top boundary, a bottom boundary, a left boundary and a right boundary. Generally the top boundary, bottom boundary, left boundary and right boundary may refer to the top, bottom, left and right sides of the image, respectively, as it would appear on a viewport after manipulation according to prescribed hanging protocol rules.
-
FIGS. 2A to 2C are flowcharts illustrating in greater detail one embodiment of the image alignment process (200) performed by the mammography system (100). - Referring now to
FIGS. 1A , 1B and 2A, the process begins at step (210) upon the mammography system (100) receiving a plurality of physically scaled mammography images (130 1) to (130 n). At step (220), the processor (105) of the mammography system (100) categorizes the images (130 1) to (130 n) based on a corresponding mammography view. In one embodiment, the processor (105) may categorize an image based on the mammographic view as either CC view or MLO view. At step (230), the processor (105) then determines the dimensions of the images (130 1) to (130 n) based on pixel spacing, as illustrated in more detail inFIG. 2C . - Having determined the dimensions and categorization of the images (130 1) to (130 n), the processor (105) proceeds to align the images (130 1) to (130 n) so as to allow comparison. Subsequent steps described in
FIG. 2A , steps (240) to (270), are performed on each mammographic view. - At step (240) the processor (105) selects a first image on the basis of image dimension. As will be explained further in
FIG. 2C , image dimensions may be determined based on the image width (150) and image height (155), or breast image region width (170) and breast image region height (175). Using image dimension as a desired basis of selection, the first mammography image may be chosen from the collection of images on the basis that the chosen image has the largest width, height or both. For example, the first mammography image (330 1) illustrated inFIG. 3A may be chosen on the basis that it has the largest image height (155). InFIG. 3C , the first image (348 1) may be chosen on the basis that it has the largest breast image region height (175). - In step (250) the first mammography image is centered by the processor (105) within the viewport (332) and presented to the user by the rendering module (115). Centering of the first mammography image may be conducted with respect to either the horizontal axis or the vertical axis of the viewport (332).
FIG. 3A provides an example of a vertically centered first image.FIG. 5A illustrates a horizontally centered first image. - In step (260), to facilitate alignment of subsequent images of the same category, a virtual line is generated based on a boundary of the first mammography image. In some embodiments, a virtual horizontal line may be generated along the top boundary of a vertically aligned image while a virtual vertical line maybe generated along the right boundary of a horizontally aligned image.
FIG. 3A provides an example of a virtual horizontal line (334A) generated along the top boundary (336) of the vertically centeredfirst mammography image 330 1.FIG. 5A provides an example of a virtual vertical line generated along the right boundary (556) of the horizontally centered first mammography image (530 1). - In step (270), subsequent images of the same category may be positioned with the first image such that a boundary of the subsequent image is aligned with the virtual line. As illustrated in
FIG. 3B , the top boundary (344) of physically scaled mammography image (330 n) may be aligned to the generated virtual horizontal line (334A). As illustrated further inFIG. 5B , the right boundary (564) of physically scaled mammography image (530 n) is aligned to the generated virtual vertical line (554A). - Referring now to
FIG. 2B , therein illustrated is a flowchart diagram of the process referred to in step (220) ofFIG. 2A to categorize mammography images based on mammographic view. At step (222), the image header tags are extracted by the processor (105) after retrieving the images from the storage module (120). At step (224) the processor (105) determines the mammography view (e.g. CC view or MLO view) based on the extracted tags. At step (226), the processor (105) classifies the images according to the identified mammographic view. - Referring now to
FIG. 2C , therein illustrated is a flowchart diagram of the process referred to in step (230) ofFIG. 2A to determine image dimensions (width and height) based on pixel spacing. For example, the DICOM image format which is frequently used to digitally represent mammographic images, contain within the image header pixel spacing information. Pixel spacing may refer to the vertical spacing corresponding to the center-center distance between pixels of adjacent rows that belong to the same column, or horizontal spacing corresponding to the center-center distance between pixels of adjacent columns that belong to the same row. The pixel spacing may be specified with respect to the body coordinate system or the plate coordinate system. It is generally understood that the body coordinate system reflects distances measured as if they were made on the patient body, while the plate coordinate system refers to distances as measured on the imaging plate. In some embodiments, the mammographic system is configured to use the body coordinate system to represent image dimensions. Therefore images whose pixel spacing is based on plate coordinate system would require conversion to the body coordinate system before image comparisons can be made. - At step (231) of
FIG. 2C , the processor (105) extracts pixel spacing information from the image header for each image. At step (232) the processor (105) determines whether the pixel spacing is based on the body coordinate system or plate coordinate system. - For pixel spacing based on the body coordinate system, the processor (105) at step (233) counts the number of pixels in a row or column for each image. At step (234) the processor (105) determines the image dimensions by multiplying the pixel spacing by the number of pixels in a column or row corresponding to the mammography image or breast image region to determine the width or height, respectively.
- For pixel spacing based on the plate coordinate system, the processor (105) at step (235) counts the number of pixels in a row or column for each image. At step (236) the processor (105) determines the image dimensions by multiplying the pixel spacing by the number of pixels in a column or row corresponding to the mammography image or breast image region to determine image width or height, respectively. Finally, in step (237), the processor (105) converts the image dimensions from the plate coordinate system to the body coordinate system.
-
FIGS. 3A-3D , 4A-4D, 5A-5D and 6A-6D, illustrate examples of positioning and displaying images. The examples show that the mammography image or breast image region may be centered in a viewport with respect to the viewport's horizontal axis or vertical axis. While the figures depict images positioned adjacent to each other, it is understood that such an arrangement is one of many ways aligned images may be presented for comparison. For instance, in some embodiments, the plurality of images may be aligned and arranged in a stack within a viewport so that images may appear before or behind each other to allow the medical personnel to examine a series of aligned images by “scrolling” through a sequence of aligned images with a peripheral device such as a computer mouse. In yet another embodiment, a combination of the previously mentioned arrangements may be used to facilitate image comparison. For instance, multiple viewports may be aligned according to a virtual line with each viewport presenting images arranged in stacks. -
FIGS. 3A and 3B illustrate vertical alignment of mammographic images in the MLO view. Referring now toFIG. 3A , therein illustrated is a schematic diagram of a first mammography image (330 1) in the MLO view vertically centered within the viewport (332). Vertically centering the first mammography image (330 1) may be accomplished by positioning the first mammography image (330 1) within the viewport (332) such that the vertical space above and below the first mammography image (330 1) within the viewport (332) are equal. With the first mammography image (3300 vertically centered, a virtual horizontal line (334A) may be generated corresponding to the top boundary (336) of the first physically scaled mammography image. - Referring now to
FIG. 3B , therein illustrated is a schematic diagram of a mammography image (330 n) in the MLO view positioned within the viewport (332) adjacent to the first mammography image (3300 such that the top boundary (344) of the mammography image (330 n) is aligned with the virtual horizontal line (334A). -
FIGS. 3C and 3D illustrate vertical alignment of mammographic images in the MLO view based on the breast image region. Referring now toFIG. 3C , therein illustrated is a schematic diagram of a first breast image region (348 1) in the MLO view vertically centered within the viewport (332). Vertically centering the first breast image region (348 1) may be accomplished by positioning the first breast image region (348 1) within the viewport (332) such that the vertical space above and below the first breast image region (348 1) within the viewport (332) are equal. With the first breast image region (348 1) vertically centered, a virtual horizontal line (334C) may be generated corresponding to the top boundary (338) of the first breast image region (3480. - Referring now to
FIG. 3D , therein illustrated is a schematic diagram of a breast image region (348 n) in the MLO view positioned within the viewport (332) adjacent to the first breast image region (348 1) such that the top boundary (346) of the breast image region (348 n) is aligned with the virtual horizontal line (334C). -
FIGS. 4A and 4B illustrate vertical alignment of mammographic images in the CC view. Referring now toFIG. 4A , therein illustrated is a schematic diagram of a first mammography image (430 1) in the CC view vertically centered within the viewport (332). Vertically centering the first mammography image (430 1) may be accomplished by positioning the first mammography image (430 1) within the viewport (332) such that the vertical space above and below the first mammography image (430 1) within the viewport (332) are equal. With the first mammography image (430 1) vertically centered, a virtual horizontal line (434A) may be generated corresponding to the top boundary (436) of the first physically scaled mammography image. - Referring now to
FIG. 4B , therein illustrated is a schematic diagram of a mammography image (430 1) in the CC view positioned within the viewport (332) adjacent to thefirst mammography image 430 1 such that the top boundary (444) of the mammography image (430 1) is aligned with the virtual horizontal line (434A). -
FIGS. 4C and 4D illustrate vertical alignment of mammographic images in the CC view based on the breast image region. Referring now toFIG. 4C , therein illustrated is a schematic diagram of a first breast image region (448 1) in the CC view vertically centered within the viewport (332). Vertically centering the first breast image region (448 1) may be accomplished by positioning the first breast image region (448 1) within the viewport (332) such that the vertical space above and below the first breast image region (448 1) within the viewport (332) are equal. With the first breast image region (448 1) vertically centered, a virtual horizontal line (434C) may be generated corresponding to the top boundary (438) of the first breast image region (448 1). - Referring now to
FIG. 4D , therein illustrated is a schematic diagram of a breast image region (448 n) in the CC view positioned within the viewport (332) adjacent to the first breast image region (448 1) such that the top boundary (446) of the breast image region (448 n) is aligned with the virtual horizontal line (434C). -
FIGS. 5A and 5B illustrate horizontal alignment of mammographic images in the MLO view. Referring now toFIG. 5A , therein illustrated is a schematic diagram of a first mammography image (530 1) in the MLO view horizontally centered within the viewport (332). Horizontally centering the first mammography image (530 1) may be accomplished by positioning the first mammography image (530 1) within the viewport (332) such that the horizontal space to the left and right the first mammography image (530 1) within the viewport (332) are equal. With the first mammography image (530 1) horizontally centered, a virtual vertical line (554A) may be generated corresponding to the right boundary (556) of the first physically scaled mammography image. - Referring now to
FIG. 5B , therein illustrated is a schematic diagram of a mammography image (530 n) in the MLO view positioned within the viewport (332) adjacent to the first mammography image 530 1 such that the right boundary (564) of the mammography image (530 n) is aligned with the virtual vertical line (554A). -
FIGS. 5C and 5D illustrate horizontal alignment of mammographic images in the MLO view based on the breast image region. Referring now toFIG. 5C , therein illustrated is a schematic diagram of a first breast image region (548 1) in the MLO view horizontally centered within the viewport (332). Horizontally centering the first breast image region (548 1) may be accomplished by positioning the first breast image region (548 1)within the viewport (332) such that the horizontal space to the left and right of the first breast image region (548 1) within the viewport (332) are equal. With the first breast image region (448 1) horizontally centered, a virtual vertical line (554C) may be generated corresponding to the right boundary (558) of the first breast image region (548 1). - Referring now to
FIG. 5D , therein illustrated is a schematic diagram of a breast image region (548 n) in the MLO view positioned within the viewport (332) adjacent to the first breast image region (548 1) such that the right boundary (566) of the breast image region (548 n) is aligned with the virtual vertical line (554C). -
FIGS. 6A and 6B illustrate horizontal alignment of mammographic images in the CC view. Referring now toFIG. 6A , therein illustrated is a schematic diagram of a first mammography image (630 1) in the CC view horizontally centered within the viewport (332). Horizontally centering the first mammography image (630 1) may be accomplished by positioning the first mammography image (630 1) within the viewport (332) such that the horizontal space to the left and right of the first mammography image (630 1) within the viewport (332) are equal. With the first mammography image (630 1) horizontally centered, a virtual vertical line (654A) may be generated corresponding to the right boundary (656) of the first physically scaled mammography image. - Referring now to
FIG. 6B , therein illustrated is a schematic diagram of a mammography image (630 n) in the CC view positioned within the viewport (332) adjacent to the first mammography image 630 1 such that the right boundary (664) of the mammography image (630 n) is aligned with the virtual vertical line (654A). -
FIGS. 6C and 6D illustrate horizontal alignment of mammographic images in the CC view based on the breast image region. Referring now toFIG. 6C , therein illustrated is a schematic diagram of a first breast image region (648 1) in the CC view horizontally centered within the viewport (332). Vertically centering the first breast image region (648 1) may be accomplished by positioning the first breast image region (648 1) within the viewport (332) such that the horizontal space to the left and right of the first breast image region (648 1) within the viewport (332) are equal. With the first breast image region (648 1) horizontally centered, a virtual vertical line (654C) may be generated corresponding to the right boundary (658) of the first breast image region (648 1). - Referring now to
FIG. 6D , therein illustrated is a schematic diagram of a breast image region (648 n) in the CC view positioned within the viewport (332) adjacent to the first breast image region (648 1) such that the right boundary (666) of the breast image region (648 n) is aligned with the virtual vertical line (654C). - While the above description provides examples of the embodiments, it will be appreciated that some features and/or functions of the described embodiments are susceptible to modification without departing from the spirit and principles of operation of the described embodiments. Accordingly, what has been described above has been intended to be illustrative of the invention and non-limiting and it will be understood by persons skilled in the art that other variants and modifications may be made without departing from the scope of the invention as defined in the claims appended hereto.
- It will be appreciated that while the present invention has been described in the context of medical image management in order to provide an application-specific illustration, it should be understood that the method and system presented could also be applied to any other type of image review and analysis system.
- Numerous specific details are set forth herein in order to provide a thorough understanding of the exemplary embodiments described herein. However, it will be understood by those of ordinary skill in the art that these embodiments may be practiced without these specific details. In other instances, well-known methods, procedures and components have not been described in detail so as not to obscure the description of the embodiments.
- While the invention has been disclosed in connection with certain preferred embodiments, this should not be taken as a limitation to all of the provided details. Modifications and variations of the described embodiments may be made without departing from the spirit and scope of the invention, and other embodiments should be understood to be encompassed in the present disclosure as would be understood by those of ordinary skill in the art.
Claims (17)
Priority Applications (5)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US14/334,522 US9256939B1 (en) | 2014-07-17 | 2014-07-17 | System and method for aligning mammography images |
EP15821383.5A EP3169223A4 (en) | 2014-07-17 | 2015-06-18 | System and method for aligning mammography images |
BR112017000886-6A BR112017000886B1 (en) | 2014-07-17 | 2015-06-18 | METHOD AND SYSTEM FOR ALIGNMENT OF A PLURALITY OF PHYSICALLY SCALE MAMMOGRAPHY IMAGES AND COMPUTER READable MEMORY |
CN201580038710.6A CN106535747B (en) | 2014-07-17 | 2015-06-18 | System and method for being directed at mammography image |
PCT/CA2015/000398 WO2016008028A1 (en) | 2014-07-17 | 2015-06-18 | System and method for aligning mammography images |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US14/334,522 US9256939B1 (en) | 2014-07-17 | 2014-07-17 | System and method for aligning mammography images |
Publications (2)
Publication Number | Publication Date |
---|---|
US20160019690A1 true US20160019690A1 (en) | 2016-01-21 |
US9256939B1 US9256939B1 (en) | 2016-02-09 |
Family
ID=55074984
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US14/334,522 Active 2034-08-01 US9256939B1 (en) | 2014-07-17 | 2014-07-17 | System and method for aligning mammography images |
Country Status (5)
Country | Link |
---|---|
US (1) | US9256939B1 (en) |
EP (1) | EP3169223A4 (en) |
CN (1) | CN106535747B (en) |
BR (1) | BR112017000886B1 (en) |
WO (1) | WO2016008028A1 (en) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20180292963A1 (en) * | 2017-04-10 | 2018-10-11 | Konica Minolta, Inc. | Medical image display apparatus and program |
WO2019145896A1 (en) | 2018-01-25 | 2019-08-01 | Per Hall | Compositions and methods for monitoring the treatment of breast disorders |
Families Citing this family (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP6126058B2 (en) | 2014-09-30 | 2017-05-10 | 富士フイルム株式会社 | Image display apparatus, image processing apparatus, radiographic imaging system, tomographic image display method, and tomographic image display program. |
EP3457353B1 (en) * | 2017-09-18 | 2020-11-25 | Siemens Healthcare GmbH | Method and system for obtaining a true shape of objects in a medical image |
CN110038179B (en) * | 2019-03-26 | 2021-01-26 | 文静 | Overflow catheter port disinfection cleaning device for mammography |
CN110473235A (en) * | 2019-09-12 | 2019-11-19 | 杭州依图医疗技术有限公司 | A kind of method and device being aligned two sides breast image |
CN111415332B (en) * | 2020-03-05 | 2023-10-24 | 北京深睿博联科技有限责任公司 | Mammary gland X-ray image linkage method and device |
Family Cites Families (28)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE69312257T2 (en) | 1993-02-11 | 1998-01-29 | Agfa Gevaert Nv | Radiation field detection method |
US5825936A (en) | 1994-09-22 | 1998-10-20 | University Of South Florida | Image analyzing device using adaptive criteria |
EP0742536B1 (en) | 1995-05-11 | 2000-09-13 | Agfa-Gevaert N.V. | Method of recognising one or more irradiation fields |
EP0887769B1 (en) | 1997-06-05 | 2002-03-13 | Agfa-Gevaert | Method of segmenting a radiation image into direct exposure area and diagnostically relevant area |
US5999639A (en) | 1997-09-04 | 1999-12-07 | Qualia Computing, Inc. | Method and system for automated detection of clustered microcalcifications from digital mammograms |
WO2002015113A2 (en) | 2000-08-14 | 2002-02-21 | University Of Maryland, Baltimore County | Mammography screening to detect and classify microcalcifications |
FR2818781B1 (en) | 2000-12-22 | 2003-03-21 | Ge Med Sys Global Tech Co Llc | METHOD OF SIMULTANEOUSLY DISPLAYING ORGAN IMAGES |
EP1256907B1 (en) | 2001-05-10 | 2008-03-05 | Agfa HealthCare NV | Retrospective correction of inhomogeneities in radiographs |
US7680315B2 (en) | 2001-11-21 | 2010-03-16 | Hologic, Inc. | Facilitating computer-aided detection, comparison, or display of medical images |
US7203348B1 (en) | 2002-01-18 | 2007-04-10 | R2 Technology, Inc. | Method and apparatus for correction of mammograms for non-uniform breast thickness |
US8571289B2 (en) * | 2002-11-27 | 2013-10-29 | Hologic, Inc. | System and method for generating a 2D image from a tomosynthesis data set |
US7616818B2 (en) | 2003-02-19 | 2009-11-10 | Agfa Healthcare | Method of determining the orientation of an image |
JP2006061472A (en) | 2004-08-27 | 2006-03-09 | Fuji Photo Film Co Ltd | Breast image display device, and program therefor |
JP2006068373A (en) | 2004-09-03 | 2006-03-16 | Fuji Photo Film Co Ltd | Mammilla detector and program thereof |
US7519207B2 (en) | 2004-11-19 | 2009-04-14 | Carestream Health, Inc. | Detection and correction method for radiograph orientation |
US7646902B2 (en) | 2005-02-08 | 2010-01-12 | Regents Of The University Of Michigan | Computerized detection of breast cancer on digital tomosynthesis mammograms |
US7885443B2 (en) | 2005-11-14 | 2011-02-08 | Hologic, Inc. | Facilitating temporal comparison of medical images |
US20070206844A1 (en) | 2006-03-03 | 2007-09-06 | Fuji Photo Film Co., Ltd. | Method and apparatus for breast border detection |
US8208700B2 (en) | 2007-05-15 | 2012-06-26 | Three Palm Software | Mass spicules detection and tracing from digital mammograms |
US20090060300A1 (en) | 2007-08-30 | 2009-03-05 | Fujifilm Corporation | Method and apparatus for image alignment |
US20110222752A1 (en) | 2008-04-08 | 2011-09-15 | Three Palm Software | Microcalcification enhancement from digital mammograms |
US8164039B2 (en) | 2008-04-30 | 2012-04-24 | Board Of Regents, The University Of Texas System | Method and apparatus for detecting spiculated masses in mammography |
DE102008035566B4 (en) * | 2008-07-30 | 2018-09-06 | Image Diagnost International Gmbh | A method of processing a finding entered in a mammogram |
EP2462561B1 (en) * | 2009-08-03 | 2018-10-31 | Volpara Health Technologies Limited | A method and system for analysing tissue from images |
WO2011058482A2 (en) * | 2009-11-12 | 2011-05-19 | Koninklijke Philips Electronics N.V. | Visualization of an object and an annotation |
US8649578B2 (en) | 2010-03-08 | 2014-02-11 | Agfa Healthcare Inc. | Method and system for defining a breast window |
WO2013093687A1 (en) | 2011-12-22 | 2013-06-27 | Koninklijke Philips Electronics N.V. | Processing and displaying a breast image |
EP2631873B1 (en) | 2012-02-27 | 2015-12-16 | Agfa Healthcare | Image alignment of breast images |
-
2014
- 2014-07-17 US US14/334,522 patent/US9256939B1/en active Active
-
2015
- 2015-06-18 BR BR112017000886-6A patent/BR112017000886B1/en active IP Right Grant
- 2015-06-18 WO PCT/CA2015/000398 patent/WO2016008028A1/en active Application Filing
- 2015-06-18 CN CN201580038710.6A patent/CN106535747B/en not_active Expired - Fee Related
- 2015-06-18 EP EP15821383.5A patent/EP3169223A4/en not_active Withdrawn
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20180292963A1 (en) * | 2017-04-10 | 2018-10-11 | Konica Minolta, Inc. | Medical image display apparatus and program |
WO2019145896A1 (en) | 2018-01-25 | 2019-08-01 | Per Hall | Compositions and methods for monitoring the treatment of breast disorders |
Also Published As
Publication number | Publication date |
---|---|
WO2016008028A1 (en) | 2016-01-21 |
EP3169223A1 (en) | 2017-05-24 |
BR112017000886A2 (en) | 2017-11-14 |
BR112017000886B1 (en) | 2022-10-04 |
CN106535747A (en) | 2017-03-22 |
CN106535747B (en) | 2019-09-06 |
US9256939B1 (en) | 2016-02-09 |
EP3169223A4 (en) | 2018-05-16 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US9256939B1 (en) | System and method for aligning mammography images | |
US20230352152A1 (en) | Systems and methods for controlling user repeatability and reproducibility of automated image annotation correction | |
US20230054121A1 (en) | System and method for synthesizing low-dimensional image data from high-dimensional image data using an object grid enhancement | |
US11399790B2 (en) | System and method for hierarchical multi-level feature image synthesis and representation | |
US9747421B2 (en) | Multi-factor brain analysis via medical imaging decision support systems and methods | |
US11751832B2 (en) | CTA large vessel occlusion model | |
US8135195B2 (en) | Systems and methods for synchronized image viewing with an image atlas | |
US8254648B2 (en) | Method for providing adaptive hanging protocols for image reading | |
KR101957811B1 (en) | Method for computing severity with respect to dementia of subject based on medical image and apparatus using the same | |
EP2631873B1 (en) | Image alignment of breast images | |
WO2017164204A1 (en) | Method and apparatus for extracting diagnosis object from medical document | |
US9474497B2 (en) | Method and system for generating pre-scaled images for a series of mammography images | |
US20140139402A1 (en) | Method for producing logical area-based hanging protocols for multiple monitor workstations | |
US20200321098A1 (en) | System and method for viewing medical image | |
US20080240524A1 (en) | Organ based hanging protocol for a diagnostic reading workstation | |
Gandomkar et al. | Can eye‐tracking metrics be used to better pair radiologists in a mammogram reading task? | |
KR101923962B1 (en) | Method for facilitating medical image view and apparatus using the same | |
CN107157475B (en) | Display method of electrocardiogram data and terminal equipment | |
US20230342928A1 (en) | Detecting ischemic stroke mimic using deep learning-based analysis of medical images | |
US20200138383A1 (en) | Medical information processing apparatus and medical information processing method | |
WO2024102765A1 (en) | Registration based medical image analysis |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: AGFA HEALTHCARE, CANADA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:BEDIZ, MEHMET;HITZELBERGER, RONALD DALE;SIGNING DATES FROM 20141107 TO 20141110;REEL/FRAME:034230/0802 |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
AS | Assignment |
Owner name: AGFA HEALTHCARE INC., CANADA Free format text: CORRECTIVE ASSIGNMENT TO CORRECT THE RECEIVING PARTY DATA NAME PREVIOUSLY RECORDED ON REEL 034230 FRAME 0802. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:BEDIZ, MEHMET;REEL/FRAME:045922/0071 Effective date: 20170823 |
|
AS | Assignment |
Owner name: AGFA HEALTHCARE INC., CANADA Free format text: CORRECTIVE ASSIGNMENT TO CORRECT THE RECEIVING PARTY DATA NAME PREVIOUSLY RECORDED ON REEL 034230 FRAME 0802. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:HITZELBERGER, RONALD DALE;BEDIZ, MEHMET;SIGNING DATES FROM 20170823 TO 20170829;REEL/FRAME:046495/0524 |
|
FEPP | Fee payment procedure |
Free format text: SURCHARGE FOR LATE PAYMENT, LARGE ENTITY (ORIGINAL EVENT CODE: M1554); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
MAFP | Maintenance fee payment |
Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1551); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY Year of fee payment: 4 |
|
AS | Assignment |
Owner name: AGFA HEALTHCARE INC., CANADA Free format text: CORRECTIVE ASSIGNMENT TO CORRECT THE PROPERTY NUMBER PCT/US/15/00398 AND THE ASSIGNOR'S DATA PREVIOUSLY RECORDED ON REEL 045922 FRAME 0071. ASSIGNOR(S) HEREBY CONFIRMS THE CORRECTIVE ASSIGNMENT;ASSIGNORS:BEDIZ, MEHMET;HITZELBERGER, RONALD DALE;SIGNING DATES FROM 20170823 TO 20170829;REEL/FRAME:052423/0480 |
|
MAFP | Maintenance fee payment |
Free format text: PAYMENT OF MAINTENANCE FEE, 8TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1552); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY Year of fee payment: 8 |