CN110689947A - Display device and display method - Google Patents
Display device and display method Download PDFInfo
- Publication number
- CN110689947A CN110689947A CN201810721235.8A CN201810721235A CN110689947A CN 110689947 A CN110689947 A CN 110689947A CN 201810721235 A CN201810721235 A CN 201810721235A CN 110689947 A CN110689947 A CN 110689947A
- Authority
- CN
- China
- Prior art keywords
- dimensional medical
- medical image
- image data
- target structure
- target
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H30/00—ICT specially adapted for the handling or processing of medical images
- G16H30/20—ICT specially adapted for the handling or processing of medical images for handling medical images, e.g. DICOM, HL7 or PACS
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/20—Image enhancement or restoration by the use of local operators
- G06T5/30—Erosion or dilatation, e.g. thinning
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/40—Image enhancement or restoration by the use of histogram techniques
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
- G06T7/136—Segmentation; Edge detection involving thresholding
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10004—Still image; Photographic image
- G06T2207/10012—Stereo images
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10072—Tomographic images
- G06T2207/10081—Computed x-ray tomography [CT]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30004—Biomedical image processing
- G06T2207/30008—Bone
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30004—Biomedical image processing
- G06T2207/30008—Bone
- G06T2207/30012—Spine; Backbone
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Radiology & Medical Imaging (AREA)
- Epidemiology (AREA)
- General Health & Medical Sciences (AREA)
- Medical Informatics (AREA)
- Primary Health Care (AREA)
- Public Health (AREA)
- Apparatus For Radiation Diagnosis (AREA)
Abstract
A display device, comprising: a database storing a plurality of three-dimensional medical image data; the partitioning module is used for segmenting the three-dimensional medical image according to an anatomical structure to form three-dimensional medical image data of a plurality of structures; a rendering module that generates a plurality of three-dimensional medical image datasets; an extraction module that extracts three-dimensional medical image datasets of a target structure and a non-target structure; and the configuration module defines color and transparency, respectively configures the three-dimensional medical image data sets of the target structure and the non-target structure, and outputs and displays the three-dimensional medical image data sets. Wherein the three-dimensional medical image data comprises at least two-dimensional medical images; the display device also comprises a preprocessing module which processes the two-dimensional medical image by histogram specification to enable the boundaries of all anatomical structures to be clearer. The invention also provides a display method. By the method and the device, each anatomical structure in the three-dimensional medical image can be extracted independently and displayed in a contrast mode.
Description
Technical Field
The invention relates to the field of medical teaching, in particular to a display device and a display method.
Background
The most common method for three-dimensional reconstruction of CT data in the imaging department is volume rendering, which is also a method well known to clinicians. In this way, CT cases taken by a patient can be converted into a colored three-dimensional volume. The interior voxels can be seen if the surface voxels are given a certain transparency. This provides some assistance to the physician in evaluating the patient's condition. However, when a complex part fracture, such as a pelvic fracture, is evaluated, the volume rendering imaging technology is used alone, although some technical methods can be adopted to remove the blocking between tissues, a certain fragment cannot be selected alone, and the relative position of the fracture fragment cannot be moved to observe, so that the case analysis of the complex part fracture is not facilitated.
Disclosure of Invention
In order to solve the above problem, the present invention provides a display device including:
a database for storing a plurality of three-dimensional medical image data;
the partitioning module is used for segmenting the three-dimensional medical image data according to an anatomical structure to form three-dimensional medical image data of a plurality of structures;
a rendering module for generating a plurality of three-dimensional medical image datasets;
an extraction module for extracting three-dimensional medical image datasets of a target structure and a non-target structure;
and the configuration module is used for defining color and transparency, respectively configuring the three-dimensional medical image data sets of the target structure and the non-target structure, and outputting and displaying the three-dimensional medical image data sets.
The three-dimensional medical image data comprises at least two-dimensional medical images.
The display device further comprises a preprocessing module for making the boundaries of the respective anatomical structures in the three-dimensional medical image data clearer.
The invention also provides a display method, which comprises the following steps:
s1) acquiring three-dimensional medical image data;
s2) preprocessing and segmentation: increasing the contrast of the three-dimensional medical image data, and segmenting the three-dimensional medical image data according to anatomical structures to form three-dimensional medical image data of each anatomical structure;
s3) generating a plurality of three-dimensional medical image data sets by adopting stereo rendering;
s4) extracting three-dimensional medical image datasets of target and non-target structures;
s5), defining color and transparency, respectively configuring the three-dimensional medical image data sets of the target structure and the non-target structure, and outputting and displaying.
The three-dimensional medical image data comprises at least two-dimensional medical images.
The preprocessing and segmenting comprises:
a) defining the contrast of the enhanced image by using a histogram;
b) dividing image pixel points into a plurality of classes by adopting threshold segmentation;
c) determining boundaries of the anatomical structure using a region growing technique;
d) the use of erosion and dilation techniques allows for more accurate delineation of anatomical structures.
And the three-dimensional rendering adopts three-dimensional light projection.
The stereo rendering adopts texture mapping.
The invention has the beneficial effects that: the invention generates a plurality of three-dimensional medical image data sets of anatomical structures by adopting three-dimensional rendering, respectively configures the colors and transparencies of the target structures and the non-target structures, and outputs and displays the data sets, thereby not only being capable of independently extracting the three-dimensional medical image of a certain anatomical structure for viewing and transferring, but also being capable of carrying out contrast display on a plurality of structures.
Drawings
FIG. 1 is a schematic flow chart of a display method of the present invention;
FIG. 2 is a schematic structural diagram of a display device according to the present invention;
FIG. 3 is a schematic three-dimensional structure of a first embodiment of the present invention;
FIG. 4 is a schematic structural diagram of a target structure shown separately in the first embodiment of the present invention;
FIG. 5 is a schematic diagram illustrating a comparison between a target structure and a non-target structure according to a first embodiment of the present invention;
FIG. 6 is a diagram illustrating a color and transparency mapping curve according to a first embodiment of the present invention;
FIG. 7 is a schematic three-dimensional structure of a second embodiment of the present invention;
FIG. 8 is a schematic structural diagram illustrating a plurality of target structures according to a second embodiment of the present invention;
FIG. 9 is a schematic structural diagram of a non-target structure according to a second embodiment of the present invention;
fig. 10 is a schematic structural diagram of a plurality of target structures simultaneously displayed according to a second embodiment of the present invention.
Detailed Description
The invention provides a display device and a display method, wherein a plurality of three-dimensional medical image sets are generated by adopting multi-stereo rendering, and the colors and the transparencies are respectively configured, so that not only can each anatomical structure be independently extracted, but also the contrast display of a plurality of anatomical structures can be carried out.
As shown in fig. 1, the display method includes:
s1), acquiring three-dimensional medical image data: opening at least two-dimensional medical images;
s2), preprocessing and segmenting the two-dimensional medical image according to the anatomical structure in the step S1) to form three-dimensional medical image data of each anatomical structure, wherein the three-dimensional medical image data comprises: a) defining and enhancing the contrast of the image by using a histogram, b) dividing pixel points of the image into a plurality of classes by using threshold segmentation, c) determining the boundary of the anatomical structure by using a region growing technology, and d) enabling the boundary of each anatomical structure to be more accurate by using a corrosion and expansion technology;
s3) performing stereo rendering according to the anatomical structures segmented in the step S2), wherein a plurality of three-dimensional medical image data sets of the anatomical structures are generated in the method in a stereo ray projection mode;
s4) extracting three-dimensional medical image data sets of the target structure and the non-target structure: the number of target structures can be 1 or more;
s5): defining color and transparency, respectively configuring the three-dimensional medical image data sets of the target structure and the non-target structure, and outputting and displaying.
As shown in fig. 2, a display device includes:
a database storing a plurality of three-dimensional medical image data including at least two-dimensional medical images;
a partitioning module for segmenting the three-dimensional medical image according to anatomical structures to form three-dimensional medical image data of a plurality of structures, comprising: a) The contrast of the image is enhanced by histogram regularization preprocessing, b) the image pixels are divided into a plurality of classes by threshold segmentation, c) the boundaries of the anatomical structures are determined by adopting a region growing technology, and d) the boundaries of the anatomical structures are more accurate by adopting a corrosion and expansion technology;
a rendering module that generates a plurality of three-dimensional medical image datasets;
an extraction module that extracts three-dimensional medical image datasets of a target structure and a non-target structure;
and the configuration module defines color and transparency, respectively configures the three-dimensional medical image data sets of the target structure and the non-target structure, and outputs and displays the three-dimensional medical image data sets.
The display device and the display method will be further described with reference to specific applications.
The first embodiment is as follows: contrast display of the thoracic cavity
S1) opening a three-dimensional medical image generated by a plurality of two-dimensional medical image sequences, wherein the two-dimensional medical image is a CT image of a clinical chest cavity;
and S2) preprocessing and segmenting the CT image according to the anatomical structure in the step S1) to form three-dimensional medical image data of each anatomical structure, wherein the three-dimensional medical image data comprises: a) defining and enhancing the contrast of the image by using a histogram, b) dividing pixel points of the image into a plurality of classes by using threshold segmentation, c) determining the boundary of the anatomical structure by using a region growing technology, and d) enabling the boundary of each anatomical structure to be more accurate by using a corrosion and expansion technology;
s3) generating a plurality of three-dimensional medical image data sets of the anatomical structure by means of stereo ray casting according to the anatomical structure segmented in the step S2), as shown in figure 3;
s4), extracting the sternum of the target structure, determining the structure except the sternum as a non-target structure, and forming two three-dimensional medical image data sets;
s5): defining colors and transparencies, configuring three-dimensional medical image datasets of sternum and non-target structures, respectively, such as:
1) separate extraction: in this mode, the transparency of the non-target structure is 100%, the interface displays the sternum of the target structure alone, as shown in fig. 4, the color and transparency of the sternum can be adjusted, and the sternum can be rotated, turned, moved and the like;
2) and (3) comparison shows that: in this mode, the sternum and non-target structures are provided with color and transparency maps, optionally adjusted simultaneously or separately:
m) simultaneously adjusting: setting a color transparency mapping curve as shown in fig. 6, by which an appropriate display state can be selected according to a desired observation position and angle, as shown in fig. 5, when transparency of the sternum increases, transparency of the non-target structure decreases, and when transparency of the non-target structure decreases to 100%, its display is as shown in fig. 4, consistent with the single extraction display;
n) adjusting: similarly to separate extractions, the color and transparency of the sternum and non-target structures can be set separately.
Example two: contrast display of multiple structures of waist and abdomen
S1) opening a three-dimensional medical image generated by a plurality of two-dimensional medical image sequences, wherein the two-dimensional medical image is a nuclear magnetic resonance image of the clinical abdomen;
and S2) preprocessing and segmenting the magnetic resonance image according to the anatomical structures in the step S1) to form three-dimensional medical image data of each anatomical structure, wherein the three-dimensional medical image data comprises: a) defining and enhancing the contrast of the image by using a histogram, b) dividing pixel points of the image into a plurality of classes by using threshold segmentation, c) determining the boundary of the anatomical structure by using a region growing technology, and d) enabling the boundary of each anatomical structure to be more accurate by using a corrosion and expansion technology;
s3) generating a plurality of three-dimensional medical image data sets of the anatomical structure by means of stereo ray casting according to the anatomical structure segmented in the step S2), as shown in figure 7;
s4), extracting target structure vertebrae, left ribs and right ribs, and determining the rest structures as non-target structures to form four three-dimensional medical image data sets;
s5): defining colors and transparencies, respectively configuring three-dimensional medical image datasets of vertebrae, left ribs, right ribs and non-target structures, such as:
1) separate extraction: in this mode, the transparency of the non-target structure is 100%, the interface can separately display the target structure vertebrae, the left rib, and the right rib as shown in fig. 8, and can adjust the color and transparency of the vertebrae, the left rib, and the right rib, and can also perform operations such as rotation, turning, and movement;
2) and (3) comparison shows that: in this mode, color and transparency mapping is set, and display is performed by adjusting the color and transparency of the vertebrae, the left ribs, the right ribs, and the non-target structures, and when the transparency of the target structure is 100%, the interface displays the non-target structures as shown in fig. 9, and when the transparency of the non-target structures is 100%, the interface displays the target structures as shown in fig. 10.
It is worth noting that the invention can determine the target structure and the non-target structure according to the user's requirement, and can check the target structure and the non-target structure in multiple angles and positions, including rotation, translation, overturn, etc., by setting the mapping attribute values of color and transparency.
The above description is only a preferred embodiment of the present invention, and is not intended to limit the technical scope of the present invention, so that any minor modifications, equivalent changes and modifications made to the above embodiment according to the technical spirit of the present invention are within the technical scope of the present invention.
Claims (8)
1. A display device, comprising:
a database for storing a plurality of three-dimensional medical image data;
the partitioning module is used for segmenting the three-dimensional medical image data according to an anatomical structure to form three-dimensional medical image data of a plurality of structures;
a rendering module for generating a plurality of three-dimensional medical image datasets;
an extraction module for extracting three-dimensional medical image datasets of a target structure and a non-target structure;
and the configuration module is used for defining color and transparency, respectively configuring the three-dimensional medical image data sets of the target structure and the non-target structure, and outputting and displaying the three-dimensional medical image data sets.
2. The display device according to claim 1, wherein the three-dimensional medical image data comprises at least two-dimensional medical images.
3. The display device of claim 1, further comprising a preprocessing module for sharpening boundaries of anatomical structures in the three-dimensional medical image data.
4. A display method, comprising:
s1) acquiring three-dimensional medical image data;
s2) preprocessing and segmentation: increasing the contrast of the three-dimensional medical image data, and segmenting the three-dimensional medical image data according to anatomical structures to form three-dimensional medical image data of each anatomical structure;
s3) generating a plurality of three-dimensional medical image data sets by adopting stereo rendering;
s4) extracting three-dimensional medical image datasets of target and non-target structures;
s5), defining color and transparency, respectively configuring the three-dimensional medical image data sets of the target structure and the non-target structure, and outputting and displaying.
5. The display method according to claim 4, wherein the three-dimensional medical image data includes at least two-dimensional medical images.
6. The display method according to claim 4, wherein the preprocessing and the segmenting comprise:
a) defining the contrast of the enhanced image by using a histogram;
b) dividing image pixel points into a plurality of classes by adopting threshold segmentation;
c) determining boundaries of the anatomical structure using a region growing technique;
d) the use of erosion and dilation techniques allows for more accurate delineation of anatomical structures.
7. The display method according to claim 4, wherein the stereoscopic rendering employs stereoscopic ray casting.
8. The display method according to claim 4, wherein the stereoscopic rendering employs texture mapping.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810721235.8A CN110689947A (en) | 2018-07-04 | 2018-07-04 | Display device and display method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810721235.8A CN110689947A (en) | 2018-07-04 | 2018-07-04 | Display device and display method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110689947A true CN110689947A (en) | 2020-01-14 |
Family
ID=69106322
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810721235.8A Pending CN110689947A (en) | 2018-07-04 | 2018-07-04 | Display device and display method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110689947A (en) |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102184565A (en) * | 2011-04-27 | 2011-09-14 | 深圳技师学院 | Non-grid three-dimensional reconstruction method for medical image |
| CN102332152A (en) * | 2011-09-09 | 2012-01-25 | 山东大学威海分校 | Local image segmentation method |
| CN103908299A (en) * | 2012-12-31 | 2014-07-09 | 通用电气公司 | Systems and methods for ultrasound image rendering |
| US20150371390A1 (en) * | 2013-01-29 | 2015-12-24 | Brainlab Ag | Three-Dimensional Image Segmentation Based on a Two-Dimensional Image Information |
| CN105354837A (en) * | 2015-10-13 | 2016-02-24 | 哈尔滨工程大学 | X-ray digestive tract image resolution evaluation method based on human anatomic structure |
| CN105389813A (en) * | 2015-10-30 | 2016-03-09 | 上海联影医疗科技有限公司 | Medical image organ recognition method and segmentation method |
| CN106446515A (en) * | 2016-08-31 | 2017-02-22 | 上海联影医疗科技有限公司 | Three-dimensional medical image display method and apparatus |
| CN107625533A (en) * | 2016-07-19 | 2018-01-26 | 东芝医疗系统株式会社 | Medical treatment device and medical treatment method |
| CN108010021A (en) * | 2017-11-30 | 2018-05-08 | 上海联影医疗科技有限公司 | A kind of magic magiscan and method |
-
2018
- 2018-07-04 CN CN201810721235.8A patent/CN110689947A/en active Pending
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102184565A (en) * | 2011-04-27 | 2011-09-14 | 深圳技师学院 | Non-grid three-dimensional reconstruction method for medical image |
| CN102332152A (en) * | 2011-09-09 | 2012-01-25 | 山东大学威海分校 | Local image segmentation method |
| CN103908299A (en) * | 2012-12-31 | 2014-07-09 | 通用电气公司 | Systems and methods for ultrasound image rendering |
| US20150371390A1 (en) * | 2013-01-29 | 2015-12-24 | Brainlab Ag | Three-Dimensional Image Segmentation Based on a Two-Dimensional Image Information |
| CN105354837A (en) * | 2015-10-13 | 2016-02-24 | 哈尔滨工程大学 | X-ray digestive tract image resolution evaluation method based on human anatomic structure |
| CN105389813A (en) * | 2015-10-30 | 2016-03-09 | 上海联影医疗科技有限公司 | Medical image organ recognition method and segmentation method |
| CN107625533A (en) * | 2016-07-19 | 2018-01-26 | 东芝医疗系统株式会社 | Medical treatment device and medical treatment method |
| CN106446515A (en) * | 2016-08-31 | 2017-02-22 | 上海联影医疗科技有限公司 | Three-dimensional medical image display method and apparatus |
| CN108010021A (en) * | 2017-11-30 | 2018-05-08 | 上海联影医疗科技有限公司 | A kind of magic magiscan and method |
Non-Patent Citations (1)
| Title |
|---|
| 林荔: "肝脏血管骨架的三维重建及实现", 《廊坊师范学院学报( 自然科学版)》 * |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Chen et al. | Automatic segmentation of individual tooth in dental CBCT images from tooth surface map by a multi-task FCN | |
| EP2545527B1 (en) | Probabilistic refinement of model-based segmentation | |
| CN107430690A (en) | Rebuild according to T1 MRI automatic 3D segmentations and cortical surface | |
| US20150131882A1 (en) | Medical image data processing apparatus and method | |
| US9129391B2 (en) | Semi-automated preoperative resection planning | |
| US9675317B2 (en) | Interface identification apparatus and method | |
| WO2012040721A2 (en) | Registration of scanned objects obtained from different orientations | |
| KR20210051141A (en) | Method, apparatus and computer program for providing augmented reality based medical information of patient | |
| EP3789965A1 (en) | Method for controlling a display, computer program and mixed reality display device | |
| CN107256575A (en) | A kind of three-dimensional tongue based on binocular stereo vision is as method for reconstructing | |
| AU2019430369B2 (en) | VRDS 4D medical image-based vein Ai endoscopic analysis method and product | |
| WO2011041475A1 (en) | Medical image analysis system using n-way belief propagation for anatomical images subject to deformation and related methods | |
| CN105869169B (en) | A kind of automatic division method of the micro- arrangement image of tumor tissues | |
| EP2483865A1 (en) | Medical image analysis system for anatomical images subject to deformation and related methods | |
| KR102433473B1 (en) | Method, apparatus and computer program for providing augmented reality based medical information of patient | |
| Piao et al. | Segmentation of cysts in kidney and 3-D volume calculation from CT images | |
| Myint et al. | Effective kidney segmentation using gradient based approach in abdominal CT images | |
| CN110689947A (en) | Display device and display method | |
| Liu et al. | Optimization of reconstruction of 2D medical images based on computer 3D reconstruction technology | |
| Macho et al. | Segmenting Teeth from Volumetric CT Data with a Hierarchical CNN-based Approach. | |
| Al-Shayeh et al. | Efficient 3D object visualization via 2D images | |
| CN105957062A (en) | Meniscus data partitioning method in knee joint MRI 3D reconstruction | |
| Kwon et al. | 3D segmentation for high-resolution image datasets using a commercial editing tool in the IoT environment | |
| Cheirsilp | 3D multimodal image analysis for lung-cancer assessment | |
| Pana et al. | 3D Brain Tumor Volume Reconstruction and Quantification using MRI Multi-modalities Brain Images |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20200114 |
|
| WD01 | Invention patent application deemed withdrawn after publication |