CN110211216A - A kind of 3-D image airspace fusion method based on the weighting of volume drawing opacity - Google Patents
A kind of 3-D image airspace fusion method based on the weighting of volume drawing opacity Download PDFInfo
- Publication number
- CN110211216A CN110211216A CN201910516549.9A CN201910516549A CN110211216A CN 110211216 A CN110211216 A CN 110211216A CN 201910516549 A CN201910516549 A CN 201910516549A CN 110211216 A CN110211216 A CN 110211216A
- Authority
- CN
- China
- Prior art keywords
- image
- volume
- fusion
- opacity
- volume drawing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T15/00—3D [Three Dimensional] image rendering
- G06T15/08—Volume rendering
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T15/00—3D [Three Dimensional] image rendering
- G06T15/10—Geometric effects
- G06T15/20—Perspective computation
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Computer Graphics (AREA)
- General Physics & Mathematics (AREA)
- Computing Systems (AREA)
- Geometry (AREA)
- Image Generation (AREA)
Abstract
The present invention relates to a kind of 3-D image airspace fusion methods based on the weighting of volume drawing opacity, belong to 3-D image integration technology field.This method combines Direct Volume Rendering Techniques and pixel-level image fusion technology, and 3 d image data is carried out fusion treatment as a whole.Firstly, selecting interested content by volume drawing opacity transfer function；Then image co-registration weight is set by volume drawing opacity；Fusion is weighted in image airspace according still further to the weight of setting.It is thus achieved that between different 3 d image datas content of interest fusion, achieve relatively good syncretizing effect.Method of the invention puts on an equal footing each dimension of 3 d image data, directly presentation three-dimensional spatial information, is conducive to the analysis of space structure and position morphological feature in 3 d image data.
Description
Technical field
The present invention relates to a kind of image interfusion method, in particular to a kind of three-dimensional figure based on the weighting of volume drawing opacity
As airspace fusion method, belong to 3-D image integration technology field.
Background technique
With being widely used for modern imaging techniques and image modalities, many application fields produce a large amount of different moulds
The 3 d image data of state.Due to the difference of image-forming principle and purposes, the content that the data of different modalities are stressed also has obviously
Difference.For example, CT (Computed Tomography) image, which can compare, clearly displays high density institutional framework, still
The image of density regions is then relatively fuzzyyer；And MRI (Magnetic Resonance Imaging) image relatively good can be caught
Obtain the detailed information of soft low density tissue.In practical applications, it in order to obtain the more comprehensive information of research object, often needs
The fusing image data of the different modalities of distinct device acquisition is got up to carry out comprehensive analysis.
For this purpose, domestic and foreign scholars propose many image fusion technologies and method.According to data characterization level when fusion
These technology and methods can be divided into Pixel-level fusion, feature-based fusion and decision level fusion by difference.Wherein, Pixel-level merges
Refer under the premise of image rigid registrations, raw image data fusion is got up according to certain fusion rule or strategy.
Most of traditional image co-registration work is carried out on the two dimensional image either two dimension slicing of 3-D image
's.For this 3 d image data collected for modern imaging devices, there is obvious limitation.Because this
In the case of, practical study object is all 3D solid, and the fusion based on both two-dimensional image slices can not be using between contiguous slices
Neighborhood relevance, as a result, the three-D space structure information of loss research object.If directly to 3 d image data into
Row fusion, then can effectively avoid this problem.Occur a variety of 3-D image fusion methods as a result, such as airspace Weighted Fusion side
Method, maximin fusion method etc..Compared with two-dimentional fusion method, three-dimensional fusion method puts on an equal footing each dimension, is protecting
It is more advantageous to hold three-D space structure message context, better syncretizing effect can be obtained.But carefully analyze the prior art
It is seen that: most of 3-D image fusion is all based on entire image to be fused come what is done, does not account for institute in practical application
Concern is often the interested content in part (such as certain specific institutional framework or region).In addition, analyzing and looking into
When seeing three-dimensional fusion result, it is often returned to two dimension slicing space.This was both related with practical application habit, and (people get used to looking into
See two-dimensional slice image), it is also related with the visualization difficulty of 3 d image data that (3 d image data cannot be directly displayed at two
It ties up on screen).
Direct Volume Rendering Techniques (Direct Volume Rendering) are a kind of directly visual to three-dimensional data progress
The technology of change can effectively disclose the structural information inside three-dimensional data.For example, passing through the opacity for adjusting volume drawing
Transmission function (Opacity Transfer Function) can show the space structure of Hidden object in three dimensional CT data
Come.Therefore, visual analyzing can be carried out to 3 d image data by Direct Volume Rendering Techniques, directly with the side of tripleplane
Formula checks interested content.Key therein is to be arranged and adjust volume drawing opacity transfer function, emerging to feel
The content of interest is shown in a manner of tripleplane.Compared with traditional slice checks mode, this mode can directly be felt
Know three-D space structure information, does not need that three-dimensional scenic is removed to imagine and reconstructed according to two-dimensional slice image.But this mode exists
Also the information fusion problem between different 3 d image datas is faced in practical application.
In view of the foregoing, the present invention proposes a kind of 3-D image airspace fusion side based on the weighting of volume drawing opacity
Method.3 d image data as whole rather than slice progress fusion treatment, is combined direct body painting by this method on this basis
Technology processed and pixel-level image fusion technology, realize the fusion of content of interest between different 3 d image datas, achieve
Relatively good syncretizing effect.
Summary of the invention
The object of the present invention is to provide it is a kind of based on volume drawing opacity weighting 3-D image airspace fusion method, with
Just it under the premise of keeping three-D space structure information, realizes the fusion of content of interest between different 3 d image datas and shows
Show.
The purpose of the present invention is what is be achieved through the following technical solutions.
A kind of 3-D image airspace fusion method based on the weighting of volume drawing opacity, comprising the following steps:
Two step 1, input 3-D image volume datas to be fused, enable it for V respectivelyAAnd VB；
Step 2 is required according to Direct Volume Rendering Techniques, and V is respectively setAAnd VBOpaque transfer function OTFAAnd OTFB,
To VAAnd VBDirect volume drawing is carried out, the volume drawing result I of corresponding content of interest is obtainedAAnd IB；
Step 3, according to opacity transfer function OTFAAnd OTFB, calculate separately volume data VAAnd VBIn each voxel
Opaque value obtains corresponding opacity volume data OAAnd OB；OAAnd OBCircular be:
OA(i, j, k)=OTFA(VA(i,j,k)), (1)
OB(i, j, k)=OTFB(VB(i,j,k)), (2)
Wherein (i, j, k) is that the voxel of volume data is numbered；
Step 4 calculates separately volume data V according to following formula (3) and (4)AAnd VBWeight coefficient WAAnd WB:
WA(i, j, k)=OA(i,j,k)/(OA(i,j,k)+OB(i,j,k)), (3)
WB(i, j, k)=OB(i,j,k)/(OA(i,j,k)+OB(i,j,k)), (4)
Wherein (i, j, k) is that the voxel of volume data is numbered；
Step 5 enables volume data VAAnd VBFusion results be F, calculate F according to following formula (5):
F (i, j, k)=VA(i,j,k)*WA(i,j,k)+VB(i,j,k)*WB(i,j,k) (5)
Wherein (i, j, k) is voxel number；
Step 6 carries out volume drawing to fused volume data F using Direct Volume Rendering Techniques, obtains the body of fusion results
Drawing image IF。
Beneficial effect
A kind of 3-D image airspace fusion method based on the weighting of volume drawing opacity of the present invention, can keep
In the case where three-D space structure information, the fusion and display of content of interest between different 3 d image datas are realized.With it
He compares method, and method of the invention has the advantages that the following aspects:
(1) 3 d image data is carried out fusion treatment as an entirety by the method for the present invention, is overcome conventional two-dimensional and is cut
Piece fusion can not utilize the problem of neighborhood relevance between slice.
(2) the method for the present invention uses Direct Volume Rendering Techniques visualization of 3 d image data, and three-dimensional space can directly be presented
Between structural information, do not need to be gone according to two-dimensional slice image to imagine and reconstruct three-dimensional scenic.
(3) the method for the present invention combines Direct Volume Rendering Techniques and pixel-level image fusion technology, is based on volume drawing
Opacity transfer function selects interested content, image co-registration weight is arranged by volume drawing opacity, better
Realize the selection of different content with merge, be conducive to the analysis of space structure and position morphological feature in 3 d image data.
Detailed description of the invention
A kind of Fig. 1 process of the 3-D image airspace fusion method based on the weighting of volume drawing opacity of the present invention
Figure；
Fig. 2 VAOpacity transfer function OTFA；
Fig. 3 VBOpacity transfer function OTFB；
Fig. 4 VAThe volume drawing result I of middle content of interestA；
Fig. 5 VBThe volume drawing result I of middle content of interestB；
Fig. 6 VAAnd VBThrough the fused volume drawing result I in airspaceF。
Specific embodiment
It elaborates with reference to the accompanying drawings and examples to the present invention.
Fig. 1 gives a kind of 3-D image airspace fusion method based on the weighting of volume drawing opacity of the present invention
Flow chart, key step is as follows:
Step 1: two 3-D image volume datas to be fused of input, enable it for V respectivelyAAnd VB。
The present embodiment is used as input using the 3-D image volume data that two titles are respectively Fuel and CrossedRods,
Enable it for V respectivelyAAnd VB.The size of the two volume datas is all 64x64x64, and wherein Fuel simulates fuel injection combustion chamber
The case where situation, Crossed Rods features three vertical rods inside a square box.Due to being three-dimensional data, common figure
As display technology can not directly display the three-dimensional scenic inside the two data fields.
Step 2: requiring according to Direct Volume Rendering Techniques, V is respectively setAAnd VBOpaque transfer function OTFAWith
OTFB, to VAAnd VBDirect volume drawing is carried out, the volume drawing result I of corresponding content of interest is obtainedAAnd IB。
V of the present embodiment to inputAAnd VBThe volume drawing opacity transfer function OTF of settingAAnd OTFBRespectively such as Fig. 2
With shown in Fig. 3.According to set opaque transfer function respectively to VAAnd VBCarry out direct volume drawing, obtained volume drawing knot
Fruit is as shown in Figure 4 and Figure 5.During this volume drawing, the setting of color transmission function will not influence the choosing of content of interest
It takes.Therefore the color transmission function of volume drawing can be set according to actual needs.In the present embodiment, all volume drawing colors
Transfer function is all fixed as gray scale linear function, and minimum voxel value is mapped as black, and maximum voxel value is mapped as white, median
Equal proportion is mapped as the grey of varying strength.
Step 3: according to opacity transfer function OTFAAnd OTFB, calculate separately volume data VAAnd VBIn each voxel
Opaque value obtains corresponding opacity volume data OAAnd OB；OAAnd OBCircular be:
OA(i, j, k)=OTFA(VA(i,j,k)), (1)
OB(i, j, k)=OTFB(VB(i,j,k)), (2)
Wherein (i, j, k) is that the voxel of volume data is numbered.
In the present embodiment, since the size of input data field is 64x64x64, so the value range of i, j and k are all 0
To 64, i.e. 0≤i, j, k < 64.
Step 4: calculating separately volume data V according to following formula (3) and (4)AAnd VBWeight coefficient WAAnd WB:
WA(i, j, k)=OA(i,j,k)/(OA(i,j,k)+OB(i,j,k)), (3)
WB(i, j, k)=OB(i,j,k)/(OA(i,j,k)+OB(i,j,k)), (4)
Wherein (i, j, k) is that the voxel of volume data is numbered.
In the present embodiment, since the size of input data field is 64x64x64, so the value range of i, j and k are all 0
To 64, i.e. 0≤i, j, k < 64.
Step 5: enabling volume data VAAnd VBFusion results be F, calculate F according to following formula (5):
F (i, j, k)=VA(i,j,k)*WA(i,j,k)+VB(i,j,k)*WB(i,j,k) (5)
Wherein (i, j, k) is voxel number.
Step 6: carrying out volume drawing to fused volume data F using Direct Volume Rendering Techniques, the body of fusion results is obtained
Drawing image IF。
The present embodiment is when carrying out volume drawing to fusion results F, using the opacity transfer function OTF before fusionB
(as shown in Figure 3), obtained volume drawing result images IFAs shown in Figure 6.The figure not only combines the content of Fig. 4 and Fig. 5, but also
Clearly show the spatial position between fuel shown in Fig. 4 and crossbar shown in fig. 5 and structural relation.These information are only
Fig. 4 and Fig. 5 is only relied on to be difficult to accurately hold.Here, it is to be noted that the volume drawing result of fusion results F is with being adopted
Opacity transfer function is closely related；Different opacity transfer functions will obtain different volume drawing results.Tool
When body is applied, opacity transfer function can be adjusted and is arranged according to actual needs.
Above-mentioned steps and embodiment illustrate a kind of three-dimensional figure based on the weighting of volume drawing opacity of the present invention
As all processes of airspace fusion method.
It should be understood that present embodiment is the specific example that the present invention is implemented, it should not be present invention protection model
The limitation enclosed.In the case where not departing from spirit and scope of the invention, it is equal that equivalent modification or change are carried out to above content
It should be comprising within scope of the present invention.
Claims (1)
1. a kind of 3-D image airspace fusion method based on the weighting of volume drawing opacity, which is characterized in that including following step
It is rapid:
Two step 1, input 3-D image volume datas to be fused, enable it for V respectivelyAAnd VB；
Step 2 is required according to Direct Volume Rendering Techniques, and V is respectively setAAnd VBOpaque transfer function OTFAAnd OTFB, to VA
And VBDirect volume drawing is carried out, the volume drawing result I of corresponding content of interest is obtainedAAnd IB；
Step 3, according to opacity transfer function OTFAAnd OTFB, calculate separately volume data VAAnd VBIn each voxel it is opaque
Value, obtains corresponding opacity volume data OAAnd OB；OAAnd OBCircular be:
OA(i, j, k)=OTFA(VA(i,j,k)), (1)
OB(i, j, k)=OTFB(VB(i,j,k)), (2)
Wherein (i, j, k) is that the voxel of volume data is numbered；
Step 4 calculates separately volume data V according to following formula (3) and (4)AAnd VBWeight coefficient WAAnd WB:
WA(i, j, k)=OA(i,j,k)/(OA(i,j,k)+OB(i,j,k)), (3)
WB(i, j, k)=OB(i,j,k)/(OA(i,j,k)+OB(i,j,k)), (4)
Wherein (i, j, k) is that the voxel of volume data is numbered；
Step 5 enables volume data VAAnd VBFusion results be F, calculate F according to following formula (5):
F (i, j, k)=VA(i,j,k)*WA(i,j,k)+VB(i,j,k)*WB(i,j,k) (5)
Wherein (i, j, k) is voxel number；
Step 6 carries out volume drawing to fused volume data F using Direct Volume Rendering Techniques, obtains the volume drawing of fusion results
Image IF。
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910516549.9A CN110211216B (en) | 2019-06-14 | 2019-06-14 | Three-dimensional image spatial domain fusion method based on volume rendering opacity weighting |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910516549.9A CN110211216B (en) | 2019-06-14 | 2019-06-14 | Three-dimensional image spatial domain fusion method based on volume rendering opacity weighting |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110211216A true CN110211216A (en) | 2019-09-06 |
| CN110211216B CN110211216B (en) | 2020-11-03 |
Family
ID=67792801
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910516549.9A Active CN110211216B (en) | 2019-06-14 | 2019-06-14 | Three-dimensional image spatial domain fusion method based on volume rendering opacity weighting |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110211216B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113421323A (en) * | 2021-06-21 | 2021-09-21 | 北京理工大学 | Bimodal volume data region-of-interest fusion method based on ray projection |
| CN113436305A (en) * | 2021-06-23 | 2021-09-24 | 北京理工大学 | High-quality geometric modeling method guided by direct volume rendering |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070008317A1 (en) * | 2005-05-25 | 2007-01-11 | Sectra Ab | Automated medical image visualization using volume rendering with local histograms |
| CN102903141A (en) * | 2012-08-31 | 2013-01-30 | 电子科技大学 | Multi-earthquake-attribution-fused texture mapping body drawing method based on nontransparency weighing |
| CN103279976A (en) * | 2007-10-09 | 2013-09-04 | 爱克发医疗保健公司 | Method and apparatus for volume rendering of data sets |
| CN104205172A (en) * | 2012-03-14 | 2014-12-10 | 富士胶片株式会社 | Image generation device, method, and program |
| CN106055188A (en) * | 2015-04-03 | 2016-10-26 | 登塔尔图像科技公司 | System and method for displaying volumetric images |
| CN106226817A (en) * | 2016-09-12 | 2016-12-14 | 电子科技大学 | Many attributes earthquake data visualization method based on continuous parallel coordinates |
| CN108460835A (en) * | 2018-03-05 | 2018-08-28 | 北京理工大学 | A method of geometric object is incorporated into volume drawing result |
| WO2018214063A1 (en) * | 2017-05-24 | 2018-11-29 | 深圳迈瑞生物医疗电子股份有限公司 | Ultrasonic device and three-dimensional ultrasonic image display method therefor |
| CN109544688A (en) * | 2018-11-22 | 2019-03-29 | 北京理工大学 | A kind of volume drawing fusion method based on opacity transfer function |
-
2019
- 2019-06-14 CN CN201910516549.9A patent/CN110211216B/en active Active
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070008317A1 (en) * | 2005-05-25 | 2007-01-11 | Sectra Ab | Automated medical image visualization using volume rendering with local histograms |
| CN103279976A (en) * | 2007-10-09 | 2013-09-04 | 爱克发医疗保健公司 | Method and apparatus for volume rendering of data sets |
| CN104205172A (en) * | 2012-03-14 | 2014-12-10 | 富士胶片株式会社 | Image generation device, method, and program |
| CN102903141A (en) * | 2012-08-31 | 2013-01-30 | 电子科技大学 | Multi-earthquake-attribution-fused texture mapping body drawing method based on nontransparency weighing |
| CN106055188A (en) * | 2015-04-03 | 2016-10-26 | 登塔尔图像科技公司 | System and method for displaying volumetric images |
| CN106226817A (en) * | 2016-09-12 | 2016-12-14 | 电子科技大学 | Many attributes earthquake data visualization method based on continuous parallel coordinates |
| WO2018214063A1 (en) * | 2017-05-24 | 2018-11-29 | 深圳迈瑞生物医疗电子股份有限公司 | Ultrasonic device and three-dimensional ultrasonic image display method therefor |
| CN108460835A (en) * | 2018-03-05 | 2018-08-28 | 北京理工大学 | A method of geometric object is incorporated into volume drawing result |
| CN109544688A (en) * | 2018-11-22 | 2019-03-29 | 北京理工大学 | A kind of volume drawing fusion method based on opacity transfer function |
Non-Patent Citations (2)
| Title |
|---|
| PASCUAL ABELLÁN ET AL: ""Regions-based illustrative visualization of multimodal datasets"", 《COMPUTERIZED MEDICAL IMAGING AND GRAPHICS》 * |
| 易玮玮 等: ""一种基于CPU的三维超声图像体绘制方法"", 《生命科学仪器》 * |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113421323A (en) * | 2021-06-21 | 2021-09-21 | 北京理工大学 | Bimodal volume data region-of-interest fusion method based on ray projection |
| CN113421323B (en) * | 2021-06-21 | 2022-07-12 | 北京理工大学 | Bimodal volume data region-of-interest fusion method based on ray projection |
| CN113436305A (en) * | 2021-06-23 | 2021-09-24 | 北京理工大学 | High-quality geometric modeling method guided by direct volume rendering |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110211216B (en) | 2020-11-03 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107194872B (en) | Remote sensed image super-resolution reconstruction method based on perception of content deep learning network | |
| CN111340944B (en) | Single-image human body three-dimensional reconstruction method based on implicit function and human body template | |
| CN101916454A (en) | Method for reconstructing high-resolution human face based on grid deformation and continuous optimization | |
| CN103077557B (en) | The implementation method that a kind of adaptive layered time big data of chest show | |
| CN101692286A (en) | Method for acquiring three-view drawing of medical image | |
| CN109308680A (en) | A kind of brain anatomy tutoring system based on nuclear magnetic resonance image | |
| CN110458802A (en) | Based on the projection normalized stereo image quality evaluation method of weight | |
| CN110211216A (en) | A kind of 3-D image airspace fusion method based on the weighting of volume drawing opacity | |
| CN106023214B (en) | Image quality evaluating method and system based on central fovea view gradient-structure similitude | |
| CN104008547A (en) | Method for visible serial segmentation of human body slice images based on skeleton angular points | |
| CN109919885A (en) | CVH image and Image registration fusion method based on B-spline and mutual information | |
| Huang et al. | Light field image quality assessment: An overview | |
| Lu et al. | Example-based volume illustrations | |
| CN103218848B (en) | Based on the Direct volume rendering of the transport function of electric field theory | |
| CN102631196A (en) | Three-dimensional visualization method and system of magnetic resonance elastography | |
| Song et al. | Breast tissue 3D segmentation and visualization on MRI | |
| CN102074051B (en) | Fast locating method for data bonding volume of volume rendering parallel projection | |
| CN109191447A (en) | A kind of three-dimensional grid quality evaluating method based on geometric buckling analysis | |
| CN110223371A (en) | A kind of 3-D image fusion method based on shearing wave conversion and the weighting of volume drawing opacity | |
| CN111951241B (en) | Method for measuring and displaying muscle deformation in aquatic animal exercise process | |
| CN106651930A (en) | Multi-level manifold learning medical image color perceiving method | |
| CN106652012A (en) | Medical image volume rendering method and system | |
| Borse et al. | Literature survey for 3D reconstruction of brain MRI images | |
| Zhang et al. | Real-time interactive heart illustration platform via hardware accelerated rendering | |
| CN110415793A (en) | A kind of organic image construction method and system based on voxel model |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CB03 | Change of inventor or designer information |
Inventor after: Zhang Wenyao Inventor after: Wang Na Inventor after: Wang Cheng Inventor before: Zhang Wenyao Inventor before: Wang Na |
|
| CB03 | Change of inventor or designer information |