CN105513032A - Fusion method of infrared medical image and human body sliced image - Google Patents
Fusion method of infrared medical image and human body sliced image Download PDFInfo
- Publication number
- CN105513032A CN105513032A CN201510850012.8A CN201510850012A CN105513032A CN 105513032 A CN105513032 A CN 105513032A CN 201510850012 A CN201510850012 A CN 201510850012A CN 105513032 A CN105513032 A CN 105513032A
- Authority
- CN
- China
- Prior art keywords
- image
- human body
- infrared
- fusion
- sliced
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000007500 overflow downdraw method Methods 0.000 title claims abstract description 8
- 230000004927 fusion Effects 0.000 claims abstract description 31
- 238000000034 method Methods 0.000 claims abstract description 31
- 239000012634 fragment Substances 0.000 claims description 18
- 239000003814 drug Substances 0.000 claims description 17
- 230000001186 cumulative effect Effects 0.000 claims description 9
- 230000002285 radioactive effect Effects 0.000 claims description 6
- 210000001835 viscera Anatomy 0.000 claims description 5
- 239000000654 additive Substances 0.000 claims description 3
- 230000000996 additive effect Effects 0.000 claims description 3
- 230000015572 biosynthetic process Effects 0.000 claims description 3
- 238000003786 synthesis reaction Methods 0.000 claims description 3
- 238000013519 translation Methods 0.000 claims description 3
- 238000002224 dissection Methods 0.000 abstract description 3
- 210000000056 organ Anatomy 0.000 abstract 1
- 239000007787 solid Substances 0.000 description 4
- 238000010586 diagram Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000002347 injection Methods 0.000 description 1
- 239000007924 injection Substances 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 230000001105 regulatory effect Effects 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 239000000243 solution Substances 0.000 description 1
- 238000001931 thermography Methods 0.000 description 1
- 210000003462 vein Anatomy 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/50—Image enhancement or restoration using two or more images, e.g. averaging or subtraction
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformations in the plane of the image
- G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
- G06T3/4038—Image mosaicing, e.g. composing plane images from plane sub-images
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20212—Image combination
- G06T2207/20221—Image fusion; Image merging
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Image Processing (AREA)
- Image Generation (AREA)
- Image Analysis (AREA)
Abstract
The invention relates to a fusion method of an infrared medical image and a human body sliced image. The method comprises: a human body infrared sequence image and a CT sequence image are obtained; an area of interest at the human body infrared image is obtained; the human body CT sequence image is segmented to obtain a three-dimensional human body sliced image; according to the area of interest of the human body infrared image, coordination correspondence is carried out on the human body infrared image and the sliced image according to a certain proportion; a space region is adjusted according to the three-dimensional human body sliced image and the human body infrared image and the sliced image that are in coordinated correspondence are cut; and the transparency of the human body infrared image and the sliced image after cutting is adjusted and multi-mode fusion is carried out on the human body infrared image and the sliced image after adjustment by using an image fusion algorithm, thereby obtaining a fused image. With the method, a human body dissection position corresponding to the infrared image can be determined and the relation between the surface temperature of the human body and the inner organ of the human body can be determined conveniently, so that quantitative application and judgment of the infrared image in the medical field can be realized.
Description
Technical field
The invention belongs to technical field of image processing, be specifically related to a kind of method that infrared medicine image and sliced image of human body merge.
Background technology
Infrared thermal imaging technique is applied to the time that medical domain had for more than 50 years, but up to now, infrared image does not medically still have corresponding integration technology, make doctor when analyzing human body infrared image, can not determine the human dissection position that infrared image is corresponding, this limits the development of infrared medicine image to a certain extent.Because the infrared image of infrared camera collection belongs to two dimensional image, and the Temperature Distribution that infrared image shows is plane distribution, therefore utilize the relation that infrared image has no idea to determine between human surface temperature and human internal organs, thus make infrared image medically cannot quantize application and judge.
Summary of the invention
In order to solve the problems referred to above that prior art exists, the invention provides a kind of method that infrared medicine image and sliced image of human body merge.
The technical solution adopted in the present invention is: a kind of method that infrared medicine image and sliced image of human body merge, and it comprises the following steps: obtain human body infrared sequence image and CT sequence image; Human body infrared image obtains area-of-interest; Human body CT sequence image is split, obtains 3 D human body sectioning image; According to the area-of-interest on human body infrared image, human body infrared image and sectioning image are carried out coordination according to a certain percentage corresponding; According to 3 D human body sectioning image adjustment area of space, the human body infrared image and sectioning image coordinating correspondence is cut; Regulate the transparency of the human body infrared image after cutting and sectioning image, adopt Image Fusion that the human body infrared image after adjustment and sectioning image are carried out multi-modal fusion, obtain fused images.
Further, Image Fusion is adopted to carry out multi-modal fusion to the human body infrared image after adjustment and sectioning image, obtain fused images, its process is: according to image pixel, and human body infrared image and sectioning image are carried out additive fusion with adjustable weight proportion.
Further, Image Fusion adopts Wavelet Fusion method or laplacian pyramid fusion method.
Further, employing light projecting algorithm to the implementation procedure that CT sequence image carries out volume drawing is: play up forward face depth map, obtain forward depth texture; Face depth map is dorsad played up, obtains depth texture dorsad; Vertex position and directions of rays is calculated in vertex shading program; In fragment shader program, retrieve forward depth texture, obtain closely; In fragment shader program, retrieve depth texture dorsad, obtain remote; Calculate the maximum traverse distance on current ray direction; In fragment shader program, calculate sample texture coordinate, and volume textures is sampled; In fragment shader program, carry out color synthesis and transparency cumulative; In fragment shader program, judge whether sampled distance exceedes ultimate range or transparency is cumulative whether more than 1; Then in fragment shader program, recalculate sample texture coordinate if sampled distance does not exceed ultimate range or transparency is cumulative more than 1, and again volume textures is sampled, and order performs; Otherwise, export color value.
Further, the method that described infrared medicine image and sliced image of human body merge is further comprising the steps of: by carrying out D translation to the human body infrared image after cutting and sectioning image, show the internal organs in corresponding human body three-dimensional space.
Further, the method that described infrared medicine image and sliced image of human body merge is further comprising the steps of: place radioactive source, the fusion image data obtained and radioactive source is carried out fusion and draws, and preserves merging the view data of drawing.
Owing to adopting above technical scheme, beneficial effect of the present invention is: the view data of the same target that dissimilar sensor can obtain by the inventive method carries out spatial registration, and adopt certain Image Fusion, Information Superiority contained by each view data or complementarity are organically combined, produces new view data; Thus be convenient to the human dissection position of determining that infrared image is corresponding, be convenient to the relation determined between human surface temperature and human internal organs, make infrared image medically can quantize application and judge.
Accompanying drawing explanation
Fig. 1 is the process flow diagram of the method that infrared medicine image of the present invention and sliced image of human body merge;
Fig. 2 is CT view data volume drawing process flow diagram;
Fig. 3 is the fusion flow for displaying figure of volume data and solid.
Embodiment
Below in conjunction with drawings and Examples, the present invention is described in detail.
As shown in Figure 1, the invention provides a kind of method that infrared medicine image and sliced image of human body merge, it comprises the following steps:
1) human body infrared sequence image and CT sequence image is obtained.
2) on human body infrared image, obtain ROI (RegionOfInterest, area-of-interest) region.
3) human body CT sequence image is split, obtain 3 D human body sectioning image.
4) according to the area-of-interest on human body infrared image, human body infrared image and sectioning image are carried out coordination according to a certain percentage corresponding.
5) according to 3 D human body sectioning image adjustment area of space, the human body infrared image and sectioning image coordinating correspondence is cut.
6) transparency of the human body infrared image after cutting and sectioning image is regulated, Image Fusion is adopted to carry out multi-modal fusion to the human body infrared image after adjustment and sectioning image, obtain fused images, its process is: according to image pixel, and human body infrared image and sectioning image are carried out additive fusion with adjustable weight proportion.Wherein, Image Fusion adopts Wavelet Fusion method or laplacian pyramid fusion method.
Above-mentioned steps 3) in, as shown in Figure 2, employing light projecting algorithm to the implementation procedure that CT sequence image carries out volume drawing is:
Forward face depth map is played up, obtains forward depth texture; Face depth map is dorsad played up, obtains depth texture dorsad.
Vertex position and directions of rays is calculated in vertex shading program.
In fragment shader program, retrieve forward depth texture, obtain closely.
In fragment shader program, retrieve depth texture dorsad, obtain remote.
Calculate the maximum traverse distance on current ray direction.
In fragment shader program, calculate sample texture coordinate, and volume textures is sampled.
In fragment shader program, carry out color synthesis and transparency cumulative.
In fragment shader program, judge whether sampled distance exceedes ultimate range or transparency is cumulative whether more than 1.Then in fragment shader program, recalculate sample texture coordinate if sampled distance does not exceed ultimate range or transparency is cumulative more than 1, and again volume textures is sampled, and order performs.Otherwise, export color value.
In above-described embodiment, the method that infrared medicine image of the present invention and sliced image of human body merge is further comprising the steps of: by carrying out D translation to the human body infrared image after cutting and sectioning image, show the internal organs in corresponding human body three-dimensional space.In addition, the health anomalies point of certain depth and size can also be set on human body infrared image, at three dimensions, health anomalies point be shown.
In above-described embodiment, in order to obtain more accurately, fused images clearly, the method that infrared medicine image of the present invention and sliced image of human body merge is further comprising the steps of: place radioactive source, the fusion image data obtained and radioactive source being carried out fusion draw, preserving merging the view data of drawing.
As shown in Figure 3, volume data and solid carry out fusion display, and its basic implementation procedure is:
1) be loaded into solid, generate volume textures carrier.
2) geometry data is plotted in FBO (frame buffer object FrameBufferObject) and preserves.
3) be loaded into volume data, obtain the bounding box of volume data, so as to carry out volume data cut drafting.
4) carry out respectively forward face depth map play up and dorsad face depth map play up, by the forward depth map of acquisition and dorsad depth map be all saved in corresponding FBO.
5) according to solid and step 4) the forward depth map that obtains and depth map dorsad, redefine entry position and the injection position of volume drawing ray, be kept in corresponding color and vein and depth texture.
6) according to step 5) in obtain new to inject, penetrate the volume drawing that volume data is carried out in position, be saved in corresponding FBO.
7) by step 2) and step 6) in obtain FBO carry out fusions drafting.
8) output display is carried out by finally merging the FBO completed.
The view data of the same target that dissimilar sensor can obtain by image interfusion method of the present invention carries out spatial registration, and adopt certain Image Fusion, Information Superiority contained by each view data or complementarity are organically combined, produces new view data.Compared with single piece of information source, this new view data has the information representation comparatively optimized describing institute's research object, it can reduce or suppress polysemy, imperfection, uncertainty and the error that may exist in perceived object or environment interpretation, maximally utilises the information that various information source provides.Image co-registration is divided into Pixel-level, feature level, decision level three levels, that wherein pixel-level image fusion can provide the fusion treatment on other level not have is abundanter, more accurately, more reliable detailed information, be conducive to the further analysis of image, process and understanding.
The present invention is not limited to above-mentioned preferred forms; anyone can draw other various forms of products under enlightenment of the present invention; no matter but any change is done in its shape or structure; every have identical with the application or akin technical scheme, all drops within protection scope of the present invention.
Claims (6)
1. the method that merges of infrared medicine image and sliced image of human body, it comprises the following steps:
Obtain human body infrared sequence image and CT sequence image;
Human body infrared image obtains area-of-interest;
Human body CT sequence image is split, obtains 3 D human body sectioning image;
According to the area-of-interest on human body infrared image, human body infrared image and sectioning image are carried out coordination according to a certain percentage corresponding;
According to 3 D human body sectioning image adjustment area of space, the human body infrared image and sectioning image coordinating correspondence is cut;
Regulate the transparency of the human body infrared image after cutting and sectioning image, adopt Image Fusion that the human body infrared image after adjustment and sectioning image are carried out multi-modal fusion, obtain fused images.
2. the method that merges of a kind of infrared medicine image as claimed in claim 1 and sliced image of human body, it is characterized in that: adopt Image Fusion to carry out multi-modal fusion to the human body infrared image after adjustment and sectioning image, obtain fused images, its process is: according to image pixel, and human body infrared image and sectioning image are carried out additive fusion with adjustable weight proportion.
3. the method that merges of a kind of infrared medicine image as claimed in claim 1 or 2 and sliced image of human body, is characterized in that: Image Fusion adopts Wavelet Fusion method or laplacian pyramid fusion method.
4. the method that merges of a kind of infrared medicine image as claimed in claim 1 and sliced image of human body, is characterized in that: adopt light projecting algorithm to the implementation procedure that CT sequence image carries out volume drawing to be:
Forward face depth map is played up, obtains forward depth texture; Face depth map is dorsad played up, obtains depth texture dorsad;
Vertex position and directions of rays is calculated in vertex shading program;
In fragment shader program, retrieve forward depth texture, obtain closely;
In fragment shader program, retrieve depth texture dorsad, obtain remote;
Calculate the maximum traverse distance on current ray direction;
In fragment shader program, calculate sample texture coordinate, and volume textures is sampled;
In fragment shader program, carry out color synthesis and transparency cumulative;
In fragment shader program, judge whether sampled distance exceedes ultimate range or transparency is cumulative whether more than 1; Then in fragment shader program, recalculate sample texture coordinate if sampled distance does not exceed ultimate range or transparency is cumulative more than 1, and again volume textures is sampled, and order performs; Otherwise, export color value.
5. the method that merges of a kind of infrared medicine image as claimed in claim 1 and sliced image of human body, it is characterized in that: further comprising the steps of: by carrying out D translation to the human body infrared image after cutting and sectioning image, show the internal organs in corresponding human body three-dimensional space.
6. the method that merges of a kind of infrared medicine image as claimed in claim 1 and sliced image of human body, it is characterized in that: further comprising the steps of: place radioactive source, the fusion image data obtained and radioactive source being carried out fusion draw, preserving merging the view data of drawing.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510850012.8A CN105513032A (en) | 2015-11-27 | 2015-11-27 | Fusion method of infrared medical image and human body sliced image |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510850012.8A CN105513032A (en) | 2015-11-27 | 2015-11-27 | Fusion method of infrared medical image and human body sliced image |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN105513032A true CN105513032A (en) | 2016-04-20 |
Family
ID=55720990
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510850012.8A Pending CN105513032A (en) | 2015-11-27 | 2015-11-27 | Fusion method of infrared medical image and human body sliced image |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105513032A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107095650A (en) * | 2017-05-16 | 2017-08-29 | 王海林 | A kind of method and device for obtaining human diagnosis 3-D view |
| CN110136183A (en) * | 2018-02-09 | 2019-08-16 | 华为技术有限公司 | A kind of method and relevant device of image procossing |
| CN113344785A (en) * | 2021-06-10 | 2021-09-03 | 浙江大华技术股份有限公司 | Determination method and device of multiplying power value, storage medium and electronic device |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103110425A (en) * | 2013-03-11 | 2013-05-22 | 西安电子科技大学 | Cone-beam X-ray luminescence tomography system of combination imaging and method thereof |
| CN104146767A (en) * | 2014-04-24 | 2014-11-19 | 薛青 | Intraoperative navigation method and system for assisting in surgery |
-
2015
- 2015-11-27 CN CN201510850012.8A patent/CN105513032A/en active Pending
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103110425A (en) * | 2013-03-11 | 2013-05-22 | 西安电子科技大学 | Cone-beam X-ray luminescence tomography system of combination imaging and method thereof |
| CN104146767A (en) * | 2014-04-24 | 2014-11-19 | 薛青 | Intraoperative navigation method and system for assisting in surgery |
Non-Patent Citations (5)
| Title |
|---|
| XIAOLIAN GUO等: "A Combined Fluorescence and Microcomputed Tomography System for Small Animal Imaging", 《IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING》 * |
| 刘大鹏等: "基于多小波变换的医学图像融合算法研究", 《中国医学物理学杂质》 * |
| 刘洋: "医学图像2D/3D配准及可视化研究", 《中国优秀硕士学位论文全文数据库 医药卫生科技辑》 * |
| 李添捷: "生物医学图像融合显示方法的研究", 《中国博士学位论文全文数据库 信息科技辑》 * |
| 郑迟: "体绘制采样方法研究", 《中国优秀硕士学位论文全文数据库 信息科技辑》 * |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107095650A (en) * | 2017-05-16 | 2017-08-29 | 王海林 | A kind of method and device for obtaining human diagnosis 3-D view |
| CN110136183A (en) * | 2018-02-09 | 2019-08-16 | 华为技术有限公司 | A kind of method and relevant device of image procossing |
| CN110136183B (en) * | 2018-02-09 | 2021-05-18 | 华为技术有限公司 | Image processing method and device and camera device |
| US11250550B2 (en) | 2018-02-09 | 2022-02-15 | Huawei Technologies Co., Ltd. | Image processing method and related device |
| CN113344785A (en) * | 2021-06-10 | 2021-09-03 | 浙江大华技术股份有限公司 | Determination method and device of multiplying power value, storage medium and electronic device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104677305B (en) | A kind of body surface three-dimensional method for reconstructing and system based on cross structure light | |
| CN104299222B (en) | Medical image-processing apparatus and medical image processing method | |
| JP2019526124A (en) | Method, apparatus and system for reconstructing an image of a three-dimensional surface | |
| US20150265220A1 (en) | Systems, methods, and devices for removing prospective motion correction from medical imaging scans | |
| CN105303604A (en) | Measuring method and system for single-side osteal damage of human body | |
| Khan et al. | A methodological review of 3D reconstruction techniques in tomographic imaging | |
| CN103295234B (en) | Based on the medical image segmentation system and method for deformation surface model | |
| CN110738701A (en) | tumor three-dimensional positioning system | |
| US11288848B2 (en) | Three-dimensional ultrasound image display method | |
| CN101658428A (en) | Method and system for processing bitmap in perfusion imaging technology | |
| CN105513032A (en) | Fusion method of infrared medical image and human body sliced image | |
| WO2022105813A1 (en) | Systems and methods for subject positioning | |
| CN104236479A (en) | Line structured optical three-dimensional measurement system and three-dimensional texture image construction algorithm | |
| JP2020503913A (en) | Motion estimation and compensation system and method in helical computed tomography | |
| KR101329748B1 (en) | Image processing apparatus and operating method thereof | |
| Guo et al. | 3D scanning of live pigs system and its application in body measurements | |
| CN105869169A (en) | Automatic dividing method of tumor issue micro array image | |
| KR101727670B1 (en) | Device and method for medical image segmentation based on user interactive input | |
| Re et al. | CaSSIS-based stereo products for Mars after three years in orbit | |
| Durgadevi et al. | Deep survey and comparative analysis of medical image processing | |
| CN109872353B (en) | White light data and CT data registration method based on improved iterative closest point algorithm | |
| US20080260220A1 (en) | Registration of optical images of small animals | |
| Sood et al. | 3D surface digitization in scientific research and product development | |
| Morigi et al. | 3D long bone reconstruction based on level sets | |
| CN108542394A (en) | A kind of mammary contour measurement method and device based on Kinect |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB03 | Change of inventor or designer information |
Inventor after: Yuan Yune Inventor before: Tian Aiguo Inventor before: Yuan Yune Inventor before: Huang Qinxing Inventor before: Wu Fang |
|
| COR | Change of bibliographic data | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20180104 Address after: Room 1, room 101, supporting room of Dawning complex building, East District of Wang Fu Yuan, Beijing, Beijing Applicant after: Beijing Jiangshan visible Chinese medicine Polytron Technologies Inc Address before: No. 2516, No. 2, No. 7, innovation road, Beijing Changping District science and Technology Park, Beijing Applicant before: RED ELEPHANT MEDICAL TECHNOLOGY CO., LTD. |
|
| TA01 | Transfer of patent application right | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20160420 |
|
| RJ01 | Rejection of invention patent application after publication |