CN107492145A - Three-dimensional reconstruction is peeped in a kind of true posture in space - Google Patents
Three-dimensional reconstruction is peeped in a kind of true posture in space Download PDFInfo
- Publication number
- CN107492145A CN107492145A CN201611203293.9A CN201611203293A CN107492145A CN 107492145 A CN107492145 A CN 107492145A CN 201611203293 A CN201611203293 A CN 201611203293A CN 107492145 A CN107492145 A CN 107492145A
- Authority
- CN
- China
- Prior art keywords
- xray
- oct
- dimensional reconstruction
- dimensional
- image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2210/00—Indexing scheme for image generation or computer graphics
- G06T2210/41—Medical
Abstract
Three-dimensional reconstruction is peeped in a kind of true posture in space, including（1）XRAY image capturing system modules;（2）OCT image acquisition system module;（3）XRAY and OCT image collaboration acquisition system module;（4）XRAY binocular three-dimensional reconstruction method modules;（5）OCT image three-dimensional rebuilding method module;（6）XRAY and the three-dimensional reconstruction module of OCT image collaboration.The present invention, which reaches, to rebuild the space of blood vessel and moves towards the effect of information.
Description
Technical field
Patent of the present invention belongs to three-dimensional reconstruction field, more particularly to a kind of the interior of the true posture in space peeps three-dimensional reconstruction skill
Art.
Background technology
Cardiovascular and cerebrovascular disease is referred to as the first killer for threatening human life and health.With increasingly carrying for people's living standard
Height, living material data are also more and more sufficient.Therefore the ratio of obese people is in the trend risen, these crowds exactly heart and brain
The high risk group of vascular diseases breaking-out.Development in science and technology drive medical diagnosis technology continuous innovation, Medical Imaging Technology it is flourishing
Develop the measure to be offered convenience to the various diseases of diagnosis and effective means.Such as coronary angiography is imaged（XRAY）, computer X penetrates
Line tomoscan（CT）, Magnetic resonance imaging（MRI）Image, intravascular ultrasound imaging（IVUS）Deng being all widely applied to
Among medical diagnosis.
Space three-dimensional information reconstruction can be carried out using two width or several XRAY coronary arterys images, so as to recover the true of coronary artery
Real blood vessel three-dimensional structure.This method for reconstructing is referred to as multiple view geometry reconstruction, and the space three-dimensional vascular pattern established in this approach can
To be moved towards from exterior space view coronary artery spatial structural form, blood vessel, blood vessel diameter, hemadostewnosis lesion etc..But the party
Method can only see external information, but helpless to Endovascular information.
Three-dimensional reconstruction based on OCT sequence images.This method is to carry out three-dimensional reconstruction using multiple sequence images, acquisition
View data is optics rotary faulty scan data, so the information of every image is comprising the inside from blood vessel to tube chamber
Structural information.Intravascular spatial information, including intravascular calcification situation can be observed with the spatial model that this sequence image is rebuild,
Angiemphraxis situation etc..But information is moved towards in the space that this method can not rebuild blood vessel, so spatial model is not true form
Information.
The method that the true posture three-dimensional reconstruction in space is carried out with reference to XRAY contrastographic pictures and OCT sequence images is to combine both
Respectively to the method for the detection of outside vessel information structure and the detection of internal blood vessel message structure, construct and truly moved towards with space
Blood vessel three-dimensional model structural information.
Patent of invention content
Three-dimensional reconstruction is peeped in a kind of true posture in space, the content includes：（1）XRAY image capturing system modules;
（2）OCT image acquisition system module;（3）XRAY and OCT image collaboration acquisition system module;（4）XRAY binocular three-dimensional reconstruction sides
Method module;（5）OCT image three-dimensional rebuilding method module;（6）XRAY and the three-dimensional reconstruction module of OCT image collaboration.
Included based on XRAY binocular three-dimensional reconstruction method modules：（1）Blood vessel segmentation;(2）Skeletal extraction and matching;（3）Bone
Frame rebuilds
Included based on XRAY and OCT image collaboration three-dimensional rebuilding method module：（1）Exterior space posture three based on XRAY images
Dimension is rebuild;（2）The three-dimensional reconstruction of internal structural information based on OCT image;（3）Skeleton and the true posture of sectioning image collaboration
Three-dimensional reconstruction.
Collaboration acquisition system based on XRAY and OCT should include：（1）XRAY and OCT can be gathered simultaneously;（2）XRAY and
OCT can also be relatively the same as gathering in the cycle.
Based on the three-dimensional reconstruction module of XRAY and OCT methods image collaboration, the content includes：（1）Appearance spatial skeleton
Structure;（2）Internal structural information is rebuild.
Brief description of the drawings
Fig. 1 is that a polar curve intersects with multiple vessel segments（S1 and S2 is camera position）
Fig. 2 is XRAY contrastographic picture three-dimensional reconstruction schematic diagrames
Fig. 3 is XRAY contrastographic picture three-dimensional reconstruction flow charts
Fig. 4 is that OCT image data three-dimensional rebuilds schematic diagram
Fig. 5 is that OCT image data three-dimensional rebuilds flow chart
Fig. 6 is that XRAY images and OCT image joint rebuild schematic diagram
Fig. 7 is that XRAY images and OCT image joint rebuild flow chart.
Embodiment
Three-dimensional reconstruction is peeped in a kind of true posture in space, the content includes：（1）XRAY image capturing system moulds
Block;（2）OCT image acquisition system module;（3）XRAY and OCT image collaboration acquisition system module;（4）XRAY binocular three-dimensional weights
Construction method module;（5）OCT image three-dimensional rebuilding method module;（6）XRAY and the three-dimensional reconstruction module of OCT image collaboration.
Included based on XRAY binocular three-dimensional reconstruction method modules：（1）Blood vessel segmentation;(2）Skeletal extraction and matching;（3）Bone
Frame is rebuild.
Included based on XRAY and OCT image collaboration three-dimensional rebuilding method module：（1）Exterior space appearance based on XRAY images
State three-dimensional reconstruction;（2）The three-dimensional reconstruction of internal structural information based on OCT image;（3）Skeleton and sectioning image cooperate with true
Posture three-dimensional reconstruction.
Collaboration acquisition system based on XRAY and OCT should include：（1）XRAY and OCT can be gathered simultaneously;（2）XRAY and
OCT can also be relatively the same as gathering in the cycle.
Based on the three-dimensional reconstruction module of XRAY and OCT methods image collaboration, the content includes：（1）Appearance spatial skeleton
Structure;（2）Internal structural information is rebuild.
Using two or multiple different angle images carry out three-dimensional reconstruction, are to be based on multiple view geometry principle.Known two or
The geometric parameter at the multiple visual angles of person, and its view data obtained under the visual angle.Space can be reconstructed by method of geometry
Coordinate, as shown in figure 1, equation is as follows, wherein be the i-th row of projection matrix, i=1,2, these equations on（Spatial point）
Component（With）It is linear.Combine the equation of two width views can form shaped like equation：
WhereinFor projection matrix OK,,.It is i.e. available by solving this equationThe three of point
Dimension space coordinate.
Embodiment one（Three-dimensional rebuilding method based on XRAY view data）
Referring to Fig. 3, this part includes：Coronary angiography 1, radiography data acquisition 2, feature extraction 3, skeleton track 4, render reconstruction 5.
A kind of method that the present embodiment is related to is that a kind of scheme of coronary artery reconstruction is carried out based on XRAY images, and the program is related to
The three-D space structure of skeleton is rebuild.
The method that coronary artery three-dimensional reconstruction is carried out based on multiple view geometry, it is highly developed, but accurately obtain match parameter
It is a more difficult thing so as to obtain accurate space geometry structure.The present embodiment formulates one when obtaining view data
A little special acquisition methods, to obtain more accurate Space geometric parameter.
Coronary angiography 1：Continued using medical special conduit to patient injection contrast agent, while using big C contrast machines
Shooting.
Radiography data acquisition 2：Carried out during radiography data acquisition according to these standards,（1）According to cardiac cycle（ECG）Obtain
Access evidence.Utilize the data at the same moment of different cardiac cycles.（2）When selection different angle and the data of focal length, record
Corresponding parameter.（3）Patient body chest position, patch mark marks, for being tracked calibration to the image of acquisition.
Feature extraction 3：Distortion correction, segmentation are carried out to the contrastographic picture of acquisition, extract vascular skeleton.Marked using mark
Optimization is iterated to the parameter value of acquisition.
Skeleton track 4：Using Epipolar geometry principle, the matching relationship established by limit restraint method between image.
Render reconstruction 5：With reference to the geometric parameter of acquisition and the matching relationship established, formula is utilized（1）In equation close
System can obtain space coordinates, rebuild spatial skeleton.Blood vessel diameter measurement and three-dimensional framework with reference to two dimensional image, render space
Three-dimensional data.
The flow of the embodiment is described as shown in Figures 2 and 3：
Before clinical trial, mark point standards are carried out to thoracic oral area position.The patient for injecting contrast agent is preced with using big C contrast machines
Arteries and veins part carries out continuous imaging, then changes different angle and carries out continuous imaging.Distortion correction and feature are carried out to the data of acquisition
Extraction, reconstructing parameters are iterated with optimization using mark trackings and distortion correction method.Then, two width or more are established
The matching relationship of width image.Next, carrying out asking for spatial point by space geometry theory, and then obtain three dimensions skeleton.
With reference to spatial skeleton and the diameter information of two dimensional surface vessel measurement, carry out space body and render.
Two, embodiments two（Three-dimensional rebuilding method based on OCT sequential image datas）
Referring to Fig. 5, this part includes：OCT Clinical practices 6, OCT data acquisition 7, sequence specific primers-polymerase chain reaction 8, body render reconstruction 9.
The present embodiment is related to a kind of three-dimensional rebuilding method of OCT image sequence.Including following components：
OCT Clinical practices 6, OCT data acquisition 7, sequence specific primers-polymerase chain reaction 8, body render reconstruction 9.
OCT Clinical practices：When patient carries out coronary artery inspection, it is operated using OCT conduits and equipment.
OCT data acquisition：Optical signal is changed into electric signal by conduit to photodetector, and data are carried out into capture card
Collection.Spectrum Conversion is carried out using host computer, power spectrum is asked for, changes into view data, and export to pending disk.Obtain image
Sequence, the image that same pullback distances obtain is more, and it is better to rebuild effect.
Sequence specific primers-polymerase chain reaction：Background denoising, image enhancement processing are carried out to the OCT image of acquisition.
Body renders reconstruction：The method that body renders reconstruction can use light projection method, can also use what texture rendered
Method.When carrying out body and rendering, it is necessary to set the transparent transmission function and color transfer function required for rendering.Gradient transmits letter
Number can carry out selection setting according to demand.The scene background that body renders, it can be provided white or black.
The flow of the present embodiment controls as shown in Figure 4 and Figure 5 is：
Enter human body coronary artery to be tested using optics OCT conduits, injection contrast agent is washed away, then entered using OCT equipment
Row pullback is scanned, and interference light signal backs into photodetector from conduit and is changed into electric signal, then adopted by capture card
Collection signal data switchs to view data to host computer.In next step, sequence image to be reconstructed is handled, then selected specific
Method for reconstructing rebuild, rebuild body rendering intent can be that light projection method or texture render method.
Three, embodiments three（True configuration space three-dimensional rebuilding method based on XRAY and OCT image）
Refering to Fig. 7, OCT clinics 6, OCT data acquisition 7, sequence specific primers-polymerase chain reaction 8, coronary angiography 1, radiography data acquisition 2, space
Skeleton rebuilds 10, and sequence image spatial rearrangement 11, true posture renders reconstruction 12.
The present embodiment is related to.
OCT is clinical：OCT clinical examinations are carried out to the patient that needs are adhered to.
OCT data acquisition:With illustrating in embodiment two, the data recorded using equipment are exported and selected, and record is adopted
Collect the various geometric parameters of equipment.
Spatial skeleton is rebuild：, it is necessary to enter line distortion school to used two dimensional image between spatial skeleton reconstruction is carried out
Just, moving displacement recovers, feature extraction and characteristic matching.Feature extraction includes：Vessel borders are split, blood vessel axis detection,
Bifurcation extraction etc..Characteristic matching includes：Vessel segment matches, and the matching of blood vessel Point matching, wherein puncta vasculosa can rely on polar curve
Constrained matching or based on textural characteristics sift matching etc..After establishing matching relationship, using the geometric parameter of acquisition, with reference to several
What principle can obtain space three-dimensional point coordinates, then be fitted acquisition spatial skeleton to continuous spatial point.
Sequence image spatial rearrangement：The OCT sequential image data combinations spatial skeleton trend of acquisition includes angle and radian
Change, enters rearrangement, as shown in schematic diagram 6.
True posture renders reconstruction：Algorithm for reconstructing design is carried out to the image after sequence reorganization, sets suitable difference to calculate
Method, can be bilinear interpolation or cube interpolation.Using light projectile rendering intent or texture rendering intent, render
The three-dimensional space model of true posture.The model not only can be seen that real blood vessel endoscope structural information, and visual angle in addition
Real space structure trend can be checked.
The flow of the present embodiment is as shown in Figure 6 and Figure 7：
Using OCT image equipment acquisition system, the sequence image of needs is obtained, and image is handled.Obtaining sequence simultaneously
Row image carries out radiography data acquisition to coronary artery simultaneously, using big C contrast apparatus.For locating after the radiography data progress of collection
Reason, such as distortion correction, image enhaucament, feature skeletal extraction.Then, attempt for the skeleton of different visual angles, establish matching relationship.
Three dimensions point set is rebuild in the coordinate of each multi-view image according to the geometric parameter of acquisition and match point, data point set is carried out
Curve matching, generate space curve.OCT sequence images are entered rearrangement according to three dimensions skeleton, body is then carried out and renders three
Dimension is rebuild.
Claims (5)
1. peep three-dimensional reconstruction in a kind of true posture in space, it is characterised in that:Including（1）XRAY image capturing system moulds
Block;（2）OCT image acquisition system module;（3）XRAY and OCT image collaboration acquisition system module;（4）XRAY binocular three-dimensional weights
Construction method module;（5）OCT image three-dimensional rebuilding method module;（6）XRAY and the three-dimensional reconstruction module of OCT image collaboration.
2. according to peeping three-dimensional reconstruction in the true posture in a kind of space described in claim 1, it is characterised in that:It is based on
XRAY binocular three-dimensional reconstruction method modules include：（1）Blood vessel segmentation;(2）Skeletal extraction and matching;（3）Skeleton is rebuild.
3. according to peeping three-dimensional reconstruction in the true posture in a kind of space described in claim 1, it is characterised in that:It is based on
XRAY and OCT image collaboration three-dimensional rebuilding method module include：（1）Exterior space posture three-dimensional reconstruction based on XRAY images;
（2）The three-dimensional reconstruction of internal structural information based on OCT image;（3）Skeleton and the true posture Three-dimensional Gravity of sectioning image collaboration
Build.
4. according to peeping three-dimensional reconstruction in the true posture in a kind of space described in claim 1, it is characterised in that:It is based on
XRAY and OCT collaboration acquisition system should include：（1）XRAY and OCT can be gathered simultaneously;（2）XRAY and OCT can also be relative
With being gathered in the cycle.
5. according to peeping three-dimensional reconstruction in the true posture in a kind of space described in claim 1, it is characterised in that:It is based on
The three-dimensional reconstruction module of XRAY and OCT methods image collaboration, the content include：（1）Appearance spatial skeleton is built;（2）It is internal
Structural information is rebuild.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611203293.9A CN107492145A (en) | 2016-12-23 | 2016-12-23 | Three-dimensional reconstruction is peeped in a kind of true posture in space |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611203293.9A CN107492145A (en) | 2016-12-23 | 2016-12-23 | Three-dimensional reconstruction is peeped in a kind of true posture in space |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107492145A true CN107492145A (en) | 2017-12-19 |
Family
ID=60643149
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201611203293.9A Pending CN107492145A (en) | 2016-12-23 | 2016-12-23 | Three-dimensional reconstruction is peeped in a kind of true posture in space |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107492145A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109410325A (en) * | 2018-11-01 | 2019-03-01 | 中国矿业大学(北京) | A kind of pipeline inner wall three-dimensional reconstruction algorithm based on monocular image sequence |
| CN111134651A (en) * | 2019-12-09 | 2020-05-12 | 杭州脉流科技有限公司 | Method, device and system for calculating fractional flow reserve based on intracavity images and computer storage medium |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103462590A (en) * | 2013-09-17 | 2013-12-25 | 浙江大学 | Integrated intravascular OCT (optical coherence tomography) image and DSA (digital subtraction angiography) integrating offline treatment system |
| US20150094566A1 (en) * | 2013-09-30 | 2015-04-02 | Samsung Electronics Co., Ltd. | Method of controlling route of angiocatheter using optical coherence tomography and angiography apparatus for performing the same |
-
2016
- 2016-12-23 CN CN201611203293.9A patent/CN107492145A/en active Pending
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103462590A (en) * | 2013-09-17 | 2013-12-25 | 浙江大学 | Integrated intravascular OCT (optical coherence tomography) image and DSA (digital subtraction angiography) integrating offline treatment system |
| US20150094566A1 (en) * | 2013-09-30 | 2015-04-02 | Samsung Electronics Co., Ltd. | Method of controlling route of angiocatheter using optical coherence tomography and angiography apparatus for performing the same |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109410325A (en) * | 2018-11-01 | 2019-03-01 | 中国矿业大学(北京) | A kind of pipeline inner wall three-dimensional reconstruction algorithm based on monocular image sequence |
| CN111134651A (en) * | 2019-12-09 | 2020-05-12 | 杭州脉流科技有限公司 | Method, device and system for calculating fractional flow reserve based on intracavity images and computer storage medium |
| CN111134651B (en) * | 2019-12-09 | 2022-03-08 | 杭州脉流科技有限公司 | Method, device and system for calculating fractional flow reserve based on intracavity images and computer storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102144927B (en) | Motion-compensation-based computed tomography (CT) equipment and method | |
| KR101572487B1 (en) | System and Method For Non-Invasive Patient-Image Registration | |
| CA2587436C (en) | Method and apparatus for invasive device tracking using organ timing signal generated from mps sensors | |
| Giancardo et al. | Textureless macula swelling detection with multiple retinal fundus images | |
| Hernandez-Mier et al. | Fast construction of panoramic images for cystoscopic exploration | |
| JP5762531B2 (en) | Imaging system and imaging method | |
| CN105377109A (en) | Full-field three dimensional surface measurement | |
| JP6182045B2 (en) | Image processing apparatus and method | |
| JP2015146989A (en) | Image processing system, image processing method, program, and storage medium | |
| CN107049489B (en) | A kind of operation piloting method and system | |
| Liu et al. | Global and local panoramic views for gastroscopy: an assisted method of gastroscopic lesion surveillance | |
| CN110446453A (en) | The cardiac motion signal derived from optical imagery | |
| Ranger et al. | 3D ultrasound imaging of residual limbs with camera-based motion compensation | |
| CN107204045A (en) | Virtual endoscope system based on CT images | |
| CN107492145A (en) | Three-dimensional reconstruction is peeped in a kind of true posture in space | |
| CN107789056A (en) | A kind of medical image matches fusion method | |
| JP6392192B2 (en) | Image registration device, method of operating image registration device, and program | |
| Elad et al. | Three-dimensional measurement of biological surfaces | |
| Colantonio et al. | A method to integrate thermographic data and 3D shapes for Diabetic Foot Disease | |
| Rasche et al. | Fusion of three-dimensional X-ray angiography and three-dimensional echocardiography | |
| CN205795645U (en) | A kind of wide viewing angle optical molecular tomographic navigation system | |
| JP6795744B2 (en) | Medical support method and medical support device | |
| JP6392190B2 (en) | Image registration device, method of operating image registration device, and program | |
| Hareendranathan et al. | Patient movement compensation for 3D echocardiography fusion | |
| CN115439597A (en) | Novel OCT space reconstruction method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20171219 |
|
| WD01 | Invention patent application deemed withdrawn after publication |