CN108784832A - A kind of minimally invasive spine surgical augmented reality air navigation aid - Google Patents

A kind of minimally invasive spine surgical augmented reality air navigation aid Download PDF

Info

Publication number
CN108784832A
CN108784832A CN201710281430.9A CN201710281430A CN108784832A CN 108784832 A CN108784832 A CN 108784832A CN 201710281430 A CN201710281430 A CN 201710281430A CN 108784832 A CN108784832 A CN 108784832A
Authority
CN
China
Prior art keywords
cloud
point
point cloud
art
preoperative
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201710281430.9A
Other languages
Chinese (zh)
Inventor
宋国立
白华
赵忆文
韩建达
刘晓壮
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenyang Institute of Automation of CAS
Original Assignee
Shenyang Institute of Automation of CAS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenyang Institute of Automation of CAS filed Critical Shenyang Institute of Automation of CAS
Priority to CN201710281430.9A priority Critical patent/CN108784832A/en
Publication of CN108784832A publication Critical patent/CN108784832A/en
Pending legal-status Critical Current

Links

Abstract

The present invention relates to a kind of minimally invasive spine surgical augmented reality air navigation aids, CT images are converted into preoperative cloud, and CT images are carried out three-dimensional reconstruction;The spine image of incision is acquired by depth camera in art, and generates art point cloud;Preoperative cloud and art point cloud are registrated;Head-mounted display apparatus is calculated in the position in space, the transformational relation of head-mounted display apparatus and real backbone is obtained, by spinal three-dimensional model by augmented reality Overlapping display on patient spine.The present invention utilizes depth information, and positioning in real time and amendment show position of the equipment in actual operation space;Solve the problems, such as that threedimensional model zoom is shown in art, be in real time accurately added to pre-operative image patient's vertebra corresponding position in really performing the operation, and is not limited by the visual field, reduces the difficulty of surgical, shortens operating time.

Description

A kind of minimally invasive spine surgical augmented reality air navigation aid
Technical field
The present invention relates to augmented reality navigation fields, specifically a kind of minimally invasive spine surgical augmented reality navigation side Method.
Background technology
Currently, augmented reality airmanship there is problems for surgical field:
It is natural special after imaging since image visual field during acquisition is narrow in art and the influence of ambient noise etc. Unobvious are levied, the precision of registration is influenced, the spinal three-dimensional model generated based on preoperative CT images can not accurately and in art be swept The backbone point cloud matching retouched.
The noise for determining sensor during point of observation and visual angle, can lead to the deviation at point of observation and visual angle, can not will Threedimensional model accurately Overlapping display on backbone.
Noise in head-mounted display apparatus position fixing process can lead to the accuracy decline of system.
Invention content
In view of the deficiencies of the prior art, the present invention is based on the spinal three-dimensional models of patient personalized preoperative CT images in art The problem of patient spine real time enhancing reality is shown positions around the reconstruction of point cloud, point cloud registering, column reconstruction and in real time four sides Face conducts a research, and carries out the method for registering based on patient personalized medical image and operation actual environment, is become based on helmet Coke shows the research of the method and surgical procedure dynamic augmented reality display technology method of virtual information, solves the image after imaging Feature unobvious, how to keep after headset equipment change in location spinal three-dimensional modal position be superimposed upon in real time on patient spine and Noise in Image Acquisition, head-mounted display apparatus position fixing process leads to the accuracy decline of system, provides a kind of by trouble The three-dimensional spine model of person is directly displayed on the body of patient, and the navigation to needing the position for implementing operation to be precisely located Method.
Present invention technical solution used for the above purpose is:
A kind of minimally invasive spine surgical augmented reality air navigation aid, includes the following steps:
Step 1:CT images are converted into preoperative cloud, and CT images are subjected to three-dimensional reconstruction;
Step 2:The spine image of incision is acquired by depth camera in art, and generates art point cloud;
Step 3:Preoperative cloud and art point cloud are registrated;
Step 4:Head-mounted display apparatus is calculated in the position in space, obtains turn of head-mounted display apparatus and real backbone Relationship is changed, by spinal three-dimensional model by augmented reality Overlapping display on patient spine.
It is described by preoperative cloud and art point cloud carry out registration include following procedure:
Step 1:The correspondence of art point cloud and preoperative cloud is obtained based on ICP algorithm, and by the point cloud minute after correspondence It is segmented into status information point cloud and measurement information point cloud;
Step 2:The state space equation based on cloud is built, using the registration Algorithm based on extension set-membership filtering, is obtained The transformational relation in preoperative cloud space and art point cloud space completes the conversion of image space and real space.
The correspondence process that art point cloud and preoperative cloud are obtained based on ICP algorithm is:
Step 1:It selects spinous points and/or transverse process point as characteristic point in the three-dimensional spine model of reconstruction, is registrated;
Step 2:An initial transformational relation is obtained, initial transformational relation is used in combination to convert art point cloud;
Step 3:By ICP algorithm iteration optimization transition matrix, finds in floating point cloud in art and each put in target point cloud In closest approach, constitute corresponding points pair, the transformational relation of logistic point cloud and preoperative cloud.
The status information point cloud is the point cloud as quantity of state when establishing state space equation.
The measurement information point cloud is the point cloud as observed quantity when establishing state space equation.
The state space equation based on cloud is:
Xk+1=Xkk
Yk=h (Xk)+vk
Wherein h (Xk) definition mode it is as follows:
ui=(xI, kt11+yI, kt12+zI, k+t13+t14)/(xI, kt41+yI, kt42+zI, kt43+t44)
vi=(xI, kt21+yI, kt22+zI, kt23+t24)/(xI, kt41+yI, kt42+zI, kt43+t44
wi=(xI, k+t31+yI, kt32+zI, kt33+t34)/(xI, kt41+yI, kt42+zI, kt43+t44)
The transformational relation T of art point cloud and preoperative cloud2As follows:
Wherein i=1,2 ..., n, n are corresponding points number, and k is kth moment, ωk, vkCorresponding process and observation noise respectively; It is state vector X to define the corresponding characteristic point sequences of ICP in pre-operative imagek=[x1, k, y1, k, z1, k, x2, k, y2, k, z2, k, ...xN, k, yN, k, zN, k], wherein xI, kFor i-th point in preoperative cloud characteristic point of abscissa, yI, kFor preoperative cloud characteristic point In i-th point of ordinate, zI, kFor i-th point in preoperative cloud characteristic point of depth coordinate;It defines in art ICP pairs in image The characteristic point sequence answered is observation vector Yk=[u1, k, v1, k, w1, k, u2, k, v2, k, w2, k... uN, k,wN, k, wN, k], wherein uI, kFor I-th point of abscissa, v in art point cloud characteristic pointI, kFor i-th point in art point cloud characteristic point of ordinate, wI, kFor art I-th point of depth coordinate in point cloud characteristic point.
The head-mounted display apparatus is that depth camera and holographic display screen are integrated in integrated display equipment
The process for calculating position of the head-mounted display apparatus in space is:
According to index point coordinate in the picture and camera internal parameter, seat of the index point in camera coordinates system is obtained Mark;In conjunction with coordinate of the fixed index point in position in real space, the conversion for obtaining camera coordinates system and real space is closed System, and then find out the position of head-mounted display apparatus in space.
The characteristic point is 4.
The invention has the advantages that and advantage:
1. the present invention is passed through using limited image-capture field with the substep spatial registration algorithm based on filtering algorithm Just registration is registrated combination with essence, solves the problems, such as different degree of rarefications, different range point cloud registering, only passes through the part of mini-incision Image can be matched with whole spine model;
2. the present invention utilizes depth information, positioning in real time and amendment show position of the equipment in actual operation space;
3. of the invention be in real time accurately added to pre-operative image patient's vertebra corresponding position in true operation, not by the visual field Limitation reduces the difficulty of surgical, shortens operating time;
4. the present invention solves doctor's hand by the way that 3-D view, surgery planning enhancing to be shown in true surgical environments The problem of can not visually being had an X-rayed during art, reduce dose of radiation.
Description of the drawings
Fig. 1 is flow chart of the method for the present invention;
Fig. 2 be the present invention the correspondence flow chart of art point cloud and preoperative cloud is obtained based on ICP algorithm.
Specific implementation mode
The present invention is described in further detail with reference to the accompanying drawings and embodiments.
It is flow chart of the method for the present invention as shown in Figure 1.
CT picture of patient is changed into preoperative cloud by the data reduction method of contour surface first, and by CT data three-dimensional weights It builds.Secondly, the backbone of exposure in corrective surgery is scanned using depth camera, and generates art point cloud, in minimal invasive surgical procedures In, the limitation in the visual field, art point cloud is a part for spine model, i.e. partial points cloud.Again, by preoperative cloud and art midpoint Cloud is registrated, and shows that the resolution ratio of equipment is also different in preoperative CT images and art, and the degree of rarefication of preoperative cloud and art point cloud is also not Together.Registration process is divided into two steps:I is just registrated:Seek partial points cloud and global point cloud correspondence based on ICP algorithm and will correspond to Point cloud segmentation afterwards is two classes (status information point cloud and measurement information point cloud), ii essences registration:It is empty to build the state based on cloud Between equation;Using the registration Algorithm based on (ESMF) algorithm, optimize preoperative cloud space and art point cloud space transformational relation, it is complete It is converted at image space and real space.Finally, real-time locating and displaying equipment, doctor is using the depth entrained by headset equipment Camera acquires the depth information in operative space, and the state space equation for showing device location is established in operative space, utilizes Depth camera entrained by head-mounted display apparatus calculates the equipment in the position in space, obtains head-mounted display apparatus and reality The transition matrix of backbone is based on augmented reality principle, the pre-operative surgical planning in Virtual Space is added in real space, will The position of the information such as pose of instrument and surgery planning is compared in real space, realizes surgical instrument, surgical environments and preoperative three The dynamic fusion for tieing up medical image, by spinal three-dimensional model by holographic glasses Overlapping display on patient spine.
Be illustrated in figure 2 the present invention obtains the correspondence flow chart of art point cloud and preoperative cloud based on ICP algorithm.
It has the following steps:
Step 1:Select spinous points and/or transverse process point as characteristic point in the three-dimensional spine model of reconstruction, it is attached in lesion It closely takes a little, to reduce the quantity of operative incision, after choosing 4 points, keeps depth camera to remain static, acquire this 4 spies Point is levied, spatial registration is carried out using different location of the same group of point in different spaces;
Step 2:An initial transformational relation is obtained, is used in combination initial transformational relation to convert art point cloud, is Next step ICP algorithm iteration is prepared;
Step 3:By ICP algorithm iteration optimization transition matrix, finds in floating point cloud in art and each put in target point cloud In closest approach, constitute corresponding points pair, the transformational relation of logistic point cloud and preoperative cloud.

Claims (9)

1. a kind of minimally invasive spine surgical augmented reality air navigation aid, which is characterized in that include the following steps:
Step 1:CT images are converted into preoperative cloud, and CT images are subjected to three-dimensional reconstruction;
Step 2:The spine image of incision is acquired by depth camera in art, and generates art point cloud;
Step 3:Preoperative cloud and art point cloud are registrated;
Step 4:Head-mounted display apparatus is calculated in the position in space, the conversion for obtaining head-mounted display apparatus and real backbone is closed System, by spinal three-dimensional model by augmented reality Overlapping display on patient spine.
2. minimally invasive spine surgical augmented reality air navigation aid according to claim 1, it is characterised in that:It is described by preoperative point It includes following procedure that cloud and art point cloud, which carry out registration,:
Step 1:The correspondence of art point cloud and preoperative cloud is obtained based on ICP algorithm, and is by the point cloud segmentation after correspondence Status information point cloud and measurement information point cloud;
Step 2:The state space equation based on cloud is built, using the registration Algorithm based on extension set-membership filtering, is obtained preoperative The transformational relation in point cloud space and art point cloud space, completes the conversion of image space and real space.
3. minimally invasive spine surgical augmented reality air navigation aid according to claim 2, it is characterised in that:It is described to be based on ICP Algorithm obtains art point cloud and the correspondence process of preoperative cloud is:
Step 1:It selects spinous points and/or transverse process point as characteristic point in the three-dimensional spine model of reconstruction, is registrated;
Step 2:An initial transformational relation is obtained, initial transformational relation is used in combination to convert art point cloud;
Step 3:By ICP algorithm iteration optimization transition matrix, finds in floating point cloud in art and each put in target point cloud Closest approach constitutes corresponding points pair, the transformational relation of logistic point cloud and preoperative cloud.
4. minimally invasive spine surgical augmented reality air navigation aid according to claim 2, it is characterised in that:The status information Point cloud is the point cloud as quantity of state when establishing state space equation.
5. minimally invasive spine surgical augmented reality air navigation aid according to claim 2, it is characterised in that:The measurement information Point cloud is the point cloud as observed quantity when establishing state space equation.
6. minimally invasive spine surgical augmented reality air navigation aid according to claim 2, it is characterised in that:It is described to be based on a point cloud State space equation be:
Xk+1=Xkk
Yk=h (Xk)+vk
Wherein h (Xk) definition mode it is as follows:
ui=(xI, kt11+yI, kt12+zI, kt13+t14)/(xI, kt41+yI, kt42+zI, kt43+t44)
vi=(xI, kt21+yI, kt22+zI, kt23+t24)/(xI, kt41+yI, kt42+zI, kt43+t44)
wi=(xI, kt31+yI, kt32+zI, kt33+t34)/(xI, kt41+yI, kt42+zI, kt43+t44)
The transformational relation T of art point cloud and preoperative cloud2As follows:
Wherein i=1,2 ..., n, n are corresponding points number, and k is kth moment, ωk, vkCorresponding process and observation noise respectively;Definition The corresponding characteristic point sequences of ICP are state vector X in pre-operative imagek=[x1, k, y1, k, z1, k, x2, k, y2, k... xN, k, yN, k, zN, k], wherein xI, kFor i-th point in preoperative cloud characteristic point of abscissa, yI, kFor i-th point in preoperative cloud characteristic point Ordinate, zI, kFor i-th point in preoperative cloud characteristic point of depth coordinate;The corresponding characteristic point sequences of ICP in image in definition art It is classified as observation vector Yk=[u1, k, v1, k, w1, k, u2, k, v2, k, w2, k... uN, k, vN, k, wN, k], wherein uI, kIt is special for art point cloud I-th point of abscissa, v in sign pointI, kFor i-th point in art point cloud characteristic point of ordinate, wI, kFor art point cloud feature I-th point of depth coordinate in point.
7. minimally invasive spine surgical augmented reality air navigation aid according to claim 1, it is characterised in that:The wear-type is aobvious Show that equipment is that depth camera and holographic display screen are integrated in integrated display equipment.
8. minimally invasive spine surgical augmented reality air navigation aid according to claim 1, it is characterised in that:The calculating is worn Formula shows that process of the equipment in the position in space is:
According to index point coordinate in the picture and camera internal parameter, coordinate of the index point in camera coordinates system is obtained;Again Coordinate of the fixed index point of binding site in real space obtains the transformational relation of camera coordinates system and real space, into And find out the position of head-mounted display apparatus in space.
9. minimally invasive spine surgical augmented reality air navigation aid according to claim 3, it is characterised in that:The characteristic point is 4.
CN201710281430.9A 2017-04-26 2017-04-26 A kind of minimally invasive spine surgical augmented reality air navigation aid Pending CN108784832A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710281430.9A CN108784832A (en) 2017-04-26 2017-04-26 A kind of minimally invasive spine surgical augmented reality air navigation aid

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710281430.9A CN108784832A (en) 2017-04-26 2017-04-26 A kind of minimally invasive spine surgical augmented reality air navigation aid

Publications (1)

Publication Number Publication Date
CN108784832A true CN108784832A (en) 2018-11-13

Family

ID=64068894

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710281430.9A Pending CN108784832A (en) 2017-04-26 2017-04-26 A kind of minimally invasive spine surgical augmented reality air navigation aid

Country Status (1)

Country Link
CN (1) CN108784832A (en)

Cited By (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109512514A (en) * 2018-12-07 2019-03-26 陈玩君 A kind of mixed reality orthopaedics minimally invasive operation navigating system and application method
CN109758230A (en) * 2019-02-26 2019-05-17 中国电子科技集团公司信息科学研究院 A kind of neurosurgery air navigation aid and system based on augmented reality
CN110010249A (en) * 2019-03-29 2019-07-12 北京航空航天大学 Augmented reality operation piloting method, system and electronic equipment based on video superposition
CN110169820A (en) * 2019-04-24 2019-08-27 艾瑞迈迪科技石家庄有限公司 A kind of joint replacement surgery pose scaling method and device
CN110215284A (en) * 2019-06-06 2019-09-10 上海木木聚枞机器人科技有限公司 A kind of visualization system and method
CN110420050A (en) * 2019-07-18 2019-11-08 沈阳爱健网络科技有限公司 CT Conducted Puncture method and relevant apparatus
CN110731817A (en) * 2019-10-11 2020-01-31 浙江大学 radiationless percutaneous spine positioning method based on optical scanning automatic contour segmentation matching
CN111166538A (en) * 2019-03-05 2020-05-19 艾瑞迈迪科技石家庄有限公司 Pre-operation prosthesis pre-positioning method and device for joint replacement operation
WO2020151119A1 (en) * 2019-01-22 2020-07-30 雅客智慧(北京)科技有限公司 Augmented reality method and apparatus for dental operation
US10803608B1 (en) 2019-10-30 2020-10-13 Skia Medical procedure using augmented reality
CN111772792A (en) * 2020-08-05 2020-10-16 山东省肿瘤防治研究院(山东省肿瘤医院) Endoscopic surgery navigation method, system and readable storage medium based on augmented reality and deep learning
CN112545649A (en) * 2020-12-02 2021-03-26 中国科学院自动化研究所 Femoral head core decompression operation navigation implementation system based on mixed reality
CN112581629A (en) * 2020-12-09 2021-03-30 中国科学院深圳先进技术研究院 Augmented reality display method and device, electronic equipment and storage medium
CN112890974A (en) * 2020-11-17 2021-06-04 浙江大学 A body surface positioner for neurosurgery
CN113274130A (en) * 2021-05-14 2021-08-20 上海大学 Markless surgery registration method for optical surgery navigation system
WO2021216296A1 (en) * 2020-04-22 2021-10-28 Warsaw Orthopedic, Inc. Clinical diagnosis and treatment planning system and methods of use
CN113648057A (en) * 2021-08-18 2021-11-16 上海电气集团股份有限公司 Surgical navigation system and surgical navigation method
CN113724306A (en) * 2021-08-04 2021-11-30 卡本(深圳)医疗器械有限公司 Registration algorithm for preoperative CTMR scanning image and intraoperative patient coordinates
CN114224485A (en) * 2021-11-01 2022-03-25 中国医学科学院北京协和医院 Navigation system for open type spinal vertebral plate decompression operation and control method
WO2022127009A1 (en) * 2020-12-18 2022-06-23 南京佗道医疗科技有限公司 Guide needle placement precision evaluation method
CN114711961A (en) * 2022-04-12 2022-07-08 山东大学 Virtual reality navigation method and system for spinal endoscopic surgery

Cited By (32)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109512514A (en) * 2018-12-07 2019-03-26 陈玩君 A kind of mixed reality orthopaedics minimally invasive operation navigating system and application method
WO2020151119A1 (en) * 2019-01-22 2020-07-30 雅客智慧(北京)科技有限公司 Augmented reality method and apparatus for dental operation
CN109758230B (en) * 2019-02-26 2021-04-13 中国电子科技集团公司信息科学研究院 Neurosurgery navigation method and system based on augmented reality technology
CN109758230A (en) * 2019-02-26 2019-05-17 中国电子科技集团公司信息科学研究院 A kind of neurosurgery air navigation aid and system based on augmented reality
CN111166538A (en) * 2019-03-05 2020-05-19 艾瑞迈迪科技石家庄有限公司 Pre-operation prosthesis pre-positioning method and device for joint replacement operation
CN110010249A (en) * 2019-03-29 2019-07-12 北京航空航天大学 Augmented reality operation piloting method, system and electronic equipment based on video superposition
CN110010249B (en) * 2019-03-29 2021-04-27 北京航空航天大学 Augmented reality operation navigation method and system based on video superposition and electronic equipment
CN110169820A (en) * 2019-04-24 2019-08-27 艾瑞迈迪科技石家庄有限公司 A kind of joint replacement surgery pose scaling method and device
CN110215284B (en) * 2019-06-06 2021-04-02 上海木木聚枞机器人科技有限公司 Visualization system and method
CN110215284A (en) * 2019-06-06 2019-09-10 上海木木聚枞机器人科技有限公司 A kind of visualization system and method
CN110420050A (en) * 2019-07-18 2019-11-08 沈阳爱健网络科技有限公司 CT Conducted Puncture method and relevant apparatus
CN110731817A (en) * 2019-10-11 2020-01-31 浙江大学 radiationless percutaneous spine positioning method based on optical scanning automatic contour segmentation matching
CN110731817B (en) * 2019-10-11 2021-04-13 浙江大学 Radiationless percutaneous spine positioning method based on optical scanning automatic contour segmentation matching
US11710246B2 (en) 2019-10-30 2023-07-25 Skia Skin 3D model for medical procedure
US10970862B1 (en) 2019-10-30 2021-04-06 Skia Medical procedure using augmented reality
US10803608B1 (en) 2019-10-30 2020-10-13 Skia Medical procedure using augmented reality
US11341662B2 (en) 2019-10-30 2022-05-24 Skia Medical procedure using augmented reality
US11564767B2 (en) 2020-04-22 2023-01-31 Warsaw Orthopedic, Inc. Clinical diagnosis and treatment planning system and methods of use
WO2021216296A1 (en) * 2020-04-22 2021-10-28 Warsaw Orthopedic, Inc. Clinical diagnosis and treatment planning system and methods of use
CN111772792A (en) * 2020-08-05 2020-10-16 山东省肿瘤防治研究院(山东省肿瘤医院) Endoscopic surgery navigation method, system and readable storage medium based on augmented reality and deep learning
CN111772792B (en) * 2020-08-05 2023-11-28 山东省肿瘤防治研究院(山东省肿瘤医院) Endoscopic surgery navigation method, system and readable storage medium based on augmented reality and deep learning
CN112890974A (en) * 2020-11-17 2021-06-04 浙江大学 A body surface positioner for neurosurgery
CN112545649B (en) * 2020-12-02 2022-03-25 中国科学院自动化研究所 Femoral head core decompression operation navigation implementation system based on mixed reality
CN112545649A (en) * 2020-12-02 2021-03-26 中国科学院自动化研究所 Femoral head core decompression operation navigation implementation system based on mixed reality
CN112581629A (en) * 2020-12-09 2021-03-30 中国科学院深圳先进技术研究院 Augmented reality display method and device, electronic equipment and storage medium
WO2022127009A1 (en) * 2020-12-18 2022-06-23 南京佗道医疗科技有限公司 Guide needle placement precision evaluation method
CN113274130A (en) * 2021-05-14 2021-08-20 上海大学 Markless surgery registration method for optical surgery navigation system
CN113724306A (en) * 2021-08-04 2021-11-30 卡本(深圳)医疗器械有限公司 Registration algorithm for preoperative CTMR scanning image and intraoperative patient coordinates
CN113648057A (en) * 2021-08-18 2021-11-16 上海电气集团股份有限公司 Surgical navigation system and surgical navigation method
CN114224485A (en) * 2021-11-01 2022-03-25 中国医学科学院北京协和医院 Navigation system for open type spinal vertebral plate decompression operation and control method
CN114224485B (en) * 2021-11-01 2024-03-26 中国医学科学院北京协和医院 Navigation system and control method for open type vertebral lamina decompression operation
CN114711961A (en) * 2022-04-12 2022-07-08 山东大学 Virtual reality navigation method and system for spinal endoscopic surgery

Similar Documents

Publication Publication Date Title
CN108784832A (en) A kind of minimally invasive spine surgical augmented reality air navigation aid
US11275249B2 (en) Augmented visualization during surgery
Wang et al. Augmented reality navigation with automatic marker-free image registration using 3-D image overlay for dental surgery
EP2637593B1 (en) Visualization of anatomical data by augmented reality
USRE43952E1 (en) Interactive system for local intervention inside a non-homogeneous structure
US11647920B2 (en) Systems and methods for measurement of anatomic alignment
RU2707369C1 (en) Method for preparing and performing a surgical operation using augmented reality and a complex of equipment for its implementation
CN111772792A (en) Endoscopic surgery navigation method, system and readable storage medium based on augmented reality and deep learning
CN100418489C (en) Multimode medical figure registration system based on basic membrane used in surgical operation navigation
JPH09511430A (en) Three-dimensional data set registration system and registration method
CN107049489B (en) A kind of operation piloting method and system
CN113950301A (en) System for computer guided surgery
CN109498156A (en) A kind of head operation air navigation aid based on 3-D scanning
CN112168346A (en) Method for real-time coincidence of three-dimensional medical image and patient and operation auxiliary system
CN107016662A (en) Locally apply the transparency into CT images
US20230114385A1 (en) Mri-based augmented reality assisted real-time surgery simulation and navigation
US20170270678A1 (en) Device and method for image registration, and non-transitory recording medium
CN115153835A (en) Acetabular prosthesis placement guide system and method based on feature point registration and augmented reality
Masamune et al. Three-dimensional slice image overlay system with accurate depth perception for surgery
CN110584779A (en) Head-mounted visual surgical site navigation system and operation method thereof
WO2001057805A2 (en) Image data processing method and apparatus
KR100346363B1 (en) Method and apparatus for 3d image data reconstruction by automatic medical image segmentation and image guided surgery system using the same
Edwards et al. Neurosurgical guidance using the stereo microscope
Zhang et al. 3D augmented reality based orthopaedic interventions
CA3012522A1 (en) Visualizing navigation of a medical device in a patient organ using a dummy device and a physical 3d model

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20181113

RJ01 Rejection of invention patent application after publication