CN103279984B - A kind of sight glass viewing angle tracking method of graphic based transformation matrix - Google Patents

A kind of sight glass viewing angle tracking method of graphic based transformation matrix Download PDF

Info

Publication number
CN103279984B
CN103279984B CN201310220543.XA CN201310220543A CN103279984B CN 103279984 B CN103279984 B CN 103279984B CN 201310220543 A CN201310220543 A CN 201310220543A CN 103279984 B CN103279984 B CN 103279984B
Authority
CN
China
Prior art keywords
camera
point
visual angle
sight glass
axis
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201310220543.XA
Other languages
Chinese (zh)
Other versions
CN103279984A (en
Inventor
李章维
冯远静
刘衍志
白雪琛
禹鑫燚
徐晓乐
叶峰
陈蒙奇
洪凌
郭冰冰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Zhejiang University of Technology ZJUT
Original Assignee
Zhejiang University of Technology ZJUT
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Zhejiang University of Technology ZJUT filed Critical Zhejiang University of Technology ZJUT
Priority to CN201310220543.XA priority Critical patent/CN103279984B/en
Publication of CN103279984A publication Critical patent/CN103279984A/en
Application granted granted Critical
Publication of CN103279984B publication Critical patent/CN103279984B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Landscapes

  • Image Processing (AREA)
  • Processing Or Creating Images (AREA)

Abstract

The present invention is a kind of sight glass viewing angle tracking method of graph transformation matrix, can show the sight glass visual angle of scalpel, belong to the field of Computer Graphics in areas of information technology in virtual operation training system.Propose a kind of algorithm of graphic based transformation matrix, by changing the spatial coordinate location of several calibration point, constructing one and can follow the tool motion in virtual operation training system and the visual angle of moving, thus reaching the effect at sight glass visual angle.This method uses absolute type variable quantity, decrease the cumulative errors of image data in tool motion process, by calibration during initialization, eliminate steady-state error, make simultaneously visual angle can with portion's mechanical linkage, reduce the associative operation in true operation completely, and operand is less, antijamming capability is good.

Description

A kind of sight glass viewing angle tracking method of graphic based transformation matrix
Technical field
The present invention relates to the field of Computer Graphics under areas of information technology.
Background technology
Neuro-surgery operation is the important means for the treatment of neuro-surgery disease at present, but because brain organ structure complexity, some diseased region are near important histoorgan, makes neuro-surgery operation complicated and challenging.Therefore, accurately show all brain structures information such as brain functional areas, nerve fibre trend, and the operative training system of high-fidelity is provided, raising neuro-surgery operation level is had great importance.
Current operative training systematic research both domestic and external makes some progress, as American I ntuitiveSurgical company successfully develops DaVinci surgical robot systems, and has dropped into business use; The software systems that the people such as the PeterC.Everett of Harvard Medical School SurgicalPlanningLaboratory utilize VTK to develop can be carried out mutual cutting and can be demonstrated the change of topological structure on triangular facet model.The MeVisTo-Jaw system of people's exploitations such as the PatrickNeumann of Germany FreeUniversityofBerlin can simulate craniofacial surgery in three-dimensional scenic, this system is the cutting that the method utilizing volume data to operate carrys out analog bone tissue, and utilize the device such as anaglyph spectacles and force feedback to increase the authenticity of surgical simulation, but also there is following problem in these operative training systems:
First, surgical navigational and training system operation observation point are static observation point.Current operative training system is as the VectorVision system of Germany, and only have the static observation point that 5 fixing, it realizes the tracking of knife head for surgical by all brain structures of transparence virtual patient, lacks the authenticity of sham operated.
Secondly, virtual sight glass visual angle is lacked.In real neurosurgery Minimally Invasive Surgery, doctor normally obtains the data message of scalpel periphery by the sight glass being arranged on knife head for surgical, and this observation station moves along with the movement of scalpel mirror sheath, can ensure the real-time monitoring to knife head for surgical.The observation visual angle of current operative training system is many is specified by user, can not change with the movement of analog scalpel.
Summary of the invention
In order to the training system visual angle overcoming prior art is untrue, cause the shortcoming that operative training and actual operation disconnect, we propose a kind of sight glass viewing angle tracking method of graphic based transformation matrix, simulate sight glass visual angle with dynamic concept measuring point, make operative training system more close to true operation.
The technical solution used in the present invention is:
A sight glass viewing angle tracking method for graphic based transformation matrix, mainly comprises following three steps:
Step 1, obtains the spatial parameter of digital scalpel in Virtual Space:
Described spatial parameter comprises camera position (Position), camera focus (FocusPoint) and upwardly-directed (ViewUp), position on camera position and digital scalpel residing for virtual camera point, the position at camera place in Reality simulation operation; The focal position at camera focus and visual angle, is mainly used to jointly form sight line vector with camera position; It is upwardly-directed the y-axis positive dirction of view plane; By setting up Virtual Space in computing machine, and for setting up coordinate axis in this Virtual Space, digitizing scalpel is imported this Virtual Space, thus using the position of virtual camera point that gets as camera position P (P x, P y, P z), with P point along the position of y-axis positive dirction 5 units being second some F (F x, F y, F z), as camera focus, wherein be sight line vector, a V (V is in the position of P point and mirror sheath axisymmetrical x, V y, V z), it is view plane positive direction vector.
Step 2, according to scalpel model sport, carry out coordinate transform:
We set up the graphics transformation matrix R of three 4x4 x, R z, T ycarry out the change at sight glass visual angle, wherein, R xcamera point transformation matrix when x-axis rotates, R zthe transformation matrix of point when z-axis rotates, T ybe the transformation matrix of point along the direction translation of tool coordinate y-axis, be specially:
R x = 1 0 0 0 0 cos α s i n α 0 0 - s i n α cos α 0 0 0 0 1 ;
R = c o s β s i n β 0 0 - s i n β c o s β 0 0 0 0 1 0 0 0 0 1 ;
T y = 1 0 0 0 0 1 0 0 0 0 1 0 0 T 0 1 ;
α represents the angle that cutter rotates through from initial position around x-axis; β represents the angle that cutter rotates through from initial position around z-axis; T represents the translation of cutter relative initial position on tool coordinate y-axis direction;
By obtaining above:
P → ′ = P → * T y * R x * R z ;
F → ′ = F → * T y * R x * R z ;
V → ′ = V → * T y * R x * R z ;
Wherein, P → = ( P x , P y , P z , 1 ) , ( P x , P y , P z ) Represent initial P point coordinate, 1 converts for companion matrix; P → ′ = ( P ′ x , P ′ y , P ′ z , 1 ) , ( P ′ x , P ′ y , P ′ z ) Represent post exercise P point coordinate P', 1 converts for companion matrix; F → = ( F x , F y , F z , 1 ) , ( F x , F y , F z ) Represent initial F point coordinate, 1 converts for companion matrix; represent post exercise F point coordinate F', 1 converts for companion matrix; represent initial V point coordinate, 1 converts for companion matrix; represent post exercise V point coordinate V', 1 converts for companion matrix;
Now P' represents the position at visual angle, constitute view plane normal vector, constitute view plane positive dirction;
Step 3, redraws sight glass visual angle:
Camera position is given respectively by P', F', V', camera focus and upwardly-directed, then system can according to current camera point position and a upper moment camera point position calculation go out current visual angle towards, redraw the object that camera point thus observes, complete sight glass visual angle display.
Useful performance of the present invention is:
1. make operative training truer.By applying virtual sight glass visual angle technology in training system, the sight glass visual angle of Reality simulation operation, thus improve doctor institute of undergoing training and obtain the validity of training image information, raising training effect.
2. assist physicians better observes focal area.Virtual sight glass visual angle, with the interlock of digitizing scalpel, is being carried out in operative training process, can come omnibearing observation focal area, make virtual operation process more accurate by operation cutter.
Accompanying drawing explanation
Fig. 1 is the design sketch that the present invention realizes in VTK model
Fig. 2 is analog scalpel model of the present invention
Fig. 3 is sight glass camera point position of the present invention
Embodiment
Below with reference to accompanying drawing, the present invention is described in further details:
With reference to accompanying drawing 1-3,
A sight glass viewing angle tracking method for graphic based transformation matrix, mainly comprises following three steps:
Step 1, obtains the spatial parameter of digital scalpel in Virtual Space:
Described spatial parameter comprises camera position (Position), camera focus (FocusPoint) and upwardly-directed (ViewUp), position on camera position and digital scalpel residing for virtual camera point, the position at camera place in Reality simulation operation; The focal position at camera focus and visual angle, is mainly used to jointly form sight line vector with camera position; It is upwardly-directed the y-axis positive dirction of view plane; By setting up Virtual Space in computing machine, and for setting up coordinate axis in this Virtual Space, digitizing scalpel is imported this Virtual Space, thus using the position of virtual camera point that gets as camera position P (P x, P y, P z), with P point along the position of y-axis positive dirction 5 units being second some F (F x, F y, F z), as camera focus, wherein be sight line vector, a V (V is in the position of P point and mirror sheath axisymmetrical x, V y, V z), it is view plane positive direction vector.
Step 2, according to scalpel model sport, carry out coordinate transform:
We set up the graphics transformation matrix R of three 4x4 x, R z, T ycarry out the change at sight glass visual angle, wherein, R xcamera point transformation matrix when x-axis rotates, R zthe transformation matrix of point when z-axis rotates, T ybe the transformation matrix of point along the direction translation of tool coordinate y-axis, be specially:
R x = 1 0 0 0 0 c o s α s i n α 0 0 - s i n α cos α 0 0 0 0 1 ;
R z = c o s β s i n β 0 0 - s i n β c o s β 0 0 0 0 1 0 0 0 0 1 ;
T y = 1 0 0 0 0 1 0 0 0 0 1 0 0 T 0 1 ;
α represents the angle that cutter rotates through from initial position around x-axis; β represents the angle that cutter rotates through from initial position around z-axis; T represents the translation of cutter relative initial position on tool coordinate y-axis direction;
By obtaining above:
P → ′ = P → * T y * R x * R z ;
F → ′ = F → * T y * R x * R z ;
V → ′ = V → * T y * R x * R z ;
Wherein, P → = ( P x , P y , P z , 1 ) , ( P x , P y , P z ) Represent initial P point coordinate, 1 converts for companion matrix; P → ′ = ( P ′ x , P ′ y , P ′ z , 1 ) , ( P ′ x , P ′ y , P ′ z ) Represent post exercise P point coordinate P', 1 converts for companion matrix; F → = ( F x , F y , F z , 1 ) , ( F x , F y , F z ) Represent initial F point coordinate, 1 converts for companion matrix; represent post exercise F point coordinate F', 1 converts for companion matrix; represent initial V point coordinate, 1 converts for companion matrix; represent post exercise V point coordinate V', 1 converts for companion matrix;
Now P' represents the position at visual angle, constitute view plane normal vector, constitute view plane positive dirction;
Step 3, redraws sight glass visual angle:
Camera position is given respectively by P', F', V', camera focus and upwardly-directed, then system can according to current camera point position and a upper moment camera point position calculation go out current visual angle towards, redraw the object that camera point thus observes, complete sight glass visual angle display.

Claims (1)

1. a sight glass viewing angle tracking method for graphic based transformation matrix, mainly comprises following three steps:
Step 1, obtains digital scalpel spatial parameter in Virtual Space:
Described spatial parameter comprises camera position (Position), camera focus (FocusPoint) and upwardly-directed (ViewUp), position on camera position and digital scalpel residing for virtual camera point, the position at camera place in Reality simulation operation; The focal position at camera focus and visual angle, is mainly used to jointly form sight line vector with camera position; It is upwardly-directed the y-axis positive dirction of view plane; By setting up Virtual Space in computing machine, and for setting up coordinate axis in this Virtual Space, digitizing scalpel is imported this Virtual Space, thus using the virtual camera point position that gets as camera position P (P x, P y, P z), with P point along the position of y-axis positive dirction 5 units being second some F (F x, F y, F z), as camera focus, wherein be sight line vector, a V (V is in the position of P point and mirror sheath axisymmetrical x, V y, V z), it is view plane positive direction vector;
Step 2, according to scalpel model sport, carry out coordinate transform:
Set up three 4 × 4 graphics transformation matrix R x, R z, T ycarry out sight glass visual angle change, wherein, R xcamera point transformation matrix when x-axis rotates, R zthe transformation matrix of camera point when z-axis rotates, T ybe the transformation matrix of camera point along the direction translation of tool coordinate y-axis, be specially:
R x = 1 0 0 0 0 cos α sin α 0 0 - s i n α cos α 0 0 0 0 1 ;
R z = c o s β s i n β 0 0 - s i n β c o s β 0 0 0 0 1 0 0 0 0 1 ;
T y = 1 0 0 0 0 1 0 0 0 0 1 0 0 T 0 1 ;
α represents the angle that cutter rotates through from initial position around x-axis; β represents the angle that cutter rotates through from initial position around z-axis; T represents the translation of cutter relative initial position on tool coordinate y-axis direction;
By obtaining above:
P → ′ = P → * T y * R x * R z ;
F → ′ = F → * T y * R x * R z ;
V → ′ = V → * T y * R x * R z ;
Wherein, (P x, P y, P z) represent initial P point coordinate, 1 converts for companion matrix;
(P ' x, P ' y, P ' z) represent post exercise P point coordinate P', 1 converts for companion matrix;
(F x, F y, F z) represent initial F point coordinate, 1 converts for companion matrix;
(F ' x, F ' y, F ' z) represent post exercise F point coordinate F', 1 converts for companion matrix;
(V x, V y, V z) represent initial V point coordinate, 1 converts for companion matrix; (V' x, V' y, V' z) represent post exercise V point coordinate V', 1 converts for companion matrix;
Now P' represents the position at visual angle, constitute view plane normal vector, constitute view plane positive dirction;
Step 3, redraws sight glass visual angle:
Camera position is given respectively by P', F', V', camera focus and upwardly-directed, then system can according to current camera point position and a upper moment camera point position calculation go out current visual angle towards, redraw the object that camera point thus observes, complete sight glass visual angle display.
CN201310220543.XA 2013-06-04 2013-06-04 A kind of sight glass viewing angle tracking method of graphic based transformation matrix Active CN103279984B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201310220543.XA CN103279984B (en) 2013-06-04 2013-06-04 A kind of sight glass viewing angle tracking method of graphic based transformation matrix

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201310220543.XA CN103279984B (en) 2013-06-04 2013-06-04 A kind of sight glass viewing angle tracking method of graphic based transformation matrix

Publications (2)

Publication Number Publication Date
CN103279984A CN103279984A (en) 2013-09-04
CN103279984B true CN103279984B (en) 2016-04-13

Family

ID=49062489

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201310220543.XA Active CN103279984B (en) 2013-06-04 2013-06-04 A kind of sight glass viewing angle tracking method of graphic based transformation matrix

Country Status (1)

Country Link
CN (1) CN103279984B (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106327587B (en) * 2016-11-16 2019-06-28 北京航空航天大学 A kind of accurate fusion method of laparoscope video for augmented reality surgical navigational
CN111000631B (en) * 2019-12-17 2021-04-06 上海嘉奥信息科技发展有限公司 Endoscope simulation method and system based on Unity3D volume rendering

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101849843B (en) * 2009-03-31 2013-03-13 上海交通大学医学院附属新华医院 Navigation method of three-dimensional cardiac ultrasonic virtual endoscope
JP5380348B2 (en) * 2010-03-31 2014-01-08 富士フイルム株式会社 System, method, apparatus, and program for supporting endoscopic observation
JP5369078B2 (en) * 2010-11-26 2013-12-18 富士フイルム株式会社 Medical image processing apparatus and method, and program

Also Published As

Publication number Publication date
CN103279984A (en) 2013-09-04

Similar Documents

Publication Publication Date Title
US11532135B2 (en) Dual mode augmented reality surgical system and method
Lee et al. Virtual reality and augmented reality in the management of intracranial tumors: a review
McJunkin et al. Development of a mixed reality platform for lateral skull base anatomy
US11547499B2 (en) Dynamic and interactive navigation in a surgical environment
US20170367771A1 (en) Surgical Navigation Inside A Body
Sun et al. Fast and accurate online calibration of optical see-through head-mounted display for AR-based surgical navigation using Microsoft HoloLens
Andrews et al. Registration techniques for clinical applications of three-dimensional augmented reality devices
CN101797182A (en) Nasal endoscope minimally invasive operation navigating system based on augmented reality technique
Galati et al. Experimental setup employed in the operating room based on virtual and mixed reality: analysis of pros and cons in open abdomen surgery
Halic et al. Mixed reality simulation of rasping procedure in artificial cervical disc replacement (ACDR) surgery
Si et al. Assessing performance of augmented reality-based neurosurgical training
CN110215285A (en) The method for correcting error and system of surgical navigational
Fischer et al. Evaluation of different visualization techniques for perception-based alignment in medical ar
Yuan et al. Extended reality for biomedicine
CN103279984B (en) A kind of sight glass viewing angle tracking method of graphic based transformation matrix
Seetohul et al. Augmented reality (AR) For surgical robotic and autonomous systems: State of the art, challenges, and solutions
Behringer et al. Some usability issues of augmented and mixed reality for e-health applications in the medical domain
Huang et al. Augmented reality-based autostereoscopic surgical visualization system for telesurgery
Wang et al. Intelligent HMI in orthopedic navigation
Jiang et al. Enhancing a laparoscopy training system with augmented reality visualization
Bockholt et al. Augmented reality for enhancement of endoscopic interventions
Liao 3D medical imaging and augmented reality for image-guided surgery
Das et al. The utilization of AR/VR in robotic surgery: A study
Drouin et al. Interaction in augmented reality image-guided surgery
Mojica et al. Interactive and immersive image-guided control of interventional manipulators with a prototype holographic interface

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
CB03 Change of inventor or designer information

Inventor after: Li Zhangwei

Inventor after: Guo Bingbing

Inventor after: Feng Yuanjing

Inventor after: Liu Yanzhi

Inventor after: Bai Xuechen

Inventor after: Yu Xinyi

Inventor after: Xu Xiaole

Inventor after: Ye Feng

Inventor after: Chen Mengqi

Inventor after: Hong Ling

Inventor before: Liu Yanzhi

Inventor before: Bai Xuechen

Inventor before: Feng Yuanjing

Inventor before: Yu Xinyi

Inventor before: Ye Feng

Inventor before: Chen Mengqi

Inventor before: Hong Ling

Inventor before: Guo Bingbing

COR Change of bibliographic data
C14 Grant of patent or utility model
GR01 Patent grant