CN116486665A - Cataract operation simulation teaching model construction method based on digital twin technology - Google Patents

Cataract operation simulation teaching model construction method based on digital twin technology Download PDF

Info

Publication number
CN116486665A
CN116486665A CN202310364917.9A CN202310364917A CN116486665A CN 116486665 A CN116486665 A CN 116486665A CN 202310364917 A CN202310364917 A CN 202310364917A CN 116486665 A CN116486665 A CN 116486665A
Authority
CN
China
Prior art keywords
model
eyeball
cataract surgery
constructing
cataract
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202310364917.9A
Other languages
Chinese (zh)
Inventor
杨小红
余洪华
吴冠蓉
胡一骏
牛勇毅
李聪
方莹
况宇
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong General Hospital
Original Assignee
Guangdong General Hospital
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong General Hospital filed Critical Guangdong General Hospital
Priority to CN202310364917.9A priority Critical patent/CN116486665A/en
Publication of CN116486665A publication Critical patent/CN116486665A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B9/00Simulators for teaching or training purposes
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/016Input arrangements with force or tactile feedback as computer generated output to the user
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00Three dimensional [3D] modelling, e.g. data description of 3D objects
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00Manipulating 3D models or images for computer graphics
    • G06T19/003Navigation within 3D models or images
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2210/00Indexing scheme for image generation or computer graphics
    • G06T2210/28Force feedback
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2210/00Indexing scheme for image generation or computer graphics
    • G06T2210/41Medical

Abstract

The invention discloses a cataract surgery simulation teaching model construction method based on a digital twin technology. The invention has the following beneficial effects: (1) Creating a 3D eyeball model based on a digital twin technology, wherein the 3D eyeball model can dynamically display eyeball structure and disease knowledge, and deepen the understanding of a resident doctor on cataract basic knowledge and diagnosis and treatment process; (2) The virtual space transplanting method has the advantages that a cataract surgery simulation teaching model which does not need entity micro-operation equipment is created by utilizing VR and a force feedback device, and through virtual space transplanting of surgery operation, a resident can truly feel the effect of surgical instruments on a 3D eyeball model, cataract surgery simulation has high authenticity, and the resident truly experiences the cataract surgery operation process; (3) And establishing a cataract surgery simulation training feedback and scoring system, and guiding a resident to master the operation requirement in the repeated training process through real-time monitoring and feedback of the training process, so as to form good operation specifications.

Description

Cataract operation simulation teaching model construction method based on digital twin technology
Technical Field
The invention relates to the technical field of cataract surgery simulation teaching, in particular to a method for constructing a cataract surgery simulation teaching model based on a digital twin technology.
Background
With the progress of medical technology and equipment, cataract surgery has been developed as minimally invasive phacoemulsification surgery, which has the advantages of rapid vision recovery, good surgical effect and few complications, is one of the most cost-effective treatment methods, and is also one of the most commonly used microsurgery for ophthalmology. According to the standardized training content and standard of the inpatients in China, the standardized training of the inpatients in ophthalmology needs to understand and master the cataract operation process.
However, it is extremely difficult to achieve the ideal standardized training results in a practical clinical setting. Firstly, the eyeball is a very precise visual organ, the fine micromanipulation of the operator is required by cataract operation, and the irrecoverable visual function injury can be brought to the patient due to slight deviation of the operation; secondly, at present, cataract surgery is moved from blindness treatment to refraction, and patients have high requirements on the surgery effect, so that the clinical practice opportunities of ophthalmic inpatients are few, the microsurgery skill training is insufficient, and the talent culture period of the ophthalmic cataract surgery is greatly prolonged. Therefore, how to develop a safe and convenient cataract surgery simulation teaching tool becomes a difficult problem to be solved in the current ophthalmic inpatient microsurgery teaching.
Disclosure of Invention
(one) solving the technical problems
Aiming at the defects of the prior art, the invention provides a cataract surgery simulation teaching model construction method based on a digital twin technology, which can solve the technical problems.
(II) technical scheme
In order to solve the technical problems, the invention provides the following technical scheme: a cataract surgery simulation teaching model construction method based on digital twin technology comprises the following steps:
s1: constructing a 3D eyeball model based on a digital twin technology;
s2: performing cataract surgery on eyeball tissues of the 3D eyeball model in a virtual space by utilizing VR and a force feedback device;
s3: collecting morphological change data of eyeball tissue during cataract surgery and mechanical parameters during cataract surgery;
s4: and synchronizing the morphological change data of the eyeball tissues and the mechanical parameters to the 3D eyeball model so as to establish a cataract surgery simulation teaching model.
Preferably, the step S1 specifically includes the following substeps:
s11: acquiring data required for constructing a 3D eyeball model;
s12: marking and cleaning the data;
s13: constructing a static model of the 3D eyeball model by using data and digital modeling software;
s14: and automatically generating a dynamic simulation model of the 3D eyeball model from the static model based on a data matching method.
Preferably, after sub-step S14, a sub-step S15 is also included: the eye de-dissection, eye tissue physiological and pathological characteristics and cataract disease pathogenesis of the 3D eye model are presented on the vision equipment.
Preferably, step S2 specifically comprises the following sub-steps:
s21: modeling eyeball tissue by using a triangulation method to subdivide the eyeball tissue into a plurality of triangles;
s22: performing cataract surgery on the balloon tissue in the virtual space by utilizing the VR, the force feedback device and the surgical instrument;
s23: detecting the contact position and action degree of the surgical instrument and eyeball tissues;
s24: the normal force of the surgical instrument on the eye tissue surface was simulated on each triangle.
Preferably, the step S3 specifically includes: the morphological change data of eyeball tissues during cataract surgery is collected through the surgical video equipment, and the mechanical parameters during cataract surgery are collected through the force feedback device.
Preferably, step S5 is further included after step S4: simulation training feedback and scoring of cataract surgery are performed.
Preferably, step S5 specifically comprises the following sub-steps:
s51: using a simulated surgical teaching set by students to perform cataract surgery on a 3D eyeball model, wherein the simulated surgical teaching set comprises VR, a force feedback device and surgical instruments;
s52: collecting the position and mechanical parameters of a surgical instrument acting on eyeball tissues of a student in the cataract surgery process in real time, and collecting morphological change data of the eyeball tissues of the student in the cataract surgery process to generate a student surgery model;
s53: and comparing the student operation model with the teacher operation model.
Preferably, the substep S53 is specifically: the student surgical model is compared with the teacher surgical model, and the expert critique is used for scoring the student surgical training.
Preferably, step S5 further comprises a substep S54: and (5) performing comprehensive evaluation to generate a surgery optimization scheme so as to further guide students to perform surgery.
(III) beneficial effects
Compared with the prior art, the invention provides a cataract surgery simulation teaching model construction method based on a digital twin technology, which has the following beneficial effects: (1) Creating a 3D eyeball model based on a digital twin technology, wherein the 3D eyeball model can dynamically display eyeball structure and disease knowledge, and deepen the understanding of a resident doctor on cataract basic knowledge and diagnosis and treatment process; (2) The virtual space transplanting method has the advantages that a cataract surgery simulation teaching model which does not need entity micro-operation equipment is created by utilizing VR and a force feedback device, and through virtual space transplanting of surgery operation, a resident can truly feel the effect of surgical instruments on a 3D eyeball model, cataract surgery simulation has high authenticity, and the resident truly experiences the cataract surgery operation process; (3) And establishing a cataract surgery simulation training feedback and scoring system, and guiding a resident to master the operation requirement in the repeated training process through real-time monitoring and feedback of the training process, so as to form good operation specifications. Through the mode, the invention can provide a safe, convenient, high-reality and interactive learning platform for training and improving cataract microsurgery skills of ophthalmologists.
Drawings
FIG. 1 is a flow chart of the steps of a method for constructing a simulated teaching model of cataract surgery based on digital twinning technology;
FIG. 2 is a step flow chart of step S1 of the present invention;
FIG. 3 is a step flow chart of steps S2-S4 of the present invention;
fig. 4 is a step flow chart of step S5 of the present invention.
Detailed Description
The following description of the embodiments of the present invention will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present invention, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
The invention provides a cataract surgery simulation teaching model construction method based on a digital twin technology, which comprises the following steps:
s1: and constructing a 3D eyeball model based on a digital twin technology.
The digital twin is to fully utilize data such as a physical model, sensor update, operation history and the like, integrate simulation processes of multiple disciplines, multiple physical quantities, multiple scales and multiple probabilities, and complete mapping in a virtual space, thereby reflecting the full life cycle process of corresponding entity equipment. The rapid development of digital twinning technology has enabled the development of surgical simulation training tools. The digital twin technology can construct various dynamic simulation models by applying technologies such as digital modeling, internet of things, information perception, artificial Intelligence (AI), cloud computing and the like, and can be used in the fields of teaching, equipment research and development, disease diagnosis and treatment, disease evolution, mechanism research and the like.
Specifically, the step S1 specifically includes the following substeps:
s11: data required for constructing a 3D eye model is acquired. Specifically, real world data of the basic structure and physiological functions of the eyeball, the occurrence and development of cataract and the diagnosis and treatment process are acquired through an ophthalmic examination device and a medical informatization system (HIS, EMR, LIS, PACS system and the like).
S12: and marking and cleaning the data. The acquired data are marked and cleaned, so that the types and the attributes of the data meet the requirements of building a 3D eyeball model.
S13: and constructing a static model of the 3D eyeball model by using data and digital modeling software. This sub-step S13 builds various initial 3D eye models, i.e. static models, using various 3D model modeling tools by using the acquired and processed structured data in combination with the theory of ophthalmology, material mechanics, optics, etc.
S14: and automatically generating a dynamic simulation model of the 3D eyeball model from the static model based on a data matching method. The sub-step S14 automatically generates a dynamic simulation model from a static model based on a data matching method, and continuously optimizes through real-time data feedback, so that the deconstructing and physiological and pathological characteristics of the 3D eyeball model are finally infinitely close to those of a real eyeball.
For example, firstly, the whole outline of the eyeball is outlined, the whole model of the eyeball is built by locating the whole and local tissue space parameters through a program, and then important tissues such as cornea, iris, ciliary muscle, crystal, vitreous body, sclera, iris, retina and the like are built. Then, according to the characteristics of the physiological motion parameters of the eyeballs, the physiological change of the eyeballs and tissues thereof is realized. For example, we control pupil constriction by adjusting changes in iris inner diameter and thickness, ciliary muscle length and thickness, and crystal diameter and thickness; and pupil color control is achieved by multiplying the original model texture by defined color attributes.
Furthermore, following the above sub-step S14, a sub-step S15 is included: the eye de-dissection, eye tissue physiological and pathological characteristics and cataract disease pathogenesis of the 3D eye model are presented on the vision equipment. The full-view multi-dimensional display eyeball de-cleavage structure can be particularly used on visual equipment such as a PC end, VR or mobile terminal, and the like, and the physiological and pathological characteristics of eyeball tissues and pathogenesis of cataract and the like are dynamically displayed.
S2: cataract surgery is performed on eye tissue of the 3D eye model in virtual space using VR and force feedback devices.
VR (Virtual Reality), which is a combination of Virtual and Reality, can create and experience a Virtual world. The force feedback device is a stimulator of tactile sensation, and the force feedback device of the invention can specifically adopt force feedback gloves. Cataract surgical procedures may include phacoemulsification, intraocular lens implantation, and the like.
Specifically, the step S2 specifically includes the following substeps:
s21: the eye tissue is modeled using a trigonometric approach to subdivide the eye tissue into a plurality of triangles.
S22: cataract surgery is performed on the balloon tissue in virtual space using VR, force feedback devices and surgical instruments.
S23: the position (corresponding to the triangle area) and the action degree (depth) of the surgical instrument in contact with the eyeball tissue are detected.
S24: the normal force of the surgical instrument on the eye tissue surface was simulated on each triangle.
S3: form change data of eyeball tissue during cataract operation and mechanical parameters during cataract operation are collected.
Preferably, the step S3 specifically includes: the morphological change data of eyeball tissues during cataract surgery is collected through the surgical video equipment, and the mechanical parameters during cataract surgery are collected through the force feedback device. The mechanical parameters may include, in particular, pressure and friction forces applied by the finger to the surgical instrument during cataract surgery and by the surgical instrument to the ocular tissue surface.
S4: and synchronizing the morphological change data of the eyeball tissues and the mechanical parameters to the 3D eyeball model so as to establish a cataract surgery simulation teaching model.
Preferably, step S5 is further included after step S4: simulation training feedback and scoring of cataract surgery are performed.
Further, the step S5 specifically includes the following substeps:
s51: students use a simulated surgical teaching set to perform cataract surgery on a 3D eyeball model, wherein the simulated surgical teaching set comprises VR, a force feedback device and surgical instruments. The student uses the simulated operation teaching suit to perform operation on the 3D eyeball model, and the student can truly feel the touch feeling and the stress degree of the virtual operation instrument on the 3D eyeball model in the process, and can see the change of the eyeball tissue morphology in real time.
S52: the method comprises the steps of collecting the position and mechanical parameters of a surgical instrument acting on eyeball tissues of a student in the cataract surgery process in real time, collecting morphological change data of the eyeball tissues of the student in the cataract surgery process, and generating a student surgery model.
S53: and comparing the student operation model with the teacher operation model. It should be understood that the teacher surgical model is a surgical model that the teacher generates accordingly by performing cataract surgery on the 3D eyeball model using simulated surgical teaching suit.
Preferably, this substep S53 is specifically: the student surgical model is compared with the teacher surgical model, and the expert critique is used for scoring the student surgical training. The key links of the student operation are scored by a double mechanism through expert criticizing and student-teacher model comparison.
In addition, step S5 further includes sub-step S54: and (5) performing comprehensive evaluation to generate a surgery optimization scheme so as to further guide students to perform surgery. Specifically, the comprehensive evaluation can be performed according to the technical specifications of cataract operation, the operation proficiency of the student operation process, the error condition in the operation and the like, and an operation optimization scheme is correspondingly generated.
Compared with the prior art, the invention provides a cataract surgery simulation teaching model construction method based on a digital twin technology, which has the following beneficial effects: (1) Creating a 3D eyeball model based on a digital twin technology, wherein the 3D eyeball model can dynamically display eyeball structure and disease knowledge, and deepen the understanding of a resident doctor on cataract basic knowledge and diagnosis and treatment process; (2) The virtual space transplanting method has the advantages that a cataract surgery simulation teaching model which does not need entity micro-operation equipment is created by utilizing VR and a force feedback device, and through virtual space transplanting of surgery operation, a resident can truly feel the effect of surgical instruments on a 3D eyeball model, cataract surgery simulation has high authenticity, and the resident truly experiences the cataract surgery operation process; (3) And establishing a cataract surgery simulation training feedback and scoring system, and guiding a resident to master the operation requirement in the repeated training process through real-time monitoring and feedback of the training process, so as to form good operation specifications. Through the mode, the invention can provide a safe, convenient, high-reality and interactive learning platform for training and improving cataract microsurgery skills of ophthalmologists.
It should be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
Although embodiments of the present invention have been shown and described, it will be understood by those skilled in the art that various changes, modifications, substitutions and alterations can be made therein without departing from the principles and spirit of the invention, the scope of which is defined in the appended claims and their equivalents.

Claims (9)

1. The method for constructing the cataract surgery simulation teaching model based on the digital twin technology is characterized by comprising the following steps of:
s1: constructing a 3D eyeball model based on a digital twin technology;
s2: performing cataract surgery on eyeball tissues of the 3D eyeball model in a virtual space by utilizing VR and a force feedback device;
s3: collecting morphological change data of the eyeball tissue during the cataract surgery and mechanical parameters during the cataract surgery;
s4: synchronizing the morphological change data of the eyeball tissues and the mechanical parameters to the 3D eyeball model to establish a cataract surgery simulation teaching model.
2. The method for constructing a digital twinning-based cataract surgery simulation teaching model according to claim 1, wherein the step S1 specifically comprises the following substeps:
s11: acquiring data required for constructing the 3D eyeball model;
s12: identifying and cleaning the data;
s13: constructing a static model of the 3D eyeball model by utilizing the data and digital modeling software;
s14: and automatically generating a dynamic simulation model of the 3D eyeball model from the static model based on a data matching method.
3. The method for constructing a digital twinning-based cataract surgery simulation teaching model according to claim 2, characterized by further comprising the substep S15 after the substep S14: and presenting eyeball de-dissection, eyeball tissue physiological and pathological characteristics and cataract disease pathogenesis of the 3D eyeball model on visual equipment.
4. The method for constructing a digital twinning-based cataract surgery simulation teaching model according to claim 1, wherein the step S2 specifically comprises the following substeps:
s21: modeling the eye tissue using a triangulation method to subdivide the eye tissue into a plurality of triangles;
s22: performing cataract surgery on the eyeball tissue in a virtual space by using the VR, a force feedback device and a surgical instrument;
s23: detecting the contact position and action degree of the surgical instrument and the eyeball tissues;
s24: the normal force of the surgical instrument on the eyeball tissue surface is simulated on each triangle.
5. The method for constructing a simulated teaching model for cataract surgery based on digital twinning technique according to claim 4, wherein the step S3 is specifically: the morphological change data of the eyeball tissues during cataract surgery is collected through a surgical video device, and meanwhile, the mechanical parameters during cataract surgery are collected through the force feedback device.
6. The method for constructing a digital twin technology-based cataract surgery simulation teaching model according to claim 5, further comprising step S5 after step S4: simulation training feedback and scoring of cataract surgery are performed.
7. The method for constructing a simulated teaching model for cataract surgery based on digital twinning technique according to claim 6, wherein the step S5 specifically comprises the following substeps:
s51: performing cataract surgery on the 3D eye model using a simulated surgical teaching set, wherein the simulated surgical teaching set comprises the VR, a force feedback device, and a surgical instrument;
s52: collecting the position and mechanical parameters of the student acting on the eyeball tissues by the surgical instrument in the cataract surgery process in real time, and collecting the morphological change data of the eyeball tissues of the student in the cataract surgery process to generate a student surgery model;
s53: and comparing the student operation model with a teacher operation model.
8. The method for constructing a digital twin technology-based cataract surgery simulation teaching model according to claim 7, wherein the substep S53 is specifically: and comparing the student operation model with a teacher operation model, and scoring the operation training of the student by expert comment.
9. The method for constructing a digital twin technology-based cataract surgery simulation teaching model according to claim 8, wherein the step S5 further comprises the substep S54: and (5) performing comprehensive evaluation to generate a surgery optimization scheme so as to further guide students to perform surgery.
CN202310364917.9A 2023-04-06 2023-04-06 Cataract operation simulation teaching model construction method based on digital twin technology Pending CN116486665A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202310364917.9A CN116486665A (en) 2023-04-06 2023-04-06 Cataract operation simulation teaching model construction method based on digital twin technology

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202310364917.9A CN116486665A (en) 2023-04-06 2023-04-06 Cataract operation simulation teaching model construction method based on digital twin technology

Publications (1)

Publication Number Publication Date
CN116486665A true CN116486665A (en) 2023-07-25

Family

ID=87214779

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202310364917.9A Pending CN116486665A (en) 2023-04-06 2023-04-06 Cataract operation simulation teaching model construction method based on digital twin technology

Country Status (1)

Country Link
CN (1) CN116486665A (en)

Similar Documents

Publication Publication Date Title
Sinclair et al. Computer-simulated eye surgery: a novel teaching method for residents and practitioners
Ting et al. Ophthalmology simulation for undergraduate and postgraduate clinical education
Ong et al. Applications of extended reality in ophthalmology: systematic review
CN105825752A (en) Force feedback device-based virtual corneal surgery training system
KR20200048830A (en) Cataract surgery Simulation System for education based on virtual reality
US11227509B2 (en) Surgical simulator systems and methods
Laurell et al. Computer-simulated phacoemulsification
Lam et al. Virtual reality simulator for phacoemulsification cataract surgery education and training
US11751953B2 (en) Cloud based system cataract treatment database and algorithm system
CN114402378B (en) Surgical simulator system and method
US20200163727A1 (en) Cloud based system cataract treatment database and algorithm system
Nguyen et al. An experimental training support framework for eye fundus examination skill development
WO2007019546A2 (en) System, device, and methods for simulating surgical wound debridements
CN116486665A (en) Cataract operation simulation teaching model construction method based on digital twin technology
Lam et al. Virtual simulation of eyeball and extraocular muscle reaction during cataract surgery
Jayakumar et al. Interactive gesture based cataract surgery simulation
Mahr The Eyesi Ophthalmic Surgical Simulator
WO2020091224A1 (en) Virtual reality-based cataract surgery simulator system
Perez et al. Cataract surgery simulator for medical education & finite element/3D human eye model
RU2755546C1 (en) Method for teaching basic technical skills of phacoemulsification and vitreoretinal surgery using simulation technologies
TWI830910B (en) Device, method and system for cloud based system cataract treatment
Cai et al. Parametric eyeball model for interactive simulation of ophthalmologic surgery
Gross Muñoz et al. Augmented Reality, Virtual Reality, and Game Technologies in Ophthalmology Training
Koh Applications of extended reality in ophthalmology: Systematic
Lee et al. Ophthalmoscopic examination training using virtual reality

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination