CN112037629A - Medical operation simulation system based on mixed reality technology - Google Patents
Medical operation simulation system based on mixed reality technology Download PDFInfo
- Publication number
- CN112037629A CN112037629A CN202010717314.9A CN202010717314A CN112037629A CN 112037629 A CN112037629 A CN 112037629A CN 202010717314 A CN202010717314 A CN 202010717314A CN 112037629 A CN112037629 A CN 112037629A
- Authority
- CN
- China
- Prior art keywords
- mixed reality
- medical
- information
- user
- scene
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B23/00—Models for scientific, medical, or mathematical purposes, e.g. full-sized devices for demonstration purposes
- G09B23/28—Models for scientific, medical, or mathematical purposes, e.g. full-sized devices for demonstration purposes for medicine
- G09B23/286—Models for scientific, medical, or mathematical purposes, e.g. full-sized devices for demonstration purposes for medicine for scanning or photography techniques, e.g. X-rays, ultrasonics
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B9/00—Simulators for teaching or training purposes
Abstract
The invention provides a medical operation simulation system based on a mixed reality technology, which comprises: the data storage module is used for storing medical operation information, wherein the medical operation information comprises basic information of a plurality of medical instruments and operation information related to the plurality of medical instruments; the scene construction module is used for constructing an operation simulation scene according to the medical operation information; the mixed reality holographic image module is used for building a mixed reality operation simulation scene according to the operation simulation scene so that a user can perform operation exercise and operation observation in the mixed reality operation simulation scene. The invention can save the cost and time for training medical staff in hospitals and schools, reduce the misoperation risk of operation trainees, and has important significance for medical education and actual work in hospitals.
Description
Technical Field
The invention relates to the technical field of simulation equipment, in particular to a medical operation simulation system based on a mixed reality technology.
Background
Medical technology is continuously developed, and the technical level of medical staff needs to be improved continuously. Medical personnel can acquire academic knowledge by browsing data, including use and description of medical instruments, diagnosis and treatment of various diseases, study and research of various anatomical operations on human bodies, and many medical academic wait for the medical personnel to continuously explore.
However, currently, for surgical operations, most medical staff watch videos or clinically watch other medical staff to study and study, and do not get better exercise for actual manual operation ability.
Disclosure of Invention
The medical operation simulation system based on the mixed reality technology can enable a user to experience a clinical operation process similar to the actual operation process, save the cost and time for training medical staff in hospitals and schools, reduce the misoperation risk of operation trainees and have important significance for medical education and actual work of hospitals.
The technical scheme adopted by the invention is as follows:
a medical operation simulation system based on mixed reality technology comprises: the data storage module is used for storing medical operation information, wherein the medical operation information comprises basic information of a plurality of medical instruments and operation information related to the plurality of medical instruments; the scene construction module is used for constructing an operation simulation scene according to the medical operation information; mixed reality holographic image module, mixed reality holographic image module be used for the basis mixed reality operation simulation scene is built to operation simulation scene to the user is in carry out operation rehearsal and operation sight in the mixed reality operation simulation scene.
The basic information of the medical instrument comprises a model and performance of the medical instrument, and the operation information related to the medical instrument comprises an operation type corresponding to the medical instrument.
The operation simulation scene comprises the name and the number of medical instruments needed in the simulated operation process and the operation posture of a user in the actual operation process.
The mixed reality holographic image module comprises an acquisition unit, and the acquisition unit is used for acquiring the action information of the user in the mixed reality operation simulation scene in real time.
The motion information includes real-time finger motion and real-time operation images during the simulated surgical procedure.
The mixed reality holographic image module comprises a correction unit, and the correction unit is used for acquiring the operation statement of the user in the mixed reality operation simulation scene and judging whether the operation statement and the action information of the user in the mixed reality operation simulation scene are correct or not according to the medical operation information.
The mixed reality holographic image module comprises a learning unit, wherein the learning unit is used for preferentially acquiring new actions in the action information of the user and sending the new actions to the data storage module so as to update the medical operation information in the data storage module.
The invention has the beneficial effects that:
according to the medical operation simulation system based on the mixed reality technology, the virtual operation simulation scene is built based on the mixed reality technology, so that users such as medical staff and students can conduct operation training, operation and planning in the simulation scene by means of mixed reality equipment and experience a clinical operation process similar to the actual operation, therefore, the cost and time for training medical staff in hospitals and schools can be saved, the misoperation risk of operation trainees is reduced, and the medical operation simulation system based on the mixed reality technology has important significance for medical education and actual work of hospitals.
Drawings
FIG. 1 is a block diagram of a medical operation simulation system based on mixed reality technology according to an embodiment of the present invention;
fig. 2 is a block diagram of a medical operation simulation system based on mixed reality technology according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
As shown in fig. 1, the medical operation simulation system based on mixed reality technology according to the embodiment of the present invention includes a data storage module 10, a scene construction module 20, and a mixed reality hologram module 30. The data storage module 10 is configured to store medical operation information, where the medical operation information includes basic information of a plurality of medical instruments and operation information related to the plurality of medical instruments; the scene construction module 20 is used for constructing an operation simulation scene according to the medical operation information; the mixed reality holographic image module 30 is used for building a mixed reality operation simulation scene according to the operation simulation scene, so that the user can perform operation exercise and operation observation in the mixed reality operation simulation scene.
In one embodiment of the present invention, for each medical instrument stored in the data storage module 10, each has a corresponding name, and its basic information may include its model and capabilities, and the surgical information associated therewith may include its corresponding surgical type. Each operation type has a corresponding operation mode, including postures, actions and the like of medical staff in the actual operation process.
The scene construction module 20 may construct a surgery simulation scene according to basic information of any medical instrument called by a surgery to be simulated and surgery information related to the medical instrument, where the surgery simulation scene includes names and numbers of medical instruments required in a simulated surgery process, and an operation posture of a user in an actual operation process.
The mixed reality hologram module 30 has a basic hologram display function, and may further have a collection function, a correction function, and a learning function.
In one embodiment of the present invention, as shown in fig. 2, the mixed reality hologram module 30 may include an acquisition unit 31, and the acquisition unit 31 is used to acquire motion information of a user in a mixed reality surgery simulation scene in real time. The motion information comprises real-time finger motion and real-time operation images in the simulated operation process. Specifically, the finger motion of the user can be collected in real time through a motion sensor worn by the finger of the user, or the finger image of the user can be shot through a camera, and the finger motion of the user can be obtained through image analysis. The operation image can be obtained by shooting the whole simulated operation scene through the camera.
In one embodiment of the present invention, as shown in fig. 2, the mixed reality hologram module 30 may include a correction unit 32, and the correction unit 32 is configured to obtain the operation statement of the user in the mixed reality surgery simulation scene, and determine whether the operation statement and the action information of the user in the mixed reality surgery simulation scene are correct according to the medical surgery information. Specifically, the user wears the mixed reality glasses to perform medical operation observation in the mixed reality operation simulation scene, and when the drill operation is required, the user performs the operation on the human organ presented in the mixed reality operation simulation scene while dictating key points of the operation and detailed operation of the operation process. The calibration unit 32 may retrieve the user's statement and call up the medical procedure information in the data storage module 10 to determine whether the user's statement and actual action are correct.
In one embodiment of the present invention, as shown in fig. 2, the mixed reality hologram module 30 may include a learning unit 33, and the learning unit 33 is configured to preferentially acquire a new action in the action information of the user and send the new action to the data storage module 10, so as to update the medical operation information in the data storage module 10. Specifically, when the user performs the surgical drill in the mixed reality surgical simulation scene, if a new research on the surgical procedure finds a simple posture in the dissection process, the learning unit 33 may record the information in real time and transmit the information to the data storage module 10, and the data storage module 10 updates the data information in the data storage module in real time, so as to be called in the subsequent medical surgical simulation process.
According to the medical operation simulation system based on the mixed reality technology, a virtual operation simulation scene is built based on the mixed reality technology, so that users such as medical staff and students can conduct operation training, operation and planning in the simulation scene by means of mixed reality equipment and experience a clinical operation process similar to the actual operation, therefore, the cost and time for training medical staff in hospitals and schools can be saved, the misoperation risk of operation trainees is reduced, and the medical operation simulation system based on the mixed reality technology has important significance for medical education and actual work of hospitals.
In the description of the present invention, the terms "first" and "second" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implying any number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature. The meaning of "plurality" is two or more unless specifically limited otherwise.
In the present invention, unless otherwise expressly stated or limited, the terms "mounted," "connected," "secured," and the like are to be construed broadly and can, for example, be fixedly connected, detachably connected, or integrally formed; can be mechanically or electrically connected; either directly or indirectly through intervening media, either internally or in any other relationship. The specific meanings of the above terms in the present invention can be understood by those skilled in the art according to specific situations.
In the present invention, unless otherwise expressly stated or limited, the first feature "on" or "under" the second feature may be directly contacting the first and second features or indirectly contacting the first and second features through an intermediate. Also, a first feature "on," "over," and "above" a second feature may be directly or diagonally above the second feature, or may simply indicate that the first feature is at a higher level than the second feature. A first feature being "under," "below," and "beneath" a second feature may be directly under or obliquely under the first feature, or may simply mean that the first feature is at a lesser elevation than the second feature.
In the description herein, references to the description of the term "one embodiment," "some embodiments," "an example," "a specific example," or "some examples," etc., mean that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the invention. In this specification, the schematic representations of the terms used above are not necessarily intended to refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples. Furthermore, various embodiments or examples and features of different embodiments or examples described in this specification can be combined and combined by one skilled in the art without contradiction.
Although embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that changes, modifications, substitutions and alterations can be made in these embodiments without departing from the principles and spirit of the invention, the scope of which is defined in the appended claims and their equivalents.
Claims (7)
1. A medical operation simulation system based on mixed reality technology, comprising:
the data storage module is used for storing medical operation information, wherein the medical operation information comprises basic information of a plurality of medical instruments and operation information related to the plurality of medical instruments;
the scene construction module is used for constructing an operation simulation scene according to the medical operation information;
mixed reality holographic image module, mixed reality holographic image module be used for the basis mixed reality operation simulation scene is built to operation simulation scene to the user is in carry out operation rehearsal and operation sight in the mixed reality operation simulation scene.
2. The mixed reality technology-based medical operation simulation system of claim 1, wherein the basic information of the medical instrument comprises a model and performance of the medical instrument, and the operation information related to the medical instrument comprises an operation type corresponding to the medical instrument.
3. The mixed reality technology-based medical surgery simulation system according to claim 2, wherein the surgery simulation scenario includes names, numbers of medical instruments required in a simulated surgical procedure, and operation postures of a user during an actual operation.
4. The mixed reality technology-based medical surgery simulation system according to claim 3, wherein the mixed reality holographic image module comprises an acquisition unit for acquiring motion information of the user in the mixed reality surgery simulation scene in real time.
5. The mixed reality technology-based medical procedure simulation system of claim 4, wherein the motion information comprises real-time finger motion and real-time operation images during the simulated procedure.
6. The mixed reality technology-based medical operation simulation system of claim 5, wherein the mixed reality holographic image module comprises a correction unit, and the correction unit is configured to obtain the operation statement of the user in the mixed reality operation simulation scene, and determine whether the operation statement and the action information of the user in the mixed reality operation simulation scene are correct according to the medical operation information.
7. The mixed reality technology-based medical procedure simulation system of claim 6, wherein the mixed reality hologram module comprises a learning unit for preferentially acquiring a new action in the action information of the user and sending the new action to the data storage module so as to update the medical procedure information in the data storage module.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010717314.9A CN112037629A (en) | 2020-07-23 | 2020-07-23 | Medical operation simulation system based on mixed reality technology |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010717314.9A CN112037629A (en) | 2020-07-23 | 2020-07-23 | Medical operation simulation system based on mixed reality technology |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112037629A true CN112037629A (en) | 2020-12-04 |
Family
ID=73582998
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010717314.9A Pending CN112037629A (en) | 2020-07-23 | 2020-07-23 | Medical operation simulation system based on mixed reality technology |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112037629A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112863283A (en) * | 2021-01-19 | 2021-05-28 | 上海石指健康科技有限公司 | Medical education system based on mixed reality and 5G network slicing technology |
| CN113284597A (en) * | 2021-07-23 | 2021-08-20 | 杭州乾瑾科技有限公司 | Critical MDT system and method based on scene fusion and MR |
| CN114913309A (en) * | 2022-05-28 | 2022-08-16 | 深圳大学 | High-simulation surgical operation teaching system and method based on mixed reality |
| WO2022240356A1 (en) * | 2021-05-10 | 2022-11-17 | National University Of Singapore | Systems and methods for building, and assessing performance of, scenarios for virtual environments |
Citations (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20030163271A1 (en) * | 2002-02-25 | 2003-08-28 | Erik Chell | Method and apparatus for reconstruction calibration of detector position and source motion based on a multi-pin phantom |
| CN102254476A (en) * | 2011-07-18 | 2011-11-23 | 广州赛宝联睿信息科技有限公司 | Endoscopic minimally invasive surgery simulation training method and system |
| CN104685551A (en) * | 2012-09-12 | 2015-06-03 | 维塔医疗股份公司 | Mixed reality simulation method and system |
| CN104778894A (en) * | 2015-04-28 | 2015-07-15 | 关宏刚 | Virtual simulation bone-setting manipulation training system and establishment method thereof |
| CN106251751A (en) * | 2016-10-12 | 2016-12-21 | 大连文森特软件科技有限公司 | A kind of simulated medical surgery analogue system based on VR technology |
| CN106251752A (en) * | 2016-10-25 | 2016-12-21 | 深圳市科创数字显示技术有限公司 | The medical science training system that AR and VR combines |
| CN106846496A (en) * | 2017-01-19 | 2017-06-13 | 杭州古珀医疗科技有限公司 | DICOM images based on mixed reality technology check system and operating method |
| CN206505576U (en) * | 2017-02-17 | 2017-09-19 | 昆明医科大学 | A kind of Medical Network Teaching interactive system |
| KR20180058885A (en) * | 2016-11-24 | 2018-06-04 | 전자부품연구원 | Non-enter SSDS virtual training apparatus and system based on mixed reality |
| CN110136522A (en) * | 2019-05-07 | 2019-08-16 | 艾瑞迈迪科技石家庄有限公司 | Skull base surgery simulation teching training system |
| CN110362209A (en) * | 2019-07-23 | 2019-10-22 | 辽宁向日葵教育科技有限公司 | A kind of MR mixed reality intelligent perception interactive system |
| CN110491235A (en) * | 2019-09-06 | 2019-11-22 | 上海域圆信息科技有限公司 | A kind of multi-person synergy formula midwifery teaching training system |
| CN110556031A (en) * | 2019-09-06 | 2019-12-10 | 重庆大学附属肿瘤医院 | Medical guidance system for ostomy patient |
| CN210667262U (en) * | 2019-09-19 | 2020-06-02 | 中国医学科学院北京协和医院 | Patient education medical system based on VR technology |
-
2020
- 2020-07-23 CN CN202010717314.9A patent/CN112037629A/en active Pending
Patent Citations (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20030163271A1 (en) * | 2002-02-25 | 2003-08-28 | Erik Chell | Method and apparatus for reconstruction calibration of detector position and source motion based on a multi-pin phantom |
| CN102254476A (en) * | 2011-07-18 | 2011-11-23 | 广州赛宝联睿信息科技有限公司 | Endoscopic minimally invasive surgery simulation training method and system |
| CN104685551A (en) * | 2012-09-12 | 2015-06-03 | 维塔医疗股份公司 | Mixed reality simulation method and system |
| CN104778894A (en) * | 2015-04-28 | 2015-07-15 | 关宏刚 | Virtual simulation bone-setting manipulation training system and establishment method thereof |
| CN106251751A (en) * | 2016-10-12 | 2016-12-21 | 大连文森特软件科技有限公司 | A kind of simulated medical surgery analogue system based on VR technology |
| CN106251752A (en) * | 2016-10-25 | 2016-12-21 | 深圳市科创数字显示技术有限公司 | The medical science training system that AR and VR combines |
| KR20180058885A (en) * | 2016-11-24 | 2018-06-04 | 전자부품연구원 | Non-enter SSDS virtual training apparatus and system based on mixed reality |
| CN106846496A (en) * | 2017-01-19 | 2017-06-13 | 杭州古珀医疗科技有限公司 | DICOM images based on mixed reality technology check system and operating method |
| CN206505576U (en) * | 2017-02-17 | 2017-09-19 | 昆明医科大学 | A kind of Medical Network Teaching interactive system |
| CN110136522A (en) * | 2019-05-07 | 2019-08-16 | 艾瑞迈迪科技石家庄有限公司 | Skull base surgery simulation teching training system |
| CN110362209A (en) * | 2019-07-23 | 2019-10-22 | 辽宁向日葵教育科技有限公司 | A kind of MR mixed reality intelligent perception interactive system |
| CN110491235A (en) * | 2019-09-06 | 2019-11-22 | 上海域圆信息科技有限公司 | A kind of multi-person synergy formula midwifery teaching training system |
| CN110556031A (en) * | 2019-09-06 | 2019-12-10 | 重庆大学附属肿瘤医院 | Medical guidance system for ostomy patient |
| CN210667262U (en) * | 2019-09-19 | 2020-06-02 | 中国医学科学院北京协和医院 | Patient education medical system based on VR technology |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112863283A (en) * | 2021-01-19 | 2021-05-28 | 上海石指健康科技有限公司 | Medical education system based on mixed reality and 5G network slicing technology |
| WO2022240356A1 (en) * | 2021-05-10 | 2022-11-17 | National University Of Singapore | Systems and methods for building, and assessing performance of, scenarios for virtual environments |
| CN113284597A (en) * | 2021-07-23 | 2021-08-20 | 杭州乾瑾科技有限公司 | Critical MDT system and method based on scene fusion and MR |
| CN114913309A (en) * | 2022-05-28 | 2022-08-16 | 深圳大学 | High-simulation surgical operation teaching system and method based on mixed reality |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112037629A (en) | Medical operation simulation system based on mixed reality technology | |
| Turney | Anatomy in a modern medical curriculum | |
| Basdogan et al. | VR-based simulators for training in minimally invasive surgery | |
| CN206431875U (en) | Medical anatomy assisted teaching system based on augmented reality | |
| KR20180058656A (en) | Reality - Enhanced morphological method | |
| CN106297464A (en) | A kind of virtual diagnosis and therapy system | |
| US20080050711A1 (en) | Modulating Computer System Useful for Enhancing Learning | |
| CN110400620B (en) | Heart three-dimensional model construction method and simulated heart operation guidance system | |
| US7878811B2 (en) | Method and system for providing timely performance evaluations to medical students or trainees | |
| US20220375621A1 (en) | Digital twin | |
| CN112151155A (en) | Ultrasonic image intelligent training method and system based on artificial intelligence and application system | |
| US20060040245A1 (en) | Interactive medical procedure training | |
| CN110300547A (en) | Medical information virtual reality server system, medical information virtual reality program, medical information virtual reality system, the creation method and medical information virtual reality data of medical information virtual reality data | |
| CN111402982A (en) | Diagnosis evaluation system based on virtual standard patient | |
| CN113995525A (en) | Medical scene synchronous operation system capable of switching visual angles and based on mixed reality and storage medium | |
| Bass | Fundamental changes in general surgery residency training | |
| RU2687564C1 (en) | System for training and evaluating medical personnel performing injection and surgical minimally invasive procedures | |
| US20200111376A1 (en) | Augmented reality training devices and methods | |
| CN116229793A (en) | Training and checking system based on virtual reality technology | |
| Mohamadipanah et al. | Performance assessment using sensor technology | |
| Siegel et al. | Computerized diagnosis: implications for clinical education | |
| TWI467521B (en) | System and method for learning clinical diagnosis | |
| Kuo et al. | Virtual reality: current urologic applications and future developments | |
| US20230169880A1 (en) | System and method for evaluating simulation-based medical training | |
| Reis et al. | A framework for simulation systems and technologies for medical training |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20201204 |
|
| RJ01 | Rejection of invention patent application after publication |