CN112489541A - Multimedia auxiliary system for medical training - Google Patents
Multimedia auxiliary system for medical training Download PDFInfo
- Publication number
- CN112489541A CN112489541A CN201910864649.0A CN201910864649A CN112489541A CN 112489541 A CN112489541 A CN 112489541A CN 201910864649 A CN201910864649 A CN 201910864649A CN 112489541 A CN112489541 A CN 112489541A
- Authority
- CN
- China
- Prior art keywords
- training
- medical
- database
- medical training
- auxiliary system
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B23/00—Models for scientific, medical, or mathematical purposes, e.g. full-sized devices for demonstration purposes
- G09B23/28—Models for scientific, medical, or mathematical purposes, e.g. full-sized devices for demonstration purposes for medicine
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B9/00—Simulators for teaching or training purposes
Landscapes
- Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Educational Technology (AREA)
- Educational Administration (AREA)
- Business, Economics & Management (AREA)
- Computational Mathematics (AREA)
- Health & Medical Sciences (AREA)
- Algebra (AREA)
- Mathematical Analysis (AREA)
- Mathematical Optimization (AREA)
- Mathematical Physics (AREA)
- Pure & Applied Mathematics (AREA)
- Medicinal Chemistry (AREA)
- Medical Informatics (AREA)
- General Health & Medical Sciences (AREA)
- Chemical & Material Sciences (AREA)
- Instructional Devices (AREA)
Abstract
A multimedia assistive system of medical training, comprising: a medical training database, which comprises a first training database and an arithmetic unit; the virtual reality image wearing equipment is used for being worn by a user, is linked with the medical training database through a network and transmits a real-time image to the medical training database; the multi-somatosensory detection unit is used for generating at least one action signal after detecting the action of the user and transmitting the action signal to the medical training database; accordingly, the operation unit provides feedback information according to the action signal and the real-time image.
Description
The technical field is as follows:
the invention relates to a multimedia auxiliary system for medical training, in particular to a multimedia auxiliary system for medical training, which can provide feedback information by using real-time images.
Background art:
virtual Reality (VR) is a new technology developed in recent years by computer multimedia technology, and integrates software and hardware of a computer, simulates a real environment or physical properties, matches with the operation speed, drawing and animation processing capabilities of the computer, and an appropriate operation interface, and enables a user to learn, train and simulate a test in a timely and interactive operation environment.
The current virtual reality technology is applied to the examples of rehabilitation medicine, including a virtual reality treadmill training system, a virtual reality hand continuous passive motion rehabilitation system, a virtual reality agoraphobia evaluation training system and the like. Similarly, the applications in the medical field are more: virtual surgical planning, simulation training systems, telesurgery interfaces, virtual human anatomy interactive education systems, and the like, will have significant impact on the development of medical science and technology.
At present, the medical application of virtual reality focuses on developing and training students in medical schools to learn human anatomy and pathology, simulating and planning a complex preoperative procedure, controlling an endoscope in a surgical process, predicting a surgical result and the like by using a virtual reality technology. The national library of medicine in the united states developed a standard digital optical disc database for use in medical college physiological anatomy teaching. Piper et al also developed an integrated lower extremity biomechanical virtual reality simulation system. In the future, the system can be expanded to a virtual corpse (virtanl cadover) simulating the whole body of a human body, so that a user can utilize a helmet display and a touch sensing glove to walk in the virtual corpse to know the correlation among organs in the body and the reaction in the treatment process. In addition, the virtual reality technology can be used to construct a surgical operation simulation system for young physicians to repeatedly exercise the surgical procedure and the manipulation of instruments, so that the physicians can train in the same way as pilots in flight training simulators to improve the skill and technique of surgical operation.
However, due to the complexity of the surgery, the physician often needs to have a sudden condition in the surgery process along with the difference of the physical constitution or physical condition of the patient, or a new physician who is not trained yet occurs, so that the surgery training time of the physician is longer.
The invention content is as follows:
the objective of the present invention is to disclose a multimedia auxiliary system for medical training, which comprises: a medical training database, which comprises a first training database and an arithmetic unit; the virtual reality image wearing equipment is used for being worn by a user, is linked with the medical training database through a network and transmits a real-time image to the medical training database; the multi-somatosensory detection unit is used for generating at least one action signal after detecting the action of the user and transmitting the action signal to the medical training database; accordingly, the operation unit provides feedback information according to the action signal and the real-time image.
The multimedia auxiliary system for medical training, wherein the multiple somatosensory detection unit comprises a wrist sensor.
The multimedia auxiliary system for medical training comprises a first database, an arithmetic unit and a second database, wherein the first database comprises an image database, and the arithmetic unit comprises an image recognition unit and is used for comparing the image database with a real-time image.
The multimedia auxiliary system for medical training comprises a training target setting unit, and when feedback information meets the training target setting unit, the medical training database generates a second training database.
The multimedia auxiliary system for medical training, wherein, the image database contains live operation images from a remote doctor.
The multimedia auxiliary system for medical training further comprises a medical instrument information acquisition unit for acquiring angle or route information of a user operating an instrument.
The multimedia auxiliary system for medical training, wherein the medical instrument information acquisition unit comprises a probe.
The multimedia auxiliary system for medical training further comprises a real-time communication unit for the user to communicate with a remote doctor in real time during training.
The multimedia auxiliary system for medical training, wherein the multiple somatosensory detection units are arranged in the silica gel bracelet or the glove.
The multimedia auxiliary system for medical training is characterized in that the medical training database comprises medical images of ultrasonic waves and an endoscope and is linked with a server.
Therefore, when the user performs medical training, the operated picture can be faithfully presented in a first visual angle mode, so that the multimedia auxiliary system for medical training can compare and provide feedback information.
In addition, the multimedia auxiliary system for medical training provided by the invention can be used for enabling a trainee to more quickly absorb medical knowledge in the practical application, wherein the first training database can be the content of a set training course, or can be an actual operation picture which is carried out by a deep-seated doctor from overseas and other places, particularly in the teaching of special cases.
Furthermore, the training condition is monitored by the training target setting unit, and simultaneously, the difficulty level can be divided, and the simulated training is provided according to the sequence of the difficulty level according to the experience of the intern.
Description of the drawings:
fig. 1 is a schematic diagram of a multimedia auxiliary system for medical training according to the present invention.
Fig. 2 is a schematic diagram of another multimedia auxiliary system for medical training of the present invention.
Fig. 3 is a schematic diagram of another multimedia auxiliary system for medical training of the present invention.
Fig. 4 is a schematic diagram of another multimedia auxiliary system for medical training of the present invention.
Reference numerals:
multimedia auxiliary system 1 for medical training
Virtual reality image wearing equipment 20
Real-time image 21
Multiple somatosensory detection unit 30
Training target setting unit 40
Medical instrument information acquisition unit 50
Real-time communication unit 60
The specific implementation mode is as follows:
reference will now be made in detail to the present embodiments of the invention, examples of which are illustrated in the accompanying drawings, wherein like reference numerals or characters refer to the same elements or concepts throughout the different views. The embodiments of the present invention will be described with reference to the accompanying drawings.
Please refer to fig. 1, which is a schematic diagram of a multimedia auxiliary system 1 for medical training according to the present invention. Which comprises the following steps: a medical training database 10, a virtual reality image wearing device 20, and a multi-motion sensing unit 30. The medical training database 10 includes a first training database 11 and an arithmetic unit 12. The virtual reality image wearing device 20 is used for being worn by a user, the virtual reality image wearing device 20 can be linked with the medical training database 10 through a wired network or a wireless network to transmit a real-time image 21 to the medical training database 10, wherein, the user can be a trainee, when wearing the virtual reality image wearing device 20, the simulated surgery exercise can be carried out by referring to the existing training teaching materials or training operation instructions in the first training database 11, and in the process of simulating the surgery operation, a camera can be arranged on the virtual reality image wearing device 20 to record the visual field of the trainee in a first visual angle mode to be used as the real-time image 21, and the real-time image 21 is transmitted back to the medical training database.
The multi-somatosensory detection unit 30 is used for detecting the motion of the user, generating at least one motion signal 31 according to the detected motion, and transmitting the motion signal 31 to the medical training database 10; accordingly, the operation unit 12 provides feedback information 32 according to the action signal 31 and the real-time image 31 and after comparing the action signal with the first training database 11. For example, if the first training database 11 is a training instruction, the computing unit 12 compares the action signal 31 and the real-time image 31 to determine whether they match the content of the training instruction, and accordingly provides a feedback message 32 to the user for further review and analysis.
Furthermore, the multiple motion sensing unit 30 is mainly used for detecting the motion or the body state of the user, and therefore, it is preferable to be disposed on the user, and optionally, a wrist sensor, or a magnetic tracker, an inertial sensor, an optical tracker, or a 3-axis acceleration sensor, a gyroscope, an electronic compass, etc. are not particularly limited, and the manner of disposing is not particularly limited, for example, the multiple motion sensing unit may be disposed in a silica gel bracelet or a glove, as long as it can sense the specific motion or the specific body state of the user according to the requirement.
In one embodiment, the user is a intern, and prepares to perform a simulation exercise of a minimally invasive surgery, so to detect whether the micro motions of the hand of the intern are correct during the operation, the multi-motion sensing unit 30 selects a wrist sensor and a glove with multiple multi-motion sensing units 30 arranged on the fingers, the intern wears the wrist sensor and the glove and wears the virtual reality image wearing device 20 to start the simulation exercise of the minimally invasive surgery, at this time, the virtual reality image wearing device 20 transmits a real-time image 21 with the intern as a first visual angle, the wrist sensor and the multi-motion sensing unit 30 on the glove transmit a plurality of motion signals 31 of the intern to the medical training database 10, and accordingly, after the computing unit 12 compares the motion signals 31 with the real-time image 31 to the first training database 11, providing feedback information 32 to the virtual reality image-worn device 20. In addition, the real-time images 21 conveyed by the first perspective of the intern may also be used for post-training review and analysis.
Referring to fig. 2, in order to make the learning of the intern more effective, the first training database 11 may include an image database 111, and the operation unit 12 includes an image recognition unit 121 for comparing the image database 111 with the real-time image 31, further, the image database 111 may further include live operation images from a remote physician, so as to collect the teaching experience and the classic case of the physician, record various mature operation technical points and exercise principles, facilitate the incorporation of the assistant training, and simulate different clinical exercise layouts to make the physician focus on the training.
In addition, referring to fig. 3, in an embodiment, the multimedia auxiliary system 1 for medical training further includes a training target setting unit 40, and the medical training database 10 generates a second training database 13 after the feedback information 32 satisfies the training target setting unit 40. Accordingly, it is possible to effectively monitor the training situation of the training match, and at the same time, it is possible to classify the difficulty level, and according to the experience of the trainee, the simulation training is provided in order of the difficulty level, and after the trainee has reached the target setting unit 40 in the simulation operation, the simulation operation can be advanced to the simulation operation target with higher difficulty level or higher complexity level, and at this time, the medical training database 10 generates the second training database 13, in other words, the difficulty level or complexity level of the second training database 13 is higher than that of the first training database 11.
In general, the content of the first training database 11 and the second training database 13 may include medical images of ultrasound or endoscope, or videos and operation flow descriptions of various operations, and the data may be too huge after being accumulated for a long time, so that the data may be linked to a server for storing the data of the first training database 11 and the second training database 13, the angle or route information of the operation instrument captured by the medical instrument information capturing unit 50, or historical data of the real-time image 21, the action signal 31, the feedback information 32, and the like, so as to facilitate the subsequent operation calibration and operation analysis of the practicing physician, and improve the operation or medical experience of the practicing physician as fast as possible.
Referring to fig. 4, in another embodiment, the multimedia auxiliary system 1 for medical training further comprises a medical instrument information retrieving unit 50 for retrieving angle or route information of the user operating the instrument, and transmits this information to the arithmetic unit 11, mainly because, during surgery, the doctor must operate the machine or instrument, therefore, not only the skill of the physician to operate the device is known by knowing the body sensing movement or gesture movement information of the physician, but also the accuracy of the device to be operated is required, and therefore, by the medical device information capturing unit 50, the time, angle, direction, etc. of the physician operating the apparatus can be detected, and therefore, the form of the medical apparatus information capturing unit 50 is not particularly limited as long as the movement of the specific apparatus can be detected according to the requirement, for example, the probe 51 of the detecting apparatus is used to accomplish the above functions.
In addition, the multimedia auxiliary system 1 for medical training of the present invention may further include a real-time communication unit 60 for providing a trainee with real-time communication with a remote physician during training, including real-time communication of images or real-time communication of voice, for example, through a ZigBee voice transmission mode or a micro microphone, a speaker, or an earphone.
It should be noted that, in the multimedia auxiliary system for medical training provided by the present invention, in practical applications, the first training database 11 may be the content of a given training course, or may be the actual operation picture from a senior physician at a different place, both abroad and abroad, and particularly, in the teaching of a special case, the internist can absorb the medical knowledge more quickly.
Although the present invention has been described with reference to the preferred embodiments, it should be understood that various changes, substitutions and alterations can be made herein without departing from the spirit and scope of the invention as defined by the appended claims.
Claims (10)
1. A multimedia auxiliary system for medical training, comprising:
a medical training database, which comprises a first training database and an arithmetic unit;
the virtual reality image wearing equipment is used for being worn by a user, is linked with the medical training database through a network and transmits a real-time image to the medical training database;
the multi-somatosensory detection unit is used for generating at least one action signal after detecting the action of the user and transmitting the action signal to the medical training database;
accordingly, the operation unit provides feedback information after comparing the action signal with the real-time image in the first training database.
2. The multimedia auxiliary system for medical training of claim 1, wherein said multi-somatosensory detection unit comprises a wrist sensor.
3. The multimedia auxiliary system for medical training according to claim 1, wherein the multiple somatosensory detection units are disposed in a silicone bracelet or a glove.
4. The multimedia assistant system for medical training of claim 1, wherein the first training database comprises an image database, and the operation unit comprises an image recognition unit for comparing the image database with the real-time image.
5. A medically trained multimedia assistance system according to claim 4, wherein said image database comprises live surgical images from a remote physician.
6. The multimedia auxiliary system for medical training according to claim 1, comprising a training target setting unit, wherein said medical training database generates a second training database when said feedback information satisfies said training target setting unit.
7. The multimedia auxiliary system for medical training according to claim 1, further comprising a medical instrument information retrieving unit for retrieving angle or route information of said user operating instrument.
8. The multimedia auxiliary system for medical training of claim 7, wherein the medical instrument information acquisition unit comprises a probe.
9. The multimedia auxiliary system for medical training of claim 1, further comprising a real-time communication unit for providing real-time communication with a remote physician during training.
10. The multimedia auxiliary system for medical training as claimed in claim 1, wherein said medical training database contains medical images of ultrasound and endoscope and is linked to a server.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910864649.0A CN112489541A (en) | 2019-09-12 | 2019-09-12 | Multimedia auxiliary system for medical training |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910864649.0A CN112489541A (en) | 2019-09-12 | 2019-09-12 | Multimedia auxiliary system for medical training |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112489541A true CN112489541A (en) | 2021-03-12 |
Family
ID=74920785
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910864649.0A Pending CN112489541A (en) | 2019-09-12 | 2019-09-12 | Multimedia auxiliary system for medical training |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112489541A (en) |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20080020361A1 (en) * | 2006-07-12 | 2008-01-24 | Kron Frederick W | Computerized medical training system |
| US20080220941A1 (en) * | 2007-03-08 | 2008-09-11 | Rocky Shaw | Virtual trainer system and method |
| US20120189996A1 (en) * | 2009-03-20 | 2012-07-26 | Hager Gregory D | Method and system for quantifying technical skill |
| CN104778894A (en) * | 2015-04-28 | 2015-07-15 | 关宏刚 | Virtual simulation bone-setting manipulation training system and establishment method thereof |
| CN106297472A (en) * | 2016-10-25 | 2017-01-04 | 深圳市科创数字显示技术有限公司 | The cornea intelligent operation training system that AR with VR combines |
| CN106856067A (en) * | 2017-01-18 | 2017-06-16 | 北京大学人民医院 | A kind of intelligent electronic simulates fabric bronchoscope training device |
| CN108154778A (en) * | 2017-12-28 | 2018-06-12 | 深圳科创广泰技术有限公司 | Based on motion-captured and mixed reality ophthalmologic operation training system and method |
| CN108281055A (en) * | 2018-01-19 | 2018-07-13 | 武汉康慧然信息技术咨询有限公司 | Staged surgical training device and its application method |
| CN109658771A (en) * | 2019-01-30 | 2019-04-19 | 上海市精神卫生中心（上海市心理咨询培训中心） | Neurodevelopmental disorder traffic safety training system and method based on VR technology |
-
2019
- 2019-09-12 CN CN201910864649.0A patent/CN112489541A/en active Pending
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20080020361A1 (en) * | 2006-07-12 | 2008-01-24 | Kron Frederick W | Computerized medical training system |
| US20080220941A1 (en) * | 2007-03-08 | 2008-09-11 | Rocky Shaw | Virtual trainer system and method |
| US20120189996A1 (en) * | 2009-03-20 | 2012-07-26 | Hager Gregory D | Method and system for quantifying technical skill |
| CN104778894A (en) * | 2015-04-28 | 2015-07-15 | 关宏刚 | Virtual simulation bone-setting manipulation training system and establishment method thereof |
| CN106297472A (en) * | 2016-10-25 | 2017-01-04 | 深圳市科创数字显示技术有限公司 | The cornea intelligent operation training system that AR with VR combines |
| CN106856067A (en) * | 2017-01-18 | 2017-06-16 | 北京大学人民医院 | A kind of intelligent electronic simulates fabric bronchoscope training device |
| CN108154778A (en) * | 2017-12-28 | 2018-06-12 | 深圳科创广泰技术有限公司 | Based on motion-captured and mixed reality ophthalmologic operation training system and method |
| CN108281055A (en) * | 2018-01-19 | 2018-07-13 | 武汉康慧然信息技术咨询有限公司 | Staged surgical training device and its application method |
| CN109658771A (en) * | 2019-01-30 | 2019-04-19 | 上海市精神卫生中心（上海市心理咨询培训中心） | Neurodevelopmental disorder traffic safety training system and method based on VR technology |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20200279498A1 (en) | Augmented and virtual reality simulator for professional and educational training | |
| Limbu et al. | Using sensors and augmented reality to train apprentices using recorded expert performance: A systematic literature review | |
| Avola et al. | An interactive and low-cost full body rehabilitation framework based on 3D immersive serious games | |
| US9142145B2 (en) | Medical training systems and methods | |
| US9808549B2 (en) | System for detecting sterile field events and related methods | |
| Melero et al. | Upbeat: augmented reality-guided dancing for prosthetic rehabilitation of upper limb amputees | |
| JP7367690B2 (en) | information processing equipment | |
| US20240153407A1 (en) | Simulated reality technologies for enhanced medical protocol training | |
| Castillo-Segura et al. | A cost-effective IoT learning environment for the training and assessment of surgical technical skills with visual learning analytics | |
| TW201443818A (en) | Object-oriented rehabilitation assisting system and operation setting method thereof | |
| WO2021148880A1 (en) | Systems for dynamic assessment of upper extremity impairments in virtual/augmented reality | |
| Komizunai et al. | An immersive nursing education system that provides experience of exemplary procedures from first person viewpoint with haptic feedback on wrist | |
| EP4243001A1 (en) | Simulator system for the safe training of medical personnel | |
| TWM569887U (en) | Augmented reality system | |
| CN112489541A (en) | Multimedia auxiliary system for medical training | |
| US20230169880A1 (en) | System and method for evaluating simulation-based medical training | |
| TW202111724A (en) | A multimedia assisted system for medical training | |
| Jantscher | Using real-time smoothness metrics to deliver haptic performance cues for a dexterous task | |
| Crossan | The design and evaluation of a haptic veterinary palpation training simulator | |
| CN115328317A (en) | Quality control feedback system and method based on virtual reality | |
| Byrns | Hand and Eye Gaze Analysis for the Objective Assessment of Open Surgical Dexterity | |
| WO2024006348A1 (en) | Systems and methods for clinical procedure training using mixed environment technology | |
| Sherstyuk et al. | Creating mixed reality manikins for medical education | |
| Feng | A situational awareness enhancing system for minimally invasive surgery training | |
| Patel | Novel Cost and Space Efficient Range of Motion and Gait Analysis Systems |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20210312 |