CN206301538U - The medical science training system that AR and VR are combined - Google Patents

Abstract

The utility model provides the medical science training system that a kind of AR and VR is combined, its 3-D view for passing through the operating theater instruments that 3D rendering acquisition module collection surgical target object and start-up use, by the surgical action of motion capture module real-time capture start-up, correction information and tutorial message are exported by central processing unit, set up the 3-D view comprising the collection of 3D rendering acquisition module, tutorial message, and correct the augmented reality or virtual reality model of information, start-up obtains the situation of surgical target object and its operating theater instruments for using by AR interactive modules in real time, tutorial message and correction information, the sense of reality and telepresenc of medical training can be lifted, shorten the medical training cycle, reduce medical training cost.

Description

The medical science training system that AR and VR are combined

Technical field

The utility model is related to medical training technical field, more particularly to the medical science training system that a kind of AR and VR are combined System.

Background technology

With increasing for medical college and medico, hospital can be supplied to the practice opportunity and resource of medico increasingly to subtract Few, natively very nervous clinical practice teaching resource becomes shorter, directly results in practising and views and emulates quality Decline, the chance of student's practical operation operation is even more very little, it is difficult to turn out high-caliber doctor.

At the same time, because many reasons cause current doctor-patient relationship very nervous, medical tangle is continuous, national healthcare Dispute and medical mishandling requlations are also launched respectively, and the cultural method that past medico is practised with patient is also It is eliminated, as a result, the theory study of medico cannot digest with learning by doing, it is difficult to lift the clinical comprehensive of medico Conjunction ability, it is difficult to turn out high-caliber doctor, and then cause doctor-patient relationship further more nervous, formation one is pernicious to follow Ring.

At present, many mechanisms have also been simulated the technology of operation by various means in research, for medico increases Plus chance of more practising, current sham operated is mostly to carry out virtual operation by artificial prosthesis, its sense of reality with when participating in the cintest Sense is very poor, and practicality is not high, simultaneously because student's viewing angle has differences with the personnel viewing angle of guidance during training, and refers to The quantity limitation of personnel is led, student also is difficult to obtain surgical guidance in the very first time, so as to cause student to form the operation of mistake Custom, it is difficult to correct.

Virtual reality (Virtual Reality, VR) and augmented reality (Augmented Reality, AR) are to go out in recent years Existing new scientific research focus, by VR and AR technologies, people can watch the virtual screen of 3 D stereo, and can be by three Three-dimensional virtual screen is tieed up to be overlapped with the scene in real world, so that viewer experience is to sensation on the spot in person, very True feeling is extremely strong with telepresenc.

Utility model content

The purpose of this utility model is to provide the medical science training system that a kind of AR and VR is combined so that start-up's energy It is enough to watch the 3-D view of surgical target object and the prompt message of current procedure process simultaneously.

To achieve the above object, the utility model provides the medical science training system that a kind of AR and VR are combined, including：Mould Intend operating table, the 3D rendering that operation destination object, the correspondence surgical target object are set on the sham operated platform is adopted The central processing unit and the central processing unit communication connecting moves of collection module and 3D rendering acquisition module communication connection Capture module and the AR interactive modules of central processing unit communication connection.

The 3D rendering acquisition module is 3D photographic microscopes or 3D video cameras.

The motion capture module is TOF sensor.

The AR interactive modules are AR glasses.

The AR glasses are the AR glasses using LCOS chip or Si-OLED chips or Micro-LED chips.

The surgical target object is the sample of the corresponding animal body parts of the operation.

Also include the manikin on the sham operated platform, the sample pair of the corresponding animal body parts of the operation Should be arranged in the manikin.

Also include display module.

The tutorial message and correction information are text information, image information or text information and image information Combination.

Sound broadcasting device is additionally provided with the AR interactive modules.

The beneficial effects of the utility model：The utility model provides the medical science training system that a kind of AR and VR are combined, Its 3-D view for passing through the operating theater instruments that 3D rendering acquisition module collection surgical target object and start-up use, passes through The surgical action of motion capture module real-time capture start-up, correction information and tutorial message are given by central processing unit, Set up the 3-D view comprising the collection of 3D rendering acquisition module, tutorial message and correct the augmented reality of information or virtual existing Real mould, start-up is obtained the situation of surgical target object and its operating theater instruments for using by AR interactive modules, referred in real time Information and correction information are led, the sense of reality and telepresenc of medical training can be lifted, shorten the medical training cycle, reduce medical treatment Training cost.

Brief description of the drawings

In order to be able to be further understood that feature of the present utility model and technology contents, refer to new below in connection with this practicality The detailed description of type and accompanying drawing, however accompanying drawing only provide with reference to and explanation use, not for being any limitation as to the utility model.

In accompanying drawing,

Fig. 1 is the medical science training system structure chart that AR of the present utility model and VR are combined.

Specific embodiment

Further to illustrate technological means and its effect that the utility model is taken, below in conjunction with of the present utility model Preferred embodiment and its accompanying drawing are described in detail.

Fig. 1 is referred to, the utility model provides the medical science training system that a kind of AR and VR is combined, including：Sham operated Platform 1, performed the operation on the sham operated platform 1 destination object 2, the 3D rendering collection of the corresponding setting of surgical target object 2 The central processing unit 4 and the communication connection of the central processing unit 4 of module 3 and the 3D rendering acquisition module 3 communication connection are dynamic Make the AR interactive modules 6 of capture module 5 and central processing unit communication connection.

Specifically, the need for the sham operated platform 1 is according to specific medical training content, true operating table can be copied Set, to lift the sense of reality of medical training, or the simplified version of true operating table, only retain the core of true operating table Part, with the carrying for controlling cost He be easy to sham operated platform 1.

Specifically, the surgical target object 2 can be using the mark of the corresponding animal body parts of operation for needing training This, such as during cornea surgery training, the surgical target object 2 can select pig Eyeball exemplar, while in order to further provide for The sense of reality of operation, can also now set manikin, and surgical target object 2 is placed on the sham operated platform 1 When the manikin, such as cornea surgery training, pig eyeball is positioned over the eye of human head model, it is certainly described Surgical target object 2 can also be people organ model, these can according to medical training the need for be adjusted, can't Influence realization of the present utility model.

Specifically, surgical target object 2 and start-up in the Real-time Collection surgical procedure of the 3D rendering acquisition module 3 The 3-D view of the operating theater instruments for using, and transmit to central processing unit 4, further, according to the 3D the need for medical training Image capture module 3 can select 3D photographic microscopes or 3D video cameras, wherein it is desired to carried out under microscope magnification field Surgical selection 3D photographic microscopes to obtain the three-dimensional enlarged drawing of surgical target object, without what is carried out under the microscope Operation is then from 3D video cameras obtaining the normal picture of surgical target object.

Specifically, in the Real-time Collection surgical procedure of the motion capture module 5 start-up surgical action, and transmit to Central processing unit 4, it is preferable that the motion capture module 5 be flight time (Time of Flight, TOF) sensor, its The surgical action of the angle acquisition start-up different from the 3D rendering acquisition module 3, such as 3D rendering acquisition module 3 are from hand The surface of art destination object 2, gathers 3-D view, and the motion capture module 5 gathers hand from the side of surgical target object 2 Art is acted, by the application of motion capture module 5 so that image is realized including vertical angle and level angle with data acquisition Obtained in interior multi-angle, such that it is able to each details in more truly performance operation, show start-up and medical science The visual angle that expert is difficult to see that in normal surgical training, reduces the understanding difficulty of surgical action, accelerates training speed, lifting training Instruction quality.

Specifically, the finger being pre-stored in central processing unit 4 that the central processing unit 4 is accordingly exported according to the process of operation Information is led, and surgical action and default the standard procedures action that motion capture module 5 gathers the start-up for coming are carried out into reality When compare, provide correction information, and the 3D rendering acquisition module 3 is gathered 3-D view, tutorial message and correct letter Breath is modeled together, and the 3-D view comprising the collection of 3D rendering acquisition module 3, tutorial message are generated in real time and letter is corrected The augmented reality or virtual reality model of breath.Further, it is the procedure of the standard that is stored with the central processing unit 4, each The special status that is likely to occur in the standard procedures action of individual process and each process, the procedure of the standard and The standard procedures action reference of each process substantial amounts of expert operation process formulated, it is ensured that procedure it is accurate Property, instruct start-up accurately to process the special status being likely to occur in each procedure and each procedure.Preferably, The tutorial message and correct information can for text information, can also image information, even text information and image letter The combination of breath, start-up obtains procedure and operation method according to tutorial message, and mistake is corrected according to the information of correction Surgical action.

Specifically, the AR interactive modules 6 obtain the augmented reality or virtual reality mould of the generation of central processing unit 4 in real time Type, and tutorial message and correction information are illustrated in the visual field of start-up according to the augmented reality or virtual reality model In, start-up is by the watching operation destination object 2 of AR interactive modules 6 and its operating theater instruments or watching operation target pair for using As 2 and the 3-D view of its operating theater instruments for using, and obtain tutorial message and correction information.Preferably, the AR interactions Module 6 is AR glasses, organic in particular by liquid crystal on silicon (Liquid Crystal on Silicon, LCOS) chip, silicon substrate Light emitting diode (Si-OLED) chip or micro- light emitting diode (Micro-LED) chip can show ultrahigh resolution image AR glasses.

Further, the implementation of the AR interactive modules 6 can be according to selecting video perspective type the need for medical training (camera see through) or optical perspective formula (optical see through), wherein, video perspective type is to scheme 3D 3-D view, tutorial message as the collection of acquisition module 3 and information superposition is corrected in an image, and by corresponding aobvious Show that equipment is shown, what start-up watched is shown in surgical target object 2 and its surgical device for using in display device The 3-D view of tool and the tutorial message being superimposed upon on the 3-D view and correction information, and optical perspective formula is to instruct In the light path of AR interactive modules 6, start-up directly sees through the light path of AR interactive modules 6 for information and correction information projection See the real scene of surgical target object 2 and its operating theater instruments for using and project tutorial message in the optical path and correction Information, either the position of tutorial message and the displaying of correction information is required to protect in video perspective type or optical perspective formula Card start-up can normal observation surgical target object 2 and its operating theater instruments for using, to ensure that surgery training is normally carried out.

It is noted that compared to tradition training when start-up's direct viewing or by simple microscope etc. aid in set Standby watching operation destination object, the utility model can be on the premise of the sense of reality be ensured, also as the process performed the operation to training Personnel provide tutorial message and correct information, and start-up can be in no Other-directed Person according to tutorial message and correction information Surgery training is independently carried out in the case of member, and ensure the accuracy of surgical action and flow, compared to using including containing each The medical operating training system of force feedback mechanism is planted, the utility model need not increase using cumbersome on surgical target object Force feedback mechanism, and surgical target object can select real animal bodies sample 2, the sense of reality of operation is stronger, trainer Member obtains the feel of operation more preferably in surgical procedure, and system cost is also substantially reduced while training value is higher.

Further, the medical science training system that AR of the present utility model and VR are combined can also include one it is independent aobvious Show module, the display module simultaneous display start-up passes through the 3-D view of the picture that AR interactive modules 6 are watched, so that Make other staff on the scene and start-up synchronously receive the image that start-up sees, the display module can also show student Information, training progress, training duration, training process be live and video recording etc., and accordingly, on-site training instructs the personnel can be to entering The start-up of row operation is instructed, and other start-ups can be with observation of an operation process, comprehension operation essential, it is preferable that institute Display screen is stated for 3D touching display screens.Further, it is also possible in the medical science training system that AR of the present utility model and VR are combined Sound broadcasting device is set up, tutorial message is carried out to start-up by sound broadcasting device and the voice message of information is corrected, Preferably, the sound broadcasting device is in the AR interactive modules 6.

Additionally, the medical science training system that AR of the present utility model and VR are combined, can also set History Parser Module, lead to The process that overwriting analysis module record start-up trains each time, and big data analysis is carried out to record, obtain training difficult The data such as point and result of training, to Optimization Training scheme, accelerate training process, lift training efficiency.

It should be noted that the medical science training system that AR of the present utility model and VR are combined, mould is gathered using 3D rendering The three-dimensional picture of surgical target object 2 and operating theater instruments in the collection real world of block 3, and by being modeled in start-up's Show tutorial message in the visual field and correct information, start-up not only sees surgical scene in operation, additionally it is possible to see superposition Tutorial message and correction information in surgical scene, so that start-up obtains information more more than direct viewing, it is right Surgery training carries out real-time instruction or correction, and equipment is simple, low cost, training it is better, in hgher efficiency, by AR and VR Be combined, realize that operation technique flow and actual conditions dispose it is real merge, realize it is completely visual, can simulate, repeat Teaching and the technical scheme of training.

In sum, the utility model provides the medical science training system that a kind of AR and VR are combined, and it passes through 3D rendering Acquisition module gathers the 3-D view of the operating theater instruments that surgical target object and start-up use, by motion capture module The surgical action of real-time capture start-up, correction information and tutorial message are given by central processing unit, are set up comprising 3D figures The augmented reality or virtual reality model of 3-D view, tutorial message and correction information as acquisition module collection, trainer Member obtains surgical target object and situation, tutorial message and the correction of its operating theater instruments for using in real time by AR interactive modules Information, can lift the sense of reality and telepresenc of medical training, shorten the medical training cycle, reduce medical training cost.

The above, for the person of ordinary skill of the art, can according to the technical solution of the utility model and Technology design makes other various corresponding changes and deformation, and all these changes and deformation should all belong to the utility model power The protection domain that profit is required.

Claims (10)

1. the medical science training system that a kind of AR and VR are combined, it is characterised in that including：Sham operated platform (1), located at the mould The 3D rendering acquisition module (3) of destination object (2), the correspondence of being performed the operation in plan operating table (1) surgical target object (2) setting, The central processing unit (4) and the central processing unit (4) communication connection being connected with the 3D rendering acquisition module (3) communication are dynamic Make the AR interactive modules (6) of capture module (5) and the central processing unit (4) communication connection.

2. the medical science training system that AR as claimed in claim 1 and VR are combined, it is characterised in that the 3D rendering gathers mould Block (3) is 3D photographic microscopes or 3D video cameras.

3. the medical science training system that AR as claimed in claim 1 and VR are combined, it is characterised in that the motion capture module (5) it is TOF sensor.

4. the medical science training system that AR as claimed in claim 1 and VR are combined, it is characterised in that the AR interactive modules (6) it is AR glasses.

5. the medical science training system that AR as claimed in claim 4 and VR are combined, it is characterised in that the AR glasses are use The AR glasses of LCOS chip or Si-OLED chips or Micro-LED chips.

6. the medical science training system that AR as claimed in claim 1 and VR are combined, it is characterised in that the surgical target object (2) be the corresponding animal body parts of the operation sample.

7. the medical science training system that AR as claimed in claim 6 and VR are combined, it is characterised in that also including located at the mould Intend the manikin on operating table (1), the sample of the corresponding animal body parts of the operation is correspondingly arranged in the manikin It is interior.

8. the medical science training system that AR as claimed in claim 1 and VR are combined, it is characterised in that also including display module.

9. the medical science training system that AR as claimed in claim 1 and VR are combined, it is characterised in that the tutorial message and Correction information is the combination of text information, image information or text information and image information.

10. the medical science training system that AR as claimed in claim 1 and VR are combined, it is characterised in that the AR interactive modules (6) sound broadcasting device is additionally provided with.