CN206301504U - The cornea intelligent operation training system that AR is combined with VR - Google Patents

Abstract

The utility model provides the cornea intelligent operation training system that a kind of AR is combined with VR,The front 3-D view of the operating theater instruments that the system is used by animal eyeball sample and start-up in 3D photographic microscope Real-time Collection surgical procedures,By TOF sensor to animal eyeball sample,The operating theater instruments that start-up uses,And the hand motion of start-up carries out real-time side 3D scannings,Contrasted and exported tutorial message and correction information by central processing unit and preset data,Set up the front 3-D view comprising the collection of 3D photographic microscopes,The augmented reality or virtual reality model of tutorial message and correction information,Start-up obtains the situation of surgical target object and its operating theater instruments for using by AR glasses in real time,Tutorial message and correction information,Lift the sense of reality and telepresenc of cornea surgery training,Improve the real-time instruction effect in surgery training,Shorten the cornea surgery training cycle,Reduce cornea surgery training cost,Lifting training quality.

Description

The cornea intelligent operation training system that AR is combined with VR

Technical field

The utility model is related to medical training technical field, more particularly to the cornea intelligence hand that a kind of AR is combined with VR Art training system.

Background technology

According to the investigation of the World Health Organization, corneal blindness is the second substantially blindness causing disease for being only second to cataract.It is Chinese current Corneal blindness patient is about 5,000,000 people, and increases 100,000 multiple-cases newly every year, and in the middle of these patients, vast majority of people can lead to Corneal transplantation is crossed to see light again.But because many factors, the cornea source of various regions eye bank of China are in great shortage, many patients can only Passively wait and contributing.Statistics shows that China waits patient at least 500,000 people of corneal transplantation every year, but has an opportunity to connect By corneal graft and the patient that recovers lost eyesight less than 5000 people.

As science and technology is continued to develop, the appearance of artificial cornea solves the deficiency of corneal donor, is China 5,000,000 or even complete The corneal blindness patient of ball 60,000,000 brings the hope recovered lost eyesight, but the wretched insufficiency of corneal transplantation doctor is still to lie across in cornea Blind patient moves towards the light the huge obstacle on road.The whole nation has oculist 28000 or so at present, but can carry out interior eye hand Art less than 4000 people, the doctor for being capable of complete independently corneal graft still lacks less than hundred people, oculist's resource.Make Obtain artificial cornea popularization and application to be extremely restricted, how more, quickly culture grasp lamellar keratoplasty technology doctor As a difficult problem urgently to be solved.

Current traditional lamellar keratoplasty operative doctor Training Methodology is mainly concentration instruction, demonstration teaching, substitute (eyeball as selected pig) rehearsal and on-the-spot guidance formula practical operation, student's viewing angle exists with doctor's work angle during due to training Difference, demonstration teaching number are limited, substitute drills the reasons, even senior eye such as telepresenc is not enough, practical operation risk in scene is big Section doctor grasps this operation and is required for the long period, and the cultivation cycle of young doctor is just more very long.

The problem of virtual operation on eyeball training is equipment and program complex and expensive, and with the simulating degree of true operation still Relatively large distance, the sense of reality is not strong.

Virtual reality (Virtual Reality, VR) technology is a kind of computer that can be created with the experiencing virtual world Emulation technology, it creates a Virtual Space using computer, and user can completely be immersed to the Virtual Space by VR glasses In, using Binocular Vision Principle, Virtual Space is 3D three-dimensional in glasses, so as to reach effect on the spot in person.

Technology is will be virtual for the augmented reality (Augmented Reality, AR) developed by virtual reality technology Information superposition is perceived in real world by human sensory, so as to reach the sensory experience of exceeding reality, different from virtual existing Real technology, the virtual information generated by computer can not only be seen using augmented reality user, additionally it is possible to see existing The real information in the world, telepresenc and the sense of reality are all stronger.

Utility model content

The purpose of this utility model is the cornea intelligent operation training system that a kind of AR is combined with VR, can be true Cornea procedure is reproduced, and real-time instruction is carried out to start-up, lifted the sense of reality of cornea surgery training and come personally Sense, shortens the cornea surgery training cycle, reduces cornea surgery training cost.

To achieve the above object, the utility model provides the cornea intelligent operation training system that a kind of AR is combined with VR System, including：Emulation operating table, the animal eyeball sample being provided with the emulation operating table, the correspondence animal eyeball sample set The central processing unit and the central processing unit that the 3D photographic microscopes put and the 3D photographic microscopes are electrically connected with are electrical The TOF sensor of connection and the AR glasses being electrically connected with the central processing unit.

Also include：The display screen being electrically connected with the central processing unit.

Human head model is additionally provided with the emulation operating table, the animal eyeball sample is located at the human body head mould The eye of type.

The 3D scan images that the front 3-D view and the TOF sensor that the 3D photographic microscopes shoot are obtained are also High in the clouds is uploaded to by internet.

The emulation operating table is additionally provided with the foot-operated of the control 3D photographic microscopes.

Memory cell is provided with the central processing unit, the memory cell preserves the canthus of the standard for having modeled in advance Film procedure, the tutorial message of each process, the standard procedures action of each process, various ophthalmology focuses and various hands Art accident.

Sound broadcasting device is additionally provided with the AR glasses, tutorial message is carried out to start-up by language broadcast device With the verbal cue of the information of correction.

The AR glasses are the AR glasses using LCOS chip or Si-OLED chips or Micro-LED chips.

The animal eyeball sample is pig eyeball.

The tutorial message and the group that correction information is text information, image information or text information and image information Close.

The beneficial effects of the utility model：The utility model provides the cornea intelligent operation that a kind of AR is combined with VR Training system, the system is used by animal eyeball sample in 3D photographic microscope Real-time Collection surgical procedures and start-up Operating theater instruments front 3-D view, the operating theater instruments used animal eyeball sample, start-up by TOF sensor, And the hand motion of start-up carries out real-time side 3D scannings, provides correction information by central processing unit and instructs to believe Breath, sets up the front 3-D view comprising the collection of 3D photographic microscopes, tutorial message and corrects the augmented reality or void of information Intend real model, start-up is obtained the situation of surgical target object and its operating theater instruments for using by AR glasses, referred in real time Information and correction information are led, by the combination of AR and VR, virtual image, lifting cornea operation training is superimposed on true picture The sense of reality and telepresenc of instruction, improve the real-time instruction effect in surgery training, shorten the cornea surgery training cycle, reduce eye Operation on cornea training cost, lifts training quality.

Brief description of the drawings

In order to be able to be further understood that feature of the present utility model and technology contents, refer to new below in connection with this practicality The detailed description of type and accompanying drawing, however accompanying drawing only provide with reference to and explanation use, not for being any limitation as to the utility model.

In accompanying drawing,

Fig. 1 is the cornea intelligent operation training system structured flowchart that AR of the present utility model is combined with VR；

Fig. 2 is the stereogram of the cornea intelligent operation training system that AR of the present utility model is combined with VR.

Specific embodiment

Further to illustrate technological means and its effect that the utility model is taken, below in conjunction with of the present utility model Preferred embodiment and its accompanying drawing are described in detail.

Fig. 1 and Fig. 2 is referred to, the utility model provides the cornea intelligent operation training system that a kind of AR is combined with VR System, including：Emulation operating table 1, the animal eyeball sample 2 being provided with the emulation operating table 1, the correspondence animal eyeball sample Central processing unit 4 and the center treatment that the 2 3D photographic microscopes 3 for setting and the 3D photographic microscopes 3 are electrically connected with TOF sensor 5 and the AR glasses 6 with the electric connection of central processing unit 4 that device 4 is electrically connected with.

Specifically, the emulation operating table 1 copies the operating table of real cornea operation to make, so that trainer Member obtains experiencing when participating in the cintest for true operation, especially, in order to further lift the sense of reality of operation, on the emulation operating table 1 Be provided with human head model 21, during operation, animal eyeball sample 2 is put in the eye of the human head model 21, at the same with it is true Cornea operation operating table it is identical, the emulation operating table 1 also is provided with foot-operated 11, by foot-operated 11 can adjust 3D image it is aobvious The parameter such as the focal length of the shooting of micro mirror 3 and position.

Specifically, the 3D photographic microscopes 3 shoot the operating theater instruments that animal eyeball sample 2 and start-up use Front 3-D view, and transmit to central processing unit 4, it is preferable that as shown in Fig. 2 the 3D photographic microscopes 3 correspondence is positioned at described The surface of animal eyeball sample 2, so as to gather the front 3-D view consistent with start-up visual angle, it is true that lifting is performed the operation Sense.

Specifically, flight time (TIME OF FLIGHT, the TOF) sensor 5 is to animal eyeball sample 2, trainer The operating theater instruments and the hand motion of start-up that member uses carry out side 3D scannings, and 3D scan images are transmitted into Central processor 4, is provided with memory cell in the central processing unit 4, the memory cell preserves the advance standard for having modeled Cornea procedure, the tutorial message of each process, the standard procedures action of each process, various ophthalmology focuses, Yi Jiduo Operation accident is planted, is compared in real time by the 3D scan images and the surgical action of standard that provide TOF sensor 5, Wrong surgical action of the real time correction to start-up in surgical procedure.Wherein, the cornea procedure of the standard, each The tutorial message of individual process, the standard procedures of each process are acted, various ophthalmology focuses and various operation accidents are referred to Substantial amounts of expert operation case formulated, it is ensured that the accuracy of procedure, and training diversity and practicality, lead to The cornea procedure crossed in standard adds the situation of accident treatment, and start-up is obtained in that the various operations for the treatment of are prominent The experience of hair event, so as to reach more preferable result of training.By the application of TOF sensor 5 so that image and data acquisition reality Show and obtained including the multi-angle including vertical angle and level angle, such that it is able to each in more truly performance operation Details, shows the visual angle that start-up and medical expert are difficult to see that in normal surgical training, reduces the reason of surgical action Solution difficulty, accelerates training speed, lifts training quality.

The central processing unit 4 is pre-stored in the corresponding tutorial message in central processing unit 4 according to the process output of operation, Simultaneously by TOF sensor 5 gather come 3D scan images and default standard procedures action compared in real time, be given correction letter Cease, and front 3-D view, tutorial message and correction information that 3D photographic microscopes 3 are gathered are modeled together, in real time Front 3-D view of the generation comprising the collection of 3D photographic microscopes 3, the augmented reality of tutorial message and correction information or virtual Real model.

The AR glasses 6 obtain the augmented reality or virtual reality model of the generation of central processing unit 4 in real time, and according to the increasing Be illustrated in the visual field of start-up for tutorial message and correction information by strong reality or virtual reality model, and start-up passes through The viewing animal eyeball of AR glasses 6 sample 2 and its operating theater instruments for using or viewing animal eyeball sample 2 and its surgical device for using The front 3-D view of tool, and tutorial message and correction information are obtained, start-up carries out procedure according to tutorial message The training for the treatment of, according to the surgical action for correcting information training status.

Preferably, the A glasses 6 be using liquid crystal on silicon (Liquid Crystal on Silicon, LCOS) chip, Silicon-based organic light-emitting diode (Si-OLED) chip or micro- light emitting diode (Micro-LED) chip can show ultra high-definition The AR glasses of clear degree image.

Further, the implementation of AR (augmented reality) glasses 6 can be according to selecting video the need for medical training Perspective formula (camera see through) or optical perspective formula (optical see through), wherein, video perspective type is Front 3-D view that 3D photographic microscopes 3 are gathered, tutorial message and information superposition is corrected in an image, and pass through Corresponding display device shown, start-up's viewing be shown in display device animal eyeball sample 2 and it is used Operating theater instruments front 3-D view and the tutorial message that is superimposed upon on the 3-D view and correction information, and optical lens It is that start-up is straight through the light path of AR glasses 6 by tutorial message and correction information projection in the light path of AR glasses 6 depending on formula Connect the real scene and projection of watching operation destination object 2 and its operating theater instruments for using tutorial message in the optical path and Correction information, either the position of tutorial message and the displaying of correction information is both needed in video perspective type or optical perspective formula Ensure start-up can normal observation surgical target object 2 and its operating theater instruments for using, to ensure that surgery training is normal Carry out.Wherein, the tutorial message and correction information can be text information, can also be image information or be word The combination of information and image information.

It is understood that because cornea operation is the operation that needs to complete under the microscope, therefore either pass through The front 3-D view of the collection of 3D photographic microscopes 3 of the viewing of AR glasses 6 of video perspective type (camera see through), Or (the animal eyeball sample 2 that glasses 6 are watched is used the AR of optical perspective formula (optical see through) with it The real scene of operating theater instruments is all that by amplifying, namely it is enlarged drawing that start-up watched by AR glasses 6, so that Reach the same viewing effect of the true operation carried out in the case where mirror is shown, it is ensured that surgery training is normally carried out.

Specifically, the AR also includes with the cornea intelligent operation training system that VR is combined：With the electricity of central processing unit 4 Property connection display screen 7, the display screen 7 can watch the graphics of picture with simultaneous display start-up from AR glasses 6 Picture so that other staff on the scene and start-up synchronously receive the image that start-up sees, the display screen 7 can also show Show that information of trainee, training progress, training duration, training process be live and the function such as video recording, accordingly, on-site training instructs the personnel can Instructed with to the start-up for being performed the operation, other start-ups can with observation of an operation process, comprehension operation essential, Preferably, the display screen 7 is 3D touching display screens.

Further, AR of the present utility model also has with the cornea intelligent operation training system that VR is combined and remotely refers to Function is led, the 3D obtained by the front 3-D view and the TOF sensor 5 that shoot the 3D photographic microscopes 3 is swept As being uploaded to high in the clouds 9 via internet, the training instruction personnel of the specialty such as ophthalmologist, oculist and ophthalmology professor can beyond the clouds 9 for tracing In real time obtain start-up procedure, long-range real-time instruction is carried out to it so that training process it is more various with it is clever It is living, lift the efficiency of surgery training.

Further, it is also possible in AR of the present utility model with setting up language in the cornea intelligent operation training system that VR is combined Sound broadcast device, carries out tutorial message to start-up and corrects the voice message of information by sound broadcasting device, it is preferable that The sound broadcasting device is in the AR glasses 6.

Preferably, the animal eyeball sample 2 is pig eyeball, while surgery training authenticity is taken into account, reduces operation The cost of training, because the utility model uses real animal eyeball sample 2, compared to using including containing various force feedbacks The ARTIFICIAL EYELID wherein such as mechanism and artificial scalpel and the cornea surgery training system that carries out compare, not only drop significantly Low system cost, and closer to the feel of actual operation so that the value of training is higher, is trained during compared to tradition training Personnel's direct viewing is performed the operation by the auxiliary equipment direct viewing eyeball such as simple microscope, and the utility model can protected On the premise of the card sense of reality, provide tutorial message to start-up also as the process of operation and correct information, lifting training Efficiency and quality.

Specifically, the utility model can also set History Parser Module, and start-up is recorded by History Parser Module The process trained each time, and big data analysis is carried out to record, the data such as training difficult point and result of training are obtained, it is used to optimize Training scheme, accelerates training process, lifts training efficiency.

It is noted that the utility model is not only suitable for lamellar cornea operation, penetrating type operation on cornea is also applied for, it is excellent Selection of land, the training of the emergency situations being mainly used in cornea procedure of the present utility model.

Further, the cornea intelligent operation training system that AR of the present utility model is combined with VR, is imaged using 3D The three-dimensional picture of animal eyeball sample 2 and operating theater instruments in the collection real world of microscope 3, and by being modeled in trainer Show tutorial message in the visual field of member and correct information, start-up not only sees surgical scene in operation, additionally it is possible to see The tutorial message and correction information being superimposed upon in surgical scene, so that start-up obtains letters more more than direct viewing Breath, carries out real-time instruction or correction to surgery training, and equipment is simple, low cost, training it is better, in hgher efficiency, pass through AR is combined with VR, realize that operation technique flow and actual conditions dispose it is real merge, realize it is completely visual, can simulate, Repeatable teaching and the technical scheme of training, solve because the particularity of ophthalmologic operation is stranded to imaging importing after micro- collection Difficulty, realizes the augmented reality entity training for applying to ophthalmologic operation truly, and equipment is simple, low cost, training It is better, in hgher efficiency, be that artificial cornea popularization and application are swept so as to the batch for realizing cornea operative doctor is quickly trained Remove obstacles and hinder.

In sum, the utility model provides the cornea intelligent operation training system that a kind of AR is combined with VR, should The operating theater instruments that system is used by animal eyeball sample and start-up in 3D photographic microscope Real-time Collection surgical procedures Front 3-D view, the operating theater instruments used animal eyeball sample, start-up by TOF sensor and trainer The hand motion of member carries out real-time side 3D scannings, and correction information and tutorial message are given by central processing unit, and foundation is included The augmented reality or virtual reality model of the front 3-D view, tutorial message and correction information of the collection of 3D photographic microscopes, Start-up is obtained the situation of surgical target object and its operating theater instruments for using, tutorial message by AR glasses and entangled in real time Positive information, by the combination of AR and VR, is superimposed virtual image on true picture, lifted cornea surgery training the sense of reality and Telepresenc, improves the real-time instruction effect in surgery training, shortens the cornea surgery training cycle, reduces cornea surgery training Cost, lifts training quality.

The above, for the person of ordinary skill of the art, can according to the technical solution of the utility model and Technology design makes other various corresponding changes and deformation, and all these changes and deformation should all belong to the utility model power The protection domain that profit is required.

Claims (10)

1. the cornea intelligent operation training system that a kind of AR is combined with VR, it is characterised in that including：Emulation operating table (1), It is provided with animal eyeball sample (2), the 3D shootings of correspondence animal eyeball sample (2) setting on emulation operating table (1) Central processing unit (4) and the central processing unit (4) electricity that microscope (3) and the 3D photographic microscopes (3) are electrically connected with Property connection TOF sensor (5) and with central processing unit (4) be electrically connected with AR glasses (6).

2. the cornea intelligent operation training system that AR as claimed in claim 1 is combined with VR, it is characterised in that also wrap Include：The display screen (7) being electrically connected with central processing unit (4).

3. the cornea intelligent operation training system that AR as claimed in claim 1 is combined with VR, it is characterised in that described imitative Human head model (21) is additionally provided with true operating table (1), the animal eyeball sample (2) is located at the human head model (21) eye.

4. the cornea intelligent operation training system that AR as claimed in claim 1 is combined with VR, it is characterised in that the 3D The 3D scan images that the front 3-D view and the TOF sensor (5) that photographic microscope (3) shoots are obtained are also by interconnection Reach high in the clouds (9) on the net.

5. the cornea intelligent operation training system that AR as claimed in claim 1 is combined with VR, it is characterised in that described imitative True operating table (1) is additionally provided with foot-operated (11) of the control 3D photographic microscopes (3).

6. the cornea intelligent operation training system that AR as claimed in claim 1 is combined with VR, it is characterised in that in described Be provided with memory cell in central processor (4), the memory cell preserve the standard for having modeled in advance cornea procedure, The tutorial message of each process, the standard procedures action of each process, various ophthalmology focuses and various operation accidents.

7. the cornea intelligent operation training system that AR as claimed in claim 1 is combined with VR, it is characterised in that the AR Glasses are additionally provided with sound broadcasting device in (6).

8. the cornea intelligent operation training system that AR as claimed in claim 1 is combined with VR, it is characterised in that the AR Glasses (6) are the AR glasses using LCOS chip or Si-OLED chips or Micro-LED chips.

9. the cornea intelligent operation training system that AR as claimed in claim 1 is combined with VR, it is characterised in that described dynamic Thing Eyeball exemplar (2) is pig eyeball.

10. the cornea intelligent operation training system that AR as claimed in claim 1 is combined with VR, it is characterised in that described Tutorial message and the combination that correction information is text information, image information or text information and image information.