CN110292439A - Cardiac stent operation auxiliary diagnosis and therapy system and application method based on augmented reality - Google Patents

Cardiac stent operation auxiliary diagnosis and therapy system and application method based on augmented reality Download PDF

Info

Publication number
CN110292439A
CN110292439A CN201910704951.XA CN201910704951A CN110292439A CN 110292439 A CN110292439 A CN 110292439A CN 201910704951 A CN201910704951 A CN 201910704951A CN 110292439 A CN110292439 A CN 110292439A
Authority
CN
China
Prior art keywords
unit
augmented reality
heart
data
module
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201910704951.XA
Other languages
Chinese (zh)
Inventor
崔笑宇
王于
赵越
王柄政
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Northeastern University China
Original Assignee
Northeastern University China
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Northeastern University China filed Critical Northeastern University China
Priority to CN201910704951.XA priority Critical patent/CN110292439A/en
Priority to PCT/CN2019/099012 priority patent/WO2021017019A1/en
Publication of CN110292439A publication Critical patent/CN110292439A/en
Pending legal-status Critical Current

Links

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/10Computer-aided planning, simulation or modelling of surgical operations
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/20Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/02Detecting, measuring or recording pulse, heart rate, blood pressure or blood flow; Combined pulse/heart-rate/blood pressure determination; Evaluating a cardiovascular condition not otherwise provided for, e.g. using combinations of techniques provided for in this group with electrocardiography or electroauscultation; Heart catheters for measuring blood pressure
    • A61B5/0205Simultaneously evaluating both cardiovascular conditions and different types of body conditions, e.g. heart and respiratory condition
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/24Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
    • A61B5/316Modalities, i.e. specific diagnostic methods
    • A61B5/318Heart-related electrical modalities, e.g. electrocardiography [ECG]
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/74Details of notification to user or communication with user or patient ; user input means
    • A61B5/746Alarms related to a physiological condition, e.g. details of setting alarm thresholds or avoiding false alarms
    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16HHEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H20/00ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance
    • G16H20/60ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance relating to nutrition control, e.g. diets
    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16HHEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H50/00ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
    • G16H50/20ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for computer-aided diagnosis, e.g. based on medical expert systems
    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16HHEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H50/00ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
    • G16H50/70ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for mining of medical data, e.g. analysing previous cases of other patients
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/10Computer-aided planning, simulation or modelling of surgical operations
    • A61B2034/101Computer-aided simulation of surgical operations
    • A61B2034/102Modelling of surgical devices, implants or prosthesis
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/10Computer-aided planning, simulation or modelling of surgical operations
    • A61B2034/101Computer-aided simulation of surgical operations
    • A61B2034/105Modelling of the patient, e.g. for ligaments or bones

Landscapes

  • Health & Medical Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Medical Informatics (AREA)
  • Public Health (AREA)
  • General Health & Medical Sciences (AREA)
  • Biomedical Technology (AREA)
  • Surgery (AREA)
  • Animal Behavior & Ethology (AREA)
  • Pathology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Molecular Biology (AREA)
  • Veterinary Medicine (AREA)
  • Cardiology (AREA)
  • Primary Health Care (AREA)
  • Physiology (AREA)
  • Physics & Mathematics (AREA)
  • Biophysics (AREA)
  • Epidemiology (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Robotics (AREA)
  • Pulmonology (AREA)
  • Nutrition Science (AREA)
  • Measuring And Recording Apparatus For Diagnosis (AREA)
  • Medical Treatment And Welfare Office Work (AREA)

Abstract

The present invention proposes a kind of cardiac stent operation auxiliary diagnosis and therapy system and application method based on augmented reality, belong to intellectual medical assisting in diagnosis and treatment field, specifically include: big data service system, augmented reality glasses, holographic alternative projection device, data transmission and exchange system, detection bracelet;Big data service system carries out data communication with augmented reality glasses, holographic alternative projection device and detection bracelet respectively with exchange system by data transmission;Bracelet is detected, gives patient worn after surgery, the data of monitoring are passed through data transmission and exchange system real-time delivery to big data service system by monitoring heart of patient bounce situation.The present invention can be with real-time display cardiac three-dimensional image, preferable reaction heart truth, increases the visuality of operation, reduces surgical operation difficulty, to the quantity of bracket is put, there has also been relatively good judgements, while postoperative patient situation can track very well and provide reasonable life and direct.

Description

Cardiac stent operation auxiliary diagnosis and therapy system and application method based on augmented reality
Technical field
The invention belongs to intellectual medical assisting in diagnosis and treatment fields, more particularly to the cardiac stent auxiliary surgical based on augmented reality Help diagnosis and therapy system and application method.
Background technique
With the development of economic society high speed, the improvement of people's living standards, high protein diet takes in more and more, heart The quantity of patient is also quickling increase.There are open surgery and insertion type operation for cardiopathic operative treatment at present.
Open surgery wind wound is big, the high easy infection of risk, costly, postoperative complications are more, healing time is long.Insertion type Operation wound is small, safety coefficient is high, expense is low, post-surgical healing time is short, quality of life of patients is high.
Cardiac stent operation belongs to one kind of insertion type operation, is mainly used for treating narrow or obstruction tubular pole artery, It can also improve immediately blood flow after heart attack.Stent procedure is by extensively in clinical use at present.
The especially appearance of applying support reduces heart bypass surgery with angioplasty use.Make more Low-income household can obtain medical treatment.But stent procedure is can only to show X-Y scheme by contrast agent and C arm machine and display Picture cannot preferably reflect true heart situation, reduce the visuality of operation, increase the difficulty of the judgement of doctor.For The problem of putting several brackets, doctor often can only rule of thumb judge, increase operating difficulty.Postoperative patient situation simultaneously It can not track very well and reasonable life is provided and direct.
Summary of the invention
Based on the above technical deficiency, the present invention proposes a kind of cardiac stent operation auxiliary diagnosis and therapy system based on augmented reality A kind of and application method, wherein cardiac stent operation auxiliary diagnosis and therapy system based on augmented reality, comprising: big data service system System, augmented reality glasses, holographic alternative projection device, data transmission and exchange system, detection bracelet;
The big data service system is transmitted by data and interacts throwing with augmented reality glasses, holography respectively with exchange system Shadow device and detection bracelet carry out data communication;
The augmented reality glasses, the Virtual Cardiac Mode after three-dimensional reconstruction are merged with actual environment, auxiliary is led The insertion of pipe;
The holography alternative projection device, the three-dimensional heart model after three-dimensional reconstruction is projected in face of doctor, and identify hand The gesture of art process doctor, the three-dimensional heart model in real-time display surgical procedure, gesture interaction being capable of 360 deg rotations Holographic heart observes heart stopping state;
The big data service system, comprising: storage unit, central data processing unit, image processing unit, intelligence are examined Disconnected unit, three-dimensionalreconstruction unit and laser transmission unit;
The storage unit is connected with central data processing unit, central data processing unit and image processing unit phase Connection, image processing unit are connected with intelligent diagnostics unit, and intelligent diagnostics unit is connected with laser transmission unit, laser Defeated unit is transmitted with data to be connected with exchange system;
The storage unit, for saving cardiac imaging information, ECG information, previous medical history and the detection bracelet of patient The data passed over;
The central data processing unit is classified after handling data in storage unit, and sorted data are sent out Give image processing unit;
Sorted data are generated bidimensional image information, and bidimensional image information are transmitted by described image processing unit Give intelligent diagnostics unit;
The intelligent diagnostics unit according to bidimensional image information, Diagnosing Cardiac angiemphraxis situation, and congestion situations is passed Pass three-dimensionalreconstruction unit;
The three-dimensionalreconstruction unit, in conjunction with cardiovascular congestion situations, three-dimensionalreconstruction unit generates three-dimensional heart model, and Three-dimensional heart model is passed into laser transmission unit;
Three-dimensional heart model is transmitted to data transmission and exchange system by the laser transmission unit;
Three-dimensional heart model is uniformly sent to augmented reality glasses and holographic interaction by the data transmission and exchange system Projector.
The detection bracelet, gives patient worn after surgery, and monitoring heart of patient bounce situation encounters the different situation of heart and carries out It reminds, judges whether that starting first-aid unit dials rescue phone according to sign, positioning in real time and monitoring patient status;Recommend health Dietary guidelines remind sleep, movement.The data of monitoring are passed through into data transmission and exchange system real-time delivery to big data service System.
The augmented reality glasses, comprising: binocular vision module, five axis anti-shaking modules, image processing module, high definition are shown Module and wireless transport module;
The binocular vision module is connected with five axis anti-shaking modules, and five axis anti-shaking modules are connected with image processing module It connects, image processing module is connected with high definition display module, and high definition display module is connected with wireless transport module;
The binocular vision module receives information and three-dimensional heart model information from external environment, and information is passed Pass five axis anti-shaking modules;
The five axis anti-shaking module has stabilization function, and the information for guaranteeing that binocular vision module passes over is shown clearly Picture, and treated that image passes to image processing module by stabilization;
Described image processing module receives stabilization treated image, is in Ren Ranneng in movement in augmented reality glasses It is enough to guarantee display clearly picture, and the picture after image procossing is passed into high definition display module;
The high definition display module, the picture after receiving image procossing, and the picture is generated into high definition picture, it is shown in eye On mirror, and high definition picture is passed into wireless transport module;
The wireless transport module goes out high definition picture wireless transmission;
The detection bracelet, comprising: electrocardiosignal monitoring unit, prewarning unit, first-aid unit, intelligent sound unit, OLED display unit.
The electrocardiosignal monitoring unit, real-time monitoring heart of patient bounce situation, heartbeat situation is passed to OLED display unit, and according to the threshold value set, judge whether heart there are abnormal conditions, it will be abnormal if there is heart abnormality Signal passes to prewarning unit;If the case where first aid occurs in judgement, first aid information is sent to first-aid unit;
The prewarning unit after receiving the heart abnormality signal that electrocardiosignal monitoring unit is sent, issues early warning sound;
The first-aid unit, after receiving the first aid information that electrocardiosignal monitoring unit is sent, automatic dialing ambulance call, and GPS positioning function is opened, patient is positioned at any time;
The intelligent sound unit realizes man machine language's interaction;
The OLED display unit, monitoring heart of patient bounce situation are shown by OLED screen curtain.
The video information from external environment, comprising: conduit, sacculus, bracket, thrombus collector, high-speed micro rotary head Conduit, sacculus, bracket, thrombus collector, high-speed micro rotary head medical equipment are carried out 3-D scanning, form three by medical equipment Dimension module.Threedimensional model is transmitted in big data service system and is stored;
A kind of application method of the cardiac stent operation auxiliary diagnosis and therapy system based on augmented reality, using one kind based on enhancing The cardiac stent operation auxiliary diagnosis and therapy system of reality is realized, the specific steps are as follows:
Step 1: starting the cardiac stent operation auxiliary diagnosis and therapy system of augmented reality;
Step 2: initialization big data service system, after central data processing unit handles data in storage unit Sorted data are sent to image processing unit by classification;
Step 3: sorted data being generated into bidimensional image information, and bidimensional image information is passed into intelligent diagnostics list Member;;
Step 4: according to bidimensional image information, Diagnosing Cardiac angiemphraxis situation, and congestion situations being passed into Three-dimensional Gravity Structure unit;
Step 5: in conjunction with cardiovascular congestion situations, three-dimensionalreconstruction unit generates three-dimensional heart model, and by three-dimensional cardiac Model Transfer gives laser transmission unit;
Step 6: three-dimensional heart model is transmitted to data transmission and exchange system by laser transmission unit;
Step 7: three-dimensional heart model is uniformly sent to augmented reality glasses and holographic friendship by data transmission and exchange system Mutual projector;
Step 8: doctor puts on augmented reality glasses, starts augmented reality glasses, certainly extraneous on glasses according to being shown in The video information and three-dimensional heart model video information of environment, perform the operation, the positioning of subsidiary conduit;
Step 9: start holographic alternative projection device when conduit reaches coronary sinus bottom, takes augmented reality glasses, Using holographic alternative projection device gesture identification function, heart stopping state is observed, and complete remaining operation;
Step 10: after the completion of operation, patient worn detects bracelet, monitoring heart of patient bounce situation.Encounter the different feelings of heart Condition is reminded, and judges whether that starting first-aid unit dials rescue phone according to sign, positioning in real time and monitoring patient status;It pushes away It recommends healthy diet guide, remind sleep, movement;The data of monitoring are passed through into data transmission and exchange system real-time delivery to big number According to service system.
Advantageous effects:
This system can be preferable to react heart truth with real-time display cardiac three-dimensional image, and increase operation can Depending on property, surgical operation difficulty is reduced, to putting the quantity of bracket there has also been relatively good judgement, while postoperative patient situation It can track very well and reasonable life is provided and direct.
Detailed description of the invention
Fig. 1 is a kind of cardiac stent operation auxiliary diagnosis and therapy system block diagram based on augmented reality of the embodiment of the present invention;
Fig. 2 is a kind of cardiac stent operation auxiliary diagnosis and therapy system application method based on augmented reality of the embodiment of the present invention Flow chart;
Fig. 3 is the cardiac stent surgical procedure overall situation figure of the embodiment of the present invention;
Fig. 4 is the holographic alternative projection device of the embodiment of the present invention;
Fig. 5 is that the patient worn of the embodiment of the present invention detects hand ring diagram;
Fig. 6 is the augmented reality glasses composition block diagram of the embodiment of the present invention;
In figure: 1- puts on the doctor of augmented reality glasses operation, 2- augmented reality glasses, and 3- takes augmented reality glasses Doctor, patient 4-, 5-X ray machine, 6- display screen, 7- holography alternative projection device, 8- big data service system, 9- remote transmission letter Number, 10- transmission line, 11- operating table, 12- virtual three-dimensional cardiac module, 13- projection lens, 14- binocular head 1,15- binocular First 2,16.1-USB interface, 16.2-HDMI interface, 16.3-VGA interface, 17- power supply, 18- heat dissipation grid, 19- power knob, 20- Cable interface, 21- data transmission interface, 22- detect bracelet.
Specific embodiment
Invention is described further with specific implementation example with reference to the accompanying drawing, a kind of heart branch based on augmented reality Frame operation auxiliary diagnosis and therapy system, as shown in Figure 1, comprising: big data service system 8, augmented reality glasses 2, holographic alternative projection Device 7, data transmission and exchange system, detection bracelet 22;
The big data service system 8 is transmitted by data and is interacted respectively with augmented reality glasses 2, holography with exchange system Projector 7 and detection bracelet 22 carry out data communication;
The augmented reality glasses 2, the Virtual Cardiac Mode after three-dimensional reconstruction are merged with actual environment, auxiliary is led The insertion of pipe;
The holography alternative projection device 7, the three-dimensional heart model after three-dimensional reconstruction is projected in face of doctor, and identify hand The gesture of art process doctor, the three-dimensional heart model in real-time display surgical procedure, gesture interaction being capable of 360 deg rotations Holographic heart observes heart stopping state;
The big data service system 8, comprising: storage unit, central data processing unit, image processing unit, intelligence Diagnosis unit, three-dimensionalreconstruction unit and laser transmission unit;
The storage unit is connected with central data processing unit, central data processing unit and image processing unit phase Connection, image processing unit are connected with intelligent diagnostics unit, and intelligent diagnostics unit is connected with laser transmission unit, laser Defeated unit is transmitted with data to be connected with exchange system;
The storage unit, for saving cardiac imaging information, ECG information, previous medical history and the detection bracelet of patient The data passed over;
The central data processing unit is classified after handling data in storage unit, and sorted data are sent To image processing unit;
Sorted data are generated bidimensional image information, and bidimensional image information are transmitted by described image processing unit Give intelligent diagnostics unit;
The intelligent diagnostics unit judges cardiovascular congestion situations according to bidimensional image information, and congestion situations are passed Pass three-dimensionalreconstruction unit;
The three-dimensionalreconstruction unit, in conjunction with cardiovascular congestion situations, three-dimensionalreconstruction unit generates three-dimensional heart model, and Three-dimensional heart model is passed into laser transmission unit;
Three-dimensional heart model is transmitted to data transmission and exchange system by the laser transmission unit;
Three-dimensional heart model is uniformly sent to augmented reality glasses and holographic interaction by the data transmission and exchange system Projector.
The detection bracelet 22 gives patient worn after surgery, and monitoring heart of patient bounce situation is logical, encounters the different situation of heart It is reminded, judges whether that starting first-aid unit dials rescue phone according to sign, positioning in real time and monitoring patient status;Recommend Healthy diet guide reminds sleep, movement.The data of monitoring are passed through into data transmission and exchange system real-time delivery to big data Service system.
The augmented reality glasses 2, as shown in Figure 6, comprising: binocular vision module (Sony IMX586), five axis stabilization moulds Block (Sony), image processing module (high pass 855), high definition display module and wireless transport module (Samsung);
The binocular vision module is connected with five axis anti-shaking modules, and five axis anti-shaking modules are connected with image processing module It connects, image processing module is connected with high definition display module, and high definition display module is connected with wireless transport module;
The binocular vision module receives information and three-dimensional heart model information from external environment, and information is passed Pass five axis anti-shaking modules;
The five axis anti-shaking module has stabilization function, and the information for guaranteeing that binocular vision module passes over is shown clearly Picture, and treated that image passes to image processing module by stabilization;
Described image processing module receives stabilization treated image, is in Ren Ranneng in movement in augmented reality glasses It is enough to guarantee display clearly picture, and the picture after image procossing is passed into high definition display module;
The high definition display module, the picture after receiving image procossing, and the picture is generated into high definition picture, it is shown in eye On mirror, and high definition picture is passed into wireless transport module;
The wireless transport module goes out high definition picture wireless transmission;
The detection bracelet, comprising: electrocardiosignal monitoring unit, prewarning unit, first-aid unit, intelligent sound unit, OLED display unit.
The holography alternative projection device 7, as shown in Figure 4, comprising: projection lens 13, binocular head 114, binocular head 215, usb 1 6.1, HDMI interface 16.2, USB interface 16.3, power supply 17, radiate grid 18, power knob 19, cable interface 20, data transmission interface 21;
The electrocardiosignal monitoring unit, real-time monitoring heart of patient bounce situation, heartbeat situation is passed to OLED display unit, and according to the threshold value set, judge whether heart there are abnormal conditions, it will be abnormal if there is heart abnormality Signal passes to prewarning unit;If the case where first aid occurs in judgement, first aid information is sent to first-aid unit;
The prewarning unit after receiving the heart abnormality signal that electrocardiosignal monitoring unit is sent, issues early warning sound;
The first-aid unit, after receiving the first aid information that electrocardiosignal monitoring unit is sent, automatic dialing ambulance call, and GPS positioning function is opened, patient is positioned at any time;
The intelligent sound unit realizes man machine language's interaction;
The OLED display unit, monitoring heart of patient bounce situation are shown by OLED screen curtain.
The video information from external environment, comprising: conduit, sacculus, bracket, thrombus collector, high-speed micro rotary head Conduit, sacculus, bracket, thrombus collector, high-speed micro rotary head medical equipment are carried out 3-D scanning, form three by medical equipment Dimension module.Threedimensional model is transmitted in big data service system and is stored;
A kind of application method of the cardiac stent operation auxiliary diagnosis and therapy system based on augmented reality, using one kind based on enhancing The cardiac stent operation auxiliary diagnosis and therapy system realization of reality, as shown in Figure 2 and Figure 3, the specific steps are as follows:
Step 1: starting the cardiac stent operation auxiliary diagnosis and therapy system of augmented reality;
Step 2: initialization big data service system, after central data processing unit handles data in storage unit Sorted data are sent to image processing unit by classification;
Step 3: sorted data being generated into bidimensional image information, and bidimensional image information is passed into intelligent diagnostics list Member;;
Step 4: according to bidimensional image information, Diagnosing Cardiac angiemphraxis situation, and congestion situations being passed into Three-dimensional Gravity Structure unit;
Step 5: in conjunction with cardiovascular congestion situations, three-dimensionalreconstruction unit generates three-dimensional heart model, and by three-dimensional cardiac Model Transfer gives laser transmission unit;
Step 6: three-dimensional heart model is transmitted to data transmission and exchange system by laser transmission unit;
Step 7: three-dimensional heart model is uniformly sent to augmented reality glasses and holographic friendship by data transmission and exchange system Mutual projector;
Step 8: doctor puts on augmented reality glasses, starts augmented reality glasses, certainly extraneous on glasses according to being shown in The video information and three-dimensional heart model video information of environment, perform the operation, subsidiary conduit is put into;
Step 9: start holographic alternative projection device when conduit reaches coronary sinus bottom, takes augmented reality glasses, Using holographic alternative projection device gesture identification function, heart stopping state is observed, more than the placement and completion of auxiliary stand Under operation;
Step 10: after the completion of operation, patient worn detects bracelet, monitoring heart of patient bounce situation, as shown in figure 5, meeting It is reminded to the different situation of heart, judges whether that starting first-aid unit dials rescue phone according to sign, positioning in real time and monitoring Patient status;Recommend healthy diet guide, remind sleep, movement;The data of monitoring are real by data transmission and exchange system When be transmitted to big data service system.
It will be in the cardiac imaging information of patient, ECG information and previous medical history conveying big data service system.System is fast Speed is analyzed and is established three bit model of high definition heart and block of information is transmitted to data transmission and exchange system.
Data are uniformly sent to wireless wearable eyes, holographic alternative projection instrument by data exchange service system.It need to Conduit, sacculus, bracket, thrombus collector, the high-speed micro rotary head medical equipment progress 3-D scanning wanted, form threedimensional model. It will be stored in mode input big data service system.
Patient is inserted into conduit by manual arteries and veins, and when doctor takes wearable glasses, system starts automatically, wearable glasses Wireless module on the one hand receive from data exchange service system information, and the three-dimensional heart model that displays it.
Another aspect binocular vision module receives the video information from external environment, and automatic phasing machine is demarcated, and to label Click through line trace.Five axis stabilization stabilizations cooperate high definition display module, and image processing module is in movement in unlimited wearable eyes In appoint can so guarantee show picture clarity.
After calibration, binocular vision system starts to identify conduit, and transmission instruction, caching can be sent to big data service system Catheter models in data line are sent on glasses by interchanger, and are carried out heart enhancing and realized display.
Contrast agent is squeezed into, in conjunction with the length of C arm machine and insertion conduit, catheter head is positioned.Pass through augmented reality Glasses can watch conduit in the location of body.Before conduit is sent into coronary sinus bottom by blood vessel, glasses all can be real-time Augmented reality shows that this procedures system can be automatically to vessels analysis and modeling.Analyze the rough diameter and model of blood vessel. It prepares so as to subsequent to the assessment for being put into number of holders and the holographic display link of entrance.When conduit to coronary sinus bottom, system Line holographic projections device can be started automatically.
Holographic three-dimensional interactive projection.Received three-dimensional heart model is passed through laser hologram by holographic alternative projection device Projector projects come out.Gesture interaction can rotate holographic heart with six degree of freedom, observe heart features.Hologram and perform the operation into Journey is synchronous.This has benefited from big data service system, can quickly handle in time and generate useful image and be transferred to data rapidly Transmission exchange system, by line holographic projections can be to watch, blood vessel blockage degree, if such issues that calcification occur.
Thrombus collector is first placed on calcification part front end by the part of calcification, then with pivoting rail head to calcification part It thoroughly crushes, can not only clear up thrombus in this way, but also the anti-tampon of energy flows through in blood.
System is by analysis by modeling and telling doctor to be put into the number of bracket by voice.Before being put into, palpus will Thrombus collector is placed on before block part, then sacculus is put into block part, and pressurization is washed the blood vessel of block part open, put Enter required bracket.These are all to cross observation line holographic projections to operate.
Postoperative wear to patient detects bracelet.Heart of patient bounce situation is monitored by detection unit and is shown by OLED screen curtain It shows and.Support voice input, telephone service, GPS service.It encounters the different situation alarm unit of heart and issues red prompting, remind Patient looks after one's health exception.Judge whether system starts first-aid unit and dial rescue phone according to sign, system is equipped with GPS positioning System positions patient, and monitoring patient is simultaneously emitted by voice and seeks help to surrounding.Recommend healthy diet in terms of usually life The sleep of guide display alarm, movement.By the data of monitoring by data exchange service system it is synchronous with big data system, formation Networking effectiveness.

Claims (4)

1. a kind of cardiac stent operation auxiliary diagnosis and therapy system based on augmented reality characterized by comprising big data service system System, augmented reality glasses, holographic alternative projection device, data transmission and exchange system, detection bracelet;
The big data service system by data transmission and exchange system respectively with augmented reality glasses, holographic alternative projection device Data communication is carried out with detection bracelet;
The augmented reality glasses, the Virtual Cardiac Mode after three-dimensional reconstruction is merged with actual environment, subsidiary conduit Insertion;
The holography alternative projection device, the three-dimensional heart model after three-dimensional reconstruction is projected in face of doctor, and identify and performed the operation The gesture of Cheng doctor, the three-dimensional heart model in real-time display surgical procedure, gesture interaction can 360 deg rotation it is holographic Heart observes heart stopping state, while assisting rack;
The big data service system, comprising: storage unit, central data processing unit, image processing unit, intelligent diagnostics list Member, three-dimensionalreconstruction unit and laser transmission unit;
The storage unit is connected with central data processing unit, and central data processing unit is connected with image processing unit It connects, image processing unit is connected with intelligent diagnostics unit, and intelligent diagnostics unit is connected with laser transmission unit, laser transmission Unit is transmitted with data to be connected with exchange system;
The storage unit, for saving cardiac imaging information, ECG information, previous medical history and the detection bracelet transmitting of patient The data to come over;
The central data processing unit is classified after handling data in storage unit, and sorted data are sent to figure As processing unit;
Sorted data are generated bidimensional image information, and bidimensional image information are passed to intelligence by described image processing unit It can diagnosis unit;
The intelligent diagnostics unit judges cardiovascular congestion situations according to bidimensional image information, and congestion situations are passed to Three-dimensionalreconstruction unit;
The three-dimensionalreconstruction unit, in conjunction with cardiovascular congestion situations, three-dimensionalreconstruction unit generates three-dimensional heart model, and by three Dimension cardiac module passes to laser transmission unit;
Three-dimensional heart model is transmitted to data transmission and exchange system by the laser transmission unit;
Three-dimensional heart model is uniformly sent to augmented reality glasses and holographic alternative projection by the data transmission and exchange system Device;
The detection bracelet gives patient worn after surgery, and monitoring heart of patient bounce situation is logical, encounters the different situation of heart and is mentioned It wakes up, judges whether that starting first-aid unit dials rescue phone according to sign, positioning in real time and monitoring patient status;Recommend health drink Index finger south reminds and sleeps, moves, and the data of monitoring are serviced system with exchange system real-time delivery to big data by data transmission System.
2. the cardiac stent operation auxiliary diagnosis and therapy system based on augmented reality according to claim 1, which is characterized in that described Augmented reality glasses, comprising: binocular vision module, five axis anti-shaking modules, image processing module, high definition display module and wireless biography Defeated module;
The binocular vision module is connected with five axis anti-shaking modules, and five axis anti-shaking modules are connected with image processing module, figure As processing module is connected with high definition display module, high definition display module is connected with wireless transport module;
The binocular vision module receives information and three-dimensional heart model information from external environment, and passes information to Five axis anti-shaking modules;
The five axis anti-shaking module has stabilization function, and the information that guarantee binocular vision module passes over, which is shown, clearly draws Face, and treated that image passes to image processing module by stabilization;
Described image processing module receives stabilization treated image, and being in appoint in movement in augmented reality glasses can so protect Card shows clearly picture, and the picture after image procossing is passed to high definition display module;
The high definition display module, the picture after receiving image procossing, and the picture is generated into high definition picture, it is shown in glasses On, and high definition picture is passed into wireless transport module;
The wireless transport module goes out high definition picture wireless transmission.
3. the cardiac stent operation auxiliary diagnosis and therapy system based on augmented reality according to claim 1, which is characterized in that described Detect bracelet, comprising: electrocardiosignal monitoring unit, prewarning unit, first-aid unit, intelligent sound unit, OLED display unit;
The electrocardiosignal monitoring unit, real-time monitoring heart of patient bounce situation, passes to OLED for heartbeat situation and shows Show unit, and according to the threshold value set, judges whether heart there are abnormal conditions, pass abnormal signal if there is heart abnormality Pass prewarning unit;If the case where first aid occurs in judgement, first aid information is sent to first-aid unit;
The prewarning unit after receiving the heart abnormality signal that electrocardiosignal monitoring unit is sent, issues early warning sound;
The first-aid unit, after receiving the first aid information that electrocardiosignal monitoring unit is sent, automatic dialing ambulance call, and open GPS positioning function at any time positions patient;
The intelligent sound unit realizes man machine language's interaction;
The OLED display unit, monitoring heart of patient bounce situation are shown by OLED screen curtain;
The video information from external environment, comprising: conduit, sacculus, bracket, thrombus collector, high-speed micro rotary head medical treatment Conduit, sacculus, bracket, thrombus collector, high-speed micro rotary head medical equipment are carried out 3-D scanning, form three-dimensional mould by equipment Threedimensional model is transmitted in big data service system and stores by type.
4. a kind of application method of the cardiac stent operation auxiliary diagnosis and therapy system based on augmented reality, using described in claim 1 Cardiac stent operation auxiliary diagnosis and therapy system based on augmented reality is realized, which is characterized in that specific step is as follows:
Step 1: starting the cardiac stent operation auxiliary diagnosis and therapy system of augmented reality;
Step 2: initialization big data service system, central data processing unit divide after handling data in storage unit Sorted data are sent to image processing unit by class;
Step 3: sorted data being generated into bidimensional image information, and bidimensional image information is passed into intelligent diagnostics unit;;
Step 4: according to bidimensional image information, Diagnosing Cardiac angiemphraxis situation, and congestion situations being passed into three-dimensionalreconstruction list Member;
Step 5: in conjunction with cardiovascular congestion situations, three-dimensionalreconstruction unit generates three-dimensional heart model, and by three-dimensional heart model Pass to laser transmission unit;
Step 6: three-dimensional heart model is transmitted to data transmission and exchange system by laser transmission unit;
Step 7: three-dimensional heart model is uniformly sent to augmented reality glasses with exchange system by data transmission and holography interacts throwing Shadow device;
Step 8: doctor puts on augmented reality glasses, starts augmented reality glasses, according to be shown on glasses from external environment Video information and three-dimensional heart model video information, perform the operation, subsidiary conduit is put into;
Step 9: starting holographic alternative projection device when conduit reaches coronary sinus bottom, augmented reality glasses are taken, using complete Alternative projection device gesture identification function is ceased, heart stopping state is observed, auxiliary puts bracket and completes remaining operation;
Step 10: after the completion of operation, patient worn detect bracelet, monitoring heart of patient beat situation, encounter the different situation of heart into Row is reminded, and judges whether that starting first-aid unit dials rescue phone according to sign, positioning in real time and monitoring patient status;Recommend strong Health dietary guidelines remind sleep, movement;The data of monitoring are taken by data transmission with exchange system real-time delivery to big data Business system.
CN201910704951.XA 2019-07-31 2019-07-31 Cardiac stent operation auxiliary diagnosis and therapy system and application method based on augmented reality Pending CN110292439A (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201910704951.XA CN110292439A (en) 2019-07-31 2019-07-31 Cardiac stent operation auxiliary diagnosis and therapy system and application method based on augmented reality
PCT/CN2019/099012 WO2021017019A1 (en) 2019-07-31 2019-08-02 Augmented reality-based auxiliary diagnosis and treatment system for coronary angioplasty surgery, and use method thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910704951.XA CN110292439A (en) 2019-07-31 2019-07-31 Cardiac stent operation auxiliary diagnosis and therapy system and application method based on augmented reality

Publications (1)

Publication Number Publication Date
CN110292439A true CN110292439A (en) 2019-10-01

Family

ID=68032447

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910704951.XA Pending CN110292439A (en) 2019-07-31 2019-07-31 Cardiac stent operation auxiliary diagnosis and therapy system and application method based on augmented reality

Country Status (2)

Country Link
CN (1) CN110292439A (en)
WO (1) WO2021017019A1 (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111053598A (en) * 2019-12-03 2020-04-24 天津大学 Augmented reality system platform based on projector
CN111150490A (en) * 2020-01-15 2020-05-15 陈挺 Intelligent assistant system for cardiac radio frequency ablation surgery based on AR and AI technologies
CN113303806A (en) * 2021-04-24 2021-08-27 华中科技大学同济医学院附属协和医院 Wireless holographic display electrocardiogram monitoring system and monitoring method
CN113616333A (en) * 2021-09-13 2021-11-09 上海微创医疗机器人(集团)股份有限公司 Catheter movement assistance method, catheter movement assistance system, and readable storage medium
CN113761776A (en) * 2021-08-24 2021-12-07 中国人民解放军总医院第一医学中心 Simulation system and method of heart hemorrhage and hemostasis model based on augmented reality

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2536650A (en) 2015-03-24 2016-09-28 Augmedics Ltd Method and system for combining video-based and optic-based augmented reality in a near eye display
EP3787543A4 (en) 2018-05-02 2022-01-19 Augmedics Ltd. Registration of a fiducial marker for an augmented reality system
US11766296B2 (en) 2018-11-26 2023-09-26 Augmedics Ltd. Tracking system for image-guided surgery
US11980506B2 (en) 2019-07-29 2024-05-14 Augmedics Ltd. Fiducial marker
US11382712B2 (en) 2019-12-22 2022-07-12 Augmedics Ltd. Mirroring in image guided surgery
RU2749289C1 (en) * 2020-09-25 2021-06-08 Федеральное государственное бюджетное учреждение "Национальный медицинский исследовательский центр терапии и профилактической медицины" Министерства здравоохранения Российской Федерации (ФГБУ "НМИЦ ТПМ" Минздрава России) Method for non-invasive diagnostics of coronary atherosclerosis using visual scale
US11896445B2 (en) 2021-07-07 2024-02-13 Augmedics Ltd. Iliac pin and adapter

Citations (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1914617A (en) * 2004-02-03 2007-02-14 美国西门子医疗解决公司 Systems and methods for automated diagnosis and decision support for heart related diseases and conditions
CN105615831A (en) * 2015-12-18 2016-06-01 李占和 Medical image holographic AR (augmented reality) display system
CN105657370A (en) * 2016-01-08 2016-06-08 李昂 Closed wearable panoramic photographing and processing system and operation method thereof
CN105748029A (en) * 2016-02-18 2016-07-13 深圳开立生物医疗科技股份有限公司 Imaging system of endoscope
CN105852847A (en) * 2016-04-26 2016-08-17 胡冬硕 Heart and vital sign monitoring and analyzing system
WO2017060106A1 (en) * 2015-10-07 2017-04-13 Koninklijke Philips N.V. Mobile ffr simulation
CN106901834A (en) * 2016-12-29 2017-06-30 陕西联邦义齿有限公司 The preoperative planning of minimally invasive cardiac surgery and operation virtual reality simulation method
CN106999053A (en) * 2014-12-08 2017-08-01 皇家飞利浦有限公司 Patient education for percutaneous coronary intervention (pci)
CN107296650A (en) * 2017-06-01 2017-10-27 西安电子科技大学 Intelligent operation accessory system based on virtual reality and augmented reality
CN206995246U (en) * 2017-01-26 2018-02-13 宿迁学院 A kind of real-time positioning salvage system based on electrocardio and figure
CN108324246A (en) * 2018-01-19 2018-07-27 上海联影医疗科技有限公司 Medical diagnosis auxiliary system and method
CN108882854A (en) * 2016-03-21 2018-11-23 华盛顿大学 The virtual reality or augmented reality of 3D medical image visualize
CN109036548A (en) * 2018-06-19 2018-12-18 黑龙江拓盟科技有限公司 Assisting in diagnosis and treatment system based on mixed reality three-dimensional visualization
CN109223121A (en) * 2018-07-31 2019-01-18 广州狄卡视觉科技有限公司 Based on medical image Model Reconstruction, the cerebral hemorrhage puncturing operation navigation system of positioning
CN109907758A (en) * 2019-03-15 2019-06-21 脑玺(上海)智能科技有限公司 The image mask method and system of intracranial vessel blood flow delay

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104382576A (en) * 2014-12-19 2015-03-04 王常松 Medical intelligent monitoring ring system
CN106580361B (en) * 2016-12-08 2018-03-23 王国良 A kind of portable orthopaedics detection means based on AR VR technologies 4D imagings
US11350994B2 (en) * 2017-06-19 2022-06-07 Navlab Holdings Ii, Llc Surgery planning
CN109730768A (en) * 2019-01-10 2019-05-10 黄德荣 A kind of cardiac thoracic surgery supplementary controlled system and method based on virtual reality
CN109730771A (en) * 2019-03-19 2019-05-10 安徽紫薇帝星数字科技有限公司 A kind of operation guiding system based on AR technology

Patent Citations (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1914617A (en) * 2004-02-03 2007-02-14 美国西门子医疗解决公司 Systems and methods for automated diagnosis and decision support for heart related diseases and conditions
CN106999053A (en) * 2014-12-08 2017-08-01 皇家飞利浦有限公司 Patient education for percutaneous coronary intervention (pci)
WO2017060106A1 (en) * 2015-10-07 2017-04-13 Koninklijke Philips N.V. Mobile ffr simulation
CN105615831A (en) * 2015-12-18 2016-06-01 李占和 Medical image holographic AR (augmented reality) display system
CN105657370A (en) * 2016-01-08 2016-06-08 李昂 Closed wearable panoramic photographing and processing system and operation method thereof
CN105748029A (en) * 2016-02-18 2016-07-13 深圳开立生物医疗科技股份有限公司 Imaging system of endoscope
CN108882854A (en) * 2016-03-21 2018-11-23 华盛顿大学 The virtual reality or augmented reality of 3D medical image visualize
CN105852847A (en) * 2016-04-26 2016-08-17 胡冬硕 Heart and vital sign monitoring and analyzing system
CN106901834A (en) * 2016-12-29 2017-06-30 陕西联邦义齿有限公司 The preoperative planning of minimally invasive cardiac surgery and operation virtual reality simulation method
CN206995246U (en) * 2017-01-26 2018-02-13 宿迁学院 A kind of real-time positioning salvage system based on electrocardio and figure
CN107296650A (en) * 2017-06-01 2017-10-27 西安电子科技大学 Intelligent operation accessory system based on virtual reality and augmented reality
CN108324246A (en) * 2018-01-19 2018-07-27 上海联影医疗科技有限公司 Medical diagnosis auxiliary system and method
CN109036548A (en) * 2018-06-19 2018-12-18 黑龙江拓盟科技有限公司 Assisting in diagnosis and treatment system based on mixed reality three-dimensional visualization
CN109223121A (en) * 2018-07-31 2019-01-18 广州狄卡视觉科技有限公司 Based on medical image Model Reconstruction, the cerebral hemorrhage puncturing operation navigation system of positioning
CN109907758A (en) * 2019-03-15 2019-06-21 脑玺(上海)智能科技有限公司 The image mask method and system of intracranial vessel blood flow delay

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111053598A (en) * 2019-12-03 2020-04-24 天津大学 Augmented reality system platform based on projector
CN111150490A (en) * 2020-01-15 2020-05-15 陈挺 Intelligent assistant system for cardiac radio frequency ablation surgery based on AR and AI technologies
CN111150490B (en) * 2020-01-15 2021-01-29 陈挺 Intelligent assistant system for cardiac radio frequency ablation surgery based on AR and AI technologies
CN113303806A (en) * 2021-04-24 2021-08-27 华中科技大学同济医学院附属协和医院 Wireless holographic display electrocardiogram monitoring system and monitoring method
CN113761776A (en) * 2021-08-24 2021-12-07 中国人民解放军总医院第一医学中心 Simulation system and method of heart hemorrhage and hemostasis model based on augmented reality
CN113761776B (en) * 2021-08-24 2023-03-14 中国人民解放军总医院第一医学中心 Simulation system and method of heart hemorrhage and hemostasis model based on augmented reality
CN113616333A (en) * 2021-09-13 2021-11-09 上海微创医疗机器人(集团)股份有限公司 Catheter movement assistance method, catheter movement assistance system, and readable storage medium
CN113616333B (en) * 2021-09-13 2023-02-10 上海微创微航机器人有限公司 Catheter movement assistance method, catheter movement assistance system, and readable storage medium

Also Published As

Publication number Publication date
WO2021017019A1 (en) 2021-02-04

Similar Documents

Publication Publication Date Title
CN110292439A (en) Cardiac stent operation auxiliary diagnosis and therapy system and application method based on augmented reality
RU2740259C2 (en) Ultrasonic imaging sensor positioning
CA3095287C (en) Augmented reality systems for time critical biomedical applications
CN108324246B (en) Medical diagnosis assisting system and method
US11297285B2 (en) Dental and medical loupe system for lighting control, streaming, and augmented reality assisted procedures
CN108430306A (en) System and method for using laser speckle contrast Imaging fast to check vascular system and particle stream
US20170367661A1 (en) Automotive key device, steering wheel docking station, and system including the automotive key device and the steering wheel docking station
CN210956178U (en) Mobile emergency system and ambulance
CN105078580B (en) Surgical robot system and its laparoscopic procedure method and human body temperature type operation image processing apparatus and its method
CN107810535A (en) Wear-type computing device, method and computer program product
CN110148477A (en) A kind of AR Telemedicine System and its application method
CN109875505A (en) A kind of integrated operation room remote medical consultation with specialists method based on virtual reality technology
CN107714006A (en) A kind of remote interaction system and method based on virtual reality head-mounted display apparatus
Monkman et al. A see through future: augmented reality and health information systems.
CN111554391A (en) Medical first-aid dispatching system device based on Internet of things
CN113610145A (en) Model training method, image prediction method, training system, and storage medium
CN114098962A (en) Cerebral hemorrhage puncture operation navigation system
CN113903448A (en) Wearable AR remote medical first-aid cooperation system and method based on Internet of things
CN111053598A (en) Augmented reality system platform based on projector
CN111193830B (en) Portable augmented reality medical image observation auxiliary assembly based on smart phone
CN111857342A (en) Eye movement tracking system and method based on medical endoscope
CN110025383A (en) A kind of robot medicine mirror system with color Doppler ultrasound function
WO2020143871A1 (en) Audio-video conferencing system of telemedicine
EP4318408A1 (en) Information processing system, information processing method, and program
Bacharach Visual field testing undergoes modern transformation via wearable technology.

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20191001