CN109659024A - A kind of remote diagnosis method of MR auxiliary - Google Patents
A kind of remote diagnosis method of MR auxiliary Download PDFInfo
- Publication number
- CN109659024A CN109659024A CN201811514498.8A CN201811514498A CN109659024A CN 109659024 A CN109659024 A CN 109659024A CN 201811514498 A CN201811514498 A CN 201811514498A CN 109659024 A CN109659024 A CN 109659024A
- Authority
- CN
- China
- Prior art keywords
- hololens
- local
- model
- strange land
- remote diagnosis
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000004171 remote diagnosis Methods 0.000 title claims abstract description 20
- 238000000034 method Methods 0.000 title claims abstract description 18
- 238000001356 surgical procedure Methods 0.000 claims abstract description 8
- 230000000694 effects Effects 0.000 claims abstract description 7
- 230000001360 synchronised effect Effects 0.000 claims abstract description 6
- 230000005540 biological transmission Effects 0.000 claims description 17
- 230000003902 lesion Effects 0.000 claims description 3
- 238000004088 simulation Methods 0.000 claims description 3
- 239000003814 drug Substances 0.000 abstract description 11
- 238000005516 engineering process Methods 0.000 abstract description 8
- 238000003745 diagnosis Methods 0.000 description 3
- 238000010586 diagram Methods 0.000 description 2
- 230000003190 augmentative effect Effects 0.000 description 1
- 210000004204 blood vessel Anatomy 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000005611 electricity Effects 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 238000012800 visualization Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H40/00—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices
- G16H40/60—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices
- G16H40/67—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices for remote operation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/003—Navigation within 3D models or images
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/20—Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H30/00—ICT specially adapted for the handling or processing of medical images
- G16H30/40—ICT specially adapted for the handling or processing of medical images for processing medical images, e.g. editing
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H50/00—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
- G16H50/20—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for computer-aided diagnosis, e.g. based on medical expert systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2210/00—Indexing scheme for image generation or computer graphics
- G06T2210/41—Medical
Landscapes
- Engineering & Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Public Health (AREA)
- Medical Informatics (AREA)
- Software Systems (AREA)
- Biomedical Technology (AREA)
- General Engineering & Computer Science (AREA)
- General Health & Medical Sciences (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Computer Hardware Design (AREA)
- Computer Graphics (AREA)
- Physics & Mathematics (AREA)
- Primary Health Care (AREA)
- Epidemiology (AREA)
- Business, Economics & Management (AREA)
- Remote Sensing (AREA)
- General Business, Economics & Management (AREA)
- Radar, Positioning & Navigation (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Radiology & Medical Imaging (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Pathology (AREA)
- Architecture (AREA)
- Apparatus For Radiation Diagnosis (AREA)
- Measuring And Recording Apparatus For Diagnosis (AREA)
Abstract
The present invention relates to a kind of remote diagnosis methods of MR auxiliary to be transferred to strange land Hololens for 3D model method includes the following steps: the CT two dimensional image of human body is obtained 3D model by three-dimensional reconstruction by (1) local Hololens；(2) truth of patient is transferred to strange land Hololens by high-definition camera；(3) local Hololens precisely launches 3D model on human body；(4) local doctor comes into effect operation under the auxiliary of local Hololens；(5) surgical procedure is transferred to strange land Hololens by high-definition camera；(6) doctor in strange land instructs operation by the image of observation 3D model and surgical procedure, and feeds back to local Hololens.The case where present invention combines mixed reality technology with tele-medicine, allows the doctor in strange land that can implement operation with Synchronous to virtual model and local, moreover it is possible to further dummy model be controlled, facilitate carry out medical treatment guidance.
Description
Technical field
The invention belongs to tele-medicine fields, are related to a kind of remote diagnosis method of MR auxiliary.
Background technique
Tele-medicine refer to by computer technology, remote sensing, telemetering, remote control technology for rely on, give full play to large hospital or
The medical technology and Medical Devices advantage at specialized health center, on the outlying district poor to medical condition, island or naval vessel
The sick and wounded carry out telediagnosis, treatment and consulting.Be intended to improve diagnosis and medical level, reduce medical expenses, meet it is vast
One completely new medical services of people's health care demand.Currently, Tele medicine is from initial TV monitoring, electricity
Words remote diagnosis, which is developed to, carries out number, the comprehensive transmission of image, voice using high speed network, and realizes real-time voice
With exchanging for HD image, broader development space is provided for the application of modern medicine.But traditional tele-medicine
Only high-resolution two dimensional image can be linked up and be exchanged, long-range effect need to be improved.
Mixed reality refers to the new visible environment that merging reality is generated with virtual world, in new visualization ring
Physics and digital object coexist in border, and real-time interactive.The realization needs of mixed reality can be with each things of real world at one
In the environment interacted, if it is exactly virtual reality that all things, which are all virtual those, if the virtual information shown
Can only simple superposition in real things, that is, augmented reality.The advantage of the two is combined to the final mesh of as mixed reality
Place.Currently, yet there are no the report for combining mixed reality technology with tele-medicine.
Summary of the invention
The object of the present invention is to provide a kind of remote diagnosis methods of MR auxiliary, by mixed reality technology and tele-medicine phase
In conjunction with, it is intended to improve the level and precision of tele-medicine.
The present invention is achieved through the following technical solutions: a kind of remote diagnosis method of MR auxiliary, this method includes following
Step:
(1) the CT two dimensional image of human body is obtained 3D model by three-dimensional reconstruction by local Hololens, and 3D model is transmitted
Give strange land Hololens；
(2) truth of patient is transferred to strange land Hololens by high-definition camera；
(3) local Hololens precisely launches 3D model on human body；
(4) local doctor comes into effect operation under the auxiliary of local Hololens；
(5) surgical procedure is transferred to strange land Hololens by high-definition camera；
(6) doctor in strange land instructs operation by the image of observation 3D model and surgical procedure, and feeds back to local
Hololens。
Further, the local Hololens and strange land Hololens is equipped with remote diagnosis system, and can lead to
It crosses local area network and synchronizes connection.
Further, the remote diagnosis system includes:
Audio transmission module is used for transmission audio data；
Video transmission module is used for transmission video data；
Control module is operated, for rotation, movement, expansion and the scaling to 3D model.
It further, further include global flag module, for remotely lesion or tissue to be marked.
Further, further include simulation surgical modules, dummy model is carried out by virtual operation instrument for remotely real
When operate.
Further, the video transmission module connects high-definition camera.
Good effect by adopting the above technical scheme: the present invention combines mixed reality technology with tele-medicine, allows different
The case where doctor on ground can implement operation with Synchronous to virtual model and local, moreover it is possible to further to virtual mould
Type is controlled, and carry out medical treatment guidance is facilitated, and is improved diagnosis and the medical level of local, is met the need of broad masses of the people
It asks.
Detailed description of the invention
Fig. 1 is flow diagram of the invention.
Specific embodiment
The following further describes the technical solution of the present invention with reference to the accompanying drawing, but should not be construed as to limit of the invention
System:
Fig. 1 is flow diagram of the invention, as shown, a kind of remote diagnosis method of MR auxiliary, this method includes following
Step:
(1) the CT two dimensional image of human body is obtained 3D model by three-dimensional reconstruction by local Hololens, and 3D model is transmitted
Give strange land Hololens；
(2) truth of patient is transferred to strange land Hololens by high-definition camera；
(3) local Hololens precisely launches 3D model on human body；
(4) local doctor comes into effect operation under the auxiliary of local Hololens；
(5) surgical procedure is transferred to strange land Hololens by high-definition camera；
(6) doctor in strange land instructs operation by the image of observation 3D model and surgical procedure, and feeds back to local
Hololens。
The local Hololens and strange land Hololens is equipped with remote diagnosis system, and can by local area network into
Row synchronized links.
The remote diagnosis system includes:
Audio transmission module is used for transmission audio data, and local user and strange land user can be with speech exchanges.
Video transmission module is used for transmission video data, can realize strange land with simultaneous transmission dummy model and real scene
User and dummy model seen in local user and real scene are fully synchronized.
Control module is operated, for rotation, movement, expansion and the scaling to 3D model, local user and strange land user are
Operation control can be carried out to 3D model, convenient for the exchanges and communication of medical staff.
It further include global flag module, for remotely lesion or tissue to be marked, such as: wherein cutting, which retains
A little blood vessels etc., can be used as label, in art or preoperative suggesting effect.
Further include simulation surgical modules, for remotely carrying out real-time operation to dummy model by virtual operation instrument, is
Built-in various surgical instruments and surgical environments in system, can remotely pass through scalpel, cut, clamp, tweezer etc. operates dummy model,
The model operated can be hidden, restore.
The video transmission module connects high-definition camera, transmits to the real scene of high-definition camera shooting.
The present invention combines mixed reality technology with tele-medicine, allows the doctor in strange land can be with Synchronous to virtual
The case where model and local implement operation, facilitates carry out medical treatment guidance, improves diagnosis and the medical level of local,
Meets the needs of broad masses of the people.
Claims (6)
1. a kind of remote diagnosis method of MR auxiliary, it is characterised in that: method includes the following steps:
(1) the CT two dimensional image of human body is obtained 3D model by three-dimensional reconstruction by local Hololens, and 3D model is transmitted
Give strange land Hololens；
(2) truth of patient is transferred to strange land Hololens by high-definition camera；
(3) local Hololens precisely launches 3D model on human body；
(4) local doctor comes into effect operation under the auxiliary of local Hololens；
(5) surgical procedure is transferred to strange land Hololens by high-definition camera；
(6) doctor in strange land instructs operation by the image of observation 3D model and surgical procedure, and feeds back to local
Hololens。
2. the remote diagnosis method of MR according to claim 1 auxiliary, it is characterised in that: the local Hololens and
Strange land Hololens is equipped with remote diagnosis system, and connection can be synchronized by local area network.
3. the remote diagnosis method of MR auxiliary according to claim 2, it is characterised in that: the remote diagnosis system packet
It includes:
Audio transmission module is used for transmission audio data；
Video transmission module is used for transmission video data；
Control module is operated, for rotation, movement, expansion and the scaling to 3D model.
4. the remote diagnosis method of MR auxiliary according to claim 3, it is characterised in that: it further include global flag module,
For remotely lesion or tissue to be marked.
5. the remote diagnosis method of MR auxiliary according to claim 3, it is characterised in that: it further include simulation surgical modules,
Real-time operation is carried out to dummy model for remotely passing through virtual operation instrument.
6. the remote diagnosis method assisted according to MR described in any one of claim 3-5 claim, it is characterised in that:
The video transmission module connects high-definition camera.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811514498.8A CN109659024A (en) | 2018-12-12 | 2018-12-12 | A kind of remote diagnosis method of MR auxiliary |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811514498.8A CN109659024A (en) | 2018-12-12 | 2018-12-12 | A kind of remote diagnosis method of MR auxiliary |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109659024A true CN109659024A (en) | 2019-04-19 |
Family
ID=66113724
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811514498.8A Pending CN109659024A (en) | 2018-12-12 | 2018-12-12 | A kind of remote diagnosis method of MR auxiliary |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109659024A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109935313A (en) * | 2019-03-04 | 2019-06-25 | 苏州达辰医疗科技有限公司 | The medical application of three-dimensional visualization and mixed reality |
| CN110349661A (en) * | 2019-07-08 | 2019-10-18 | 艾炳蔚 | A kind of acupuncture remote diagnosis system |
| CN110931121A (en) * | 2019-11-29 | 2020-03-27 | 重庆邮电大学 | Remote operation guiding device based on Hololens and operation method |
| WO2020253280A1 (en) * | 2019-06-18 | 2020-12-24 | 北京航空航天大学 | Augmented reality navigation method and system for minimally invasive total knee replacement surgery |
| CN113995525A (en) * | 2021-11-05 | 2022-02-01 | 无锡蓝软智能医疗科技有限公司 | Medical scene synchronous operation system capable of switching visual angles and based on mixed reality and storage medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104274247A (en) * | 2014-10-20 | 2015-01-14 | 上海电机学院 | Medical surgical navigation method |
| CN105512467A (en) * | 2015-11-30 | 2016-04-20 | 湖北融创三维数字医学科技有限公司 | Digit visualization mobile terminal medical method |
| CN106845120A (en) * | 2017-01-19 | 2017-06-13 | 杭州古珀医疗科技有限公司 | A kind of Telemedicine System and its operating method based on mixed reality technology |
| US20170172696A1 (en) * | 2015-12-18 | 2017-06-22 | MediLux Capitol Holdings, S.A.R.L. | Mixed Reality Imaging System, Apparatus and Surgical Suite |
| US20180090029A1 (en) * | 2016-09-29 | 2018-03-29 | Simbionix Ltd. | Method and system for medical simulation in an operating room in a virtual reality or augmented reality environment |
| CN108294814A (en) * | 2018-04-13 | 2018-07-20 | 首都医科大学宣武医院 | Intracranial puncture positioning method based on mixed reality |
-
2018
- 2018-12-12 CN CN201811514498.8A patent/CN109659024A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104274247A (en) * | 2014-10-20 | 2015-01-14 | 上海电机学院 | Medical surgical navigation method |
| CN105512467A (en) * | 2015-11-30 | 2016-04-20 | 湖北融创三维数字医学科技有限公司 | Digit visualization mobile terminal medical method |
| US20170172696A1 (en) * | 2015-12-18 | 2017-06-22 | MediLux Capitol Holdings, S.A.R.L. | Mixed Reality Imaging System, Apparatus and Surgical Suite |
| US20180090029A1 (en) * | 2016-09-29 | 2018-03-29 | Simbionix Ltd. | Method and system for medical simulation in an operating room in a virtual reality or augmented reality environment |
| CN106845120A (en) * | 2017-01-19 | 2017-06-13 | 杭州古珀医疗科技有限公司 | A kind of Telemedicine System and its operating method based on mixed reality technology |
| CN108294814A (en) * | 2018-04-13 | 2018-07-20 | 首都医科大学宣武医院 | Intracranial puncture positioning method based on mixed reality |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109935313A (en) * | 2019-03-04 | 2019-06-25 | 苏州达辰医疗科技有限公司 | The medical application of three-dimensional visualization and mixed reality |
| WO2020253280A1 (en) * | 2019-06-18 | 2020-12-24 | 北京航空航天大学 | Augmented reality navigation method and system for minimally invasive total knee replacement surgery |
| CN110349661A (en) * | 2019-07-08 | 2019-10-18 | 艾炳蔚 | A kind of acupuncture remote diagnosis system |
| CN110931121A (en) * | 2019-11-29 | 2020-03-27 | 重庆邮电大学 | Remote operation guiding device based on Hololens and operation method |
| CN113995525A (en) * | 2021-11-05 | 2022-02-01 | 无锡蓝软智能医疗科技有限公司 | Medical scene synchronous operation system capable of switching visual angles and based on mixed reality and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109659024A (en) | A kind of remote diagnosis method of MR auxiliary | |
| Hu et al. | Application and prospect of mixed reality technology in medical field | |
| Park et al. | Augmented and mixed reality: technologies for enhancing the future of IR | |
| McJunkin et al. | Development of a mixed reality platform for lateral skull base anatomy | |
| Sielhorst et al. | An augmented reality delivery simulator for medical training | |
| CN109464195B (en) | Dual mode augmented reality surgical system and method | |
| Gsaxner et al. | The HoloLens in medicine: A systematic review and taxonomy | |
| TWI745307B (en) | Augmented reality surgical navigation | |
| Rose et al. | Development of augmented‐reality applications in otolaryngology–head and neck surgery | |
| Shenai et al. | Virtual interactive presence for real-time, long-distance surgical collaboration during complex microsurgical procedures | |
| Lu et al. | Applications of mixed reality technology in orthopedics surgery: a pilot study | |
| WO2012081194A1 (en) | Medical-treatment assisting apparatus, medical-treatment assisting method, and medical-treatment assisting system | |
| WO2018028166A1 (en) | Remote interaction system and method based on virtual reality head-mounted display device | |
| Sugimoto | Cloud XR (extended reality: virtual reality, augmented reality, mixed reality) and 5g mobile communication system for medical image-guided holographic surgery and telemedicine | |
| Gsaxner et al. | Augmented reality in oral and maxillofacial surgery | |
| Rattner et al. | Advanced devices for the operating room of the future | |
| Abou El-Seoud et al. | An interactive mixed reality ray tracing rendering mobile application of medical data in minimally invasive surgeries | |
| CN109758231A (en) | Operation piloting method and system in thoracic cavity based on mixed reality | |
| Jiang et al. | User's image perception improved strategy and application of augmented reality systems in smart medical care: A review | |
| Harders et al. | Multimodal augmented reality in medicine | |
| Gupta et al. | A virtual reality enhanced cyber physical framework to support simulation based training of orthopedic surgical procedures | |
| KR20180123310A (en) | Laparoscopic surgery education system using augmented reality | |
| Zhang et al. | From AR to AI: augmentation technology for intelligent surgery and medical treatments | |
| Dai et al. | The application and prospection of augmented reality in hepato-pancreato-biliary surgery | |
| CN111477303A (en) | Aligning 3D real-time display system based on digital subtraction technology |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20190419 |