CN106845120A - A kind of Telemedicine System and its operating method based on mixed reality technology - Google Patents
A kind of Telemedicine System and its operating method based on mixed reality technology Download PDFInfo
- Publication number
- CN106845120A CN106845120A CN201710056916.2A CN201710056916A CN106845120A CN 106845120 A CN106845120 A CN 106845120A CN 201710056916 A CN201710056916 A CN 201710056916A CN 106845120 A CN106845120 A CN 106845120A
- Authority
- CN
- China
- Prior art keywords
- intelligent terminals
- mixed reality
- intelligent
- data
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G06F19/3418—
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H50/00—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
- G16H50/50—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for simulation or modelling of medical disorders
Landscapes
- Health & Medical Sciences (AREA)
- Engineering & Computer Science (AREA)
- Medical Informatics (AREA)
- Public Health (AREA)
- Pathology (AREA)
- Databases & Information Systems (AREA)
- Data Mining & Analysis (AREA)
- Biomedical Technology (AREA)
- Epidemiology (AREA)
- General Health & Medical Sciences (AREA)
- Primary Health Care (AREA)
- Medical Treatment And Welfare Office Work (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The present invention relates to technical field of long-distance medical, and in particular to a kind of Telemedicine System and its operating method based on mixed reality technology.Physical context information residing for MR intelligent terminal automatic identification wearers in space where patient, and physical environment modeling is carried out, generate physics environmental model；During medical data is projected physical environment model in the form of the hologram by MR intelligent terminals, mixed reality scene is generated；MR intelligent terminals wearer realizes the editing and processing to medical data in mixed reality scene by different control modes.Hospital or medical institutions need not set up special remote medical consultation with specialists room and build the hardware environment of complexity, it is only necessary to carry out tele-medicine by wearing MR intelligent terminals.But also with features such as wireless, mobiles, personnel participating in the meeting is carried out tele-medicine whenever and wherever possible, greatly reduce time cost.Using line holographic projections technology, the limitation in space can be broken through, show more effective contents, it is to avoid expand more terminal presentation facilities.
Description
Technical field
The present invention relates to technical field of long-distance medical, and in particular to a kind of Telemedicine System based on mixed reality technology
And its operating method.
Background technology
Mixed reality technology (MR) is the further development of virtual reality technology, and the technology is presented empty by reality scene
Intend scene information, an information circuits for interaction feedback are set up between virtual world, real world and user, to strengthen user
The sense of reality of experience.Mixed reality (MR) (both virtual including augmented reality and enhancing) refer to merging reality and virtual world and
The new visible environment for producing.Physics and digital object coexist in new visible environment, and real-time interactive.
Mixed reality technology brings great convenience for human lives, in the great embodiment that medical field is just obtained,
The patent of invention of such as Publication No. CN106109015A discloses a kind of wear-type medical system and its operating method, including
AR/MR wears display device and laser generator, and AR/MR wears the head that display device is worn on doctor, laser generator frame
The top of operating table is located at, artificial bone mark is carried out in patient's body surface, laser generator is directed at the body of patient illness part
Table is irradiated, and during the affected part 3D mode inputs AR/MR that CT scan is obtained is worn display device, doctor wears and starts AR/
MR wears display device, and sight line is directed at artificial bone mark, wears camera that AR/MR worn in display device to artifical bone's property
Mark is observed and recognized, affected part 3D models is displayed in the correspondence position of patient body, is worn AR/MR and is worn display device
Doctor arbitrarily walked about around operating table, observe affected part 3D models, guided operation operation.The present invention is relative to existing surgical technic
There is the characteristics of more efficient, more directly perceived, security is higher, feature is stronger.
Although greatly improving the operating efficiency and accuracy of operator using mixed reality technology, more efficiently
Intuitively, but also embodied for the transformation of remote medical consultation with specialists, the major defect of existing Telemedicine System has：
Need to set up remote medical consultation with specialists or Medical Treatment Room, and be equipped with various hardware devices, the compatibility between each hardware is relatively not
Stabilization.The hardware cost and maintenance cost for building the system are very high.Consultation of doctors place is limited to consulting room, and this not only makes consultation of doctors group
The person of knitting spends more energy to carry out coordination of attending a meeting, and participant is consumed more time cost.Personnel participating in the meeting watches jointly
The content that display is shown, as specialist it should be understood that sufferer itself medical domain inspection survey report or correlation
During medical information, it is impossible to which total number is projected over the display, therefore can only expand more terminal presentation facilities.
The content of the invention
The present invention is in order to solve the above-mentioned technical problem, there is provided a kind of Telemedicine System based on mixed reality technology and its
Operating method, using line holographic projections technology, can break through the limitation in space, show more effective contents, it is to avoid expand more ends
End display device, greatly improves the convenience and high efficiency of tele-medicine.
In order to reach above-mentioned technique effect, the present invention includes following technical scheme：
The invention provides a kind of Telemedicine System based on mixed reality technology, including server, information for hospital system
System, memory and multiple MR intelligent terminals,
The server, connects the hospital information system, memory and multiple MR intelligent terminals respectively；
The hospital information system includes EMR, PACS system and LIS systems, the medical data for storing patient, and incites somebody to action
The medical data is uploaded to MR intelligent terminals by server, for generating mixed reality scene；
The memory is used to store diagnosis and therapy recording, diagnosis and treatment suggestion and opinion；
The MR intelligent terminals are used to obtain physical context information, carry out physical environment modeling, generate physics environmental model,
And during medical data projected into physical environment model, obtain mixed reality scene；The MR intelligent terminals are additionally operable to pass through
Multiple control modes are consulted the medical data in mixed reality scene, edited, being arranged and statistical analysis；The MR intelligence
Terminal is additionally operable to carry out audio, video communication and resources sharing between each wearer.
Further, the MR intelligent terminals are MR intelligent glasses, including controller is logical also including what is be connected with controller
Letter module, optical projection module, input module, output module and operation module,
The controller is used to control to perform mixed reality interactive program；
The communication connection that the communication module is used between each MR intelligent glasses, is additionally operable to MR intelligent glasses and server
Between communication connection；
During the optical projection module is used to perform medical data projected into physical environment model, mixed reality is formed
Scape；
The input module, for being input into the data for controlling MR intelligent glasses；
The output module includes loudspeaker and display, is respectively used to exports audio signal, vision signal；
The operation module is used to obtain state, the state of the surrounding of MR intelligent glasses, the MR intelligence of MR intelligent glasses
The state and movable information of energy glasses wearer, and the information that will be sensed is sent to controller.
A kind of operating method of above-mentioned Telemedicine System, comprises the following steps：
Step one：MR intelligence is respectively provided with space where patient or local doctor and in diagnosis and treatment space where the doctor of distal end
Terminal, sets up communication connection between each MR intelligent terminals；
Step 2：Physical context information residing for MR intelligent terminal automatic identification wearers in each space, and carry out thing
Reason environmental modeling, generates physics environmental model；
Step 3：MR intelligent terminals in space where patient or local doctor connect EMR, PACS or LIS system of hospital
System, carries out data syn-chronization, the medical data required for getting the patient；
Step 4：Medical data is projected physical environment by MR intelligent terminals after calculation process in the form of hologram
In model, mixed reality scene is generated；
Step 5：MR intelligent terminals wearer realizes providing medical treatment in mixed reality scene by various control modes
The access of material, editor, arrange and statistical analysis, distal end doctor can be made to understand patient's details rapidly, so as to make precisely judgement.
Step 6：Carried out in real time or in message form by MR intelligent terminals between doctor and patient, between different doctors
Communication exchange.
Adopt with the aforedescribed process, hospital or medical institutions need not set up special remote medical consultation with specialists room and build the hardware of complexity
Environment, it is only necessary to carry out case history discussion and remote medical consultation with specialists by wearing MR intelligent terminals.But also with features such as wireless, mobiles,
Distal end doctor is carried out remote medical consultation with specialists and case history discussion whenever and wherever possible, greatly reduce time cost.Using line holographic projections technology, can
To break through the limitation in space, show more effective contents, it is to avoid expand more terminal presentation facilities.
Further, described physical context information includes wall, ground, ceiling, tables and chairs and special sign.
Further, described medical data include personal patient information, diagnosis and therapy recording, progress note, medical image and
Audit report.Above-mentioned various information can be presented in mixed reality scene and be supplied to doctor to refer to, and facilitate doctor to search
Medical data.
Further, doctor is after lookup data, data can be sorted out, statistics, analysis, the change of patient's state of an illness with
The pathological examinations such as inspection, inspection set up ocular connection, find out more effective therapeutic scheme.
Further, the control mode in step 5 include walking about, eye gaze, gesture operation and voice command.Pass through
Varied control mode being easily achieved realizes interacting for doctor and mixed reality scene, serves medical diagnosis or treatment.
Further, in step 5 to the access of medical data, editor, arrange and statistical analysis form includes browsing various
Information, the information classification that will be needed are concentrated, and mobile rotation scaling data, copy backup data, mark data of punctuating, collection are shared
Data and screenshotss video recording recording.
Further, described MR intelligent terminals can be presented the visual angle of other coupled intelligent terminals.Remotely assisting
Help treatment or operation during, each position guide doctor, by wearing MR intelligent terminals, check in surgical procedure with itself section
Not related real time data, and live doctor visual angle can be presented, carrying out real-time instruction with the doctor in same post exchanges.
Further, MR intelligent terminals are connected with memory, and the storage of diagnosis and therapy recording, diagnosis and treatment suggestion and opinion is in memory
It is interior.
Further, the mixed reality scene that the multiple MR intelligent terminals in the same space are seen carries out data automatically
Synchronous to merge, the mixed reality scene that each wearer sees on sense organ is identical.The uniformity of mixed reality scene is realized, is kept away
Exempt from various mixed reality scenes different doctor's diagnosis and treatment to be judged to bring interference and is influenceed.
Using above-mentioned technical proposal, including following beneficial effect：
1) hospital or medical institutions need not set up special remote medical consultation with specialists room and build the hardware environment of complexity, and cost is obtained
Greatly control, MR intelligent terminals are highly integrated on hardware, it is to avoid because compatibility is asked caused by the interaction operation of various hardware
Topic, while reducing maintenance cost.
2) MR intelligent terminals possess wirelessly, the feature such as mobile, make participation Cases Discussion and remote medical consultation with specialists doctor at any time with
Carry out the work, greatly reduce time cost, improve efficiency.Meanwhile, local doctor need to only wear MR intelligence eventually with distal end doctor
Hold and line, you can while carrying out facial diagnosis exchange to patient, local doctor and distal end doctor can share facial diagnosis picture, and mutually
Exchange.
Thus, it is possible to make to carry out at present and inactive but significant tele-medicine activity, into the growth of geometry times level,
So as to benefit many patients.
3) this programme uses line holographic projections technology, allows and instructs doctor on the spot in person, more intuitively carries out medical treatment guidance, breaks through
The limitation in space, shows more effective contents, it is to avoid expand more terminal presentation facilities.
4) each position guide doctor can whenever and wherever possible carry out the medical treatment guidance in this post, and exchange instruction in time；
5) during first aid, after field first aid personnel wear MR intelligent terminals, doctor's observable field condition is instructed, and live people
Member's then hand-free, takes measure of more effectively suing and labouring.
Brief description of the drawings
Fig. 1 is a kind of FB(flow block) of implementation method of telemedicine method of the present invention；
Fig. 2 is the communication structure connection diagram of Telemedicine System of the present invention；
Fig. 3 is the structured flowchart of MR intelligent glasses in the present invention；
In figure,
1st, server；2nd, hospital information system；3rd, memory；4th, MR intelligent terminals；401st, controller；402nd, communicate mould
Block；403rd, light projection module；404th, input module；405th, output module；406th, operation module；5th, display terminal.
Specific embodiment
The present invention is described in further detail below by specific embodiment.
All terms including including descriptive or technical term used herein should be interpreted as having this area
The implication that those of ordinary skill understands.However, intention, precedent or new technology according to those of ordinary skill in the art goes out
Existing, term can have different implications.In addition, some terms can be selected by applicant, and in the case, selected term
Implication will be described in detail in detailed description.So as to terms used herein must be based on the implication of term together with whole
Description in individual specification is defined.
In addition, when a part " including " or during one element of "comprising", unless there are specific descriptions in contrast, the otherwise portion
Part may also include other elements, however not excluded that other elements.In others description, the such as term of " module " and " module " etc
Refer to the unit for processing at least one function or operation, wherein module and module can be realized as hardware or software or can led to
Combination hardware and software is crossed to realize.
Embodiment can be realized in many different forms, and should not be construed as being limited to embodiment described herein；More
Exactly, there is provided these embodiments be in order that the disclosure will thoroughly and completely, and will be one or more realities
The design for applying example intactly conveys to those of ordinary skill in the art.In following description, it is not described in known
Function or construction, because they will obscure embodiment, and similar label in accompanying drawing whole with unnecessary details
All the time similar or similar element is represented in specification.
According to used herein, one or more any and institute that lists in project of the term "and/or" including association
There is combination.Whole element list is modified in the statement of such as "...... at least one" etc when before the list of element,
Without the individual element of volume in modification list.
Embodiment：
The invention provides a kind of Telemedicine System based on mixed reality technology, as shown in figure 1, including server 1,
Hospital information system 2, memory 3 and multiple MR intelligent terminals 4,
The server 1, connects the hospital information system 2, memory 3 and multiple MR intelligent terminals 4 respectively；
The hospital information system 2 include EMR, PACS system and LIS systems, the medical data for storing patient, and
The medical data is uploaded to MR intelligent terminals 4 by server 1, for generating mixed reality scene；
The memory 3 is used to store diagnosis and therapy recording, diagnosis and treatment suggestion and opinion；
The MR intelligent terminals 4 are used to obtain physical context information, carry out physical environment modeling, generate physical environment mould
Type, and medical data is projected into physical environment model, obtain mixed reality scene；The MR intelligent terminals 4 are additionally operable to
The medical data in mixed reality scene consulted by multiple control modes, is edited, being arranged and statistical analysis；The MR
Intelligent terminal 4 is additionally operable to carry out audio, video communication and resources sharing between each wearer.
In the above-described embodiment, the server 1 may also take on the form of the computing device of other identical functions
Instead of, it will be appreciated that substantially any computer architecture can be used without departing from the scope of this disclosure, in different embodiments
In, computing device can take mainframe computer, the computer of server 1, desktop computer, laptop computer, flat board to calculate
The form of machine, home entertaining computer, network computing device, mobile computing device, mobile communication equipment, game station etc..
As described above, in certain embodiments, server 1 can be integrated into MR intelligent terminals 4.
In the above-described embodiment, hospital information system 2 includes EMR, PACS system and LIS systems, but not limited to this, also
Can be the information system of other hospital internals, such as RIS systems, those skilled in the art can reproduce as needed skill
Conventional selection is carried out in art means.
To ensure the accuracy that technical term is used, above-mentioned portion of techniques term is explained as follows：
LIS：LIMS (Laboratory Information Management System), is special
It is a set of information management system that hospital laboratory is designed, patient samples can be stepped on laboratory apparatus and computer network consisting
Numerous and diverse operating process such as record, experimental data access, report examination ＆ verification, print and distribute, experimental data statistical analysis realize intelligence
Change, automate and standardized management.The holistic management level in laboratory is favorably improved, leak is reduced, quality inspection is improved.
PACS：Picture Archiving and Communication System (Picture archiving and communication
Systems), be developed rapidly recently as digital imaging technology, computer technology and improving for network technology,
It is intended to the integrated system of acquisition, display, storage, transmission and the management of comprehensively solve medical image.
RIS：Radiology Information System (Radioiogy information system), is optimization hospital radiological department work
Make the software systems of workflow management, typical flow include registration reservation, it is medical, produce image, slice, report, examination ＆ verification,
The links such as hair piece.
EMR：Electronic health record (Electronic Medical Record), refers to that traditional paper defects is gone through into completely electronicization,
And the management modes such as electronic storage, inquiry, statistics, data exchange are provided, it is information technology and network technology in medical field
The inevitable outcome of application, is the inexorable trend of hospital computer networkization management, change at present area research turned into one it is new
Focus is applied in research.
In the above-described embodiment, server 1 can also be connected with display terminal 5, can be for conventional with display work(
The terminal of energy.Such as smart mobile phone, panel computer or other.
In above-mentioned implementation, specifically, the MR intelligent terminals 4 are MR intelligent glasses, as shown in Fig. 2 including controller
401, also including be connected with controller 401 communication module 402, optical projection module, input module 404, output module 405 and
Operation module 406,
The controller 401 is used to control to perform mixed reality interactive program；
The communication connection that the communication module 402 is used between each MR intelligent glasses, is additionally operable to MR intelligent glasses with clothes
Communication connection between business device 1；
During the optical projection module is used to perform medical data projected into physical environment model, mixed reality is formed
Scape；
The input module 404, for being input into the data for controlling MR intelligent glasses；
The output module 405 includes loudspeaker and display, is respectively used to exports audio signal, vision signal；
The operation module 406 is used to obtain state, the state of the surrounding of MR intelligent glasses, the MR of MR intelligent glasses
The state and movable information of intelligent glasses wearer, and the information that will be sensed is sent to controller 401.
In the above-described embodiment, controller 401 generally controls the integrated operation of MR intelligent glasses.For example, controller
401 can by perform its internally stored program come generally controlled output module 405, input module 404, communication module 402,
Operation module 406 and light projection module 403.
When the use mode of operation of user is operated, controller 401 can obtain the user for dressing MR intelligent glasses
Movable information.The movable information of user may include in movement state information, motion velocity information and the positional information of user
It is at least one.
At least one sensor or element that the operation module 406 that controller 401 can be based in MR intelligent glasses includes
Determine whether user dresses MR intelligent glasses, and when it is determined that user dresses MR intelligent glasses, controller 401 can be obtained
The movable information of user.
Controller 401 also can by based on measured using MR intelligent glasses walk about, eye gaze, gesture operation and language
At least one analysis user's of sound order moves to obtain the movable information or input information of user.
Controller 401 can be based on user movable information or input information determine to provide it is corresponding with mode of operation for
The concrete operations of mixed reality scene.
Controller 401 is contemplated that the environmental information on the environment in the specific range from MR intelligent glasses to determine
Content of announcement is output as at least one of audio signal or vision signal.Environmental information may include on from MR Brilliant Eyes
The external voice information of the sound of generation and the external image on being obtained using high-definition camera in the specific range that mirror rises
At least one of information.
In the above-described embodiment, communication module 402 may include to enable MR intelligent glasses with external equipment or service
At least one component of the communication of device 1.For example, communication module 402 may include short-range wireless communication module 402, mobile communication module
402 (such as GPRS) and broadcast receiving circuit module.Short-range wireless communication module 402 can for bluetooth, NFC, Wi-Fi, purple honeybee,
Any one or a few in IrDA, WFD, UWB and Ant+, but not limited to this.
Communication module 402 can be asked from the external equipment for being connected to MR intelligent glasses and receive the movable information of user.It is logical
Letter module 402 can to external equipment send using MR intelligent glasses measure walk about, eye gaze, gesture operation and voice
The movable information of user is asked while command information etc..
In the above-described embodiment, input module 404 can be motion input, touch input, key input, phonetic entry and
At least one of multiple input, but not limited to this.For example, input mode may include the given zone of the framework for touching glasses
The input in domain, the input of button for selecting the framework of glasses to include, speech sound input, come back motion input etc.,
But not limited to this.The specific region of the framework of glasses can be set in advance.
In the above-described embodiment, the output module 405 is used for exports audio signal, vision signal or vibration letter
Number, and display, loudspeaker and vibrator are may include, but it is not limited to this.
In the above-described embodiment, described operation module 406 may include microphone, inertia measurement sensor, environment sense
Know at least one in camera, high-definition camera, depth of field camera, mixed reality seizure module, eye tracking sensor, but operation
The component not limited to this that module 406 includes.Operation module 406 may also include temperature sensor, luminance sensor, pressure sensing
Device or iris scan sensor, Magnetic Sensor, acceleration transducer, inclination sensor, depth transducer, gyro sensor,
Position sensor.Because the function of each sensor or component can intuitively be pushed away by those of ordinary skill in the art based on its title
It is disconnected, so not describing its details here.
A kind of telemedicine method based on mixed reality technology, as shown in figure 3, comprising the following steps：
S101：MR intelligence is respectively provided with space where patient or local doctor and in diagnosis and treatment space where the doctor of distal end eventually
End 4, sets up communication connection between each MR intelligent terminals 4；
S102：Physical context information residing for the automatic identification wearer of MR intelligent terminals 4 in each space, and carry out physics
Environmental modeling, generates physics environmental model；
S103：The connection of MR intelligent terminals 4 hospital EMR, PACS or LIS system, carries out data syn-chronization, gets the patient institute
The medical data of needs；
S104：Medical data is projected physical environment by MR intelligent terminals 4 after calculation process in the form of hologram
In model, mixed reality scene is generated；
S105：The wearer of MR intelligent terminals 4 is realized to medical data in mixed reality scene by multiple control modes
Access, editor, arrange and statistical analysis.
S106：Ditch is carried out by MR intelligent terminals 4 in real time or in message form between doctor and patient, between different doctors
Logical exchange.
In the above-described embodiment, MR intelligent terminals 4 can be MR intelligent glasses, you can wearing glasses, are to be worn on
With in the display device of the drawing axis of user offer image on the head of user.Present inventive concept is not limited to that glasses type is wearable to be set
It is standby, but head mounted display (HMD) device based on MR technologies is equally applicable to, a part for its main body is fixed to user's
Head is with the display information in the visual angle of user.It is various forms to be capable of achieving, for example, HMD devices can realize for glasses, the helmet and
Cap, but not limited to this.
In the above-described embodiment, in S101, the communication mode between each MR intelligent terminals 4 can be each in the prior art
Ripe communication connection mode is planted, can be wired connection, WIFI connections, bluetooth connection, NFC connections, mobile communication connection, gone back
Can be to be indirectly connected with by server 1, but not limited to this.
In the above-described embodiment, described physical context information includes wall, ground, ceiling, tables and chairs and special mark
Show, but not limited to this.
In the above-described embodiment, described medical data includes personal patient information, diagnosis and therapy recording, progress note, doctor
Learn image and audit report, but not limited to this.
In the above-described embodiment, the control mode in step 5 include walk about, eye gaze, gesture operation and voice life
Order, but not limited to this.
In the above-described embodiment, in step 5 to the access of medical data, editor, arrange and statistical analysis form includes
The information classification that browse various information, will need is concentrated, mobile rotation scaling data, copy backup data, mark data of punctuating,
Collection sharing data and screenshotss video recording recording, but not limited to this.
In the above-described embodiment, described MR intelligent terminals 4 can be presented the visual angle of other coupled intelligent terminals.
During remote assistance is treated or is performed the operation, each position guide doctor, by wearing MR intelligent terminals 4, checks surgical procedure
In the real time data related to itself department, and live doctor visual angle can be presented, the doctor with same post carries out real-time instruction friendship
Stream.
In the above-described embodiment, MR intelligent terminals 4 are connected with memory 3, the storage of diagnosis and therapy recording, diagnosis and treatment suggestion and opinion
In memory 3.Certainly described memory 3 can be user-defined personalized memory 3, such as in server 1
Memory cell, high in the clouds memory 3 or other, can also be the memory 3 being arranged in MR intelligent terminals 4.
In the above-described embodiment, the mixed reality scene that the multiple MR intelligent terminals 4 in the same space are seen is certainly
Dynamic to carry out data syn-chronization merging, the mixed reality scene that each wearer sees on sense organ is identical.In the same space
Multiple equipment of MR intelligent terminals 4 set up unified space physics model, when certain wearer is to space by space identity technology
In mixed reality scene operated after, the last state data of mixed reality scene will be distributed to it by server 1
His equipment of MR intelligent terminals 4, these equipment according to status data is received, modify by the mixed reality scene to itself, with
Realize the uniformity of mixed reality scene, it is to avoid various mixed reality scenes judge different doctor's diagnosis and treatment to bring interference and shadow
Ring.
The concrete application scene of the Telemedicine System in above-mentioned implementation method can be remote medical consultation with specialists, long-range facial diagnosis, remote
Cheng Shoushu and remote assistance first aid etc..
For example, after remote medical consultation with specialists is initiated, doctor or the wearable intelligent glasses for possessing MR functions of sufferer or similar terminal
Equipment participates in remote medical consultation with specialists, and conventional remote medical consultation with specialists equipment can also be connected in the system.MR intelligent terminals 4 can automatic identification
Physical environment residing for wearer simultaneously carries out physical environment modeling.Meanwhile, MR intelligent terminals 4 can be from hospital's EMR, PACS, LIS system
In synchronous data, the data required for getting remote medical consultation with specialists, and combine physics environmental model, with the form of hologram,
(projection) is placed in physical environment.The modes such as wearer is walked about by itself, eye gaze, gesture operation, voice command, behaviour
Make holographic object, realize for example：Case history is browsed, medical image, mobile rotation scaling data is checked, data is sorted out and exhibition is concentrated
Show, copy backup data, mark data of punctuating, collection sharing data, screenshotss video recording recording etc. interactive operation.MR intelligent terminals 4
Understand the image that seen wearer, the sound for being sent, the operating process for being carried out and result, Real-Time Sharing gives other with meeting
People.These content decapacitation show outer in the MR intelligent terminals 4 of other wearers, it is also possible in traditional electronic equipment (such as electricity
Brain, mobile phone, flat board etc.) in be shown.By the image-sound systems of MR intelligent terminals 4, wearer is carried out with other personnels participating in the meeting
Real-time video speech exchange.Can also receive the image that other personnels participating in the meeting are transmitted by MR or other equipment simultaneously.Attend a meeting
The consultation of doctors opinions or suggestions that person produces during the consultation of doctors, by after encryption, by safe lane, the cloud of real-time synchronization to system
End carries out safe storage.Meanwhile, MR intelligent terminals 4 itself can preserve consultation note, and check offline.
Again for example, when long-range facial diagnosis is needed, doctor need to only wear MR intelligent terminals 4, you can carry out facial diagnosis friendship with patient
Stream, meanwhile, facial diagnosis picture also can in real time pass to distal end expert physician, and receive its guidance.
Again for example, during remote operation, by the panoramic imaging techniques of MR intelligent terminals 4, allowing and instructing doctor to be in
In operating room, operating room whole progress is grasped totally；Each position guide doctor, by wearing MR intelligent terminals 4, checks and performed the operation
The real time data related to itself department in journey, and can be live doctor visual angle, the doctor with same post by itself visual angle effect
Carry out real-time instruction exchange.
Again for example, when emergency situations occur, field first aid personnel wear MR intelligent terminals 4 and carry out first aid, instruct doctor
By oneself MR intelligent terminals 4 or other mobile devices, field first aid personnel visual angle is can switch to, observation first aid is live, and
Give salvage suggestion.
The preferred embodiments of the present invention are the foregoing is only, is not intended to limit the invention, for the skill of this area
For art personnel, the present invention can have various modifications and variations.It is all within the spirit and principles in the present invention, made any repair
Change, equivalent, improvement etc., should be included within the scope of the present invention.
Claims (10)
1. a kind of Telemedicine System based on mixed reality technology, it is characterised in that including：Server (1), information for hospital system
System (2), memory (3) and multiple MR intelligent terminals (4),
The server, connects the hospital information system, memory and multiple MR intelligent terminals respectively；
The hospital information system includes EMR, PACS system and LIS systems, the medical data for storing patient, and incites somebody to action described
Medical data is uploaded to MR intelligent terminals by server, for generating mixed reality scene；
The memory is used to store diagnosis and therapy recording, diagnosis and treatment suggestion and opinion；
The MR intelligent terminals are used to obtain physical context information, carry out physical environment modeling, generate physics environmental model, and
During medical data projected into physical environment model, mixed reality scene is obtained；The MR intelligent terminals are additionally operable to by various
Control mode is consulted the medical data in mixed reality scene, edited, being arranged and statistical analysis；The MR intelligent terminals
It is additionally operable to carry out audio, video communication and resources sharing between each wearer.
2. Telemedicine System according to claim 1, it is characterised in that the MR intelligent terminals are MR intelligent glasses,
Including controller (401), also communication module (402), optical projection module (403), input module including being connected with controller
(404), output module (405) and operation module (406),
The controller is used to control to perform mixed reality interactive program；
The communication connection that the communication module is used between each MR intelligent glasses, is additionally operable between MR intelligent glasses and server
Communication connection；
During the optical projection module is used to perform medical data projected into physical environment model, mixed reality scene is formed；
The input module, for being input into the data for controlling MR intelligent glasses；
The output module includes loudspeaker and display, is respectively used to exports audio signal, vision signal；
The operation module is used to obtain state, the state of the surrounding of MR intelligent glasses, the MR Brilliant Eyes of MR intelligent glasses
The state and movable information of mirror wearer, and the information that will be sensed is sent to controller.
3. the operating method of the Telemedicine System described in a kind of claim 1 or 2, it is characterised in that comprise the following steps：
Step one：MR intelligence is respectively provided with space where patient or local doctor and in diagnosis and treatment space where the doctor of distal end eventually
End, sets up communication connection between each MR intelligent terminals；
Step 2：Physical context information residing for MR intelligent terminal automatic identification wearers in each space, and carry out physical rings
Border models, and generates physics environmental model；
Step 3：MR intelligent terminals in space where patient or local doctor connect EMR, PACS or LIS system of hospital, enter
Row data syn-chronization, the medical data required for getting above-mentioned patient；
Step 4：Medical data is projected physical environment model by MR intelligent terminals after calculation process in the form of hologram
In, generate mixed reality scene；
Step 5：MR intelligent terminals wearer realizes looking into medical data in mixed reality scene by multiple control modes
Read, edit, arranging and statistical analysis.
Step 6：Linked up in real time or in message form by MR intelligent terminals between doctor and patient, between different doctors
Exchange.
4. the operating method of Telemedicine System according to claim 4, it is characterised in that described physical context information
Including wall, ground, ceiling, tables and chairs and special sign.
5. the operating method of Telemedicine System according to claim 4, it is characterised in that described medical data includes
Personal patient information, diagnosis and therapy recording, progress note, medical image and audit report.
6. the operating method of Telemedicine System according to claim 4, it is characterised in that the control mode in step 5
Including walking about, eye gaze, gesture operation and voice command.
7. the operating method of Telemedicine System according to claim 4, it is characterised in that to medical data in step 5
Access, editor, arrange and statistical analysis form includes that the information classification that browse various information, will need is concentrated, mobile rotation
Scaling data, copy backup data, mark data of punctuating, collection sharing data and screenshotss video recording recording.
8. the operating method of the Telemedicine System according to any one of claim 3~7, it is characterised in that described MR
Intelligent terminal can be presented the visual angle of other coupled intelligent terminals.
9. the operating method of Telemedicine System according to claim 3, it is characterised in that MR intelligent terminals are connected with to be deposited
Reservoir, the storage of diagnosis and therapy recording, diagnosis and treatment suggestion and opinion is in memory.
10. the operating method of Telemedicine System according to claim 3, it is characterised in that in the same space
The mixed reality scene that multiple MR intelligent terminals are seen carries out data syn-chronization merging automatically, what each wearer saw on sense organ
Mixed reality scene is identical.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710056916.2A CN106845120A (en) | 2017-01-19 | 2017-01-19 | A kind of Telemedicine System and its operating method based on mixed reality technology |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710056916.2A CN106845120A (en) | 2017-01-19 | 2017-01-19 | A kind of Telemedicine System and its operating method based on mixed reality technology |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106845120A true CN106845120A (en) | 2017-06-13 |
Family
ID=59121870
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710056916.2A Pending CN106845120A (en) | 2017-01-19 | 2017-01-19 | A kind of Telemedicine System and its operating method based on mixed reality technology |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106845120A (en) |
Cited By (29)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107368697A (en) * | 2017-08-30 | 2017-11-21 | 上海联影医疗科技有限公司 | The virtual reality control system and method for Medical Devices |
| CN107391928A (en) * | 2017-07-20 | 2017-11-24 | 上海联影医疗科技有限公司 | Data processing method, terminal and the system virtually held a consultation |
| CN108742898A (en) * | 2018-06-12 | 2018-11-06 | 中国人民解放军总医院 | Tooth-planting navigation system based on mixed reality |
| CN109462637A (en) * | 2018-10-17 | 2019-03-12 | 广东电网有限责任公司 | MR expert's remote collaboration method and system based on power equipment 3D model library |
| CN109659024A (en) * | 2018-12-12 | 2019-04-19 | 黑龙江拓盟科技有限公司 | A kind of remote diagnosis method of MR auxiliary |
| CN109801701A (en) * | 2017-11-17 | 2019-05-24 | 西门子医疗有限公司 | Control the method and operating system with the medical technology facility of movable-component |
| CN109935313A (en) * | 2019-03-04 | 2019-06-25 | 苏州达辰医疗科技有限公司 | The medical application of three-dimensional visualization and mixed reality |
| CN110062007A (en) * | 2019-05-17 | 2019-07-26 | 中车资阳机车有限公司 | A kind of Locomotive remote maintenance service system and method based on mixed reality technology |
| CN110111875A (en) * | 2019-03-19 | 2019-08-09 | 北京缙铖医疗科技有限公司 | A kind of MR Telemedicine System |
| CN110289630A (en) * | 2018-10-25 | 2019-09-27 | 国网天津市电力公司客户服务中心 | Distributed energy simulation control subsystem and its operating method based on mixed reality scene in unmanned business hall |
| WO2019207371A1 (en) * | 2018-04-27 | 2019-10-31 | International Business Machines Corporation | Augmented reality presentation associated with a patient's medical condition and/or treatment |
| CN110442486A (en) * | 2019-08-05 | 2019-11-12 | 北京远舢智能科技有限公司 | A kind of remote device diagnostics system and method based on mixed reality technology |
| CN110478051A (en) * | 2019-08-30 | 2019-11-22 | 深圳市汇健医疗工程有限公司 | Digital composite operating room holographic projection system |
| CN111144202A (en) * | 2019-11-14 | 2020-05-12 | 北京海益同展信息科技有限公司 | Object control method, device and system, electronic equipment and storage medium |
| CN111210911A (en) * | 2020-01-15 | 2020-05-29 | 于金明 | Radiotherapy external irradiation auxiliary diagnosis and treatment system based on virtual intelligent medical platform |
| CN111553974A (en) * | 2020-04-21 | 2020-08-18 | 北京金恒博远科技股份有限公司 | Data visualization remote assistance method and system based on mixed reality |
| CN111613280A (en) * | 2020-04-14 | 2020-09-01 | 上海九想数字科技有限公司 | H.I.P.S multi-point touch propaganda and education interaction system for medical treatment |
| CN111882676A (en) * | 2020-08-04 | 2020-11-03 | 杭州东方通信软件技术有限公司 | Remote monitoring support system and monitoring support method |
| CN112259255A (en) * | 2019-07-22 | 2021-01-22 | 阿尔法(广州)远程医疗科技有限公司 | Remote consultation system capable of carrying out holographic projection |
| CN112566578A (en) * | 2018-06-19 | 2021-03-26 | 托尼尔公司 | Mixed reality assisted teaching using virtual models or virtual representations for orthopedic surgery |
| CN112635070A (en) * | 2020-12-14 | 2021-04-09 | 创业慧康科技股份有限公司 | Patient clinical information acquisition and display method and device |
| CN112802596A (en) * | 2021-02-06 | 2021-05-14 | 上海集迈实业有限公司 | Digital operating room safety door control management system |
| CN112992381A (en) * | 2021-03-10 | 2021-06-18 | 张志宏 | MR (magnetic resonance) collaborative sharing communication system for surgical diagnosis and treatment |
| CN113284597A (en) * | 2021-07-23 | 2021-08-20 | 杭州乾瑾科技有限公司 | Critical MDT system and method based on scene fusion and MR |
| CN113299129A (en) * | 2021-05-14 | 2021-08-24 | 吉林师范大学 | Education and teaching multimedia system based on internet |
| WO2021164362A1 (en) * | 2020-02-21 | 2021-08-26 | Shanghai United Imaging Intelligence Co., Ltd. | Systems and methods for automated healthcare services |
| CN113705278A (en) * | 2020-05-20 | 2021-11-26 | 深圳市看见智能科技有限公司 | Human behavior recognition system and method for intelligent glasses |
| CN113888723A (en) * | 2021-09-30 | 2022-01-04 | 创业慧康科技股份有限公司 | Ultrahigh-definition diagnosis-level medical data MR panoramic display system and method |
| CN113995525A (en) * | 2021-11-05 | 2022-02-01 | 无锡蓝软智能医疗科技有限公司 | Medical scene synchronous operation system capable of switching visual angles and based on mixed reality and storage medium |
Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101681455A (en) * | 2007-04-23 | 2010-03-24 | 三星电子株式会社 | Remote medical-diagnosis system and method |
| CN202502499U (en) * | 2012-03-02 | 2012-10-24 | 杨德文 | Medical image processing system in remote medical treatment consultation |
| CN103479362A (en) * | 2013-09-05 | 2014-01-01 | 南京邮电大学 | Motor function rehabilitation monitoring system based on wireless body area network |
| CN104166953A (en) * | 2014-08-06 | 2014-11-26 | 深圳市锦雅电子数码科技有限公司 | Medical nursing system based on intelligent mobile terminal |
| CN104345147A (en) * | 2014-09-03 | 2015-02-11 | 郑彦博 | Portable medical blood glucose detecting system with code scanner |
| US20150350517A1 (en) * | 2014-05-27 | 2015-12-03 | François Duret | Device for visualizing an interior of a patient's mouth |
| CN205569609U (en) * | 2016-04-22 | 2016-09-14 | 吴宗明 | Virtual reality body -building system |
| CN205581784U (en) * | 2016-04-14 | 2016-09-14 | 江苏华博创意产业有限公司 | Can mix real platform alternately based on reality scene |
| CN106066700A (en) * | 2016-06-29 | 2016-11-02 | 宁波市电力设计院有限公司 | Electric power industry based on MR technology expands engineering aid system and method for work thereof |
| CN106109015A (en) * | 2016-08-18 | 2016-11-16 | 秦春晖 | A kind of wear-type medical system and operational approach thereof |
| CN106126917A (en) * | 2016-06-22 | 2016-11-16 | 扬州立兴科技发展合伙企业（有限合伙） | A kind of remote diagnosis system based on virtual reality technology |
| CN205750782U (en) * | 2016-04-27 | 2016-11-30 | 上海芝麻开花医疗科技有限公司 | Telemedicine System based on intelligent glasses |
| CN106295189A (en) * | 2016-08-12 | 2017-01-04 | 上海鸿巍企业管理咨询有限公司 | A kind of visualization operation whole process integral system |
-
2017
- 2017-01-19 CN CN201710056916.2A patent/CN106845120A/en active Pending
Patent Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101681455A (en) * | 2007-04-23 | 2010-03-24 | 三星电子株式会社 | Remote medical-diagnosis system and method |
| CN202502499U (en) * | 2012-03-02 | 2012-10-24 | 杨德文 | Medical image processing system in remote medical treatment consultation |
| CN103479362A (en) * | 2013-09-05 | 2014-01-01 | 南京邮电大学 | Motor function rehabilitation monitoring system based on wireless body area network |
| US20150350517A1 (en) * | 2014-05-27 | 2015-12-03 | François Duret | Device for visualizing an interior of a patient's mouth |
| CN104166953A (en) * | 2014-08-06 | 2014-11-26 | 深圳市锦雅电子数码科技有限公司 | Medical nursing system based on intelligent mobile terminal |
| CN104345147A (en) * | 2014-09-03 | 2015-02-11 | 郑彦博 | Portable medical blood glucose detecting system with code scanner |
| CN205581784U (en) * | 2016-04-14 | 2016-09-14 | 江苏华博创意产业有限公司 | Can mix real platform alternately based on reality scene |
| CN205569609U (en) * | 2016-04-22 | 2016-09-14 | 吴宗明 | Virtual reality body -building system |
| CN205750782U (en) * | 2016-04-27 | 2016-11-30 | 上海芝麻开花医疗科技有限公司 | Telemedicine System based on intelligent glasses |
| CN106126917A (en) * | 2016-06-22 | 2016-11-16 | 扬州立兴科技发展合伙企业（有限合伙） | A kind of remote diagnosis system based on virtual reality technology |
| CN106066700A (en) * | 2016-06-29 | 2016-11-02 | 宁波市电力设计院有限公司 | Electric power industry based on MR technology expands engineering aid system and method for work thereof |
| CN106295189A (en) * | 2016-08-12 | 2017-01-04 | 上海鸿巍企业管理咨询有限公司 | A kind of visualization operation whole process integral system |
| CN106109015A (en) * | 2016-08-18 | 2016-11-16 | 秦春晖 | A kind of wear-type medical system and operational approach thereof |
Cited By (37)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107391928A (en) * | 2017-07-20 | 2017-11-24 | 上海联影医疗科技有限公司 | Data processing method, terminal and the system virtually held a consultation |
| CN107368697B (en) * | 2017-08-30 | 2020-09-22 | 上海联影医疗科技有限公司 | Virtual reality control system and method for medical equipment |
| CN107368697A (en) * | 2017-08-30 | 2017-11-21 | 上海联影医疗科技有限公司 | The virtual reality control system and method for Medical Devices |
| CN109801701A (en) * | 2017-11-17 | 2019-05-24 | 西门子医疗有限公司 | Control the method and operating system with the medical technology facility of movable-component |
| CN109801701B (en) * | 2017-11-17 | 2023-08-15 | 西门子医疗有限公司 | Method and operating system for controlling a medical facility with a movable component |
| GB2587098A (en) * | 2018-04-27 | 2021-03-17 | Ibm | Augmented reality presentation associated with a patient's medical condition and/or treatment |
| CN112041939A (en) * | 2018-04-27 | 2020-12-04 | 国际商业机器公司 | Augmented reality representations associated with patient medical conditions and/or treatments |
| WO2019207371A1 (en) * | 2018-04-27 | 2019-10-31 | International Business Machines Corporation | Augmented reality presentation associated with a patient's medical condition and/or treatment |
| CN108742898A (en) * | 2018-06-12 | 2018-11-06 | 中国人民解放军总医院 | Tooth-planting navigation system based on mixed reality |
| CN112566579A (en) * | 2018-06-19 | 2021-03-26 | 托尼尔公司 | Multi-user collaboration and workflow techniques for orthopedic surgery using mixed reality |
| CN112566578A (en) * | 2018-06-19 | 2021-03-26 | 托尼尔公司 | Mixed reality assisted teaching using virtual models or virtual representations for orthopedic surgery |
| CN109462637A (en) * | 2018-10-17 | 2019-03-12 | 广东电网有限责任公司 | MR expert's remote collaboration method and system based on power equipment 3D model library |
| CN110289630A (en) * | 2018-10-25 | 2019-09-27 | 国网天津市电力公司客户服务中心 | Distributed energy simulation control subsystem and its operating method based on mixed reality scene in unmanned business hall |
| CN109659024A (en) * | 2018-12-12 | 2019-04-19 | 黑龙江拓盟科技有限公司 | A kind of remote diagnosis method of MR auxiliary |
| CN109935313A (en) * | 2019-03-04 | 2019-06-25 | 苏州达辰医疗科技有限公司 | The medical application of three-dimensional visualization and mixed reality |
| CN110111875A (en) * | 2019-03-19 | 2019-08-09 | 北京缙铖医疗科技有限公司 | A kind of MR Telemedicine System |
| CN110062007A (en) * | 2019-05-17 | 2019-07-26 | 中车资阳机车有限公司 | A kind of Locomotive remote maintenance service system and method based on mixed reality technology |
| CN112259255A (en) * | 2019-07-22 | 2021-01-22 | 阿尔法(广州)远程医疗科技有限公司 | Remote consultation system capable of carrying out holographic projection |
| CN110442486A (en) * | 2019-08-05 | 2019-11-12 | 北京远舢智能科技有限公司 | A kind of remote device diagnostics system and method based on mixed reality technology |
| CN110478051A (en) * | 2019-08-30 | 2019-11-22 | 深圳市汇健医疗工程有限公司 | Digital composite operating room holographic projection system |
| CN111144202A (en) * | 2019-11-14 | 2020-05-12 | 北京海益同展信息科技有限公司 | Object control method, device and system, electronic equipment and storage medium |
| CN111144202B (en) * | 2019-11-14 | 2023-11-07 | 京东科技信息技术有限公司 | Object control method, device and system, electronic equipment and storage medium |
| CN111210911A (en) * | 2020-01-15 | 2020-05-29 | 于金明 | Radiotherapy external irradiation auxiliary diagnosis and treatment system based on virtual intelligent medical platform |
| WO2021164362A1 (en) * | 2020-02-21 | 2021-08-26 | Shanghai United Imaging Intelligence Co., Ltd. | Systems and methods for automated healthcare services |
| US11475997B2 (en) | 2020-02-21 | 2022-10-18 | Shanghai United Imaging Intelligence Co., Ltd. | Systems and methods for automated healthcare services |
| CN111613280A (en) * | 2020-04-14 | 2020-09-01 | 上海九想数字科技有限公司 | H.I.P.S multi-point touch propaganda and education interaction system for medical treatment |
| CN111613280B (en) * | 2020-04-14 | 2023-04-28 | 上海九想数字科技有限公司 | H.I.P.S multi-touch teaching interaction system for medical treatment |
| CN111553974A (en) * | 2020-04-21 | 2020-08-18 | 北京金恒博远科技股份有限公司 | Data visualization remote assistance method and system based on mixed reality |
| CN113705278A (en) * | 2020-05-20 | 2021-11-26 | 深圳市看见智能科技有限公司 | Human behavior recognition system and method for intelligent glasses |
| CN111882676A (en) * | 2020-08-04 | 2020-11-03 | 杭州东方通信软件技术有限公司 | Remote monitoring support system and monitoring support method |
| CN112635070A (en) * | 2020-12-14 | 2021-04-09 | 创业慧康科技股份有限公司 | Patient clinical information acquisition and display method and device |
| CN112802596A (en) * | 2021-02-06 | 2021-05-14 | 上海集迈实业有限公司 | Digital operating room safety door control management system |
| CN112992381A (en) * | 2021-03-10 | 2021-06-18 | 张志宏 | MR (magnetic resonance) collaborative sharing communication system for surgical diagnosis and treatment |
| CN113299129A (en) * | 2021-05-14 | 2021-08-24 | 吉林师范大学 | Education and teaching multimedia system based on internet |
| CN113284597A (en) * | 2021-07-23 | 2021-08-20 | 杭州乾瑾科技有限公司 | Critical MDT system and method based on scene fusion and MR |
| CN113888723A (en) * | 2021-09-30 | 2022-01-04 | 创业慧康科技股份有限公司 | Ultrahigh-definition diagnosis-level medical data MR panoramic display system and method |
| CN113995525A (en) * | 2021-11-05 | 2022-02-01 | 无锡蓝软智能医疗科技有限公司 | Medical scene synchronous operation system capable of switching visual angles and based on mixed reality and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106845120A (en) | A kind of Telemedicine System and its operating method based on mixed reality technology | |
| US11478310B2 (en) | Virtual guidance for ankle surgery procedures | |
| US9645785B1 (en) | Heads-up displays for augmented reality network in a medical environment | |
| CN109464195A (en) | Double mode augmented reality surgical system and method | |
| JP2021500690A (en) | Self-expanding augmented reality-based service instruction library | |
| WO2012081194A1 (en) | Medical-treatment assisting apparatus, medical-treatment assisting method, and medical-treatment assisting system | |
| CN107613897A (en) | The surgical navigation of augmented reality | |
| KR20190004088A (en) | Virtual Reality Education System and Method based on Bio Sensors | |
| CN205644372U (en) | Can replace intelligent wearing equipment of module | |
| US20210335483A1 (en) | Surgery visualization theatre | |
| CN106846496A (en) | DICOM images based on mixed reality technology check system and operating method | |
| CN111403022B (en) | Application method of medical movable split type control system | |
| WO2021226134A1 (en) | Surgery visualization theatre | |
| Aloqaily et al. | Digital twin for healthcare immersive services: Fundamentals, architectures, and open issues | |
| KR20210131061A (en) | Medical surgery and procedure guidance system using 3D virtual reality | |
| Li et al. | The next generation of healthcare ecosystem in the metaverse | |
| Mozumder et al. | The metaverse for intelligent healthcare using XAI, blockchain, and immersive technology | |
| US11611705B1 (en) | Smart glasses with augmented reality capability for dentistry | |
| JP2019133270A (en) | Computer program, assistance device, and assistance method | |
| CN105718036B (en) | The information interacting method and system of wearable device | |
| Mamdouh et al. | Improve speed real-time rendering in mixed reality HOLOLENS during training | |
| US20240127931A1 (en) | Surgery visualization theatre | |
| Shimpi | Vis2Go: exploring the effect of immersive analytics for on-the-Go decision making | |
| Sharma et al. | Virtual Reality: Robotic Improved Surgical Precision Using AI Techniques | |
| CN118160044A (en) | Customization of overlay data and configuration |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170613 |