CN109061892A - Plastic surgery medical image Model Reconstruction interacts naked-eye stereoscopic display system and method - Google Patents
Plastic surgery medical image Model Reconstruction interacts naked-eye stereoscopic display system and method Download PDFInfo
- Publication number
- CN109061892A CN109061892A CN201811132717.6A CN201811132717A CN109061892A CN 109061892 A CN109061892 A CN 109061892A CN 201811132717 A CN201811132717 A CN 201811132717A CN 109061892 A CN109061892 A CN 109061892A
- Authority
- CN
- China
- Prior art keywords
- reconstruction
- medical image
- data
- model
- plastic surgery
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B30/00—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B23/00—Models for scientific, medical, or mathematical purposes, e.g. full-sized devices for demonstration purposes
- G09B23/28—Models for scientific, medical, or mathematical purposes, e.g. full-sized devices for demonstration purposes for medicine
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H30/00—ICT specially adapted for the handling or processing of medical images
- G16H30/40—ICT specially adapted for the handling or processing of medical images for processing medical images, e.g. editing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2210/00—Indexing scheme for image generation or computer graphics
- G06T2210/41—Medical
Abstract
Naked-eye stereoscopic display system disclosed by the invention, including medical image data import modul, reconstructing three-dimensional model module, human-computer interaction device, server and naked eye 3D display module, the medical image data of importing is carried out preoperative cast reconstruction by reconstructing three-dimensional model module, with d engine to the preoperative cast of reconstruction, be subject to patient's preoperative cast and patient select effect shaping model comparison, modification, design；Cook up the threedimensional model of postoperative effect and the implementation model at plastic operation position；Operation is simulated with preoperative cast of the d engine to reconstruction；Server receives interactive operation data and according to the threedimensional model location information of virtual hand, the threedimensional model location information of surgical instrument and the preoperative cast for updating reconstruction in interactive operation data real-time update simulated scenario.The system can help doctor to better grasp operation main points, and doctor and patient can be seen postoperative 3D effect with naked eye, have certain foresight, can reduce medical tangle.
Description
Technical field
The present invention relates to naked eye 3D display systems technology fields, and in particular to a kind of plastic surgery medical image Model Reconstruction
The naked-eye stereoscopic display system and method for interaction.
Background technique
With the raising of quality of life level, requirement of the people to figure and features is also higher and higher, due to congenital sexual function and outside
Defect in terms of shape, or because figure and features caused by the reasons such as traffic accident, wound, tumour is bad and the reasons such as beauty, select whole
Shape surgery is more and more come the people for improving figure and features defect.Design and method in plastic surgery operations are practised by surgeon individual
The subjective factors such as used, experience influence, and effect does not have foresight, and random and blindness is larger, while still a medical treatment is entangled
Confused high-incidence subject.With the development of computer technology, the application of three-dimensional simulation and reconstruction technique in plastic surgery is also more next
It is more extensive, it is necessary to which that the operating process and postoperative result of plastic operation can be watched by constructing one without wearing VR equipment
System.
Summary of the invention
For the defects in the prior art, one of the objects of the present invention is to provide a kind of plastic surgery medical image models
The naked-eye stereoscopic display system for rebuilding interaction carries out reconstructing three-dimensional model by the medical image to patient, constructs shaping position
Threedimensional model, doctor interacted by human-computer interaction device and the shaping position in virtual scene, and doctor and patient are not necessarily to
Wear VR equipment can direct viewing cosmetic surgery procedures, have certain foresight to surgical effect, reduce medical tangle.
In a first aspect, a kind of naked eye of plastic surgery medical image Model Reconstruction interaction provided in an embodiment of the present invention is three-dimensional
Display system, including medical image data import modul, reconstructing three-dimensional model module, human-computer interaction device, server and naked eye
3D display module, the medical image data import modul is for obtaining plastic surgery medical image data；The threedimensional model
It rebuilds module and the medical image data of importing is carried out preoperative cast reconstruction, preoperative cast, patient with d engine to reconstruction
Preoperative cast and patient select comparison, modification, the design of the shaping model of effect, cook up the threedimensional model of postoperative effect with it is whole
The implementation model of shape operative site；With d engine to the threedimensional model of virtual operation instrument and the threedimensional model counterweight of virtual hand
The preoperative cast built carries out simulation operation；The human-computer interaction device for realizing operator and system interactive operation, it is man-machine
Interactive operation data are sent server by interactive device；The server receives interactive operation data and according to interactive operation number
According to the threedimensional model location information of virtual hand, the threedimensional model location information of surgical instrument and update in real-time update simulated scenario
The preoperative cast of reconstruction, and idsplay order is sent to naked eye 3D display module；The naked eye 3D display module is for receiving and holding
The row idsplay order shows the threedimensional model in virtual scene, shows that the process of simulated plastic surgery and simulation are performed the operation
The effect arrived.
Optionally, system further includes virtual operation evaluation module, and the virtual operation evaluation module is used for according to patient's
The risk for the recruitment evaluation operation that case history and simulated plastic surgery obtain.
Optionally, system further includes consultation of doctor module, and the consultation of doctor module is used to create multiple chat windows, to
Multiple case history, medical image and preoperative threedimensional models of reconstruction for participating in doctor and distributing patient, multiple doctors are according to medicine shadow
The progress operation plan discussion as the case where data, the preoperative cast of reconstruction and observation patient, obtains final plastic operation scheme.
Optionally, the consultation of doctor module includes consultation of doctors creating unit, personal management unit, personnel's speech administrative unit
With end consultation of doctors unit, the consultation of doctors creating unit is used to pass through the more people's chat windows of network creation；The personal management unit
For manage participate in the consultation of doctors personnel, and to participate in doctor distribute patient history, medical image and reconstruction preoperative cast；Institute
It states personnel and makes a speech administrative unit for managing the speech situation of participant, allowing or participant being prevented to make a speech；The end
Unit hold a consultation for terminating the consultation of doctors, cuts off and participates in contacting for consultation of doctors personnel with each.
Optionally, consultation of doctor module further includes scheme demonstration unit, and the scheme demonstration unit passes through for operator
Human-computer interaction device carries out simulation operation demonstration according to the plastic operation scheme that the consultation of doctors obtains.
Optionally, the consultation of doctor module further includes scheme presentation record unit, and the scheme presentation record unit is used
In storage simulated plastic surgery presentation process and playback simulated plastic surgery presentation process.
Optionally, the human-computer interaction device includes data glove, 3 D stereo positioning device and connecting line, the three-dimensional
3 D positioning equipment is mounted in data glove, and the data glove is connect with 3 D stereo positioning device, the data glove
By connecting line and server communication, the data glove is used to acquire the movement of the hand of operator, the 3 D stereo positioning
Movement of the device according to data glove in space, calculates the position data and bearing data of data glove, and by position data
Server is sent to bearing data；The 3 D stereo positioning device includes transmitter, receiver and controller, the transmitting
Device transmission of electromagnetic signals, the receiver receive the electromagnetic signal of transmitter transmitting, and the receiver is mounted on data glove
The back of the hand position, for the position and direction of detection data gloves, 3 location parameters and 3 directioin parameters are sent to by receiver
Controller, controller and server communication, the signal transmitting of controller control transmitter, and by the received electromagnetic signal of receiver
It is converted to digital signal and is sent to server；Digital Signal Processing is obtained current location and the fortune of data glove by the server
Dynamic direction, the location information of the server real-time update virtual hand, the location information of virtual operation instrument and virtual shaping portion
The threedimensional model of position.
Second aspect, a kind of naked eye of plastic surgery medical image Model Reconstruction interaction provided in an embodiment of the present invention are three-dimensional
Display methods, the bore hole stereoscopic display system of the plastic surgery medical image Model Reconstruction interaction suitable for above-described embodiment description
System, method include:
Medical image data import modul obtains plastic surgery medical image data；
The medical image data of importing is carried out preoperative cast reconstruction by reconstructing three-dimensional model module, with d engine to reconstruction
Preoperative cast, patient's preoperative cast and patient select effect shaping model comparison, modification, design, cook up postoperative effect
The threedimensional model of fruit and the implementation model at plastic operation position；
Simulation operation is carried out with preoperative cast of the d engine to reconstruction；
Human-computer interaction device realizes the interactive operation of operator and system, and human-computer interaction device sends interactive operation data
To server；
Server receives interactive operation data and according to three of virtual hand in interactive operation data real-time update simulated scenario
Dimension module location information, surgical instrument threedimensional model location information and update the preoperative cast rebuild, and by naked eye 3D display
Module sends idsplay order；
Naked eye 3D display module receives the idsplay order, shows that the threedimensional model in virtual scene, display simulate shaping
The effect that the process of operation and simulation operation obtain.
Optionally, method further include: according to the wind for the recruitment evaluation operation that the case history of patient and simulated plastic surgery obtain
Danger.
Optionally, method further include: create multiple chat windows, case history, the medicine of patient are distributed to multiple participation doctors
The case where preoperative cast of image and reconstruction, multiple doctors are according to medical image data, the preoperative cast of reconstruction and observation patient
Operation plan discussion is carried out, final plastic operation scheme is obtained.
Beneficial effects of the present invention:
A kind of naked-eye stereoscopic display system of plastic surgery medical image Model Reconstruction interaction provided in an embodiment of the present invention
And method, the medical image that the imaging devices such as computed tomography, Magnetic resonance imaging obtain is reconstructed into threedimensional model, is cured
It is raw that human-computer interaction is carried out by human-computer interaction device and threedimensional model, facilitate doctor to carry out plastic surgery simulated training, mentions
High-immersion, doctor can be helped to better grasp operation main points, doctor and patient can be with naked eye by naked eye 3D display module
See postoperative effect, there is certain foresight, medical tangle can be reduced；For preoperative analysis and optimal operation can also be formulated
Method provides foundation, and it is horizontal to improve medical diagnosis.
Detailed description of the invention
It, below will be to specific in order to illustrate more clearly of the specific embodiment of the invention or technical solution in the prior art
Embodiment or attached drawing needed to be used in the description of the prior art are briefly described.In all the appended drawings, similar element
Or part is generally identified by similar appended drawing reference.In attached drawing, each element or part might not be drawn according to actual ratio.
Fig. 1 shows a kind of bore hole stereoscopic display of plastic surgery medical image Model Reconstruction interaction provided by the present invention
The structural schematic diagram of the first embodiment of system；
Fig. 2 shows a kind of bore hole stereoscopic displays of plastic surgery medical image Model Reconstruction interaction provided by the present invention
The structural schematic diagram of another embodiment of system；
Fig. 3 shows a kind of bore hole stereoscopic display of plastic surgery medical image Model Reconstruction interaction provided by the present invention
The structural schematic diagram of another embodiment of system；
Fig. 4 shows the structural schematic diagram of human-computer interaction device in Fig. 3；
Fig. 5 shows the structural schematic diagram of 3 D stereo positioning device in Fig. 4；
Fig. 6 shows a kind of bore hole stereoscopic display of plastic surgery medical image Model Reconstruction interaction provided by the present invention
The flow chart of method first embodiment.
Specific embodiment
Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention carries out clear, complete
Site preparation description, it is clear that described embodiments are some of the embodiments of the present invention, instead of all the embodiments.Based on this hair
Embodiment in bright, every other implementation obtained by those of ordinary skill in the art without making creative efforts
Example, shall fall within the protection scope of the present invention.
It should be appreciated that ought use in this specification and in the appended claims, term " includes " and "comprising" instruction
Described feature, entirety, step, operation, the presence of element and/or component, but one or more of the other feature, whole is not precluded
Body, step, operation, the presence or addition of element, component and/or its set.
It is also understood that mesh of the term used in this description of the invention merely for the sake of description specific embodiment
And be not intended to limit the present invention.As description of the invention and it is used in the attached claims, unless on
Other situations are hereafter clearly indicated, otherwise " one " of singular, "one" and "the" are intended to include plural form.
It will be further appreciated that term "and/or" used in description of the invention and the appended claims refers to
Any combination and all possible combinations of one or more of the associated item listed, and including these combinations.
As used in this specification and in the appended claims, term " if " can be according to context quilt
Be construed to " when ... " or " once " or " in response to determination " or " in response to detecting ".Similarly, phrase " if it is determined that " or
" if detecting [described condition or event] " can be interpreted to mean according to context " once it is determined that " or " in response to true
It is fixed " or " once detecting [described condition or event] " or " in response to detecting [described condition or event] ".
It should be noted that unless otherwise indicated, technical term or scientific term used in this application should be this hair
The ordinary meaning that bright one of ordinary skill in the art are understood.
As shown in Figure 1, showing a kind of naked eye of plastic surgery medical image Model Reconstruction interaction provided by the present invention
The structural schematic diagram of the first embodiment of three-dimensional display system, including medical image data import modul, reconstructing three-dimensional model mould
Block, human-computer interaction device, server and naked eye 3D display module, the medical image data import modul is for obtaining outside shaping
Section's medical image data；The medical image data of importing is carried out preoperative cast reconstruction by the reconstructing three-dimensional model module, with three
Comparison, modification, design that engine selects the preoperative cast, patient's preoperative cast and patient of reconstruction the shaping model of effect are tieed up,
Cook up the threedimensional model of postoperative effect and the implementation model at plastic operation position；With d engine to the three of virtual operation instrument
Dimension module and the threedimensional model of virtual hand carry out simulation operation to the preoperative cast of reconstruction；The human-computer interaction device for realizing
Interactive operation data are sent server by the interactive operation of operator and system, human-computer interaction device；The server receives
Interactive operation data and according to the threedimensional model location information of virtual hand in interactive operation data real-time update simulated scenario, operation
The threedimensional model location information of instrument and the preoperative cast for updating reconstruction, and idsplay order is sent to naked eye 3D display module；Institute
Naked eye 3D display module is stated for receiving and executing the idsplay order, shows that the threedimensional model in virtual scene, display are simulated
The effect that the process of plastic operation and simulation operation obtain.Currently, passing through computer tomography (CT), Magnetic resonance imaging
(MRI), the medical imaging technologies such as ultrasonic wave obtain the digital tomography two-dimensional image sequence at shaping position, medicine in the system
Image data import modul obtains plastic surgery medical image data, and two dimension is cut figure and carries out image by reconstructing three-dimensional model module
Three-dimensional reconstruction obtains the preoperative threedimensional model at shaping position, and reconstructing three-dimensional model module also sets up virtual hand and surgical instrument
Threedimensional model, the shaping model of effect is selected to the preoperative cast of reconstruction, patient's preoperative cast and patient with d engine
It compares, modification, design, cooks up the threedimensional model of postoperative effect and the implementation model at plastic operation position.Doctor passes through man-machine
Hand, surgical instrument and preoperative shaping position in interactive device and virtual scene interact operation, and human-computer interaction device will hand over
Interoperability data is sent to server, and server gets after interactive operation data hand and surgical device in real-time update virtual scene
The location information of tool, and the model of preoperative reconstruction is updated, server issues idsplay order to naked eye 3D display module, and naked eye 3D is aobvious
Show that module executes display command, shows the threedimensional model and virtual operation process in virtual scene.After virtual operation,
Doctor and patient can not wear any VR equipment can direct viewing finally obtain surgical effect.In the present embodiment,
Naked eye 3D display module uses cylindrical lenses 3D display device.
A kind of naked-eye stereoscopic display system of plastic surgery medical image Model Reconstruction interaction provided in an embodiment of the present invention,
The medical image that the imaging devices such as computed tomography, Magnetic resonance imaging obtain is reconstructed into threedimensional model, doctor passes through
Human-computer interaction device and threedimensional model carry out human-computer interaction, and doctor is facilitated to carry out plastic surgery simulated training, and raising is immersed
Sense, can help doctor better grasp operation main points, doctor and patient can be seen by naked eye 3D display module with naked eye it is in one's hands
Postoperative effect has certain foresight, can reduce medical tangle；It for preoperative analysis and optimal operation method can also be formulated mentions
For foundation, it is horizontal to improve medical diagnosis.
As shown in Fig. 2, the naked eye for showing a kind of plastic surgery medical image Model Reconstruction interaction provided by the invention is vertical
Another embodiment of body display system, is different from the first embodiment in, and system further includes virtual operation evaluation module, institute
State the risk of recruitment evaluation operation of the virtual operation evaluation module for obtaining according to the case history and virtual plastic operation of patient.It is empty
Quasi- operation evaluation module is referred to according to the effect comprehensive assessment operation risk that the case history and virtual operation of patient obtain for doctor.
As shown in figure 3, the naked eye for showing a kind of plastic surgery medical image Model Reconstruction interaction provided by the invention is vertical
Another embodiment of body display system, system further include consultation of doctor module, and the consultation of doctor module is for creating multiple chat
Skylight opening distributes case history, medical image and the preoperative cast of reconstruction of patient to multiple participation doctors, and multiple doctors are according to medicine
The case where image data, the preoperative cast of reconstruction and observation patient, carries out operation plan discussion, obtains final plastic operation side
Case.Consultation of doctor module includes consultation of doctors creating unit, personal management unit, personnel's speech administrative unit and terminates consultation of doctors unit,
The consultation of doctors creating unit is used to pass through the more people's chat windows of network creation；The personal management unit participates in the consultation of doctors for managing
Personnel, and to participate in doctor distribute patient history, medical image and reconstruction preoperative cast；The personnel, which make a speech, manages list
Member is for managing the speech situation of participant, allowing or participant being prevented to make a speech；The end consultation of doctors unit is for terminating
The consultation of doctors is cut off and participates in contacting for consultation of doctors personnel with each.Consultation of doctor module further includes scheme demonstration unit, the scheme demonstration
Unit carries out simulation operation demonstration according to the plastic operation scheme that the consultation of doctors obtains by human-computer interaction device for operator.Doctor
Consultation of doctors module further includes scheme presentation record unit, and the scheme presentation record unit was demonstrated for storing virtual plastic operation
Journey and the virtual plastic operation presentation process of playback.When encountering than case difficult to deal with, doctor can pass through consultation of doctor module
Multiple doctors are convened to hold a consultation the case, it is common to inquire into plastic operation scheme.Promoter (some doctor) passes through doctor's meeting
It examines creating unit and creates more people's chat windows, the personnel for participating in the consultation of doctors are determined by personal management unit, participate in the personnel of the consultation of doctors
Including doctor and patient, distribute case history, medical image and the preoperative cast of reconstruction of patient Xiang doctor, promoter is sent out by personnel
Whose speech is the speech situation for saying administrative unit management participant allow turn on the voice permission of this people, is held a consultation by terminating
Unit terminates to hold a consultation.The comprehensive consultation of doctors of promoter as a result, obtaining final plastic operation scheme.Doctor passes through human-computer interaction device
Simulation operation demonstration is carried out according to the final shaping operation plan that the consultation of doctors obtains, the storage simulation operation of scheme presentation record unit is drilled
Show process, and surgical procedure can be played back.Other doctors can play back the mould for learning difficult case by scheme recording unit
Quasi- operation presentation process, it is horizontal to improve medical diagnosis.
A kind of naked-eye stereoscopic display system of plastic surgery medical image Model Reconstruction interaction provided in an embodiment of the present invention,
When encountering difficult case, doctor can carry out consultation of doctor by consultation of doctor module, inquire into the scheme of plastic operation jointly,
Optimal plastic operation scheme is obtained after the consultation of doctors, the doctor for initiating the consultation of doctors is by human-computer interaction device according to operation plan
Simulation operation demonstration is carried out, system record simulation operation presentation process improves the medical treatment of all doctors convenient for later period playback study
It is horizontal.
As shown in Figure 4,5, the structural schematic diagram of human-computer interaction device in above-described embodiment is shown, in the present embodiment,
Human-computer interaction device includes data glove, 3 D stereo positioning device and connecting line, and the 3 D stereo positioning device is mounted on
In data glove, the data glove is connect with 3 D stereo positioning device, and the data glove passes through connecting line and server
Communication, the data glove are used to acquire the movement of the hand of operator, and the 3 D stereo positioning device exists according to data glove
The movement in space calculates the position data and bearing data of data glove, and position data and bearing data is sent to clothes
Business device；The 3 D stereo positioning device includes transmitter, receiver and controller, the transmitter transmission of electromagnetic signals, institute
The electromagnetic signal that receiver receives transmitter transmitting is stated, the receiver is mounted on the back of the hand position of data glove, for detecting
3 location parameters and 3 directioin parameters are sent to controller, controller and clothes by the position and direction of data glove, receiver
Business device communication, the signal transmitting of controller control transmitter, and the received electromagnetic signal of receiver is converted into digital signal hair
Give server；Digital Signal Processing is obtained current location and the direction of motion of data glove, the service by the server
The threedimensional model of the location information of device real-time update virtual hand, the location information of virtual instrument and virtual shaping position.Data hand
Set uses the data glove there are five sensor, and the data glove passes through USB interface and server communication.Using data glove
As human-computer interaction device, doctor is easy to operate, flexible operating, easy to use.
As shown in fig. 6, the naked eye for showing a kind of plastic surgery medical image Model Reconstruction interaction provided by the invention is vertical
The flow chart of body display methods first embodiment, the plastic surgery medical image Model Reconstruction suitable for above-described embodiment description are mutual
Dynamic naked-eye stereoscopic display system, method include:
S1: medical image data import modul obtains plastic surgery medical image data.
Medical image data be by the medicine such as computer tomography (CT), Magnetic resonance imaging (MRI), ultrasonic wave at
The digital tomography two-dimensional image sequence at shaping position is obtained as technology.
S2: the medical image data of importing is carried out preoperative cast reconstruction by reconstructing three-dimensional model module, is at least drawn with three-dimensional
Hold up comparison, modification, design that the preoperative cast to reconstruction, patient's preoperative cast and patient select the shaping model of effect, planning
The implementation model of the threedimensional model of postoperative effect and plastic operation position out；Mould is carried out with preoperative cast of the d engine to reconstruction
Quasi- operation.
S3: human-computer interaction device realizes the interactive operation of operator and system, and human-computer interaction device is by interactive operation data
It is sent to server.
S4: server receives interactive operation data and according to virtual hand in interactive operation data real-time update simulated scenario
The model of threedimensional model location information, the threedimensional model location information of surgical instrument and the preoperative reconstruction of update, and naked eye 3D is shown
Show that module sends idsplay order.
S5: naked eye 3D display module receives and executes idsplay order, shows that the threedimensional model in virtual scene, display are simulated
The result that the process of plastic operation and simulation operation obtain.
S6: the risk for the outcome evaluation operation that virtual plastic operation obtains is carried out according to operator.
S7: further including creating multiple chat windows, and case history, medical image and the reconstruction of patient are distributed to multiple participation doctors
Preoperative cast, multiple doctors according to medical image data, reconstruction preoperative cast and observation patient the case where carry out operation side
Case is inquired into, and final plastic operation scheme is made.
A kind of Nakedness-yet stereoscopic display method of plastic surgery medical image Model Reconstruction interaction provided in an embodiment of the present invention,
The medical image that the imaging devices such as computed tomography, Magnetic resonance imaging obtain is reconstructed into threedimensional model, doctor passes through
Human-computer interaction device and threedimensional model carry out human-computer interaction, and doctor is facilitated to carry out plastic surgery simulated training, and raising is immersed
Sense, can help doctor better grasp operation main points, doctor and patient can be seen by naked eye 3D display module with naked eye it is in one's hands
Postoperative effect has certain foresight, can reduce medical tangle；It for preoperative analysis and optimal operation method can also be formulated mentions
For foundation, it is horizontal to improve medical diagnosis.When encountering difficult case, doctor can carry out doctor's meeting by consultation of doctor module
It examines, the common scheme for inquiring into plastic operation obtains final plastic operation scheme after the consultation of doctors.
Finally, it should be noted that the above embodiments are only used to illustrate the technical solution of the present invention., rather than its limitations；To the greatest extent
Pipe present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that: its according to
So be possible to modify the technical solutions described in the foregoing embodiments, or to some or all of the technical features into
Row equivalent replacement；And these are modified or replaceed, various embodiments of the present invention technology that it does not separate the essence of the corresponding technical solution
The range of scheme should all cover within the scope of the claims and the description of the invention.
Claims (10)
1. a kind of naked-eye stereoscopic display system of plastic surgery medical image Model Reconstruction interaction, which is characterized in that including medicine
Image data import modul, reconstructing three-dimensional model module, human-computer interaction device, server and naked eye 3D display module, the doctor
Image data import modul is learned for obtaining plastic surgery medical image data；Doctor of the reconstructing three-dimensional model module importing
It learns image data and carries out preoperative cast reconstruction, selected with preoperative cast, patient preoperative cast and patient of the d engine to reconstruction
The threedimensional model of postoperative effect and the implementation mould at plastic operation position are cooked up in comparison, modification, the design of the shaping model of effect
Type；Mould is carried out to the preoperative cast of reconstruction to the threedimensional model of virtual operation instrument and the threedimensional model of virtual hand with d engine
Quasi- operation；The human-computer interaction device is for realizing the interactive operation of operator and system, and human-computer interaction device is by interactive operation
Data are sent to server；The server receives interactive operation data and according to interactive operation data real-time update simulated scenario
The threedimensional model location information of middle virtual hand, the threedimensional model location information of surgical instrument and the preoperative cast for updating reconstruction, and
Idsplay order is sent to naked eye 3D display module；The naked eye 3D display module is shown for receiving and executing the idsplay order
Show the effect that the threedimensional model in virtual scene, the process for showing simulated plastic surgery and simulation operation obtain.
2. the naked-eye stereoscopic display system of plastic surgery medical image Model Reconstruction interaction as described in claim 1, feature
Be, the system also includes virtual operation evaluation module, the virtual operation evaluation module be used for according to the case history of patient and
The risk for the recruitment evaluation operation that simulated plastic surgery obtains.
3. the naked-eye stereoscopic display system of plastic surgery medical image Model Reconstruction interaction as described in claim 1, feature
It is, the system also includes consultation of doctor module, the consultation of doctor module is for creating multiple chat windows, to multiple ginsengs
With doctor distribute patient case history, medical image and the preoperative cast of reconstruction, multiple doctors according to medical image data, rebuild
Preoperative cast carries out operation plan discussion with the case where observation patient, obtains final plastic operation scheme.
4. the naked-eye stereoscopic display system of plastic surgery medical image Model Reconstruction interaction as claimed in claim 3, feature
It is, the consultation of doctor module includes consultation of doctors creating unit, personal management unit, personnel's speech administrative unit and terminates the consultation of doctors
Unit, the consultation of doctors creating unit are used to pass through the more people's chat windows of network creation；The personal management unit is for managing ginseng
With the personnel of the consultation of doctors, and to participate in doctor distribute patient history, medical image and reconstruction preoperative cast；Personnel's speech
Administrative unit is used to manage the speech situation of participant, allows or participant is prevented to make a speech；The end consultation of doctors unit is used
In terminating to hold a consultation, cuts off and participate in contacting for consultation of doctors personnel with each.
5. the naked-eye stereoscopic display system of plastic surgery medical image Model Reconstruction interaction as claimed in claim 4, feature
It is, the consultation of doctor module further includes scheme demonstration unit, and the scheme demonstration unit passes through man-machine friendship for operator
Mutual equipment carries out simulation operation demonstration according to the plastic operation scheme that the consultation of doctors obtains.
6. the naked-eye stereoscopic display system of plastic surgery medical image Model Reconstruction interaction as claimed in claim 5, feature
It is, the consultation of doctor module further includes scheme presentation record unit, and the scheme presentation record unit is virtual for storing
Plastic operation presentation process and the virtual plastic operation presentation process of playback.
7. the naked-eye stereoscopic display system that the plastic surgery medical image Model Reconstruction as described in one of claim 1-6 interacts,
It is characterized in that, the human-computer interaction device includes data glove, 3 D stereo positioning device and connecting line, the 3 D stereo
Positioning device is mounted in data glove, and the data glove is connect with 3 D stereo positioning device, and the data glove passes through
Connecting line and server communication, the data glove are used to acquire the movement of the hand of operator, the 3 D stereo positioning device
Movement according to data glove in space, calculates the position data and bearing data of data glove, and by position data and side
Position data are sent to server；The 3 D stereo positioning device includes transmitter, receiver and controller, the transmitter hair
Radio magnetic signal, the receiver receive the electromagnetic signal of transmitter transmitting, and the receiver is mounted on the back of the hand of data glove
Position, for the position and direction of detection data gloves, 3 location parameters and 3 directioin parameters are sent to control by receiver
Device, controller and server communication, the signal transmitting of controller control transmitter, and the received electromagnetic signal of receiver is converted
Server is sent to for digital signal；Digital Signal Processing is obtained the current location and movement side of data glove by the server
To, the location information of the server real-time update virtual hand, the location information of virtual operation instrument and virtual shaping position
Threedimensional model.
8. a kind of Nakedness-yet stereoscopic display method of plastic surgery medical image Model Reconstruction interaction, is suitable for described in claim 1
Plastic surgery medical image Model Reconstruction interaction naked-eye stereoscopic display system, which is characterized in that the described method includes:
Medical image data import modul obtains plastic surgery medical image data；
The medical image data of importing is carried out preoperative cast reconstruction by reconstructing three-dimensional model module, at least with d engine to reconstruction
Preoperative cast, patient's preoperative cast and patient select effect shaping model comparison, modification, design, cook up postoperative effect
The threedimensional model of fruit and the implementation model at plastic operation position；
Simulation operation is carried out with preoperative cast of the d engine to reconstruction；
Human-computer interaction device realizes the interactive operation of operator and system, and interactive operation data are sent clothes by human-computer interaction device
Business device；
Server receives interactive operation data and according to the three-dimensional mould of virtual hand in interactive operation data real-time update simulated scenario
Type location information, surgical instrument threedimensional model location information and update the preoperative cast rebuild, and by naked eye 3D display module
Send idsplay order；
Naked eye 3D display module receives the idsplay order, shows threedimensional model, display simulated plastic surgery in virtual scene
Process and the obtained effect of simulation operation.
9. the Nakedness-yet stereoscopic display method of plastic surgery medical image Model Reconstruction interaction as claimed in claim 8, feature
It is, the method also includes: according to the risk for the recruitment evaluation operation that the case history of patient and simulated plastic surgery obtain.
10. the Nakedness-yet stereoscopic display method of plastic surgery medical image Model Reconstruction interaction as claimed in claim 9, feature
Be, the method also includes: create multiple chat windows, to multiple participation doctors distribute the case histories of patients, medical image and
The preoperative cast of reconstruction, multiple doctors carry out hand according to the case where medical image data, the preoperative cast of reconstruction and observation patient
Art Discussion on Project obtains final plastic operation scheme.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811132717.6A CN109061892A (en) | 2018-09-27 | 2018-09-27 | Plastic surgery medical image Model Reconstruction interacts naked-eye stereoscopic display system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811132717.6A CN109061892A (en) | 2018-09-27 | 2018-09-27 | Plastic surgery medical image Model Reconstruction interacts naked-eye stereoscopic display system and method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109061892A true CN109061892A (en) | 2018-12-21 |
Family
ID=64766154
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811132717.6A Pending CN109061892A (en) | 2018-09-27 | 2018-09-27 | Plastic surgery medical image Model Reconstruction interacts naked-eye stereoscopic display system and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109061892A (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111227933A (en) * | 2019-04-16 | 2020-06-05 | 北京大学第三医院（北京大学第三临床医学院） | Prediction and real-time rendering system for mandibular angle osteotomy |
| CN111227945A (en) * | 2020-02-13 | 2020-06-05 | 京东方科技集团股份有限公司 | A robot system and plastic surgery platform for plastic surgery platform |
| CN111553979A (en) * | 2020-05-26 | 2020-08-18 | 广州狄卡视觉科技有限公司 | Operation auxiliary system and method based on medical image three-dimensional reconstruction |
| CN111739377A (en) * | 2020-07-21 | 2020-10-02 | 北京众绘虚拟现实技术研究院有限公司 | Multi-person interconnected situational first-aid system |
| CN113012789A (en) * | 2021-03-24 | 2021-06-22 | 纵深视觉科技(南京)有限责任公司 | Patient information visualization method, device, medium and electronic equipment |
| CN117611753A (en) * | 2024-01-23 | 2024-02-27 | 吉林大学 | Facial shaping and repairing auxiliary system and method based on artificial intelligent reconstruction technology |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103678847A (en) * | 2012-09-24 | 2014-03-26 | 邵雁 | Skin soft tissue expanding auxiliary system |
| CN105938627A (en) * | 2016-04-12 | 2016-09-14 | 湖南拓视觉信息技术有限公司 | Processing method and system for virtual plastic processing on face |
| CN107067856A (en) * | 2016-12-31 | 2017-08-18 | 歌尔科技有限公司 | A kind of medical simulation training system and method |
| CN107506559A (en) * | 2017-09-08 | 2017-12-22 | 廖海斌 | Star's face shaping based on human face similarity degree analysis, which is made up, recommends method and apparatus |
-
2018
- 2018-09-27 CN CN201811132717.6A patent/CN109061892A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103678847A (en) * | 2012-09-24 | 2014-03-26 | 邵雁 | Skin soft tissue expanding auxiliary system |
| CN105938627A (en) * | 2016-04-12 | 2016-09-14 | 湖南拓视觉信息技术有限公司 | Processing method and system for virtual plastic processing on face |
| CN107067856A (en) * | 2016-12-31 | 2017-08-18 | 歌尔科技有限公司 | A kind of medical simulation training system and method |
| CN107506559A (en) * | 2017-09-08 | 2017-12-22 | 廖海斌 | Star's face shaping based on human face similarity degree analysis, which is made up, recommends method and apparatus |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111227933A (en) * | 2019-04-16 | 2020-06-05 | 北京大学第三医院（北京大学第三临床医学院） | Prediction and real-time rendering system for mandibular angle osteotomy |
| CN111227933B (en) * | 2019-04-16 | 2021-02-19 | 北京大学第三医院（北京大学第三临床医学院） | Prediction and real-time rendering system for mandibular angle osteotomy |
| CN111227945A (en) * | 2020-02-13 | 2020-06-05 | 京东方科技集团股份有限公司 | A robot system and plastic surgery platform for plastic surgery platform |
| CN111553979A (en) * | 2020-05-26 | 2020-08-18 | 广州狄卡视觉科技有限公司 | Operation auxiliary system and method based on medical image three-dimensional reconstruction |
| CN111553979B (en) * | 2020-05-26 | 2023-12-26 | 广州雪利昂生物科技有限公司 | Operation auxiliary system and method based on three-dimensional reconstruction of medical image |
| CN111739377A (en) * | 2020-07-21 | 2020-10-02 | 北京众绘虚拟现实技术研究院有限公司 | Multi-person interconnected situational first-aid system |
| CN113012789A (en) * | 2021-03-24 | 2021-06-22 | 纵深视觉科技(南京)有限责任公司 | Patient information visualization method, device, medium and electronic equipment |
| CN117611753A (en) * | 2024-01-23 | 2024-02-27 | 吉林大学 | Facial shaping and repairing auxiliary system and method based on artificial intelligent reconstruction technology |
| CN117611753B (en) * | 2024-01-23 | 2024-03-22 | 吉林大学 | Facial shaping and repairing auxiliary system and method based on artificial intelligent reconstruction technology |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109061892A (en) | Plastic surgery medical image Model Reconstruction interacts naked-eye stereoscopic display system and method | |
| CN106909771B (en) | For exporting the method and system of augmented reality information | |
| CN109643530A (en) | System and method for being trained and cooperating in virtual environment | |
| CN107067856B (en) | Medical simulation training system and method | |
| US20190021698A1 (en) | Methods for acquiring ultrasonic data | |
| TW202103646A (en) | Augmented reality system and method for tele-proctoring a surgical procedure | |
| CN109464195A (en) | Double mode augmented reality surgical system and method | |
| US20150213725A1 (en) | Method, apparatus, and system for viewing multiple-slice medical images | |
| WO2019147972A1 (en) | System and method for patient engagement | |
| CN107822690A (en) | Mixed image with the control without hand/scene reproduction device | |
| CN105992996A (en) | Dynamic and interactive navigation in a surgical environment | |
| CN109410337A (en) | A kind of artificial intelligence medical system implementation method, system based on VR model | |
| CN110021445A (en) | A kind of medical system based on VR model | |
| US11925418B2 (en) | Methods for multi-modal bioimaging data integration and visualization | |
| Mathew et al. | Role of immersive (XR) technologies in improving healthcare competencies: a review | |
| CN109065147A (en) | Medical Digital 3D model human body surgical simulation human-computer interaction system and method | |
| KR20160078777A (en) | Device for fabricating artificial osseous tissue and method of fabricating the same | |
| US20020120208A1 (en) | System and method of providing service for enhancing attention on internet | |
| CN219370483U (en) | Simulation device and simulation system for vascular intervention operation | |
| CN110718284A (en) | Three-dimensional medical image data interaction method and system | |
| WO2021244074A1 (en) | Virtual reality technology-based medical image display method, and system | |
| Çakmak et al. | Haptic ventriculostomy simulation in a grid environment | |
| KR20220043562A (en) | System for providing treatment and skill simulation using virtual reality | |
| CN110689968A (en) | Big data medical learning method and system based on 5G and VR technology | |
| WO2023058759A1 (en) | Wall thickness estimation method, computer program, learning method, model production method, wall thickness estimation device, and wall thickness estimation system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20181221 |
|
| RJ01 | Rejection of invention patent application after publication |