CN106874700A - Surgical simulation method, surgical simulation device and electronic equipment based on Web - Google Patents
Surgical simulation method, surgical simulation device and electronic equipment based on Web Download PDFInfo
- Publication number
- CN106874700A CN106874700A CN201710214646.3A CN201710214646A CN106874700A CN 106874700 A CN106874700 A CN 106874700A CN 201710214646 A CN201710214646 A CN 201710214646A CN 106874700 A CN106874700 A CN 106874700A
- Authority
- CN
- China
- Prior art keywords
- virtual scene
- file
- web
- image
- surgical simulation
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G06F19/3418—
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H50/00—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
- G16H50/50—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for simulation or modelling of medical disorders
Landscapes
- Health & Medical Sciences (AREA)
- Engineering & Computer Science (AREA)
- Medical Informatics (AREA)
- Public Health (AREA)
- Biomedical Technology (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Pathology (AREA)
- Epidemiology (AREA)
- General Health & Medical Sciences (AREA)
- Primary Health Care (AREA)
- Processing Or Creating Images (AREA)
Abstract
The invention provides a kind of surgical simulation method based on Web, surgical simulation device and electronic equipment, the surgical simulation method includes：The modeling file generated according to medical image is obtained, the modeling file is used to be shown and be interacted in virtual environment；Build the virtual scene based on Web；The modeling file is loaded onto in the virtual scene；After the modeling file is loaded onto in the virtual scene, the virtual scene is distributed to Web ends；Based on the virtual scene sham operated process for being distributed to the Web ends.Technical scheme can provide accurately and intuitively pathological anatomy structural information and visual feedback convenient for clinician, and fast and accurate diagnosis and treatment are realized so as to help to assist a physician.
Description
Technical field
The present invention relates to medical information technical field, in particular to a kind of surgical simulation method based on Web,
Surgical simulation device and electronic equipment.
Background technology
At present, virtual reality technology (Virtual Reality, abbreviation VR) gradually penetrates into each scientific domain,
Especially field of medicaments, being primarily due to can be according to the characteristics of sufferer and clinic needs to realize individual character by virtual reality technology
Change diagnosis and treatment, therefore virtual reality technology has turned into the precisely medical potential powerful measure of auxiliary.
But, how convenient for clinician's offer, accurately and intuitively pathological anatomy structural information and vision are anti-
Feedback, so as to assist clinician to realize technical problem urgently to be resolved hurrily in fast and accurate diagnosis and treatment always industry.
It should be noted that information is only used for strengthening the reason to background of the invention disclosed in above-mentioned background section
Solution, therefore can include not constituting the information to prior art known to persons of ordinary skill in the art.
The content of the invention
It is an object of the invention to provide a kind of surgical simulation method based on Web, surgical simulation device and electronic equipment,
And then at least overcome to a certain extent due to one or more problem caused by the limitation of correlation technique and defect.
Other characteristics of the invention and advantage will be apparent from by following detailed description, or partially by the present invention
Practice and acquistion.
According to the first aspect of the invention, there is provided a kind of surgical simulation method based on Web, including：Obtain according to medical science
The modeling file of video generation, the modeling file is used to be shown and be interacted in virtual environment；Build the void based on Web
Intend scene；The modeling file is loaded onto in the virtual scene；The modeling file is being loaded onto the virtual scene
In after, the virtual scene is distributed to Web ends；Based on the virtual scene sham operated process for being distributed to the Web ends.
In some embodiments of the invention, based on aforementioned schemes, the modeling file that acquisition is generated according to medical image
Step, including：
Obtain the medical image that user terminal sends；The modeling file is generated based on the medical image；Or
Obtain the modeling file generated according to the medical image that user terminal sends.
In some embodiments of the invention, based on aforementioned schemes, based on the medical image generation modeling text
In the case of part, based on the medical image generate the modeling file the step of, including：Obtain what the user terminal sent
The dissection comprising focus and/or organ gathered by the first image documentation equipment and the first image file of function information, wherein, institute
It is the information gathering according to clinical demand and the focus and/or organ for needing to be presented in virtual scene to state the first image file
's；Three-dimensional reconstruction is carried out based on first image file, file is rebuild in generation；The form of the reconstruction file is converted into institute
The file format of virtual scene support is stated, to obtain the modeling file.
In some embodiments of the invention, based on aforementioned schemes, three-dimensional reconstruction is carried out based on first image file,
The step of file is rebuild in generation, including：According to the picture characteristics of first image file, first image file is carried out
The division of area-of-interest；Image segmentation and three-dimensional are carried out to first image file based on the area-of-interest for dividing
Rebuild, to obtain the reconstruction file for each area-of-interest.
In some embodiments of the invention, based on aforementioned schemes, also include：Obtain passing through for the user terminal transmission
The focus and/or organ of the first image documentation equipment collection are in multiple first image files of out of phase phase, and/or pass through
The dissection comprising the focus and/or organ of the second image documentation equipment collection and the second image file of function information；To basis
The reconstruction file of the multiple first image file generation carries out the image registration treatment based on anatomical structure and phase time,
And/or the reconstruction file and the reconstruction file of first image file to second image file are carried out based on anatomical features
The image registration treatment of point.
In some embodiments of the invention, based on aforementioned schemes, also include：The loading simulation hand in the virtual scene
Operating theater instruments and/or intervening equipment required for art process.
In some embodiments of the invention, based on aforementioned schemes, also include：The parameter of the virtual scene is configured, is had
Body includes：Addition day sylphon, addition video camera simultaneously adjust its parameter, addition renderer, add control object and effect object, add
Enter and illuminate and adjust lighting parameter, render scenes；Wherein, the parameter of the video camera includes：The height of video camera, camera lens side
To, the camera lens visual field, camera lens visual angle；The control object is used to adjust the video camera according to the status information of virtual reality device
Parameter；The effect object is used to that the display interface of the virtual scene to be divided into the interface for right and left eyes.
In some embodiments of the invention, based on aforementioned schemes, also include：The terminal for obtaining operation Web client sets
Standby configuration information；Judge whether the terminal device can show the virtual scene according to the configuration information；If it is determined that
The terminal device can show the virtual scene, then the configuration-direct of communication interface is sent to the terminal device, with base
The terminal device connection external equipment is controlled in the configuration-direct.
In some embodiments of the invention, based on aforementioned schemes, also include：Run simultaneously there are multiple Web clients
During the virtual scene, the control to the distribution of at least one of the multiple Web client Web client to the virtual scene
Authority processed.
In some embodiments of the invention, based on aforementioned schemes, a Web in the multiple Web client
In the case that client distributes the control authority to the virtual scene, also include：Obtain and run in one Web client
Virtual scene in the parameters value that changes；According to the parameters value for getting, the ginseng at Web service end is updated
Number, and the parameters value is sent into other clients into the multiple Web client, to update described other clients
Parameter in the virtual scene run on end.
In some embodiments of the invention, based on aforementioned schemes, in the multiple Web client at least two
In the case that Web client distributes the control authority to the virtual scene, also include：Obtain at least two web client
The parameters value changed in the virtual scene run on end；According to the parameters value for getting, Web clothes are updated
The parameter at business end, and the parameters value is sent into each client into the multiple Web client, it is described to update
Parameters in the virtual scene run in each client.
In some embodiments of the invention, based on aforementioned schemes, also include：Having, a Web client operation is described
During virtual scene, the control authority to the virtual scene is distributed to one Web client.
In some embodiments of the invention, based on aforementioned schemes, also include：The virtual scene is generated at Web ends
Entrance；The information of the entrance is pushed to user, wherein, the information of the entrance includes：The link of the network address and/or it is used for
Triggering enters the Quick Response Code of the entrance.
According to the second aspect of the invention, there is provided a kind of surgical simulation device based on Web, including：Acquiring unit, uses
In the modeling file according to medical image generation is obtained, the modeling file is used to be shown and be interacted in virtual environment；
Construction unit, for building the virtual scene based on Web；Loading unit, it is described virtual for the modeling file to be loaded onto
In scene；Release unit, for after the modeling file is loaded onto in the virtual scene, by virtual scene hair
Cloth is to Web ends；Processing unit, for based on the virtual scene sham operated process for being distributed to the Web ends.
According to the third aspect of the invention we, there is provided a kind of electronic equipment, including：Processor and memory, the storage
Device is stored with executable instruction, and the processor is used to calling the executable instruction of the memory storage to perform as described above first
Surgical simulation method described in aspect.
In the technical scheme that some embodiments of the present invention are provided, by by medical image and virtual reality technology phase
With reference to carrying out the simulation of surgical procedure, and by carrying out ROI (Region of Interest, region of interest to medical image
Domain) the treatment such as division, image segmentation, the generation of modeling file, registration optimization, enabling set up standardized, accurately
Anatomical model comprising pathological information, and then accurately and intuitively pathological anatomy structural information and vision can be provided for clinician
Feedback, fast and accurate diagnosis and treatment are realized so as to help to assist a physician.
Web ends are distributed to by by virtual scene, based on the virtual scene sham operated process for being distributed to Web ends, to make
Obtaining doctor can easily carry out the simulation of surgical procedure based on Web client, be not necessarily limited to fixed place, and then can
Realize remote medical consultation with specialists and long-range analysis of cases.It can be seen that, technical scheme is to advancing accurate medical treatment and realizing patient characteristic
Change treatment to have important practical significance and social benefit.
It should be appreciated that the general description of the above and detailed description hereinafter are only exemplary and explanatory, not
Can the limitation present invention.
Brief description of the drawings
Accompanying drawing herein is merged in specification and constitutes the part of this specification, shows and meets implementation of the invention
Example, and be used to explain principle of the invention together with specification.It should be evident that drawings in the following description are only the present invention
Some embodiments, for those of ordinary skill in the art, on the premise of not paying creative work, can also basis
These accompanying drawings obtain other accompanying drawings.In the accompanying drawings：
Fig. 1 diagrammatically illustrates the flow of the surgical simulation method based on Web according to first embodiment of the invention
Figure；
Fig. 2 diagrammatically illustrates the flow that modeling file is generated based on medical image according to an embodiment of the invention
Figure；
Fig. 3 diagrammatically illustrates the flow of the surgical simulation method based on Web of second embodiment of the invention
Figure；
Fig. 4 diagrammatically illustrates the stream of the three-dimensional modeling based on medical image of first implementation method of the invention
Cheng Tu；
Fig. 5 diagrammatically illustrates the stream of the three-dimensional modeling based on medical image of second implementation method of the invention
Cheng Tu；
Fig. 6 diagrammatically illustrates the design sketch that day sylphon is added according to an embodiment of the invention in virtual scene；
Fig. 7 diagrammatically illustrates virtual interacting according to an embodiment of the invention by displays such as virtual glasses or the helmets
Environment schematic；
Fig. 8 is diagrammatically illustrated according to an embodiment of the invention by showing that virtual interactive environment runs on mobile phone A PP
It is intended to；
Fig. 9 diagrammatically illustrates the communication construction at Web service end according to an embodiment of the invention and Web client
Schematic diagram；
Figure 10 diagrammatically illustrates the block diagram of the surgical simulation device based on Web according to an embodiment of the invention.
Specific embodiment
Example embodiment is described more fully with referring now to accompanying drawing.However, example embodiment can be with various shapes
Formula is implemented, and is not understood as limited to example set forth herein；Conversely, thesing embodiments are provided so that the present invention will more
Fully and completely, and by the design of example embodiment those skilled in the art is comprehensively conveyed to.
Additionally, described feature, structure or characteristic can be combined in one or more implementations in any suitable manner
In example.In the following description, there is provided many details fully understand so as to be given to embodiments of the invention.However,
It will be appreciated by persons skilled in the art that it is one or more during technical scheme can be put into practice without specific detail,
Or can be using other methods, constituent element, device, step etc..In other cases, it is not shown in detail or describes known square
Method, device, realization operate to avoid fuzzy each aspect of the present invention.
Block diagram shown in accompanying drawing is only functional entity, not necessarily must be corresponding with physically separate entity.
I.e., it is possible to realize these functional entitys using software form, or realized in one or more hardware modules or integrated circuit
These functional entitys, or these functional entitys are realized in heterogeneous networks and/or processor device and/or microcontroller device.
Flow chart shown in accompanying drawing is merely illustrative, it is not necessary to including all of content and operation/step,
It is not required to be performed by described order.For example, some operation/steps can also be decomposed, and some operation/steps can be closed
And or part merge, therefore the actual order for performing is possible to be changed according to actual conditions.
Fig. 1 diagrammatically illustrates the flow of the surgical simulation method based on Web according to first embodiment of the invention
Figure.
Reference picture 1, the surgical simulation method based on Web according to first embodiment of the invention, comprises the following steps：
Step S10, obtains the modeling file generated according to medical image, and the modeling file is used to enter in virtual environment
Row display and interaction.
In an embodiment of the present invention, step S10 has the following two kinds specific embodiment：
Implementation method one：
Obtain the medical image that user terminal sends；The modeling file is generated based on the medical image.
In implementation method one, user (such as doctor) can be by user terminal (such as mobile phone, panel computer, computer)
Medical image is uploaded, and then service end can generate modeling file according to the medical image.
Exemplary embodiment of the invention, as shown in Fig. 2 generating the modeling file based on the medical image
Step, including：
Step S202, obtain that the user terminal sends by the first image documentation equipment gather comprising focus and/or device
The dissection of official and the first image file of function information, wherein, first image file is to be according to clinical demand and needs
The information gathering of focus and/or organ in present virtual scene.
In an embodiment of the present invention, the first image documentation equipment can be that (Computed Tomography, computer breaks CT
Layer scanning) equipment.
Step S204, three-dimensional reconstruction is carried out based on first image file, and file is rebuild in generation.
In an exemplary embodiment of the present invention, step S204 is specifically included：According to the image of first image file
Characteristic, the division of area-of-interest is carried out to first image file；Based on the area-of-interest for dividing to described the
One image file carries out image segmentation and three-dimensional reconstruction, to obtain the reconstruction file for each area-of-interest.
It should be noted that the division due to area-of-interest can be carried out to the first image file, therefore, it is possible to will be every
One organ, functional block, focus etc. are independently divided into an area-of-interest, and then can make each organ, functional block, disease
Stove etc. is individually formed a reconstruction file.
Step S206, is converted to the file format that the virtual scene is supported, to obtain by the form of the reconstruction file
The modeling file.
In an embodiment of the present invention, the file format that virtual scene is supported such as can be " .OBJ " form.In form
During conversion, therefore, to assure that anatomic information is non-warping, do not lose, and can enter in virtual environment for modeling file
Row material, color, refraction, transparency, the definition and setting of gloss.
In an embodiment of the present invention, it is above-mentioned in order to provide the anatomical structure function information for becoming apparent to clinician
Multiple files of rebuilding for each organ, functional block, focus etc. can be based on the initial data that different image documentation equipments are gathered
Or DICOM image files rebuild generation by volume of data and image processing algorithm, or adopted based on same image documentation equipment
The initial data or DICOM image files of the different time phase phase of collection are processed by volume of data and image processing algorithm
Rebuild generation.Further, it is also possible to image registration treatment is carried out to multiple files of rebuilding of generation, so as to realize clearly accurately weighing
Existing anatomical structure and organ dysfunction information.Specifically, following three kinds of image registration schemes be the embodiment of the invention provides：
Image registration scheme one：
The focus gathered by the first image documentation equipment and/or organ for obtaining user terminal transmission are in out of phase
Multiple first image files of phase；Reconstruction file to being generated according to the multiple first image file is carried out based on anatomical structure
Image registration with phase time is processed.
Image registration scheme one：
Obtain user terminal send by the second image documentation equipment gather the dissection comprising the focus and/or organ and
Second image file of function information；To the reconstruction text for rebuilding file and first image file of second image file
Part carries out the image registration based on anatomical features point and processes.
Image registration scheme one：
The image registration scheme is the association schemes of above-mentioned image registration scheme one and image registration scheme two, that is, obtain and use
The focus gathered by the first image documentation equipment and/or organ that family terminal sends are in multiple first images text of out of phase phase
Part, and the dissection comprising focus and/or organ by the collection of the second image documentation equipment and the second image file of function information,
The reconstruction file of the reconstruction file and multiple first image files that are then based on the second image file carries out image registration treatment.
In a kind of possible implementation method, the weight of multiple first image files that first can be gathered to the first image documentation equipment
Building file carries out the image registration treatment based on anatomical structure and phase time, then again to according to multiple first image files
The result and the reconstruction file of the second image file of the second image documentation equipment collection rebuild after file registration carry out special based on dissecting
Levy image registration treatment a little.Certainly, embodiments of the present invention are not limited to this.
It should be noted that the second above-mentioned image documentation equipment can be MR (Magnetic Resonance, magnetic resonance) setting
It is standby.
Implementation method two：
Obtain the modeling file generated according to the medical image that user terminal sends.
In implementation method two, user (such as doctor) can be by user terminal (such as mobile phone, panel computer, computer)
The modeling file for being generated according to medical image is directly uploaded, such service end need not regenerate modeling file.
With continued reference to Fig. 1, the described surgical simulation method based on Web also includes：
Step S12, builds the virtual scene based on Web.
In embodiments of the present invention, virtual scene is generated by computer, is acted on by vision, hearing, touch feel etc.
User, the interactive mode of the sensation for being allowed to produce on the spot in person is emulated regarding border.When the virtual scene based on Web is built, can make
Code is write with three.js (a kind of operation 3D engines in a browser), and using WebGL (Web Graphics
Library, a kind of 3D drafting standards) technology sets up virtual scene.
After the virtual scene based on Web is built, can also include：The parameter of the virtual scene is configured, specific bag
Include：Addition day sylphon, addition video camera simultaneously adjust its parameter, addition renderer, add control object and effect object, add and shine
It is bright and adjust lighting parameter, render scenes；Wherein, the parameter of the video camera includes：The height of video camera, lens direction, mirror
The head visual field, camera lens visual angle；The control object is used to be adjusted according to the status information of virtual reality device the ginseng of the video camera
Number；The effect object is used to that the display interface of the virtual scene to be divided into the interface for right and left eyes.
Step S14, the modeling file is loaded onto in the virtual scene.
Further, it is also possible in operating theater instruments and/or intervening equipment required for loading simulation surgical procedure in virtual scene,
To aid in carrying out virtual operation.
Step S16, after the modeling file is loaded onto in the virtual scene, the virtual scene is distributed to
Web ends.
Step S18, based on the virtual scene sham operated process for being distributed to the Web ends.
It should be noted that：" surgical procedure " in the embodiment of the present invention refer to being carried out in virtual scene with operation
Related process, it is included but is not limited to：To the analysis process of case in virtual scene before implementing operation, and virtual
Implement process of specific operation etc. in scene.
In some embodiments of the invention, based on aforementioned schemes, also include：The virtual scene is generated at Web ends
Entrance；The information of the entrance is pushed to user, wherein, the information of the entrance includes：The link of the network address and/or it is used for
Triggering enters the Quick Response Code of the entrance.
It should be noted that when generation virtual scene is after the entrance at Web ends, user (such as doctor) can easily enter
Enter virtual scene, such as can be by way of scanning Quick Response Code or the mode of the input network address enters virtual scene, this
The mode of kind is very easy to the operation of user, such as when needing to carry out remote medical consultation with specialists, each consultation of doctors participant can pass through
Mobile device scans Quick Response Code come in proceeding to same virtual scene, and also can send the Quick Response Code and invite other users ginseng
With.
In some embodiments of the invention, based on aforementioned schemes, also include：The terminal for obtaining operation Web client sets
Standby configuration information；Judge whether the terminal device can show the virtual scene according to the configuration information；If it is determined that
The terminal device can show the virtual scene, then the configuration-direct of communication interface is sent to the terminal device, with base
The terminal device connection external equipment is controlled in the configuration-direct.
After virtual scene is distributed into Web ends, can be exemplified below based on the virtual scene come sham operated process
Several control models during sham operated, certain embodiments of the present invention are not limited to this：
Control model one：
There are multiple Web clients while when running the virtual scene, to one in the multiple Web client
Web client distributes the control authority to the virtual scene.
Control model one is many people's single control patterns, i.e., when there is multiple users to enter in same virtual scene, only
One user is with the control authority to the virtual scene.
In the control model, in order to the virtual scene display presented in the Web client for ensureing each user is consistent, need
The synchronization of data is carried out, is specifically included：
Obtain the virtual field run in one Web client (client is the client of the limit that is possessed of control power)
The parameters value changed in scape；According to the parameters value for getting, the parameter at Web service end is updated, and will
The parameters value sends other clients into the multiple Web client, is transported in described other clients with updating
Parameter in capable virtual scene.
Control model two：
There are multiple Web clients while when running the virtual scene, at least two in the multiple Web client
Control authority of the individual Web client distribution to the virtual scene.
Control model two is many people's multi-control modes, i.e., when there is multiple users to enter in same virtual scene, there is many
Individual user has the control authority to the virtual scene.
In the control model, in order to the virtual scene display presented in the Web client for ensureing each user is consistent, need
The synchronization of data is carried out, is specifically included：
Obtain what is run at least two Web client (these clients are the client of the limit that is possessed of control power)
The parameters value changed in virtual scene；According to the parameters value for getting, the ginseng at Web service end is updated
Number, and the parameters value is sent into each client into the multiple Web client, to update described each client
Parameters in the virtual scene run on end.
Control model three：
When there is a Web client to run the virtual scene, to the distribution of one Web client to described virtual
The control authority of scene.
Control model three is single single control pattern, i.e., only one user enters in virtual scene, need not now enter
The synchronization process of row data, without the parameter for updating Web service end.
Fig. 3 diagrammatically illustrates the flow of the surgical simulation method based on Web of second embodiment of the invention
Figure.
Reference picture 3, can carry out three-dimensional and build to focus/organ and surrounding anatomical structures in database based on medical image
Mould, obtains modeling file, and builds the VR scenes based on Web in Web rear ends, then imports modeling file and is obtained in VR scenes
Virtual scene.And then the browser based on virtual scene and web front end carries out the virtual interacting based on VR equipment.
Said process is described in detail respectively below：
1st, focus/organ and surrounding anatomical structures are based on the three-dimensional modeling of medical image, obtain modeling file.The present invention is carried
The following two kinds specific embodiment is gone out：
Embodiment one：
Shown in reference picture 4, in one exemplary embodiment of the present invention, three-dimensional modeling bag is carried out based on medical image
Include：
Step S402, image and data acquisition.
Specifically, virtual environment is presented on according to clinical demand, and the need for clinician and image expert confirmation
In focus and histoorgan information, gather dissection and the function information of corresponding organ/focus.If for example, three-dimensional modeling
For formulating operation optimal case, then modeling needs are included：Lesion information, perilesional histoorgan information, sensitiveness device
In official's information, surgical procedure/intervention procedure in routing information, and be connected with focus important untouchable organ letter
Breath (for example, sustainer, nerve).
Meanwhile, can be gathered by CT and MR and include organ and lesion information, accurately to react the shadow of human anatomic structure
As file, this document includes DICOM (Digital Imaging and Communications in Medicine, medical science number
Word is imaged and communicates) file and uncorrected data (raw data) file.In order to obtain the sufficiently high three-dimensional reconstruction figure of spatial resolution
Picture, can use based on the image file of high-end CT, and data acquisition thickness is generally less than 0.6mm, makes by specific algorithm
Thickness is obtained between 0.3mm-0.6mm, temporal resolution needs the cardiac cycle higher than 1/2, keep x-y-z direction of principal axis each to same
Property.
It should be noted that：Above-mentioned DICOM is the international standard (ISO 12052) of medical image and relevant information, it
Define that quality can meet clinical needs can be used for the Medical Image Format of data exchange.DICOM is widely used in radiation
Medical treatment, angiocarpy imaging and treatment for radiation-caused disease diagnostic device (X-ray, CT, nuclear magnetic resonance, ultrasound etc.), and in ophthalmology and tooth
Other medical domains such as section obtain more and more deeply being widely applied.Ten hundreds of with medical imaging device, DICOM
It is one of most widely-installed medical information standard.
Above-mentioned uncorrected data is a proper noun for medical image, for example, can refer to and directly be extracted from CT system
Do not do 2 dimension reconstruction images (DICOM) it is direct from detector gather by human body decay data.
Additionally, in order to obtain more accurately three-dimensional reconstruction file, using the out of phase phase in same image documentation equipment
Image file be also necessary, for example, CT imaging in order to it is clearer display artery and vein vessel information, can exist
The certain diodone of injection in patient's body, and the image information in arterial phase and venous phase is gathered respectively, it is final three-dimensional
Rebuild and data are provided.
Step S404, image preprocessing.
Step S406, data prediction and 2 dimension image reconstructions.
Step S408,3 d image is rebuild and post processing of image.
Step S410, the image modeling based on medical image.
In an exemplary embodiment of the present invention, the treatment to image can include image preprocessing, post processing, and 2D
Conversion 3D rendering modeling.Based on DICOM images or uncorrected data, according to picture characteristics, the HU values and low contrast of such as CT are right
Image carries out area-of-interest division, image segmentation and 3D modeling, finally makes each organ, and functional block, focus is individually formed
One reconstruction file.And by image registration, such as with reference to the image of same organs/focus under MR, with the high spatial point for obtaining
The CT images of resolution carry out registration according to anatomical features point, the function information for being become apparent from.
Step S412, generation is based on the focus/organ of medical image and being shown under VR environment for surrounding anatomical structures
With interactive modeling file.
Specifically, each focus and the 3D modeling file of organ and perienchyma based on medical image are converted into void
Intend actual environment acceptable file, such as " .OBJ " file (a kind of 3D model files form of standard).And in transfer process really
Protect that anatomic information is non-warping, do not lose, and to each 3D modeling file, material is carried out in the environment of virtual reality, color,
Refraction, transparency, the definition and setting of gloss.
Embodiment two：
Shown in reference picture 5, in two exemplary embodiments of the invention, medical image DICOM file is mainly based upon
And/or uncorrected data generation modeling file.
Specifically, the focus that is presented on the need for being confirmed according to clinician and image expert engineer in virtual environment and
The message of histoorgan, gathers clinical medicine image data, image preprocessing, post processing is carried out to it, is rebuild and form conversion
With optimization etc. a series of image processing techniques, formed can by reality environment receive file format.With reference to Fig. 5 to it
Illustrate.
First, image and data acquisition are carried out.
In one embodiment of the invention, DICOM images can be obtained.In another embodiment of the invention, another
In one embodiment, uncorrected data can be obtained, data prediction and image reconstruction then are carried out to the uncorrected data.For example：Noise reduction, go
Artifact, area-of-interest selection (ROI (region of interest) info), iterative approximation enhancing etc..
Secondly, image and data to above-mentioned collection carry out image procossing.
In the implementation method shown in Fig. 5, image procossing can be built including image preprocessing, post processing of image and image
Mould.
Wherein, image preprocessing can for example include：Image registration, area-of-interest enhancing, bone is extracted, muscle is extracted,
Image artifacts elimination etc..Post processing of image can for example include：Image divides, filtering, and diffusion quantifies, conversion etc..Image modeling
Can for example include：Cutting, filtering, mark etc..
Wherein, image modeling here can use three-dimensional image reconstruction and display：It is right using classical three-dimensional reconstruction algorithm
The sequence image of acquisition carries out three-dimensional reconstruction on computers；And show each tomography in die body data using visualization technique
View data, while including cutting, zoomed image processing function, realizes the more interaction process to image.
By the iterative process to above-mentioned image procossing, and ensure image/mould through image expert engineer and clinician
Body is accurately presented organ and lesion information, generates modeling file.
2nd, the VR scenes based on Web are built.
In an embodiment of the present invention, browser can be based on, code be write using three.js, using WebGL technologies
Set up three-dimensional scenic, including following process：
(1) obtain VR equipment and carry out communication configuration.
When browser access server, server can be by API (Application Programming
Interface, application programming interface) interface obtains VR equipment, such as some configuration informations of mobile phone, by detecting these
Configure to judge whether the equipment possesses VR display functions, it is such as blue to the communication interface of the equipment when with VR display functions
Tooth etc. is configured, to connect the external equipments such as corresponding Bluetooth handle, gloves.
(2) VR scenes are set up.
After opening webpage, it is shown that general three-dimensional scenic, if equipment can click on " the Enter VR " of lower section by detection
Into VR scenes.A scene for sky is first set up, then adds day sylphon, i.e. six backgrounds in face of square, tool in this scenario
Body is as shown in Figure 6.
(3) video camera is added.
Video camera is added in box on high, and adjusts its height, direction, the visual field, visual angle etc., make it with day sylphon ground
Height of the mobile phone apart from actual ground is highly equal to, such user can have more telepresenc.
(4) renderer is added.
After renderer is added, renderer parameter can be configured.
(5) control (control) object and effect (effect) object are added.
Control objects and effect objects are added, status information of the control objects mainly to VR equipment is obtained
And be applied on video camera.For example when display on mobile phone, rotation inclination of mobile phone etc. will be applied directly to video camera
On.Screen display is mainly cut into the screen that right and left eyes are regarded by effect objects, and the content shown by two screens has one
Fixed difference so that the content in screen can be seen to obtain three-dimensional by the binocular stereo vision of people.
(6) threedimensional model is loaded.
Loading threedimensional model, the file format that can be loaded includes " .stl " and " .obj ", to each threedimensional model virtual
It is required for carrying out the definition and setting of material, color, refraction, transparency, gloss, position in actual environment, and the model is added
In entering virtual scene, while adding lighting parameter in virtual scene.
(7) render scenes.
Whole scene can be specifically rendered using renderer.
3rd, after by above-mentioned treatment, virtual scene is published to internet Web ends.
Specifically, node.js and its relevant framework are disposed in server end, configuration server environment, server can be selected
Select home server, it is also possible to select cloud server；Then on web site contents are uploaded onto the server, and carry out domain name and tie up
It is fixed.User can be by the corresponding website platform of browser access, after VR patterns are entered afterwards, it is possible to use and virtual glasses/
Pseudo operation is perhaps carried out in helmet viewing.
The advantage for building virtual scene based on Web ends is that the operational performance of its server is much higher than mobile terminal.It is right
In some complicated and substantial amounts of simulation modeling files, it is possible to use background server CPU powerful operational performance and video card GPU
Render performance, complex data is processed and is rendered, server end generate virtual scene, then send it to again
Web ends, after user's access website enters VR virtual scenes, mobile phone are arranged in virtual glasses, it is possible to start and virtual ring
Border is interactive.Specifically, it is illustrated in figure 7 the virtual interacting ring by displays such as virtual glasses or the helmets of the embodiment of the present invention
Border schematic diagram.Fig. 8 show the example that virtual interactive environment is run on mobile phone A PP of the embodiment of the present invention.
Based on above-mentioned scheme, the Internet community platform can be built, the platform can provide remote medical consultation with specialists and case point
The functions such as analysis, preoperative planning and the operation of many human simulations.The function of remote medical consultation with specialists and analysis of cases can cure the multidigit in same place
The multidigit doctor of raw or different location is entered into same virtual scene by wearing VR equipment, and patient is carried out remotely
Examine and analysis of cases.Preoperative planning function causes that the doctor in charge can carry out preoperative rule in virtual scene by VR equipment to patient
Explanation is drawn, other doctors and patient can be synchronized in same virtual scene by VR equipment.Many human simulation surgical functions can be real
Existing multidigit doctor compounding practice, sham operated in same virtual scene.
Specifically may include steps of：
Step 1, upload case mode, create virtual scene.
The threedimensional model of case or medical image can be uploaded to user (such as doctor) background server of this platform, together
When based on upload one virtual scene of data creation, by generate the virtual scene Quick Response Code or web site url be sent to need
The doctor of the consultation of doctors is participated in, doctor can open browser or directly pass through link and open browser, enter into by barcode scanning
In virtual scene.
Step 2, configuration surgical apparatus and intervention apparatus.
This virtual platform additionally provides various medical operation devices and intervening equipment, and for master control, doctor is controlled, in void
Intend after scene is set up equipment and the apparatus for needing to use in, it is necessary to be loaded into operation.
Step 3, acquisition ownership.
After all doctors are entered into virtual scene, the doctor for having obtained ownership can be operated and be said to case
Solution, including case mode is rotated, drag, scaled, it is highlighted to focuses such as tumours, set using operating theater instruments or intervention
It is standby to operate etc., and other doctors can be synchronized to the visual angle of ownership doctor, it is also possible to apply for ownership to obtain to case
The control and operation of example.
I.e. in an embodiment of the present invention, when there are multiple doctors to enter virtual scene, multiple doctors can simultaneously be assigned
Ownership carries out surgical simulation, and controlling equipment implements sham operated to many people to patient simultaneously；A doctor can also only be assigned
Ownership carries out surgical simulation.When only one of which doctor enters virtual scene, the doctor can be assigned to virtual scene
Ownership.
It should be noted that：In an embodiment of the present invention, can be based between Web client and Web service end
WebSocket technologies carry out webpage real-time Communication for Power.
WebSocket technologies are full-duplex communication technologies between the browser that HTML5 is provided and server, are mainly used in real time
Communication service.WebSocket technologies are very efficient, need only browser and server once shaken hands just can bi-directional number
According to.Socket.IO is a module of increasing income of Node.JS, and it is encapsulated to WebSocket, there is provided set up connection and
The interface that message is pushed, in an embodiment of the present invention, can set up Socket service based on this module at Web service end, and
It is connected with each Web client, completes information updating and Message Processing work.At present, IE, FireFox, Chrome, Opera etc.
Major browsers support the technology.
Specific framework is as shown in figure 9, Web service end is synchronous by WebSocket communication holdings with Web client.Web takes
Business end program realizes the functions such as database interaction, client event treatment.Listening port after the program startup of Web service end, to step on
Employ family and set up service, while set up being connected with the socket of Web client program.Web client program realizes threedimensional model
Display, VR such as show at the function, wherein, Web client program may operate on the browser of user.Web client program with
The program connection of Web service end, sends self information, and receive other Web clients of Web service end transmission to Web service end
Information and system command.
Based on the above-mentioned network architecture, the present invention can have following several control models：
The single control of multi-user：
After certain Web client obtains ownership, all ginsengs changed in the virtual scene that the Web client will be run
Number is sent to Web service end (including the position of threedimensional model, the anglec of rotation, camera position and parameter etc. angle), Web service
End can update the parameter value for storing thereon, other Web clients then be sent these parameters to, to update other web clients
The interface shown on end.
The many people's controls of multi-user：
Server end first store in virtual scene initial parameter (including all models and apparatus three-dimensional coordinate, rotation
The information such as angle), after certain several client is simultaneously mobile or rotates certain model or apparatus, client can at once by more
The variable for changing is sent to server, and message is pressed into message queue by server successively in chronological order, and changes server successively
On value, then all of client is broadcast to, to reach the purpose of all clients synchronized update.
The single control of single user：
In this control mode, user need to only carry out pseudo operation in corresponding Web client, the Web client without
Need to be communicated with Web service end.
Figure 10 diagrammatically illustrates the block diagram of the surgical simulation device based on Web according to an embodiment of the invention.
Reference picture 10, the surgical simulation device 1000 based on Web according to an embodiment of the invention, including：Obtain
Unit 1002, construction unit 1004, loading unit 1006, release unit 1008 and processing unit 1010.
Specifically, acquiring unit 1002 is used to obtain the modeling file generated according to medical image, and the modeling file is used
In being shown in virtual environment and interacted；Construction unit 1004 is used to build the virtual scene based on Web；Loading unit
1006 are used to be loaded onto the modeling file in the virtual scene；Release unit 1008 is used to add by the modeling file
After being loaded onto in the virtual scene, the virtual scene is distributed to Web ends；Processing unit 1010 is used to be based on being distributed to institute
State the virtual scene sham operated process at Web ends.
It should be noted that the detail of each module/unit is right in the above-mentioned surgical simulation device based on Web
It is described in detail in the surgical simulation method based on Web answered, therefore here is omitted.
Additionally, embodiments of the present invention also provide a kind of electronic equipment, can include：Processor and memory, wherein,
The memory storage has executable instruction, and the processor is used to call the executable instruction of the memory storage to perform such as
The surgical simulation method based on Web described in the above embodiment of the present invention.
In the exemplary embodiment, a kind of non-transitorycomputer readable storage medium including instructing, example are additionally provided
Such as include the memory of instruction, above-mentioned instruction can be upper with complete in the exemplary embodiment by the computing device of electronic equipment
State technical scheme.For example, the non-transitorycomputer readable storage medium can be ROM, random access memory (RAM),
CD-ROM, tape, floppy disk and optical data storage devices etc..
Although it should be noted that being referred to some modules or list of the equipment for action executing in above-detailed
Unit, but this division is not enforceable.In fact, according to the embodiment of the present invention, it is above-described two or more
The feature and function of module or unit can embody in a module or unit.Conversely, an above-described mould
The feature and function of block or unit can be further divided into being embodied by multiple modules or unit.
Through the above description of the embodiments, those skilled in the art is it can be readily appreciated that example described herein is implemented
Mode can be realized by software, it is also possible to be realized by way of software is with reference to necessary hardware.Therefore, according to the present invention
The technical scheme of implementation method can be embodied in the form of software product, and the software product can store non-volatile at one
Property storage medium (can be CD-ROM, USB flash disk, mobile hard disk etc.) in or network on, including some instructions are causing a calculating
Equipment (can be personal computer, server, touch control terminal or network equipment etc.) is performed according to embodiment of the present invention
Method.
Those skilled in the art considering specification and after putting into practice invention disclosed herein, will readily occur to it is of the invention its
Its embodiment.The application is intended to any modification of the invention, purposes or adaptations, these modifications, purposes or
Person's adaptations follow general principle of the invention and including undocumented common knowledge in the art of the invention
Or conventional techniques.Description and embodiments are considered only as exemplary, and true scope and spirit of the invention are by following
Claim is pointed out.
It should be appreciated that the invention is not limited in the precision architecture being described above and be shown in the drawings, and
And can without departing from the scope carry out various modifications and changes.The scope of the present invention is only limited by appended claim.
Claims (14)
1. a kind of surgical simulation method based on Web, it is characterised in that including：
The modeling file generated according to medical image is obtained, the modeling file is used to be shown and be handed in virtual environment
Mutually；
Build the virtual scene based on Web；
The modeling file is loaded onto in the virtual scene；
After the modeling file is loaded onto in the virtual scene, the virtual scene is distributed to Web ends；
Based on the virtual scene sham operated process for being distributed to the Web ends.
2. surgical simulation method according to claim 1, it is characterised in that obtain the modeling text generated according to medical image
The step of part, including：
Obtain the medical image that user terminal sends；The modeling file is generated based on the medical image；Or
Obtain the modeling file generated according to the medical image that user terminal sends.
3. surgical simulation method according to claim 2, it is characterised in that based on being built described in medical image generation
In the case of mould file, based on the medical image generate the modeling file the step of, including：
Obtain the dissection comprising focus and/or organ gathered by the first image documentation equipment and function that the user terminal sends
First image file of information, wherein, first image file is according to clinical demand and needs to be presented in virtual scene
Focus and/or organ information gathering；
Three-dimensional reconstruction is carried out based on first image file, file is rebuild in generation；
The form of the reconstruction file is converted into the file format that the virtual scene is supported, to obtain the modeling file.
4. surgical simulation method according to claim 3, it is characterised in that three-dimensional is carried out based on first image file
Rebuild, generate the step of rebuilding file, including：
According to the picture characteristics of first image file, the division of area-of-interest is carried out to first image file；
Image segmentation and three-dimensional reconstruction are carried out to first image file based on the area-of-interest for dividing, to obtain pin
To the reconstruction file of area-of-interest each described.
5. surgical simulation method according to claim 3, it is characterised in that also include：
The focus gathered by the first image documentation equipment and/or organ for obtaining the user terminal transmission are in out of phase
Multiple first image files of phase, and/or by the second image documentation equipment gather the dissection comprising the focus and/or organ and
Second image file of function information；
Reconstruction file to being generated according to the multiple first image file carries out the image based on anatomical structure and phase time
Registration process, and/or reconstruction file and the reconstruction file of first image file to second image file carries out base
Processed in the image registration of anatomical features point.
6. surgical simulation method according to claim 1, it is characterised in that also include：
In operating theater instruments and/or intervening equipment required for loading simulation surgical procedure in the virtual scene.
7. surgical simulation method according to claim 1, it is characterised in that also include：
Obtain the configuration information of the terminal device of operation Web client；
Judge whether the terminal device can show the virtual scene according to the configuration information；
If it is determined that the terminal device can show the virtual scene, then the configuration of communication interface is sent to the terminal device
Instruction, the terminal device connection external equipment is controlled with based on the configuration-direct.
8. the surgical simulation method according to any one of claim 1, it is characterised in that also include：
There are multiple Web clients while when running the virtual scene, at least one of the multiple Web client
Web client distributes the control authority to the virtual scene.
9. surgical simulation method according to claim 8, it is characterised in that in the multiple Web client
In the case that individual Web client distributes the control authority to the virtual scene, also include：
Obtain the parameters value changed in the virtual scene run in one Web client；
According to the parameters value for getting, the parameter at Web service end is updated, and the parameters value is sent to institute
Other clients in multiple Web clients are stated, to update the parameter in the virtual scene run in described other clients.
10. surgical simulation method according to claim 8, it is characterised in that in the multiple Web client extremely
In the case that few two Web clients distribute the control authority to the virtual scene, also include：
Obtain the parameters value changed in the virtual scene run at least two Web client；
According to the parameters value for getting, the parameter at Web service end is updated, and the parameters value is sent to institute
Each client in multiple Web clients is stated, to update the every ginseng in the virtual scene run in described each client
Number.
11. surgical simulation methods according to claim 1, it is characterised in that also include：
When there is a Web client to run the virtual scene, to the distribution of one Web client to the virtual scene
Control authority.
The 12. surgical simulation method according to any one of claim 1 to 11, it is characterised in that also include：
Generate entrance of the virtual scene at Web ends；
The information of the entrance is pushed to user, wherein, the information of the entrance includes：The link of the network address and/or it is used for
Triggering enters the Quick Response Code of the entrance.
A kind of 13. surgical simulation devices based on Web, it is characterised in that including：
Acquiring unit, for obtaining the modeling file generated according to medical image, the modeling file is used in virtual environment
Shown and interacted；
Construction unit, for building the virtual scene based on Web；
Loading unit, for the modeling file to be loaded onto in the virtual scene；
Release unit, for after the modeling file is loaded onto in the virtual scene, by virtual scene issue
To Web ends；
Processing unit, for based on the virtual scene sham operated process for being distributed to the Web ends.
14. a kind of electronic equipment, it is characterised in that including：Processor and memory, the memory storage have executable finger
Order, the processor is used to call the executable instruction of the memory storage to perform such as any one of claim 1 to 12 institute
The surgical simulation method stated.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710214646.3A CN106874700A (en) | 2017-04-01 | 2017-04-01 | Surgical simulation method, surgical simulation device and electronic equipment based on Web |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710214646.3A CN106874700A (en) | 2017-04-01 | 2017-04-01 | Surgical simulation method, surgical simulation device and electronic equipment based on Web |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106874700A true CN106874700A (en) | 2017-06-20 |
Family
ID=59160699
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710214646.3A Pending CN106874700A (en) | 2017-04-01 | 2017-04-01 | Surgical simulation method, surgical simulation device and electronic equipment based on Web |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106874700A (en) |
Cited By (21)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107481254A (en) * | 2017-08-24 | 2017-12-15 | 上海术理智能科技有限公司 | Processing method, device, medium and the electronic equipment of medical image |
| CN107578434A (en) * | 2017-08-25 | 2018-01-12 | 上海嘉奥信息科技发展有限公司 | VR rendering intents and system based on 3D point cloud rapid registering |
| CN107948159A (en) * | 2017-11-27 | 2018-04-20 | 宁波市科技园区明天医网科技有限公司 | A kind of method of medical image simultaneous display and diagnostic operation based on browser |
| CN108156443A (en) * | 2017-12-21 | 2018-06-12 | 成都真实维度科技有限公司 | A kind of operation VR live streaming platforms and its business model |
| WO2019051787A1 (en) * | 2017-09-15 | 2019-03-21 | 深圳迈瑞生物医疗电子股份有限公司 | Access method for remote consultation and consultation terminal |
| CN109767847A (en) * | 2019-02-01 | 2019-05-17 | 深圳安泰创新科技股份有限公司 | The medical method, apparatus of tele-medicine and computer readable storage medium |
| CN109785938A (en) * | 2018-12-03 | 2019-05-21 | 深圳市旭东数字医学影像技术有限公司 | Medical image three-dimensional visualization processing method and system based on web |
| CN110163959A (en) * | 2019-05-22 | 2019-08-23 | 图兮深维医疗科技（苏州）有限公司 | A kind of medical image three-dimensional stereo reconstruction device and equipment |
| CN110246585A (en) * | 2019-05-22 | 2019-09-17 | 江西省人民医院 | Neurodegenerative disease diagnosis and therapy system based on big data and VR technology |
| CN111128350A (en) * | 2019-12-25 | 2020-05-08 | 北京爱康宜诚医疗器材有限公司 | Online editing method and device |
| CN111161853A (en) * | 2019-12-25 | 2020-05-15 | 北京爱康宜诚医疗器材有限公司 | Online display method and device |
| CN111261265A (en) * | 2020-01-14 | 2020-06-09 | 于金明 | Medical image system based on virtual intelligent medical platform |
| CN111311705A (en) * | 2020-02-14 | 2020-06-19 | 广州柏视医疗科技有限公司 | High-adaptability medical image multi-plane reconstruction method and system based on webgl |
| CN111383328A (en) * | 2020-02-27 | 2020-07-07 | 西安交通大学 | 3D visualization method and system for breast cancer focus |
| CN111553979A (en) * | 2020-05-26 | 2020-08-18 | 广州狄卡视觉科技有限公司 | Operation auxiliary system and method based on medical image three-dimensional reconstruction |
| CN111986813A (en) * | 2020-07-06 | 2020-11-24 | 北京欧应信息技术有限公司 | Method for automatically generating three-dimensional surgical model based on surgical record |
| CN113608978A (en) * | 2021-07-15 | 2021-11-05 | 荣耀终端有限公司 | Test method, test device and computer readable storage medium |
| CN113808728A (en) * | 2021-09-02 | 2021-12-17 | 武汉联影医疗科技有限公司 | Medical equipment management method and device, computer equipment and storage medium |
| CN114121218A (en) * | 2021-11-26 | 2022-03-01 | 中科麦迪人工智能研究院(苏州)有限公司 | Virtual scene construction method, device, equipment and medium applied to operation |
| CN114201098A (en) * | 2021-12-06 | 2022-03-18 | 北京泽桥医疗科技股份有限公司 | Medical teaching courseware generation method, device and equipment based on three-dimensional modeling |
| CN117689814A (en) * | 2023-12-11 | 2024-03-12 | 苏州睿酷医疗科技有限责任公司 | Virtual reality medical data display method and system |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO1998037517A1 (en) * | 1997-02-25 | 1998-08-27 | Wake Forest University | Automatic analysis in virtual endoscopy |
| CN1801214A (en) * | 2005-11-18 | 2006-07-12 | 厦门大学 | Apparatus and method for processing tumor image information based on digital virtual organ |
| CN101976458A (en) * | 2010-10-15 | 2011-02-16 | 华中科技大学 | Medical image three-dimensional visualization method applied to mobile handheld equipment |
| CN105512467A (en) * | 2015-11-30 | 2016-04-20 | 湖北融创三维数字医学科技有限公司 | Digit visualization mobile terminal medical method |
| CN106200982A (en) * | 2016-07-26 | 2016-12-07 | 南京意斯伽生态科技有限公司 | A kind of medical surgery training system based on virtual reality technology |
| CN106251381A (en) * | 2016-07-29 | 2016-12-21 | 上海联影医疗科技有限公司 | Image rebuilding method |
-
2017
- 2017-04-01 CN CN201710214646.3A patent/CN106874700A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO1998037517A1 (en) * | 1997-02-25 | 1998-08-27 | Wake Forest University | Automatic analysis in virtual endoscopy |
| CN1801214A (en) * | 2005-11-18 | 2006-07-12 | 厦门大学 | Apparatus and method for processing tumor image information based on digital virtual organ |
| CN101976458A (en) * | 2010-10-15 | 2011-02-16 | 华中科技大学 | Medical image three-dimensional visualization method applied to mobile handheld equipment |
| CN105512467A (en) * | 2015-11-30 | 2016-04-20 | 湖北融创三维数字医学科技有限公司 | Digit visualization mobile terminal medical method |
| CN106200982A (en) * | 2016-07-26 | 2016-12-07 | 南京意斯伽生态科技有限公司 | A kind of medical surgery training system based on virtual reality technology |
| CN106251381A (en) * | 2016-07-29 | 2016-12-21 | 上海联影医疗科技有限公司 | Image rebuilding method |
Cited By (27)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107481254A (en) * | 2017-08-24 | 2017-12-15 | 上海术理智能科技有限公司 | Processing method, device, medium and the electronic equipment of medical image |
| CN107578434A (en) * | 2017-08-25 | 2018-01-12 | 上海嘉奥信息科技发展有限公司 | VR rendering intents and system based on 3D point cloud rapid registering |
| CN111052258A (en) * | 2017-09-15 | 2020-04-21 | 深圳迈瑞生物医疗电子股份有限公司 | Remote consultation access method and consultation terminal |
| WO2019051787A1 (en) * | 2017-09-15 | 2019-03-21 | 深圳迈瑞生物医疗电子股份有限公司 | Access method for remote consultation and consultation terminal |
| CN107948159A (en) * | 2017-11-27 | 2018-04-20 | 宁波市科技园区明天医网科技有限公司 | A kind of method of medical image simultaneous display and diagnostic operation based on browser |
| CN107948159B (en) * | 2017-11-27 | 2021-04-20 | 宁波市科技园区明天医网科技有限公司 | Medical image synchronous display and diagnosis operation method based on browser |
| CN108156443A (en) * | 2017-12-21 | 2018-06-12 | 成都真实维度科技有限公司 | A kind of operation VR live streaming platforms and its business model |
| CN109785938A (en) * | 2018-12-03 | 2019-05-21 | 深圳市旭东数字医学影像技术有限公司 | Medical image three-dimensional visualization processing method and system based on web |
| CN109767847A (en) * | 2019-02-01 | 2019-05-17 | 深圳安泰创新科技股份有限公司 | The medical method, apparatus of tele-medicine and computer readable storage medium |
| CN110163959A (en) * | 2019-05-22 | 2019-08-23 | 图兮深维医疗科技（苏州）有限公司 | A kind of medical image three-dimensional stereo reconstruction device and equipment |
| CN110246585A (en) * | 2019-05-22 | 2019-09-17 | 江西省人民医院 | Neurodegenerative disease diagnosis and therapy system based on big data and VR technology |
| CN111128350A (en) * | 2019-12-25 | 2020-05-08 | 北京爱康宜诚医疗器材有限公司 | Online editing method and device |
| CN111161853A (en) * | 2019-12-25 | 2020-05-15 | 北京爱康宜诚医疗器材有限公司 | Online display method and device |
| CN111128350B (en) * | 2019-12-25 | 2023-09-08 | 北京爱康宜诚医疗器材有限公司 | Online editing method and device |
| CN111261265A (en) * | 2020-01-14 | 2020-06-09 | 于金明 | Medical image system based on virtual intelligent medical platform |
| CN111261265B (en) * | 2020-01-14 | 2024-02-27 | 上海联影医疗科技股份有限公司 | Medical imaging system based on virtual intelligent medical platform |
| CN111311705B (en) * | 2020-02-14 | 2021-06-04 | 广州柏视医疗科技有限公司 | High-adaptability medical image multi-plane reconstruction method and system based on webgl |
| CN111311705A (en) * | 2020-02-14 | 2020-06-19 | 广州柏视医疗科技有限公司 | High-adaptability medical image multi-plane reconstruction method and system based on webgl |
| CN111383328A (en) * | 2020-02-27 | 2020-07-07 | 西安交通大学 | 3D visualization method and system for breast cancer focus |
| CN111553979A (en) * | 2020-05-26 | 2020-08-18 | 广州狄卡视觉科技有限公司 | Operation auxiliary system and method based on medical image three-dimensional reconstruction |
| CN111553979B (en) * | 2020-05-26 | 2023-12-26 | 广州雪利昂生物科技有限公司 | Operation auxiliary system and method based on three-dimensional reconstruction of medical image |
| CN111986813A (en) * | 2020-07-06 | 2020-11-24 | 北京欧应信息技术有限公司 | Method for automatically generating three-dimensional surgical model based on surgical record |
| CN113608978A (en) * | 2021-07-15 | 2021-11-05 | 荣耀终端有限公司 | Test method, test device and computer readable storage medium |
| CN113808728A (en) * | 2021-09-02 | 2021-12-17 | 武汉联影医疗科技有限公司 | Medical equipment management method and device, computer equipment and storage medium |
| CN114121218A (en) * | 2021-11-26 | 2022-03-01 | 中科麦迪人工智能研究院(苏州)有限公司 | Virtual scene construction method, device, equipment and medium applied to operation |
| CN114201098A (en) * | 2021-12-06 | 2022-03-18 | 北京泽桥医疗科技股份有限公司 | Medical teaching courseware generation method, device and equipment based on three-dimensional modeling |
| CN117689814A (en) * | 2023-12-11 | 2024-03-12 | 苏州睿酷医疗科技有限责任公司 | Virtual reality medical data display method and system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106874700A (en) | Surgical simulation method, surgical simulation device and electronic equipment based on Web | |
| McJunkin et al. | Development of a mixed reality platform for lateral skull base anatomy | |
| US20200388363A1 (en) | Extended reality medical report generating system | |
| CN106974730A (en) | Surgical simulation method, device and equipment based on virtual reality and medical image | |
| JP7522269B2 (en) | Medical image processing method, medical image processing device, medical image processing system, and medical image processing program | |
| JP2021512440A (en) | Patient Engagement Systems and Methods | |
| JP2017501459A (en) | Advanced medical image processing wizard | |
| CN106569673A (en) | Multi-media case report displaying method and displaying device for multi-media case report | |
| CN110021445A (en) | A kind of medical system based on VR model | |
| Pires et al. | On the use of virtual reality for medical imaging visualization | |
| JP2022077991A (en) | Medical image processing apparatus, medical image processing method, medical image processing program, model training apparatus, and training method | |
| CN111383328A (en) | 3D visualization method and system for breast cancer focus | |
| Izard et al. | NextMed: How to enhance 3D radiological images with Augmented and Virtual Reality | |
| Abou El-Seoud et al. | An interactive mixed reality ray tracing rendering mobile application of medical data in minimally invasive surgeries | |
| JP3989896B2 (en) | Medical image processing apparatus, region of interest extraction method, and program | |
| Prutsch et al. | Design and development of a web-based tool for inpainting of dissected aortae in angiography images | |
| Bucioli et al. | Holographic real time 3D heart visualization from coronary tomography for multi-place medical diagnostics | |
| CN114340496A (en) | Analysis method and related device of heart coronary artery based on VRDS AI medical image | |
| CN108877897A (en) | Dental diagnostic scheme generation method, device and diagnosis and therapy system | |
| US20230290085A1 (en) | Systems and Methods for Displaying Layered Augmented Anatomical Features | |
| McGhee | 3‐D visualization and animation technologies in anatomical imaging | |
| CN112950774A (en) | Three-dimensional modeling device, operation planning system and teaching system | |
| Marsh et al. | VR in medicine: virtual colonoscopy | |
| JP2011212099A (en) | Anatomy diagram generation method and apparatus, and program | |
| Chen et al. | A system design for virtual reality visualization of medical image |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170620 |