CN106708260A - Generation method and device for virtual reality surgery scene - Google Patents
Generation method and device for virtual reality surgery scene Download PDFInfo
- Publication number
- CN106708260A CN106708260A CN201611095182.0A CN201611095182A CN106708260A CN 106708260 A CN106708260 A CN 106708260A CN 201611095182 A CN201611095182 A CN 201611095182A CN 106708260 A CN106708260 A CN 106708260A
- Authority
- CN
- China
- Prior art keywords
- virtual reality
- operation technique
- information
- surgical scene
- feedback
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B5/00—Electrically-operated educational appliances
- G09B5/02—Electrically-operated educational appliances with visual presentation of the material to be studied, e.g. using film strip
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H50/00—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
- G16H50/50—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for simulation or modelling of medical disorders
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Health & Medical Sciences (AREA)
- Public Health (AREA)
- Medical Informatics (AREA)
- General Engineering & Computer Science (AREA)
- Geometry (AREA)
- Databases & Information Systems (AREA)
- Business, Economics & Management (AREA)
- Software Systems (AREA)
- Human Computer Interaction (AREA)
- Biomedical Technology (AREA)
- Data Mining & Analysis (AREA)
- Computer Graphics (AREA)
- Educational Technology (AREA)
- Pathology (AREA)
- Educational Administration (AREA)
- Epidemiology (AREA)
- General Health & Medical Sciences (AREA)
- Primary Health Care (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The embodiment of the invention discloses a generation method and device for a virtual reality surgery scene. The method comprises the following steps that: collecting the sign data of a target human body, and generating a virtual reality human shape model according to the sign data, wherein the sign data comprises three-dimensional data, the index data of each human body position, the index data of each human body tissue and the like; when a surgery operation instruction input by aiming at the virtual reality human shape model is received, obtaining the surgery operation information, wherein the surgery operation information comprises a surgery operation gesture; and carrying out synthetic processing on the virtual reality human shape model and the surgery operation information to generate a virtual reality surgery scene, and outputting the virtual reality surgery scene. When the method is adopted, the surgery is trained to enrich surgery operation ways and improve the success rate of the surgery.
Description
Technical field
The present invention relates to field of computer technology, more particularly to a kind of virtual reality surgical scene generation method and device.
Background technology
With development in science and technology, medical knowledge also increasingly improves with technology, but complex now accurate for completing
The difficulty of operation is still very high.
In view of this, the correlation technique of many operation/medical auxiliary systems or method is proposed successively, it is desirable to by software and hardware
With reference to mode combination specialized medical knowledge and relevant hardware devices and formed with accessory system, be used to produce preoperative planning conduct
Assessment, prediction or planning before medical act or operation execution, but during actual operation, may not conformed to due to surgery planning
It is suitable, or the original such as operational error is so that operative failure, reduces the success rate of operation.
The content of the invention
Embodiment of the present invention technical problem to be solved is, there is provided a kind of virtual reality surgical scene generation method and
Device, by the training to performing the operation, enriches the mode of operation technique, improves the success rate of operation.
In order to solve the above-mentioned technical problem, a kind of virtual reality surgical scene generation method is the embodiment of the invention provides,
Methods described includes：
The sign data of target body is gathered, the humanoid model of virtual reality, the sign are generated according to the sign data
Data are including the achievement data of three-dimensional data, the achievement data of each human body and each tissue etc.；
When the operation technique instruction for the humanoid model input of the virtual reality is received, operation technique letter is obtained
Breath, the operation technique information includes operation technique gesture；
The humanoid model of the virtual reality and the operation technique information are carried out into synthesis treatment to generate virtual reality hand
Art scene, and the virtual reality surgical scene is exported.
Optionally, the operation technique information is also identified including operation technique human body；
It is described that the virtual reality manikin and the operation technique information are carried out into synthesis treatment to generate virtual reality
Border surgical scene, including：
By the position of the indicated virtual reality manikin of operation technique human body mark and the operation behaviour
Making a sign with the hand carries out synthesis treatment to generate virtual reality surgical scene.
Optionally, it is described to be exported the virtual reality surgical scene, including：
The virtual reality surgical scene is shown using default display effect in virtual reality display interface.
Optionally, it is described that the virtual reality manikin and the operation technique information are carried out into synthesis treatment to generate
After virtual reality surgical scene, also include：
Feedback information is exported according to the operation technique information in real time, the feedback information includes that feedback is normal and feedback is different
Often.
Optionally, it is described feedback information is exported according to the operation technique information in real time after, also include：
When the feedback information is abnormal for feedback, output abnormality prompt message.
Correspondingly, the embodiment of the present invention additionally provides a kind of virtual reality surgical scene generating means, and described device includes：
Model generation module, the sign data for gathering target body generates virtual reality according to the sign data
Humanoid model, the sign data includes the index number of three-dimensional data, the achievement data of each human body and each tissue
According to etc.；
Data obtaining module, for working as the operation technique instruction received for the humanoid model input of the virtual reality
When, operation technique information is obtained, the operation technique information includes operation technique gesture；
Scenario generating module, for the humanoid model of the virtual reality to be carried out into synthesis treatment with the operation technique information
To generate virtual reality surgical scene, and the virtual reality surgical scene is exported.
Optionally, the operation technique information is also identified including operation technique human body；
The scenario generating module specifically for：
By the position of the indicated virtual reality manikin of operation technique human body mark and the operation behaviour
Making a sign with the hand carries out synthesis treatment to generate virtual reality surgical scene, and the virtual reality surgical scene is exported.
Optionally, the scenario generating module specifically for：
The humanoid model of the virtual reality and the operation technique information are carried out into synthesis treatment to generate virtual reality hand
Art scene, the virtual reality surgical scene is shown in virtual reality display interface using default display effect.
Optionally, described device also includes：
Feedback information output module, for exporting feedback information, the feedback letter in real time according to the operation technique information
Breath includes that feedback is normal and feedback is abnormal.
Optionally, described device also includes：
Prompt message output module, for being output abnormality prompt message when feeding back abnormal in the feedback information.
In embodiments of the present invention, virtual reality surgical scene generating means collection target body three-dimensional data, each one
The sign datas such as the achievement data of the achievement data of body region and each tissue, to generate the humanoid model of virtual reality, when
When the operation technique received for the humanoid model input of the virtual reality is instructed, corresponding operation technique information is obtained, and
The humanoid model of virtual reality and operation technique information are carried out into synthesis treatment to generate virtual reality surgical scene while carrying out defeated
Go out.Operative training is carried out by the humanoid model of virtual reality for generating so that surgical staff can be to operation technique and operation effect
Fruit carries out anticipation, enriches the mode of operation technique, and improve the success rate of operation.
Brief description of the drawings
In order to illustrate more clearly about the embodiment of the present invention or technical scheme of the prior art, below will be to embodiment or existing
The accompanying drawing to be used needed for having technology description is briefly described, it should be apparent that, drawings in the following description are only this
Some embodiments of invention, for those of ordinary skill in the art, on the premise of not paying creative work, can be with
Other accompanying drawings are obtained according to these accompanying drawings.
Fig. 1 is a kind of schematic flow sheet of the virtual reality surgical scene generation method in the embodiment of the present invention；
Fig. 2 is the schematic flow sheet of another virtual reality surgical scene generation method in the embodiment of the present invention；
Fig. 3 is a kind of structural representation of the virtual reality surgical scene generating means in the embodiment of the present invention；
Fig. 4 is the structural representation of another middle virtual reality surgical scene generating means in the embodiment of the present invention；
Fig. 5 is a kind of computer system for performing above-mentioned virtual reality surgical scene generation method in the embodiment of the present invention
Organization Chart.
Specific embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is carried out clear, complete
Site preparation is described, it is clear that described embodiment is only a part of embodiment of the invention, rather than whole embodiments.It is based on
Embodiment in the present invention, it is every other that those of ordinary skill in the art are obtained under the premise of creative work is not made
Embodiment, belongs to the scope of protection of the invention.
Term " comprising " and " having " in description and claims of this specification and above-mentioned accompanying drawing and they appoint
What deforms, it is intended that covering is non-exclusive to be included.For example contain process, method, system, the product of series of steps or unit
Product or equipment are not limited to the step of having listed or unit, but alternatively also include the step of not listing or unit, or
Alternatively also include for these processes, method, product or other intrinsic steps of equipment or unit.
The execution of the virtual reality surgical scene generation method referred in the embodiment of the present invention depends on computer program, can
Run on the computer system of Feng Ruoyiman systems based on information virtual reality surgical scene generating means.The department of computer science
System can be PC, panel computer, notebook computer, smart mobile phone, palm PC and mobile internet device (MID)
Deng terminal device.
It is described in detail individually below.
Fig. 1 is a kind of schematic flow sheet of virtual reality surgical scene generation method in the embodiment of the present invention, as shown in the figure
Methods described at least includes：
Step S101, gathers the sign data of target body, and the humanoid model of virtual reality is generated according to the sign data,
The sign data is including the achievement data of three-dimensional data, the achievement data of each human body and each tissue etc.；
Specifically, the sign data include three-dimensional data, each human body achievement data (such as heartbeat number of times/
Point, the information such as the index content of each organ such as blood pressure, blood fat index and size, the structure of each organ) and each human body
Achievement data of tissue etc..Wherein, the three-dimensional data at least height information including target body, body weight information and measurements of the chest, waist and hips information
Deng.
The sign data of the collection target body, the humanoid model of virtual reality is generated according to the sign data, can be with
Understand, the figure information of target body can be gathered by camera, such as by camera according to preset order to target person
Body is scanned, and etc. height information of the figure information at least including user, body weight information and measurements of the chest, waist and hips information, then passes through
X-ray fluoroscopy human body and organizational information；Can also be input every human parameters information that detection is obtained in advance.
In specific implementation, when the humanoid model signals of structure are detected or received, such as detect and shown for virtual reality
Trigger signal and the default structures such as the operating gesture being input into during the manikin touch control operation of interface input or by body-sensing instrument
When model trigger message matches etc. under triggering situation, virtual reality surgical scene generating means start camera and X-ray check
Equipment carries out the collection of sign data, and the humanoid model of virtual reality is generated further according to these sign datas for gathering, wherein, it is described
The generation humanoid model of virtual reality can be using default modeling algorithm or function and the sign data that will be collected as
|input paramete, to obtain corresponding output, the output is the humanoid model of virtual reality of generation；Can also be default
Corresponding humanoid model of sign data collected described in being searched in humanoid model information set, etc..
Optionally, the virtual reality matched with the target body can be built according to the sign data equal proportion for collecting
Humanoid model, the equal proportion can be 1:1, it is also possible to less than 1:1, do not limit specifically.
Step S102, when the operation technique instruction for the humanoid model input of the virtual reality is received, obtains
Operation technique information, the operation technique information includes operation technique gesture；
Specifically, instruction is the order for indicating computer to perform certain operation.It is made up of a string of binary numerals, generally
Including two parts：Command code and address code.Wherein, command code indicates the type or property of the instruction operation to be completed, such as
Fetch, do addition or output data etc., and address code then indicates the memory unit address at the interior perhaps place of operation object.According to
Instruction type, certain specific field of storage is referred to as " register (register) ", and the inside contains and can be used to recall instruction
Data or data storage location.Operation technique instruction is and indicates virtual reality surgical scene generating means to perform operation technique
Order.
In specific implementation, when doctor or other users are by wearing virtual reality (Virtual Reality, VR) eye
After the VR equipment such as mirror, VR gloves, VR dress ornaments enter virtual reality, operation behaviour is input into by virtual reality surgical scene generating means
When making, these operations are exactly series of instructions, virtual reality surgical scene for virtual reality surgical scene generating means
After generating means receive these instructions, according to instruction type, instruction is extracted from default memory and instruction is solved
Analysis, extracts the information that instruction is carried, such as operation technique gesture.The operation technique gesture can include fingers opening-closing degree, finger
The information such as flexibility, finger motion track etc., so as to accurately determine the operation of input.
Optionally, the operation technique information is also identified including operation technique human body, and the mark is used for unique identification
Human body, such as heart, liver, spleen, lung, kidney, Eye Ear Nose And Throat organ or each tissue, to determine operation technique position.
Step S103, synthesis treatment is carried out to generate void by the humanoid model of the virtual reality and the operation technique information
Intend real border surgical scene, and the virtual reality surgical scene is exported.
Specifically, the synthesis treatment is the operation technique that will be input into and corresponding human body is synthesized,
With the purpose for realizing performing the operation human body, using this synthesis processing procedure as virtual reality surgical scene, meanwhile, virtual real
The virtual reality display interface (interactive interface) of border surgical scene generating means is exported the scene, and the output can be
In real time.
Optionally, the virtual reality surgical scene can be shown using default display effect, it is described default aobvious
Show that effect can be in a rotational display of plane 180, or the rotational display of space 360, can also be to operative site
Amplify or the mode such as different colours is highlighted etc., be not especially limited herein.
In embodiments of the present invention, virtual reality surgical scene generating means collection target body three-dimensional data, each one
The sign datas such as the achievement data of the achievement data of body region and each tissue, to generate the humanoid model of virtual reality, when
When the operation technique received for the humanoid model input of the virtual reality is instructed, corresponding operation technique information is obtained, and
The humanoid model of virtual reality and operation technique information are carried out into synthesis treatment to generate virtual reality surgical scene while carrying out defeated
Go out.Operative training is carried out by the humanoid model of virtual reality for generating so that surgical staff can be to operation technique and operation effect
Fruit carries out anticipation, enriches the mode of operation technique, and improve the success rate of operation.
Fig. 2 is the schematic flow sheet of the virtual reality surgical scene generation method that another embodiment of the present invention is provided, and is such as schemed
Shown methods described at least includes：
Step S201, gathers the sign data of target body, and the humanoid model of virtual reality is generated according to the sign data,
The sign data is including the achievement data of three-dimensional data, the achievement data of each human body and each tissue etc.；
Specifically, the sign data include three-dimensional data, each human body achievement data (such as heartbeat number of times/
Point, the information such as the index content of each organ such as blood pressure, blood fat index and size, the structure of each organ) and each human body
Achievement data of tissue etc..Wherein, the three-dimensional data at least height information including target body, body weight information and measurements of the chest, waist and hips information
Deng.
The sign data of the collection target body, the humanoid model of virtual reality is generated according to the sign data, can be with
Understand, the figure information of target body can be gathered by camera, such as by camera according to preset order to target person
Body is scanned, and etc. height information of the figure information at least including user, body weight information and measurements of the chest, waist and hips information, then passes through
X-ray fluoroscopy human body and organizational information；Can also be input every human parameters information that detection is obtained in advance.
In specific implementation, when the humanoid model signals of structure are detected or received, such as detect and shown for virtual reality
Trigger signal and the default structures such as the operating gesture being input into during the manikin touch control operation of interface input or by body-sensing instrument
When model trigger message matches etc. under triggering situation, virtual reality surgical scene generating means start camera and X-ray check
Equipment carries out the collection of sign data, and the humanoid model of virtual reality is generated further according to these sign datas for gathering, wherein, it is described
The generation humanoid model of virtual reality can be using default modeling algorithm or function and the sign data that will be collected as
|input paramete, to obtain corresponding output, the output is the humanoid model of virtual reality of generation；Can also be default
Corresponding humanoid model of sign data collected described in being searched in humanoid model information set, etc..
Optionally, the virtual reality matched with the target body can be built according to the sign data equal proportion for collecting
Humanoid model, the equal proportion can be 1:1, it is also possible to less than 1:1, do not limit specifically.
Step S202, when the operation technique instruction for the humanoid model input of the virtual reality is received, obtains
Operation technique information, the operation technique information is identified including operation technique gesture operation technique human body；
Specifically, instruction is the order for indicating computer to perform certain operation.It is made up of a string of binary numerals, generally
Including two parts：Command code and address code.Wherein, command code indicates the type or property of the instruction operation to be completed, such as
Fetch, do addition or output data etc., and address code then indicates the memory unit address at the interior perhaps place of operation object.According to
Instruction type, certain specific field of storage is referred to as " register (register) ", and the inside contains and can be used to recall instruction
Data or data storage location.Operation technique instruction is and indicates virtual reality surgical scene generating means to perform operation technique
Order.
In specific implementation, when doctor or other users are by wearing virtual reality (Virtual Reality, VR) eye
After the VR equipment such as mirror, VR gloves, VR dress ornaments enter virtual reality, operation behaviour is input into by virtual reality surgical scene generating means
When making, these operations are exactly series of instructions, virtual reality surgical scene for virtual reality surgical scene generating means
After generating means receive these instructions, according to instruction type, instruction is extracted from default memory and instruction is solved
Analysis, extracts the information that instruction is carried, and such as operation technique gesture and operation technique human body is identified.The operation technique gesture can
With information, the finger motion track etc. such as including fingers opening-closing degree, digital flexion degree, so as to accurately determine the operation of input；It is described
Operation technique human body is identified for unique identification human body, such as the heart, liver, spleen, lung, kidney, Eye Ear Nose And Throat organ or
Each tissue, to determine operation technique position.
Optionally, be input into instruction can be received by the somatosensory device in virtual reality surgical scene generating means,
When user uses the equipment for the first time, can be debugged in advance, so that the collection that the operation of user is refined.
Step S203, by the position of the indicated virtual reality manikin of operation technique human body mark and institute
Stating operation technique gesture carries out synthesis treatment to generate virtual reality surgical scene, and in virtual reality display interface using default
Display effect shows the virtual reality surgical scene；
Specifically, the synthesis treatment is the operation technique that will be input into and corresponding human body is synthesized,
With the purpose for realizing performing the operation human body, specifically by the virtual reality manikin indicated by operation technique human body mark
Position (such as heart, liver, spleen, lung, kidney position) synthesized with operation technique gesture, this synthesis processing procedure be virtual reality
Border surgical scene generating process, meanwhile, on virtual reality display interface (the interaction circle of virtual reality surgical scene generating means
Face) scene is exported, the output can be real-time.Meanwhile, using default display effect to the virtual reality
Surgical scene is shown that the default display effect can be in a rotational display of plane 180, or space
360 rotational displays, can also be operative site to be amplified or the mode such as different colours is highlighted etc., not make specific herein
Limit.
Step S204, feedback information is exported according to the operation technique information in real time, and the feedback information is including feedback just
It is often abnormal with feedback；
Specifically, in the virtual reality surgical scene of foregoing description, humanoid model is carried out in real time to the operation being input into
Feedback, exports feedback information.The feedback information can be normal for feedback, and so operation is correct, and secondary operation is reasonable, this operation essence
Standard etc.；Can also be abnormal for feedback, such operating mistake, this operation has error, and this operation is unreasonable, and this operation can produce serious
Consequence etc..
Step S205, when the feedback information is abnormal for feedback, output abnormality prompt message.
If specifically, when the feedback information of output is for feedback exception, being pointed out.Can be with text, audio, video, flicker
The modes such as light are pointed out；Can also by different way be pointed out according to the abnormal order of severity of feedback, such as serious flicker red light,
Slight flashing yellow lamp, or serious reminding sound volume is big, and slight reminding sound volume is small, etc., does not limit specifically.
In embodiments of the present invention, virtual reality surgical scene generating means collection target body three-dimensional data, each one
The sign datas such as the achievement data of the achievement data of body region and each tissue, to generate the humanoid model of virtual reality, when
When the operation technique received for the humanoid model input of the virtual reality is instructed, corresponding operation technique information is obtained, and
The humanoid model of virtual reality and operation technique information are carried out into synthesis treatment to generate virtual reality surgical scene while carrying out defeated
Go out.Operative training is carried out by the humanoid model of virtual reality for generating so that surgical staff can be to operation technique and operation effect
Fruit carries out anticipation, enriches the mode of operation technique, and improve the success rate of operation.
Fig. 3 is a kind of composition structural representation of virtual reality surgical scene generating means provided in an embodiment of the present invention,
Described device includes as shown in the figure：
Model generation module 10, the sign data for gathering target body is virtual real according to sign data generation
The humanoid model in border, the sign data includes the index of three-dimensional data, the achievement data of each human body and each tissue
Data etc.；
Data obtaining module 20, the operation technique for that ought receive for the humanoid model input of the virtual reality refers to
When making, operation technique information is obtained, the operation technique information includes operation technique gesture；
Scenario generating module 30, for the humanoid model of the virtual reality to be carried out at synthesis with the operation technique information
Reason is exported the virtual reality surgical scene with generating virtual reality surgical scene.
Optionally, the operation technique information is also identified including operation technique human body；
The scenario generating module 30 specifically for：
By the position of the indicated virtual reality manikin of operation technique human body mark and the operation behaviour
Making a sign with the hand carries out synthesis treatment to generate virtual reality surgical scene, and the virtual reality surgical scene is exported.
Optionally, the scenario generating module 30 specifically for：
The humanoid model of the virtual reality and the operation technique information are carried out into synthesis treatment to generate virtual reality hand
Art scene, the virtual reality surgical scene is shown in virtual reality display interface using default display effect.
Optionally, as shown in figure 4, described device also includes：
Feedback information output module 40, for exporting feedback information, the feedback in real time according to the operation technique information
Information includes that feedback is normal and feedback is abnormal.
Optionally, as shown in figure 4, described device also includes：
Prompt message output module 50, for being output abnormality prompt message when feeding back abnormal in the feedback information.
In embodiments of the present invention, virtual reality surgical scene generating means collection target body three-dimensional data, each one
The sign datas such as the achievement data of the achievement data of body region and each tissue, to generate the humanoid model of virtual reality, when
When the operation technique received for the humanoid model input of the virtual reality is instructed, corresponding operation technique information is obtained, and
The humanoid model of virtual reality and operation technique information are carried out into synthesis treatment to generate virtual reality surgical scene while carrying out defeated
Go out.Operative training is carried out by the humanoid model of virtual reality for generating so that surgical staff can be to operation technique and operation effect
Fruit carries out anticipation, enriches the mode of operation technique, and improve the success rate of operation.
Fig. 5 illustrates a kind of calculating based on von Neumann system for running above-mentioned virtual reality surgical scene generation method
Machine system 10.The computer system 10 can be smart mobile phone, panel computer, palm PC, notebook computer or PC
Deng subscriber terminal equipment.Specifically, may include the outer input interface 1001 connected by system bus, processor 1002, depositing
Reservoir 1003 and output interface 1004.Wherein, outer input interface 1001 may include touch screen 10016, can also optionally wrap
Include network interface 10018.Memory 1003 may include external memory 10032 (such as hard disk, CD or floppy disk etc.) and memory storage
Device 10034.Output interface 1004 may include the equipment such as display screen 10042 and sound equipment/loudspeaker 10044.
In the present embodiment, the operation of this method is based on computer program, and the program file of the computer program is stored in
In the external memory 10032 of the foregoing computer system 10 based on von Neumann system, built-in storage is operationally loaded into
In 10034, then it is compiled as being transferred to be performed in processor 1002 after machine code, so that being based on von Neumann system
Computer system 10 in form model generation module 10 in logic, data obtaining module 20, scenario generating module 30, feedback
Message output module 40 and prompt message output module 50, and in above-mentioned virtual reality surgical scene generation method implementation procedure
In, the parameter of input is received by outer input interface 1001, and is transferred to be cached in memory 1003, is then input to place
Processed in reason device 1002, the result data for the treatment of or be cached in memory 1003 is subsequently processed, or is passed
Exported to output interface 1004.
One of ordinary skill in the art will appreciate that all or part of flow in realizing above-described embodiment method, can be
The hardware of correlation is instructed to complete by computer program, described program can be stored in a computer read/write memory medium
In, the program is upon execution, it may include such as the flow of the embodiment of above-mentioned each method.Wherein, described storage medium can be magnetic
Dish, CD, read-only memory (Read-Only Memory, ROM) or random access memory (Random Access
Memory, RAM) etc..
Above disclosed is only present pre-ferred embodiments, can not limit the right model of the present invention with this certainly
Enclose, therefore the equivalent variations made according to the claims in the present invention, still belong to the scope that the present invention is covered.
Claims (10)
1. a kind of virtual reality surgical scene generation method, it is characterised in that including：
The sign data of target body is gathered, the humanoid model of virtual reality, the sign data are generated according to the sign data
Including the achievement data of three-dimensional data, the achievement data of each human body and each tissue etc.；
When the operation technique instruction for the humanoid model input of the virtual reality is received, operation technique information is obtained,
The operation technique information includes operation technique gesture；
The humanoid model of the virtual reality and the operation technique information are carried out into synthesis treatment to generate virtual reality operation field
Scape, and the virtual reality surgical scene is exported.
2. the method for claim 1, it is characterised in that the operation technique information also includes operation technique human body
Mark；
It is described that the virtual reality manikin and the operation technique information are carried out into synthesis treatment to generate virtual reality hand
Art scene, including：
By the position of the indicated virtual reality manikin of operation technique human body mark and the operation technique hand
Gesture carries out synthesis treatment to generate virtual reality surgical scene.
3. the method for claim 1, it is characterised in that described to be exported the virtual reality surgical scene, bag
Include：
The virtual reality surgical scene is shown using default display effect in virtual reality display interface.
4. the method for claim 1, it is characterised in that described by the virtual reality manikin and the operation behaviour
Carry out synthesis treatment after generating virtual reality surgical scene, also to include as information：
Feedback information is exported according to the operation technique information in real time, the feedback information includes that feedback is normal and feedback is abnormal.
5. method as claimed in claim 4, it is characterised in that described that feedback letter is exported according to the operation technique information in real time
After breath, also include：
When the feedback information is abnormal for feedback, output abnormality prompt message.
6. a kind of virtual reality surgical scene generating means, it is characterised in that including：
Model generation module, the sign data for gathering target body generates virtual reality humanoid according to the sign data
Model, the sign data is including the achievement data of three-dimensional data, the achievement data of each human body and each tissue etc.；
Data obtaining module, for when receiving the operation technique for the input of the virtual reality humanoid model and instructing,
Operation technique information is obtained, the operation technique information includes operation technique gesture；
Scenario generating module, for the humanoid model of the virtual reality and the operation technique information to be carried out into synthesis treatment with life
Into virtual reality surgical scene, and the virtual reality surgical scene is exported.
7. device as claimed in claim 6, it is characterised in that the operation technique information also includes operation technique human body
Mark；
The scenario generating module specifically for：
By the position of the indicated virtual reality manikin of operation technique human body mark and the operation technique hand
Gesture carries out synthesis treatment to generate virtual reality surgical scene, and the virtual reality surgical scene is exported.
8. device as claimed in claim 6, it is characterised in that the scenario generating module specifically for：
The humanoid model of the virtual reality and the operation technique information are carried out into synthesis treatment to generate virtual reality operation field
Scape, the virtual reality surgical scene is shown in virtual reality display interface using default display effect.
9. device as claimed in claim 6, it is characterised in that described device also includes：
Feedback information output module, for exporting feedback information, the feedback information bag in real time according to the operation technique information
Include feedback normal abnormal with feedback.
10. device as claimed in claim 9, it is characterised in that described device also includes：
Prompt message output module, for being output abnormality prompt message when feeding back abnormal in the feedback information.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611095182.0A CN106708260A (en) | 2016-11-30 | 2016-11-30 | Generation method and device for virtual reality surgery scene |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611095182.0A CN106708260A (en) | 2016-11-30 | 2016-11-30 | Generation method and device for virtual reality surgery scene |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106708260A true CN106708260A (en) | 2017-05-24 |
Family
ID=58935469
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201611095182.0A Pending CN106708260A (en) | 2016-11-30 | 2016-11-30 | Generation method and device for virtual reality surgery scene |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106708260A (en) |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107978195A (en) * | 2017-12-29 | 2018-05-01 | 福州大学 | A kind of lateral cerebral ventricle puncture operative training system based on Virtual Reality Platform |
| CN108922300A (en) * | 2018-07-24 | 2018-11-30 | 杭州行开科技有限公司 | Surgical simulation 3D system based on digitized humans |
| CN109064817A (en) * | 2018-07-18 | 2018-12-21 | 杭州行开科技有限公司 | Surgery simulation system based on CT Three-dimension Reconstruction Model |
| CN109979266A (en) * | 2019-04-30 | 2019-07-05 | 邵阳学院 | A kind of human anatomy 3D tutoring system |
| CN111834021A (en) * | 2020-07-20 | 2020-10-27 | 北京百度网讯科技有限公司 | Data interaction method, device, equipment and storage medium |
| CN112422901A (en) * | 2020-10-30 | 2021-02-26 | 哈雷医用(广州)智能技术有限公司 | Method and device for generating operation virtual reality video |
| CN114121218A (en) * | 2021-11-26 | 2022-03-01 | 中科麦迪人工智能研究院(苏州)有限公司 | Virtual scene construction method, device, equipment and medium applied to operation |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| NL1017315C2 (en) * | 2001-02-08 | 2002-08-12 | Univ Delft Tech | Operating device for laparoscopic surgery training instrument, comprises body movable over flat surface and used to supply movement signals to instrument |
| CN103106348A (en) * | 2013-03-08 | 2013-05-15 | 上海交通大学医学院附属第九人民医院 | Virtual surgery simulation method and device thereof |
| CN104517016A (en) * | 2013-09-28 | 2015-04-15 | 南京专创知识产权服务有限公司 | Surgery simulation system using motion sensing technology and virtual reality technology |
| CN104916184A (en) * | 2015-06-16 | 2015-09-16 | 中国科学院自动化研究所 | Virtual operation simulation training system for preoperative training and training method thereof |
-
2016
- 2016-11-30 CN CN201611095182.0A patent/CN106708260A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| NL1017315C2 (en) * | 2001-02-08 | 2002-08-12 | Univ Delft Tech | Operating device for laparoscopic surgery training instrument, comprises body movable over flat surface and used to supply movement signals to instrument |
| CN103106348A (en) * | 2013-03-08 | 2013-05-15 | 上海交通大学医学院附属第九人民医院 | Virtual surgery simulation method and device thereof |
| CN104517016A (en) * | 2013-09-28 | 2015-04-15 | 南京专创知识产权服务有限公司 | Surgery simulation system using motion sensing technology and virtual reality technology |
| CN104916184A (en) * | 2015-06-16 | 2015-09-16 | 中国科学院自动化研究所 | Virtual operation simulation training system for preoperative training and training method thereof |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107978195A (en) * | 2017-12-29 | 2018-05-01 | 福州大学 | A kind of lateral cerebral ventricle puncture operative training system based on Virtual Reality Platform |
| CN109064817A (en) * | 2018-07-18 | 2018-12-21 | 杭州行开科技有限公司 | Surgery simulation system based on CT Three-dimension Reconstruction Model |
| CN108922300A (en) * | 2018-07-24 | 2018-11-30 | 杭州行开科技有限公司 | Surgical simulation 3D system based on digitized humans |
| CN109979266A (en) * | 2019-04-30 | 2019-07-05 | 邵阳学院 | A kind of human anatomy 3D tutoring system |
| CN111834021A (en) * | 2020-07-20 | 2020-10-27 | 北京百度网讯科技有限公司 | Data interaction method, device, equipment and storage medium |
| CN112422901A (en) * | 2020-10-30 | 2021-02-26 | 哈雷医用(广州)智能技术有限公司 | Method and device for generating operation virtual reality video |
| CN114121218A (en) * | 2021-11-26 | 2022-03-01 | 中科麦迪人工智能研究院(苏州)有限公司 | Virtual scene construction method, device, equipment and medium applied to operation |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106708260A (en) | Generation method and device for virtual reality surgery scene | |
| KR102014385B1 (en) | Method and apparatus for learning surgical image and recognizing surgical action based on learning | |
| CN107067856B (en) | Medical simulation training system and method | |
| CN109432753B (en) | Action correcting method, device, storage medium and electronic equipment | |
| CN107296650A (en) | Intelligent operation accessory system based on virtual reality and augmented reality | |
| CN103705306B (en) | Operation support system | |
| US9144407B2 (en) | Image processing device and method, and program | |
| CN111770735B (en) | Operation simulation information generation method and program | |
| CN106974730A (en) | Surgical simulation method, device and equipment based on virtual reality and medical image | |
| US11776123B2 (en) | Systems and methods for displaying augmented anatomical features | |
| US12040071B2 (en) | Method and program for providing feedback on surgical outcome | |
| CN107450714A (en) | Man-machine interaction support test system based on augmented reality and image recognition | |
| US10607363B2 (en) | Visualization of distances on an electroanatomical map | |
| KR102146672B1 (en) | Program and method for providing feedback about result of surgery | |
| CN107315915A (en) | A kind of simulated medical surgery method and system | |
| KR102628324B1 (en) | Device and method for analysing results of surgical through user interface based on artificial interlligence | |
| KR102298417B1 (en) | Program and method for generating surgical simulation information | |
| KR20190133423A (en) | Program and method for generating surgical simulation information | |
| US20230290085A1 (en) | Systems and Methods for Displaying Layered Augmented Anatomical Features | |
| CN111741729B (en) | Surgical optimization method and device | |
| KR101940706B1 (en) | Program and method for generating surgical simulation information | |
| EP4222697A1 (en) | Systems and methods for displaying augmented anatomical features | |
| CN114565741A (en) | Operation-assisted data processing method, device, equipment, medium and system | |
| CN112885435B (en) | Method, device and system for determining image target area | |
| KR20190133424A (en) | Program and method for providing feedback about result of surgery |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170524 |
|
| RJ01 | Rejection of invention patent application after publication |