CN109714571A - A kind of surgical wisdom supervisory systems - Google Patents

A kind of surgical wisdom supervisory systems Download PDF

Info

Publication number
CN109714571A
CN109714571A CN201811617158.8A CN201811617158A CN109714571A CN 109714571 A CN109714571 A CN 109714571A CN 201811617158 A CN201811617158 A CN 201811617158A CN 109714571 A CN109714571 A CN 109714571A
Authority
CN
China
Prior art keywords
information
surgical
motion capture
action message
server
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201811617158.8A
Other languages
Chinese (zh)
Inventor
张弟龙
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Chongqing College of Electronic Engineering
Original Assignee
Chongqing College of Electronic Engineering
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Chongqing College of Electronic Engineering filed Critical Chongqing College of Electronic Engineering
Priority to CN201811617158.8A priority Critical patent/CN109714571A/en
Publication of CN109714571A publication Critical patent/CN109714571A/en
Pending legal-status Critical Current

Links

Abstract

The present invention proposes a kind of surgical wisdom supervisory systems, comprising: at least one indoor VR camera lens of operation is set to, for shooting the panoramic video of operation;At least one motion capture device, for monitoring the action message at least one position;Server, for receiving the action message of the panoramic video and described at least one portion;The server is also used to rebuild the operation panoramic video using VR technology the surgical operation images of 3 D stereo;The server is also used to the physical condition information and local environment information of real-time monitoring motion capture object;And according to the action message at least one position, the physical condition information and the environmental information, the entire motion posture and entire motion information of the motion capture object are obtained.

Description

A kind of surgical wisdom supervisory systems
Technical field
The present invention relates to field of virtual reality, and in particular to a kind of surgical wisdom supervisory systems.
Background technique
Operation especially capital operation in hospital, requires whole video recording, so that other doctors of out operating-room can be with The process of operation is seen at any time, these operation video frequency data are also used as learning materials, for allowing old physician guidance youth to cure It is raw.
In the prior art, camera usually is arranged in indoor all angles of performing the operation to carry out whole video recording.But in reality In the operating room on border, since surgical procedure space is smaller, along with the hand and surgical instrument of doctor cause to block to sight, because This, these methods can only all record the substantially process of operation, and the details of operation much performed the operation still can not be observed in video recording.
Summary of the invention
In view of the foregoing deficiencies of prior art, the purpose of the present invention is to provide a kind of supervision of surgical wisdom is System, to solve the problems, such as that surgical procedure details can not be taken in the prior art.
In order to achieve the above objects and other related objects, the present invention provides a kind of surgical wisdom supervisory systems, comprising:
It is set at least one indoor VR camera lens of operation, for shooting the panoramic video of operation;
At least one motion capture device, for monitoring the action message at least one position;
Server, for receiving the action message of the panoramic video and described at least one portion;
The server is also used to rebuild the operation panoramic video using VR technology the surgical operation images of 3 D stereo;
The server is also used to the physical condition information and local environment information of real-time monitoring motion capture object;And According to the action message at least one position, the physical condition information and the environmental information, obtains the movement and catch Catch the entire motion posture and entire motion information of object;
The system further includes RFID reader, for identifying to the RFID tag being set on operation tool.
Optionally, the action message at least one position according to, the physical condition information and the environment Information obtains the entire motion posture and entire motion information of the motion capture object, specifically includes:
At the action message at one or more of positions, the physical condition information and the environmental information Reason, obtains location information, acceleration, angular speed and the Geomagnetism Information of the motion capture object, and according to the positional information, Acceleration, angular speed and Geomagnetism Information generate biomechanical model, and obtain the movement according to the biomechanical model and catch Catch the entire motion posture and entire motion information of object.
Optionally, the server carries out more medical educational scene also according to the data that the motion capture device obtains Newly.
Optionally, which further includes display equipment, for playing the surgical operation images of the 3 D stereo.
Optionally, the display equipment is VR wear-type eyeshade.
As described above, a kind of surgical wisdom supervisory systems of the invention, has the advantages that
The present invention is rebuild by the way that VR camera lens is arranged in operating room by the panoramic video that server shoots the VR camera lens At the surgical operation images of 3 D stereo, whole process of operation and details of operation therein, the operation of 3 D stereo can be not only taken Image can also restore the surgical scene of true stereo to doctor, be allowed to experience feeling on the spot in person, be conducive to later period teaching. Doctor can watch the index that various movements are subtle in oneself surgical procedure, doctor is helped to change by motion capture device simultaneously Into surgical skills and scientific research.
Specific embodiment
Illustrate embodiments of the present invention below by way of specific specific example, those skilled in the art can be by this specification Other advantages and efficacy of the present invention can be easily understood for disclosed content.The present invention can also pass through in addition different specific realities The mode of applying is embodied or practiced, the various details in this specification can also based on different viewpoints and application, without departing from Various modifications or alterations are carried out under spirit of the invention.It should be noted that in the absence of conflict, following embodiment and implementation Feature in example can be combined with each other.
The present invention provides a kind of surgical wisdom supervisory systems, comprising:
It is set at least one indoor VR camera lens of operation, for shooting the panoramic video of operation;
At least one motion capture device, for monitoring the action message at least one position;
Server, for receiving the action message of the panoramic video and described at least one portion;
The server is also used to rebuild the operation panoramic video using VR technology the surgical operation images of 3 D stereo;
The server is also used to the physical condition information and local environment information of real-time monitoring motion capture object;And According to the action message at least one position, the physical condition information and the environmental information, obtains the movement and catch Catch the entire motion posture and entire motion information of object;
The system further includes RFID reader, for identifying to the RFID tag being set on operation tool.
Specifically, RFID reader is set in ward, when RFID reader recognizes the label letter of RFID tag Number when, it is believed that the operation tool for being provided with RF tag is brought into ward, while server receives RFID tag Label mark level signal intensity judge that the RFID tag at a distance from RFID reader, can further be sentenced according to distance The position of disconnected operation tool.
Whether RFID reader identifies that the label signal of RFID tag can be mentioned by one LED light of setting Show, LED flashes if recognizing.
Action message, the physical condition information and the environmental information at least one position according to, obtain To the entire motion posture and entire motion information of the motion capture object, specifically include:
At the action message at one or more of positions, the physical condition information and the environmental information Reason, obtains location information, acceleration, angular speed and the Geomagnetism Information of the motion capture object, and according to the positional information, Acceleration, angular speed and Geomagnetism Information generate biomechanical model, and obtain the movement according to the biomechanical model and catch Catch the entire motion posture and entire motion information of object.
Specifically, the motion capture device includes:
MEMS sensor unit, the MEMS sensor unit is by mems accelerometer, MEMS gyroscope and MEMS magnetic force Meter is constituted, and is measured for acceleration, angular speed and the magnetic force signal respectively at least one position;
First micro-control unit, first micro-control unit are connected with the MEMS sensor unit, for described Acceleration, angular speed and the magnetic force signal at least one position are handled;
First communication module, the first communication module are connected with first micro-control unit, for by treated Acceleration, angular speed and magnetic force signal are sent to the communication relay device or the processor;
First power module, first power module are used for as at least one motion capture device power supply;
First memory module, first memory module are used to store the action message, described at least one position Physical condition information and the environmental information;
Synchronization module, the synchronization module are used to carry out at least one described motion capture device and communication relay device It is synchronous, so that the clock between one or more of motion capture devices and communication relay device is synchronous.
In an embodiment, the data that the server is obtained also according to the motion capture device are to medical educational scene It is updated.
In an embodiment, which further includes display equipment, for playing the surgical operation images of the 3 D stereo.
In an embodiment, the display equipment is VR wear-type eyeshade.
Specifically, the VR wear-type eyeshade includes the first spectacle lens, secondary glasses piece and is used to adjust the first spectacle lens With the adjustment module of the spacing distance of secondary glasses piece.
The adjustment module is in the following manner adjusted the distance between the first spectacle lens and secondary glasses piece:
The eyes image information of the user is obtained by image collecting device;
According to the eyes image information, two interpupillary distances of the user are calculated;
According to the two of the user interpupillary distances, the interpupillary distance information of the user is obtained;
It is described according to the eye information, however, it is determined that the eye information is unsatisfactory for the visual bars of the VR wear-type eyeshade Part determines adjustment modes then according to the eye information, comprising:
If it is determined that the interpupillary distance information is unsatisfactory for the interpupillary distance configuration information in the visual condition, then believed according to the interpupillary distance Breath and the interpupillary distance configuration information determine that the adjustment modes are interpupillary distance adjustment modes.
It is described according to the adjustment modes, adjust the VR wear-type eyeshade, comprising:
According to the interpupillary distance information of the user, the first spectacle lens and secondary glasses piece of the VR wear-type eyeshade are adjusted Position.
According to the interpupillary distance information of the user, the interpupillary distance of the user and the current pupil of VR wear-type eyeshade Away from size;
If the interpupillary distance of the user is greater than the current interpupillary distance of VR wear-type eyeshade, the first motor and the second horse are controlled It reaches, to drive corresponding first spectacle lens of first motor and the corresponding secondary glasses piece of second motor synchronously to remote Direction from center reference point is mobile, so that the interpupillary distance of the VR wear-type eyeshade and the interpupillary distance of the user match;
If the interpupillary distance of the user is less than the current interpupillary distance of VR wear-type eyeshade, the first motor and the second horse are controlled It reaches, to drive corresponding first spectacle lens of first motor and the corresponding secondary glasses piece of second motor synchronously to leaning on The direction of nearly center reference point is mobile, so that the interpupillary distance of the VR wear-type eyeshade and the interpupillary distance of the user match.
In the present embodiment, the eye information of VR wear-type eyeshade user is obtained by acquisition, however, it is determined that user's Eye information is unsatisfactory for the visual condition of VR wear-type eyeshade, according to the eye information of user, determines adjustment modes, automatic right VR wear-type eyeshade carries out the adjustment of different adjustment modes, can make the visual condition of VR wear-type eyeshade and the eye of user Information matches realize the eye information of automatic collection user, and are worn according to the eye information adjust automatically VR of user The visual condition of formula eyeshade improves the visual effect of VR wear-type eyeshade, improves user's visual experience.
The present invention is rebuild by the way that VR camera lens is arranged in operating room by the panoramic video that server shoots the VR camera lens At the surgical operation images of 3 D stereo, whole process of operation and details of operation therein, the operation of 3 D stereo can be not only taken Image can also restore the surgical scene of true stereo to doctor, be allowed to experience feeling on the spot in person, be conducive to later period teaching. Doctor can observe VR video on one side when in use, on one side by the data of motion capture device come corresponding with VR video to dynamic It compares.The index that various movements are subtle in oneself surgical procedure is watched, doctor is helped to improve surgical skills and scientific research.
The above-described embodiments merely illustrate the principles and effects of the present invention, and is not intended to limit the present invention.It is any ripe The personage for knowing this technology all without departing from the spirit and scope of the present invention, carries out modifications and changes to above-described embodiment.Cause This, institute is complete without departing from the spirit and technical ideas disclosed in the present invention by those of ordinary skill in the art such as At all equivalent modifications or change, should be covered by the claims of the present invention.

Claims (5)

1. a kind of surgical acts wisdom supervisory systems characterized by comprising
It is set at least one indoor VR camera lens of operation, for shooting the panoramic video of operation;
At least one motion capture device, for monitoring the action message at least one position;
Server, for receiving the action message of the panoramic video and described at least one portion;
The server is also used to rebuild the operation panoramic video using VR technology the surgical operation images of 3 D stereo;
The server is also used to the physical condition information and local environment information of real-time monitoring motion capture object;And according to The action message at least one position, the physical condition information and the environmental information, obtain the motion capture pair The entire motion posture and entire motion information of elephant;
The system further includes RFID reader, for identifying to the RFID tag being set on operation tool.
2. a kind of surgical wisdom supervisory systems according to claim 1, which is characterized in that it is described according at least The action message at one position, the physical condition information and the environmental information obtain the complete of the motion capture object Athletic posture and entire motion information, specifically include:
The action message at one or more of positions, the physical condition information and the environmental information are handled, obtained To location information, acceleration, angular speed and the Geomagnetism Information of the motion capture object, and according to the positional information, accelerate Degree, angular speed and Geomagnetism Information generate biomechanical model, and obtain the motion capture pair according to the biomechanical model The entire motion posture and entire motion information of elephant.
3. a kind of surgical wisdom supervisory systems according to claim 1, which is characterized in that the server also according to The data that the motion capture device obtains are updated medical educational scene.
4. a kind of surgical wisdom supervisory systems according to claim 1, which is characterized in that the system further includes display Equipment, for playing the surgical operation images of the 3 D stereo.
5. a kind of surgical wisdom supervisory systems according to claim 4, which is characterized in that the display equipment is VR Wear-type eyeshade.
CN201811617158.8A 2018-12-28 2018-12-28 A kind of surgical wisdom supervisory systems Pending CN109714571A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201811617158.8A CN109714571A (en) 2018-12-28 2018-12-28 A kind of surgical wisdom supervisory systems

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201811617158.8A CN109714571A (en) 2018-12-28 2018-12-28 A kind of surgical wisdom supervisory systems

Publications (1)

Publication Number Publication Date
CN109714571A true CN109714571A (en) 2019-05-03

Family

ID=66258897

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201811617158.8A Pending CN109714571A (en) 2018-12-28 2018-12-28 A kind of surgical wisdom supervisory systems

Country Status (1)

Country Link
CN (1) CN109714571A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111447415A (en) * 2020-04-02 2020-07-24 吴敏 System and method for adjusting voice and video definition based on remote operation

Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130038707A1 (en) * 2011-08-09 2013-02-14 Tyco Healthcare Group Lp Apparatus and Method for Using Augmented Reality Vision System in Surgical Procedures
CN104887314A (en) * 2015-04-21 2015-09-09 长春理工大学 Virtual three-dimensional endoscope displaying method and equipment for three-dimensional endoscopic surgery navigation
CN105974588A (en) * 2016-06-14 2016-09-28 深圳市金立通信设备有限公司 Method for adjusting pupil distance of VR glasses, and VR glasses thereof
CN106267781A (en) * 2016-09-19 2017-01-04 清华大学 Water proof type motion capture system for athletic training
CN106779387A (en) * 2016-12-08 2017-05-31 杭州电子科技大学 A kind of operating theater instruments and its management system
CN107229125A (en) * 2017-08-09 2017-10-03 上海闻泰电子科技有限公司 VR eyeglass control method and device
CN107241579A (en) * 2017-07-14 2017-10-10 福建铁工机智能机器人有限公司 A kind of utilization AR realizes the method and apparatus of Telemedicine Consultation
CN107506036A (en) * 2017-08-23 2017-12-22 歌尔股份有限公司 VR interpupillary distances adjusting method and device
CN107801016A (en) * 2017-09-15 2018-03-13 上海理工大学 Virtual long diagnoses and treatment system
CN107908007A (en) * 2017-12-28 2018-04-13 武汉市陆刻科技有限公司 A kind of method of adjusting VR glasses interpupillary distances
CN207429174U (en) * 2017-02-23 2018-06-01 医影联合(北京)科技有限公司 Shadowless lamp and the system for obtaining surgical operation images

Patent Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130038707A1 (en) * 2011-08-09 2013-02-14 Tyco Healthcare Group Lp Apparatus and Method for Using Augmented Reality Vision System in Surgical Procedures
CN104887314A (en) * 2015-04-21 2015-09-09 长春理工大学 Virtual three-dimensional endoscope displaying method and equipment for three-dimensional endoscopic surgery navigation
CN105974588A (en) * 2016-06-14 2016-09-28 深圳市金立通信设备有限公司 Method for adjusting pupil distance of VR glasses, and VR glasses thereof
CN106267781A (en) * 2016-09-19 2017-01-04 清华大学 Water proof type motion capture system for athletic training
CN106779387A (en) * 2016-12-08 2017-05-31 杭州电子科技大学 A kind of operating theater instruments and its management system
CN207429174U (en) * 2017-02-23 2018-06-01 医影联合(北京)科技有限公司 Shadowless lamp and the system for obtaining surgical operation images
CN107241579A (en) * 2017-07-14 2017-10-10 福建铁工机智能机器人有限公司 A kind of utilization AR realizes the method and apparatus of Telemedicine Consultation
CN107229125A (en) * 2017-08-09 2017-10-03 上海闻泰电子科技有限公司 VR eyeglass control method and device
CN107506036A (en) * 2017-08-23 2017-12-22 歌尔股份有限公司 VR interpupillary distances adjusting method and device
CN107801016A (en) * 2017-09-15 2018-03-13 上海理工大学 Virtual long diagnoses and treatment system
CN107908007A (en) * 2017-12-28 2018-04-13 武汉市陆刻科技有限公司 A kind of method of adjusting VR glasses interpupillary distances

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111447415A (en) * 2020-04-02 2020-07-24 吴敏 System and method for adjusting voice and video definition based on remote operation

Similar Documents

Publication Publication Date Title
US10162408B2 (en) Head mounted display, detection device, control method for head mounted display, and computer program
CN104699247B (en) A kind of virtual reality interactive system and method based on machine vision
WO2016184107A1 (en) Wearable apparatus for sight line focus positioning and method for sight line focus positioning
CN107660039B (en) A kind of lamp control system of identification dynamic gesture
CN108478399B (en) Amblyopia training instrument
CN105850113A (en) Calibration of virtual reality systems
CN107077214A (en) For the method and system of the communication used within the hospital
CN104090371B (en) A kind of 3D glasses and 3D display systems
CN106267734A (en) A kind of digitized body-building system
CN111552076A (en) Image display method, AR glasses and storage medium
CN106388762A (en) Vision testing and training system based on virtual reality
CN108888487A (en) A kind of eyeball training system and method
CN105943327B (en) Vision exercise health care system with anti-dizziness device
CN205195880U (en) Watch equipment and watch system
CN104768447A (en) Device for imaging an eye
CN106406543A (en) VR scene conversion device controlled by human eyes
CN204636276U (en) A kind of wearing die cavity mirror virtual display system
CN107854288A (en) Ocular disorders monitoring and rehabilitation training glasses based on digital intelligent virtual three-dimensional stereopsis technology
CN107422844A (en) A kind of information processing method and electronic equipment
CN106791769A (en) Virtual reality realization method and system
CN205359411U (en) Endoscope image control system
CN109714571A (en) A kind of surgical wisdom supervisory systems
CN114187651A (en) Taijiquan training method and system based on mixed reality, equipment and storage medium
KR20130014275A (en) Method for controlling display screen and display apparatus thereof
CN209358681U (en) One kind being applied to the indoor naked eye 3D eye tracking device that performs the operation

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20190503