CN108524011A - Visual field focus based on eye tracker principle indicates system and method - Google Patents
Visual field focus based on eye tracker principle indicates system and method Download PDFInfo
- Publication number
- CN108524011A CN108524011A CN201810436376.5A CN201810436376A CN108524011A CN 108524011 A CN108524011 A CN 108524011A CN 201810436376 A CN201810436376 A CN 201810436376A CN 108524011 A CN108524011 A CN 108524011A
- Authority
- CN
- China
- Prior art keywords
- visual field
- laparoscope
- field focus
- eye tracker
- image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
- A61B90/36—Image-producing devices or illumination devices not otherwise provided for
- A61B90/37—Surgical systems with images on a monitor during operation
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
- A61B90/36—Image-producing devices or illumination devices not otherwise provided for
- A61B90/361—Image-producing devices, e.g. surgical cameras
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/67—Focus control based on electronic image sensor signals
Abstract
The invention discloses the visual field focuses based on eye tracker principle to indicate system and method, including laparoscopic device, laparoscope capture card, eye tracker, Medical Imaging System and visual field focus display；Laparoscopic device includes laparoscope, monitor and the microcam at laparoscope eyepiece, monitor and miniature video camera mechatronics, microcam is also electrically connected with laparoscope capture card, laparoscope capture card, eye tracker are electrically connected with Medical Imaging System respectively, and Medical Imaging System is electrically connected with visual field focus display；The present invention passes through the image processing module in Medical Imaging System, by the visual field focus information of the operator doctor eyeball of eye tracker monitoring, on the abdominal cavity picture that the laparoscope capture card that is added to obtains and it is marked, then labeled image is fed back to by visual field focus display and helps mirror hand, convenient for helping mirror hand smoothly to coordinate the positioning and transfer in the operator doctor visual field, the time for greatling save operator doctor and support staff's communication, improve procedure efficiency.
Description
Technical field
The present invention relates to laparoscopic surgery apparatus field, particularly relates to the visual field focus based on eye tracker principle and refer to
Show system and method.
Background technology
Surgery mostly uses laparoscopic surgery at present, completes to perform the operation by operator doctor and Chi Jing Handball Associations are same.Hold mirror assistant's needs
The position of operator doctor operation is kept to be located at visual field center.If holding lacking experience for mirror hand, it is easy to cause losing for surgical field of view
It loses.Before not reaching experienced and tacit, it not only will appear and waste valuable hand because continually correcting surgical field of view
The art time can also make operator doctor generate impatient mood, and then injure surgical quality.
Based on this, if the sight focus of operator doctor can be shown on laparoscope display screen in real time so that hold mirror and help
Hand can smoothly coordinate the positioning and transfer of the surgical field of view for completing operator doctor, it will greatly save the time of communication, improve hand
Art efficiency.
Invention content
To solve the problems mentioned above in the background art, the purpose of the present invention is to provide one kind being based on eye tracker principle
Visual field focus indicate system and method.
To achieve the above object, the technical solution that the present invention takes is：
The invention discloses the visual field focuses based on eye tracker principle to indicate that system, including laparoscopic device, laparoscope are adopted
Truck, eye tracker, Medical Imaging System and visual field focus display；Laparoscopic device includes laparoscope, monitor and is mounted on
Microcam at laparoscope eyepiece, the monitor and miniature video camera mechatronics check trouble for operator doctor monitoring
The intraperitoneal picture of person；
The camera lens insertion of the laparoscope is intraperitoneal, for obtaining the picture in surgical procedure in abdominal cavity of patients；The abdomen
Hysteroscope capture card and miniature video camera mechatronics, the video analog signal for capturing microcam；
The eye tracker is placed on monitor, for monitoring the visual field focus of operator doctor on the monitor of performing the operation in real time；
The Medical Imaging System is electrically connected with laparoscope capture card, eye tracker respectively, for receiving surgical procedure midfield
The image information of intracavitary and the visual field focus of operator doctor, and operator doctor visual field focus is labeled in abdominal cavity picture, then lead to
The visual field focus display being electrically connected with Medical Imaging System is crossed to show.
In above-mentioned technical proposal, the Medical Imaging System includes medical image acquisition module, image processing module, image
Memory module；The medical image acquisition module is electrically connected with eye tracker and laparoscope capture card respectively, and the medical image is adopted
Collection module is also electrically connected with image processing module, and described image processing module is shown with image storage module and visual field focus respectively
Device is electrically connected；
The medical image acquisition module is for obtaining the collected video analog signal of laparoscope capture card and eye tracker
Collected visual field focus information；
Described image processing module to the data of acquisition for being digitized processing, and the operator that eye tracker is monitored
The eyeball visual field focus information of doctor, which corresponds to, to be labeled on the abdominal cavity picture of microcam acquisition.
The invention also discloses the visual field focus indicating means based on eye tracker principle, include the following steps：
Step 1: eye tracker is placed in above monitor, the eyeball for monitoring operation operator doctor in real time by eye tracker exists
Visual field focus on monitor, and the collected visual field focus information of eye tracker is transferred to the medical image of Medical Imaging System
Acquisition module；
Step 2: lens of laparoscope is inserted into it is intraperitoneal, and by microcam obtain surgical procedure in it is intraperitoneal
Picture captures the video analog signal of microcam by laparoscope capture card and is transmitted to the doctor of Medical Imaging System
Learn image collecting module, the video analog signal for the abdominal cavity picture that the medical image acquisition module acquires laparoscope capture card
It is sent to image processing module, described image processing module is digitized processing to the video analog signal of abdominal cavity picture；
Step 3: the operator doctor monitored by eye tracker that medical image acquisition module described in step 1 is obtained
The data of eyeball visual field focus be sent to image processing module, described image processing module to the data of eyeball visual field focus into
Row handle and be compared with the video analog signal of the abdominal cavity picture of image processing module digitized processing in step 2 it is integrated,
And mark image is created to mark the eyeball visual field focus of operator doctor in the position of visual field focus；
Step 4: by the abdominal cavity picture that image processing module in step 3 marked be sent respectively to image storage module and
Visual field focus display, image storage module store backup image, and visual field focus display, which is shown, is labeled with operator doctor
The abdominal cavity picture of eyeball visual field focus holds mirror assistant according to the eyeball for being labeled with operator doctor shown on the focus display of the visual field
The abdominal cavity picture of visual field focus, adjusts the angle of laparoscope, and the positioning and transfer in the operator doctor visual field are completed in cooperation.
It is described to mark the low bright green dotted circle that image is diameter 2mm, circle ring center and operator in above-mentioned technical proposal
Doctor's eyeball watches center coincidence attentively.
Compared with prior art, the beneficial effects of the invention are as follows：
The present invention is existed the operator doctor that eye tracker real-time monitors by the image processing module in Medical Imaging System
Eyeball focus on monitor is added on the intraperitoneal picture obtained to laparoscope capture card and is marked, then will mark
The image recorded a demerit, which is output to visual field focus display and feeds back to, helps mirror hand, convenient for helping mirror hand smoothly to coordinate determining for the operator doctor visual field
Position and transfer greatly save the time of operator doctor and support staff's communication, improve procedure efficiency.
Description of the drawings
Fig. 1 is the structural schematic diagram that the visual field focus based on eye tracker principle indicates system in the present invention.
Reference sign：
1, laparoscopic device；11, laparoscope；12, microcam；13, monitor；2, laparoscope capture card；3, eye movement
Instrument；4, Medical Imaging System；41, medical image acquisition module；42, image processing module；43, image storage module；5, the visual field
Focus display.
Specific implementation mode
To make the technical means, the creative features, the aims and the efficiencies achieved by the present invention be easy to understand, with reference to
The drawings and specific embodiments, how the present invention is further explained implements.
As shown in Figure 1, the invention discloses the visual field focuses based on eye tracker principle to indicate system, including laparoscopic device
1, laparoscope capture card 2, eye tracker 3, Medical Imaging System 4 and visual field focus display 5；Laparoscopic device 1 includes laparoscope
11, monitor 13 and the microcam 12 at laparoscope eyepiece, monitor 13 are electrically connected with microcam 12, are used
The picture in abdominal cavity of patients is checked in operator doctor monitoring；
The camera lens insertion of laparoscope 11 is intraperitoneal, for obtaining the picture in surgical procedure in abdominal cavity of patients；Laparoscope is adopted
Truck 2 is electrically connected with microcam 12, and the video analog signal for capturing microcam 12 is simultaneously transmitted to medicine
Image system 4；
Eye tracker 3 is placed on monitor 13, for monitoring visual field focus of the operator doctor on monitor 13 of performing the operation in real time；
Medical Imaging System 4 is electrically connected with laparoscope capture card 2, eye tracker 3 respectively, for receiving abdominal cavity in surgical procedure
The visual field focus of interior image information and operator doctor, and operator doctor visual field focus is labeled in abdominal cavity picture, then pass through
The visual field focus display 5 being electrically connected with Medical Imaging System 4 is shown.
In the present invention, Medical Imaging System 4 includes medical image acquisition module 41, image processing module 42 and image storage
Module 43；Medical image acquisition module 41 is electrically connected with eye tracker 3 and laparoscope capture card 2 respectively, medical image acquisition module
41 are also electrically connected with image processing module 42, image processing module 42 respectively with image storage module 43 and visual field focus display
5 electrical connections；
Medical image acquisition module 41 is for obtaining 2 collected video analog signal of laparoscope capture card and eye tracker 3
Collected visual field focus information；
Image processing module 42 to the data of acquisition for being digitized processing, and the operator that eye tracker 3 is monitored
The eyeball visual field focus information of doctor, which corresponds to, to be labeled on the abdominal cavity picture of the acquisition of microcam 12.
The invention also discloses the visual field focus indicating means based on eye tracker principle, include the following steps：
Step 1: eye tracker 3 is placed in 13 top of monitor, pass through the eye of the operator doctor of monitoring operation in real time of eye tracker 3
Visual field focus of the ball on monitor 13, and the collected visual field focus information of eye tracker is transferred to Medical Imaging System 4
Medical image acquisition module 41；
Step 2: the insertion of 1 camera lens of laparoscope is intraperitoneal, and by intraperitoneal in the acquisition surgical procedure of microcam 12
Picture, by laparoscope capture card 2 capture microcam 12 video analog signal and be transmitted to medical image system
The medical image acquisition module 41 of system 4, the video for the abdominal cavity picture that medical image acquisition module 41 acquires laparoscope capture card 2
Analog signal is sent to image processing module 42, and image processing module 42 is digitized the video analog signal of abdominal cavity picture
Processing；
Step 3: the operator doctor monitored by eye tracker 3 that step 1 traditional Chinese medicine image collecting module 41 is obtained
The data of eyeball visual field focus be sent to image processing module 42, image processing module 42 to the data of eyeball visual field focus into
Row handles and collection is compared with the video analog signal of the abdominal cavity picture of 42 digitized processing of image processing module in step 2
At, and mark image is created to mark the eyeball visual field focus of operator doctor in the position of visual field focus；
Step 4: the abdominal cavity picture that image processing module in step 3 42 marked is sent respectively to image storage module
43 and visual field focus display 5, image storage module 43 stores backup image, and visual field focus display 5, which is shown, is labeled with master
The abdominal cavity picture of the eyeball visual field focus of knife doctor holds mirror assistant and is labeled with operator doctor according to what is shown on the focus display of the visual field
The abdominal cavity picture of the eyeball visual field focus of teacher, adjusts the angle of laparoscope 11, and cooperation is completed the positioning in the operator doctor visual field and turned
It moves.
In the present invention, the low bright green dotted circle that mark image is diameter 2mm, circle ring center and operator doctor eyeball
Watch center coincidence attentively.
In the present invention, the eye movement action definition is as follows：
1, when operator doctor sight focus moves, sign (low-light level) shows movement locus.The visual field immobilizes 2 seconds
Zhong Hou, sign are highlighted 2 seconds, then disappear.
2, it continuously winks one's left eye twice, annular amplification prompts magnification field, continuously blinks right eye twice, and annular reduces, and prompts contracting
Low coverage.
3, to the left head when, annular ring rotates counterclockwise, is identified, and prompts the visual field to be rotated to the left, head to the right
When, annular ring rotates clockwise, and prompts the visual field to right rotation.
Finally illustrate, the above examples are only used to illustrate the technical scheme of the present invention and are not limiting, although with reference to compared with
Good embodiment describes the invention in detail, it will be understood by those of ordinary skill in the art that, it can be to the skill of the present invention
Art scheme is modified or replaced equivalently, and without departing from the objective and range of technical solution of the present invention, should all be covered at this
In the right of invention.
Claims (4)
1. the visual field focus based on eye tracker principle indicates system, which is characterized in that adopted including laparoscopic device (1), laparoscope
Truck (2), eye tracker (3), Medical Imaging System (4) and visual field focus display (5)；Laparoscopic device (1) includes laparoscope
(11), monitor (13) and the microcam (12) at laparoscope (11) eyepiece, the monitor (13) with it is miniature
Video camera (12) is electrically connected, and the picture in abdominal cavity of patients is checked for operator doctor monitoring；
The camera lens insertion of the laparoscope (11) is intraperitoneal, for obtaining the picture in surgical procedure in abdominal cavity of patients；The abdomen
Hysteroscope capture card (2) is electrically connected with microcam (12), the video analog signal for capturing microcam (12)；
The eye tracker (3) is placed on monitor (13), for monitoring operator doctor regarding on monitor (13) of performing the operation in real time
Wild focus；
The Medical Imaging System (4) is electrically connected with laparoscope capture card (2), eye tracker (3) respectively, for receiving surgical procedure
In intraperitoneal image information and operator doctor visual field focus, and operator doctor visual field focus is labeled in abdominal cavity picture, so
It is shown afterwards by the visual field focus display (5) being electrically connected with Medical Imaging System (4).
2. the visual field focus according to claim 1 based on eye tracker principle indicates system, which is characterized in that the medicine
Image system (4) includes medical image acquisition module (41), image processing module (42) and image storage module (43)；The doctor
It learns image collecting module (41) to be electrically connected with eye tracker (3) and laparoscope capture card (2) respectively, the medical image acquisition module
(41) be also electrically connected with image processing module (42), described image processing module (42) respectively with image storage module (43) and regard
Wild focus display (5) electrical connection；
The medical image acquisition module (41) is for obtaining the collected video analog signal of laparoscope capture card (2) and eye movement
The collected visual field focus information of instrument (3)；
Described image processing module (42) is used to be digitized processing to the data of acquisition, and eye tracker (3) is monitored
The eyeball visual field focus information of operator doctor, which corresponds to, to be labeled on the abdominal cavity picture of microcam (12) acquisition.
3. the visual field focus indicating means based on eye tracker principle, which is characterized in that include the following steps：
Step 1: eye tracker (3) is placed in above monitor (13), pass through eye tracker (3) operator doctor of monitoring operation in real time
Visual field focus of the eyeball on monitor (13), and the collected visual field focus information of eye tracker is transferred to Medical Imaging System
(4) medical image acquisition module (41)；
Step 2: the insertion of laparoscope (1) camera lens is intraperitoneal, and by intraperitoneal in microcam (12) acquisition surgical procedure
Picture, by laparoscope capture card (2) capture microcam (12) video analog signal and be transmitted to medicine shadow
As the medical image acquisition module (41) of system (4), the medical image acquisition module (41) acquires laparoscope capture card (2)
The video analog signal of abdominal cavity picture be sent to image processing module (42), described image processing module (42) is to abdominal cavity picture
Video analog signal be digitized processing；
Step 3: the operator monitored by eye tracker (3) that medical image acquisition module described in step 1 (41) is obtained
The data of the eyeball visual field focus of doctor are sent to image processing module (42), and described image processing module (42) is to the eyeball visual field
The data of focus carry out processing and with the video simulation of the abdominal cavity picture of image processing module in step 2 (42) digitized processing
Signal is compared integrated, and creates mark image in the position of visual field focus and marks the eyeball visual field focus of operator doctor；
Step 4: the abdominal cavity picture that image processing module in step 3 (42) marked is sent respectively to image storage module
(43) and visual field focus display (5), image storage module (43) store backup image, and visual field focus display (5) is shown
It is labeled with the abdominal cavity picture of the eyeball visual field focus of operator doctor, holds mirror assistant according to the mark shown on the focus display of the visual field
There are the abdominal cavity picture of the eyeball visual field focus of operator doctor, the angle of adjustment laparoscope (11), cooperation to complete the operator doctor visual field
Positioning and transfer.
4. the visual field focus indicating means according to claim 3 based on eye tracker principle, which is characterized in that the mark
Image is the low bright green dotted circle of diameter 2mm, and circle ring center and operator doctor eyeball watch center coincidence attentively.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810436376.5A CN108524011A (en) | 2018-05-09 | 2018-05-09 | Visual field focus based on eye tracker principle indicates system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810436376.5A CN108524011A (en) | 2018-05-09 | 2018-05-09 | Visual field focus based on eye tracker principle indicates system and method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108524011A true CN108524011A (en) | 2018-09-14 |
Family
ID=63477196
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810436376.5A Pending CN108524011A (en) | 2018-05-09 | 2018-05-09 | Visual field focus based on eye tracker principle indicates system and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108524011A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109330685A (en) * | 2018-10-31 | 2019-02-15 | 南京航空航天大学 | A kind of porous abdominal operation robot laparoscope automatic navigation method |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120069166A1 (en) * | 2009-02-24 | 2012-03-22 | Reiner Kunz | Navigation of endoscopic devices by means of eye-tracker |
| CN102958464A (en) * | 2010-04-07 | 2013-03-06 | 索发有限公司 | Robotized surgery system with improved control |
| US20140024889A1 (en) * | 2012-07-17 | 2014-01-23 | Wilkes University | Gaze Contingent Control System for a Robotic Laparoscope Holder |
| US20140066700A1 (en) * | 2012-02-06 | 2014-03-06 | Vantage Surgical Systems Inc. | Stereoscopic System for Minimally Invasive Surgery Visualization |
| CN205359411U (en) * | 2015-12-25 | 2016-07-06 | 重庆金山科技（集团）有限公司 | Endoscope image control system |
| CN106456148A (en) * | 2014-03-19 | 2017-02-22 | 直观外科手术操作公司 | Medical devices, systems, and methods using eye gaze tracking |
| US20170068081A1 (en) * | 2014-03-31 | 2017-03-09 | Sony Corporation | Surgical control device, control method, and imaging control system |
| CN208799333U (en) * | 2018-05-09 | 2019-04-30 | 杨琨 | Visual field focus based on eye tracker principle indicates system |
-
2018
- 2018-05-09 CN CN201810436376.5A patent/CN108524011A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120069166A1 (en) * | 2009-02-24 | 2012-03-22 | Reiner Kunz | Navigation of endoscopic devices by means of eye-tracker |
| CN102958464A (en) * | 2010-04-07 | 2013-03-06 | 索发有限公司 | Robotized surgery system with improved control |
| US20140066700A1 (en) * | 2012-02-06 | 2014-03-06 | Vantage Surgical Systems Inc. | Stereoscopic System for Minimally Invasive Surgery Visualization |
| US20140024889A1 (en) * | 2012-07-17 | 2014-01-23 | Wilkes University | Gaze Contingent Control System for a Robotic Laparoscope Holder |
| CN106456148A (en) * | 2014-03-19 | 2017-02-22 | 直观外科手术操作公司 | Medical devices, systems, and methods using eye gaze tracking |
| US20170068081A1 (en) * | 2014-03-31 | 2017-03-09 | Sony Corporation | Surgical control device, control method, and imaging control system |
| CN205359411U (en) * | 2015-12-25 | 2016-07-06 | 重庆金山科技（集团）有限公司 | Endoscope image control system |
| CN208799333U (en) * | 2018-05-09 | 2019-04-30 | 杨琨 | Visual field focus based on eye tracker principle indicates system |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109330685A (en) * | 2018-10-31 | 2019-02-15 | 南京航空航天大学 | A kind of porous abdominal operation robot laparoscope automatic navigation method |
| CN109330685B (en) * | 2018-10-31 | 2024-02-02 | 南京航空航天大学 | Automatic navigation method for laparoscope of porous abdominal cavity surgical robot |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10238462B2 (en) | Digital-based medical devices | |
| CN106805934B (en) | Augmented reality wireless electronic endoscope surgery systems | |
| CN108042090B (en) | Medical endoscope system configured with artificial intelligence chip and image processing method | |
| JP5750669B2 (en) | Endoscope system | |
| US20150282691A1 (en) | Auto Zoom for Video Camera | |
| US20200396411A1 (en) | Information processor, information processing method, and program | |
| CN103815972A (en) | Automatic tracking system for operative region of laparothoracoscope and method | |
| CN112353361A (en) | 3D (three-dimensional) pleuroperitoneal cavity mirror system based on master-slave integrated intelligent mirror holding robot | |
| CN208799333U (en) | Visual field focus based on eye tracker principle indicates system | |
| CN108524011A (en) | Visual field focus based on eye tracker principle indicates system and method | |
| CN111035458A (en) | Intelligent auxiliary system for operation comprehensive vision and image processing method | |
| CN206548612U (en) | A kind of medicinal intelligent operation microscopic system | |
| CN201822842U (en) | Wireless video image bladder inspectoscope | |
| CN112019872B (en) | Operation live broadcast system and use method thereof | |
| CN115580692A (en) | Eye movement tracking principle-based positioning and vision field expanding method and intelligent glasses | |
| WO2017145606A1 (en) | Image processing device, image processing method, and endoscope system | |
| CN108478197A (en) | Intelligent dermal imaging equipment | |
| CN111193830B (en) | Portable augmented reality medical image observation auxiliary assembly based on smart phone | |
| CN112806958A (en) | Full-automatic fundus camera system and working method thereof | |
| CN209595730U (en) | Intelligent dermal imaging equipment | |
| CN201727494U (en) | Portable ear speculum | |
| US11356596B2 (en) | Imaging device, imaging device control unit, and imaging method for adjusting parameters of imaging device | |
| CN218006415U (en) | Medical image 3D display system | |
| CN102309310B (en) | Portable otoscope | |
| CN214761039U (en) | Full-automatic desk type eye ground camera system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |