CN108732746A - A kind of wear-type visual sight control system - Google Patents
A kind of wear-type visual sight control system Download PDFInfo
- Publication number
- CN108732746A CN108732746A CN201810533057.6A CN201810533057A CN108732746A CN 108732746 A CN108732746 A CN 108732746A CN 201810533057 A CN201810533057 A CN 201810533057A CN 108732746 A CN108732746 A CN 108732746A
- Authority
- CN
- China
- Prior art keywords
- eye
- user
- information
- image information
- communication module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/0093—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
- Position Input By Displaying (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The present invention relates to wearable intelligent equipment technical fields, and in particular to a kind of visual sight control system.A kind of wear-type visual sight control system, technical solution are：Visual detection tracks of device is worn on user head, including：Position tracker, eye cameras, corneal reflection infrared light supply, eye movement processing module, headband display and optical system；Servo console is equipped with camera, and is moved under the control of control panel；Data processing receives the scene image information that camera obtains with communication module, and the scene image information is sent to display screen driving plate；Data processing blends blinkpunkt information, head posture information with communication module, and by the information detecting and tracking corresponding to the scene image information progress that camera obtains after fusion, detecting and tracking result is sent to control panel, and what servo console was visually moved moves synchronously.The present invention can more accurately control servo console and be moved according to the intention of eye movement.
Description
Technical field
The present invention relates to wearable intelligent equipment technical fields, and in particular to a kind of visual sight control system.
Background technology
Wearable visual sight control system is a kind of supplementary controlled system of portable, easy to operate realization, for obtaining
The blinkpunkt position of human eye in real-time scene, and synchronize and controlled servo console is carried out according to the blinkpunkt position of human eye
Motion work.It is mainly used for auxiliary operation person to set with instrument with carrying out multichannel in complicated operating environment (such as outdoor study)
It is standby to interact, to be that the fixation characteristics using human eye complete multimode interactive operation, can be used for military affairs, scientific investigation, medical treatment,
The fields such as building, repair.
About 44 eye tracker research and development develop wearable eye movement detection device with production unit in the world at present,
Middle comparative maturity has U.S.'s ASL Applied Science Laboratories, SR Science Institutes of Canada, German SMI sensings moving instrument public
The Tobii eye trackers company of department and Sweden.These eye movement detection devices, which are substantially all, to be acquired the corresponding data of human eye,
And collected data are subjected to analysis and are applied to Related Research Domain.Domestic Related Research Domain introduced some Table top types and
Wear-type eye movement equipment further develops oneself eye-movement measurement and gaze tracking system.
It is had the following problems in existing eye movement detecting system：1) wearable head position control system, control range
Greatly, but control accuracy is not high；2) figure in scene is also acquired while wearable eye movement control system acquires optical data
As information, but there is no the Figure and Image in the information and scene of eye movement is associated control；3) existing wearable
Eye movement control system is applied to the scene of virtual reality and augmented reality, and the scene controlled is existing model of place, not
There is realization to control real-time real scene.
Invention content
The purpose of the present invention is：To solve portable wearable visual detection tracking problem, a kind of wear-type mesh is provided
Depending on pointing control system, aims at by visual observation and servo console movement is controlled.
The technical scheme is that：A kind of wear-type visual sight control system, it includes：Visual detection tracking dress
Set, servo console, data processing and communication module and battery；
Visual detection tracks of device includes：It is worn on the belt on user head；On belt, used for obtaining
The position tracker of person head pose；On belt, it to be used for head of the connector with fixed plate and headband fixedly connected part
Portion's fixator；The outer cover being fixedly connected in headband fixedly connected part；It is red to be fixed on eye cameras in outer cover, corneal reflection
Outer light source, eye movement processing module, headband display and optical system, wherein corneal reflection infrared light supply is used for irradiating
Person's pupil, which is formed, refers to hot spot, and eye cameras is used to obtain the image information of user's eye, eye movement processing module and eyes
Video camera connects, and blinkpunkt information, headband display and optics are obtained for carrying out preliminary treatment to collected eyes image
System matches, and the scene image information for being obtained in real time within sweep of the eye to user's display servo console, headband is shown
Device is driven by display screen driving plate；
Servo console is equipped with the camera for obtaining scene image information, and servo console connect with control panel, controlling
The movement of six-freedom degree is carried out under the control of making sheet；
Battery is used to power to data processing and communication module, visual detection tracks of device；
Data processing and communication module and eye movement processing module, position tracker, display screen driving plate, camera, control
Plate connects；Data processing receives the scene image information that camera obtains with communication module, and the scene image information is sent
To display screen driving plate, user is watched by display；Eye movement processing module will by blinkpunkt information, position tracker
User head posture information is sent to data processing and communication module, and data processing and communication module are by blinkpunkt information, head
Portion's posture information blends, and by the information detecting and tracking corresponding to the scene image information progress that camera obtains after fusion,
Detecting and tracking result is sent to control panel, is moved synchronously by what control panel driving servo console was completed visually to move.User's eye
Portion ceaselessly watches the image information in display attentively, as human eye watches the variation of blinkpunkt and head pose, data
The variation is converted to the information of servo console movement with communication module by processing, and servo console is controlled to complete visual sight
Movement.
Further, it is flexibly connected between connector band fixed plate and head holder, it, can be right in headband coupling part
Outer cover and carry out rotation position adjustment it includes part, working condition can rotate outer cover to immediately ahead of eyes, off working state
Outer cover can be rotated to crown position.
Comfort level when further, to ensure that user's face is bonded with outer cover, outer cover and user face joint place
Equipped with sponge bed course, the distance between eye and optical system can be finely adjusted by adjusting the thickness of sponge bed course.
In said program, specifically, corneal reflection infrared light supply is distributed in user's eye one week.
In said program, specifically, eye cameras, corneal reflection infrared light supply and eye movement processing module are integrated to turn to one
Body is mounted in optical system, and keeps setpoint distance with headband display, in use, integrated part is to user's eye
Information is acquired, while user can also watch the Figure and Image shown in headband display well.
Advantageous effect：Visually detecting and tracking device obtains the blinkpunkt of user's eye to the present invention in a manner of dressing
Information and the posture information on head, and the scene image information that servo console obtains in real time within sweep of the eye is transferred to
It is shown in headband display, by the way that the posture information of blinkpunkt information, head is associated with the location information of object, more
It accurately determines blinkpunkt information, the posture information on head, movement is realized according to the intention of eye movement to control servo console.
Description of the drawings
Fig. 1 is the overall structure diagram of the present invention；
Fig. 2 is the structural schematic diagram of the wearable part of the present invention；
Fig. 3 is the partial structural diagram of visual detection tracks of device in the present invention；
Fig. 4 is the sectional view of Fig. 3；
Fig. 5 is the structural schematic diagram of servo console in the present invention.
Specific implementation mode
Referring to attached drawing 1, a kind of wear-type visual sight control system, it includes：Visual detection tracks of device, servo console
18, data processing and communication module 13 and battery 14；
Referring to attached drawing 2-4, visual detection tracks of device uses simple eye control mode, including：It is worn on user head
Belt 15；On belt 15, the position tracker 16 for obtaining user head pose；On belt 15,
For head holder 1 of the connector with fixed plate 2 and headband fixedly connected part 3；It is fixedly connected on headband fixedly connected part 3
On outer cover 11；It is aobvious to be fixed on eye cameras 4 in outer cover 11, corneal reflection infrared light supply 5, eye movement processing module 6, headband
Show device 9 and optical system 10, wherein corneal reflection infrared light supply 5 is formed for irradiating user's pupil with reference to hot spot, is convenient for
Preferably extraction eye information characteristics are to carry out the estimation of human eye fixation point, and eye cameras 4 is for obtaining user's eye
Image information, eye movement processing module 6 connect with eye cameras 4, for carrying out preliminary treatment to collected eyes image
Blinkpunkt information is obtained, headband display 9 is matched with optical system 10, for showing 18 visual field model of servo console to user
The interior scene image information obtained in real time is enclosed, headband display 9 is driven by display screen driving plate 7；Display screen driving plate 7 is pacified
In driving plate set casing 8；
Referring to attached drawing 5, servo console 18 is equipped with camera 17 for obtaining scene image information, servo console 18 with
Control panel 19 connects, and the movement of six-freedom degree is carried out under the control of control panel 19；When servo console 18 moves, camera 17
Keep opposing stationary；
Battery 14 is used to power to data processing and communication module 13, visual detection tracks of device, is taken with oneself by user
Band or wearing；
Data processing is carried or is dressed by user with communication module 13；Data processing and communication module 13 and eye movement
Processing module 6, position tracker 16, display screen driving plate 7, camera 17, control panel 19 connect；Data processing and communication module
13 receive the scene image information that camera 17 obtains, and the scene image information is sent to display screen driving plate 7, user
It is watched by display 9；User head pose is believed blinkpunkt information, position tracker 16 by eye movement processing module 6
Breath is sent to data processing and communication module 13, and data processing and communication module 13 are by blinkpunkt information, head posture information phase
Fusion, and by the information detecting and tracking corresponding to the scene image information progress that camera 17 obtains after fusion, detecting and tracking knot
Fruit is sent to control panel 19, and tracking result is converted to 18 movable information of servo console by control panel 19, drives servo console 18
That completes visually to move moves synchronously.User's eye ceaselessly watches the image information in display 9 attentively, with human eye
The variation of blinkpunkt and head pose is watched, which is converted to what servo console 18 moved by data processing with communication module 13
Information, to complete the movement that visual sight controls servo console.
Further, it is flexibly connected between connector band fixed plate 2 and head holder 1, it, can be in headband coupling part
To outer cover 11 and it includes parts to carry out rotation position adjustment, and working condition can rotate outer cover 11 to eyes, non-work
Making state can rotate outer cover 11 to crown position.
Comfort level when further, to ensure that user's face is bonded with outer cover, outer cover 11 are bonded with user face
Place is equipped with sponge bed course 12, can be carried out to the distance between eye and optical system 10 by adjusting the thickness of sponge bed course 12
Fine tuning.
In said program, specifically, corneal reflection infrared light supply 5 is distributed in user's eye one week.
In said program, specifically, eye cameras 4, corneal reflection infrared light supply 5 and eye movement processing module 6 are integrated
It is integrated, is mounted in optical system 10, and setpoint distance is kept with headband display 9, in use, integrated part is to using
Person's eye information is acquired, while user can also watch the Figure and Image shown in headband display 9 well.
Although above having used general explanation and specific embodiment, the present invention is described in detail, at this
On the basis of invention, it can be made some modifications or improvements, this will be apparent to those skilled in the art.Therefore,
These modifications or improvements without departing from theon the basis of the spirit of the present invention belong to the scope of protection of present invention.
Claims (5)
1. a kind of wear-type visual sight control system, it includes：Visual detection tracks of device, servo console (18), at data
Reason and communication module (13) and battery (14), it is characterised in that：
The visual detection tracks of device includes：It is worn on the belt (15) on user head；On the belt (15),
Position tracker (16) for obtaining user head pose；On the belt (15), fixed for connector band
The head holder (1) of plate (2) and headband fixedly connected part (3)；It is fixedly connected on the headband fixedly connected part (3)
Outer cover (11)；Eye cameras (4), corneal reflection infrared light supply (5), the eye movement processing module being fixed in the outer cover (11)
(6), headband display (9) and optical system (10), wherein the corneal reflection infrared light supply (5) is for irradiating user
Pupil, which is formed, refers to hot spot, and the eye cameras (4) is used to obtain the image information of user's eye, and the eye movement handles mould
Block (6) is connect with the eye cameras (4), and blinkpunkt letter is obtained for carrying out preliminary treatment to collected eyes image
Breath, the headband display (9) match with the optical system (10), for showing the servo console (18) to user
The scene image information obtained in real time within sweep of the eye, the headband display (9) are driven by display screen driving plate (7)；
The servo console (18) is equipped with camera (17) for obtaining scene image information, the servo console (18) with
Control panel (19) connects, and the movement of six-freedom degree is carried out under the control of the control panel (19)；
The battery (14) is used to power to the data processing and communication module (13), the visual detection tracks of device；
It is the data processing and communication module (13) and the eye movement processing module (6), the position tracker (16), described aobvious
Display screen driving plate (7), the camera (17), the control panel (19) connection；The data processing connects with communication module (13)
The scene image information of the camera (17) acquisition is received, and the scene image information is sent to the display screen driving plate
(7), user is watched by the display (9)；The eye movement processing module (6) is by blinkpunkt information, the position
User head posture information is sent to the data processing and communication module (13) by tracker (16), the data processing with
Communication module (13) blends the blinkpunkt information, the head posture information, and the information after fusion is taken the photograph with described
The scene image information obtained as head (17) carries out corresponding detecting and tracking, and detecting and tracking result is sent to the control panel (19),
It is moved synchronously by what the control panel (19) the driving servo console (18) completed visually to move.
2. a kind of wear-type visual sight control system as described in claim 1, it is characterised in that：The connector band is fixed
It is flexibly connected between plate (2) and the head holder (1).
3. a kind of wear-type visual sight control system as claimed in claim 1 or 2, it is characterised in that：The outer cover (11)
With user face joint place equipped with sponge bed course (12).
4. a kind of wear-type visual sight control system as claimed in claim 1 or 2, it is characterised in that：The corneal reflection
Infrared light supply (5) is distributed in user's eye one week.
5. a kind of wear-type visual sight control system as claimed in claim 1 or 2, it is characterised in that：The eyes camera shooting
Machine (4), the corneal reflection infrared light supply (5) and the eye movement processing module (6) is integrated is integrated, are mounted on the optics
In system (10), and setpoint distance is kept with the headband display (9).
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810533057.6A CN108732746A (en) | 2018-05-29 | 2018-05-29 | A kind of wear-type visual sight control system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810533057.6A CN108732746A (en) | 2018-05-29 | 2018-05-29 | A kind of wear-type visual sight control system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108732746A true CN108732746A (en) | 2018-11-02 |
Family
ID=63936594
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810533057.6A Pending CN108732746A (en) | 2018-05-29 | 2018-05-29 | A kind of wear-type visual sight control system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108732746A (en) |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110375582A (en) * | 2019-08-13 | 2019-10-25 | 北京缔科新技术研究院(有限合伙) | A kind of laser of view-based access control model information takes aim at mirror and focusing and zooming method |
| CN110881981A (en) * | 2019-11-16 | 2020-03-17 | 嘉兴赛科威信息技术有限公司 | Alzheimer's disease auxiliary detection system based on virtual reality technology |
| CN111012301A (en) * | 2019-12-19 | 2020-04-17 | 北京理工大学 | Head-mounted visual accurate aiming system |
| CN111435575A (en) * | 2019-01-15 | 2020-07-21 | 合肥探奥教育科技有限公司 | Presentation device of science popularization eye movement recognition technology |
| CN112666705A (en) * | 2019-10-15 | 2021-04-16 | 北京七鑫易维信息技术有限公司 | Eye movement tracking device and eye movement tracking method |
| CN113259584A (en) * | 2020-02-10 | 2021-08-13 | 格罗伯斯医疗有限公司 | Camera tracking system |
| CN113262464A (en) * | 2021-04-21 | 2021-08-17 | 青岛小鸟看看科技有限公司 | Dynamic change method and device of virtual reality scene and electronic equipment |
| CN113473015A (en) * | 2021-06-08 | 2021-10-01 | 荣耀终端有限公司 | Holder control method and electronic equipment |
| CN113891062A (en) * | 2021-09-27 | 2022-01-04 | 歌尔光学科技有限公司 | Video display method, VR head-mounted device, video display system and storage medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN203405629U (en) * | 2013-07-02 | 2014-01-22 | 苏州大学 | Simple helmet sight |
| CN105334864A (en) * | 2015-11-24 | 2016-02-17 | 杨珊珊 | Intelligent glasses and control method for controlling unmanned aerial vehicle |
| CN106168853A (en) * | 2016-06-23 | 2016-11-30 | 中国科学技术大学 | A kind of free space wear-type gaze tracking system |
| CN106406509A (en) * | 2016-05-16 | 2017-02-15 | 上海青研科技有限公司 | Head-mounted eye control virtual reality device |
| CN107014378A (en) * | 2017-05-22 | 2017-08-04 | 中国科学技术大学 | A kind of eye tracking aims at control system and method |
| CN107968915A (en) * | 2017-12-04 | 2018-04-27 | 国网山东省电力公司电力科学研究院 | Underwater robot camera pan-tilt real-time control system and its method |
-
2018
- 2018-05-29 CN CN201810533057.6A patent/CN108732746A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN203405629U (en) * | 2013-07-02 | 2014-01-22 | 苏州大学 | Simple helmet sight |
| CN105334864A (en) * | 2015-11-24 | 2016-02-17 | 杨珊珊 | Intelligent glasses and control method for controlling unmanned aerial vehicle |
| CN106406509A (en) * | 2016-05-16 | 2017-02-15 | 上海青研科技有限公司 | Head-mounted eye control virtual reality device |
| CN106168853A (en) * | 2016-06-23 | 2016-11-30 | 中国科学技术大学 | A kind of free space wear-type gaze tracking system |
| CN107014378A (en) * | 2017-05-22 | 2017-08-04 | 中国科学技术大学 | A kind of eye tracking aims at control system and method |
| CN107968915A (en) * | 2017-12-04 | 2018-04-27 | 国网山东省电力公司电力科学研究院 | Underwater robot camera pan-tilt real-time control system and its method |
Cited By (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111435575A (en) * | 2019-01-15 | 2020-07-21 | 合肥探奥教育科技有限公司 | Presentation device of science popularization eye movement recognition technology |
| CN110375582A (en) * | 2019-08-13 | 2019-10-25 | 北京缔科新技术研究院(有限合伙) | A kind of laser of view-based access control model information takes aim at mirror and focusing and zooming method |
| CN112666705A (en) * | 2019-10-15 | 2021-04-16 | 北京七鑫易维信息技术有限公司 | Eye movement tracking device and eye movement tracking method |
| CN110881981A (en) * | 2019-11-16 | 2020-03-17 | 嘉兴赛科威信息技术有限公司 | Alzheimer's disease auxiliary detection system based on virtual reality technology |
| CN111012301A (en) * | 2019-12-19 | 2020-04-17 | 北京理工大学 | Head-mounted visual accurate aiming system |
| CN111012301B (en) * | 2019-12-19 | 2021-04-13 | 北京理工大学 | Head-mounted visual accurate aiming system |
| CN113259584A (en) * | 2020-02-10 | 2021-08-13 | 格罗伯斯医疗有限公司 | Camera tracking system |
| CN113259584B (en) * | 2020-02-10 | 2023-04-21 | 格罗伯斯医疗有限公司 | Camera tracking system |
| CN113262464A (en) * | 2021-04-21 | 2021-08-17 | 青岛小鸟看看科技有限公司 | Dynamic change method and device of virtual reality scene and electronic equipment |
| US11782505B1 (en) | 2021-04-21 | 2023-10-10 | Qingdao Pico Technology Co., Ltd. | Dynamic changing method and apparatus for virtual reality scene, and electronic device |
| CN113473015A (en) * | 2021-06-08 | 2021-10-01 | 荣耀终端有限公司 | Holder control method and electronic equipment |
| CN113473015B (en) * | 2021-06-08 | 2022-03-08 | 荣耀终端有限公司 | Holder control method and electronic equipment |
| CN113891062A (en) * | 2021-09-27 | 2022-01-04 | 歌尔光学科技有限公司 | Video display method, VR head-mounted device, video display system and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108732746A (en) | A kind of wear-type visual sight control system | |
| CN104055478B (en) | Based on the medical endoscope control system that Eye-controlling focus controls | |
| EP3912588B1 (en) | Imaging system for surgical robot, and surgical robot | |
| EP2903551B1 (en) | Digital system for surgical video capturing and display | |
| US9766441B2 (en) | Surgical stereo vision systems and methods for microsurgery | |
| WO2016184107A1 (en) | Wearable apparatus for sight line focus positioning and method for sight line focus positioning | |
| CN1222807C (en) | Visual aid in form of telescopic spectacles with an automatic focussing device | |
| CA2486525C (en) | A guide system and a probe therefor | |
| CA3049379A1 (en) | Improved accuracy of displayed virtual data with optical head mount displays for mixed reality | |
| CN108478399B (en) | Amblyopia training instrument | |
| CN110502100A (en) | Virtual reality exchange method and device based on eye-tracking | |
| CN107092346B (en) | Information processing method and electronic equipment | |
| CN106659541A (en) | Medical Devices, Systems, And Methods Integrating Eye Gaze Tracking For Stereo Viewer | |
| US12076088B2 (en) | Virtual reality-based portable nystagmography device and diagnostic test method using same | |
| US11094283B2 (en) | Head-wearable presentation apparatus, method for operating the same, and medical-optical observation system | |
| KR101667152B1 (en) | Smart glasses system for supplying surgery assist image and method for supplying surgery assist image using smart glasses | |
| CN110169821B (en) | Image processing method, device and system | |
| US20210121245A1 (en) | Surgeon interfaces using augmented reality | |
| KR20130059827A (en) | Glasses type camera using by pupil tracker | |
| CN211433341U (en) | Display helmet for endoscopic surgery | |
| CN103040444A (en) | Near-infrared body-surface vessel detector | |
| CN102068294A (en) | Auxiliary positioning system for shock wave stone breaker | |
| CN209132985U (en) | Camera settings and surgery training device | |
| CN213715886U (en) | Ultrasonic diagnostic system | |
| CN111193830B (en) | Portable augmented reality medical image observation auxiliary assembly based on smart phone |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20181102 |
|
| RJ01 | Rejection of invention patent application after publication |