CN107102738B - Device for solving infrared interference of multiple eye-movement instruments and control method thereof - Google Patents
Device for solving infrared interference of multiple eye-movement instruments and control method thereof Download PDFInfo
- Publication number
- CN107102738B CN107102738B CN201710303958.1A CN201710303958A CN107102738B CN 107102738 B CN107102738 B CN 107102738B CN 201710303958 A CN201710303958 A CN 201710303958A CN 107102738 B CN107102738 B CN 107102738B
- Authority
- CN
- China
- Prior art keywords
- eye
- head
- instruments
- dimming
- film
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 230000004424 eye movement Effects 0.000 title claims abstract description 30
- 238000000034 method Methods 0.000 title claims abstract description 13
- 230000000007 visual effect Effects 0.000 claims abstract description 16
- 239000000463 material Substances 0.000 claims description 11
- 239000004973 liquid crystal related substance Substances 0.000 claims description 7
- 229920000642 polymer Polymers 0.000 claims description 7
- 229920002799 BoPET Polymers 0.000 claims description 4
- 238000000149 argon plasma sintering Methods 0.000 claims description 4
- 230000009471 action Effects 0.000 claims description 3
- 230000005684 electric field Effects 0.000 claims description 2
- 239000003889 eye drop Substances 0.000 claims 1
- 230000001105 regulatory effect Effects 0.000 claims 1
- 230000004927 fusion Effects 0.000 abstract description 3
- 230000001737 promoting effect Effects 0.000 abstract description 3
- 238000001514 detection method Methods 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 3
- 238000005286 illumination Methods 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- 238000002834 transmittance Methods 0.000 description 3
- 230000008859 change Effects 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 210000003128 head Anatomy 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000007405 data analysis Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 239000003814 drug Substances 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/013—Eye tracking input arrangements
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
- A61B3/10—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions
- A61B3/113—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions for determining or recording eye movement
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/0093—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/20—Analysis of motion
- G06T7/292—Multi-camera tracking
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/18—Eye characteristics, e.g. of the iris
- G06V40/19—Sensors therefor
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Human Computer Interaction (AREA)
- Life Sciences & Earth Sciences (AREA)
- General Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Ophthalmology & Optometry (AREA)
- General Health & Medical Sciences (AREA)
- Medical Informatics (AREA)
- Veterinary Medicine (AREA)
- Molecular Biology (AREA)
- Surgery (AREA)
- Animal Behavior & Ethology (AREA)
- Biomedical Technology (AREA)
- Public Health (AREA)
- Heart & Thoracic Surgery (AREA)
- Optics & Photonics (AREA)
- Biophysics (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Liquid Crystal (AREA)
- Eye Examination Apparatus (AREA)
- Position Input By Displaying (AREA)
Abstract
The invention discloses a device for solving infrared interference of a plurality of eye-moving instruments, which comprises a dimming film, a switch controller and a control device, wherein at least two non-head-mounted eye-moving instruments are respectively arranged on the cameras of the eye-moving instruments according to the requirement of a visual field range and the visual field range of a single eye-moving instrument, the dimming film is arranged on the cameras of the eye-moving instruments, and a power switch of each dimming film is connected with the control device through one switch controller. The invention also discloses a control method of the device for solving the infrared interference of the eye movement instruments. The invention not only thoroughly solves the problem of interference of infrared rays of a plurality of eye-movement instruments, but also solves the problem of complex and massive data fusion after the cooperative work of a plurality of eye-movement instruments when only one eye-movement instrument works at any moment. The invention has no strict limit to the number of eye movement instruments. The invention plays a good role in promoting the promotion of the cooperative work of a plurality of eye-movement instruments which need to enlarge the visual field range.
Description
Technical Field
The invention relates to the technical field of eye movement tracking, in particular to a device for solving infrared interference of a plurality of eye movement instruments and a control method thereof.
Background
Eye tracking technology, also called gaze tracking technology, is a technology that uses various detection means such as mechanical, electronic, and optical to acquire the current direction of "visual attention" of a subject. The method is widely applied to the fields of man-machine interaction, medicine, marketing and advertising, ergonomics, virtual reality, military and the like.
Eye tracking techniques can be categorized into both head-mounted and non-head-mounted, also known as invasive and non-invasive, depending on the system configuration and detection method. According to the working illumination environment of the system, the system can be divided into an infrared illumination system and a natural illumination system. The head-wearing eye-movement instrument has the advantages that the visual field range is wider, the movement range of the head to be tested is not limited, but an auxiliary device is needed to be worn, so that eye-movement data of the head to be tested in a natural state cannot be detected, and the view is always in continuous change in the acquisition process, so that the analysis of the eye-movement data in the later stage is huge and complicated; the non-head-mounted infrared light eye-tracker consists of camera-type eye-tracker acquisition hardware and matched calculation analysis software, no auxiliary device is needed to be worn by a test, the later-period eye-tracker data analysis work is relatively simple, but the defect is that the single eye-tracker has relatively small detection coverage field of view, and especially the application requirement of a wide-view scene cannot be met. In order to solve the problem that a single eye tracker has a smaller detection visual field range, a plurality of eye trackers can be combined for application.
It is critical to combine multiple eye-pieces to solve the problem of infrared interference of each eye-piece. When a plurality of non-head-mounted infrared photo-eye electrokinetic devices work cooperatively, equipment cannot normally acquire eye image information due to mutual infrared interference. The present invention has been made to solve the above problems.
Disclosure of Invention
The invention aims to provide a device for preventing infrared interference when a plurality of eye-pieces are applied in a combined way and a control method thereof aiming at the problem of infrared interference among the plurality of non-head-mounted eye-pieces.
The technical problems solved by the invention can be realized by adopting the following technical scheme:
the device for solving the infrared interference of the eye-moving instruments is characterized by comprising a dimming film, a switch controller and a control device, wherein at least two non-head-mounted eye-moving instruments are respectively arranged on the eye-moving instrument cameras according to the requirement of a visual field range and the visual field range of a single eye-moving instrument, the dimming film is arranged on the eye-moving instrument cameras, and a power switch of each dimming film is connected with the control device through one switch controller.
In a preferred embodiment of the present invention, the non-head-mounted eye-tracker has three devices, and the total viewing angle ranges are 45 degrees on the left and right and 38 degrees on the top and bottom. Such a layout may satisfy the completion of a particular operational task.
In a preferred embodiment of the present invention, the dimming film includes a pair of transparent conductive films disposed opposite to each other and a liquid crystal/polymer mixed material layer filled in between the pair of transparent conductive films, the pair of transparent conductive films being respectively connected to both poles of a power source.
The control method of the device for solving the infrared interference of the eye motion instruments according to any one of the technical schemes, is characterized by comprising the following steps:
(1) At the beginning, all dimming films are opened;
(2) When a certain non-head-mounted eye tracker tracks human eyes and has eye movement data output, a command is sent to a control device, so that only a dimming film on the non-head-mounted eye tracker is in an electrified opening state, and dimming films on other non-head-mounted eye trackers are in an outage closing state, and at the moment, only the non-head-mounted eye tracker is always in a tracking and output state;
(3) When the non-head-mounted eye-tracker in the step (2) is lost, a command is sent to the control device, so that the dimming films on all the non-head-mounted eye-trackers are in an electrified open state, at the moment, all the non-head-mounted eye-trackers track human eyes together, and if a certain non-head-mounted eye-tracker finds human eyes, the step (2) is entered.
By adopting the technical scheme, the invention not only thoroughly solves the problem of interference of infrared rays of a plurality of eye-movement instruments, but also solves the problem of complex and massive data fusion after the cooperative work of the eye-movement instruments when only one eye-movement instrument works at any moment. The invention has no strict limit on the number of the eye-movement instruments, and the number of the eye-movement instruments can be adjusted according to the operation task requirement. The invention plays a good role in promoting the promotion of the cooperative work of a plurality of eye-movement instruments which need to enlarge the visual field range.
Drawings
In order to more clearly illustrate the embodiments of the invention or the technical solutions in the prior art, the drawings that are required in the embodiments or the description of the prior art will be briefly described, it being obvious that the drawings in the following description are only some embodiments of the invention, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
Fig. 1 is a schematic diagram of the structure of an embodiment of the present invention.
Fig. 2 is a schematic structural view of a dimming film according to an embodiment of the present invention.
Fig. 3 is a schematic diagram of the operation of a dimming film according to an embodiment of the present invention.
Detailed Description
The invention is further described below in order to make the technical means, the creation characteristics, the achievement of the purpose and the effect of the implementation of the invention easy to understand.
Referring to fig. 1, a device for solving infrared interference of multiple eye-pieces includes a dimming film 300, a switch controller 400 and a control device 200, where at least two non-head-mounted eye-pieces 100 are respectively arranged according to the requirement of the visual field range and the visual field range of a single eye-piece, so as to implement camera arrangement of the eye-pieces. The non-head-mounted eye-tracker 100 in the embodiment has three non-head-mounted eye-tracker 100, the total visual angle range is 45 degrees on the left and right sides and 38 degrees on the top and bottom sides, and thus the layout can meet the completion of specific operation tasks. The structure of the non-head-mounted eye tracker 100 is substantially the same as that of the prior art, and will not be described in detail herein. The control device 200 is preferably a PC.
A light modulation film 300 is attached to the camera surface 110 of each non-head-mounted eye tracker 100, and the power switch of each light modulation film 300 is connected to the control device 200 through a switch controller 400. The switch controller 400 is preferably an inverter control board, one end of which is connected to the control device 200 through a USB, and communicates with the control device 200 through an RS232 serial port; the other end is connected with a power switch of the light adjusting film 300 to control the on-off of the light adjusting film 300.
Referring to fig. 2 and 3, the dimming film 300 in the present embodiment includes a pair of transparent conductive films 310 disposed opposite to each other and a liquid crystal/polymer mixed material layer 320 filled between the pair of transparent conductive films 310, and the pair of transparent conductive films 310 are respectively connected to both poles of a power supply 330. The pair of transparent conductive films 310 includes a PET film 311 and an ITO conductive layer 312 provided on the inner surface of the PET film. When the light modulation film 300 is electrified (in an on state), the molecules of the liquid crystal/polymer mixed material layer 320 are orderly arranged under the action of an electric field, the refractive indexes of the materials tend to be consistent, the light scattering is greatly inhibited, and the light modulation film 300 is in a colorless transparent state; when the light modulation film 300 is powered off (off state), the liquid crystal/polymer mixed material layer 320 molecules are randomly oriented, the microscopic refractive indexes of the materials are mismatched, the light modulation film 300 generates strong light scattering, and the appearance is a milky white or brown or black opaque film; when the power supply voltage of the dimming film 300 is adjusted, gradual dimming of the dimming film can be achieved.
In the test, the light modulation film 300 was attached to a window, and the change in light transmittance of the light modulation film under the power-off and power-on conditions was observed. The on-state light transmittance is greater than 75%, and the off-state light transmittance is 5%; response time: the off-state to on-state (on-state) is below 5ms, the on-state to off-state (off-state) is below 50ms, and the power-on state viewing angle is 150 degrees.
For convenience of expression and control, for three non-head-mounted eye-pieces of the eye-movement apparatus 100, dimming films are defined as dimming films 1, 2, and 3, respectively, and commands are set in the switch controller 400 as in the following table 1:
TABLE 1
| Command | Action |
| oc0 | Closing all dimming films |
| oc1 | Light adjusting film 1 (EyeX 0) is turned on, and other light adjusting films are turned off |
| oc2 | The dimming film 2 (EyeX 1) is turned on, and the other dimming films are turned off |
| oc3 | The dimming film 3 (EyeX 2) is turned on, and the other dimming films are turned off |
| Oc4 | Opening all dimming films |
A control method of a device for solving infrared interference of a plurality of eye-movement instruments comprises the following steps:
(1) At the beginning, all dimming films are opened;
(2) When a certain non-head-mounted eye tracker (the non-head-mounted eye tracker corresponding to the dimming film 1 is assumed) tracks human eyes and has eye movement data output, a command oc1 is sent to a serial port, so that only the dimming film (namely the dimming film 1) on the non-head-mounted eye tracker is in an electrified and opened state, and the dimming films on other non-head-mounted eye trackers are in an outage and closed state, and at the moment, only the non-head-mounted eye tracker is always in a tracking and output state;
(3) When the non-head-mounted eye-tracker in the step (2) is lost, a command oc4 is sent to the serial port, so that the dimming films on all the non-head-mounted eye-trackers are in an electrified open state, at the moment, all the non-head-mounted eye-trackers track human eyes together, and if a certain non-head-mounted eye-tracker finds human eyes, the step (2) is entered.
Since the serial port is occupied in the process of sending the instruction, if two commands need to be sent at the same time, the command sent later is shielded because the serial port is occupied. The above process can ensure that only one non-head-mounted eye-tracker is in a tracking state at the same time, and prevent other non-head-mounted eye-trackers which do not track human eyes from generating infrared interference on the working eye-tracker.
The invention not only thoroughly solves the problem of interference of infrared rays of a plurality of eye-movement instruments, but also solves the problem of complex and massive data fusion after the cooperative work of a plurality of eye-movement instruments when only one eye-movement instrument works at any moment. The invention has no strict limit to the number of eye movement instruments. The invention plays a good role in promoting the promotion of the cooperative work of a plurality of eye-movement instruments which need to enlarge the visual field range.
The foregoing has shown and described the basic principles and main features of the present invention and the advantages of the present invention. It will be understood by those skilled in the art that the present invention is not limited to the embodiments described above, and that the above embodiments and descriptions are merely illustrative of the principles of the present invention, and various changes and modifications may be made without departing from the spirit and scope of the invention, which is defined in the appended claims. The scope of the invention is defined by the appended claims and equivalents thereof.
Claims (2)
1. The device for solving the infrared interference of the eye-moving instruments is characterized by comprising a dimming film, a switch controller and a control device, wherein three non-head-mounted eye-moving instruments are used for arranging cameras of the eye-moving instruments according to the requirement of a visual field range and the visual angle range of a single eye-moving instrument respectively, the dimming film is arranged on the cameras of the eye-moving instruments, and a power switch of each dimming film is connected with the control device through one switch controller; the dimming film comprises a pair of transparent conductive films which are oppositely arranged and a liquid crystal/polymer mixed material layer filled in the middle of the pair of transparent conductive films, and the pair of transparent conductive films are respectively connected with two poles of a power supply; the pair of transparent conductive films comprises a PET film and an ITO conductive layer arranged on the inner surface of the PET film; when the dimming film is electrified to be in an on state, molecules of the liquid crystal/polymer mixed material layer are orderly arranged under the action of an electric field, the refractive indexes of the materials tend to be consistent, light scattering is greatly inhibited, and the dimming film is in a colorless transparent state; when the dimming film is in a closing state after power failure, molecules of the liquid crystal/polymer mixed material layer are in disordered orientation, microscopic refractive indexes of the materials are mismatched, the dimming film generates strong light scattering, and the appearance of the dimming film is a milky white or brown or black opaque film; when the power supply voltage of the dimming film is regulated, gradual dimming of the dimming film can be realized;
the total visual angle range of the three non-head-mounted eye-movement instruments is 45 degrees respectively at left and right sides and 38 degrees respectively at upper and lower sides; only one eye tracker is active at any time.
2. A control method of the device for solving the infrared interference of the eye-drop instruments as claimed in claim 1, comprising the steps of:
(1) At the beginning, all dimming films are opened;
(2) When a certain non-head-mounted eye tracker tracks human eyes and has eye movement data output, a command is sent to a control device, so that only a dimming film on the non-head-mounted eye tracker is in an electrified opening state, and dimming films on other non-head-mounted eye trackers are in an outage closing state, and at the moment, only the non-head-mounted eye tracker is always in a tracking and output state;
(3) When the non-head-mounted eye-tracker in the step (2) is lost, a command is sent to the control device, so that the dimming films on all the non-head-mounted eye-trackers are in an electrified open state, at the moment, all the non-head-mounted eye-trackers track human eyes together, and if a certain non-head-mounted eye-tracker finds human eyes, the step (2) is entered.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710303958.1A CN107102738B (en) | 2017-05-03 | 2017-05-03 | Device for solving infrared interference of multiple eye-movement instruments and control method thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710303958.1A CN107102738B (en) | 2017-05-03 | 2017-05-03 | Device for solving infrared interference of multiple eye-movement instruments and control method thereof |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107102738A CN107102738A (en) | 2017-08-29 |
| CN107102738B true CN107102738B (en) | 2024-04-05 |
Family
ID=59656738
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710303958.1A Active CN107102738B (en) | 2017-05-03 | 2017-05-03 | Device for solving infrared interference of multiple eye-movement instruments and control method thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107102738B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110171427B (en) * | 2019-05-30 | 2020-10-27 | 北京七鑫易维信息技术有限公司 | Sight tracking method, device and system |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101581874B (en) * | 2009-03-27 | 2011-01-05 | 北京航空航天大学 | Tele-immersion teamwork device based on multi-camera acquisition |
| CN102006461B (en) * | 2010-11-18 | 2013-01-02 | 无锡中星微电子有限公司 | Joint tracking detection system for cameras |
| CN104950476B (en) * | 2014-03-26 | 2018-06-15 | 北京数字智通科技有限公司 | For the electric-controlled light-regulating unit and photographic device of photographic device |
| CN204595327U (en) * | 2014-12-26 | 2015-08-26 | 成都理想境界科技有限公司 | Head-mounted display apparatus |
| CN207301972U (en) * | 2017-05-03 | 2018-05-01 | 中国人民解放军海军医学研究所 | A kind of device for solving more eye tracker Infrared jammings |
-
2017
- 2017-05-03 CN CN201710303958.1A patent/CN107102738B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN107102738A (en) | 2017-08-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10228566B2 (en) | Apparatus und method for rendering a virtual monitor on smart ophthalmic devices in augmented reality environments | |
| CN103443742B (en) | For staring the system and method with gesture interface | |
| US9489044B2 (en) | Visual stabilization system for head-mounted displays | |
| US11733525B2 (en) | Method and apparatus for independent control of focal vergence and emphasis of displayed and transmitted optical content | |
| US20190324274A1 (en) | Head-Mounted Device with an Adjustable Opacity System | |
| US20150205134A1 (en) | Systems, articles, and methods for wearable heads-up displays | |
| US20200058256A1 (en) | SELECTIVE DIMMING OF AMBIENT LIGHTING IN VIRTUAL, AUGMENTED, AND MIXED REALITY (xR) APPLICATIONS | |
| CN103293747B (en) | Transparent liquid crystal display device | |
| JP2017534957A (en) | Display that reduces eye discomfort | |
| US20210072821A1 (en) | Apparatus und Method for Rendering a Virtual Monitor on Smart Ophthalmic Devices in Augmented Reality Environments | |
| KR20210004776A (en) | Apparatus and method of displaying augmented reality | |
| Tas et al. | An object-mediated updating account of insensitivity to transsaccadic change | |
| CN205982834U (en) | Multi -mode wear -type visual device | |
| CN105676455A (en) | Head-wearing display equipment | |
| CN107102738B (en) | Device for solving infrared interference of multiple eye-movement instruments and control method thereof | |
| Hazubski et al. | Electrode-free visual prosthesis/exoskeleton control using augmented reality glasses in a first proof-of-technical-concept study | |
| CN205608290U (en) | Head -wearing display equipment | |
| US9491365B2 (en) | Viewfinder wearable, at least in part, by human operator | |
| Beach et al. | Eye tracker system for use with head mounted displays | |
| CN106291914A (en) | Display floater and driving method thereof and display device | |
| CN109240510A (en) | Augmented reality human-computer interaction device and control method based on Eye-controlling focus | |
| CN207301972U (en) | A kind of device for solving more eye tracker Infrared jammings | |
| Adhikarla et al. | Design and evaluation of freehand gesture interaction for light field display | |
| CN110865480A (en) | Image depth modulation module and application thereof | |
| Marsili | Epidermal systems and virtual reality: emerging disruptive technology for military applications |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |