CN110633014A - Head-mounted eye movement tracking device - Google Patents
Head-mounted eye movement tracking device Download PDFInfo
- Publication number
- CN110633014A CN110633014A CN201911011899.6A CN201911011899A CN110633014A CN 110633014 A CN110633014 A CN 110633014A CN 201911011899 A CN201911011899 A CN 201911011899A CN 110633014 A CN110633014 A CN 110633014A
- Authority
- CN
- China
- Prior art keywords
- eye
- module
- video image
- camera bracket
- circuit unit
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 230000004424 eye movement Effects 0.000 title claims abstract description 18
- 210000001508 eye Anatomy 0.000 claims abstract description 99
- 238000012545 processing Methods 0.000 claims abstract description 45
- 210000003128 head Anatomy 0.000 claims abstract description 27
- 230000005540 biological transmission Effects 0.000 claims abstract description 20
- 210000005252 bulbus oculi Anatomy 0.000 claims abstract description 5
- WHXSMMKQMYFTQS-UHFFFAOYSA-N Lithium Chemical compound [Li] WHXSMMKQMYFTQS-UHFFFAOYSA-N 0.000 claims description 8
- 229910052744 lithium Inorganic materials 0.000 claims description 8
- 229920000642 polymer Polymers 0.000 claims description 8
- 238000003384 imaging method Methods 0.000 claims description 6
- 230000004438 eyesight Effects 0.000 claims description 4
- 235000002911 Salvia sclarea Nutrition 0.000 abstract description 5
- 244000182022 Salvia sclarea Species 0.000 abstract description 5
- 230000033001 locomotion Effects 0.000 abstract description 5
- 238000003745 diagnosis Methods 0.000 abstract description 3
- 208000020016 psychiatric disease Diseases 0.000 abstract description 3
- 230000001575 pathological effect Effects 0.000 abstract description 2
- 230000004397 blinking Effects 0.000 abstract 2
- 210000001747 pupil Anatomy 0.000 description 11
- 238000013461 design Methods 0.000 description 3
- 230000000694 effects Effects 0.000 description 3
- 230000008901 benefit Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000000903 blocking effect Effects 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 238000000034 method Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 210000000056 organ Anatomy 0.000 description 1
- 238000004088 simulation Methods 0.000 description 1
Images
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
- A61B3/10—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions
- A61B3/113—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions for determining or recording eye movement
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
- A61B3/10—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions
- A61B3/14—Arrangements specially adapted for eye photography
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/0093—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/013—Eye tracking input arrangements
Landscapes
- Engineering & Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Physics & Mathematics (AREA)
- Surgery (AREA)
- Public Health (AREA)
- Biomedical Technology (AREA)
- Heart & Thoracic Surgery (AREA)
- Medical Informatics (AREA)
- Molecular Biology (AREA)
- Biophysics (AREA)
- Animal Behavior & Ethology (AREA)
- General Health & Medical Sciences (AREA)
- Ophthalmology & Optometry (AREA)
- Veterinary Medicine (AREA)
- General Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Optics & Photonics (AREA)
- Studio Devices (AREA)
Abstract
The invention discloses a head-mounted eye movement tracking device. The invention is worn on the head of a user and comprises a head wearing piece, a miniature infrared camera module arranged in the head wearing piece, an eye video image processing module, a wireless data transmission module and a power supply module; the invention is worn on the head, and the infrared camera bracket on the wearing piece is adjusted to be aligned with the eyes, so that clear eye images can be presented; the eyeball motion track can be recorded, and reference is provided for the diagnosis of mental diseases; the system can track the sight line information of human eyes, detect blinking actions and convert the blinking actions into mouse signals to control the use of digital terminals such as computers, mobile phones and the like. The invention can provide assistance for doctors to the pathological examination and the mental disease diagnosis of the eyes of the patients, can also realize the rough replacement of the mouse by controlling the cursor through the eye movement information, brings convenience to people who are inconvenient to use the mouse with hands, and has low equipment cost and convenient wearing.
Description
Technical Field
The invention relates to the field of eye movement tracking devices, in particular to a head-mounted eye movement tracking device.
Background
The eyes are important organs for acquiring information from the surrounding world, and can be used as important basis for researching human psychological activities and extracting psychological consciousness by accurately measuring the fixation point of one person, and the fixation point can be used for replacing a mouse or touch operation to realize human-computer interaction by utilizing the fixation point; the eye movement tracking device is used as a sight line drop point measuring device, and has wide application prospects in various industries, including the fields of rehabilitation, advertisement design, game design, human-computer interface design and the like. Although the eye tracking device has a wide application prospect, most of the existing eye tracking devices in China at present are head-limited, and a measured person needs to fix the head on a plane, and the head cannot move during measurement, so that the eye tracking device is very inflexible. Moreover, the distance between the camera and the human eyes is far, the proportion of the pixels of the human eyes in each frame of image acquired by the camera is small, and the interference caused by a complex background image cannot be avoided, so that the tracking algorithm on the non-wearable device is high in complexity, large in calculated amount, high in requirement on hardware operation speed, low in instantaneity and poor in user experience, and the hardware resources of the controlled device are occupied.
If can provide a wearable eye tracking device in head, dress elasticity, camera angle are adjustable, can be suitable for different individual and the wearing comfortablely of use, and the core is not calculated from the area, thereby occupies the hardware resource of controlled equipment in a large number and reduces the hardware performance requirement to controlled equipment, can improve the use of eye tracking technique greatly and experience, and market prospect is wide. The present invention has thus been made.
Disclosure of Invention
The invention aims to solve the defects of the existing eye tracking device and discloses a wearable eye tracking device with low cost.
A head-wearing type eye movement tracking device comprises a head wearing piece (1), a micro infrared camera module (2) arranged in the head wearing piece, an eye video image processing module (3), a wireless data transmission module (4) and a power supply module (5); the eye tracking system has three working modes of eye imaging, eyeball track tracking and eye sight tracking;
the head wearing piece (1) is provided with a USB Type-C input socket (1-1), a rear fixing clamping band (1-2), a front fixing clamping band (1-3), an LED indicating lamp (1-4), a multifunctional light touch key (1-5), a left camera bracket (1-6), a right camera bracket (1-7), a clamping band tightness adjusting left knob (1-8), a left camera bracket rotation adjusting knob (1-9), a clamping band tightness adjusting right knob (1-10) and a right camera bracket rotation adjusting knob (1-11);
wherein the multifunctional light touch key (1-5) is positioned in the middle of the front side of the front fixed clamping belt (1-3); the LED indicator lamps (1-4) are positioned at two sides of the multifunctional light touch key (1-5); the left camera bracket (1-6) is connected with the left tail end of the front fixing clamping belt (1-3); the right camera bracket (1-7) is connected with the tail end of the right side of the front fixing clamping belt (1-3); the USB Type-C input socket (1-1) is positioned in the middle of the outer side of the cavity of the rear fixed clamping belt (1-2); the left clamping belt tightness adjusting knob (1-8) is positioned at the left connecting part of the rear fixed clamping belt (1-2) and the front fixed clamping belt (1-3); the right clamping belt tightness adjusting knob (1-10) is positioned at the right connecting part of the rear fixed clamping belt (1-2) and the front fixed clamping belt (1-3); the left camera bracket rotation adjusting knob (1-9) is positioned at the joint of the left camera bracket (1-6) and the front fixing clamping belt (1-3), and the right camera bracket rotation adjusting knob (1-11) is positioned at the right joint of the right camera bracket (1-7) and the front fixing clamping belt (1-3); the USB Type-C input socket (1-1) is used as a charging input and limited data transmission socket; the multifunctional light touch key (1-5) is used for turning on or off the head-mounted eye tracking device, indicating the state of a switch and switching the working mode; the LED indicator lamps (1-4) are used for indicating different working modes, charging states and residual electric quantity; the rear fixing clamping belt (1-2) and the front fixing clamping belt (1-3) are used for wearing the device on the head; the left clamping belt tightness adjusting knob (1-8) and the right clamping belt tightness adjusting knob (1-10) are used for adjusting the tightness of the device to adapt to different users; the left camera bracket (1-6) and the right camera bracket (1-7) are respectively used for fixing the miniature infrared camera and can respectively rotate up and down by taking the left camera bracket rotation adjusting knob (1-9) and the right camera bracket rotation adjusting knob (1-11) as centers; the left camera bracket rotation adjusting knob (1-9) and the right camera bracket rotation adjusting knob (1-11) are respectively used for adjusting the rotation positions of the left camera bracket (1-6) and the right camera bracket (1-7) to enable the micro infrared camera to be aligned to the eye;
the eye video image processing module (3) arranged in the head wearing piece (1) is respectively connected with the micro infrared camera module (2), the wireless data transmission module (4) and the power supply module (5);
the eye video image processing module (3) comprises an eye video image data cache circuit unit (3-1), an FPGA image processing and control circuit unit (3-2), an LED indicator lamp driving circuit unit (3-3) and a key circuit unit (3-4); the miniature infrared camera module (2) is used for collecting the eye images of the user; the eye video image processing module (3) is used for processing video image signals output by the micro infrared camera module (2) to complete pupil center positioning and eye action identification; the wireless data transmission module (4) is used for transmitting the processing result obtained by the eye video image processing module (3) to a mobile phone or a computer or other digital terminals in a wireless mode; the power supply module (5) comprises a charging circuit unit (5-1) and a 3.7V polymer lithium battery (5-2) and is used for supplying power to the system.
The number of the cameras of the miniature infrared camera module (2) is 2, and the miniature infrared camera module is respectively arranged in a left camera bracket (1-6) and a right camera bracket (1-7) of the wearing piece (1) and integrated with an infrared light-emitting diode; a larger cavity is arranged in the middle of the rear side of the rear fixing clamping belt (1-2) and is used for fixing and protecting the eye video image processing module (3), the wireless data transmission module (4) and the power supply module (5); the FPGA image processing and control circuit unit (3-2) in the eye video image processing module (3) is respectively connected with an eye video image data cache circuit unit (3-1), an LED indicator lamp driving circuit unit (3-3) and a key circuit unit (3-4); the eye video image data cache circuit unit (3-1) is used for caching video image data output by the micro infrared camera module (2) by taking a frame as a unit; the FPGA image processing and control circuit unit (3-2) is used for reading eye video image data from the eye video image data cache circuit unit (3-1) by taking a frame as a unit, processing the eye video image data to realize pupil center positioning and eye action identification, transmitting an obtained processing result to the wireless data transmission module (4), judging the state of the multifunctional key (1-5) according to an output result of the key circuit unit (3-4) to realize switching of a working mode and controlling the display of the LED indicator light circuit unit (3-3); the charging circuit (5-1) in the power module (5) is used for charging a 3.7V polymer lithium battery (5-2) through a USB Type-C input socket (1-1); the 3.7V polymer lithium battery (5-2) provides working voltage for each module.
The invention has the beneficial effects that:
the head-wearing eye movement tracking device provided by the invention has the advantages that the viewing angle of the camera is adjustable, the wearing tightness is adjustable, the head-wearing eye movement tracking device is suitable for different wearing individuals and is comfortable to wear, the camera can shoot clear eye images without blocking the sight of human eyes by only wearing the head-wearing eye movement tracking device on the head and adjusting the camera bracket, so that the effects of tracking the eye gaze point of the human eyes, tracking the movement track of the eyeballs and presenting clear eye images can be realized; the wireless data transmission can be used for being associated with digital terminals such as computers, mobile phones and the like; corresponding driving software is installed at the computer end or the mobile phone end, and when the human eye sight tracking working mode is adopted, the purpose that a mouse or touch operation is replaced by a human eye fixation point to use a computer or a mobile phone can be achieved; when the eye tracking or eye imaging mode is adopted, clear eye real-time images can be displayed at a computer or a mobile phone end. The eye movement control mouse can provide assistance for doctors to pathological examination and mental disease diagnosis of the eyes of patients, can also realize that the mouse is roughly replaced by controlling the cursor through the eye movement information, and brings convenience for people who are inconvenient to use the mouse with hands. The digital image processing is carried out by taking the embedded hardware as a computing core, the hardware resource occupancy rate of the controlled equipment is low, the hardware performance requirement of the controlled equipment is lower, the use limit is less, the equipment cost is low, and the wearing is convenient.
Drawings
FIG. 1 is a left side view of a head wear of a head mounted eye tracking device in accordance with the present invention;
FIG. 2 is a right side view of a head wear of a head mounted eye tracking device in accordance with the present invention;
FIG. 3 is a rear view of a head wear of a head mounted eye tracking device in accordance with the present invention;
FIG. 4 is a block diagram of a system module of a head-mounted eye tracking device according to the present invention;
Detailed Description
Exemplary embodiments of the present invention will be described hereinafter with reference to the accompanying drawings. In the interest of clarity and conciseness, not all features of an actual implementation are described in the specification. It will of course be appreciated that in the development of any such actual embodiment, numerous implementation-specific decisions must be made to achieve the developers' specific goals, such as compliance with system-related and business-related constraints, which will vary from one implementation to another.
It should be noted that, in order to avoid obscuring the present invention with unnecessary details, only the modules and/or circuits that are closely related to the solution according to the present invention are shown in the drawings, and other details that are not so relevant to the present invention are omitted.
The first embodiment is as follows:
as shown in fig. 1, 2, and 3, the head-mounted eye tracking device according to the present embodiment includes:
a head wearing member 1 for wearing the device on the head of various individuals and fixing and protecting electronic components required for the device; the wearable part 1 is provided with a USB Type-C input socket 1-1, a rear fixing clamping band 1-2, a front fixing clamping band 1-3, an LED indicator lamp 1-4, a multifunctional light touch key 1-5, a left camera bracket 1-6, a right camera bracket 1-7, a clamping band tightness adjusting left knob 1-8, a left camera bracket rotation adjusting knob 1-9, a clamping band tightness adjusting right knob 1-10 and a right camera bracket rotation adjusting knob 1-11;
the multifunctional light touch key 1-5 is positioned in the middle of the front side of the front fixed clamping belt 1-3 and is used for turning on or off the eye movement centering device, indicating the state of a switch and switching the working mode; lightly pressing the multifunctional keys 1-5, enabling the multifunctional keys 1-5 to emit red light, turning on the eye movement tracking device and defaulting to be in an eye imaging working mode, and adjusting left and right camera brackets according to an imaging effect to enable the cameras to be in positions where clear eye images can be shot and the sight lines of human eyes are not shielded; then quickly and lightly pressing the two multifunctional keys 1-5, and switching to an eyeball motion track tracking mode after the red light emitted by the keys flickers; then, quickly and lightly pressing two multifunctional keys 1-5, and switching to a human eye sight tracking mode after the red light emitted by the keys flickers; lightly pressing the two multifunctional keys 1-5, and switching to the default eye imaging mode after the red light emitted by the keys flickers; long-pressing the multifunctional key 1-5, turning off red light of the functional key 1-5, and turning off the eye movement tracking device;
the LED indicator lamps 1-4 are positioned at two sides of the multifunctional light touch key 1-5; when the eye tracking device is in different working states, the LED indicator lamps on the left sides of the multifunctional keys 1-5 are in different colors so as to indicate different working states; the LED indicator lamp on the right side of the multifunctional key 1-5 is used for indicating different electric quantity grades, and when the residual electric quantity is 100% -70%, the LED indicator lamp emits green light; when the residual capacity is between 69% and 40%, the battery emits yellow light; when the electric quantity is 39% -10%, the red light is emitted; when the electric quantity is lower than 10%, the lamp twinkles to emit red light; when the device is charged, the device flickers to emit green light, and when the electric quantity is full, the device is a constant green light;
the left camera bracket 1-6 is connected with the left end of the front fixing clamping belt 1-3; the device can be used for fixing and adjusting the miniature infrared camera module; the right camera bracket 1-7 is connected with the right tail end of the front fixing clamping belt 1-3 and used for fixing and adjusting the miniature infrared camera module;
the USB Type-C input socket 1-1 is positioned in the middle of the outer side of the cavity of the rear fixing clamping belt 1-2; the device is used for realizing charging and wired data transmission of the device;
the left clamping belt tightness adjusting knob 1-8 is positioned at the left connecting part of the rear fixed clamping belt 1-2 and the front fixed clamping belt 1-3; the right clamping belt tightness adjusting knob 1-10 is positioned at the right connecting part of the rear fixed clamping belt 1-2 and the front fixed clamping belt 1-3; the diameter of a circle formed by the rear fixing clamping band 1-2 and the front fixing clamping band 1-3 can be adjusted by rotating the left knob 1-8 and the right knob 1-10, so that individuals with different head diameters can firmly wear the device on the head;
the left camera bracket rotation adjusting knob 1-9 is positioned at the joint of the left camera bracket 1-6 and the front fixing clamping belt 1-3, the right camera bracket rotation adjusting knob 1-11 is positioned at the right joint of the right camera bracket 1-7 and the front fixing clamping belt 1-3, and the rotation positions of the left camera bracket 1-6 and the right camera bracket 1-7 are respectively adjusted to enable the micro infrared camera to be aligned with the eye;
the second embodiment is as follows: unlike the first embodiment, the head-mounted eye tracking apparatus according to the present embodiment, as shown in fig. 1 and 4, includes:
the miniature infrared camera module 2, the eye video image processing module 3, the wireless data transmission module 4 and the power module 5 are arranged in the head wearing piece 1; the eye video image processing module 3 is respectively connected with the micro infrared camera module 2, the wireless data transmission module 4 and the power supply module 5; the device comprises a micro infrared camera module, a micro infrared light-emitting diode module and a micro infrared camera module, wherein 2 micro infrared camera modules are integrated with the micro infrared light-emitting diode and are responsible for collecting human eye video image data; the eye video image processing module 3 is responsible for processing the algorithm of the whole eye movement tracking device, the wireless data transmission module 4 is used for transmitting the result obtained after the eye video image data is processed by the eye video image processing module 3 to the associated digital equipment such as a computer or a mobile phone in a wireless mode, and the power supply module 5 is used for supplying power and charging the system;
the third concrete implementation mode: in contrast to the second embodiment, the head-mounted eye tracking apparatus of the present embodiment is shown in fig. 4:
the eye video image processing module (3) comprises an eye video image data cache circuit unit 3-1, an FPGA image processing and control circuit unit 3-2, an LED indicator lamp driving circuit unit 3-3 and a key circuit unit 3-4; an FPGA image processing and control circuit unit 3-2 in the eye video image processing module 3 is respectively connected with an eye video image data cache circuit unit 3-1, an LED indicator lamp driving circuit unit 3-3 and a key circuit unit 3-4; the eye video image data cache circuit unit 3-1 is used for caching the video image data output by the micro infrared camera module 2 by taking a frame as a unit; the FPGA image processing and control circuit unit 3-2 is used for reading eye video image data from the eye video image data cache circuit unit 3-1 by taking a frame as a unit, processing the eye video image data to realize pupil center positioning and eye action identification, transmitting an obtained processing result to the wireless data transmission module 4, judging the state of the multifunctional key 1-5 according to an output result of the key circuit unit 3-4 to realize the switching of a working mode and controlling the display of the LED indicator lamp driving circuit unit 3-3;
the power module 5 comprises a charging circuit unit 5-1 and a 3.7V polymer lithium battery 5-2; wherein the charging circuit (5-1) is used for realizing the charging of the 3.7V polymer lithium battery 5-2 through the USB Type-C input socket 1-1.
The fourth concrete implementation mode: different from the third embodiment, the eye tracking algorithm of the head-mounted eye tracking device according to the present embodiment includes the following steps:
step one, collecting bright and dark pupil images:
the micro infrared light emitting diode integrated by the micro infrared camera module 2 flickers at a certain frequency, the FPGA image processing and control circuit unit 3-2 in the eye video image processing module 3 controls the frame rate of the image output by the micro infrared camera module 2 and the flickering frequency of the micro infrared light emitting diode to make the frequencies of the two same, so that the obtained eye images are images supplemented by the micro infrared diode in the continuous 2 frames of images, only one frame of image is an image supplemented by the micro infrared diode, the two continuous frames of images including the pupils of human eyes are images with alternating bright pupils and dark pupils respectively, and the two frames of images are cached in the eye video image data caching circuit unit 3-1.
Step two, pupil center coordinate extraction:
using the bright and dark pupil image obtained in the first step, reading two continuous frames of images from the eye video image data cache circuit unit 3-1 by the FPGA image processing and control circuit unit 3-2, and performing differential operation according to a formula (1-1) by using pixels in the current frame of image and pixels corresponding to the next frame of image; wherein T is1To set the threshold value, (x)i) Representing the x-th frame of a current frame in two successive frames of imagesiValue of pixel, B (x)i) A value representing a pixel of a subsequent frame in two consecutive frames of images; determining the pixels meeting the formula (1-1) as pupil image pixels in the eye image, and otherwise, determining the pixels as non-pupil image pixels; setting the pupil image pixel as 1 and the non-pupil image pixel as 0 to form a binary image, thereby obtaining a binary image only containing the pupil, respectively calculating the minimum circumscribed circle of the pupil image pixel, and taking the center of the circle as the pupil center coordinate;
F(xi)-B(xi)>T1 (1-1)
step three, mouse time sequence simulation:
the wireless data transmission module 4 encodes the obtained pupil center coordinate data into a signal data format of the mouse, simulates the signal time sequence of the mouse equipment, and transmits the data out, so that the eye tracking device can be used as the mouse equipment by a related computer or a mobile phone and the like, the movement of a mouse cursor is controlled by the movement of the center coordinate, and the equipment which supports mouse control can be controlled by the eye tracking device;
although the invention has been described in terms of the above embodiments, it will be apparent to those skilled in the art, having the benefit of the foregoing description, that other embodiments are envisaged which are within the scope of the invention as thus described. Furthermore, it should be noted that the language used in the specification has been principally selected for readability and instructional purposes, and may not have been selected to delineate or circumscribe the inventive subject matter. Accordingly, many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the appended claims. The present invention has been disclosed in an illustrative rather than a restrictive sense, and the scope of the present invention is defined by the appended claims.
Claims (2)
1. A head-mounted eye movement tracking device, comprising: the eye-protection type head wearing piece comprises a head wearing piece (1), a miniature infrared camera module (2) arranged in the head wearing piece, an eye video image processing module (3), a wireless data transmission module (4) and a power supply module (5); the eye tracking system has three working modes of eye imaging, eyeball track tracking and eye sight tracking;
the head wearing piece (1) is provided with a USB Type-C input socket (1-1), a rear fixing clamping band (1-2), a front fixing clamping band (1-3), an LED indicating lamp (1-4), a multifunctional light touch key (1-5), a left camera bracket (1-6), a right camera bracket (1-7), a clamping band tightness adjusting left knob (1-8), a left camera bracket rotation adjusting knob (1-9), a clamping band tightness adjusting right knob (1-10) and a right camera bracket rotation adjusting knob (1-11); wherein the multifunctional light touch key (1-5) is positioned in the middle of the front side of the front fixed clamping belt (1-3); the LED indicator lamps (1-4) are positioned at two sides of the multifunctional light touch key (1-5); the left camera bracket (1-6) is connected with the left tail end of the front fixing clamping belt (1-3); the right camera bracket (1-7) is connected with the tail end of the right side of the front fixing clamping belt (1-3); the USB Type-C input socket (1-1) is positioned in the middle of the outer side of the cavity of the rear fixed clamping belt (1-2); the left clamping belt tightness adjusting knob (1-8) is positioned at the left connecting part of the rear fixed clamping belt (1-2) and the front fixed clamping belt (1-3); the right clamping belt tightness adjusting knob (1-10) is positioned at the right connecting part of the rear fixed clamping belt (1-2) and the front fixed clamping belt (1-3); the left camera bracket rotation adjusting knob (1-9) is positioned at the joint of the left camera bracket (1-6) and the front fixing clamping belt (1-3), and the right camera bracket rotation adjusting knob (1-11) is positioned at the right joint of the right camera bracket (1-7) and the front fixing clamping belt (1-3);
the USB Type-C input socket (1-1) is used as a charging input and a wired data transmission socket; the multifunctional light touch key (1-5) is used for turning on or off the head-mounted eye tracking device, indicating the state of a switch and switching the working mode; the LED indicator lamps (1-4) are used for indicating different working modes, charging states and residual electric quantity; the rear fixing clamping belt (1-2) and the front fixing clamping belt (1-3) are used for wearing the device on the head; the clamping belt tightness adjusting left knob (1-8) and the clamping belt tightness adjusting right knob (1-10) are used for adjusting the wearing tightness so as to be suitable for different wearing individuals; the left camera bracket (1-6) and the right camera bracket (1-7) are respectively used for fixing the miniature infrared camera and can respectively rotate up and down by taking the left camera bracket rotation adjusting knob (1-9) and the right camera bracket rotation adjusting knob (1-11) as centers; the left camera bracket rotation adjusting knob (1-9) and the right camera bracket rotation adjusting knob (1-11) are respectively used for adjusting the rotation positions of the left camera bracket (1-6) and the right camera bracket (1-7) so that the micro infrared camera can be aligned to eyes;
the eye video image processing module (3) arranged in the wearing piece (1) is respectively connected with the micro infrared camera module (2), the wireless data transmission module (4) and the power supply module (5); the eye video image processing module (3) comprises an eye video image data cache circuit unit (3-1), an FPGA image processing and control circuit unit (3-2), an LED indicator lamp driving circuit unit (3-3) and a key circuit unit (3-4);
the miniature infrared camera module (2) is used for collecting the eye images of the user; the eye video image processing module (3) is used for processing video image signals output by the micro infrared camera module (2) to complete pupil center positioning and eye action identification; the wireless data transmission module (4) is used for transmitting the processing result obtained by the eye video image processing module (3) to a mobile phone or a computer or other digital terminals in a wireless mode; the power supply module (5) comprises a charging circuit unit (5-1) and a 3.7V polymer lithium battery (5-2) and is used for supplying power to the system.
2. A head-mounted eye tracking device according to claim 1, wherein: the number of the cameras of the miniature infrared camera module (2) is 2, and the left camera bracket (1-6) and the right camera bracket (1-7) which are respectively arranged in the head wearing piece (1) are integrated with a miniature infrared light-emitting diode; a larger cavity is arranged in the middle of the rear side of the rear fixing clamping belt (1-2) and is used for fixing and protecting the eye video image processing module (3), the wireless data transmission module (4) and the power supply module (5); the FPGA image processing and control circuit unit (3-2) in the eye video image processing module (3) is respectively connected with the eye video image data cache circuit unit (3-1), the LED indicator light circuit unit (3-3) and the key circuit unit (3-4); the eye video image data cache circuit unit (3-1) is used for caching video image data output by the micro infrared camera module (2) by taking a frame as a unit; the FPGA image processing and control circuit unit (3-2) is used for reading eye video image data from the eye video image data cache circuit unit (3-1) by taking a frame as a unit, processing the eye video image data to realize pupil center positioning and eye action identification, transmitting an obtained processing result to the wireless data transmission module (4), judging the state of the multifunctional key (1-5) according to an output result of the key circuit unit (3-4) to realize switching of a working mode and controlling the display of the LED indicator light circuit unit (3-3); the charging circuit (5-1) in the power module (5) is used for charging the 3.7V polymer lithium battery (5-2) through the USBType-C input socket (1-1); the 3.7V polymer lithium battery (5-2) provides working voltage for each module.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911011899.6A CN110633014B (en) | 2019-10-23 | 2019-10-23 | Head-wearing eye movement tracking device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911011899.6A CN110633014B (en) | 2019-10-23 | 2019-10-23 | Head-wearing eye movement tracking device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110633014A true CN110633014A (en) | 2019-12-31 |
| CN110633014B CN110633014B (en) | 2024-04-05 |
Family
ID=68977431
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911011899.6A Active CN110633014B (en) | 2019-10-23 | 2019-10-23 | Head-wearing eye movement tracking device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110633014B (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111714080A (en) * | 2020-06-30 | 2020-09-29 | 重庆大学 | Disease classification system based on eye movement information |
| CN112674716A (en) * | 2020-12-11 | 2021-04-20 | 首都医科大学附属北京儿童医院 | Head position measuring device capable of collecting eye shake data |
| CN114035673A (en) * | 2020-11-18 | 2022-02-11 | 武汉联影医疗科技有限公司 | Ultrasonic eye movement control system and method |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2002000567A (en) * | 2000-06-23 | 2002-01-08 | Kansai Tlo Kk | Method of measuring pupil center position and method of detecting view point position |
| CN104055478A (en) * | 2014-07-08 | 2014-09-24 | 金纯� | Medical endoscope control system based on sight tracking control |
| CN104866105A (en) * | 2015-06-03 | 2015-08-26 | 深圳市智帽科技开发有限公司 | Eye movement and head movement interactive method for head display equipment |
| CN107247511A (en) * | 2017-05-05 | 2017-10-13 | 浙江大学 | A kind of across object exchange method and device based on the dynamic seizure of eye in virtual reality |
| CN107388201A (en) * | 2017-09-05 | 2017-11-24 | 哈尔滨理工大学 | The dynamic control operation illuminating lamp of medical wear-type eye |
| WO2018076202A1 (en) * | 2016-10-26 | 2018-05-03 | 中国科学院深圳先进技术研究院 | Head-mounted display device that can perform eye tracking, and eye tracking method |
| WO2019196133A1 (en) * | 2018-04-09 | 2019-10-17 | 杭州瑞杰珑科技有限公司 | Head-mounted visual aid device |
-
2019
- 2019-10-23 CN CN201911011899.6A patent/CN110633014B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2002000567A (en) * | 2000-06-23 | 2002-01-08 | Kansai Tlo Kk | Method of measuring pupil center position and method of detecting view point position |
| CN104055478A (en) * | 2014-07-08 | 2014-09-24 | 金纯� | Medical endoscope control system based on sight tracking control |
| CN104866105A (en) * | 2015-06-03 | 2015-08-26 | 深圳市智帽科技开发有限公司 | Eye movement and head movement interactive method for head display equipment |
| CN108170279A (en) * | 2015-06-03 | 2018-06-15 | 塔普翊海（上海）智能科技有限公司 | The eye of aobvious equipment is moved moves exchange method with head |
| WO2018076202A1 (en) * | 2016-10-26 | 2018-05-03 | 中国科学院深圳先进技术研究院 | Head-mounted display device that can perform eye tracking, and eye tracking method |
| CN107247511A (en) * | 2017-05-05 | 2017-10-13 | 浙江大学 | A kind of across object exchange method and device based on the dynamic seizure of eye in virtual reality |
| CN107388201A (en) * | 2017-09-05 | 2017-11-24 | 哈尔滨理工大学 | The dynamic control operation illuminating lamp of medical wear-type eye |
| WO2019196133A1 (en) * | 2018-04-09 | 2019-10-17 | 杭州瑞杰珑科技有限公司 | Head-mounted visual aid device |
Non-Patent Citations (2)
| Title |
|---|
| 曹晔;: "穿戴式视线追踪系统研究", 计算机与数字工程, no. 06, 20 June 2016 (2016-06-20) * |
| 朱麒文;闫隆鑫;张若兰;张帅;杨兰兰;: "基于视线追踪的眼控鼠标设计", 电子器件, no. 02, 20 April 2016 (2016-04-20) * |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111714080A (en) * | 2020-06-30 | 2020-09-29 | 重庆大学 | Disease classification system based on eye movement information |
| CN111714080B (en) * | 2020-06-30 | 2021-03-23 | 重庆大学 | Disease classification system based on eye movement information |
| CN114035673A (en) * | 2020-11-18 | 2022-02-11 | 武汉联影医疗科技有限公司 | Ultrasonic eye movement control system and method |
| CN112674716A (en) * | 2020-12-11 | 2021-04-20 | 首都医科大学附属北京儿童医院 | Head position measuring device capable of collecting eye shake data |
| CN112674716B (en) * | 2020-12-11 | 2024-02-27 | 首都医科大学附属北京儿童医院 | Head position measuring device capable of collecting eye vibration data |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110633014B (en) | 2024-04-05 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110633014B (en) | Head-wearing eye movement tracking device | |
| CN105142498B (en) | Enhanced optical and perceptual digital eyewear | |
| Kelly et al. | Recalibration of perceived distance in virtual environments occurs rapidly and transfers asymmetrically across scale | |
| CN205903239U (en) | Visual acuity test and trainer based on virtual reality | |
| CN107174195B (en) | Visual chart projecting method and VR spectacle vision table projector based on VR technology | |
| Rantanen et al. | A Wearable, Wireless Gaze Tracker with Integrated Selection Command Source for Human‐Computer Interaction | |
| WO2018214520A1 (en) | Method and apparatus for synchronizing video data and exercise effect animation | |
| CN108618776A (en) | The method that ECG electrode positions accessory and positions electrocardiogram patch location by accessory | |
| CN105900141A (en) | Mapping glints to light sources | |
| CN103876720A (en) | Method and system for detecting human body and environment information | |
| CN104257373A (en) | Cloud technology based human health intelligent monitoring device and method | |
| CN203101728U (en) | Head type display for assisting medical operation teaching | |
| WO2018214521A1 (en) | Method and apparatus for displaying exercise effects of fitness movements | |
| CN104483754A (en) | Head-wearing type multimedia terminal assisted watching system aiming at patient with dysopia | |
| CN211786989U (en) | Head-mounted eye movement tracking device | |
| CN105380590A (en) | Device with eye position detection function and achieving method thereof | |
| Younis et al. | Augmented and virtual reality approaches to help with peripheral vision loss | |
| CN103576340A (en) | Eyeglasses with mouse function | |
| WO2018214525A1 (en) | Exercise effect displaying method and apparatus | |
| CN115185365A (en) | Wireless control eye control system and control method thereof | |
| CN108573248A (en) | A kind of anti-cheating device for examination hall | |
| CN211213173U (en) | Intelligent device worn on wrist and used for monitoring eye state and eye environment | |
| CN110680290A (en) | Triage classification device based on AR glasses | |
| CN108769661A (en) | The 3D rendering video system taken exercise for vision restoration | |
| US20220401009A1 (en) | System, method, and head mounted display for consussion assessment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20221202 Address after: 213031 NO.666, Liaohe Road, Xinbei District, Changzhou City, Jiangsu Province Applicant after: CHANGZHOU INSTITUTE OF TECHNOLOGY Address before: 150080 No. 52, Xuefu Road, Nangang District, Heilongjiang, Harbin Applicant before: HARBIN University OF SCIENCE AND TECHNOLOGY |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant |