CN110801202A - Eye movement tracking video shooting system based on one-way perspective mirror - Google Patents
Eye movement tracking video shooting system based on one-way perspective mirror Download PDFInfo
- Publication number
- CN110801202A CN110801202A CN201910994926.XA CN201910994926A CN110801202A CN 110801202 A CN110801202 A CN 110801202A CN 201910994926 A CN201910994926 A CN 201910994926A CN 110801202 A CN110801202 A CN 110801202A
- Authority
- CN
- China
- Prior art keywords
- eye
- eye movement
- mirror
- way perspective
- infrared
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
- A61B3/10—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions
- A61B3/113—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions for determining or recording eye movement
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
- A61B3/10—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions
- A61B3/14—Arrangements specially adapted for eye photography
- A61B3/145—Arrangements specially adapted for eye photography by video means
Landscapes
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Engineering & Computer Science (AREA)
- Heart & Thoracic Surgery (AREA)
- Molecular Biology (AREA)
- Biophysics (AREA)
- Ophthalmology & Optometry (AREA)
- Biomedical Technology (AREA)
- Veterinary Medicine (AREA)
- Medical Informatics (AREA)
- Physics & Mathematics (AREA)
- Surgery (AREA)
- Animal Behavior & Ethology (AREA)
- General Health & Medical Sciences (AREA)
- Public Health (AREA)
- Human Computer Interaction (AREA)
- Multimedia (AREA)
- Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
- Studio Devices (AREA)
Abstract
The invention discloses a high-definition naked eye 3D eye movement tracking video shooting system based on a one-way perspective mirror, which comprises left and right eyepieces (3) and (4), left and right liquid crystal display screens (6) and (7) and a binocular eye movement acquisition module; wherein: the binocular eye movement acquisition module comprises a first one-way perspective mirror (11), a second one-way perspective mirror (12), a left eye infrared camera (9), a right eye infrared camera (16), an integral system circuit control unit (10) and an infrared LED light source (5): the binocular eye movement acquisition module is used for high-precision synchronous acquisition of eye movement data of a tester under 3D video stimulation, and the whole system circuit control unit (10) is used for receiving the eye movement data acquired by the left camera (9) and the right camera (16) and carrying out synchronous cloud uploading. The invention can synchronously acquire the binocular eye movement data under the stimulation of the 3D video with high precision, and the reliability of the acquisition of the eye movement information is higher.
Description
Technical Field
The invention relates to the technical field of eye movement instruments and meters, in particular to a non-contact/non-head-mounted binocular eye movement collection technology under naked eye high-definition 3D video stimulation.
Background
The human visual system is the most important channel for human perception of the outside world. The visual system delivers perceived images of the outside world to the brain, which and the nervous system understand the content of the images and drive the visual system to focus visually on the content of interest to the brain. Therefore, the activity of attention of the human visual system to the outside world (eye movement) can reflect the activity of the human brain and nervous system to some extent.
When the human visual system adopts binocular perception, the stereo world is perceived by using parallax. Many researches show that when a three-dimensional world is perceived, because a vision system needs to drive two eyes to cooperatively perceive depth information, eyeball movement of the two eyes is more complex than that when a single eye perceives a two-dimensional world. Compared with two-dimensional image stimulation, eyeball movement under the stimulation of the three-dimensional image can more accurately reflect the activity conditions of the brain and the nervous system.
An Eye Tracker (ET) is a commonly used instrument for Eye movement analysis, and collects Eye movement information of a test subject while presenting a specific image stimulus to the test subject. By collecting eye movement information and applying different algorithms to analyze and calculate various test indexes, the eye tracker can provide analysis reports for different applications and researches.
Currently, there are two main types of eye tracker on the market: desktop formula eye moves appearance and wear-type eye moves appearance. The desktop type eye tracker is in a non-contact type and is arranged in or connected to the display. The head-mounted eye tracker is composed of a light hat or glasses with only the eye tracker inside and a built-in video camera. However, the existing eye tracker in the market at present cannot provide high-quality stereoscopic image stimulation, and has a heavy structure, inflexible movement and poor wearing experience, that is, cannot meet the experimental conditions required for medical assistance.
The simplest way for presenting the stereoscopic video is to adopt a stereoscopic television, stereoscopic projection and the like, but scenes of the above ways cannot meet experimental needs, the anti-interference performance is poor, and the reliability of eye movement information acquisition is low.
Disclosure of Invention
The invention aims to provide an eye movement tracking video shooting system based on a one-way perspective mirror, which realizes binocular eye movement video acquisition by utilizing a high-definition naked eye 3D display optical path, and the acquisition result is used for shooting eye movement tracking.
1. The invention relates to a high-definition naked eye 3D eye movement tracking video shooting system based on a one-way perspective mirror, in particular to a high-definition naked eye 3D eye movement tracking video shooting system based on a one-way perspective mirror, which is characterized by comprising left and right eyepieces 3 and 4, left and right liquid crystal display screens 6 and 7 and a binocular eye movement acquisition module; wherein:
the binocular eye movement acquisition module is used for synchronously acquiring eye movement data of a tester under 3D video stimulation at high precision, and comprises a first one-way perspective mirror 11, a second one-way perspective mirror 12, a left eye infrared camera 9, a right eye infrared camera 16, an integral system circuit control unit 10 and an infrared LED light source 5: the two same left and right eye infrared cameras 9 and 16 are arranged on one sides of the lens surfaces 13 and 14 of the left and right one-way perspective mirrors and are used for collecting eye moving images of an observer; the two one-way perspective mirrors are vertically arranged, and a sight line clapboard 8 is arranged at the vertical intersection edge; the whole system circuit control unit 10 is positioned at the rear sides of the left and right eye infrared cameras 9 and 16 and is used for processing the collected video images; the left and right infrared LED light sources 5, 15 are arranged above the convex lenses, namely the left and right eyepieces 3, 4;
the whole system circuit control units 10 respectively comprise a playing board for providing a stereoscopic video source; an FPGA screen-dividing board used for cutting the stereo video source image left and right, dividing the stereo video source image into two parts and transmitting the two parts to left and right liquid crystal display screens 6 and 7; and the multi-path camera coding board is used for receiving eye movement data collected by the left camera 9 and the right camera 16 and uploading the eye movement data to the cloud synchronously.
The invention has the beneficial effects that:
(1) the invention can provide high-quality stereo image stimulation, strictly design parameters and meet the experimental conditions required by medical assistance;
(2) the invention can synchronously acquire the binocular eye movement data under the stimulation of the 3D video with high precision, and the reliability of the acquisition of the eye movement information is higher.
Drawings
Fig. 1 is a block diagram of the overall structure of the embodiment of the present invention.
Reference numerals:
1. 2, left and right one-way perspective mirror reflection mirror surfaces, 3, 4, left and right eyepieces, 5, 15, left and right infrared LED light sources, 6, 7, left and right liquid crystal display screens, 8, a sight line clapboard, 9, 16, left and right eye infrared cameras, 10, an integral system circuit control unit, 11, 12, a first one-way perspective mirror, a second one-way perspective mirror, 13, 14, and left and right one-way perspective mirror surfaces.
Detailed Description
The technical solution of the present invention is described in detail below with reference to the accompanying drawings and examples.
As shown in fig. 1, the high-definition naked eye 3D eye tracking video shooting system based on the half-mirror comprises left and right eyepieces 3 and 4, left and right liquid crystal displays 6 and 7, and a binocular eye movement acquisition module. Wherein the binocular eye movement acquisition module is used for high-precision synchronous acquisition of eye movement data of a tester under 3D video stimulation, and comprises a first one-way perspective mirror 11, a second one-way perspective mirror 12, a left eye infrared camera 9, a right eye infrared camera 9, an integral system circuit control unit 10 and an infrared LED light source 5: the two same left and right eye infrared cameras 9 and 16 are arranged on one sides of lens surfaces 13 and 14 of the left and right one-way perspective mirrors and used for collecting eye moving images of an observer, and the whole system circuit control unit 10 is arranged on the rear sides of the left and right eye infrared cameras 9 and 16 and used for processing collected video images; the left and right infrared LED light sources 5 and 15 are arranged above the convex lenses, namely the left and right eyepieces 3 and 4, and are used for providing light sources for eye movement collection. The convex lens is used for creating different picture depth perceptions in local space based on different visual fields, a three-dimensional 3D visual field is formed in a brain visual system of a user, and an infrared light source is placed at the position to be matched with an infrared camera to carry out eye movement data acquisition.
The two one-way perspective mirrors are vertically arranged, and a sight line clapboard 8 is arranged at the vertical intersection edge.
The incident surface field angle theta of the one-way perspective mirror1The range of the angle is 18 degrees to 22 degrees, and the field angle theta of the light-emitting surface of the one-way perspective mirror2The range of the distance D of the exit pupil of the one-way perspective mirror is 40-50 degrees, the range of the distance D of the exit pupil of the one-way perspective mirror is 50-70 millimeters, the range of the focal length f of the lens is 100-150 millimeters, and the length of the one-way perspective mirror is LTransparent filmThe width of the lens is WTransparent filmThe length of the display screen is LDisplay deviceThe width of the display screen is WDisplay deviceThe distance between the lens and the display screen and the distance between the lens and the intersection point of the optical axes of the reflectors are L1The distance from the intersection point of the optical axes of the reflectors to the middle point of the display screen is L2And satisfy the relationshipFormula (II): 0.35<L1/L2<1.50。
The circuit control unit comprises a playing board used for providing a stereoscopic video source, an FPGA screen separating board used for cutting a stereoscopic video source image left and right, dividing the stereoscopic video source image into two parts and conveying the two parts to left and right liquid crystal display screens 6 and 7, and a multi-path camera coding board used for receiving eye movement data collected by left and right cameras 9 and uploading the eye movement data to a cloud synchronously.
Preferably, the value range of the center distance L between the left display optical path and the right display optical path is 60-70 mm, and 65 mm is selected as the most preferable value.
Preferably, the lens is arranged perpendicular to the display screen.
Preferably, the resolution of the display screen is greater than 1280 × 720, and is 1920 × 1080 and 3840 × 2160, so that the viewed image has high resolution and clear image quality.
Preferably, the LED light source is an infrared lamp light source. The eye movement tracking system mainly adopts the infrared LED light source, so that the influence of the visible light source on the stereoscopic video playing environment can be avoided, and the eye movement information capture of the camera is facilitated. Due to the infrared effect, a Purkinje spot is generated near the pupil of the human eye, and the fixation point position of the tested person can be calibrated more conveniently by combining the eye movement algorithm.
Preferably, the camera is a high-resolution infrared camera and is used for synchronously acquiring high-resolution eye movement data of the left eye and the right eye.
One side of the one-way perspective mirror (i.e. a half-reflecting and half-transmitting mirror) is used for reflecting light rays and playing a role of a mirror, and the other side of the one-way perspective mirror is used for transmitting light rays and playing a role of a perspective mirror. The mirror surface 1 of the one-way perspective mirror is used for realizing the naked eye 3D effect,
example (b):
the left ocular 3 and the right ocular 4 are directly opposite to the left ocular reflector 1 and the right ocular reflector 2, and an included angle of 90 degrees is formed between the left ocular reflector 1 and the right ocular reflector 2; the fresh wet surfaces of the left liquid crystal display screen 6 and the right liquid crystal display screen 6 are respectively opposite to the mirror surfaces of the left eye reflective mirror 1 and the right eye reflective mirror 2 and are transversely arranged. The sight of the left eye and the right eye of a person is respectively transmitted to a left eye reflector 1 and a right eye reflector 2 through a left ocular 3 and a right ocular 4, because the included angle between the left eye reflector 1 and the right eye reflector 2 is 90 degrees, the mirror surfaces of the left eye reflector 1 and the right eye reflector 2 are respectively 45 degrees and are opposite to the left ocular 3 and the right ocular 4, the left ocular reflector 1 and the right ocular reflector 2 which are arranged at 90 degrees reflect the sight emitted by the left eye and the right eye of the person to pictures broadcasted by a left liquid crystal display screen 6 and a right liquid crystal display screen 7, because the two eyes of the person have the interval of about 65 millimeters, the two images of the same object at different angles are seen, and the stereoscopic vision feeling is generated through the synthesis of the brain of the person.
By utilizing the sight line partition plate 8, the sight lines emitted by the left eye and the right eye of a person are separated, the left light path is prevented from being seen by the left eye residual light and the left light path is prevented from being seen by the right eye residual light, the left light path and the right light path entering the brain of the person are ensured not to be mixed, and the brain of a person watching a stereoscopic video is prevented from being dizzy.
The eye movement information can be shot while 3D video stimulation is provided by utilizing the one-way perspective mirror surface 13, the infrared LED and the 940nm infrared camera for capturing and combining a circuit control unit to carry out synchronous video coding. The problem of most eye movement appearance can't carry out eye movement tracking when providing 3D video stimulation is solved, utilize the half-reflection semi-permeable effect of single direction perspective mirror, single direction perspective mirror plane of reflection provides the 3D video, and single direction perspective mirror plane of transmission is used for the eye movement to shoot.
The eye movement tracking system mainly irradiates the eyes of a user through a plurality of infrared LEDs and captures reflected light by using the camera sensor, so that the system can calculate the positions of the pupils of the user and obtain the direction of a fixation point of the user.
The infrared LED light source is adopted, so that the influence of the visible light source on the stereoscopic video playing environment can be avoided, and the eye movement information capture of the camera is facilitated. Due to the infrared effect, a Purkinje spot is generated near the pupil of the human eye, and the fixation point position of the tested person can be calibrated more conveniently by combining the eye movement algorithm.
Claims (8)
1. A high-definition naked eye 3D eye movement tracking video shooting system based on a one-way perspective mirror is characterized by comprising left and right eyepieces (3) (4), left and right liquid crystal display screens (6) (7) and a binocular eye movement acquisition module; wherein:
the binocular eye movement acquisition module is used for synchronously acquiring eye movement data of a tester under 3D video stimulation at high precision, and comprises a first one-way perspective mirror (11), a second one-way perspective mirror (12), a left eye infrared camera (9), a right eye infrared camera (16), an integral system circuit control unit (10) and an infrared LED light source (5): the two same left and right eye infrared cameras (9) and (16) are arranged on one side of the lens surfaces (13) and (14) of the left and right one-way perspective mirrors and are used for collecting eye moving images of an observer; the two one-way perspective mirrors are vertically arranged, and a sight line clapboard (8) is arranged at the vertical intersection edge; the whole system circuit control unit (10) is positioned at the rear sides of the left and right eye infrared cameras (9) and (16) and is used for processing the acquired video images; the left and right infrared LED light sources (5) and (15) are arranged above the convex lenses, namely the left and right eyepieces (3) and (4);
the integrated system circuit control units (10) respectively comprise a playing board used for providing a stereoscopic video source; an FPGA screen-dividing board used for cutting the stereo video source image left and right, dividing the stereo video source image into two parts and transmitting the two parts to left and right liquid crystal display screens (6) (7); and the multi-path camera coding board is used for receiving eye movement data collected by the left and right cameras (9) and (16) and uploading the eye movement data to a synchronous cloud terminal.
2. The high-definition naked eye 3D eye movement tracking video shooting system based on one-way perspective mirror as claimed in claim 1, wherein preferably, the incident surface field angle theta of the one-way perspective mirror1The value range of the angle is 18 degrees to 22 degrees, and the field angle theta of the light-emitting surface2The range of the focal length f is 40-50 degrees, the range of the exit pupil distance D is 50-70 millimeters, and the range of the focal length f is 100-150 millimeters.
3. The high-definition naked eye 3D eye movement tracking video shooting system based on the half-mirror as claimed in claim 1, wherein the distance between the lens and the display screen from the intersection point of the optical axes of the lens and the reflector is L as the preferable preference1The distance from the intersection point of the optical axes of the reflectors to the middle point of the display screen is L2And satisfies the relation: 0.35<L1/L2<1.50。
4. The one-way mirror-based high-definition naked eye 3D eye movement tracking video shooting system is characterized in that the value range of the center distance L between the left display optical path and the right display optical path is 60-70 mm, and is preferably 65 mm.
5. The one-way mirror-based high-definition naked eye 3D eye movement tracking video shooting system is characterized in that the lens is preferably perpendicular to the display screen.
6. The system as claimed in claim 1, wherein the display screen resolution is preferably greater than 1280 × 720, particularly 1920 × 1080, 3840 × 2160.
7. The one-way mirror-based high-definition naked eye 3D eye movement tracking video shooting system is characterized in that the light source is preferably an infrared lamp light source.
8. The one-way mirror-based high-definition naked eye 3D eye movement tracking video shooting system is preferably characterized in that the camera is a high-resolution infrared camera and is used for synchronously acquiring high-resolution eye movement data of the left eye and the right eye.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910994926.XA CN110801202A (en) | 2019-10-18 | 2019-10-18 | Eye movement tracking video shooting system based on one-way perspective mirror |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910994926.XA CN110801202A (en) | 2019-10-18 | 2019-10-18 | Eye movement tracking video shooting system based on one-way perspective mirror |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110801202A true CN110801202A (en) | 2020-02-18 |
Family
ID=69488639
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910994926.XA Pending CN110801202A (en) | 2019-10-18 | 2019-10-18 | Eye movement tracking video shooting system based on one-way perspective mirror |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110801202A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112584123A (en) * | 2020-12-07 | 2021-03-30 | 西诺医疗器械集团有限公司 | Binocular naked eye 3D video lamp |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| GB2385451A (en) * | 2002-02-13 | 2003-08-20 | Loadpoint Ltd | Monitoring drowsiness |
| CN205181314U (en) * | 2015-03-14 | 2016-04-27 | 中国科学院苏州生物医学工程技术研究所 | Portable pair of mesh pupil detection device |
| CN205333973U (en) * | 2015-12-29 | 2016-06-22 | 杭州立体世界科技有限公司 | Three -dimensional private cinema display device of high definition bore hole 3D |
| CN109645955A (en) * | 2019-01-31 | 2019-04-19 | 北京大学第三医院（北京大学第三临床医学院） | Based on VR and eye movement the Multifunctional visual sense function detection device tracked and method |
-
2019
- 2019-10-18 CN CN201910994926.XA patent/CN110801202A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| GB2385451A (en) * | 2002-02-13 | 2003-08-20 | Loadpoint Ltd | Monitoring drowsiness |
| CN205181314U (en) * | 2015-03-14 | 2016-04-27 | 中国科学院苏州生物医学工程技术研究所 | Portable pair of mesh pupil detection device |
| CN205333973U (en) * | 2015-12-29 | 2016-06-22 | 杭州立体世界科技有限公司 | Three -dimensional private cinema display device of high definition bore hole 3D |
| CN109645955A (en) * | 2019-01-31 | 2019-04-19 | 北京大学第三医院（北京大学第三临床医学院） | Based on VR and eye movement the Multifunctional visual sense function detection device tracked and method |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112584123A (en) * | 2020-12-07 | 2021-03-30 | 西诺医疗器械集团有限公司 | Binocular naked eye 3D video lamp |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10554960B2 (en) | Unassisted stereoscopic display device using directional backlight structure | |
| US9348139B2 (en) | Open-type head mount display device and display method thereof | |
| EP4016169B1 (en) | Wearable 3d augmented reality display with variable focus and/or object recognition | |
| CN106797423B (en) | Sight line detection device | |
| US7428001B2 (en) | Materials and methods for simulating focal shifts in viewers using large depth of focus displays | |
| US6246382B1 (en) | Apparatus for presenting stereoscopic images | |
| CN109188700B (en) | Optical display system and AR/VR display device | |
| US11178380B2 (en) | Converting a monocular camera into a binocular stereo camera | |
| KR20220006046A (en) | Display system providing concentric light field and monocular to binocular hybridization | |
| CN109725462B (en) | Display device, display apparatus, and driving method of display device | |
| KR101650706B1 (en) | Device for wearable display | |
| CN114153066A (en) | Head-up display device and head-up display system | |
| WO2012115301A1 (en) | Three-dimensional glasses lens and glasses using same | |
| SG178785A1 (en) | An imaging device and method | |
| WO2016101861A1 (en) | Head-worn display device | |
| CN110801202A (en) | Eye movement tracking video shooting system based on one-way perspective mirror | |
| WO2014127134A1 (en) | Methods and apparatus for retinal imaging | |
| WO2021128912A1 (en) | See-through eyeglasses used for vision enhancement | |
| CN113272710A (en) | Extending field of view by color separation | |
| TWI676048B (en) | Near-eye display structure | |
| CN108459408B (en) | Intelligent mixed reality telescope | |
| CN110769243A (en) | Binocular eye movement acquisition system under stimulation of high-definition naked eye 3D (three-dimensional) video | |
| CN113795783A (en) | Display integrated imaging device for head mounted display | |
| US20060152580A1 (en) | Auto-stereoscopic volumetric imaging system and method | |
| CN111812857B (en) | Display device, method and application |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20200218 |