CN205563453U - Sight is tracked and people's eye zone location system interested - Google Patents
Sight is tracked and people's eye zone location system interested Download PDFInfo
- Publication number
- CN205563453U CN205563453U CN201521052147.1U CN201521052147U CN205563453U CN 205563453 U CN205563453 U CN 205563453U CN 201521052147 U CN201521052147 U CN 201521052147U CN 205563453 U CN205563453 U CN 205563453U
- Authority
- CN
- China
- Prior art keywords
- hardware platform
- human eye
- pupil
- camera
- image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Landscapes
- Studio Devices (AREA)
Abstract
The utility model discloses a sight is tracked and people's eye zone location system interested, including image acquisition equipment, hardware platform and demonstration output device, image acquisition equipment includes infrared people's eye camera and prospect camera, and the output of infrared people's eye camera and prospect camera is continuous with hardware platform's input respectively, and hardware platform's output links to each other with the input that shows output device, hardware platform includes memory cell, and hardware platform is based on FPGA and double -core ARM9 treater, infrared people's eye camera be used for shooing people's pupil hole pattern like to with this image real time transport to hardware platform, the prospect camera be used for shooing people's an eye line administrative division map like, with people's an eye line administrative division map like real time transport to hardware platform, through utilizing the utility model discloses the mapping relation of pupil and mark point can at point of fixation / the interested point of sight administrative division map in like, realize the function of sight pursuit in order to confirm people's eye.
Description
Technical field
The utility model relates to a kind of wearable electronic equipment, especially a kind of based on pupil detection technology
Eye-controlling focus and human eye area-of-interest alignment system.
Background technology
Eye Tracking Technique be widely used in business data analysis, vehicle assistant drive, psychology grind with physiology
Study carefully, people is because of fields such as analysis, virtual realities.The research in current domestic Eye-controlling focus field has also been in
Step section, external Ji Jia developed country high-tech company the most few in number is grasped key technology and pushes away
Go out matured product.Their product price is the most sufficiently expensive, and software kit needs extra purchase, and
Structure is complicated, uses process relatively cumbersome, and these factors limit Eye Tracking Technique and more widely should
With.
Utility model content
In order to solve the problem in background technology, the utility model proposes a kind of precision higher, cost is relatively
Low, simple in construction, easy-to-use Eye-controlling focus and human eye area-of-interest alignment system.
The utility model provides techniques below scheme:
Eye-controlling focus and human eye area-of-interest alignment system, it is characterized in that and includes IMAQ
Equipment, hardware platform and display output equipment, image capture device includes infrared human eye camera and prospect phase
Machine, infrared human eye camera is connected with the input of hardware platform respectively with the output of prospect camera, hardware
The output of platform is connected with the input of display output equipment；
Described hardware platform includes that memory cell, hardware platform are based on FPGA and double-core ARM9 processor；
Described infrared human eye camera, is used for shooting human eye pupil image, and by this Image Real-time Transmission to firmly
Part platform；Prospect camera is used for shooting human eye sight area image, is passed in real time by human eye sight area image
Transport to hardware platform；
Hardware platform is for processing the human eye pupil image received, and obtains the movement locus of corresponding pupil；
Hardware platform is additionally operable to: generate the mark dot image being provided with multiple mark point, sets up mark dot image
The coordinate of middle mark point, sends mark dot image to showing output equipment；Gather pupil position, pupil
Position refers to observe in mark dot image and marks pupil position a little, sets up the coordinate of pupil: according to mark
The coordinate of point and the coordinate of pupil, set up the mapping relations of pupil and mark point；
Hardware platform is additionally operable to be combined the human eye sight area image received with pupil movement track, root
According to the mapping relations of the pupil set up with mark point, obtain pupil movement track and human eye sight area image
Mapping relations, and display output equipment show；
Wherein, mark dot image is identical with the resolution ratio of human eye sight area image；
Described memory cell is for storing human eye pupil image and the human eye sight region that hardware platform receives
Image.
Pupil is that the coordinate according to mark point is set up divided by corresponding pupil coordinate with the mapping relations of mark point
's.Concrete method for building up: hardware platform generates mark dot image, and (mark dot image is provided with multiple mark
Point), set up in mark dot image and mark coordinate a little, mark dot image is sent to showing output equipment,
Shown by human eye observation and on output equipment, mark the mark point in image, record pupil people's eye fixation this
Position during a little mark point, sets up pupil coordinate, then with the coordinate of each mark point divided by corresponding pupil
Coordinate, obtains mapping coefficient, utilizes mapping coefficient to set up the mapping relations of pupil and mark point.
Therefore only need to detect pupil movement track after, utilize pupil the most permissible with the mapping relations of mark point
Determine human eye blinkpunkt/point-of-interest in the image of gaze area, it is achieved the function of Eye-controlling focus.
The software systems that hardware platform runs include that (SuSE) Linux OS, kernel version are 3.03,
(SuSE) Linux OS runs QT and OpenCV cross compilation environment, generates double in cross compilation environment
Core ARM9 processor executable file；Memory cell is additionally operable to store (SuSE) Linux OS.
Above-mentioned hardware platform also includes power module, VGA display interface and USB OTG interface；
Described power module is TI company's T PS series of power chip；
Described VGA display interface is ADV7511 chip and HDMI-VGA adapter；
Described USB OTG interface is TUSB1210 chip；
Described memory cell is SD card and/or USB flash disk；
Described FPGA and the ZYNQ-7020 chip that double-core ARM9 processor is Xilinx company.
Infrared human eye camera is the near-infrared CMOS camera of 320*240 resolution ratio, and prospect camera is 640*480
The wide-angle visible ray CMOS camera of resolution ratio.
Linux operation, by being stored in the (SuSE) Linux OS in memory cell card, is by hardware platform
System carry is inside double-core AMR9 processor.
Above-mentioned QT software version is 4.8.1, and described OpenCV version is 2.4.11.
Above-mentioned infrared human eye camera is connected with hardware platform by USB OTG interface respectively with prospect camera；
Described display output equipment is connected with hardware platform by VGA display interface
Above-mentioned Eye-controlling focus and human eye area-of-interest alignment system also include that the outside with control function sets
Standby, the external equipment with control function is mouse and keyboard, and described mouse and keyboard are all by USB OTG
Interface is connected with hardware platform.
The utility model has following technical effect that
Utilize the mapping relations of the utility model pupil and mark point, it may be determined that human eye is at gaze area figure
Blinkpunkt/point-of-interest in Xiang, it is possible to realizing the function of Eye-controlling focus, therefore, the utility model is permissible
Observation effect is provided for the publicity official documents and correspondence of commercial field, poster design, webpage visual effect, package design etc.
The analysis of experiments of fruit, calculates the main observation location of interest that poster advertisement is designed by consumer, thus optimizes
The design of poster advertisement is to reach preferably to publicize expectation；The utility model can also be fabricated to wearable
, user can be assisted to analyze tester's area-of-interest in real time.
Accompanying drawing explanation
Fig. 1 be the utility model Eye-controlling focus and human eye area-of-interest alignment system realize block diagram.
Fig. 2 is hardware platform physical circuit schematic diagram.
Fig. 3 is the utility model software systems general structure.
Fig. 4 is the utility model external interface schematic diagram.
Fig. 5 is the utility model software systems flow chart.
Detailed description of the invention
The utility model proposes a kind of Eye-controlling focus and human eye area-of-interest alignment system, such as Fig. 1 extremely
Fig. 5, including image capture device, hardware platform and display output equipment, image capture device includes infrared
Human eye camera and prospect camera, the output of infrared human eye camera and prospect camera respectively with hardware platform
Input is connected, and the output of hardware platform is connected with the input of display output equipment；
Described hardware platform includes that memory cell, hardware platform are based on FPGA and double-core ARM9 processor；
Described infrared human eye camera, is used for shooting human eye pupil image, and by this Image Real-time Transmission to firmly
Part platform；Prospect camera is used for shooting human eye sight area image, is passed in real time by human eye sight area image
Transport to hardware platform；
Hardware platform is for processing the human eye pupil image received, and obtains the movement locus of corresponding pupil；
Hardware platform is additionally operable to: generate the mark dot image being provided with multiple mark point, sets up mark dot image
The coordinate of middle mark point, sends mark dot image to showing output equipment；Gather pupil position, pupil
Position refers to observe in mark dot image and marks pupil position a little, sets up the coordinate of pupil: according to mark
The coordinate of point and the coordinate of pupil, set up the mapping relations of pupil and mark point；
Hardware platform is additionally operable to be combined the human eye sight area image received with pupil movement track, root
According to the mapping relations of the pupil set up with mark point, obtain pupil movement track and human eye sight area image
Mapping relations, and display output equipment show；
Wherein, mark dot image is identical with the resolution ratio of human eye sight area image；
Described memory cell is for storing human eye pupil image and the human eye sight region that hardware platform receives
Image.
The software systems that hardware platform runs include that (SuSE) Linux OS, kernel version are 3.03, Linux
Operating system is customizing operating system based on Linux3.13 kernel version, and concrete version is Ubuntu
12.04LTS；In (SuSE) Linux OS, run QT and OpenCV cross compilation environment, compile intersecting
Translate and environment realize mapping relations, wherein, QT software version be 4.8.1, OpenCV version be 2.4.11；
Memory cell is additionally operable to store (SuSE) Linux OS；Hardware platform is by being stored in memory cell card
(SuSE) Linux OS, by (SuSE) Linux OS carry inside double-core AMR9 processor.
Such as Fig. 2, hardware platform also includes power module, VGA display interface and USB OTG interface；Power supply
Module is TI company's T PS series of power chip；VGA display interface is ADV7511 chip and HDMI-VGA
Adapter；USB OTG interface is TUSB1210 chip；Memory cell is SD card and/or USB flash disk.FPGA
With the ZYNQ-7020 chip that double-core ARM9 processor is Xilinx company.This chip internal is integrated
Up-to-date 7 Series FPGA of Xilinx company and double-core ARM9 processor, and realize FPGA by AXI bus
High-speed communication with arm processor.
Infrared human eye camera is connected with hardware platform by USB OTG interface respectively with prospect camera；Described
Display output equipment is connected with hardware platform by VGA display interface；
Infrared human eye camera can be adopted as the near-infrared CMOS camera of 320*240 resolution ratio, and prospect camera can
It is adopted as the high definition wide-angle visible ray CMOS camera of 640*480 resolution ratio.
Display output equipment is the USB interface display screen of one piece of 1280*800 resolution ratio.Display mainly shows
Show infrared camera shooting human eye pupil image, prospect camera simulation human eye field-of-view image, human eye region of interest
Field mark and tracking, parameter setting area.
Eye-controlling focus and human eye area-of-interest alignment system also include having the external equipment controlling function,
The external equipment with control function is mouse and keyboard, and described mouse and keyboard are all connect by USB OTG
Mouth is connected with hardware platform, it is achieved human-computer interaction interface controls and (SuSE) Linux OS order inputs.
See Fig. 3, be general structure and the module-external design of the software systems that hardware platform runs.According to
Software systems can be divided into 5 functional modules and be respectively as follows: camera by the functional requirements of software systems
Control and display, human eye sight centralized positioning, target location, the location of area-of-interest, Attitude estimation
Correct with target location.
Seeing Fig. 4, the key element in user interface mainly has three parts: the viewing area of infrared shooting pupil camera
Territory, the viewing area of prospect camera video, the display of test image and update area.
Seeing Fig. 5, tester completes pupil position by user interface according to system prompt and demarcates, pupil
Pose is set up with viewing area mapping relations.
Relative to existing technology, the utility model Eye-controlling focus and human eye area-of-interest alignment system,
Take full advantage of ARM and add FPGA hardware platform, embedded OS runs QT and OpenCV mirror
As library file, C Plus Plus is utilized to realize human eye pupil detection and Eye-controlling focus in QT programming interface, and
Set up friendly human-computer interaction interface, utilize high-clear display to mark human eye area-of-interest, unite the most at last
Count preservation in case subsequent analysis.Compared to existing similar-type products, there is similarity precision, but cost is relatively
Low, technical difficulty requires little feature.
Foregoing is to combine concrete preferred embodiment to explain the utility model, it is impossible to assert this
Being embodied as of utility model is confined to these explanations.General for the utility model art
For logical technical staff, without departing from the concept of the premise utility, it is also possible to make some simply
Deduction or replace.
Claims (5)
1. Eye-controlling focus and human eye area-of-interest alignment system, it is characterized in that: include image capture device, hardware platform and display output equipment, image capture device includes infrared human eye camera and prospect camera, infrared human eye camera is connected with the input of hardware platform respectively with the output of prospect camera, and the output of hardware platform is connected with the input of display output equipment；
Described hardware platform includes that memory cell, hardware platform are based on FPGA and double-core ARM9 processor；
Described infrared human eye camera is used for shooting human eye pupil image, and by this Image Real-time Transmission to hardware platform；Prospect camera is used for shooting human eye sight area image, by human eye sight area image real-time Transmission to hardware platform；
Hardware platform is for processing the human eye pupil image received, and obtains the movement locus of corresponding pupil；
Hardware platform is additionally operable to: generate the mark dot image being provided with multiple mark point, sets up in mark dot image and marks coordinate a little, sends mark dot image to showing output equipment；Gathering pupil position, pupil position refers to observe in mark dot image and marks pupil position a little, sets up the coordinate of pupil: according to coordinate and the coordinate of pupil of mark point, set up the mapping relations of pupil and mark point；
Hardware platform is additionally operable to be combined the human eye sight area image received with pupil movement track, according to the mapping relations of the pupil set up with mark point, obtains the mapping relations of pupil movement track and human eye sight area image, and shows at display output equipment；
Wherein, mark dot image is identical with the resolution ratio of human eye sight area image；
Described memory cell is for storing human eye pupil image and the human eye sight area image that hardware platform receives.
Eye-controlling focus the most according to claim 1 and human eye area-of-interest alignment system, it is characterised in that: described hardware platform also includes power module, VGA display interface and USB OTG interface；
Described power module is TI company's T PS series of power chip；
Described VGA display interface is ADV7511 chip and HDMI-VGA adapter；
Described USB OTG interface is TUSB1210 chip；
Described memory cell is SD card and/or USB flash disk；
Described FPGA and the ZYNQ-7020 chip that double-core ARM9 processor is Xilinx company.
Eye-controlling focus the most according to claim 2 and human eye area-of-interest alignment system, it is characterised in that: infrared human eye camera is the near-infrared CMOS camera of 320*240 resolution ratio, and prospect camera is the wide-angle visible ray CMOS camera of 640*480 resolution ratio.
Eye-controlling focus the most according to claim 3 and human eye area-of-interest alignment system, it is characterised in that: described infrared human eye camera is connected with hardware platform by USB OTG interface respectively with prospect camera；Described display output equipment is connected with hardware platform by VGA display interface.
Eye-controlling focus the most according to claim 4 and human eye area-of-interest alignment system, it is characterized in that: described Eye-controlling focus and human eye area-of-interest alignment system also include having the external equipment controlling function, the external equipment with control function is mouse and keyboard, and described mouse is all connected with hardware platform by USB OTG interface with keyboard.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201521052147.1U CN205563453U (en) | 2015-12-16 | 2015-12-16 | Sight is tracked and people's eye zone location system interested |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201521052147.1U CN205563453U (en) | 2015-12-16 | 2015-12-16 | Sight is tracked and people's eye zone location system interested |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN205563453U true CN205563453U (en) | 2016-09-07 |
Family
ID=56823486
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201521052147.1U Expired - Fee Related CN205563453U (en) | 2015-12-16 | 2015-12-16 | Sight is tracked and people's eye zone location system interested |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN205563453U (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105425967A (en) * | 2015-12-16 | 2016-03-23 | 中国科学院西安光学精密机械研究所 | Sight tracking and human eye area-of-interest positioning system |
| CN106814846A (en) * | 2016-10-24 | 2017-06-09 | 上海青研科技有限公司 | A kind of eye movement analysis method based on sight line and collision body intersection point in VR |
| CN107817899A (en) * | 2017-11-24 | 2018-03-20 | 姜翠英 | A kind of user watches content real-time analysis method |
| CN108415955A (en) * | 2018-02-06 | 2018-08-17 | 杭州电子科技大学 | A kind of point-of-interest database method for building up based on eye movement blinkpunkt motion track |
-
2015
- 2015-12-16 CN CN201521052147.1U patent/CN205563453U/en not_active Expired - Fee Related
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105425967A (en) * | 2015-12-16 | 2016-03-23 | 中国科学院西安光学精密机械研究所 | Sight tracking and human eye area-of-interest positioning system |
| CN105425967B (en) * | 2015-12-16 | 2018-08-28 | 中国科学院西安光学精密机械研究所 | Eye-controlling focus and human eye area-of-interest positioning system |
| CN106814846A (en) * | 2016-10-24 | 2017-06-09 | 上海青研科技有限公司 | A kind of eye movement analysis method based on sight line and collision body intersection point in VR |
| CN106814846B (en) * | 2016-10-24 | 2020-11-10 | 上海青研科技有限公司 | Eye movement analysis method based on intersection point of sight line and collision body in VR |
| CN107817899A (en) * | 2017-11-24 | 2018-03-20 | 姜翠英 | A kind of user watches content real-time analysis method |
| CN107817899B (en) * | 2017-11-24 | 2018-06-26 | 南京同睿信息科技有限公司 | A kind of user watches content real-time analysis method |
| CN108415955A (en) * | 2018-02-06 | 2018-08-17 | 杭州电子科技大学 | A kind of point-of-interest database method for building up based on eye movement blinkpunkt motion track |
| CN108415955B (en) * | 2018-02-06 | 2021-12-28 | 杭州电子科技大学 | Interest point database establishing method based on eye movement fixation point moving track |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105425967B (en) | Eye-controlling focus and human eye area-of-interest positioning system | |
| CN205563453U (en) | Sight is tracked and people's eye zone location system interested | |
| Mehrubeoglu et al. | Real-time eye tracking using a smart camera | |
| US20140098018A1 (en) | Wearable sensor for tracking articulated body-parts | |
| Lopez-Basterretxea et al. | Eye/head tracking technology to improve HCI with iPad applications | |
| CN104887327B (en) | A kind of touch sensitive registration tools and its method for registering for surgical navigational | |
| KR102546510B1 (en) | Method for providing information mapped between plurality inputs and electronic device supporting the same | |
| US11508105B2 (en) | Using augmented reality for accessing legacy transaction terminals | |
| Meyer et al. | A single-camera remote eye tracker | |
| CN114078278A (en) | Method and device for positioning fixation point, electronic equipment and storage medium | |
| Bumacod et al. | Image-processing-based digital goniometer using OpenCV | |
| Aditya et al. | Recent trends in HCI: A survey on data glove, LEAP motion and microsoft kinect | |
| CN102636483A (en) | Method and device for detecting urine iodine concentration | |
| CN107945607A (en) | Ultrasonic demo system and device | |
| KR20160068447A (en) | Method for determining region of interest of image and device for determining region of interest of image | |
| CN104123552A (en) | Automatic identification translating glasses | |
| Zhang et al. | A method for mechanism analysis of frog swimming based on motion observation experiments | |
| Kovesdi et al. | Measuring human performance in simulated nuclear power plant control rooms using eye tracking | |
| TW201619754A (en) | Medical image object-oriented interface auxiliary explanation control system and method thereof | |
| CN104516483A (en) | Gesture language input identification system based on motion-sensing technology | |
| Yu et al. | Automatic guidance of laparoscope based on the region of interest for robot assisted laparoscopic surgery | |
| Wan et al. | A method of free-space point-of-regard estimation based on 3D eye model and stereo vision | |
| Kim et al. | Improving Gaze Tracking in Large Screens with Symmetric Gaze Angle Amplification and Optimization Technique | |
| CN107749213A (en) | A kind of wearable sign language tutoring system based on six axle attitude transducer modules | |
| Ding et al. | Design of upper limb rehabilitation evaluation system based on deep learning |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20160907 Termination date: 20191216 |
|
| CF01 | Termination of patent right due to non-payment of annual fee |