CN202795232U - Demonstration system based on sightline tracking technology - Google Patents

Demonstration system based on sightline tracking technology Download PDF

Info

Publication number
CN202795232U
CN202795232U CN201220472519.6U CN201220472519U CN202795232U CN 202795232 U CN202795232 U CN 202795232U CN 201220472519 U CN201220472519 U CN 201220472519U CN 202795232 U CN202795232 U CN 202795232U
Authority
CN
China
Prior art keywords
camera
equipment
image information
sightline
system based
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Lifetime
Application number
CN201220472519.6U
Other languages
Chinese (zh)
Inventor
蔡恒进
李今
杨琛
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
WUHAN YUANBAO CREATIVE TECHNOLOGY Co Ltd
Original Assignee
WUHAN YUANBAO CREATIVE TECHNOLOGY Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by WUHAN YUANBAO CREATIVE TECHNOLOGY Co Ltd filed Critical WUHAN YUANBAO CREATIVE TECHNOLOGY Co Ltd
Priority to CN201220472519.6U priority Critical patent/CN202795232U/en
Application granted granted Critical
Publication of CN202795232U publication Critical patent/CN202795232U/en
Anticipated expiration legal-status Critical
Expired - Lifetime legal-status Critical Current

Links

Images

Abstract

The utility model relates to the field of the application of a sightline tracking technology and provides a demonstration system based on the sightline tracking technology. The demonstration system comprises camera eyeglasses, a sensor, processing equipment and responding equipment, wherein the camera eyeglasses are used for acquiring human eye image information, the sensor is used for transferring image information, the processing equipment is used for processing the image information and carrying out sightline locating, and the responding equipment is used for feeding back a result; and the camera eyeglasses are connected with the processing equipment through a built-in sensor of a wireless camera, and the output terminal of the processing equipment is connected with the responding equipment. According to the demonstration system based on the sightline tracking technology, the camera is fixed on the eyeglasses, the human eye image information is synchronously acquired by using the camera, the coordinates of a located sightline are analyzed and calculated by using the processing equipment, and then the responding equipment carries out responses, such as located instructing or page turning and zooming. According to the demonstration system based on the sightline tracking technology, the stability of head motion and the sightline tracking technology are effectively utilized, handheld equipment is changed into head-worn equipment, and the demonstration system has the advantages of high accuracy, high speed, good stability, low cost, and the like.

Description

A kind of demo system based on Eye Tracking Technique
Technical field
The utility model relates to the application of Eye Tracking Technique, is specifically related to a kind of demo system based on Eye Tracking Technique.
Background technology
Development along with science and technology, the multimedization of teaching, demonstration is increasingly general, teacher, start-up, speechmaker when doing the demonstration of teaching demonstration and project in order to show more easily, need one side operating computer to explain on one side, action is limited to slight computer front, the multimedia presentation equipment of originally providing convenience has but all fettered the language that the demonstrator enriches.So, advanced demonstration equipment not only is not fully utilized, and has affected on the contrary demonstrator's performance.And for the hearer, see these personnel's details operation needing projector to help.The speaker needs to leave the computer front, realizes " where walk, where say, where say, where point to " that the hearer need to have clear and definite adminicle to help them to determine speaker's action.Therefore, the instrument of multimedia teaching has greatly been enriched in the appearance of laser pen, makes teaching, speech more lively, more perfect, thoroughly solves in the past the inconvenience of using mouse in classroom and meeting.
But, laser pen also exists defective and deficiency, when the demonstrator handheld laser pointer is demonstrated, because the people is to the control problem of dynamics, can not keep same dynamics, handheld laser pointer is trembled when positioning easily always, and then causes the location to be forbidden or locate to be difficult to the concentrated area problem, affect the accuracy that the demonstrator expresses, and bring difficulty to the beholder.
Summary of the invention
The purpose of this utility model is exactly in order to overcome above-mentioned the deficiencies in the prior art part, and provide a kind of demo system based on Eye Tracking Technique, this system is by being fixed on camera on the glasses, utilize camera synchronous acquisition eye image information, use the coordinate for the treatment of facility analytical calculation location sight line, then position indication or the responses such as page turning, convergent-divergent by response apparatus.The utility model effectively utilizes stability and the Eye Tracking Technique of head movement, and handheld device is become headset equipment, has the degree of accuracy height, and speed is fast, good stability, low cost and other advantages.
The purpose of this utility model is achieved by the following technical measures: a kind of demo system based on Eye Tracking Technique, this system comprises be used to the camera glasses that obtain eye image information, be used for to transmit the sensor of image information, carry out the treatment facility of sight line location and be used for the response apparatus of result feedback for the treatment of image information; Described camera glasses link to each other with treatment facility by the built-in sensors that wireless camera carries, and can carry out sensing by modes such as wifi or bluetooths, and the output terminal of sensor links to each other with treatment facility, and the output terminal for the treatment of facility links to each other with response apparatus.
In technique scheme, described response apparatus comprises other transaction response processing modules such as location indicating module, page turning zoom operations module.
In technique scheme, described treatment facility is PC or for mobile phone or for panel computer.
The utility model laser ophthalmoscope tutoring system has the following advantages:
1, instrument and equipment is simple, low price, and cost is low, is easy to carry.
2, treatment effeciency is high, and degree of accuracy is high.
3, user's simple operation, comfortable, simple, stable, man-machine interaction is more natural.
Description of drawings
Fig. 1 is that the utility model is based on the demo system composition diagram of Eye Tracking Technique.
Fig. 2 is workflow diagram of the present utility model.
Fig. 3 is a kind of specific embodiment of the present utility model, wherein 1, the camera glasses, and 2, PC, 3, the projection panel.
Embodiment
The utility model will be further described below in conjunction with drawings and Examples.
As shown in Figure 1, the utility model provides a kind of demo system based on Eye Tracking Technique, this system comprises be used to the camera glasses that obtain eye image information, be used for to transmit the sensor of image information, carry out the treatment facility of sight line location and be used for the response apparatus of result feedback for the treatment of image information; Described camera glasses link to each other with treatment facility by the built-in sensors that wireless camera carries, and can carry out sensing by modes such as wifi or bluetooths, and the output terminal of sensor links to each other with treatment facility, and the output terminal for the treatment of facility links to each other with response apparatus.
In technique scheme, described response apparatus comprises other transaction response processing modules such as location indicating module, page turning zoom operations module.
In technique scheme, described treatment facility is PC or for mobile phone or for panel computer.
As shown in Figure 2, be workflow diagram of the present utility model, its step is as follows:
1, obtain the image information very nearly the same with the human eye capturing information that camera is caught by the camera glasses of wearing, wherein information source can be the display for the treatment of facility or the image on the projection panel;
2, treatment facility carries out pre-service with the image information of obtaining, and is processed into gray level image so that routine analyzer carries out next step operation;
The edge that 3, can not be in image according to human eye by many images the Analysis deterrmination picture centre and set up image coordinate;
4, go out the coordinate of sight line focus according to Characteristic of Image information calculations after processing, carry out simultaneously coordinates correction;
5, according to the result who calculates, namely the coordinate of sight line focus rests on the position on display or the projection panel, judges user's expection operation, thereby determines action type;
6, according to different action types, treatment facility is transferred response apparatus and is responded; If positioning action then according to the elements of a fix that calculate, is transferred location indicating module Emission Lasers point in this zone; If the operations such as page turning and convergent-divergent are then transferred page turning zoom operations module and are carried out the page turning convergent-divergent;
7, will transfer final picture disply behind the response apparatus.
That this is based on a kind of embodiment of the demo system of Eye Tracking Technique as shown in Figure 3.Camera glasses 1 are as catching the sight line device in the present embodiment, and PC 2 is treatment facility and response apparatus, the built-in page turning zoom operations of computer module and location indicating module, and projection panel 3 is display terminal.The user wears camera glasses 1, carries out the eye movement operation, and camera collection eye image data send treatment facility to and process, and the result after treatment facility will be processed sends different respond module to, shows user's operation by projection panel 3.Key step when present embodiment uses comprises:
1, the user is connected camera with PC with projector and is connected, and constructs sight line and follows the trail of environment.
2, the user starts computer, confirms successful connection.
3, computer receives the signal that the camera glasses transmit by sensor in real time, carries out analysis and calculation.For every frame picture, calculate the LOS coordinate of user on computer screen, judge the operation that user's sight line is expressed, as be positioned at certain a bit or on a certain zone, perhaps carry out page turning, also or carry out the convergent-divergent etc. in a certain zone.
The result that 4, will analyze is distributed to the different respond module of response apparatus, if navigate to certain a bit or a certain zone then the Emission Lasers point make a mark in this zone, if corresponding operation is then made in the operations such as page turning.
5, display be shown to that the user operates the operating result of gained and by projector projects to the projection panel.The user continues to repeat aforesaid operations.
In sum, core concept of the present utility model is to utilize the glasses that embed camera, collects user's operation information according to user's sight line synchronously, import treatment facility into, treatment facility is analyzed and is followed the trail of eye movement, and the result is delivered to response apparatus, by response apparatus response user behavior.

Claims (3)

1. demo system based on Eye Tracking Technique, it is characterized in that: this system comprises be used to the camera glasses that obtain eye image information, be used for to transmit the sensor of image information, carry out the treatment facility of sight line location and be used for the response apparatus of result feedback for the treatment of image information; Described camera glasses link to each other with treatment facility by the built-in sensors that wireless camera carries, and the output terminal for the treatment of facility links to each other with response apparatus.
2. the demo system based on Eye Tracking Technique according to claim 1 is characterized in that: described response apparatus comprises page turning zoom operations module, location indicating module.
3. the demo system based on Eye Tracking Technique according to claim 1 is characterized in that: described treatment facility is PC or for mobile phone or be panel computer.
CN201220472519.6U 2012-09-17 2012-09-17 Demonstration system based on sightline tracking technology Expired - Lifetime CN202795232U (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201220472519.6U CN202795232U (en) 2012-09-17 2012-09-17 Demonstration system based on sightline tracking technology

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201220472519.6U CN202795232U (en) 2012-09-17 2012-09-17 Demonstration system based on sightline tracking technology

Publications (1)

Publication Number Publication Date
CN202795232U true CN202795232U (en) 2013-03-13

Family

ID=47822461

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201220472519.6U Expired - Lifetime CN202795232U (en) 2012-09-17 2012-09-17 Demonstration system based on sightline tracking technology

Country Status (1)

Country Link
CN (1) CN202795232U (en)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103500061A (en) * 2013-09-26 2014-01-08 三星电子(中国)研发中心 Method and equipment for controlling displayer
CN103699308A (en) * 2013-12-24 2014-04-02 惠州Tcl移动通信有限公司 Automatic paging method and device
CN104808778A (en) * 2014-01-24 2015-07-29 北京奇虎科技有限公司 Device and method for determining validity of operation of head-wearing intelligent device
CN104978020A (en) * 2014-04-01 2015-10-14 卡西欧计算机株式会社 Information processing system, information device and wearable information device
CN105007424A (en) * 2015-07-22 2015-10-28 深圳市万姓宗祠网络科技股份有限公司 Automatic focusing system, method and wearable device based on eye tracking
CN106043308A (en) * 2015-04-08 2016-10-26 罗伯特·博世有限公司 Method and device for detecting the alertness of a vehicle driver
US10163093B2 (en) 2013-09-19 2018-12-25 Casio Computer Co., Ltd. Information device, mobile device, and wearable information device

Cited By (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10163093B2 (en) 2013-09-19 2018-12-25 Casio Computer Co., Ltd. Information device, mobile device, and wearable information device
US11157891B2 (en) 2013-09-19 2021-10-26 Casio Computer Co., Ltd. Information device, mobile device, and wearable information device
CN103500061A (en) * 2013-09-26 2014-01-08 三星电子(中国)研发中心 Method and equipment for controlling displayer
CN103500061B (en) * 2013-09-26 2017-11-07 三星电子(中国)研发中心 Control the method and apparatus of display
CN103699308A (en) * 2013-12-24 2014-04-02 惠州Tcl移动通信有限公司 Automatic paging method and device
CN104808778A (en) * 2014-01-24 2015-07-29 北京奇虎科技有限公司 Device and method for determining validity of operation of head-wearing intelligent device
CN104808778B (en) * 2014-01-24 2019-03-01 北京奇虎科技有限公司 Judge the device and method of head-wearing type intelligent equipment operation validity
CN104978020A (en) * 2014-04-01 2015-10-14 卡西欧计算机株式会社 Information processing system, information device and wearable information device
CN104978020B (en) * 2014-04-01 2018-05-08 卡西欧计算机株式会社 Information processing system, information equipment, mount type information equipment
US10025350B2 (en) 2014-04-01 2018-07-17 Casio Computer Co., Ltd. Information processing system, information device, and wearable information device
CN106043308A (en) * 2015-04-08 2016-10-26 罗伯特·博世有限公司 Method and device for detecting the alertness of a vehicle driver
CN105007424A (en) * 2015-07-22 2015-10-28 深圳市万姓宗祠网络科技股份有限公司 Automatic focusing system, method and wearable device based on eye tracking

Similar Documents

Publication Publication Date Title
CN202795232U (en) Demonstration system based on sightline tracking technology
Huang et al. An augmented reality sign-reading assistant for users with reduced vision
KR101563312B1 (en) System for gaze-based providing education content
US20130342704A1 (en) Interactive audiovisual device
CN103713737A (en) Virtual keyboard system used for Google glasses
CN108694679A (en) A kind of method student's learning state detection and precisely pushed
TW202008293A (en) System and method for monitoring qualities of teaching and learning
Cuperschmid et al. Development of an Augmented Reality environment for the assembly of a precast wood-frame wall using the BIM model
US11808941B2 (en) Augmented image generation using virtual content from wearable heads up display
Leong et al. Utilizing depth sensors for analyzing multimodal presentations: Hardware, software and toolkits
CN103258447A (en) Interactive multimedia teaching system and device
CN203276606U (en) Video real object displaying system with network function
Perla et al. Google cardboard dates augmented reality: Issues, challenges and future opportunities
Metcalfe et al. Using the technology: Introducing point of view video glasses into the simulated clinical learning environment
CN109508955B (en) Cinema management method, system, service platform and medium based on artificial intelligence
Zhang et al. Designing a streamlined viewport strategy system to enhance performance in context awareness in mobile learning environments
US20220327956A1 (en) Language teaching machine
CN210039169U (en) Intelligent sharing blackboard
CN208212444U (en) A kind of child attention training device based on eye movement and touch screen interaction
CN106556963A (en) Projection arrangement and projecting method
KR20150066779A (en) Wearable apparatus for learning and System supporting learning including the same
CN105739230B (en) Touch tomography projection device
CN202331388U (en) Multimedia multifunctional mouse
CN205620668U (en) Touch photographic projection arrangement
CN210119872U (en) VR uses supervise device based on operation function

Legal Events

Date Code Title Description
C14 Grant of patent or utility model
GR01 Patent grant
CX01 Expiry of patent term

Granted publication date: 20130313

CX01 Expiry of patent term