CN109799908A - A kind of image scaling and dragging method based on eye movement signal - Google Patents
A kind of image scaling and dragging method based on eye movement signal Download PDFInfo
- Publication number
- CN109799908A CN109799908A CN201910001261.8A CN201910001261A CN109799908A CN 109799908 A CN109799908 A CN 109799908A CN 201910001261 A CN201910001261 A CN 201910001261A CN 109799908 A CN109799908 A CN 109799908A
- Authority
- CN
- China
- Prior art keywords
- image
- blinkpunkt
- scaling
- thermal map
- picture
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Landscapes
- User Interface Of Digital Computer (AREA)
- Controls And Circuits For Display Device (AREA)
- Editing Of Facsimile Originals (AREA)
Abstract
The invention discloses a kind of image scaling and dragging method based on eye movement signal, belongs to Cognitive Neuroscience, the technical field that image procossing intersects.The present invention obtains watching point as eye movement signal, in image scale operation using watching region as scaling target area using eye tracker；Drag direction is indicated with watching region in image drag operation, the characteristics of abundant eye movement signal rapid and convenient, and the key-press input of image processing techniques and mouse is combined, image scaling and dragging rapidly and efficiently may be implemented, effectively reduce manipulation strength and the time of operator.
Description
Technical field
The invention discloses a kind of image scaling and dragging method based on eye movement signal belongs to Cognitive Neuroscience, figure
The technical field to intersect as processing.
Background technique
Scaling and dragging to image are that the basic function operated to image is realized in human-computer interaction, are being related to human-computer interaction
There is important application value in field of image processing.In some special application fields, such as to image implement fine processing or
The fields such as interpretation, operator needs to handle each region of large scale picture one by one or interpretation, needs in the process
Interested regional area is repeatedly scaled and drag operation is carried out to whole picture large-size images.How to improve scaling or
It pulls efficiency and then the manipulation strength of operator is effectively reduced to the image progress special applications such as fine processing or interpretation neck
Domain has huge practical value.
Currently, for topography interested scaling mainly pass through mouse delimit in the picture it is laggard to zoom area
The scaling of row topography；And the movement after the selected coordinate of mouse by mouse is then mainly utilized to the dragging of large scale picture
To realize also there is the dragging for carrying out four direction up and down to image by keyboard.The above method requires repeatedly to move
Dynamic mouse taps keyboard, increases manipulation strength and the operating time of operator, it would be highly desirable to a kind of novel human-machine interaction mode
To reduce manipulation strength and then improve efficiency.
When operator observes piece image, based on the thermal camera and pupil-corneal reflection vector in eye tracker
The image of the available eyes eyeball of method, obtains pupil center location by image procossing, passes through the available view of coordinate transformation
Line falls track in the picture.The application is directed to a kind of realize efficient image scaling and dragging side using eye movement signal
Method.
Summary of the invention
Goal of the invention of the invention is the deficiency for above-mentioned background technique, provides a kind of image based on eye movement signal
Scaling and dragging method, keying in operation with simple mouse is trigger event and real-time capture observer's sight track, with observation
The frequent operation of the real-time eye movement situation substitution mouse-keyboard of person and then scaling and the dragging for realizing image, solve existing sense
The technical problem that the scaling and drag operation intensity of interest topography are big and the operating time is long.
The present invention adopts the following technical scheme that for achieving the above object
Image scaling and dragging method based on eye movement signal include following two part.
(1) based on the area-of-interest image scaling of eye movement signal
1) parameter setting for completing thermal camera, is set separately pupil and corneal reflection detection threshold in infrared imaging image
Value obtains the position of pupil and corneal center point respectively, utilizes RANSAC method (Mach, C.A.C., Random Sample
Consensus:a paradigm for model fitting with application to image analysis and
Automated cartography, 1981) obtain the corresponding eye movement coordinate of blinkpunkt；
2) blinkpunkt calibration is completed, quadrangle, center display calibration point in screen, sight figure personnel successively watch calibration point attentively,
Corresponding blinkpunkt coordinate is obtained, the mapping relations between blinkpunkt region and screen are established；
3) quadrangle, center display calibration point, acquisition sight figure personnel watch the blinkpunkt coordinate of calibration point attentively, calculate on the screen
Deviation between calibration point coordinate obtained in the blinkpunkt and step 2) calibration process of step acquisition out, when average deviation is small
When 1 degree of visual angle, complete calibration steps and enter step 4), otherwise repeatedly step 2) calibration process until meeting the requirements；
4) in whole picture large-size images central part according to the screen display resolution interception image of setting, and on the screen
Display interception image all over the screen placed in the middle；
5) the picture presentation time is divided into several time slices with 50ms length, obtains watching attentively in each time slice
Point distribution plots, to the corresponding blinkpunkt distribution plots of all time slices be averaging, and using Gaussian smoothing algorithm into
Blinkpunkt thermal map is formed after row smoothing techniques, 80% or more thermal map of interception blinkpunkt thermal map maximum value is superimposed upon display
The average fixation point thermal map in the time is presented as picture on image；
6) after acquisition left mouse button presses event, the relevant information of current display picture is saved (in whole picture large scale figure
The position of picture, area size, magnification ratio), and be to trace back the 1000ms time at 0 moment with the moment, by the method in step 5)
Obtain the average fixation point thermal map in ﹣ 1000ms to ﹣ 500ms；
7) using the coordinate of global maximum in above-mentioned average fixation point thermal map as scaling blinkpunkt coordinate, with scaling note
Select the rectangular region of M*N pixel as area-of-interest centered on viewpoint；
8) area-of-interest of step 7) detection is amplified K times and is shown in center Screen and grasped with the amplification for realizing image
Make；
9) after obtaining right mouse button and pressing event, according to the information saved in step 6), show on the screen picture with
Realize the reduction operation of image.
Step 6) is to the multiple zoom operations that 9) nested can be executed to realize image.
(2) image based on eye movement signal pulls
Step 1) is to 5) identical with (one)；
6) defining the range within display L, four side of image distance screen pixel is image neighboring area；Operator exists
When executing the image drag operation based on eye movement signal, it is desirable that a certain position is in operator's gazing at images neighboring area to indicate
Drag direction；The position that defining operation personnel watch attentively is to pull blinkpunkt, pulls blinkpunkt position and the corresponding of drag operation is closed
System are as follows: pull entire image and dragging blinkpunkt correspondence image is shown in center Screen to realize image drag operation；
7) it after acquisition middle button of mouse presses event, is traced back the 1000ms time using the moment as 0 point of the time, by step 5)
Method obtain ﹣ 1000ms to ﹣ 500ms in average fixation point thermal map；
8) the thermal map maximum value coordinate conduct being seated in image neighboring area is chosen from above-mentioned average fixation point thermal map
Pull blinkpunkt coordinate；
9) pulling entire image shows that dragging blinkpunkt correspondence image in center Screen to realize the dragging behaviour of image
Make.In image drag operation, acquisition operator's watching point is located region and drags relative to the position instruction image of screen
The direction dragged, that is, when being seated screen upper and lower, left and right side, correspond to upper and lower, right, left drag image；It is seated screen
When upper left, upper right, lower-left, the lower right corner, correspond to bottom right, lower-left, upper right, upper left drag image.
10) above-mentioned steps 7) to the multiple dragging that 9) nested can be executed to realize image.
The above scaling nested can execute each other with the operation for pulling two parts, to realize to the more of image
Secondary scaling or dragging.
The present invention by adopting the above technical scheme, has the advantages that
The eye movement signal generation that real-time capture observer of the present invention observes picture to be processed is able to reflect observer's sight rail
The blinkpunkt thermal map of mark keys in the external trigger pulled for image scaling and image with simple mouse, from trigger event
Scaling blinkpunkt is chosen in average fixation point thermal map in the period of starting traced back and pulls blinkpunkt, is compiled in conjunction with simple
Journey replaces mouse moving operation, it is possible to reduce the manipulation strength of operator；Further, since the movement speed of sight is faster than movement
The speed of mouse can accelerate the service speed to image using the image scaling and dragging method of the application.
Detailed description of the invention
Fig. 1 is system pie graph.
Fig. 2 is system signal flow chart.
Fig. 3 (a) is watching attentively in each time slice obtained when the time is presented using 50ms as time slice length in picture
Point distribution plots, Fig. 3 (b) are to be averaging to blinkpunkt distribution plots all in Fig. 3 (a) and carry out Gaussian smoothing processing
The blinkpunkt thermal map formed afterwards.
Fig. 4 (a) is the average fixation point thermal map that blinkpunkt thermal map obtains according to Fig. 3 (b), and Fig. 4 (b) is from Fig. 4
(a) the scaling blinkpunkt chosen in the thermal map of average fixation point shown in.
Fig. 5 (a) is the average fixation point thermal map that blinkpunkt thermal map obtains according to Fig. 3 (b), and Fig. 5 (b) is from Fig. 5
(a) the dragging blinkpunkt chosen in the thermal map of average fixation point shown in.
Fig. 6 (a) is the scaling blinkpunkt watched attentively and left mouse button key-press event obtains by treating enlarged drawing, Fig. 6
(b) for the picture after K=7 times of amplifying operation of region to be amplified progress.
Saved image information, Fig. 7 is enlarged in last time image when Fig. 7 (a) is obtains right mouse button key-press event
(b) for be zoomed out region carry out K=7 times of reduction operation after picture.
Last time image operates saved image information, Fig. 8 (b) when Fig. 8 (a) is obtains middle button of mouse key-press event
For the image obtained after dragging mould image and completing to pull.
Specific embodiment
The technical solution of invention is described in detail with reference to the accompanying drawing.
Fig. 1 is system pie graph.Realize the block diagram of the system of the application method as shown, by image display, eye
Dynamic signal check-out module, blinkpunkt thermal map generation module, mousebutton module, blinkpunkt check-out module, image scaling module, figure
As pulling module composition.Wherein, image to be operated is presented in image display；Eye movement signal check-out module obtains operator's
Eye movement signal；Eye movement signal is converted blinkpunkt thermal map by blinkpunkt thermal map generation module；Mousebutton module obtains operator
The mouse left, center, right key-press event that member is made for image is currently presented；After detecting mousebutton event, blinkpunkt
Check-out module is averaging the blinkpunkt thermal map of several time slices to trace back in hundreds of milliseconds and obtains average fixation point thermal map,
And the coordinate of global maximum in average fixation point thermal map is obtained as scaling blinkpunkt or obtains average fixation point thermal map periphery
The coordinate of global maximum is as dragging blinkpunkt in region；When obtain left mouse button press event after, image scaling module with
It selects the rectangular region of M*N pixel as area-of-interest centered on scaling blinkpunkt, which is amplified K times and in screen
Center display is to realize that image is enlarged；After acquisition right mouse button presses event, image scaling module is schemed according to the last time
As the image information saved when being enlarged, correspondence image is shown to realize that image down operates；It is pressed when obtaining middle button of mouse
After event, image pulls module centered on pulling blinkpunkt, pulls entire image and dragging blinkpunkt correspondence image is being shielded
The display of curtain center is to realize image drag operation.
Fig. 2 is system signal flow chart.Image is presented in image display, and waits the acquisition pair of eye movement signal check-out module
The eye movement signal answered；After eye movement signal check-out module obtains eye movement signal, blinkpunkt heat is generated by blinkpunkt thermal map generation module
Figure；Mousebutton module obtains operator and is intended to the operation of present image；The mousebutton thing made according to operator
Part and corresponding blinkpunkt thermal map, blinkpunkt check-out module detect to scale or pull blinkpunkt；If detecting left mouse button event,
Operation is then amplified to image according to scaling blinkpunkt by image scaling module；If right mouse button event is detected, by image
The image information that Zoom module saves when being enlarged according to last image is (big in position, the region of whole picture large-size images
Small, magnification ratio) reduction operation is carried out to image；If detecting middle button of mouse event, module is pulled by image and is infused according to dragging
Viewpoint carries out drag operation to image.
Fig. 3 is the blinkpunkt thermal map example that blinkpunkt thermal map generation module generates.As shown, Fig. 3 (a) is shown picture
The presentation time is divided into several time slices with 50ms length, obtains the blinkpunkt distribution plots in each time slice；Fig. 3
(b) it is shown and all blinkpunkt distribution plots is averaging and carried out with formation blinkpunkt thermal map after Gaussian smoothing processing.
Fig. 4 is the scaling blinkpunkt example that blinkpunkt check-out module generates.Operator waits for zoom area to image is presented
Watched attentively, traced back backward 1000ms after obtaining left mouse button or right button and pressing event, and using the moment as 0 moment of time,
According to-the 1000ms of method generation shown in Fig. 3 to blinkpunkt thermal map in -500ms, interception blinkpunkt thermal map maximum value 80% with
On thermal map be superimposed upon display image on as picture present the time in average fixation point thermal map (such as Fig. 4 (a)), will averagely infuse
The coordinate (cross rack position in such as Fig. 4 (b)) of global maximum is as scaling blinkpunkt in viewpoint thermal map.
Fig. 5 is the dragging blinkpunkt example that blinkpunkt check-out module generates.Operator is to presentation image region to be pulled
Watched attentively, after obtaining middle button of mouse and pressing event, and is traced back backward 1000ms using the moment as 0 moment of time, according to figure
Blinkpunkt thermal map in the -1000ms of method generation shown in 3 to -500ms intercepts 80% or more heat of blinkpunkt thermal map maximum value
Figure is superimposed upon on display image as the average fixation point thermal map (such as Fig. 5 (a)) in the picture presentation time, by average fixation point heat
The coordinate (cross rack position in such as Fig. 5 (b)) of global maximum is as dragging blinkpunkt in figure neighboring area.
Fig. 6 is that image scaling module realizes that image amplifies example.By treat enlarged drawing watch attentively and left mouse button by
Key events obtain scaling blinkpunkt (Fig. 6 (a)), and image scaling module amplifies K=7 times of operation (figure to region to be amplified
6(b))。
Fig. 7 is that image scaling module realizes image down example.(figure during being in the display of image of magnifying state
7 (a)), by the acquisition to right mouse button key-press event, the image information saved when being enlarged according to last image (
The positions of whole picture large-size images, area size, magnification ratio) display correspondence image to be to realize K=7 times of image down of behaviour
Make (Fig. 7 (b)).
Fig. 8 is that image pulls module realization image dragging example.By treat drag image (Fig. 8 (a)) watch attentively and mouse
Key button event in mark, image pull module and treat the operation (Fig. 8 (b)) that drag image is pulled to the right.
Claims (10)
1. a kind of image scaling and dragging method based on eye movement signal, which is characterized in that
Acquisition observer watches the eye movement signal of picture to be processed attentively to generate the blinkpunkt in the picture presentation time to be processed in real time
Thermal map,
In the external event triggering of scaling pictures, scaling blinkpunkt is extracted from average fixation point thermal map, is infused to according to scaling
The area-of-interest that viewpoint determines carries out the image scale operation of target multiple,
In the external event triggering for pulling picture, is extracted from average fixation point thermal map and pull blinkpunkt, pull entire image
It is shown in center Screen so that pulling blinkpunkt correspondence image to realize image drag operation.
2. a kind of image scaling and dragging method based on eye movement signal according to claim 1, which is characterized in that generate to
The method for handling the blinkpunkt thermal map that picture was presented in the time are as follows: obtain each blinkpunkt coordinate presented in time slice of picture
Distribution map is averaging the corresponding blinkpunkt distribution plots of all time slices, and using Gaussian smoothing algorithm to equalization
Treated, and blinkpunkt distribution plots carry out the blinkpunkt thermal map that smoothing techniques were formed in the picture presentation time to be processed.
3. a kind of image scaling and dragging method based on eye movement signal according to claim 1 or claim 2, which is characterized in that raw
At the method for the average fixation point thermal map are as follows: by since scaling pictures or pull picture external event triggering moment trace back
Blinkpunkt thermal map in T seconds periods more than given threshold obtains average fixation point thermal map after being superimposed upon on picture to be processed.
4. a kind of image scaling and dragging method based on eye movement signal according to claim 1, which is characterized in that from averagely
The method of scaling blinkpunkt is extracted in blinkpunkt thermal map are as follows: choosing being located for global maximum in average fixation point thermal map is a little contracting
Put blinkpunkt.
5. a kind of image scaling and dragging method based on eye movement signal according to claim 1, which is characterized in that from averagely
Extract the method for pulling blinkpunkt in the neighboring area of blinkpunkt thermal map are as follows: choose from the neighboring area of average fixation point thermal map maximum
A conduct of being located for value pulls blinkpunkt.
6. a kind of image scaling and dragging method based on eye movement signal according to claim 1, which is characterized in that described flat
The neighboring area of equal blinkpunkt thermal map is the image-region within the fixed numbers pixel of picture display screen curtain boundary.
7. a kind of image scaling and dragging method based on eye movement signal according to claim 1, which is characterized in that pull whole
When width image, obtains and pull the direction that blinkpunkt is located position instruction image dragging of the region relative to screen, that is, dragging is watched attentively
When point is seated screen upside, downside, left side, right side, correspond to upper and lower, right, left dragging entire image；Pull blinkpunkt
When being seated the screen upper left corner, the upper right corner, the lower left corner, the lower right corner, correspond to pull whole picture figure to bottom right, lower-left, upper right, upper left
Picture.
8. realizing a kind of dress of image scaling and dragging method based on eye movement signal described in any one of claim 1 to 7
It sets, comprising:
Eye movement signal check-out module acquires the eye movement signal that observer watches picture to be processed attentively in real time,
Image display shows picture to be processed,
Blinkpunkt thermal map generation module generates the blinkpunkt thermal map in the picture presentation time to be processed,
Blinkpunkt check-out module extracts scaling from average fixation point thermal map in the external event triggering of scaling pictures and watches attentively
Point extracts from average fixation point thermal map in the external event triggering for pulling picture and pulls blinkpunkt,
Image scaling module carries out the image scale operation of target multiple to the area-of-interest determined according to scaling blinkpunkt,
And
Image pulls module, pulls entire image and dragging blinkpunkt correspondence image is shown in center Screen to realize that image drags
Drag operation.
9. a kind of computer readable storage medium, is stored thereon with computer program, which is characterized in that the program is held by processor
It is performed the steps of when row
Acquisition observer watches the eye movement signal of picture to be processed attentively to generate the blinkpunkt in the picture presentation time to be processed in real time
Thermal map,
In the external event triggering of scaling pictures, scaling blinkpunkt is extracted from average fixation point thermal map, is infused to according to scaling
The area-of-interest that viewpoint determines carries out the image scale operation of target multiple,
In the external event triggering for pulling picture, is extracted from average fixation point thermal map and pull blinkpunkt, pull entire image
It is shown in center Screen so that pulling blinkpunkt correspondence image to realize image drag operation.
10. realize a kind of image scaling and dragging method based on eye movement signal described in any one of claim 1 to 7 is
System characterized by comprising computer equipment and to computer peripheral provide external trigger external input set
Standby, the computer equipment is comprising memory, processor and stores the computer that can be run on a memory and on a processor
Program, the processor perform the steps of when executing described program
Acquisition observer watches the eye movement signal of picture to be processed attentively to generate the blinkpunkt in the picture presentation time to be processed in real time
Thermal map,
In the external event triggering of scaling pictures, scaling blinkpunkt is extracted from average fixation point thermal map, is infused to according to scaling
The area-of-interest that viewpoint determines carries out the image scale operation of target multiple,
In the external event triggering for pulling picture, is extracted from average fixation point thermal map and pull blinkpunkt, pull entire image
It is shown in center Screen so that pulling blinkpunkt correspondence image to realize image drag operation.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910001261.8A CN109799908B (en) | 2019-01-02 | 2019-01-02 | Image zooming and dragging method based on eye movement signal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910001261.8A CN109799908B (en) | 2019-01-02 | 2019-01-02 | Image zooming and dragging method based on eye movement signal |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109799908A true CN109799908A (en) | 2019-05-24 |
| CN109799908B CN109799908B (en) | 2022-04-01 |
Family
ID=66558404
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910001261.8A Active CN109799908B (en) | 2019-01-02 | 2019-01-02 | Image zooming and dragging method based on eye movement signal |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109799908B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110348296A (en) * | 2019-05-30 | 2019-10-18 | 北京市遥感信息研究所 | A kind of target identification method based on human-computer fusion |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103257707A (en) * | 2013-04-12 | 2013-08-21 | 中国科学院电子学研究所 | Three-dimensional roaming method utilizing eye gaze tracking and conventional mouse control device |
| US20150379963A1 (en) * | 2014-06-26 | 2015-12-31 | Bogdan Constantin HOLMANU | Eye display interface for a touch display device |
| US20160116980A1 (en) * | 2013-03-01 | 2016-04-28 | Tobii Ab | Two step gaze interaction |
| CN105677024A (en) * | 2015-12-31 | 2016-06-15 | 北京元心科技有限公司 | Eye movement detection tracking method and device, and application of eye movement detection tracking method |
| CN106774886A (en) * | 2015-10-14 | 2017-05-31 | 国立民用航空学院 | Zooming effect in eye tracking interface |
| CN108255299A (en) * | 2018-01-10 | 2018-07-06 | 京东方科技集团股份有限公司 | A kind of image processing method and device |
| CN108491068A (en) * | 2018-02-08 | 2018-09-04 | 东南大学 | A kind of exchange method of eye movement signal control |
| CN108958489A (en) * | 2018-07-20 | 2018-12-07 | 东南大学 | A kind of interesting image regions Rapid Detection method based on brain electricity and eye tracker |
-
2019
- 2019-01-02 CN CN201910001261.8A patent/CN109799908B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20160116980A1 (en) * | 2013-03-01 | 2016-04-28 | Tobii Ab | Two step gaze interaction |
| CN103257707A (en) * | 2013-04-12 | 2013-08-21 | 中国科学院电子学研究所 | Three-dimensional roaming method utilizing eye gaze tracking and conventional mouse control device |
| US20150379963A1 (en) * | 2014-06-26 | 2015-12-31 | Bogdan Constantin HOLMANU | Eye display interface for a touch display device |
| CN106774886A (en) * | 2015-10-14 | 2017-05-31 | 国立民用航空学院 | Zooming effect in eye tracking interface |
| CN105677024A (en) * | 2015-12-31 | 2016-06-15 | 北京元心科技有限公司 | Eye movement detection tracking method and device, and application of eye movement detection tracking method |
| CN108255299A (en) * | 2018-01-10 | 2018-07-06 | 京东方科技集团股份有限公司 | A kind of image processing method and device |
| CN108491068A (en) * | 2018-02-08 | 2018-09-04 | 东南大学 | A kind of exchange method of eye movement signal control |
| CN108958489A (en) * | 2018-07-20 | 2018-12-07 | 东南大学 | A kind of interesting image regions Rapid Detection method based on brain electricity and eye tracker |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110348296A (en) * | 2019-05-30 | 2019-10-18 | 北京市遥感信息研究所 | A kind of target identification method based on human-computer fusion |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109799908B (en) | 2022-04-01 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102749991B (en) | A kind of contactless free space sight tracing being applicable to man-machine interaction | |
| US10456072B2 (en) | Image interpretation support apparatus and method | |
| CN105867603A (en) | Eye-controlled method and device | |
| JP6524589B2 (en) | Click operation detection device, method and program | |
| CN105892642A (en) | Method and device for controlling terminal according to eye movement | |
| CN110083202A (en) | With the multi-module interactive of near-eye display | |
| EP2360567A3 (en) | Image processing apparatus, image processing method, program, and image processing system | |
| CN104641634A (en) | Inspection imaging system, and a medical imaging system, apparatus and method | |
| CN111898407A (en) | Human-computer interaction operating system based on human face action recognition | |
| Tiersma et al. | Visualising scanning patterns of pathologists in the grading of cervical intraepithelial neoplasia | |
| CN102830800B (en) | Method and system for controlling digital signage by utilizing gesture recognition | |
| JP2015219892A (en) | Visual line analysis system and visual line analysis device | |
| CN109799908A (en) | A kind of image scaling and dragging method based on eye movement signal | |
| JP5879231B2 (en) | Image display device, program, and method of operating image display device | |
| CN109960913A (en) | A kind of biopsy method based on user's interaction | |
| Cristanti et al. | Eye gaze tracking to operate android-based communication helper application | |
| WO2018061299A1 (en) | Information processing device and information processing method | |
| US11457856B2 (en) | Information processing device, information processing method, recording medium storing program code, and biomedical-signal measuring system | |
| CN114779925A (en) | Sight line interaction method and device based on single target | |
| CN113240481A (en) | Model processing method and device, electronic equipment and readable storage medium | |
| Guo et al. | Appliancereader: A wearable, crowdsourced, vision-based system to make appliances accessible | |
| CN106095088B (en) | A kind of electronic equipment and its image processing method | |
| Xu et al. | Ravengaze: A dataset for gaze estimation leveraging psychological experiment through eye tracker | |
| Littmann et al. | Visual gesture recognition by a modular neural system | |
| CN113095243B (en) | Mouse control method and device, computer equipment and medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |