CN101872237A - Method and system for pupil tracing as well as correction method and module for pupil tracing - Google Patents
Method and system for pupil tracing as well as correction method and module for pupil tracing Download PDFInfo
- Publication number
- CN101872237A CN101872237A CN200910137211A CN200910137211A CN101872237A CN 101872237 A CN101872237 A CN 101872237A CN 200910137211 A CN200910137211 A CN 200910137211A CN 200910137211 A CN200910137211 A CN 200910137211A CN 101872237 A CN101872237 A CN 101872237A
- Authority
- CN
- China
- Prior art keywords
- pupil
- angle
- coordinate
- display screen
- module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Landscapes
- Eye Examination Apparatus (AREA)
Abstract
The invention discloses a method and a system for pupil tracing as well as a correction method and a module for pupil tracing. The method for pupil tracing comprises the following steps: capturing an image of one user eye, wherein the image of one eye comprises a pupil image and two reflective point images; calculating an area parameter and an angle parameter based on the pupil and the two reflective points; marking the area parameter and the angle parameter on an angle-area plane graph to obtain original coordinates on the angle-area plane graph; and converting the original coordinates on the angle-area plane graph into display cursor coordinates by using a coordinates system conversion method. Since the eye moving range described by characteristic values (the area and the angle) of the invention is a rectangle, the conversion process of the coordinates is equivalent to the conversion of coordinates in two rectangles, and therefore, the error can be greatly reduced, and the pupil tracing accuracy can be improved.
Description
Technical field
The present invention relates to a kind of pupil tracing method, particularly relate to and a kind ofly use special coordinate and change preposition technology and improve the pupil tracing method of accuracy.
Background technology
People's ocular pursuit (Eye tracking) technology is common to be applied to control computer, can develop as the personage of gradually freezing people or limbs inconvenience thoroughly by computer and extraneous accessory of linking up.This technology is meant follows the trail of moving of eyeball, obtains eyeball position coordinate or motion track, and according to this computer is produced certain default steering order.Therefore this respect technology at first must detect moving of eyeball accurately, then another emphasis is must convert computer exactly to produce the required data of steering order, for example eyeball position conversion correspondence is become the slider position on the computer display screen, otherwise will cause wrong steering order down.
Known person ocular pursuit technology generally can be divided into contact and contactless two big classes.Wherein, contact human eye tracer technique for example needs the user to wear the search coil method of the contact lenses of special adding inductive coil; For example need the electroculogram method of user again all around at two electrodes that are sticked.The wear-type (Head-mount) that need wear specific installation is then for example arranged at present and exempt from wear-type (Free-head) as for contactless human eye tracer technique.Aforementioned wear-type human eye tracer technique is located at video camera and light source shelf on user's head, utilizes the eyeball image of video camera acquisition to infer the sight line position, can get rid of user's head and move the error that causes; Exempting from wear-type human eye tracer technique then must overcome user's head and move the problem that causes error.
Intelligible, because contact human eye tracer technique has the foreign matter contact concerning the user, can bring strong discomfort; Contactless wear-type human eye tracer technique then is because helmet causes head to bear weight, allows the user feel heavy the user.The repulsion sense that above kind all causes the user to use, let us not go into the question now accuracy and cost problem are promoted difficult basically.
Exempt from wear-type human eye tracer technique aspect, though mainly containing user's head moves the problem that causes error and need overcome, but owing to can not cause discomfort or bear added burden to the user, industry develops and respectively releases different method for tracing towards this direction mostly, and is basic tool with the image analysing computer technology mostly.For instance, the U.S. the 7th, 197, the 165B2 patent, disclose a kind of method of utilizing image data to carry out eyeball tracking, it utilizes the three-dimensional computer model of a head of setting up in advance, and seeks the zone that is defined as eyes and eyebrow in the three dimensions, these zones are projected the bidimensional image space, find out eyeball position by the pixel intensity value of analysis of two-dimensional image space then.This technology not only need be set up the three-dimensional computer model of user's head in advance and follow the trail of the operational method complexity, must cooperate the processor of powerful calculation function just to have way to reduce the processing time, and cost is very expensive.
No matter which kind of human eye method for tracing, the developer focuses on the mobile aspect of detecting eyeball more, and the big multipotency of this respect reaches certain accuracy, but then carries no weight aspect the conversion of display screen coordinate in eyeball coordinate mapping (mapping), often takes place than multiple error in this section.In general, can need to proofread and correct earlier when carrying out for the first time the coordinate conversion, common bearing calibration is to make the user watch four corners of display screen or edge up and down, the eyeball coordinate that detects is as check point, be considered as these check points correct and be mapped to display screen, then calculate the position that projects display screen when the user watches all the other positions of display screen thereafter with interpolation method.Yet, aforementioned corrected method not only check point is few, the coordinate of the most positions of whole display screen is all tried to achieve with interpolation, in case causing wherein, a check point has deviation slightly, then will produce large-scale error effect, and this mode that directly the eyeball coordinate is converted to the display screen coordinate not to be verified be preferable.
This shows, no matter above-mentioned existing which kind of human eye method for tracing on the structure and use of method and system, obviously still has inconvenience and defective, and demands urgently further being improved.In order to solve the problem of above-mentioned existence, relevant manufacturer there's no one who doesn't or isn't seeks solution painstakingly, but does not see always that for a long time suitable design finished by development, and this obviously is the problem that the anxious desire of relevant dealer solves.Therefore how to found a kind of new pupil tracing method and system, and be used for the bearing calibration and the module of pupil tracing, real one of the current important research and development problem that belongs to, also becoming the current industry utmost point needs improved target.
Summary of the invention
The objective of the invention is to, overcome the defective that existing human eye method for tracing exists, and a kind of new pupil tracing method and system are provided, technical matters to be solved be make it improve accuracy and cost low.
Another object of the present invention is to, a kind of bearing calibration of new structure is provided and proofreaies and correct module, be used for pupil tracing and can improve accuracy.
The object of the invention to solve the technical problems realizes by the following technical solutions.A kind of pupil tracing method that proposes according to the present invention is converted to slider position on the display screen for the sight line with a user; Wherein this method comprises: an image capture step, capture this user's eyes image frame by an image capture unit, and comprise the image of a pupil and two reflective spots in this eyes image frame; One treatment step obtains an original coordinate that is located in an angle-area plane by a processing unit according to this pupil and this two reflective spot; And a coordinate switch process, undertaken by a coordinate conversion module that is connected with this processing unit, utilize the coordinate system conversion method to make the original coordinate on this angle-area plane be converted to a display screen vernier coordinate.
The object of the invention to solve the technical problems also can be applied to the following technical measures to achieve further.
Aforesaid pupil tracing method, wherein this treatment step comprises an image analysing computer step, calculates an area parameter and an angle parameter by the image analysing computer module of this processing unit that is connected with this image capture unit according to this pupil and this two reflective spot; And a graphics process step, make this area parameters and this angle parameter be shown in this angle-area plane and obtain this original coordinate by the graphics process module of this processing unit that is connected with this image analysing computer module.
Aforesaid pupil tracing method, wherein in this image analysing computer step, with a horizontal line that passes the pupil center in this eyes image frame, and this pupil and the line of a reflective spot wherein, the folded angle of two lines is this angle parameter.
Aforesaid pupil tracing method, wherein in this image analysing computer step, with a horizontal line that passes the pupil center in this eyes image frame, and this pupil and the line of a reflective spot wherein, the folded angle of two lines is first angle, the folded angle of this horizontal line and this pupil and the line of another reflective spot wherein is second angle, and the mean value of first angle and this second angle is this angle parameter.
Aforesaid pupil tracing method in this image analysing computer step, is the summit with the pupil in this eyes image frame wherein, and this pupil and this two reflective spot be the angle of line formation respectively, is this angle parameter.
Aforesaid pupil tracing method, wherein in this image analysing computer step, this area parameters is meant this pupil and the formed leg-of-mutton area value of this two reflective spots line.
Aforesaid pupil tracing method, wherein in this image analysing computer step, this area parameters is meant this pupil and the formed leg-of-mutton area value of this two reflective spots line divided by a normalization factor, and this normalization factor is that the square distance by this two reflective spot calculates.
Aforesaid pupil tracing method, wherein in this image analysing computer step, this area parameters is meant this pupil and the formed leg-of-mutton area value of this two reflective spots line divided by a normalization factor, this normalization factor equals the square distance of this two reflective spot divided by 2.
Aforesaid pupil tracing method, wherein this coordinate switch process is to adopt affine conversion method to carry out.
Aforesaid pupil tracing method, wherein when using this method for the first time, should carry out following correction: proofread and correct module by one and define 1-n check point or correction block in the display screen, and at least four four corners that are respectively adjacent to this display screen in these check points or the correction block; Capture 1-n eyes image frame by this image capture unit, these eyes image frames are that this user watches the 1-n check point of this display screen respectively attentively or proofread and correct block the corresponding acquisition of time institute; Obtain the original coordinate of 1-n on this angle-area plane according to pupil in this 1-n eyes image frame and reflective spot seriatim by this processing unit; Reach the coordinate that makes these original coordinates be mapped to the check point of this display screen or proofread and correct block by this coordinate system conversion method that coordinate conversion module uses and this coordinate conversion module is consistent.
Aforesaid pupil tracing method, wherein in the step of proofreading and correct, this processing unit is with this 1-method, pupil in its n eyes image frame calculates corresponding area parameters and angle parameter with reflective spot, is shown in seriatim and obtains the original coordinate of this 1-n on this angle-area plane.
Wherein in the step of proofreading and correct, the coordinate that this coordinate conversion module makes these original coordinates be mapped to the check point of this display screen or proofread and correct block is tried to achieve the coefficient in the coordinate system conversion formula to aforesaid pupil tracing method at last.
Aforesaid pupil tracing method, wherein 1-n proofreaies and correct block and is meant array block by the i * j of this display screen five equilibrium so n=ij in this display screen.
The object of the invention to solve the technical problems also realizes by the following technical solutions.A kind of pupil tracing system that proposes according to the present invention is converted to slider position on the display screen for the sight line with a user, and comprises an image capture unit for this user's of acquisition eyes image frame; The image that wherein comprises a pupil and two reflective spots in this eyes image frame, and this system also comprises: a processing unit obtains an original coordinate that is located in an angle-area plane according to this pupil and this two reflective spot; And coordinate conversion module, be connected with this processing unit, utilize the coordinate system conversion method to make the original coordinate on this angle-area plane be converted to a display screen vernier coordinate.
The object of the invention to solve the technical problems also can be applied to the following technical measures to achieve further.
Aforesaid pupil tracing system, wherein this processing unit comprises an image analysing computer module that is connected with this image capture unit, it orients this pupil and this two reflective spot in this eyes image frame, and calculates an area parameter and an angle parameter according to this pupil and this two reflective spot; And a graphics process module that is connected with this image analysing computer module, make this area parameters and this angle parameter be shown in this angle-area plane and obtain this original coordinate.
Aforesaid pupil tracing system, wherein this system also comprises two light sources, forms this two reflective spot in this user's eyes.
Aforesaid pupil tracing system, wherein this image analysing computer module is the horizontal line that passes the pupil center in this eyes image frame with, and this pupil and the line of a reflective spot wherein, the folded angle of two lines is this angle parameter.
Aforesaid pupil tracing system, wherein this image analysing computer module is the horizontal line that passes the pupil center in this eyes image frame with, and this pupil and the line of a reflective spot wherein, the folded angle of two lines is first angle, the folded angle of this horizontal line and this pupil and the line of another reflective spot wherein is second angle, and the mean value of first angle and this second angle is this angle parameter.
Aforesaid pupil tracing system, wherein this image analysing computer module is to be the summit with the pupil in this eyes image frame, this pupil and this two reflective spot be the angle that forms of line respectively, is this angle parameter.
Aforesaid pupil tracing system, wherein the area parameters calculated of this image analysing computer module is meant this pupil and the formed leg-of-mutton area value of this two reflective spots line.
Aforesaid pupil tracing system, the area parameters calculated of this image analysing computer module wherein, be meant this pupil and the formed leg-of-mutton area value of this two reflective spots line divided by a normalization factor, this normalization factor is that the square distance by this two reflective spot calculates.
Aforesaid pupil tracing system, the area parameters calculated of this image analysing computer module wherein, be meant this pupil and the formed leg-of-mutton area value of this two reflective spots line divided by a normalization factor, this normalization factor equals the square distance of this two reflective spot divided by 2.
Aforesaid pupil tracing system, wherein this coordinate conversion module is to adopt affine conversion method to carry out the coordinate conversion.
Aforesaid pupil tracing system, wherein this system also comprises a correction module, when using for the first time, should carry out following correction: 1-n check point or correction block in the pre-defined display screen of this correction module, and at least four four corners that are respectively adjacent to this display screen in these check points or the correction block; This image capture unit captures 1-n eyes image frame, and these eyes image frames are that this user watches the 1-n check point of this display screen respectively attentively or proofread and correct block the corresponding acquisition of time institute; This processing unit obtains the original coordinate of 1-n on this angle-area plane according to pupil in this 1-n eyes image frame and reflective spot seriatim; And this correction module uses the coordinate system conversion method consistent with this coordinate conversion module to make these original coordinates be mapped to the check point of this display screen or the coordinate of correction block.
Aforesaid pupil tracing system, wherein this system also comprises an image analysing computer module, in this trimming process, calculate corresponding area parameters and angle parameter with the line of reflective spot, be shown in seriatim according to this area parameters and angle parameter by this graphics process module again and obtain the original coordinate of this 1-n on this angle-area plane with the pupil in this 1-n eyes image frame.
Aforesaid pupil tracing system, wherein this correction module makes the original coordinate of this 1-n be mapped to the check point of this display screen or proofreaies and correct the coordinate of block, tries to achieve the coefficient in the coordinate system conversion formula at last.
Aforesaid pupil tracing system, wherein 1-n proofreaies and correct block and is meant array block by the i * j of this display screen five equilibrium so n=ij in this display screen.
The object of the invention to solve the technical problems also realizes in addition by the following technical solutions.A kind of bearing calibration that is used for pupil tracing according to the present invention's proposition, wherein the method includes the steps of: proofread and correct 1-n check point or correction block in module predefined one display screen, at least four four corners that are respectively adjacent to this display screen in these check points or the correction block by one; Capture 1-n eyes image frame by an image capture unit, these eyes image frames are that this user watches the 1-n check point of this display screen respectively attentively or proofread and correct block the corresponding acquisition of time institute; Obtain the original coordinate of 1-n on the angle-area plane according to pupil in this 1-n eyes image frame and reflective spot seriatim by a processing unit; And this correction module uses the coordinate system conversion method consistent with coordinate conversion module to make these original coordinates be mapped to the check point of this display screen or the coordinate of correction block.
The object of the invention to solve the technical problems also can be applied to the following technical measures to achieve further.
Aforesaid bearing calibration wherein is to calculate corresponding area parameters and angle parameter according to the pupil of this 1-n eyes image frame and the line of this two reflective spot seriatim by an image analysing computer module of this processing unit; Graphics process module by this processing unit is shown in this angle-area plane seriatim and obtains the original coordinate of this 1-n according to this area parameters and angle parameter again.
Aforesaid bearing calibration, wherein this correction module makes the original coordinate of this 1-n be mapped to the check point of this display screen or the coordinate of correction block, tries to achieve the coefficient in the coordinate system conversion formula at last.
Aforesaid bearing calibration, wherein 1-n proofreaies and correct block and is meant array block by the i * j of this display screen five equilibrium so n=ij in this display screen.
Aforesaid bearing calibration, wherein capture the step of this 1-n eyes image frame, must cooperate the 1-n check point that makes this display screen or proofread and correct block to be highlighted in regular turn and use and remind this user to watch attentively, when this user watches the check point that is highlighted attentively or proofreaies and correct block, carry out the acquisition of eyes image frame.
The object of the invention to solve the technical problems realizes in addition more by the following technical solutions.A kind of correction module that is used for pupil tracing according to the present invention's proposition, wherein this module comprises: one highlights controller, make the predefined 1-n check point of a display screen or proofread and correct block to be highlighted in regular turn and use and remind this user to watch attentively these check points or proofread and correct at least four four corners that are respectively adjacent to this display screen in the block; One capture controller highlights controller at this and makes wherein a check point or proofread and correct block when being highlighted, and an image capture unit is sent the controlling signal of pick-up image; And a counter, receiving the distribution range of an original coordinate of 1-n that obtains from a graphics process module, this distribution range is approximate rectangular, and makes these original coordinates be mapped to the coordinate of the correction block of this display screen.
The object of the invention to solve the technical problems also can be applied to the following technical measures to achieve further.
Aforesaid correction module, wherein this counter makes the original coordinate of this 1-n be mapped to the check point of this display screen or the coordinate of correction block, tries to achieve the coefficient in the coordinate system conversion formula at last.
Aforesaid correction module, wherein this 1-n correction block is meant the array block by the i * j of this display screen five equilibrium, so n=ij.
The present invention compared with prior art has tangible advantage and beneficial effect.By above technical scheme as can be known, major technique of the present invention thes contents are as follows:
Pupil tracing method of the present invention comprises an image capture step, an image analysing computer step, a graphics process step, and a coordinate switch process.Wherein, the image capture step is the eyes image frame that is captured a user by an image capture unit, comprises the image of a pupil and two reflective spots in this eyes image frame.The image analysing computer step is to calculate an area parameter and an angle parameter by an image analysing computer module according to this pupil and this two reflective spot.The graphics process step is undertaken by a graphics process module that is connected with this image analysing computer module, makes this area parameters and this angle parameter be shown in the planimetric map of one angle-area, obtains an original coordinate that is located in this angle-area plane.Last coordinate switch process is undertaken by a coordinate conversion module that is connected with this graphics process module, utilizes the coordinate system conversion method to make the original coordinate on this angle-area plane be converted to a display screen vernier coordinate.
Pupil tracing of the present invention system is converted to slider position on the display screen for the sight line with a user, and comprises an image capture unit, an image analysing computer module, a graphics process module and coordinate conversion module.Image capture unit comprises the image of a pupil and two reflective spots for this user's of acquisition eyes image frame in this eyes image frame.The image analysing computer module is connected with this image capture unit, orients this pupil and this two reflective spot certainly in this eyes image frame, and calculates an area parameter and an angle parameter according to this pupil and this two reflective spot; The graphics process module is connected with this image analysing computer module, makes this area parameters and this angle parameter be shown in the planimetric map of one angle-area, obtains an original coordinate that is located in this angle-area plane.Coordinate conversion module and this graphics process module connect, and utilize the coordinate system conversion method to make the original coordinate on this angle-area plane be converted to a display screen vernier coordinate.
The present invention is through experiment and mass data checking, when finding that the user watches the display screen difference, the distribution shape of parameter on angle-area plane that pupil and two reflective spots constitute in institute's pick-up image, coincide the most with reply point distribution shape on the display screen-for example, the display screen profile is a rectangle, and the user watches each block of display screen or periphery or four resultant distribution shapes on angle-area plane in corner also very near rectangle; Directly pupil coordinate (watch the resulting pupil coordinate of display screen periphery, often constitute trapezoidal or non-equilateral quadrilateral) is mapped to the display screen coordinate compared to known, can significantly reduces mapping error.
Pupil tracing method and system of the present invention should be proofreaied and correct earlier when using for the first time, and bearing calibration may further comprise the steps:
By 1-n check point or correction block in a correction module predefined one display screen, and at least four four corners that are respectively adjacent to this display screen in these check points or the correction block.Capture 1-n eyes image frame by an image capture unit, these eyes image frames are that this user watches the 1-n check point of this display screen respectively attentively or proofread and correct block the corresponding acquisition of time institute.Calculate corresponding area parameters and angle parameter according to the pupil in this 1-n eyes image frame with the line of reflective spot seriatim by an image analysing computer module.Seriatim the area parameters and the angle parameter of this this 1-n eyes image frame are shown in this angle-area plane by a graphics process module, obtain the original coordinate of 1-n.This correction module uses the coordinate system conversion method consistent with coordinate conversion module to make the original coordinate of this 1-n be mapped to the 1-n check point of this display screen or proofreaies and correct the coordinate of block, tries to achieve the coefficient in the coordinate system conversion formula at last.
The present invention is used for the correction module of pupil tracing, comprises that one highlights controller, a capture controller and a counter.Highlight controller and make the predefined 1-n check point of a display screen or proofread and correct block and highlighted in regular turn and use and remind this user to watch attentively, these check points or proofread and correct at least four four corners that are respectively adjacent to this display screen in the block.The capture controller highlights controller at this and makes wherein a check point or proofread and correct block when being highlighted, and an image capture unit is sent the controlling signal of pick-up image.Counter receives the distribution range of an original coordinate of 1-n that obtains from a graphics process module, this distribution range is approximate rectangular, and make these original coordinates be mapped to the coordinate of the correction block of this display screen, try to achieve the coefficient in the coordinate system conversion formula at last.
Beneficial effect of the present invention is: adopt angle parameter, the area parameters of the coordinate mapping pre-treatment of original creation-pupil is moved generation to be shown on the angle-area plane, change with the original coordinate on this angle-area plane again, the transfer process of this moment, be equivalent to two conversions between rectangle, can significantly reduce the known error that is caused by non-rectangle torque shape, therefore the accuracy that improves pupil tracing.
In sum, the present invention has obvious improvement technically, and has tangible good effect, really is a new and innovative, progressive, practical new design.
Above-mentioned explanation only is the general introduction of technical solution of the present invention, for can clearer understanding technological means of the present invention, and can be implemented according to the content of instructions, and for above-mentioned and other purposes, feature and advantage of the present invention can be become apparent, below especially exemplified by preferred embodiment, and conjunction with figs., be described in detail as follows.
Description of drawings
Fig. 1 is a system schematic, and the preferred embodiment of pupil tracing of the present invention system is described;
Fig. 2 is a system block diagrams, and the detailed formation of present embodiment is described;
Fig. 3 is a process flow diagram, and the correcting process when present embodiment uses for the first time is described;
Fig. 4 is a process flow diagram, and the flow process when present embodiment generally uses is described;
Fig. 5 is the synoptic diagram of an eyes image frame;
Fig. 6 is the synoptic diagram of the correction block that defines in the display screen;
Fig. 7 is an angle-area plane, and individual original coordinate of the 1-n that is located on it and any point are described;
Fig. 8 is the synoptic diagram of changing between two coordinate systems.
Embodiment
Reach technological means and the effect that predetermined goal of the invention is taked for further setting forth the present invention, below in conjunction with accompanying drawing and preferred embodiment, the pupil tracing method and system that foundation the present invention is proposed, and be used for the bearing calibration and the module of pupil tracing, describe in detail as after.
See also Fig. 1 and Fig. 2, pupil tracing of the present invention system 100 is converted to slider position on the display screen 10 in order to the sight line with a user, its preferred embodiment comprises processing unit 40, the coordinate conversion module 6 that an image capture unit 2, two light sources 3, include an image analysing computer module 4 and a graphics process module 5, and one proofreaies and correct module 7.Aforementioned processing unit 40, coordinate conversion module 6 and correction module 7 are at present embodiment, be to produce after being stored in the computer-readable program fetch of a memory body when host computer 1 CPU (central processing unit) that is connected with this display screen 10 (figure do not show) reads and carry out one, but not as limit, also can be in this host computer, to realize with integrated circuit or firmware mode, perhaps utilize an electronic installation that is connected with this host computer 1 (figure does not show) to read also and produce behind the executive routine, and operation result is sent to this host computer 1 with the slider position on the control display screen 10.
Please cooperate and consult Fig. 5, this two light source 3 can form two reflective spots 31,32 in user's eyes.Image capture unit 2 comprises the image of a pupil 30 and this two reflective spot 31,32 for acquisition user's eyes image frame 20 in this eyes image frame 20.In order to help image analysing computer module 4 to orient pupil 30 and reflective spot 31,32 images, can shine this user with infrared ray light projector (figure does not show) earlier, again by image capture unit 2 these eyes image frames 20 of acquisition.
Image analysing computer module 4 is connected with image capture unit 2, it comprises a steady arm 41, is that eyes image frame 20 is carried out binary conversion treatment (thresholding claims the gray scale graduation again) at present embodiment, make the part of gray scale in the image, be adjusted into black greater than default gray-scale value; Gray scale is adjusted into white less than the part of default gray-scale value in the image, the clear by this pupil 30 of finding out; Similarly, by adjusting default gray-scale value, can find out this two reflective spot 31,32.Image analysing computer module 4 also comprises an area parameter calculator 42 and an angle parameter counter 43, calculates an area parameter and an angle parameter according to this pupil 30 with this two reflective spot 31,32 respectively.
The method of area parameters counter 42 reference area parameters of the present invention has two: one is a hypothesis pupil 30 and 31,32 3 of reflective spots conllinear not, calculates 3 formed leg-of-mutton area values of line.Its two, be to further consider user's the relative image capture unit 2 of head and error correction problem under the situation that moves forward and backward; Because when the close image capture unit 2 of user's head, the distance of this two reflective spot 31,32 is bigger in the eyes image frame 20, along with user's head away from image capture unit 2, these two reflective spots, 31,32 distances diminish, mobile the causing that is to say user's head increases another parameter when calculating the triangle area of pupil 30 and reflective spot 31,32 formations, therefore this parameter should be prevented; Present embodiment is promptly considered this error correction problem, the method that the actual calculating area parameter adopts is, at pupil 30 and reflective spot 31,32 formed triangle areas divided by a normalization factor, this normalization factor equal this two reflective spot 31,32 distance square divided by 2.
The method that angle parameter counter 43 of the present invention calculates angle parameter has three, selects fixed wherein a kind of pupil tracing effect accurately that all can obtain during calculation.One, with a horizontal line L who is horizontally through pupil 30 centers, and the pupil 30 and the line of a reflective spot 31 wherein, the folded angle of two lines is this angle parameter.They are two years old, make horizontal line L and the pupil 30 and the line of a reflective spot 31 wherein, the folded angle of two lines is first angle [alpha] 1, the folded angle of this horizontal line L and pupil 30 and the line of another reflective spot 32 wherein be second angle [alpha], 2, the first angle [alpha] 1 with the mean value of this second angle [alpha] 2 be the following explanation of this angle parameter-present embodiment and graphic be to carry out with this account form.Its three, be the summit with pupil 30, pupil 30 and this two reflective spot 31,32 be the angle (being equivalent to α 2-α 1) that forms of lines respectively, is this angle parameter.
Coordinate conversion module 6 is connected with graphics process module 5, utilize the coordinate system conversion method make original coordinate on this angle-area plane (x, y) be mapped to display screen 10 the vernier coordinate (u, v).At present embodiment, coordinate conversion module 6 is to adopt affine conversion (affine transformation) method to carry out the coordinate conversion.
When using for the first time, need make the user watch earlier proofreading and correct in the module 7 predefined display screens 10 the 1-n check point or proofread and correct block to proofread and correct, obtain the correction coordinate on the angle-area plane by this.Present embodiment is to proofread and correct block with 1-18 shown in Figure 6 to illustrate, and 1-18 proofreaies and correct block and is meant 3 * 6 array block by display screen 10 five equilibriums among the n=18 just, and display screen 10.But not as limit, as long as at least four four corners that are respectively adjacent to display screen 10 in these check points or the correction block.
Consult Fig. 2, Fig. 3 and Fig. 6 simultaneously, the correcting mode when using for the first time is as follows, and the main leading correction module of proofreading and correct 7, comprises that one highlights controller 71, a capture controller 72, and a counter 73, and its effect is described below literary composition.
Step S11-highlights controller 71 and makes k proofread and correct block to be highlighted in regular turn and use and remind this user to watch attentively, wherein k=1-18.Capture controller 72 is highlighting controller 71 when making wherein one to proofread and correct block and highlighted, and image capture unit 2 is sent the controlling signal of pick-up image.
2 acquisitions of step S12-image capture unit obtain k eyes image frame 20 (Fig. 5).
Step S13-image analysing computer module 4 calculates area parameters and angle parameter according to pupil in this k eyes image frame 20 30 and reflective spot 31,32.
Step S14-graphics process module 5 is shown in angle-area plane with area parameters and angle parameter.
The abovementioned steps S11-step S14 execution of pulling over is finished up to k=n, then can obtain the original coordinate of 1-n (with reference to figure 7) on angle-area plane, and the original coordinate of this 1-n is the aforementioned corrected coordinate.
Then, in step S15, the distribution range that counter 73 receives from all original coordinates of graphics process module 5, this distribution range is approximate rectangular, and use affine transformation approach and make these original coordinates be mapped to the coordinate of the correction block of this display screen 10 as shown in Figure 8, can try to achieve the coefficient in the coordinate system conversion formula of affine transformation approach, use for the coordinate conversion module 6 of follow-up this pupil tracing system 100.
After calibrated, as long as the user watches arbitrary position on the display screen 10 attentively, this pupil tracing system 100 promptly carries out flow process as shown in Figure 4, and is described as follows:
2 acquisitions of step S21-image capture unit obtain an eyes image frame 20.Need to prove that this image capture unit 2 is continuous captures, so the eyes image frame in the described acquisition of this step road is the image frame in the sequential.
Step S22-image analysing computer module 4 calculates area parameters and angle parameter according to pupil in this eyes image frame 20 30 and reflective spot 31,32.
Step S23-graphics process module 5 is shown in angle-area plane with area parameters and angle parameter, obtains the original coordinate on the angle-area plane.
Step S24-coordinate conversion module 6 utilizes the coordinate system conversion method to make the original coordinate on this angle-area plane be mapped to display screen vernier coordinate.
Because empirical evidence is found, when the user watches the display screen difference, the distribution shape of parameter on angle-area plane that pupil and two reflective spots constitute in institute's pick-up image, for example coincide one the most with reply point distribution shape on the display screen, the display screen profile is a rectangle, and the user watches each block of display screen or periphery or four resultant distribution shapes on angle-area plane in corner also very near rectangle; Therefore the present invention is shown in angle parameter, the area parameters that pupil moves generation on the angle-area plane, change with the original coordinate on this angle-area plane again, the transfer process of this moment, be equivalent to two conversions between rectangle, can significantly reduce mapping error, therefore the accuracy that improves pupil tracing can be reached purpose of the present invention really.
The above, it only is preferred embodiment of the present invention, be not that the present invention is done any pro forma restriction, though the present invention discloses as above with preferred embodiment, yet be not in order to limit the present invention, any those skilled in the art, in not breaking away from the technical solution of the present invention scope, when the technology contents that can utilize above-mentioned announcement is made a little change or is modified to the equivalent embodiment of equivalent variations, in every case be not break away from the technical solution of the present invention content, according to technical spirit of the present invention to any simple modification that above embodiment did, equivalent variations and modification all still belong in the scope of technical solution of the present invention.
Claims (35)
1. pupil tracing method is converted to slider position on the display screen for the sight line with a user; It is characterized in that this method comprises:
One image capture step captures this user's eyes image frame by an image capture unit, comprises the image of a pupil and two reflective spots in this eyes image frame;
One treatment step obtains an original coordinate that is located in an angle-area plane by a processing unit according to this pupil and this two reflective spot; And
One coordinate switch process is undertaken by a coordinate conversion module that is connected with this processing unit, utilizes the coordinate system conversion method to make the original coordinate on this angle-area plane be converted to a display screen vernier coordinate.
2. pupil tracing method as claimed in claim 1, it is characterized in that this treatment step comprises an image analysing computer step, calculate an area parameter and an angle parameter according to this pupil and this two reflective spot by the image analysing computer module of this processing unit that is connected with this image capture unit; And a graphics process step, make this area parameters and this angle parameter be shown in this angle-area plane and obtain this original coordinate by the graphics process module of this processing unit that is connected with this image analysing computer module.
3. pupil tracing method as claimed in claim 2 is characterized in that in this image analysing computer step, with a horizontal line that passes the pupil center in this eyes image frame, and this pupil and the line of a reflective spot wherein, the folded angle of two lines is this angle parameter.
4. pupil tracing method as claimed in claim 2, it is characterized in that in this image analysing computer step, with a horizontal line that passes the pupil center in this eyes image frame, and this pupil and the line of a reflective spot wherein, the folded angle of two lines is first angle, the folded angle of this horizontal line and this pupil and the line of another reflective spot wherein is second angle, and the mean value of first angle and this second angle is this angle parameter.
5. pupil tracing method as claimed in claim 2, it holds to levy to be to be the summit with the pupil in this eyes image frame in this image analysing computer step, and this pupil and this two reflective spot be the angle of line formation respectively, is this angle parameter.
6. pupil tracing method as claimed in claim 2 is characterized in that in this image analysing computer step, and this area parameters is meant this pupil and the formed leg-of-mutton area value of this two reflective spots line.
7. pupil tracing method as claimed in claim 2, it is characterized in that in this image analysing computer step, this area parameters is meant this pupil and the formed leg-of-mutton area value of this two reflective spots line divided by a normalization factor, and this normalization factor is that the square distance by this two reflective spot calculates.
8. pupil tracing method as claimed in claim 2, it is characterized in that in this image analysing computer step, this area parameters is meant this pupil and the formed leg-of-mutton area value of this two reflective spots line divided by a normalization factor, and this normalization factor equals the square distance of this two reflective spot divided by 2.
9. as each described pupil tracing method among the claim 1-8, it is characterized in that this coordinate switch process, is to adopt affine conversion method to carry out.
10. as each described pupil tracing method among the claim 1-8, it is characterized in that when using this method for the first time, should carrying out following correction:
Proofread and correct module by one and define 1-n check point or correction block in the display screen, and at least four four corners that are respectively adjacent to this display screen in these check points or the correction block;
Capture 1-n eyes image frame by this image capture unit, these eyes image frames are that this user watches the 1-n check point of this display screen respectively attentively or proofread and correct block the corresponding acquisition of time institute;
Obtain the original coordinate of 1-n on this angle-area plane according to pupil in this 1-n eyes image frame and reflective spot seriatim by this processing unit; And
Use the coordinate system conversion method consistent to make these original coordinates be mapped to the check point of this display screen or the coordinate of correction block by this coordinate conversion module with this coordinate conversion module.
11. pupil tracing method as claimed in claim 10, it is characterized in that in the step of proofreading and correct, this processing unit is to calculate corresponding area parameters and angle parameter with the pupil in this 1-n eyes image frame with reflective spot, is shown in seriatim and obtains the original coordinate of this 1-n on this angle-area plane.
12. pupil tracing method as claimed in claim 10, it is characterized in that in the step of proofreading and correct, the coordinate that this coordinate conversion module makes these original coordinates be mapped to the check point of this display screen or proofread and correct block is tried to achieve the coefficient in the coordinate system conversion formula at last.
13. pupil tracing method as claimed in claim 10 is characterized in that 1-n in this display screen proofreaies and correct block and is meant array block by the i * j of this display screen five equilibrium so n=ij.
14. a pupil tracing system for the slider position that a user sight line is converted on the display screen, and comprises an image capture unit for this user's of acquisition eyes image frame; It is characterized in that comprising in this eyes image frame the image of a pupil and two reflective spots, and this system comprises also:
One processing unit obtains an original coordinate that is located in an angle-area plane according to this pupil and this two reflective spot; And
One coordinate conversion module is connected with this processing unit, utilizes the coordinate system conversion method to make the original coordinate on this angle-area plane be converted to a display screen vernier coordinate.
15. pupil tracing as claimed in claim 14 system, it is characterized in that this processing unit comprises an image analysing computer module that is connected with this image capture unit, it orients this pupil and this two reflective spot in this eyes image frame, and calculates an area parameter and an angle parameter according to this pupil and this two reflective spot; And a graphics process module that is connected with this image analysing computer module, make this area parameters and this angle parameter be shown in this angle-area plane and obtain this original coordinate.
16. pupil tracing as claimed in claim 15 system is characterized in that this system also comprises two light sources, forms this two reflective spot in this user's eyes.
17. pupil tracing as claimed in claim 15 system, it is characterized in that this image analysing computer module is the horizontal line that passes the pupil center in this eyes image frame with, and this pupil and the line of a reflective spot wherein, the folded angle of two lines is this angle parameter.
18. pupil tracing as claimed in claim 15 system, it is characterized in that this image analysing computer module is the horizontal line that passes the pupil center in this eyes image frame with, and this pupil and the line of a reflective spot wherein, the folded angle of two lines is first angle, the folded angle of this horizontal line and this pupil and the line of another reflective spot wherein is second angle, and the mean value of first angle and this second angle is this angle parameter.
19. pupil tracing as claimed in claim 15 system is characterized in that this image analysing computer module is is the summit with the pupil in this eyes image frame, this pupil and this two reflective spot be the angle that forms of line respectively, is this angle parameter.
20. pupil tracing as claimed in claim 15 system is characterized in that wherein, the area parameters that this image analysing computer module calculates is meant this pupil and the formed leg-of-mutton area value of this two reflective spots line.
21. pupil tracing as claimed in claim 15 system, it is characterized in that the area parameters that this image analysing computer module calculates, be meant this pupil and the formed leg-of-mutton area value of this two reflective spots line divided by a normalization factor, this normalization factor is that the square distance by this two reflective spot calculates.
22. pupil tracing as claimed in claim 15 system, it is characterized in that the area parameters that this image analysing computer module calculates, be meant this pupil and the formed leg-of-mutton area value of this two reflective spots line divided by a normalization factor, this normalization factor equals the square distance of this two reflective spot divided by 2.
23., it is characterized in that this coordinate conversion module, be to adopt affine conversion method to carry out the coordinate conversion as each described pupil tracing system among the claim 14-22.
24. as each described pupil tracing system among the claim 14-22, it is characterized in that this system also comprises one and proofreaies and correct module, when using for the first time, should carry out following correction:
This proofreaies and correct 1-n check point or correction block in the pre-defined display screen of module, and at least four four corners that are respectively adjacent to this display screen in these check points or the correction block;
This image capture unit captures 1-n eyes image frame, and these eyes image frames are that this user watches the 1-n check point of this display screen respectively attentively or proofread and correct block the corresponding acquisition of time institute;
This processing unit obtains the original coordinate of 1-n on this angle-area plane according to pupil in this 1-n eyes image frame and reflective spot seriatim; And
This correction module uses the coordinate system conversion method consistent with this coordinate conversion module to make these original coordinates be mapped to the check point of this display screen or proofreaies and correct the coordinate of block.
25. pupil tracing as claimed in claim 24 system, it is characterized in that this system also comprises an image analysing computer module, in this trimming process, calculate corresponding area parameters and angle parameter with the line of reflective spot, be shown in seriatim according to this area parameters and angle parameter by this graphics process module again and obtain the original coordinate of this 1-n on this angle-area plane with the pupil in this 1-n eyes image frame.
26. pupil tracing as claimed in claim 24 system is characterized in that this correction module makes the original coordinate of this 1-n be mapped to the check point of this display screen or proofreaies and correct the coordinate of block, tries to achieve the coefficient in the coordinate system conversion formula at last.
27. pupil tracing as claimed in claim 24 system is characterized in that 1-n in this display screen proofreaies and correct block and is meant array block by the i * j of this display screen five equilibrium so n=ij.
28. a bearing calibration that is used for pupil tracing is characterized in that the method includes the steps of:
By 1-n check point or correction block in a correction module predefined one display screen, and at least four four corners that are respectively adjacent to this display screen in these check points or the correction block;
Capture 1-n eyes image frame by an image capture unit, these eyes image frames are that this user watches the 1-n check point of this display screen respectively attentively or proofread and correct block the corresponding acquisition of time institute;
Obtain the original coordinate of 1-n on the angle-area plane according to pupil in this 1-n eyes image frame and reflective spot seriatim by a processing unit; And
This correction module uses the coordinate system conversion method consistent with coordinate conversion module to make these original coordinates be mapped to the check point of this display screen or proofreaies and correct the coordinate of block.
29. bearing calibration as claimed in claim 28 is characterized in that it being to calculate corresponding area parameters and angle parameter according to the pupil of this 1-n eyes image frame and the line of this two reflective spot seriatim by an image analysing computer module of this processing unit; Graphics process module by this processing unit is shown in this angle-area plane seriatim and obtains the original coordinate of this 1-n according to this area parameters and angle parameter again.
30. bearing calibration as claimed in claim 28 is characterized in that this correction module makes the original coordinate of this 1-n be mapped to the check point of this display screen or the coordinate of correction block, tries to achieve the coefficient in the coordinate system conversion formula at last.
31. bearing calibration as claimed in claim 28 is characterized in that 1-n in this display screen proofreaies and correct block and is meant array block by the i * j of this display screen five equilibrium so n=ij.
32. bearing calibration as claimed in claim 28, it is characterized in that capturing the step of this 1-n eyes image frame, must cooperate the 1-n check point that makes this display screen or proofread and correct block to be highlighted in regular turn and use and remind this user to watch attentively, when this user watches the check point that is highlighted attentively or proofreaies and correct block, carry out the acquisition of eyes image frame.
33. a correction module that is used for pupil tracing is characterized in that this module comprises:
One highlights controller, makes the predefined 1-n check point of a display screen or proofread and correct block to be highlighted in regular turn and use and remind this user to watch attentively these check points or proofread and correct at least four four corners that are respectively adjacent to this display screen in the block;
One capture controller highlights controller at this and makes wherein a check point or proofread and correct block when being highlighted, and an image capture unit is sent the controlling signal of pick-up image; And
One counter receives the distribution range of an original coordinate of 1-n that obtains from a graphics process module, and this distribution range is approximate rectangular, and makes these original coordinates be mapped to the coordinate of the correction block of this display screen.
34. correction module as claimed in claim 33 is characterized in that this counter makes the original coordinate of this 1-n be mapped to the check point of this display screen or the coordinate of correction block, tries to achieve the coefficient in the coordinate system conversion formula at last.
35. correction module as claimed in claim 33 is characterized in that this 1-n correction block is meant the array block by the i * j of this display screen five equilibrium, so n=ij.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2009101372119A CN101872237B (en) | 2009-04-23 | 2009-04-23 | Method and system for pupil tracing as well as correction method and module for pupil tracing |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2009101372119A CN101872237B (en) | 2009-04-23 | 2009-04-23 | Method and system for pupil tracing as well as correction method and module for pupil tracing |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN101872237A true CN101872237A (en) | 2010-10-27 |
| CN101872237B CN101872237B (en) | 2012-04-18 |
Family
ID=42997140
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2009101372119A Active CN101872237B (en) | 2009-04-23 | 2009-04-23 | Method and system for pupil tracing as well as correction method and module for pupil tracing |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101872237B (en) |
Cited By (21)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103356163A (en) * | 2013-07-08 | 2013-10-23 | 东北电力大学 | Fixation point measurement device and method based on video images and artificial neural network |
| CN103455147A (en) * | 2013-09-10 | 2013-12-18 | 惠州学院 | Cursor control method |
| CN104302226A (en) * | 2012-05-25 | 2015-01-21 | 索尼电脑娱乐公司 | Video analysis device, video analysis method, and point-of-gaze display system |
| CN104657648A (en) * | 2013-11-18 | 2015-05-27 | 广达电脑股份有限公司 | Head-mounted display device and login method thereof |
| CN105045374A (en) * | 2014-04-22 | 2015-11-11 | 联想（新加坡）私人有限公司 | Automatic gaze calibration |
| CN105378595A (en) * | 2013-06-06 | 2016-03-02 | 微软技术许可有限责任公司 | Calibrating eye tracking system by touch input |
| CN105827407A (en) * | 2014-10-15 | 2016-08-03 | 由田新技股份有限公司 | Network identity authentication method and system based on eye movement tracking |
| CN105929954A (en) * | 2016-04-19 | 2016-09-07 | 京东方科技集团股份有限公司 | Cursor control method and apparatus as well as display device |
| CN106339087A (en) * | 2016-08-29 | 2017-01-18 | 上海青研科技有限公司 | Eyeball tracking method based on multidimensional coordinate and device thereof |
| CN106371566A (en) * | 2015-07-24 | 2017-02-01 | 由田新技股份有限公司 | Correction module, method and computer readable recording medium for eye tracking |
| CN106659380A (en) * | 2014-06-12 | 2017-05-10 | Sr实验室有限公司 | Device and method of calibration for an eye tracker and eye control equipment comprising said calibration device |
| CN107122046A (en) * | 2017-04-18 | 2017-09-01 | 湘潭大学 | A kind of wearable amyotrophic lateral sclerosis servicing unit and its implementation based on eye control technology |
| CN107609516A (en) * | 2017-09-13 | 2018-01-19 | 重庆爱威视科技有限公司 | Adaptive eye moves method for tracing |
| CN109313501A (en) * | 2016-06-10 | 2019-02-05 | 大众汽车有限公司 | The method of operating device with eye-tracking unit and the eye-tracking unit for calibration operation device |
| CN109389619A (en) * | 2017-08-09 | 2019-02-26 | 宏碁股份有限公司 | Visual range mapping method and related eyeball tracking device and system |
| TWI674518B (en) * | 2018-11-28 | 2019-10-11 | 國立臺灣大學 | Calibration method of eye-tracking and device thereof |
| CN110568930A (en) * | 2019-09-10 | 2019-12-13 | Oppo广东移动通信有限公司 | Method for calibrating fixation point and related equipment |
| CN110780742A (en) * | 2019-10-31 | 2020-02-11 | Oppo广东移动通信有限公司 | Eyeball tracking processing method and related device |
| CN111291746A (en) * | 2018-12-06 | 2020-06-16 | 宏达国际电子股份有限公司 | Image processing system and image processing method |
| CN111399633A (en) * | 2019-01-03 | 2020-07-10 | 见臻科技股份有限公司 | Correction method for eyeball tracking application |
| US20200337556A1 (en) * | 2017-12-13 | 2020-10-29 | Medical Diagnostech Pty Ltd. | System and method for obtaining a pupil response profile |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US4836670A (en) * | 1987-08-19 | 1989-06-06 | Center For Innovative Technology | Eye movement detector |
| ES2605367T3 (en) * | 2006-01-26 | 2017-03-14 | Nokia Technologies Oy | Eye tracking device |
| CN1889016A (en) * | 2006-07-25 | 2007-01-03 | 周辰 | Eye-to-computer cursor automatic positioning controlling method and system |
-
2009
- 2009-04-23 CN CN2009101372119A patent/CN101872237B/en active Active
Cited By (35)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104302226B (en) * | 2012-05-25 | 2016-07-06 | 索尼电脑娱乐公司 | Video analysis equipment, video analysis method and point of fixation display system |
| CN104302226A (en) * | 2012-05-25 | 2015-01-21 | 索尼电脑娱乐公司 | Video analysis device, video analysis method, and point-of-gaze display system |
| US9727130B2 (en) | 2012-05-25 | 2017-08-08 | Sony Interactive Entertainment Inc. | Video analysis device, video analysis method, and point-of-gaze display system |
| CN105378595B (en) * | 2013-06-06 | 2018-12-07 | 微软技术许可有限责任公司 | The method for calibrating eyes tracking system by touch input |
| CN105378595A (en) * | 2013-06-06 | 2016-03-02 | 微软技术许可有限责任公司 | Calibrating eye tracking system by touch input |
| CN103356163A (en) * | 2013-07-08 | 2013-10-23 | 东北电力大学 | Fixation point measurement device and method based on video images and artificial neural network |
| CN103356163B (en) * | 2013-07-08 | 2016-03-30 | 东北电力大学 | Based on fixation point measuring device and the method thereof of video image and artificial neural network |
| CN103455147B (en) * | 2013-09-10 | 2016-08-31 | 惠州学院 | A kind of cursor control method |
| CN103455147A (en) * | 2013-09-10 | 2013-12-18 | 惠州学院 | Cursor control method |
| CN104657648A (en) * | 2013-11-18 | 2015-05-27 | 广达电脑股份有限公司 | Head-mounted display device and login method thereof |
| CN105045374A (en) * | 2014-04-22 | 2015-11-11 | 联想（新加坡）私人有限公司 | Automatic gaze calibration |
| CN106659380A (en) * | 2014-06-12 | 2017-05-10 | Sr实验室有限公司 | Device and method of calibration for an eye tracker and eye control equipment comprising said calibration device |
| CN105827407A (en) * | 2014-10-15 | 2016-08-03 | 由田新技股份有限公司 | Network identity authentication method and system based on eye movement tracking |
| CN106371566A (en) * | 2015-07-24 | 2017-02-01 | 由田新技股份有限公司 | Correction module, method and computer readable recording medium for eye tracking |
| CN105929954A (en) * | 2016-04-19 | 2016-09-07 | 京东方科技集团股份有限公司 | Cursor control method and apparatus as well as display device |
| CN105929954B (en) * | 2016-04-19 | 2019-10-18 | 京东方科技集团股份有限公司 | It is a kind of control cursor method and device, display equipment |
| CN109313501A (en) * | 2016-06-10 | 2019-02-05 | 大众汽车有限公司 | The method of operating device with eye-tracking unit and the eye-tracking unit for calibration operation device |
| CN106339087A (en) * | 2016-08-29 | 2017-01-18 | 上海青研科技有限公司 | Eyeball tracking method based on multidimensional coordinate and device thereof |
| CN106339087B (en) * | 2016-08-29 | 2019-01-29 | 上海青研科技有限公司 | A kind of eyeball tracking method and device thereof based on multidimensional coordinate |
| CN107122046A (en) * | 2017-04-18 | 2017-09-01 | 湘潭大学 | A kind of wearable amyotrophic lateral sclerosis servicing unit and its implementation based on eye control technology |
| CN109389619A (en) * | 2017-08-09 | 2019-02-26 | 宏碁股份有限公司 | Visual range mapping method and related eyeball tracking device and system |
| CN107609516A (en) * | 2017-09-13 | 2018-01-19 | 重庆爱威视科技有限公司 | Adaptive eye moves method for tracing |
| CN107609516B (en) * | 2017-09-13 | 2019-10-08 | 重庆爱威视科技有限公司 | Adaptive eye movement method for tracing |
| US20200337556A1 (en) * | 2017-12-13 | 2020-10-29 | Medical Diagnostech Pty Ltd. | System and method for obtaining a pupil response profile |
| US11690509B2 (en) * | 2017-12-13 | 2023-07-04 | Medical Diagnostech Pty Ltd. | System and method for obtaining a pupil response profile |
| TWI674518B (en) * | 2018-11-28 | 2019-10-11 | 國立臺灣大學 | Calibration method of eye-tracking and device thereof |
| US11615549B2 (en) | 2018-12-06 | 2023-03-28 | Htc Corporation | Image processing system and image processing method |
| CN111291746A (en) * | 2018-12-06 | 2020-06-16 | 宏达国际电子股份有限公司 | Image processing system and image processing method |
| CN111291746B (en) * | 2018-12-06 | 2024-01-26 | 宏达国际电子股份有限公司 | Image processing system and image processing method |
| CN111399633A (en) * | 2019-01-03 | 2020-07-10 | 见臻科技股份有限公司 | Correction method for eyeball tracking application |
| CN111399633B (en) * | 2019-01-03 | 2023-03-31 | 见臻科技股份有限公司 | Correction method for eyeball tracking application |
| CN110568930B (en) * | 2019-09-10 | 2022-05-17 | Oppo广东移动通信有限公司 | Method for calibrating fixation point and related equipment |
| CN110568930A (en) * | 2019-09-10 | 2019-12-13 | Oppo广东移动通信有限公司 | Method for calibrating fixation point and related equipment |
| CN110780742B (en) * | 2019-10-31 | 2021-11-02 | Oppo广东移动通信有限公司 | Eyeball tracking processing method and related device |
| CN110780742A (en) * | 2019-10-31 | 2020-02-11 | Oppo广东移动通信有限公司 | Eyeball tracking processing method and related device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN101872237B (en) | 2012-04-18 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101872237B (en) | Method and system for pupil tracing as well as correction method and module for pupil tracing | |
| TWI398796B (en) | Pupil tracking methods and systems, and correction methods and correction modules for pupil tracking | |
| CN107609516B (en) | Adaptive eye movement method for tracing | |
| CN105138965B (en) | A kind of near-to-eye sight tracing and its system | |
| CN102509303B (en) | Binarization image registration method based on improved structural similarity | |
| US11715231B2 (en) | Head pose estimation from local eye region | |
| CN104978012B (en) | One kind points to exchange method, apparatus and system | |
| CN102473282B (en) | External light glare assessment device, line of sight detection device and external light glare assessment method | |
| CN103530618A (en) | Non-contact sight tracking method based on corneal reflex | |
| CN103217108B (en) | A kind of spectacle frame geometric parameter detection method | |
| CN104133548A (en) | Method and device for determining viewpoint area and controlling screen luminance | |
| CN102830793A (en) | Sight tracking method and sight tracking device | |
| CN105574525A (en) | Method and device for obtaining complex scene multi-mode biology characteristic image | |
| CN101807110A (en) | Pupil positioning method and system | |
| US20230080861A1 (en) | Automatic Iris Capturing Method And Apparatus, Computer-Readable Storage Medium, And Computer Device | |
| CN203027358U (en) | Adaptive sight line tracking system | |
| US20200271447A1 (en) | Stereo Camera | |
| US10540809B2 (en) | Methods and apparatus for tracking a light source in an environment surrounding a device | |
| US11587240B2 (en) | Moving body detecting device, moving body detecting method, and moving body detecting program | |
| CN103870814A (en) | Non-contact real-time eye movement identification method based on intelligent camera | |
| US11080822B2 (en) | Method, system and recording medium for building environment map | |
| US9741171B2 (en) | Image processing device and image processing method | |
| CN104077586A (en) | Real-time trapezoidal distortion correction method and system for optical fingerprint sensor | |
| Klemm et al. | Non-parametric camera-based calibration of optical see-through glasses for AR applications | |
| US20040179715A1 (en) | Method for automatic tracking of a moving body |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |