CN107644443A - Parameter setting method and device in Eye-controlling focus equipment - Google Patents
Parameter setting method and device in Eye-controlling focus equipment Download PDFInfo
- Publication number
- CN107644443A CN107644443A CN201710784884.8A CN201710784884A CN107644443A CN 107644443 A CN107644443 A CN 107644443A CN 201710784884 A CN201710784884 A CN 201710784884A CN 107644443 A CN107644443 A CN 107644443A
- Authority
- CN
- China
- Prior art keywords
- camera
- hot spot
- center
- cornea
- eye
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Abstract
The invention discloses parameter setting method and device in a kind of Eye-controlling focus equipment.Wherein, Eye-controlling focus equipment includes first camera and second camera, and method includes：The position of default first camera is first position, using the position of the center of curvature coordinate of cornea and second camera as variable, builds optimization aim equation；The position of corresponding second camera when optimization aim equation value is maximum is determined, obtains the second place.The present invention solves the improper technical problem for leading to not complete the matching of light source hot spot of camera position of Eye-controlling focus equipment in the prior art.
Description
Technical field
The present invention relates to Eye-controlling focus apparatus field, in particular to parameter setting side in a kind of Eye-controlling focus equipment
Method and device.
Background technology
In the prior art when using Eye-controlling focus equipment, the 3D approximation ball models based on eyeball, VR equipment is according to pupil
Hole centre coordinate and corneal reflection, sight estimation is carried out to the remote equipment of blinkpunkt, when VR equipment uses polyphaser light more
During source, it is only necessary to single point correction process can estimates sight, but this method does not provide the scheme of camera position design,
In actual use, because light source is different with the relative position of camera, some position cameras capture less than image above-mentioned VR equipment,
Or the image captured is bad, and light source is usually without specificity, thus the capture of some position cameras less than image or
The image that person captures can not complete the matching of light source hot spot when bad, and then lead to not determine direction of visual lines.
Improper lead to not complete light source hot spot for the camera position of the above-mentioned equipment of Eye-controlling focus in the prior art
The problem of matching, effective solution is not yet proposed at present.
The content of the invention
It is existing at least to solve the embodiments of the invention provide parameter setting method and device in a kind of Eye-controlling focus equipment
The improper technical problem for leading to not complete the matching of light source hot spot of the camera position of Eye-controlling focus equipment in technology.
One side according to embodiments of the present invention, there is provided parameter setting method in a kind of Eye-controlling focus equipment, sight
Tracing equipment includes first camera and second camera, and method includes：The position of default first camera is first position, with cornea
The position of center of curvature coordinate and second camera is variable, builds optimization aim equation, wherein, multiple light sources pass through corneal reflection
Projection obtains hot spot in first camera and second camera afterwards, and the center of curvature coordinate of cornea changes in default experience range,
Optimization aim equation includes：Entropy the first phase corresponding with same light source that hot spot corresponding to first camera and second camera is distributed
Alternate position spike between the hot spot on hot spot and second camera on machine and center of curvature changes in coordinates with cornea and；Really
Determine the position of corresponding second camera when optimization aim equation value is maximum, obtain the second place.
Further, after obtaining the second place, method also includes：Determine all hot spots in the second phase according to the second place
Projection of shape on machine, obtain the first projection of shape；First projection of shape and default second projection of shape are subjected to alternate position spike
Different matching, obtain position difference matching result；Hot spot and light source are matched according to position difference matching result, obtain hot spot
Light source matching result.
Further, before the first projection of shape and default second projection of shape being carried out into position difference matching, method
Also include：Determine the second projection of shape；Wherein it is determined that the second projection of shape includes：The position of default second camera is the 3rd
Put；Determine pip of the multiple light sources on cornea in the plane parallel to the image plane of second camera according to the 3rd position
Projection of shape, obtain the second projection of shape.
Further, after obtaining hot spot light source matching result, method also includes：Determined according to hot spot light source matching result
The center of curvature estimated coordinates of cornea；The position of pupil center is determined by the refracting process of pupil center；According to the center of curvature
The position of estimated coordinates and pupil center determines optical axis direction；Direction of visual lines is determined according to optical axis direction.
Further, the position of multiple light sources is arranged to：Multiple light sources form an annular.
Another aspect according to embodiments of the present invention, parameter setting apparatus in a kind of Eye-controlling focus equipment is additionally provided, depending on
Line tracing equipment includes first camera and second camera, and device includes：Module is built, for presetting the position of first camera as the
One position, using the position of the center of curvature coordinate of cornea and second camera as variable, optimization aim equation is built, wherein, it is multiple
Light source projection in first camera and second camera after corneal reflection obtains hot spot, and the center of curvature coordinate of cornea is default
Change in experience range, optimization aim equation includes：Corresponding to first camera and second camera hot spot be distributed entropy with it is same
In alternate position spike and with cornea curvature between the hot spot on hot spot and second camera corresponding to light source in first camera
The sum of heart changes in coordinates；First determining module, for determine optimization aim equation value for it is maximum when corresponding second camera position
Put, obtain the second place.
Another aspect according to embodiments of the present invention, additionally provides a kind of storage medium, and storage medium includes the journey of storage
Sequence, wherein, equipment performs parameter setting method in above-mentioned Eye-controlling focus equipment where controlling storage medium when program is run.
Another aspect according to embodiments of the present invention, a kind of processor being additionally provided, processor is used for operation program, its
In, program performs parameter setting method in above-mentioned Eye-controlling focus equipment when running.
Another aspect according to embodiments of the present invention, additionally provide a kind of terminal, including Eye-controlling focus equipment, Eye-controlling focus
Equipment includes first camera and second camera, and terminal also includes：Module is built, the position for presetting first camera is first
Put, using the position of the center of curvature coordinate of cornea and second camera as variable, build optimization aim equation, wherein, multiple light sources
Projection obtains hot spot in first camera and second camera after corneal reflection, and the center of curvature coordinate of cornea is in default experience
In the range of change, optimization aim equation includes：The entropy that hot spot corresponding to first camera and second camera is distributed and same light source
Alternate position spike and with cornea the center of curvature between the hot spot on hot spot and second camera in corresponding first camera is sat
Mark the sum of change；First determining module, for determine optimization aim equation value for it is maximum when corresponding second camera position, obtain
To the second place；Processor, processor operation program, wherein, for from structure module and the first determining module when program is run
The data of output perform parameter setting method in above-mentioned Eye-controlling focus equipment.
Another aspect according to embodiments of the present invention, additionally provide a kind of terminal, including Eye-controlling focus equipment, Eye-controlling focus
Equipment includes first camera and second camera, and terminal also includes：Module is built, the position for presetting first camera is first
Put, using the position of the center of curvature coordinate of cornea and second camera as variable, build optimization aim equation, wherein, multiple light sources
Projection obtains hot spot in first camera and second camera after corneal reflection, and the center of curvature coordinate of cornea is in default experience
In the range of change, optimization aim equation includes：The entropy that hot spot corresponding to first camera and second camera is distributed and same light source
Alternate position spike and with cornea the center of curvature between the hot spot on hot spot and second camera in corresponding first camera is sat
Mark the sum of change；First determining module, for determine optimization aim equation value for it is maximum when corresponding second camera position, obtain
To the second place；Storage medium, for storage program, wherein, program from structure module and first operationally for determining mould
The data of block output perform parameter setting method in above-mentioned Eye-controlling focus equipment.
In embodiments of the present invention, for including first camera and second camera Eye-controlling focus equipment, passing through default first
The position of camera is first position, using the position of the center of curvature coordinate of cornea and second camera as variable, builds optimization aim
Equation, wherein, projection obtains hot spot, the curvature of cornea to multiple light sources in first camera and second camera after corneal reflection
Centre coordinate changes in default experience range, and optimization aim equation includes：Hot spot corresponding to first camera and second camera point
Alternate position spike between the hot spot on hot spot and second camera in the entropy of cloth first camera corresponding with same light source and with
The sum of the center of curvature changes in coordinates of cornea；The position of corresponding second camera when optimization aim equation value is maximum is determined,
The second place is obtained, has reached the purpose for the optimum position for determining second camera, it is achieved thereby that obtaining the light of specific maximum
Spot distribution is convenient for the technique effect of light source hot spot matching, and then solves the phase seat in the plane of Eye-controlling focus equipment in the prior art
Put the improper technical problem for leading to not complete the matching of light source hot spot.
Brief description of the drawings
Accompanying drawing described herein is used for providing a further understanding of the present invention, forms the part of the application, this hair
Bright schematic description and description is used to explain the present invention, does not form inappropriate limitation of the present invention.In the accompanying drawings：
Fig. 1 is the schematic diagram of parameter setting method in a kind of Eye-controlling focus equipment according to embodiments of the present invention；
Fig. 2 is the schematic diagram of parameter setting method in a kind of optional Eye-controlling focus equipment according to embodiments of the present invention；
Fig. 3 is the schematic diagram of parameter setting method in a kind of optional Eye-controlling focus equipment according to embodiments of the present invention；
Fig. 4 is the schematic diagram of parameter setting method in a kind of optional Eye-controlling focus equipment according to embodiments of the present invention；
Fig. 5 is the schematic diagram of parameter setting method in a kind of optional Eye-controlling focus equipment according to embodiments of the present invention；
Fig. 6 is the schematic diagram of parameter setting method in a kind of optional Eye-controlling focus equipment according to embodiments of the present invention；
And
Fig. 7 is the schematic diagram of parameter setting apparatus in a kind of Eye-controlling focus equipment according to embodiments of the present invention.
Embodiment
It should be noted that in the case where not conflicting, the feature in embodiment and embodiment in the application can phase
Mutually combination.Describe the present invention in detail below with reference to the accompanying drawings and in conjunction with the embodiments.
In order that those skilled in the art more fully understand the present invention program, below in conjunction with the embodiment of the present invention
Accompanying drawing, the technical scheme in the embodiment of the present invention is clearly and completely described, it is clear that described embodiment is only
The embodiment of a part of the invention, rather than whole embodiments.Based on the embodiment in the present invention, ordinary skill people
The every other embodiment that member is obtained under the premise of creative work is not made, it should all belong to the model that the present invention protects
Enclose.
It should be noted that term " first " in description and claims of this specification and above-mentioned accompanying drawing, "
Two " etc. be for distinguishing similar object, without for describing specific order or precedence.It should be appreciated that so use
Data can exchange in the appropriate case, so as to embodiments of the invention described herein can with except illustrating herein or
Order beyond those of description is implemented.In addition, term " comprising " and " having " and their any deformation, it is intended that cover
Cover it is non-exclusive include, be not necessarily limited to for example, containing the process of series of steps or unit, method, system, product or equipment
Those steps or unit clearly listed, but may include not list clearly or for these processes, method, product
Or the intrinsic other steps of equipment or unit.
Embodiment 1
According to embodiments of the present invention, there is provided the embodiment of the method for parameter setting method in a kind of Eye-controlling focus equipment, need
It is noted that can be in the computer system of such as one group computer executable instructions the flow of accompanying drawing illustrates the step of
Middle execution, although also, show logical order in flow charts, in some cases, can be with different from herein
Order performs shown or described step.
Fig. 1 is parameter setting method in Eye-controlling focus equipment according to embodiments of the present invention, and Eye-controlling focus equipment includes the
One camera and second camera, as shown in figure 1, this method comprises the following steps：
Step S102, the position for presetting first camera is first position, with the center of curvature coordinate and second camera of cornea
Position be variable, build optimization aim equation, wherein, multiple light sources are after corneal reflection in first camera and second camera
Upper projection obtains hot spot, and the center of curvature coordinate of cornea changes in default experience range, and optimization aim equation includes：First phase
On the hot spot and second camera in entropy first camera corresponding with same light source that hot spot corresponding to machine and second camera is distributed
Hot spot between alternate position spike and with cornea center of curvature changes in coordinates sum.
Optionally, the Eye-controlling focus equipment in all embodiments of the invention include but is not limited to virtual reality device, can be with
The intelligent terminal of Eye-controlling focus is carried out, for example, mobile phone, computer, wearable device etc..
Specifically, as shown in Fig. 2 Fig. 2 be eyeball, light source and camera schematic diagram, wherein, left camera or the right side in Fig. 2
Camera can be first camera, corresponding, and right camera or left camera can be second cameras, and O1 represents the position of left camera, O2
The position of right camera is represented, can assign first camera one defined location first, i.e., the position of default first camera is the
One position, make the position of first camera, it is known that optional, for convenience of calculation, first position can be origin, i.e., first
The coordinate of camera is [0,0,0], and the I1 and I2 in Fig. 2 represent the coordinate of light source 1 and light source 2 respectively, and two are only gived in Fig. 2
Light source, herein it should be noted that not limited the number of light source in the present invention, light source passes through the corneal reflection of eyeball
Afterwards, projection hot spot can be obtained in the image plane of first camera, and projection obtains hot spot in the image plane of second camera,
, can be by by hot spot shape in the camera and default known luminaire in the case that hot spot specificity is maximum in two cameras
Preset shape carries out the matching that the modes such as difference matching realize hot spot and light source, therefore, in situation known to first camera position
Under, may be selected that makes the hot spot position of the maximum position of specificity as second camera in second camera, in the present invention
When weighing specificity of the hot spot in second camera, while from hot spot distribution in the camera and hot spot in two cameras
The alternate position spike opposite sex weighed, therefore, the optimization aim equation of structure includes：Light corresponding to first camera and second camera
The alternate position spike between the hot spot on hot spot and second camera in the entropy first camera corresponding with same light source of spot distribution
With the sum of the center of curvature changes in coordinates with cornea, specifically, with reference to Fig. 2, using left camera as first camera, right camera is
In the case of second camera, optimization aim equation can be with as follows：
Wherein, H (qij)=- p (qij)·logp(qij),j∈{1,2}；
Wherein, c represents the center of curvature coordinate of cornea, and C represents c default experience range, and i represents the label of light source, N
It is the total number of light source, i=1,2 ..., N, λ represent empirical coefficient, and j represents camera label, represent first camera, j=during j=1
Second camera, q are represented when 2ijExpression is directed to j-th of camera, pip of the light source on cornea marked as i,Represent j-th
The center of hot spot in camera, that is, mean place.
Step S104, the position of corresponding second camera when optimization aim equation value is maximum is determined, obtains the second place.
Specifically, the entropy that hot spot is distributed in two cameras is bigger, that is to say, that Mingguang City's spot is distributed more uneven, two cameras
In hot spot alternate position spike it is bigger, that is, the alternate position spike opposite sex is bigger, therefore, in order to meet that hot spot is special in second camera
Property, hot spot is distributed in two cameras entropy maximum and make the alternate position spike of two magazine hot spots maximum can be made, specifically,
In optimization aim equation given above, when the center of curvature c of cornea is changed in experience range, that is, different
Under the center of curvature c of cornea locality condition, by searching for all possible second camera position O2, optimization aim can be obtained
The position of corresponding second camera when the value of equation is maximum, i.e., when the target function value maximum in formula (1), now
The position of second camera be the second place.
In embodiments of the present invention, for including first camera and second camera Eye-controlling focus equipment, passing through default first
The position of camera is first position, using the position of the center of curvature coordinate of cornea and second camera as variable, builds optimization aim
Equation, wherein, projection obtains hot spot, the curvature of cornea to multiple light sources in first camera and second camera after corneal reflection
Centre coordinate changes in default experience range, and optimization aim equation includes：Hot spot corresponding to first camera and second camera point
Alternate position spike between the hot spot on hot spot and second camera in the entropy of cloth first camera corresponding with same light source and with
The sum of the center of curvature changes in coordinates of cornea；The position of corresponding second camera when optimization aim equation value is maximum is determined,
The second place is obtained, has reached the purpose for the optimum position for determining second camera, it is achieved thereby that obtaining the light of specific maximum
Spot distribution is convenient for the technique effect of light source hot spot matching, and then solves the phase seat in the plane of Eye-controlling focus equipment in the prior art
Put the improper technical problem for leading to not complete the matching of light source hot spot.
In a kind of optional embodiment, after obtaining the second place in step S104, method also includes：
Step S202, projection of shape of all hot spots in second camera is determined according to the second place, obtains the first projection
Shape；
Step S204, the first projection of shape and default second projection of shape are subjected to position difference matching, obtain position
Difference matching result；
Step S206, hot spot and light source are matched according to position difference matching result, obtain hot spot light source matching knot
Fruit.
Specifically, after the second place of second camera is determined, it may be determined that the projection of all hot spots in second camera
Shape, i.e. the first projection of shape, default second projection of shape are projection shape of all hot spots of pre-estimation in second camera
Shape, and hot spot in the second projection of shape or other represent that the point of cursors and the matching relationship of light source are known, pass through
First projection of shape and the second projection of shape are subjected to position difference matching, first can be matched according to position difference matching result
Light source corresponding to hot spot in projection of shape, finally give hot spot light source matching result.
In a kind of optional embodiment, the first projection of shape and default second projection of shape are carried out in step S204
Before position difference matching, method also includes：
Step S302, determine the second projection of shape；Wherein, determine that the second projection of shape includes in step S302：
Step S402, the position for presetting second camera is the 3rd position；
Step S404, determine pip of the multiple light sources on cornea in the picture parallel to second camera according to the 3rd position
Projection of shape in the plane of plane, obtain the second projection of shape.
Specifically, before position difference matching is carried out to the first projection of shape and the second projection of shape, can lead to first
Above-mentioned steps S402 to S404 is crossed to determine the second projection of shape, can specifically give the position of first camera and second camera,
After the position of two cameras determines, you can to obtain pip of the light source based on two cameras on cornea in the picture with camera
Projection of shape in the parallel plane of plane, i.e. the second projection of shape, the point of the projection of pip is represented in the second projection of shape
What corresponding light source was to determine, by the way that the first projection of shape and the second projection of shape are carried out into position difference matching, can match
The subpoint of pip on to the second projection of shape corresponding with the subpoint of the hot spot in the first projection of shape, due to pip
Subpoint corresponding to light source be known, thus may determine that light source corresponding to the subpoint of hot spot, so as to obtain hot spot light
Source matching result.
Specifically, the coordinate of pip can be obtained by equation below：
||qij- c | |=R；
(li-oj)×(qij-oj)·(c-oj)=0；
(li-qij)·(qij-c)·||oj-qij| |=(oj-qij)·(qij-c)·||li-qij||； (2)
Wherein, R represents the radius of curvature of cornea, and Ii represents the coordinate of the light source marked as i, and Oj represents the phase marked as j
The coordinate of machine.
Specifically, determining the position of corresponding second camera when optimization aim equation value is maximum in step S104, obtain
, can be with it is determined that under conditions of center of curvature c, the position O1 of first camera and second camera position O2 during to the second place
Corresponding q is obtained by above-mentioned formula (2)ij, then substitute into above-mentioned formula (1), you can in the hope of all second camera positions
The value of corresponding optimization aim equation, the O2 when optimization aim equation is maximum are exactly the position of final second camera.
In a kind of specific embodiment, in the case where multiple light sources is form annular light source, if at the beginning of annular light source
Beginning position coordinates I0=[- 7.8180,3.4020,44.3486], c=(0.4,0,8), R 8, it is assumed that the left camera in Fig. 2 is sat
It is designated as [0,0,0], right camera coordinates are [- 16.0348,0.0347,0.2610], and when the number of light source is 180, light source is at angle
Projecting figure that pip on film is formed in the plane parallel with the image plane of left camera as shown in figure 3, light source in cornea
On the projecting figure that is formed in the plane parallel with the image plane of right camera of pip as shown in figure 4, the number of light source is 8
When individual, projecting figure such as Fig. 5 institutes that pip of the light source on cornea is formed in the plane parallel with the image plane of left camera
Show, the projecting figure that pip of the light source on cornea is formed in the plane parallel with the image plane of right camera is as shown in Figure 6
In a kind of optional embodiment, after hot spot light source matching result is obtained in step S206, method also includes：
Step S502, the center of curvature estimated coordinates of cornea are determined according to hot spot light source matching result；
Step S504, the position of pupil center is determined by the refracting process of pupil center；
Step S506, optical axis direction is determined according to the position of center of curvature estimated coordinates and pupil center；
Step S508, direction of visual lines is determined according to optical axis direction.
Specifically, after obtaining hot spot light source matching result, can be by reversely verifying the center of curvature coordinate c in different corneas
Under conditions of hot spot distribution situation, be compared with the distribution situation of hot spot of the second camera under the second place, select phase
The center of curvature estimated coordinates of the center of curvature coordinate of cornea, i.e. cornea like corresponding to the distribution situation of property highest hot spot, it
Pupil center location p is obtained by the refracting process of pupil center again afterwards, so as to obtain cp directions, that is, preliminary optical axis side
To, then the correction by the kappa angles to optical axis direction, so that it may obtain direction of visual lines.
In a kind of optional embodiment, the position of multiple light sources is arranged to：Multiple light sources form an annular.
Specifically, the matching of the first projection of shape and the second projection of shape, multiple light sources may be constructed one for convenience
The figure of individual closure, it is preferably annular.
Embodiment 2
According to embodiments of the present invention, there is provided the product embodiments of parameter setting apparatus, Fig. 7 in a kind of Eye-controlling focus equipment
It is parameter setting apparatus in Eye-controlling focus equipment according to embodiments of the present invention, Eye-controlling focus equipment includes first camera and second
Camera, as shown in fig. 7, the device includes structure module and the first determining module, wherein, module is built, for presetting the first phase
The position of machine is first position, using the position of the center of curvature coordinate of cornea and second camera as variable, builds optimization aim side
Journey, wherein, multiple light sources project in first camera and second camera after corneal reflection and obtain hot spot, in the curvature of cornea
Heart coordinate changes in default experience range, and optimization aim equation includes：Hot spot corresponding to first camera and second camera is distributed
Entropy first camera corresponding with same light source on hot spot and second camera on hot spot between it is alternate position spike and with
The sum of the center of curvature changes in coordinates of cornea；First determining module, for determine optimization aim equation value for it is maximum when it is corresponding
The position of second camera, obtains the second place.
In embodiments of the present invention, for including first camera and second camera Eye-controlling focus equipment, by building module
The position of default first camera is first position, using the position of the center of curvature coordinate of cornea and second camera as variable, structure
Optimization aim equation, wherein, projection obtains hot spot, angle to multiple light sources in first camera and second camera after corneal reflection
The center of curvature coordinate of film changes in default experience range, and optimization aim equation includes：First camera and second camera are corresponding
Hot spot distribution entropy first camera corresponding with same light source on hot spot and second camera on hot spot between position
The sum of difference and with cornea center of curvature changes in coordinates；First determining module determine optimization aim equation value for it is maximum when pair
The position for the second camera answered, obtains the second place, has reached the purpose for the optimum position for determining second camera, it is achieved thereby that
The hot spot distribution for obtaining specific maximum is convenient for the technique effect of light source hot spot matching, and then solves and regard in the prior art
The improper technical problem for leading to not complete the matching of light source hot spot of the camera position of line tracing equipment.
Herein it should be noted that above-mentioned structure module and the first determining module and calculating mould correspond in embodiment 1
Step S102 to step S104, above-mentioned module is identical with example and application scenarios that corresponding step is realized, but is not limited to
State the disclosure of that of embodiment 1.It should be noted that above-mentioned module can be in such as one group of calculating as a part of of device
Performed in the computer system of machine executable instruction.
In a kind of optional embodiment, device also includes the second determining module, the first matching module and the second matching mould
Block, wherein, the second determining module, after obtaining the second place in the first determining module, determined according to the second place all
Projection of shape of the hot spot in second camera, obtains the first projection of shape；First matching module, for by the first projection of shape with
Default second projection of shape carries out position difference matching, obtains position difference matching result；Second matching module, for basis
Position difference matching result matches to hot spot and light source, obtains hot spot light source matching result.
Herein it should be noted that above-mentioned second determining module, the first matching module and the second matching module correspond in fact
The step S202 to step S206 in example 1 is applied, above-mentioned module is identical with example and application scenarios that corresponding step is realized, but
It is not limited to the disclosure of that of above-described embodiment 1.It should be noted that above-mentioned module can be such as a part of of device
Performed in the computer system of one group of computer executable instructions.
In a kind of optional embodiment, device also includes the 3rd determining module, is thrown for the first matching module by first
Before shadow shape carries out position difference matching with default second projection of shape, the second projection of shape is determined；Wherein, the 3rd determine
Module includes presetting module and the 4th determining module, wherein, presetting module, the position for presetting second camera is the 3rd
Put；4th determining module, for determining pip of the multiple light sources on cornea parallel to second camera according to the 3rd position
Image plane plane on projection of shape, obtain the second projection of shape.
Herein it should be noted that above-mentioned 3rd determining module, presetting module and the 4th determining module correspond to embodiment 1
In step S302 and step S402 to step S404, above-mentioned the module example realized with corresponding step and application scenarios phase
Together, but it is not limited to the disclosure of that of above-described embodiment 1.It should be noted that above-mentioned module can be with as a part for device
Performed in the computer system of such as one group computer executable instructions.
In a kind of optional embodiment, device also includes the 5th determining module, the 6th determining module, the 7th determining module
With the 8th determining module, wherein, the 5th determining module, after obtaining hot spot light source matching result in the second matching module,
The center of curvature estimated coordinates of cornea are determined according to hot spot light source matching result；6th determining module, for passing through pupil center
Refracting process determine the position of pupil center；7th determining module, for according to center of curvature estimated coordinates and pupil center
Position determine optical axis direction；8th determining module, for determining direction of visual lines according to optical axis direction.
Herein it should be noted that above-mentioned 5th determining module, the 6th determining module, the 7th determining module and the 8th determine
The step S502 that module corresponds in embodiment 1 is to step S508, above-mentioned the module example realized with corresponding step and answers
It is identical with scene, but it is not limited to the disclosure of that of above-described embodiment 1.It should be noted that above-mentioned module as device one
Part can perform in the computer system of such as one group computer executable instructions.
In a kind of optional embodiment, the position of multiple light sources is arranged to：Multiple light sources form an annular.
Embodiment 3
According to embodiments of the present invention, there is provided a kind of product embodiments of storage medium, the storage medium include storage
Program, wherein, equipment performs parameter setting method in above-mentioned Eye-controlling focus equipment where controlling storage medium when program is run.
Embodiment 4
According to embodiments of the present invention, there is provided a kind of product embodiments of processor, the processor are used for operation program, its
In, program performs parameter setting method in above-mentioned Eye-controlling focus equipment when running.
Embodiment 5
According to embodiments of the present invention, there is provided a kind of product embodiments of terminal, the terminal include Eye-controlling focus equipment, depending on
Line tracing equipment includes first camera and second camera, and terminal also includes structure module, the first determining module and processor, its
In, module is built, the position for presetting first camera is first position, with the center of curvature coordinate of cornea and second camera
Position is variable, builds optimization aim equation, wherein, multiple light sources are after corneal reflection in first camera and second camera
Projection obtains hot spot, and the center of curvature coordinate of cornea changes in default experience range, and optimization aim equation includes：First camera
With second camera corresponding to hot spot distribution entropy first camera corresponding with same light source on hot spot and second camera on
The sum of alternate position spike and with cornea center of curvature changes in coordinates between hot spot；First determining module, for determining to optimize
The position of corresponding second camera, obtains the second place when target equation value is maximum；Processor, processor operation program, its
In, for performing parameter in above-mentioned Eye-controlling focus equipment from the data of structure module and the output of the first determining module when program is run
Establishing method.
Embodiment 6
According to embodiments of the present invention, there is provided a kind of product embodiments of terminal, the terminal include Eye-controlling focus equipment, depending on
Line tracing equipment includes first camera and second camera, and terminal also includes structure module, the first determining module and storage medium, its
In, module is built, the position for presetting first camera is first position, with the center of curvature coordinate of cornea and second camera
Position is variable, builds optimization aim equation, wherein, multiple light sources are after corneal reflection in first camera and second camera
Projection obtains hot spot, and the center of curvature coordinate of cornea changes in default experience range, and optimization aim equation includes：First camera
With second camera corresponding to hot spot distribution entropy first camera corresponding with same light source on hot spot and second camera on
The sum of alternate position spike and with cornea center of curvature changes in coordinates between hot spot；First determining module, for determining to optimize
The position of corresponding second camera, obtains the second place when target equation value is maximum；Storage medium, for storage program, its
In, program is operationally joined for being performed from the data of structure module and the output of the first determining module in above-mentioned Eye-controlling focus equipment
Number establishing method.
The embodiments of the present invention are for illustration only, do not represent the quality of embodiment.
In the above embodiment of the present invention, the description to each embodiment all emphasizes particularly on different fields, and does not have in some embodiment
The part of detailed description, it may refer to the associated description of other embodiment.
In several embodiments provided herein, it should be understood that disclosed technology contents, others can be passed through
Mode is realized.Wherein, device embodiment described above is only schematical, such as the division of the unit, Ke Yiwei
A kind of division of logic function, can there is an other dividing mode when actually realizing, for example, multiple units or component can combine or
Person is desirably integrated into another system, or some features can be ignored, or does not perform.Another, shown or discussed is mutual
Between coupling or direct-coupling or communication connection can be INDIRECT COUPLING or communication link by some interfaces, unit or module
Connect, can be electrical or other forms.
The unit illustrated as separating component can be or may not be physically separate, show as unit
The part shown can be or may not be physical location, you can with positioned at a place, or can also be distributed to multiple
On unit.Some or all of unit therein can be selected to realize the purpose of this embodiment scheme according to the actual needs.
In addition, each functional unit in each embodiment of the present invention can be integrated in a processing unit, can also
That unit is individually physically present, can also two or more units it is integrated in a unit.Above-mentioned integrated list
Member can both be realized in the form of hardware, can also be realized in the form of SFU software functional unit.
If the integrated unit is realized in the form of SFU software functional unit and is used as independent production marketing or use
When, it can be stored in a computer read/write memory medium.Based on such understanding, technical scheme is substantially
The part to be contributed in other words to prior art or all or part of the technical scheme can be in the form of software products
Embody, the computer software product is stored in a storage medium, including some instructions are causing a computer
Equipment (can be personal computer, server or network equipment etc.) perform each embodiment methods described of the present invention whole or
Part steps.And foregoing storage medium includes：USB flash disk, read-only storage (ROM, Read-Only Memory), arbitrary access are deposited
Reservoir (RAM, Random Access Memory), mobile hard disk, magnetic disc or CD etc. are various can be with store program codes
Medium.
Described above is only the preferred embodiment of the present invention, it is noted that for the ordinary skill people of the art
For member, under the premise without departing from the principles of the invention, some improvements and modifications can also be made, these improvements and modifications also should
It is considered as protection scope of the present invention.
Claims (10)
1. parameter setting method in a kind of Eye-controlling focus equipment, it is characterised in that the Eye-controlling focus equipment includes first camera
And second camera, methods described include：
The position for presetting the first camera is first position, with the center of curvature coordinate of cornea and the position of the second camera
For variable, optimization aim equation is built, wherein, multiple light sources are after the corneal reflection in the first camera and described the
Two camera upslide shadows obtain hot spot, and the center of curvature coordinate of the cornea changes in default experience range, the optimization aim
Equation includes：The entropy of the hot spot distribution is corresponding with the same light source corresponding to the first camera and the second camera
The first camera on the hot spot and the second camera on the hot spot between it is alternate position spike and with described
The sum of the center of curvature changes in coordinates of cornea；
The position of the corresponding second camera when optimization aim equation value is maximum is determined, obtains the second place.
2. according to the method for claim 1, it is characterised in that after obtaining the second place, methods described also includes：
Projection of shape of all hot spots in the second camera is determined according to the second place, obtains the first projection shape
Shape；
First projection of shape and default second projection of shape are subjected to position difference matching, obtain position difference matching knot
Fruit；
The hot spot and the light source are matched according to the position difference matching result, obtain hot spot light source matching knot
Fruit.
3. according to the method for claim 2, it is characterised in that by first projection of shape and the default second projection shape
Before shape carries out position difference matching, methods described also includes：
Determine second projection of shape；Wherein it is determined that second projection of shape includes：
The position for presetting the second camera is the 3rd position；
Determine pip of multiple light sources on the cornea parallel to the second camera according to the 3rd position
Image plane plane on projection of shape, obtain second projection of shape.
4. according to the method in claim 2 or 3, it is characterised in that after obtaining hot spot light source matching result, methods described
Also include：
The center of curvature estimated coordinates of the cornea are determined according to the hot spot light source matching result；
The position of the pupil center is determined by the refracting process of pupil center；
Optical axis direction is determined according to the position of the center of curvature estimated coordinates and the pupil center；
Direction of visual lines is determined according to the optical axis direction.
5. according to the method described in any one in claim 1-3, it is characterised in that the position of the multiple light source is set
For：The multiple light source forms an annular.
6. parameter setting apparatus in a kind of Eye-controlling focus equipment, it is characterised in that the Eye-controlling focus equipment includes first camera
And second camera, described device include：
Module is built, the position for presetting the first camera is first position, with the center of curvature coordinate of cornea and described
The position of second camera is variable, builds optimization aim equation, wherein, multiple light sources are after the corneal reflection described the
Projection obtains hot spot on one camera and the second camera, and the center of curvature coordinate of the cornea becomes in default experience range
Change, the optimization aim equation includes：The entropy of hot spot distribution corresponding to the first camera and the second camera with it is same
The position between the hot spot on the hot spot and the second camera corresponding to one light source in the first camera
Put the sum of difference and with the cornea center of curvature changes in coordinates；
First determining module, for determine the optimization aim equation value for it is maximum when the corresponding second camera position,
Obtain the second place.
A kind of 7. storage medium, it is characterised in that the storage medium includes the program of storage, wherein, run in described program
When control the storage medium where parameter in Eye-controlling focus equipment in equipment perform claim requirement 1 to 5 described in any one
Establishing method.
A kind of 8. processor, it is characterised in that the processor is used for operation program, wherein, right of execution when described program is run
Profit requires parameter setting method in Eye-controlling focus equipment in 1 to 5 described in any one.
9. a kind of terminal, it is characterised in that including Eye-controlling focus equipment, the Eye-controlling focus equipment includes first camera and second
Camera, the terminal also include：
Module is built, the position for presetting the first camera is first position, with the center of curvature coordinate of cornea and described
The position of second camera is variable, builds optimization aim equation, wherein, multiple light sources are after the corneal reflection described the
Projection obtains hot spot on one camera and the second camera, and the center of curvature coordinate of the cornea becomes in default experience range
Change, the optimization aim equation includes：The entropy of hot spot distribution corresponding to the first camera and the second camera with it is same
The position between the hot spot on the hot spot and the second camera corresponding to one light source in the first camera
Put the sum of difference and with the cornea center of curvature changes in coordinates；
First determining module, for determine the optimization aim equation value for it is maximum when the corresponding second camera position,
Obtain the second place；
Processor, the processor operation program, wherein, for building module and described first from described when described program is run
Parameter setting method in Eye-controlling focus equipment in the data perform claim requirement 1 to 5 of determining module output described in any one.
10. a kind of terminal, it is characterised in that including Eye-controlling focus equipment, the Eye-controlling focus equipment includes first camera and the
Two cameras, the terminal also include：
Module is built, the position for presetting the first camera is first position, with the center of curvature coordinate of cornea and described
The position of second camera is variable, builds optimization aim equation, wherein, multiple light sources are after the corneal reflection described the
Projection obtains hot spot on one camera and the second camera, and the center of curvature coordinate of the cornea becomes in default experience range
Change, the optimization aim equation includes：The entropy of hot spot distribution corresponding to the first camera and the second camera with it is same
The position between the hot spot on the hot spot and the second camera corresponding to one light source in the first camera
Put the sum of difference and with the cornea center of curvature changes in coordinates；
First determining module, for determine the optimization aim equation value for it is maximum when the corresponding second camera position,
Obtain the second place；
Storage medium, for storage program, wherein, described program is operationally for from the structure module and described first true
Parameter setting method in Eye-controlling focus equipment in the data perform claim requirement 1 to 5 of cover half block output described in any one.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710784884.8A CN107644443B (en) | 2017-09-01 | 2017-09-01 | Parameter setting method and device in sight tracking equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710784884.8A CN107644443B (en) | 2017-09-01 | 2017-09-01 | Parameter setting method and device in sight tracking equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107644443A true CN107644443A (en) | 2018-01-30 |
| CN107644443B CN107644443B (en) | 2020-07-28 |
Family
ID=61110251
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710784884.8A Active CN107644443B (en) | 2017-09-01 | 2017-09-01 | Parameter setting method and device in sight tracking equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107644443B (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7657079B2 (en) * | 2002-06-28 | 2010-02-02 | Intel Corporation | Single constraint at a time (SCAAT) tracking of a virtual reality (VR) display |
| CN104089606A (en) * | 2014-06-30 | 2014-10-08 | 天津大学 | Free space eye tracking measurement method |
| CN104834381A (en) * | 2015-05-15 | 2015-08-12 | 中国科学院深圳先进技术研究院 | Wearable device for sight focus positioning and sight focus positioning method |
| CN105934902A (en) * | 2013-11-27 | 2016-09-07 | 奇跃公司 | Virtual and augmented reality systems and methods |
| CN106780617A (en) * | 2016-11-24 | 2017-05-31 | 北京小鸟看看科技有限公司 | A kind of virtual reality system and its localization method |
-
2017
- 2017-09-01 CN CN201710784884.8A patent/CN107644443B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7657079B2 (en) * | 2002-06-28 | 2010-02-02 | Intel Corporation | Single constraint at a time (SCAAT) tracking of a virtual reality (VR) display |
| CN105934902A (en) * | 2013-11-27 | 2016-09-07 | 奇跃公司 | Virtual and augmented reality systems and methods |
| CN104089606A (en) * | 2014-06-30 | 2014-10-08 | 天津大学 | Free space eye tracking measurement method |
| CN104834381A (en) * | 2015-05-15 | 2015-08-12 | 中国科学院深圳先进技术研究院 | Wearable device for sight focus positioning and sight focus positioning method |
| CN106780617A (en) * | 2016-11-24 | 2017-05-31 | 北京小鸟看看科技有限公司 | A kind of virtual reality system and its localization method |
Non-Patent Citations (2)
| Title |
|---|
| P.RENAUD，AND ETC: "Extracting perceptual and motor invariants using eye-tracking technologies in virtual immersions", 《HAPTIC,AUDIO AND VIRTUAL ENVIRONMENTS AND THEIR APPLICATIONS,IEEE INTERNATIONAL WORKSHOP ON》 * |
| 张闯等: "视线追踪系统中眼睛跟踪方法研究", 《自动化学报》 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107644443B (en) | 2020-07-28 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11398084B2 (en) | Method, apparatus and application system for extracting a target feature | |
| US9396560B2 (en) | Image-based color palette generation | |
| US9552656B2 (en) | Image-based color palette generation | |
| JP2020061137A (en) | Transition between binocular and monocular views | |
| US20150109339A1 (en) | Method and apparatus for implementing augmented reality | |
| WO2019128677A1 (en) | Method and apparatus for determining gazing point based on eye movement analysis device | |
| CN108898171B (en) | Image recognition processing method, system and computer readable storage medium | |
| CN105678686A (en) | Picture processing method and device | |
| CN110378914A (en) | Rendering method and device, system, display equipment based on blinkpunkt information | |
| TWI691937B (en) | Method and device for filtering light spot, computer readable storage medium, processor, gaze tracking equipment | |
| CN108463823A (en) | A kind of method for reconstructing, device and the terminal of user's Hair model | |
| US20190130536A1 (en) | Image blurring methods and apparatuses, storage media, and electronic devices | |
| US20220172331A1 (en) | Image inpainting with geometric and photometric transformations | |
| CN103034330A (en) | Eye interaction method and system for video conference | |
| CN108230434B (en) | Image texture processing method and device, storage medium and electronic device | |
| CN108305280A (en) | A kind of solid matching method and system of the binocular image based on minimum spanning tree | |
| WO2019161699A1 (en) | Method and apparatus for optimizing lens of virtual reality device, and computer readable storage medium | |
| CN110099220A (en) | A kind of panorama mosaic method and device | |
| CN110276717A (en) | A kind of joining method and terminal of image | |
| CN107767421A (en) | Hot spot light source matching process and device in Eye-controlling focus equipment | |
| CN108510542A (en) | The method and apparatus for matching light source and hot spot | |
| CN107145217A (en) | Intelligent interactive system and intelligent interactive method | |
| CN107644443A (en) | Parameter setting method and device in Eye-controlling focus equipment | |
| CN107292822A (en) | The joining method and device of a kind of image | |
| CN110059621A (en) | Control method, device and the equipment of handle photosphere color |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |