CN107004132A - Eye tracking device and its auxiliary light source control method and relevant apparatus - Google Patents
Eye tracking device and its auxiliary light source control method and relevant apparatus Download PDFInfo
- Publication number
- CN107004132A CN107004132A CN201580065956.2A CN201580065956A CN107004132A CN 107004132 A CN107004132 A CN 107004132A CN 201580065956 A CN201580065956 A CN 201580065956A CN 107004132 A CN107004132 A CN 107004132A
- Authority
- CN
- China
- Prior art keywords
- infrared
- light source
- preset time
- time period
- period
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/10—Image acquisition
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- Eye Examination Apparatus (AREA)
Abstract
A kind of eye tracking device (100), including processor (110), infrared camera (130) and secondary light source (150)；The processor (110) is electrically connected with the infrared camera (130) and secondary light source (150)；The infrared camera (130) is used to export frame synchronizing signal；The processor (110) is used to receive the frame synchronizing signal；The secondary light source (150) is controlled persistently to export infrared fill-in light in preset time period according to the frame synchronizing signal；The infrared camera (130) is controlled to be exposed in the preset time period；The duration of the preset time period is less than the frame period, and the frame period is the cycle period of the frame synchronizing signal.Secondary light source (150) control method, control device (300) and a kind of non-volatile computer readable storage medium storing program for executing for storing one or more programs of a kind of eye tracking device (100).The eye tracking device (100) has relatively low power consumption, and can effectively lift the image quality of eyeball image.
Description
The present invention relates to field of human-computer interaction, more particularly to a kind of eye tracking device and its non-volatile computer readable storage medium storing program for executing of auxiliary light source control method, control device and a kind of one or more programs of storage.
With the development of human-computer interaction technology, in the intelligent terminals such as smart mobile phone, tablet personal computer, have been realized in carrying out such as page turning of control e-book, webpage roll screen shirtsleeve operation by eye tracking.At present, eye tracking technology is mainly reflected in three aspects：One is tracked according to the changing features of eyeball and eyeball periphery；Two are tracked according to iris angle change；Three be actively to project the light beams such as infrared ray to iris to extract feature.Wherein, actively project the light beams such as infrared ray to iris has preferable accuracy to extract the eye tracking technology of feature, and relatively broad application is had been obtained in the field of human-computer interaction based on eye tracking.But, in existing infrared projection formula Eye-tracking devices, as opening of the infrarede emitting diode (Light Emitting Diode, LED) of secondary light source when opening eye tracking function all the time in transmitting infrared light, it can undoubtedly increase the power consumption of whole equipment.Meanwhile, in the intelligent terminals such as smart mobile phone, the tablet personal computer that ultrathin develops, because the heat that infrared LED is opened for a long time and produces can not shed in time, so as to cause terminal heating serious, influence the Consumer's Experience of product.In addition, because infrared LED is in opening all the time, so that infrared camera can capture infrared light within the whole frame period, time for exposure is longer, if terminal or eyeball jolt under environment because being in, it can then cause the infrared camera to capture eyeball image and there is the defects such as smear, and then influence the precision of eye tracking.
The content of the invention
Technical problem to be solved of the embodiment of the present invention is, the non-volatile computer readable storage medium storing program for executing of a kind of eye tracking device and its auxiliary light source control method, control device and a kind of one or more programs of storage is provided, to solve to cause the problem of eyeball image has smear of generating heat seriously and because jolting cause because secondary light source is opened for a long time in the prior art, so as to reduce the power consumption of eye tracking device, the image quality and eye tracking precision of eyeball image are lifted.
There is provided a kind of eye tracking device, including processor, infrared camera and secondary light source for first aspect；
The processor is electrically connected with the infrared camera and secondary light source；
The infrared camera is used to export frame synchronizing signal；
The processor is used to receive the frame synchronizing signal；The secondary light source is controlled persistently to export infrared fill-in light in preset time period according to frame synchronizing signal；The infrared camera is controlled to be exposed in the preset time period；
The duration of the preset time period is less than the frame period, and the frame period is the cycle period of the frame synchronizing signal.
With reference to first aspect, in the first possible implementation, the infrared camera includes infrared image sensor, the infrared image sensor includes multiple pixel columns, the multiple pixel column includes the multiple valid pixel rows being disposed adjacent successively, the initial time of the preset time period is no earlier than the exposure scan initial time of last valid pixel row of the infrared image sensor, and the end time of the preset time period is not later than the end time of current frame period.
With reference to first aspect, in second of possible implementation, the secondary light source includes driver and infrared LED, the infrared LED is electrically connected by the driver and the processor, the processor is additionally operable to obtain the mass parameter for the eyeball image that the infrared camera is collected, and contrasted the mass parameter with preset quality parameter, and then according to comparing result generation driving configuration parameter, and control the driver to adjust driving current according to the driving configuration parameter, and then drive the infrared LED to adjust infrared luminous intensity, to lift the quality of next frame eyeball image.
With reference to first aspect, in the third possible implementation, the processor is additionally operable to obtain the mass parameter for the eyeball image that the infrared camera is collected, and contrasted the mass parameter with preset quality parameter, and then fluorescent lifetime configuration parameter is generated according to comparing result, and the duration of the preset time period is adjusted according to the fluorescent lifetime configuration parameter, and then control the fluorescent lifetime of the infrared fill-in light of the secondary light source adjustment, and the infrared camera synchronous adjustment time for exposure is controlled, to lift the quality of next frame eyeball image.
Second aspect there is provided a kind of auxiliary light source control method of eye tracking device, including：
Secondary light source is controlled persistently to export infrared fill-in light in preset time period according to frame synchronizing signal；
Control infrared camera exposes in the preset time period；
Wherein, the duration of the preset time period is less than the frame period, and the frame period is the frame synchronizing signal
Cycle period.
With reference to second aspect, in the first possible implementation, the infrared camera includes infrared image sensor, the infrared image sensor includes multiple pixel columns, the multiple pixel column includes the multiple valid pixel rows being disposed adjacent successively, the initial time of the preset time period is no earlier than the exposure scan initial time of last valid pixel row of the infrared image sensor, and the end time of the preset time period is not later than the end time of current frame period.
With reference to second aspect, in second of possible implementation, the secondary light source includes driver and infrared LED, and the infrared LED is electrically connected by the driver and the processor, and methods described also includes：
The processor obtains the mass parameter for the eyeball image that the infrared camera is collected, and the mass parameter is contrasted with preset quality parameter, obtains comparing result；
Control the driver to adjust driving current according to comparing result generation driving configuration parameter, and according to the driving configuration parameter, and then drive the infrared LED to adjust infrared luminous intensity, to lift the quality of next frame eyeball image.
With reference to second aspect, in the third possible implementation, methods described also includes：
The processor obtains the mass parameter for the eyeball image that the infrared camera is collected, and the mass parameter is contrasted with preset quality parameter, obtains comparing result；
Fluorescent lifetime configuration parameter is generated according to the comparing result, and the duration of the preset time period is adjusted according to the fluorescent lifetime configuration parameter, and then control the fluorescent lifetime of the infrared fill-in light of the secondary light source adjustment, and the infrared camera synchronous adjustment time for exposure is controlled, to lift the quality of next frame eyeball image.
The third aspect there is provided a kind of secondary light source control device of eye tracking device, including：
Time-sequence control module, for controlling secondary light source persistently to export infrared fill-in light in preset time period according to frame synchronizing signal；
The time-sequence control module, is additionally operable to control infrared camera and is exposed in the preset time period；
Wherein, the duration of the preset time period is less than the frame period, and the frame period is the cycle period of the frame synchronizing signal.
With reference to the third aspect, in the first possible implementation, the infrared camera includes infrared image sensor, the infrared image sensor includes multiple pixel columns, the multiple pixel column includes the multiple valid pixel rows being disposed adjacent successively, and the initial time of the preset time period is no earlier than the infrared image and passed
The exposure scan initial time of last valid pixel row of sensor, the end time of the preset time period is not later than the end time of current frame period.
With reference to the third aspect, in second of possible implementation, the secondary light source includes driver and infrared LED, and the infrared LED is electrically connected by the driver and the processor, and described device also includes：
Image processing module, the mass parameter for obtaining the eyeball image that the infrared camera is collected, and the mass parameter is contrasted with preset quality parameter, obtain comparing result；
Drive control module, for controlling the driver to adjust driving current according to comparing result generation driving configuration parameter, and according to the driving configuration parameter, and then drives the infrared LED to adjust infrared luminous intensity, to lift the quality of next frame eyeball image.
With reference to the third aspect, in the third possible implementation, described device also includes：
Image processing module, the mass parameter for obtaining the eyeball image that the infrared camera is collected, and the mass parameter is contrasted with preset quality parameter, obtain comparing result；
The time-sequence control module, it is additionally operable to generate fluorescent lifetime configuration parameter according to the comparing result, and the duration of the preset time period is adjusted according to the fluorescent lifetime configuration parameter, and then control the fluorescent lifetime of the infrared fill-in light of the secondary light source adjustment, and the infrared camera synchronous adjustment time for exposure is controlled, to lift the quality of next frame eyeball image.
Fourth aspect includes instruction there is provided a kind of non-volatile computer readable storage medium storing program for executing for storing one or more programs, one or more of programs, and the instruction makes the following event of computing device when being called by processor：
Secondary light source is controlled persistently to export infrared fill-in light in preset time period according to frame synchronizing signal；
Control infrared camera exposes in the preset time period；
Wherein, the preset time period is less than the frame period, and the frame period is the cycle period of the frame synchronizing signal.
With reference to fourth aspect, in the first possible implementation, the infrared camera includes infrared image sensor, the infrared image sensor includes multiple pixel columns, the multiple pixel column includes the multiple valid pixel rows being disposed adjacent successively, the initial time of the preset time period is no earlier than the exposure scan initial time of last valid pixel row of the infrared image sensor, and the end time of the preset time period is not later than the end time of current frame period.
With reference to fourth aspect, in second of possible implementation, the secondary light source includes driver and infrared LED, and the infrared LED is electrically connected by the driver and the processor, and the event also includes：
The processor obtains the mass parameter for the eyeball image that the infrared camera is collected, and the mass parameter is contrasted with preset quality parameter, obtains comparing result；
Control the driver to adjust driving current according to comparing result generation driving configuration parameter, and according to the driving configuration parameter, and then drive the infrared LED to adjust infrared luminous intensity, to lift the quality of next frame eyeball image.
With reference to fourth aspect, in the third possible implementation, the event also includes：
The processor obtains the mass parameter for the eyeball image that the infrared camera is collected, and the mass parameter is contrasted with preset quality parameter, obtains comparing result；
Fluorescent lifetime configuration parameter is generated according to the comparing result, and the duration of the preset time period is adjusted according to the fluorescent lifetime configuration parameter, and then control the fluorescent lifetime of the infrared fill-in light of the secondary light source adjustment, and the infrared camera synchronous adjustment time for exposure is controlled, to lift the quality of next frame eyeball image.
The eye tracking device according to frame synchronizing signal by controlling the secondary light source persistently to export infrared fill-in light within the preset time period less than the frame period, and control the infrared camera to be exposed in the preset time period, complete the collection of a frame eyeball image, effectively shorten the opening time of the secondary light source, and the time for exposure of the infrared camera, solve causes the problem of eyeball image has smear of generating heat seriously and cause because jolting because secondary light source is opened for a long time in the prior art, reduce the power consumption of eye tracking device, improve the image quality and eye tracking precision of eyeball image.
In order to illustrate more clearly about the embodiment of the present invention or technical scheme of the prior art, the required accompanying drawing used in embodiment or description of the prior art will be briefly described below, apparently, drawings in the following description are only some embodiments of the present invention, for those of ordinary skill in the art, on the premise of not paying creative work, other accompanying drawings can also be obtained according to these accompanying drawings.
Fig. 1 is the structural representation for the eye tracking device that the present invention is provided；
Fig. 2 is the exposure time series schematic diagram of the infrared image sensor for the eye tracking device that the present invention is provided；
Fig. 3 is another structural representation for the eye tracking device that the present invention is provided；
Fig. 4 is the work schedule logical schematic of eye tracking device shown in Fig. 3；
Fig. 5 is the schematic flow sheet of the auxiliary light source control method for the eye tracking device that the present invention is provided；
Fig. 6 is another schematic flow sheet for showing auxiliary light source control method for the eye tracking device that the present invention is provided；
Fig. 7 is the structural representation of the secondary light source control device for the eye tracking device that the present invention is provided；
Fig. 8 is the application scenarios schematic diagram of secondary light source control device shown in Fig. 7.
Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is clearly and completely described, it is clear that described embodiment is only a part of embodiment of the invention, rather than whole embodiments.Based on the embodiment in the present invention, the every other embodiment that those of ordinary skill in the art are obtained under the premise of creative work is not made belongs to the scope of protection of the invention.
First embodiment of the invention provides a kind of eye tracking device 100, applied in the intelligent terminal (not shown) such as smart mobile phone, tablet personal computer, to control the intelligent terminal by the movement locus for tracking eyeball, so as to realize the man-machine interaction based on eye tracking, for example, the operation such as intelligent terminal page turning, roll screen, multimedia is controlled, the operating function is not specifically limited.
Fig. 1 is the structural representation for the eye tracking device that the present invention is provided.
Refer to Fig. 1, the eye tracking device 100 can include processor 110, infrared camera 130 and secondary light source 150, the processor 110 is electrically connected with the infrared camera 130 and secondary light source 150, the infrared camera 130 is used to generate and export frame synchronizing signal, the processor 110 is used for the frame synchronizing signal for receiving the infrared camera output, and control the secondary light source 150 persistently to export infrared fill-in light in preset time period according to the frame synchronizing signal, and control the infrared camera 130 to be exposed in the preset time period, and then complete the collection of a frame eyeball image.Wherein, the frame period is the cycle period of the frame synchronizing signal, and the duration of the preset time period is less than the frame period.
It is appreciated that the infrared fill-in light that the secondary light source 150 is sent projects eyeball surface, and in eyeball surface formation reflective spot.While the secondary light source 150 exports infrared fill-in light, the eyeball image for being formed with reflective spot is gathered by the infrared camera 130, and then handled by the eyeball image collected described in 110 pairs of the processor, and the coordinate for obtaining the screen position that eyeball is watched attentively is calculated according to eye tracking algorithm.Further, the eye tracking device 100 is in the preset time period internal control
Make the secondary light source 150 and export infrared fill-in light, and control the infrared camera 130 to be exposed in the preset time period, complete the collection of a frame eyeball image；The processor 110 is by handling the eyeball image, and the coordinate for obtaining the screen position that the corresponding eyeball of the eyeball image is watched attentively is calculated according to eye tracking algorithm, so as to which the change of the coordinate for the screen position watched attentively according to the eyeball calculates the movement locus of eyeball, the intelligent terminal is controlled to carry out the operation such as corresponding page turning, roll screen, multimedia according further to the movement locus.
Fig. 2 is the exposure time series schematic diagram of the infrared image sensor for the eye tracking device that the present invention is provided.
The infrared camera 130 includes infrared image sensor, the infrared image sensor can include multiple pixel columns, wherein, the multiple pixel column can include multiple valid pixel rows (Valid Line) L1~LN being disposed adjacent successively and multiple dummy pixel rows (Dummy Line) D1~DM being disposed adjacent successively, valid pixel row L1~the LN forms valid data in exposure, and the dummy pixel row D1~DM is the more increased pixel column exported not as valid data outside the valid pixel row L1~LN.Wherein, at least in the presence of a dummy pixel row.Exposure time series of the valid pixel row in each frame period include data read time (R-portion in corresponding diagram 2) and exposure scan time (Expo=full in corresponding diagram 2).Wherein, within the exposure scan time, the valid pixel row exposes to complete image data acquiring in infrared auxiliary light；The data read time is used to read the view data that the valid pixel row is collected in former frame.It is appreciated that the data read time of different infrared image sensors can be different.The infrared image sensor is progressively scanned to the valid pixel row, and the valid pixel row exposes in infrared auxiliary light.
In the present embodiment, illustrated so that the infrared image sensor includes L1~L8 and 4 dummy pixel row D1~D4 of 8 valid pixel rows as an example, it is specific as shown in Figure 2.Wherein, Vsync is frame synchronizing signal, and the Vsync is periodic signal, and its cycle is a frame period；T0 is the initial time in a frame period, and T1 is last valid pixel row L8 exposure scan initial time, and T2 is the end time in a frame period.When the infrared image sensor is advanced to the multiple pixel to progressively scan, there is the segment sync exposure scan time within a frame period in the 8 valid pixel rows L1~L8, the initial time of the synchronous exposure scan time is equal to the exposure scan initial time T1 of the 8th valid pixel row L8, and the end time of the synchronous exposure scan time is equal to the end time T2 of current frame period.
It is appreciated that the infrared image sensor can include different valid pixel rows and dummy pixel row, meanwhile, by configuring the blend proportion of the valid pixel row and dummy pixel row, the synchronous exposure can be adjusted
The length of optical scanning time.In the present embodiment, if the preset time was arranged in the synchronous exposure scan period, and control the secondary light source 150 to open in the preset time period, it can ensure that the multiple valid pixel has identical time for exposure length in the preset time period, and then complete in the preset time period collection of a frame eyeball image.
To avoid opening of the secondary light source 150 all the time in transmitting infrared light within the whole frame period, increase the power consumption and caloric value of the eye tracking device 100；Simultaneously, in order to avoid there is smear defect in the eyeball image for causing the infrared camera 130 to collect because the time for exposure is long under the environment that jolts, in the present embodiment, the secondary light source 150 is controlled persistently to export infrared fill-in light in preset time period according to the frame synchronizing signal by the processor 110, and control the infrared camera 130 to be exposed in the preset time period, complete the collection of a frame eyeball image.Wherein, the initial time of the preset time period is no earlier than the exposure scan initial time of last valid pixel row of the infrared image sensor, and the end time of the preset time period is not later than the end time of current frame period.So, i.e. can be while the time for exposure of the fluorescent lifetime of the secondary light source 150 and the infrared camera 130 be shortened, ensure that the multiple valid pixel row has identical time for exposure length, so as to effectively reduce the power consumption of the eye tracking device, and lift eyeball image image quality of the infrared camera 130 under the environment that jolts.
Wherein, the initial time of the preset time period is no earlier than the exposure scan initial time of last valid pixel row of the infrared image sensor, the end time of the preset time period is not later than the end time of current frame period, can be one of following four situation：
The initial time of the preset time period is equal to the exposure scan initial time of last valid pixel row of the infrared image sensor, and the end time of the preset time period is equal to the end time of current frame period；Or
The initial time of the preset time period is equal to the exposure scan initial time of last valid pixel row of the infrared image sensor, end time of the end time earlier than current frame period of the preset time period；Or
The initial time of the preset time period is later than the exposure scan initial time of last valid pixel row of the infrared image sensor, and the end time of the preset time period is equal to the end time of current frame period；Or
The initial time of the preset time period is later than last effective picture of the infrared image sensor
The exposure scan initial time of plain row, end time of the end time earlier than current frame period of the preset time period.
Specifically, the processor 110 controls the secondary light source 150 persistently to export infrared fill-in light in preset time period according to frame synchronizing signal, controls the infrared camera 130 to be exposed in the preset time period, including：
The initial time T0 in frame period of the processor 110 in the frame synchronizing signal starts timing, and export opening control signal when timing reaches the initial time of the preset time period, to control the secondary light source 150 to export infrared fill-in light by the opening control signal, and the infrared camera 130 is controlled to start exposure；Wherein, the initial time of the preset time period can be equal to or be later than the exposure scan initial time of last valid pixel row of the infrared image sensor.
The processor 110 exports closing control signal when timing reaches the end time of the preset time period, to control the secondary light source 150 to close infrared fill-in light by the closing control signal, and controls the infrared camera 130 to terminate exposure；Wherein, the end time of the preset time period can be equal or earlier than the end time of current frame period.
Fig. 3 is another structural representation for the eye tracking device that the present invention is provided.
Refer to Fig. 3, in the present embodiment, the processor 110 includes the first general input/output port GPIO_A and the second general input/output port GPIO_B, and the infrared camera 130 is electrically connected by the first general input/output port GPIO_A with the processor 110.The secondary light source 150 includes driver 151 and infrared LED 153, and the secondary light source 150 is electrically connected by the second general input/output port GPIO_B with the processor 110.The frame synchronizing signal is generated by the infrared camera 130, and is transferred to the processor 110 by the first general input/output port GPIO_A.The cycle of the frame synchronizing signal is identical with the frame period of the infrared camera 130.The initial time T0 in frame period of the processor 110 in the frame synchronizing signal starts timing, and generate opening control signal when timing reaches the initial time of the preset time period, and the driver 151 is transferred to by the second general input/output port GPIO_B, to control the output driving current of driver 151, and then drive the infrared LED 153 to export infrared fill-in light, and control the infrared camera 130 to start exposure.When the processor 110 generates closing control signal when timing reaches the end time of the preset time period, and the driver 151 is transferred to by the second general input/output port GPIO_B, to control the driver 151 to stop output driving current, and then control the infrared LED 153 to close, and control
Make the infrared camera 130 and terminate exposure.It is appreciated that, the frame synchronizing signal is not limited to be generated by the infrared camera 130, it can also be generated by the processor 110 or other time schedule controller, it is only necessary to identical with the frame period of the infrared camera 130 in the cycle of the frame synchronizing signal.
Fig. 4 is the work schedule logical schematic of eye tracking device shown in Fig. 3.
Refer to Fig. 4, wherein, Sync/GPIO_A is the frame synchronizing signal that the processor 110 is received by the first general input/output port GPIO_A, and GPIO_B is the control signal that the processor 110 is transmitted by the second general input/output port GPIO_B；T0 is the initial time of current frame period, and T1 is the initial time of the preset time period, and T2 is the end time (being the end time of the preset time period in the present embodiment) of current frame period.Specifically, the processor 110 is when receiving the frame synchronizing signal, the timing since the initial time T0 of the current frame period, a length of T1-T0 during timing；When timing reaches the initial time T1 of the preset time period, the processor 110 exports the control signal by the second general input/output port GPIO_B, and it is transferred to the driver 151, to control the output driving current of driver 151, and then the infrared LED 153 is driven to export infrared fill-in light；When timing reaches end time (being the end time T2 of current frame period in the present embodiment) of the preset time period, the processor 110 exports the control signal by the second general input/output port GPIO_B, and it is transferred to the driver 151, to control the driver 151 to stop output driving current, and then the infrared LED 153 is controlled to stop the infrared fill-in light of output.In the present embodiment, the control signal is level triggers signal.As shown in Figure 4, when the processor 110 reaches the initial time of the preset time period in timing, by the second general input/output port GPIO_B output high level signals (i.e. opening control signal), to control the secondary light source 150 to export infrared fill-in light, and the infrared camera 130 is controlled to start exposure；The processor 110 is when timing reaches the end time of the preset time period, the output signal of the second general input/output port GPIO_B is switched into low level signal (i.e. closing control signal) by high level signal, to control the secondary light source 150 to close infrared fill-in light, and the infrared camera 130 is controlled to terminate exposure.It is appreciated that, the opening control signal and closing control signal can also be pulse triggering signal, when the processor 110 reaches the initial time of the preset time period in timing, export a pulse signal, to control the secondary light source 150 to export infrared fill-in light, and the infrared camera 130 is controlled to start exposure；When the processor 110, when timing reaches the end time of the preset time period, output exports a pulse signal, to control the secondary light source 150 to close infrared fill-in light, and controls the infrared camera 130 to terminate exposure.
It is appreciated that the level height or a kind of implementation of the positive and negative simply embodiment of the present invention of output pulse that are provided in embodiments of the invention, each parameter value of control signal can carry out appropriate adjustment according to the need for circuit.For example, when the opening control signal and closing control signal are level triggers signal, the processor 110 can also export low level signal by the second general input/output port GPIO_B and be used as the opening control signal, and the closing control signal is used as accordingly by the second general input/output port GPIO_B output high level signals；When the opening control signal and closing control signal are pulse triggering signal, the processor 110 can be exported high and low pulse by the second general input/output port GPIO_B and export positive and negative pulse respectively respectively as the opening control signal and closing control signal respectively as the opening control signal and closing control signal, or by the second general input/output port GPIO_B.
In the first alternative embodiment, the infrared camera 130 is after the collection of a frame eyeball image is completed, the eyeball image is transferred into the processor 110, the processor 110 is by calling eye tracking algorithm to handle the frame eyeball image, the coordinate for obtaining the screen position that the corresponding eyeball of each frame eyeball image is watched attentively is calculated, so that the change of the coordinate for the screen position watched attentively according to the eyeball calculates the movement locus of eyeball.Simultaneously, the processor 110 is additionally operable to obtain the mass parameter of the eyeball image, and contrasted the mass parameter with preset quality parameter, and then according to comparing result generation driving configuration parameter, and control the driver 151 to adjust driving current according to the driving configuration parameter, and then drive the infrared LED 153 to adjust infrared luminous intensity, to lift the quality of the eyeball image that the infrared camera 130 is collected in next frame period.Specifically, the mass parameter of the eyeball image can include definition, noise number, contrast etc., the preset quality parameter is, according to the accuracy requirement of the eye tracking device 100, to pass through preferably definition scope, noise number scope, contrast range etc. obtained from debugging.For example, after the processor 110 gets the definition of the eyeball image, the definition is contrasted with the default definition scope, when the definition of the eyeball image is less than the default definition scope, generation driving configuration parameter, to control the increase of driver 151 driving current, and then drives the infrared light LED 153 to increase infrared luminous intensity, in next frame eyeball IMAQ, to lift the definition of eyeball image.
In the second alternative embodiment, the processor 110 is obtaining the mass parameter of the eyeball image, and after being contrasted the mass parameter and preset quality parameter, be additionally operable to generate fluorescent lifetime configuration parameter according to the comparing result, and according to the fluorescent lifetime configuration parameter adjust the preset time period when
It is long, and then control the secondary light source 150 to adjust the fluorescent lifetime of infrared fill-in light, and the synchronous adjustment time for exposure of infrared camera 130 is controlled, to lift the quality for the eyeball image that the infrared camera in next frame period is collected.For example, after the processor 110 gets the noise number of the eyeball image, the noise number is contrasted with the default noise number scope, when the noise number of the eyeball image is more than the default noise number scope, generate fluorescent lifetime configuration parameter, and shorten the duration of the preset time period according to the fluorescent lifetime configuration parameter, and then the control secondary light source 150 shortens the fluorescent lifetime of infrared fill-in light, and control the infrared camera 130 is synchronous to shorten the time for exposure, in next frame eyeball IMAQ, to reduce the noise number of eyeball image.
Fig. 5 is the schematic flow sheet of the auxiliary light source control method for the eye tracking device that the present invention is provided.
Refer to Fig. 5, second embodiment of the invention provides a kind of auxiliary light source control method of eye tracking device, applied in the eye tracking device 100 provided described in first embodiment of the invention, to reduce the power consumption of the eye tracking device 100, and the image quality of eyeball image is lifted, improve the precision of eye tracking.The auxiliary light source control method at least comprises the following steps：
Step S201：Secondary light source is controlled persistently to export infrared fill-in light in preset time period according to frame synchronizing signal；
Step S202：Control infrared camera exposes in the preset time period；
Wherein, the duration of the preset time period is less than the frame period, and the frame period is the cycle period of the frame synchronizing signal.
It is appreciated that representing the step S201 and step S202 in Fig. 5 with flow chart, it is intended merely to perform action included in the clear auxiliary light source control method of convenient description, the execution sequence composition to the step S201 and step S202 is not limited.In the present embodiment, the step S201 and step S202 can synchronously perform.
The infrared camera includes infrared image sensor, the infrared image sensor includes multiple pixel columns, wherein, the multiple pixel column can include the multiple valid pixel rows being disposed adjacent successively and the multiple dummy pixel rows being disposed adjacent successively, when the infrared image sensor is progressively scanned to the multiple pixel column, there is the segment sync exposure scan time within a frame period in the multiple valid pixel rows being disposed adjacent successively, the initial time of the synchronous exposure scan time is equal to the exposure scan initial time of last valid pixel row, the end time of the synchronous exposure scan time is equal to the end time of current frame period.If it is appreciated that the preset time was arranged in the synchronous exposure scan period, and described pre-
If the control secondary light source is opened in the period, you can ensure that the multiple valid pixel has identical time for exposure length in the preset time period, and then complete in the preset time period collection of a frame eyeball image.Therefore, it can to set the preset time period initial time be no earlier than the infrared image sensor last valid pixel row exposure scan initial time, the end time of the preset time period is not later than the end time of current frame period.
Wherein, the initial time of the preset time period is no earlier than the exposure scan initial time of last valid pixel row of the infrared image sensor, the end time of the preset time period is not later than the end time of current frame period, can be one of following four situation：
The initial time of the preset time period is equal to the exposure scan initial time of last valid pixel row of the infrared image sensor, and the end time of the preset time period is equal to the end time of current frame period；Or
The initial time of the preset time period is equal to the exposure scan initial time of last valid pixel row of the infrared image sensor, end time of the end time earlier than current frame period of the preset time period；Or
The initial time of the preset time period is later than the exposure scan initial time of last valid pixel row of the infrared image sensor, and the end time of the preset time period is equal to the end time of current frame period；Or
The initial time of the preset time period is later than the exposure scan initial time of last valid pixel row of the infrared image sensor, end time of the end time earlier than current frame period of the preset time period.
Wherein, the setting of the preset time period can be with the associated description in reference picture 2 and first embodiment of the invention, and here is omitted.
Fig. 6 is another schematic flow sheet for showing auxiliary light source control method for the eye tracking device that the present invention is provided.
Referring to Fig. 6, described control the secondary light source persistently to export infrared fill-in light in preset time period according to frame synchronizing signal；The infrared camera is controlled to be exposed in the preset time period, including：
Step S211：Trigger initial time of the processor in the frame period of the frame synchronizing signal and start timing, and export opening control signal when timing reaches the initial time of the preset time period, to control the secondary light source to export infrared fill-in light by the opening control signal, and the infrared camera is controlled to start exposure
Light；
Step S212：Trigger the processor and export closing control signal when timing reaches the end time of the preset time period, to control the secondary light source to close infrared fill-in light by the closing control signal, and control the infrared camera to terminate exposure.
Wherein, relation between the frame synchronizing signal and the opening control signal and closing control signal, and the relation of the preset time period and the frame synchronizing signal can be with the associated description in reference picture 3, Fig. 4 and first embodiment of the invention, here is omitted.
The secondary light source can include driver and infrared LED, and the infrared LED is electrically connected by the driver and the processor, and alternatively, methods described also includes：
The processor obtains the mass parameter for the eyeball image that the infrared camera is collected, and the mass parameter is contrasted with preset quality parameter, obtains comparing result；
According to comparing result generation driving configuration parameter, and control the driver to adjust driving current according to the driving configuration parameter, and then drive the infrared LED to adjust infrared luminous intensity, to lift the quality for the eyeball image that the infrared camera in next frame period is collected.
Wherein, it is described that configuration parameter is driven according to comparison result generation, and control the specific execution for the step of driver adjusts driving current can also be with reference to the associated description in the first alternative embodiment in first embodiment of the invention according to the driving configuration parameter, here is omitted.
Alternatively, the processor obtains the mass parameter for the eyeball image that the infrared camera is collected, and the mass parameter is contrasted with preset quality parameter, obtains after comparing result, methods described also includes：
Fluorescent lifetime configuration parameter is generated according to the comparing result, and the duration of the preset time period is adjusted according to the fluorescent lifetime configuration parameter, and then control the fluorescent lifetime of the infrared fill-in light of the secondary light source adjustment, and the infrared camera synchronous adjustment time for exposure is controlled, to lift the quality for the eyeball image that the infrared camera in next frame period is collected.
Wherein, it is described that fluorescent lifetime configuration parameter is generated according to the comparing result, and specific execution the step of adjust the duration of the preset time period according to the fluorescent lifetime configuration parameter can also be with reference to the associated description in the second alternative embodiment in first embodiment of the invention, here is omitted.
Fig. 7 is the structural representation of the secondary light source control device for the eye tracking device that the present invention is provided.
Referring to Fig. 7, third embodiment of the invention provides a kind of secondary light source control dress of eye tracking device
300 are put, applied in the eye tracking device 100 provided described in first embodiment of the invention, to reduce the power consumption of the eye tracking device 100, and the image quality of eyeball image is lifted, improves the precision of eye tracking.The secondary light source control device 300 includes：
Time-sequence control module 310, for controlling secondary light source persistently to export infrared fill-in light in the preset time period according to frame synchronizing signal；
The time-sequence control module 310, is additionally operable to control infrared camera and is exposed in the preset time period；Wherein, the frame period is the cycle period of the frame synchronizing signal, and the duration of the preset time period is less than the frame period.
The infrared camera includes infrared image sensor, the infrared image sensor includes multiple pixel columns, wherein, the multiple pixel column can include the multiple valid pixel rows being disposed adjacent successively and the multiple dummy pixel rows being disposed adjacent successively, when the infrared image sensor is progressively scanned to the multiple pixel column, there is the segment sync exposure scan time within a frame period in the multiple valid pixel rows being disposed adjacent successively, the initial time of the synchronous exposure scan time is equal to the exposure scan initial time of last valid pixel row, the end time of the synchronous exposure scan time is equal to the end time of current frame period.It is appreciated that, if the preset time was arranged in the synchronous exposure scan period, and control the secondary light source to open in the preset time period, it can ensure that the multiple valid pixel has identical time for exposure length in the preset time period, and then complete in the preset time period collection of a frame eyeball image.Therefore, it can to set the preset time period initial time be no earlier than the infrared image sensor last valid pixel row exposure scan initial time, the end time of the preset time period is not later than the end time of current frame period.
Wherein, the initial time of the preset time period is no earlier than the exposure scan initial time of last valid pixel row of the infrared image sensor, the end time of the preset time period is not later than the end time of current frame period, can be one of following four situation：
The initial time of the preset time period is equal to the exposure scan initial time of last valid pixel row of the infrared image sensor, and the end time of the preset time period is equal to the end time of current frame period；Or
The initial time of the preset time period is equal to the exposure scan initial time of last valid pixel row of the infrared image sensor, end time of the end time earlier than current frame period of the preset time period；Or
The initial time of the preset time period is later than the exposure scan initial time of last valid pixel row of the infrared image sensor, and the end time of the preset time period is equal to the end time of current frame period；Or
The initial time of the preset time period is later than the exposure scan initial time of last valid pixel row of the infrared image sensor, end time of the end time earlier than current frame period of the preset time period.
Wherein, the formation of the time window and the preset time period and the relation of the time window can be with the associated descriptions in reference picture 2 and first embodiment of the invention, and here is omitted.
The time-sequence control module 310, is additionally operable to：
Trigger initial time of the processor in the frame period of the frame synchronizing signal and start timing, and export opening control signal when timing reaches the initial time of the preset time period, to control the secondary light source to export infrared fill-in light by the opening control signal, and the infrared camera is controlled to start exposure；And
Trigger the processor and export closing control signal when timing reaches the end time of the preset time period, to control the secondary light source to close infrared fill-in light by the closing control signal, and control the infrared camera to terminate exposure.
Wherein, relation between the frame synchronizing signal and the opening control signal and closing control signal, and the relation of the preset time period and the frame synchronizing signal can be with the associated description in reference picture 3, Fig. 4 and first embodiment of the invention, here is omitted.
The secondary light source includes driver and infrared LED, and the infrared LED is electrically connected by the driver and the processor, and alternatively, described device 300 also includes：
Image processing module 330, the mass parameter for obtaining the eyeball image that the infrared camera is collected, and the mass parameter is contrasted with preset quality parameter, obtain comparing result；
Drive control module 350, for according to comparing result generation driving configuration parameter, and control the driver to adjust driving current according to the driving configuration parameter, and then drive the infrared LED to adjust infrared luminous intensity, to lift the quality for the eyeball image that the infrared camera in next frame period is collected.
Wherein, the function of the drive control module 350 and execution can also be with reference to the associated descriptions in the first alternative embodiment in first embodiment of the invention, and here is omitted.
Alternatively, described image processing module 330 obtains the eyeball image that the infrared camera is collected
Mass parameter, and the mass parameter is contrasted with preset quality parameter, after acquisition comparing result；
The time-sequence control module 310, it is additionally operable to generate fluorescent lifetime configuration parameter according to the comparing result, and the duration of the preset time period is adjusted according to the fluorescent lifetime configuration parameter, and then control the fluorescent lifetime of the infrared fill-in light of the secondary light source adjustment, and the infrared camera synchronous adjustment time for exposure is controlled, to lift the quality for the eyeball image that the infrared camera in next frame period is collected.
Wherein, the function of the time-sequence control module 310 and execution can also be with reference to the associated descriptions in the second alternative embodiment in first embodiment of the invention, and here is omitted.
Fig. 8 is the application scenarios schematic diagram of secondary light source control device shown in Fig. 7.
Referring to Fig. 8, in the present embodiment, the secondary light source control device 300 is applied in the eye tracking device 100.It is appreciated that, each module of the secondary light source control device 300 is programmed algorithm module, each module of the secondary light source control device 300 can be set independently of the processor 110, or be arranged in the processor 110, the processor 110 is used for each module for calling the secondary light source control device 300, to complete the execution of corresponding function.Wherein, the execution of each functions of modules of the secondary light source control device 300 can refer to the associated description in first embodiment of the invention, and here is omitted.
Fourth embodiment of the invention provides a kind of non-volatile computer readable storage medium storing program for executing for storing one or more programs, and one or more of programs include instruction, and the instruction makes the following event of computing device when being called by processor：
Secondary light source is controlled persistently to export infrared fill-in light in preset time period according to frame synchronizing signal；
Control infrared camera exposes in the preset time period；
Wherein, the preset time period is less than the frame period, and the frame period is the cycle period of the frame synchronizing signal.
Alternatively, the infrared camera includes infrared image sensor, the infrared image sensor includes multiple pixel columns, the multiple pixel column includes the multiple valid pixel rows being disposed adjacent successively, the initial time of the preset time period is no earlier than the exposure scan initial time of last valid pixel row of the infrared image sensor, and the end time of the preset time period is not later than the end time of current frame period.
Alternatively, the initial time of the preset time period is equal to the exposure scan initial time of last valid pixel row of the infrared image sensor, and the end time of the preset time period is equal to the end time of current frame period；Or
The initial time of the preset time period is equal to last effective picture of the infrared image sensor
The exposure scan initial time of plain row, end time of the end time earlier than current frame period of the preset time period；Or
The initial time of the preset time period is later than the exposure scan initial time of last valid pixel row of the infrared image sensor, and the end time of the preset time period is equal to the end time of current frame period；Or
The initial time of the preset time period is later than the exposure scan initial time of last valid pixel row of the infrared image sensor, end time of the end time earlier than current frame period of the preset time period.
Alternatively, it is described to control the secondary light source persistently to export infrared fill-in light in preset time period according to frame synchronizing signal；The infrared camera is controlled to be exposed in the preset time period, including：
Trigger initial time of the processor in the frame period of the frame synchronizing signal and start timing, and export opening control signal when timing reaches the initial time of the preset time period, to control the secondary light source to export infrared fill-in light by the opening control signal, and the infrared camera is controlled to start exposure；
Trigger the processor and export closing control signal when timing reaches the end time of the preset time period, to control the secondary light source to close infrared fill-in light by the closing control signal, and control the infrared camera to terminate exposure.
Alternatively, the secondary light source includes driver and infrared LED, and the infrared LED is electrically connected by the driver and the processor, then the event also includes：
The processor obtains the mass parameter for the eyeball image that the infrared camera is collected, and the mass parameter is contrasted with preset quality parameter, obtains comparing result；
Control the driver to adjust driving current according to comparing result generation driving configuration parameter, and according to the driving configuration parameter, and then drive the infrared LED to adjust infrared luminous intensity, to lift the quality of next frame eyeball image.
Alternatively, the event also includes：
The processor obtains the mass parameter for the eyeball image that the infrared camera is collected, and the mass parameter is contrasted with preset quality parameter, obtains comparing result；
Fluorescent lifetime configuration parameter is generated according to the comparing result, and the duration of the preset time period is adjusted according to the fluorescent lifetime configuration parameter, and then control the fluorescent lifetime of the infrared fill-in light of the secondary light source adjustment, and the infrared camera synchronous adjustment time for exposure is controlled, to lift the quality of next frame eyeball image.
It is appreciated that instructed described in the present embodiment makes the event of computing device can also be with reference to the description in second embodiment of the invention and 3rd embodiment when being called by processor, here is omitted.
The eye tracking device 100 according to frame synchronizing signal by controlling the secondary light source 150 persistently to export infrared fill-in light within the preset time period less than the frame period, and control the infrared camera 130 to be exposed in the preset time period, complete the collection of a frame eyeball image, effectively shorten the opening time of the secondary light source 150, and the time for exposure of the infrared camera 130, solve causes the problem of eyeball image has smear of generating heat seriously and cause because jolting because secondary light source is opened for a long time in the prior art, reduce the power consumption of the eye tracking device 100, improve the image quality and eye tracking precision of eyeball image.
Above disclosed is only presently preferred embodiments of the present invention, certainly the interest field of the present invention can not be limited with this, one of ordinary skill in the art will appreciate that realizing all or part of flow of above-described embodiment, and the equivalent variations made according to the claims in the present invention, still fall within and invent covered scope.
Claims (16)
- A kind of eye tracking device, it is characterised in that described device includes processor, infrared camera and secondary light source；The processor is electrically connected with the infrared camera and secondary light source；The infrared camera is used to export frame synchronizing signal；The processor is used to receive the frame synchronizing signal；The secondary light source is controlled persistently to export infrared fill-in light in preset time period according to the frame synchronizing signal；The infrared camera is controlled to be exposed in the preset time period；The duration of the preset time period is less than the frame period, and the frame period is the cycle period of the frame synchronizing signal.
- Eye tracking device as claimed in claim 1, it is characterized in that, the infrared camera includes infrared image sensor, the infrared image sensor includes multiple pixel columns, the multiple pixel column includes the multiple valid pixel rows being disposed adjacent successively, the initial time of the preset time period is no earlier than the exposure scan initial time of last valid pixel row of the infrared image sensor, and the end time of the preset time period is not later than the end time of current frame period.
- Eye tracking device as claimed in claim 1, it is characterized in that, the secondary light source includes driver and infrared LED, the infrared LED is electrically connected by the driver and the processor, the processor is additionally operable to obtain the mass parameter for the eyeball image that the infrared camera is collected, and contrasted the mass parameter with preset quality parameter, and then according to comparing result generation driving configuration parameter, and control the driver to adjust driving current according to the driving configuration parameter, and then drive the infrared LED to adjust infrared luminous intensity, to lift the quality of next frame eyeball image.
- Eye tracking device as claimed in claim 1, it is characterized in that, the processor is additionally operable to obtain the mass parameter for the eyeball image that the infrared camera is collected, and contrasted the mass parameter with preset quality parameter, and then fluorescent lifetime configuration parameter is generated according to comparing result, and the duration of the preset time period is adjusted according to the fluorescent lifetime configuration parameter, and then control the secondary light source adjustment infrared The fluorescent lifetime of fill-in light, and the infrared camera synchronous adjustment time for exposure is controlled, to lift the quality of next frame eyeball image.
- A kind of auxiliary light source control method of eye tracking device, it is characterised in that methods described includes：Secondary light source is controlled persistently to export infrared fill-in light in preset time period according to frame synchronizing signal；Control infrared camera exposes in the preset time period；Wherein, the duration of the preset time period is less than the frame period, and the frame period is the cycle period of the frame synchronizing signal.
- Auxiliary light source control method as claimed in claim 5, it is characterized in that, the infrared camera includes infrared image sensor, the infrared image sensor includes multiple pixel columns, the multiple pixel column includes the multiple valid pixel rows being disposed adjacent successively, the initial time of the preset time period is no earlier than the exposure scan initial time of last valid pixel row of the infrared image sensor, and the end time of the preset time period is not later than the end time of current frame period.
- Auxiliary light source control method as claimed in claim 5, it is characterised in that the secondary light source includes driver and infrared LED, the infrared LED is electrically connected by the driver and the processor, and methods described also includes：The processor obtains the mass parameter for the eyeball image that the infrared camera is collected, and the mass parameter is contrasted with preset quality parameter, obtains comparing result；Control the driver to adjust driving current according to comparing result generation driving configuration parameter, and according to the driving configuration parameter, and then drive the infrared LED to adjust infrared luminous intensity, to lift the quality of next frame eyeball image.
- Auxiliary light source control method as claimed in claim 5, it is characterised in that methods described also includes：The processor obtains the mass parameter for the eyeball image that the infrared camera is collected, and the mass parameter is contrasted with preset quality parameter, obtains comparing result；Fluorescent lifetime configuration parameter is generated according to the comparing result, and according to the fluorescent lifetime configuration parameter The duration of the preset time period is adjusted, and then controls the secondary light source to adjust the fluorescent lifetime of infrared fill-in light, and controls the infrared camera synchronous adjustment time for exposure, to lift the quality of next frame eyeball image.
- A kind of secondary light source control device of eye tracking device, it is characterised in that described device includes：Time-sequence control module, for controlling secondary light source persistently to export infrared fill-in light in preset time period according to frame synchronizing signal；The time-sequence control module, is additionally operable to control infrared camera and is exposed in the preset time period；Wherein, the duration of the preset time period is less than the frame period, and the frame period is the cycle period of the frame synchronizing signal.
- Secondary light source control device as claimed in claim 9, it is characterized in that, the infrared camera includes infrared image sensor, the infrared image sensor includes multiple pixel columns, the multiple pixel column includes the multiple valid pixel rows being disposed adjacent successively, the initial time of the preset time period is no earlier than the exposure scan initial time of last valid pixel row of the infrared image sensor, and the end time of the preset time period is not later than the end time of current frame period.
- Secondary light source control device as claimed in claim 9, it is characterised in that the secondary light source includes driver and infrared LED, the infrared LED is electrically connected by the driver and the processor, and described device also includes：Image processing module, the mass parameter for obtaining the eyeball image that the infrared camera is collected, and the mass parameter is contrasted with preset quality parameter, obtain comparing result；Drive control module, for controlling the driver to adjust driving current according to comparing result generation driving configuration parameter, and according to the driving configuration parameter, and then drives the infrared LED to adjust infrared luminous intensity, to lift the quality of next frame eyeball image.
- Secondary light source control device as claimed in claim 9, it is characterised in that described device also includes：Image processing module, the mass parameter for obtaining the eyeball image that the infrared camera is collected, and the mass parameter is contrasted with preset quality parameter, obtain comparing result；The time-sequence control module, it is additionally operable to generate fluorescent lifetime configuration parameter according to the comparing result, and the duration of the preset time period is adjusted according to the fluorescent lifetime configuration parameter, and then control the fluorescent lifetime of the infrared fill-in light of the secondary light source adjustment, and the infrared camera synchronous adjustment time for exposure is controlled, to lift the quality of next frame eyeball image.
- A kind of non-volatile computer readable storage medium storing program for executing for storing one or more programs, it is characterised in that one or more of programs include instruction, the instruction makes the following event of computing device when being called by processor：Secondary light source is controlled persistently to export infrared fill-in light in preset time period according to frame synchronizing signal；Control infrared camera exposes in the preset time period；Wherein, the preset time period is less than the frame period, and the frame period is the cycle period of the frame synchronizing signal.
- Non-volatile computer readable storage medium storing program for executing as claimed in claim 13, it is characterized in that, the infrared camera includes infrared image sensor, the infrared image sensor includes multiple pixel columns, the multiple pixel column includes the multiple valid pixel rows being disposed adjacent successively, the initial time of the preset time period is no earlier than the exposure scan initial time of last valid pixel row of the infrared image sensor, and the end time of the preset time period is not later than the end time of current frame period.
- Non-volatile computer readable storage medium storing program for executing as claimed in claim 13, it is characterised in that the secondary light source includes driver and infrared LED, the infrared LED is electrically connected by the driver and the processor, then the event also includes：The processor obtains the mass parameter for the eyeball image that the infrared camera is collected, and the mass parameter is contrasted with preset quality parameter, obtains comparing result；Control the driver to adjust driving current according to comparing result generation driving configuration parameter, and according to the driving configuration parameter, and then drive the infrared LED to adjust infrared luminous intensity, to lift the quality of next frame eyeball image.
- Non-volatile computer readable storage medium storing program for executing as claimed in claim 13, it is characterised in that The event also includes：The processor obtains the mass parameter for the eyeball image that the infrared camera is collected, and the mass parameter is contrasted with preset quality parameter, obtains comparing result；Fluorescent lifetime configuration parameter is generated according to the comparing result, and the duration of the preset time period is adjusted according to the fluorescent lifetime configuration parameter, and then control the fluorescent lifetime of the infrared fill-in light of the secondary light source adjustment, and the infrared camera synchronous adjustment time for exposure is controlled, to lift the quality of next frame eyeball image.
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/CN2015/091535 WO2017059577A1 (en) | 2015-10-09 | 2015-10-09 | Eyeball tracking device and auxiliary light source control method and related device thereof |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107004132A true CN107004132A (en) | 2017-08-01 |
| CN107004132B CN107004132B (en) | 2021-01-05 |
Family
ID=58487162
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201580065956.2A Active CN107004132B (en) | 2015-10-09 | 2015-10-09 | Eyeball tracking device, auxiliary light source control method thereof and related device |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN107004132B (en) |
| WO (1) | WO2017059577A1 (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107515466A (en) * | 2017-08-14 | 2017-12-26 | 华为技术有限公司 | A kind of eyeball tracking system and eyeball tracking method |
| CN109460686A (en) * | 2018-09-25 | 2019-03-12 | 深圳盈达信息科技有限公司 | A kind of method and system aiming at light blanking for sighting device |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111741185B (en) * | 2020-06-24 | 2022-04-26 | 杭州海康威视数字技术股份有限公司 | Light supplement control method, device, system and equipment and storage medium |
| CN113689707B (en) * | 2021-07-20 | 2022-09-06 | 浙江大华技术股份有限公司 | Video data processing method, device and computer readable storage medium |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20020181774A1 (en) * | 2001-05-30 | 2002-12-05 | Mitsubishi Denki Kabushiki Kaisha | Face portion detecting apparatus |
| CN1729682A (en) * | 2002-12-27 | 2006-02-01 | 卡西欧计算机株式会社 | Illumination apparatus and illumination method for an imaging apparatus |
| CN101226587A (en) * | 2007-01-15 | 2008-07-23 | 中国科学院自动化研究所 | Image collecting device as well as human face identification system and method using the same |
| CN201477518U (en) * | 2009-08-31 | 2010-05-19 | 北京科技大学 | Sight line tracking unit based on pupilla-cornea reflection method |
| CN102346358A (en) * | 2010-07-29 | 2012-02-08 | 罗技欧洲公司 | Optimized movable ir filter in cameras |
| CN102769757A (en) * | 2012-05-25 | 2012-11-07 | 南京大学 | Active light source-based image acquisition method and system |
| CN103634531A (en) * | 2013-12-16 | 2014-03-12 | 中国电子科技集团公司第四十四研究所 | Exposure time control method for visible-light CCD (charge coupled device) camera |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1892676B (en) * | 2005-06-03 | 2010-05-12 | 沈洪泉 | Apparatus and method for face/iris combination optical imagine |
| EP2696259B1 (en) * | 2012-08-09 | 2021-10-13 | Tobii AB | Fast wake-up in a gaze tracking system |
| CN104113680B (en) * | 2013-04-19 | 2019-06-28 | 北京三星通信技术研究有限公司 | Gaze tracking system and method |
| KR20150075906A (en) * | 2013-12-26 | 2015-07-06 | 삼성전기주식회사 | Apparatus and mehtod for eye tracking |
-
2015
- 2015-10-09 CN CN201580065956.2A patent/CN107004132B/en active Active
- 2015-10-09 WO PCT/CN2015/091535 patent/WO2017059577A1/en active Application Filing
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20020181774A1 (en) * | 2001-05-30 | 2002-12-05 | Mitsubishi Denki Kabushiki Kaisha | Face portion detecting apparatus |
| CN1729682A (en) * | 2002-12-27 | 2006-02-01 | 卡西欧计算机株式会社 | Illumination apparatus and illumination method for an imaging apparatus |
| CN101226587A (en) * | 2007-01-15 | 2008-07-23 | 中国科学院自动化研究所 | Image collecting device as well as human face identification system and method using the same |
| CN201477518U (en) * | 2009-08-31 | 2010-05-19 | 北京科技大学 | Sight line tracking unit based on pupilla-cornea reflection method |
| CN102346358A (en) * | 2010-07-29 | 2012-02-08 | 罗技欧洲公司 | Optimized movable ir filter in cameras |
| CN102769757A (en) * | 2012-05-25 | 2012-11-07 | 南京大学 | Active light source-based image acquisition method and system |
| CN103634531A (en) * | 2013-12-16 | 2014-03-12 | 中国电子科技集团公司第四十四研究所 | Exposure time control method for visible-light CCD (charge coupled device) camera |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107515466A (en) * | 2017-08-14 | 2017-12-26 | 华为技术有限公司 | A kind of eyeball tracking system and eyeball tracking method |
| WO2019033757A1 (en) * | 2017-08-14 | 2019-02-21 | 华为技术有限公司 | Eye tracking system and eye tracking method |
| CN107515466B (en) * | 2017-08-14 | 2019-11-26 | 华为技术有限公司 | A kind of eyeball tracking system and eyeball tracking method |
| US11067795B2 (en) | 2017-08-14 | 2021-07-20 | Huawei Technologies Co., Ltd. | Eyeball tracking system and eyeball tracking method |
| US11598956B2 (en) | 2017-08-14 | 2023-03-07 | Huawei Technologies Co., Ltd. | Eyeball tracking system and eyeball tracking method |
| CN109460686A (en) * | 2018-09-25 | 2019-03-12 | 深圳盈达信息科技有限公司 | A kind of method and system aiming at light blanking for sighting device |
| CN109460686B (en) * | 2018-09-25 | 2022-06-14 | 深圳盈达信息科技有限公司 | Method and system for blanking aiming light of aiming device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107004132B (en) | 2021-01-05 |
| WO2017059577A1 (en) | 2017-04-13 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20220303447A1 (en) | Information acquisition device, method, patrol robot and storage medium | |
| WO2021022868A1 (en) | Light supplementation method and apparatus for camera | |
| US9819874B2 (en) | Camera color temperature compensation system and smart terminal employing same | |
| CN103339655B (en) | Image capture device, image capture method and computer program | |
| CN107004132A (en) | Eye tracking device and its auxiliary light source control method and relevant apparatus | |
| CN107181918B (en) | A kind of dynamic filming control method and system for catching video camera of optics | |
| CN102055844A (en) | Method for realizing camera shutter function by means of gesture recognition and | |
| WO2017172695A1 (en) | Systems and methods of biometric anaysis with adaptive trigger | |
| CN100527915C (en) | Method for controlling flash-lamp apparatus | |
| US9571739B2 (en) | Camera timer | |
| US10447940B2 (en) | Photographing apparatus using multiple exposure sensor and photographing method thereof | |
| CN106210532B (en) | One kind is taken pictures processing method and terminal device | |
| WO2014054249A1 (en) | Information processing apparatus, information processing method, and program | |
| JP2020504953A (en) | Camera assembly and mobile electronic device | |
| CN104104891A (en) | Projection apparatus and projection automatic correction method thereof | |
| CN103780957A (en) | Television terminal intelligent control system and television terminal intelligent control method | |
| CN105320941A (en) | Biometric identification apparatus based on fusion of iris and human face and biometric identification method using apparatus | |
| CN104780320A (en) | Ambient light detection method and electronic equipment | |
| CN109668832A (en) | Cellular li-ion battery surface bulge detection device and its method based on subregion light source | |
| CN104683680A (en) | A method, device and mobile terminal for automatically taking a picture | |
| CN114140834A (en) | Optical fingerprint sensing device, driving device and operation method thereof | |
| CN106101537A (en) | A kind of intelligent terminal | |
| CN103971658B (en) | Display drive apparatus and display drive method thereof | |
| CN104732956B (en) | method and device for adjusting brightness of screen | |
| WO2019001227A1 (en) | Control method, electronic device, and computer readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |