CN109426331A - A kind of signal synchronizing method applied to eyeball tracking - Google Patents
A kind of signal synchronizing method applied to eyeball tracking Download PDFInfo
- Publication number
- CN109426331A CN109426331A CN201710729349.2A CN201710729349A CN109426331A CN 109426331 A CN109426331 A CN 109426331A CN 201710729349 A CN201710729349 A CN 201710729349A CN 109426331 A CN109426331 A CN 109426331A
- Authority
- CN
- China
- Prior art keywords
- image
- eyeball
- frequency
- eyeball tracking
- acquisition
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/013—Eye tracking input arrangements
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Processing Or Creating Images (AREA)
Abstract
The present invention relates to a kind of signal synchronizing methods applied to eyeball tracking, it is characterized in that, by the way that hardware layer or software layer synchronize the demand frequency of Ins location information image and the picture-taken frequency of positioning image acquisition hardware, to guarantee that the eyeball image information obtained after each requirement command issues is newest, and adjustment signal phase, control delay is in default range.The advantage of the invention is that image data acquisition frequency when can reduce Ins location, convenient for the transmission of Ins location data, mitigate the data processing pressure at main frame end, promote the universal of eyeball tracking technology, when applied to virtual reality or augmented reality, the feeling of immersion of virtual reality or augmented reality experience can be obviously improved.
Description
Technical field
The present invention relates to a kind of signal synchronizing method, especially a kind of signal synchronizing method applied to eyeball tracking.
Background technique
Eyeball tracking (Eye Tracking) refers to position or the eyeball opposing headers of the blinkpunkt by measuring eyes
Movement and realize to oculomotor tracking, vision system, psychology, cognitive linguistics research in have and widely answer
With.Eyeball tracking has two major classes method at present, and invasive means are included in embedding eye movement measurement coil in eyeball or use microelectrode
Trace electronystagmogram；Compared to invasive means, non-invasive means are more popular, and most common non-invasive means are clapped by video image
Equipment is taken the photograph to obtain the position of eyeball.
In the prior art in order to realize real-time eyeball tracking effect, eye movement image is carried out frequently with high speed camera
Shooting guarantees the real-time of eyeball tracking by improving video camera shooting frame rate, therefore the hardware for shooting camera is matched
It sets more demanding, while increasing data transmission and processing pressure, and there may be the longer problems of being delayed for certain frame images.
In order to reduce the threshold that uses of eyeball tracking technology, the accuracy and accuracy of promotion eyeball tracking positioning reduce
Positioning delay, technical solution of the present invention devise a kind of data-signal synchronous method for eyeball tracking, reduce to eyeball
The configuration requirement of image acquisition hardware equipment and main frame, by reducing image data acquisition frequency when Ins location
Rate only transmits effective Ins location image data, mitigates the data processing pressure at main frame end, promotes eyeball tracking skill
Art is popularized.
Virtual reality (virtual reality, VR) technology is to generate the virtual of a three-dimensional space using computer simulation
The world provides simulation of the user about sense organs such as visions, and user is allowed to feel seemingly on the spot in person, can in time, without limitation
Observe the things in three-dimensional space.When user carries out position movement, computer carries out complicated operation immediately, by the three-dimensional generation of simulation
Boundary's video passes generation telepresenc back.
When eyeball tracking technology is applied to virtual reality technology, the feeling of immersion of virtual reality experience can be obviously improved.
Summary of the invention
Object of the present invention is to: a kind of signal synchronizing method applied to eyeball tracking is provided, is reduced at computing module data
Pressure is managed, and guarantees the real-time of collected Eyeball motion information, solves in the prior art to want image acquisition hardware configuration
Ask the problems such as higher, data processing amount is larger.
The technical scheme is that provide a kind of signal synchronizing method applied to eyeball tracking, by hardware layer or soft
Part layer synchronizes the demand frequency of Ins location information image and the picture-taken frequency of positioning image acquisition hardware, with
Guarantee that the eyeball image information obtained after each requirement command issues is most real-time, and adjustment signal phase, control delay exist
In default range.
The technical program step is after acquiring eye movement image by positioning image acquisition hardware, frame by frame by eyeball image
It is transferred to cache module, after control module issues eyeball image requirement command, latest image data are extracted from cache module,
Changing as a result, working as eyeball image requirement command frequency for eyeball tracking positioning is exported after carrying out data processing by computing module,
Then frequency more new command is sent to positioning image acquisition hardware；
Optionally, the positioning image acquisition hardware includes positioning shooting head and other image acquiring sensors；
Optionally, the mode of the positioning image acquisition hardware transmission eyeball image includes: by USB line (general serial
Bus) or wireless signal mode transmitted；
Described image cache module is for keeping in newest collected eyeball image；
The eyeball image requirement command may come from software layer demand and hardware layer demand；
Optionally, the software layer demand includes: the software for needing to carry out eyeball tracking positioning in virtual reality software, is increased
The software for carrying out eyeball tracking positioning is needed to need the software of eyeball tracking positioning function with other in strong reality software；
Optionally, the hardware layer demand includes: the screen that equipment is shown in the device with Ins location tracking function
The data processing rate of refresh rate and computing module.
The eyeball image requirement command can be adjusted according to the actual situation, can be fixed frequency instruction or variable
Frequency instruction；
The computing module includes: main frame and data processing chip.
Compared with prior art, the technical program have the advantages that reduce Ins location when picture number it is believed that
Frequency acquisition is ceased, it is lower to the hardware configuration requirement of image acquisition hardware, convenient for the transmission of Ins location data, mitigates and calculate mould
The data processing pressure of block promotes the universal of eyeball tracking technology, can be obvious when being applied to virtual reality or augmented reality
Reduce the data volume to be rendered of computing module, reduces delay, promote the feeling of immersion of virtual reality experience.
Detailed description of the invention
Fig. 1 is eyeball tracking signal acquisition in the prior art and uses schematic diagram；
Fig. 2 is technical solution of the present invention eyeball tracking signal synchronization principles schematic diagram；
Fig. 3 is the synchronous flow chart of technical solution of the present invention eyeball tracking signal；
Specific embodiment
As described in the background art, eyeball tracking simultaneous techniques in the prior art, which exists, wants image acquisition hardware configuration
Ask the problems such as higher, data processing amount is larger.
Technical solution of the present invention by by hardware layer or software layer for the demand frequency of Ins location information image and fixed
The picture-taken frequency of bit image acquisition hardware synchronizes, to guarantee the eyeball image obtained after each requirement command issues letter
Breath is newest, and adjustment signal phase, control are delayed in default range.
It is understandable to enable above structure of the invention, feature and advantage to become apparent, with reference to the accompanying drawing to the present invention
Specific embodiment be described in detail.
Fig. 1 is eyeball tracking signal acquisition in the prior art and uses schematic diagram；
As shown schematically in fig. 1, in the prior art eyeball tracking scheme frequently with method be high speed positioning shooting head with
Fixed frequency high speed acquisition eye movement image (such as step 101), and after the Image Acquisition for completing every frame by image frame by frame
It is transmitted to cache module, (such as step 103 to step 108), from caching mould after control module issues eyeball image requirement command
Newest eyeball image is transferred in block, for the data processing and output of computing module, coordinate 102 indicates the time that process carries out
Axis；
In specific implementation, when control module issues eyeball image requirement command (step 104), not due to image frame3
Acquisition is completed, and is had not been transmitted to cache module, so transferring latest image frame2 in cache module；When under control module sending
When one eyeball image requirement command (step 105), image frame5 acquisition is completed, therefore can be transferred newest in cache module
Image frame5.
The problems such as this scheme is not actually utilized there are the longer and certain frame image of certain frames delay, such as works as eyeball figure
When issuing as requirement command (step 105), the acquisition of frame5 is completed, so being carried out at data based on image frame5
The movement position deviation of reason, data processed result and practical eyeball is smaller；And when eyeball image requirement command (step 104) issues
When, the acquisition of frame3 does not complete, so data processing is carried out based on image frame2, so that data processed result and reality
There are relatively large deviations for the movement position of border eyeball, i.e. step delay is longer.
And due to two neighboring eyeball image requirement command (the eyeball position figure of step 104 and step 105) actual use
As being image frame2 and image frame5 respectively, image frame3 and image frame4 are not actually utilized, therefore increase
Unnecessary image data transmission, caching and data processing pressure are added.
Fig. 2 is technical solution of the present invention eyeball tracking signal synchronization principles schematic diagram；
As shown in Fig. 2 schematic diagram, by hardware layer or software layer for the demand frequency of Ins location information image and positioning
The picture-taken frequency of camera synchronizes, to guarantee that the eyeball image information obtained after each requirement command issues is newest
, positioning shooting head with acquire eye movement image (frequency of such as step 201) can be adjusted by control module, and
It completes that image is transmitted to cache module frame by frame after every image frame grabber, after control module issues eyeball image requirement command
(such as step 203 to step 208) transfers newest eyeball image from cache module, for computing module data processing with
Output, coordinate 202 indicate the time shaft that process carries out；
In specific implementation, when control module issues eyeball image requirement command (step 203), image frame 1 is acquired
It completes, is transmitted to cache module, image frame 1 can be transferred for data processing；When control module issues next eyeball figure
When as requirement command (step 204), image frame2 acquisition is completed, and can transfer image frame2 in cache module；It is acquiring
The gap of image frame1 and image frame2, positioning shooting head is without carrying out shooting operation, therefore the present invention program need not be high
Fast camera reduces the requirement to camera hardware configuration, while alleviating image data transmission pressure and computing module
Data processing pressure.
Positioning shooting head acquisition eyeball image and control module send the time of image requirement command in the present invention program
Difference can be adjusted by control module, i.e., positioning shooting head completes image frame 1 and collects control module transmission image
The time difference of requirement command (step 203) can preset, therefore can guarantee to obtain after each image requirement command issues
Eyeball image is all real-time, and it is shorter to be delayed.
The eyeball image requirement command may come from software layer demand and hardware layer demand；
Optionally, the software layer demand includes: the software for needing to carry out eyeball tracking positioning in virtual reality software, is increased
The software for carrying out eyeball tracking positioning is needed to need the software of eyeball tracking positioning function with other in strong reality software, it is such as virtual
In reality game software, need to carry out the high-resolution rendering of subregion of image according to the eye-gaze position of user, therefore can
Image requirement command is set to match the refresh rate of game；
Optionally, the hardware layer demand includes: the screen that equipment is shown in the device with Ins location tracking function
The data processing rate of refresh rate and computing module can match the screen brush that headband shows equipment such as in virtual reality device
New rate sets image requirement command；
The eyeball image requirement command can be adjusted according to the actual situation, can be fixed frequency or variable ratio frequency changer
Rate, such as in reality-virtualizing game software, different scenes needs to match different Ins location frequencies, therefore image demand refers to
Change transformation in real time can be carried out according to different scenes by enabling.
Fig. 3 is the synchronous flow chart of technical solution of the present invention eyeball tracking signal；
Step 301 is that positioning image acquisition hardware acquires eye movement image；
Step 302 is that the image for completing image acquisition hardware acquisition transmits frame by frame, and transmission mode can be divided into wired biography
Defeated mode and wireless transmission method；
Step 303 is that cache module keeps in image data, and the later image of acquisition time can cover acquisition time earlier
Image；
Step 304 is that control module issues eyeball image requirement command, extracts latest image data；
Step 305 is that computing module carries out data processing；Data processing step is more time-consuming step in the prior art；
Step 306 is that computing module exports eyeball tracking positioning result；
Step 307 is frequency more new command, i.e., in practical eyeball tracking position fixing process, control module is according to the actual situation
The frequency for issuing eyeball image requirement command changes, then control module sends frequency update to positioning image acquisition hardware and refers to
It enables, after receiving frequency more new command, the eyeball picture-taken frequency of image acquisition hardware makes corresponding change；
The above, the only specific embodiment of the invention.Scope of protection of the present invention is not limited thereto, any to be familiar with
In the technical scope disclosed by the present invention, any changes or substitutions that can be easily thought of by those skilled in the art, should all cover
Within protection scope of the present invention.Therefore, the protection scope that protection scope of the present invention should be defined with claim is
It is quasi-.
Claims (6)
1. a kind of signal synchronizing method applied to eyeball tracking, which is characterized in that comprising steps of
Eye movement image capturing and transmitting: the acquisition of eye movement image, and the image that acquisition is completed is transmitted；
The calculating of eyeball tracking location information: control module issues eyeball image requirement command, extracts latest image data, calculates
Module carries out data processing and exports eyeball tracking positioning result；
Image Acquisition operation is synchronous with the signal of image requirement command: the frequency acquisition of eye movement image refers to according to frequency update
Order is updated.
2. a kind of signal synchronizing method applied to eyeball tracking according to claim 1, which is characterized in that described image
Transmission mode includes wire transmission mode and wireless transmission method.
3. a kind of signal synchronizing method applied to eyeball tracking according to claim 1, which is characterized in that the eyeball
Tracing Control module issues eyeball image requirement command according to the demand frequency of Ins location information image；
The data source of the demand frequency includes hardware layer demand and software layer demand.
4. a kind of signal synchronizing method applied to eyeball tracking according to claim 1, which is characterized in that the eyeball
Image requirement command includes fixed frequency instruction and variable frequency instruction.
5. a kind of signal synchronizing method applied to eyeball tracking according to claim 1, which is characterized in that the frequency
When more new command is the requirement command frequency shift of eyeball image, instruction that control module is sent to image capture module；
After described image acquisition module receives the frequency more new command, eyeball picture-taken frequency carries out more according to instruction
Change.
6. a kind of signal synchronizing method applied to eyeball tracking according to claim 1, which is characterized in that the frequency
More new command is sent in real time according to the demand frequency of Ins location information image.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710729349.2A CN109426331A (en) | 2017-08-25 | 2017-08-25 | A kind of signal synchronizing method applied to eyeball tracking |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710729349.2A CN109426331A (en) | 2017-08-25 | 2017-08-25 | A kind of signal synchronizing method applied to eyeball tracking |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109426331A true CN109426331A (en) | 2019-03-05 |
Family
ID=65498464
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710729349.2A Pending CN109426331A (en) | 2017-08-25 | 2017-08-25 | A kind of signal synchronizing method applied to eyeball tracking |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109426331A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110221696A (en) * | 2019-06-11 | 2019-09-10 | Oppo广东移动通信有限公司 | Eyeball tracking method and Related product |
-
2017
- 2017-08-25 CN CN201710729349.2A patent/CN109426331A/en active Pending
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110221696A (en) * | 2019-06-11 | 2019-09-10 | Oppo广东移动通信有限公司 | Eyeball tracking method and Related product |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11796309B2 (en) | Information processing apparatus, information processing method, and recording medium | |
| US11119319B2 (en) | Rendering device, head-mounted display, image transmission method, and image correction method | |
| CA2956508C (en) | Method and system for reconstructing obstructed face portions for virtual reality environment | |
| RU2638776C1 (en) | Image generating device and method | |
| US10404911B2 (en) | Image pickup apparatus, information processing apparatus, display apparatus, information processing system, image data sending method, image displaying method, and computer program for displaying synthesized images from a plurality of resolutions | |
| US10133364B2 (en) | Image processing apparatus and method | |
| US8970663B2 (en) | 3D video conference | |
| US9706114B2 (en) | Image pickup apparatus, information processing apparatus, display apparatus, information processing system, image data sending method, image displaying method, and computer program | |
| WO2019111817A1 (en) | Generating device, generating method, and program | |
| JPWO2017183346A1 (en) | Information processing apparatus, information processing method, and program | |
| WO2014154839A1 (en) | High-definition 3d camera device | |
| JP2000354257A (en) | Image processor, image processing method and program provision medium | |
| CN106598211A (en) | Gesture interaction system and recognition method for multi-camera based wearable helmet | |
| WO2020003860A1 (en) | Information processing device, information processing method, and program | |
| CN105721856A (en) | Remote image display method for near-to-eye display | |
| CN109426331A (en) | A kind of signal synchronizing method applied to eyeball tracking | |
| CN114125301A (en) | Virtual reality technology shooting delay processing method and device | |
| KR100917100B1 (en) | Apparatus for displaying three-dimensional image and method for controlling location of display in the apparatus | |
| US11275434B2 (en) | Information processing apparatus, information processing method, and storage medium | |
| CN105828021A (en) | Specialized robot image acquisition control method and system based on augmented reality technology | |
| US11100716B2 (en) | Image generating apparatus and image generation method for augmented reality | |
| CN104905764B (en) | A kind of high speed sight tracing based on FPGA | |
| CN113143185B (en) | Gastroscope system, image display method and device and readable storage medium | |
| US11270673B2 (en) | Image generation apparatus, image generation method, and program | |
| JP7091043B2 (en) | Image processing equipment, image processing system, and image processing method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20190305 |