CN108334185A - A kind of eye movement data reponse system for wearing display equipment - Google Patents
A kind of eye movement data reponse system for wearing display equipment Download PDFInfo
- Publication number
- CN108334185A CN108334185A CN201710045355.6A CN201710045355A CN108334185A CN 108334185 A CN108334185 A CN 108334185A CN 201710045355 A CN201710045355 A CN 201710045355A CN 108334185 A CN108334185 A CN 108334185A
- Authority
- CN
- China
- Prior art keywords
- user
- eye movement
- data
- movement data
- module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/013—Eye tracking input arrangements
Abstract
The invention discloses a kind of eye movement data reponse systems for wearing display equipment, including：Identification module, data acquisition module, data storage module, data processing module；Identification module identifies user identity, data collecting module collected user's eye movement data；The eye movement data library of each user of data storage module correspondence establishment, and store the eye movement data that user demarcates and uses every time every time；The accumulation eye movement data that data processing module is obtained based on feedback, the eyeball phantom of the constantly improve user and general eyeball phantom.Advantage of the invention is that：Improve the eyeball phantom of single user, optimization improves the interactive experience of the user for eye movement tracing algorithm either eye control interactive algorithm or the Algorithm of Iris Recognition of the user；General eyeball phantom is improved, the interactive experience of all users is improved；Analysis eye movement data obtains user's use habit, realizes the accurate push of content.
Description
Technical field
The present invention relates to field of virtual reality, specifically a kind of to wear the eye movement data reponse system for showing equipment.
Background technology
Virtual reality and augmented reality attract attention as nearly 2 years industries just risen, it can simulate true field
Scape is superimposed virtual scene in true scene, and people is allowed to obtain the satisfaction of sense organ in the virtual world or in showing scene
It is superimposed object interaction with virtual.
With the continuous development of virtual reality technology, virtual reality wears display equipment and has obtained great application, at present
It can be divided into three classes：Circumscribed wears display equipment, integral type wears display equipment, display equipment is worn in mobile terminal.
User can be more than that 80% part is received by human eye when display equipment is worn in use in perception information, and wherein
Part more than 90% is handled by vision system.So the processing and analysis of eye movement data are for user behavior understanding and efficiently
Human-computer interaction is of great significance.
It is limited to the technical merit and price of existing hardware, current eye movement module cost is higher, in consumer level products,
Eye movement tracking precision is not high, and eye control interaction delay is longer, and overall customer experience is ineffective.
Invention content
The present invention is intended to provide eye movement related algorithm can be optimized, reduce hardware computation power consumption and cost, while can be promoted
A kind of eye movement data reponse system for wearing display equipment of interactive experience effect.
To realize the above-mentioned technical purpose, technical solution proposed by the present invention is as follows：
A kind of eye movement data reponse system for wearing display equipment, which is characterized in that including：Identification module, data
Acquisition module, data storage module, data processing module；Identification module, data acquisition module, data storage module, number
According to processing module and wear display equipment electrical connection.
Steps are as follows for present invention specific implementation：
The identification module identifies user identity；
User's eye movement data is transferred to data storage module by the data collecting module collected user eye movement data；
The eye movement data library of each user of data storage module correspondence establishment stores the eye movement data of user in the use
The corresponding eye movement data library at family, feeds back to data processing module by the eye movement data of user；
The data processing module according to the accumulation eye movement data of the user fed back, or update the user eyeball model or
Update general eyeball phantom；
The data processing module updates local eyeball phantom or update high in the clouds eye according to the accumulation eye movement data fed back
Spherical model or the eyeball phantom for wearing display equipment in the other access high in the clouds of update.
Further, the identification module includes：Iris recognition module, retina identification module, fingerprint recognition mould
One or several kinds in block, sound identification module, facial recognition modules, account number cipher login module.
Further, the identification module automatic identification user identity or user, which actively wake up, states identification
Module identifies user identity.
Preferably, identification module be iris recognition module, retina identification module, facial recognition modules when, automatically
Identify user identity.
Preferably, when identification module is fingerprint identification module, sound identification module, account number cipher login module, body
Part identification module prompt user provide identity information, such as：Fingerprint, voice, account number cipher, user's identification described in trend
Module provides identity.
Further, the data storage module is local side or high in the clouds.
Further, the eye movement data includes but not limited to：Eyes of user physiological data, user's eye movement data, user
Eye control interaction data.
Further, the display equipment of wearing is that virtual reality wears display equipment or augmented reality wears display equipment
Or mixed reality wears display equipment.
Further, it is described wear display equipment be stopped either power off or be removed wear or wear again it is aobvious
Show that the application program of equipment surprisingly exits or user identity identification fails, restarts identification module.
Advantage of the invention is that：
Improve the eyeball phantom of single user, optimization for the user eye movement tracing algorithm or eye control interactive algorithm or
The algorithm of person's Algorithm of Iris Recognition improves the interactive experience of the user；
General eyeball phantom is improved, the interactive experience of all users is improved；
Analysis eye movement data obtains user's use habit, realizes the accurate push of content.
Description of the drawings
The present invention can be further illustrated by the nonlimiting examples that attached drawing provides：
Fig. 1 is the flow chart of an embodiment of the present invention.
Specific implementation mode
In order to illustrate more clearly of the present invention, following further describes the present invention with reference to the drawings.Art technology
Personnel should be appreciated that following specifically described content is illustrative and be not restrictive, and should not limit the present invention's with this
Protection domain.
Present invention firstly provides it is a kind of wear display equipment eye movement data reponse system, including identification module,
Data acquisition module, data storage module, data processing module；
After wearing display equipment startup, self-starting identification module obtains subscriber identity information；Retrieve data storage mould
Eye movement data library in the block；If database has the library of the user, it is loaded into the eye movement data library, identification module, which enters, stops
It sleeps；If the library of the not no user of database, the eye movement data library of the user is created, identification module enters suspend mode；
Display equipment is worn or wears again if wearing display equipment and being stopped either to power off or be removed
Application program surprisingly exits or user identity identification failure, restarts identification module；
User's eye movement data is transferred to data storage module by data collecting module collected user's eye movement data；
The eye movement data library of each user of data storage module correspondence establishment stores the eye movement data of user in the user's
The eye movement data of user is fed back to data processing module by corresponding eye movement data library；
Data processing module updates the user eyeball model, Yi Jigeng according to the accumulation eye movement data of the user fed back
New general eyeball phantom；
Eye movement data includes but not limited to：Eyes of user physiological data, user's eye movement data, user's eye control interaction data；
Data processing module uses a kind of general eyeball phantom, calculates the real-time sight line point of user.
The present embodiment thinks the approximate sphere of eyeball, the general 23mm of diameter, a kind of general eyeball that the present invention uses
Model, model parameter include：Eyeball radius 23mm, iris diameter 2-8mm, cornea and eyeball centre distance 13.5mm.
Under the model, the normal vector direction of direction of visual lines and pupil center point is consistent.Therefore, it is real-time to solve user
The problem of blinkpunkt, can be converted into the problem of normal vector for solving pupil center's point, and data processing module calculates inner eye corner successively
The spatial position of point, eyeball central point and pupil center's point, to obtain the direction of gaze of user, and the blinkpunkt of user.
However, the physiological data of different human eyes is different, such as inner eye corner point, eyeball center, pupil center, cornea
Radius of curvature.For different users, model accuracy has optimization space.In order to improve adaptation of the Different Individual to algorithm
Property, the mode that we use is：The eye movement data of user is acquired, including user demarcates and use data processing module mistake every time
Eye movement data in journey, and reverse feedback is constantly accumulated to data processing module, is constantly fed back, feedback then carries out primary every time
Model automatically updates.
Specifically the embodiment of update eyeball phantom is：
Eye movement data acquires, and --- error is substituted into the fitting of algorithm by extraction useful data --- comparing normal data ---
Formula carries out fitting of a polynomial and --- obtains model equation coefficient --- preserving new model equation coefficient --- by equation coefficient
In generation, returns model equation --- update eyeball phantom
The eye movement data of user will be fed back in data processing module, and data processing module automatically extracts, progress and standard
The comparison of data does not stop the eyeball phantom for improving the user by the mapping of difference.
Meanwhile general eyeball phantom can be more perfect also with the increase of the eye data of accumulation.
The advantage of the embodiment of the present invention is：
Based on the eye movement data reponse system, user is using wearing with visual pursuit module or eye control interactive module
When showing equipment, with the increase for using duration, visual pursuit precision is higher and higher, and eye control interactive speed is getting faster, experience
It is more and more better.
Further, the eye movement custom of each individual is different, and corresponding eye movement data is different, such as：Eyeball
Drift, nystagmus, nonvoluntary twitching of the eyelid, frequency of wink.When display equipment is worn in each wearing of user, eyeball is worn aobvious relatively
Show that there is nuance in the position of equipment, in use, oculomotor mode is different, the rotation direction of eyeball,
Pupil size data are different with the difference of usage scenario.These data are by data collecting module collected, data storage module
Storage, then can be analyzed being accustomed to eye for the user by data processing module, obtained user's eye movement data and worn display equipment
The correspondence of middle shown content analyzes the behavioural habits data of the user, such as：User is to some content when staring
Length can embody level of interest of the user to the content to a certain extent, be based on this, the accurate push of content may be implemented.
The present invention is not limited to above-mentioned preferred forms, anyone can show that other are various under the inspiration of the present invention
The product of form, however, make any variation in its shape or structure, it is every that there is skill identical or similar to the present application
Art scheme, is within the scope of the present invention.
Claims (7)
1. a kind of eye movement data reponse system for wearing display equipment, it is characterised in that：The display equipment of wearing includes identity
Identification module, data acquisition module, data storage module, data processing module；Identification module, data acquisition module, number
It is connected with the main body for wearing display equipment according to storage module, data processing module.
2. a kind of eye movement data reponse system for wearing display equipment according to claim 1, it is characterised in that：The body
Part identification module identifies user identity；
The identification module includes：Iris recognition module, retina identification module, fingerprint identification module, speech recognition mould
One or several kinds in block, facial recognition modules, account number cipher login module；
The identification module automatic identification user identity or user, which actively wake up, states identification module identification user's body
Part.
3. a kind of eye movement data reponse system for wearing display equipment according to claim 1, it is characterised in that：The number
User's eye movement data is acquired according to acquisition module, user's eye movement data is transferred to data storage module.
4. a kind of eye movement data reponse system for wearing display equipment according to claim 1, it is characterised in that：The number
According to the eye movement data library of each user of storage module correspondence establishment, corresponding eye movement of the eye movement data in the user of user is stored
The eye movement data of user is fed back to data processing module by database；
The data storage module is local side or high in the clouds.
5. a kind of eye movement data reponse system for wearing display equipment according to claim 1, it is characterised in that：The number
According to processing module according to the accumulation eye movement data of the user fed back, or update the user eyeball model or the general eyeball mould of update
Type；
The data processing module updates local eyeball phantom or update high in the clouds eyeball mould according to the accumulation eye movement data fed back
Type or the eyeball phantom for wearing display equipment in the other access high in the clouds of update.
6. according to a kind of eye movement data reponse system for wearing display equipment described in claim 1 to 5, it is characterised in that：Institute
Stating eye movement data includes but not limited to：Eyes of user physiological data, user's eye movement data, user's eye control interaction data.
7. according to a kind of eye movement data reponse system for wearing display equipment described in claim 1 to 7, which is characterized in that institute
State wear display equipment be stopped either power off or be removed wear or wear again display equipment application program meaning
It exits outside or user identity identification fails, restart identification module.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710045355.6A CN108334185A (en) | 2017-01-20 | 2017-01-20 | A kind of eye movement data reponse system for wearing display equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710045355.6A CN108334185A (en) | 2017-01-20 | 2017-01-20 | A kind of eye movement data reponse system for wearing display equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108334185A true CN108334185A (en) | 2018-07-27 |
Family
ID=62922927
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710045355.6A Pending CN108334185A (en) | 2017-01-20 | 2017-01-20 | A kind of eye movement data reponse system for wearing display equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108334185A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111159678A (en) * | 2019-12-26 | 2020-05-15 | 联想(北京)有限公司 | Identity recognition method, device and storage medium |
| CN112836317A (en) * | 2021-03-05 | 2021-05-25 | 南昌工程学院 | Intelligent product design modeling method based on eye movement tracking technology |
| CN113069125A (en) * | 2021-03-18 | 2021-07-06 | 上海趣立信息科技有限公司 | Head-mounted equipment control system, method and medium based on brain wave and eye movement tracking |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104133920A (en) * | 2014-07-18 | 2014-11-05 | 百度在线网络技术（北京）有限公司 | User behavior collection method and device |
| CN104809380A (en) * | 2014-01-24 | 2015-07-29 | 北京奇虎科技有限公司 | Head-wearing intelligent equipment and method for judging identity consistency of users |
| CN104866105A (en) * | 2015-06-03 | 2015-08-26 | 深圳市智帽科技开发有限公司 | Eye movement and head movement interactive method for head display equipment |
| CN105955477A (en) * | 2016-04-29 | 2016-09-21 | 乐视控股（北京）有限公司 | Method and apparatus for adjusting display image of VR device and corresponding VR device |
| CN106020497A (en) * | 2016-07-11 | 2016-10-12 | 北京集创北方科技股份有限公司 | Display device and system and display processing method |
| CN106056405A (en) * | 2016-05-27 | 2016-10-26 | 上海青研科技有限公司 | Advertisement directional-pushing technology based on virtual reality visual interest area |
| WO2016183541A1 (en) * | 2015-05-14 | 2016-11-17 | Magic Leap, Inc. | Augmented reality systems and methods for tracking biometric data |
-
2017
- 2017-01-20 CN CN201710045355.6A patent/CN108334185A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104809380A (en) * | 2014-01-24 | 2015-07-29 | 北京奇虎科技有限公司 | Head-wearing intelligent equipment and method for judging identity consistency of users |
| CN104133920A (en) * | 2014-07-18 | 2014-11-05 | 百度在线网络技术（北京）有限公司 | User behavior collection method and device |
| WO2016183541A1 (en) * | 2015-05-14 | 2016-11-17 | Magic Leap, Inc. | Augmented reality systems and methods for tracking biometric data |
| CN104866105A (en) * | 2015-06-03 | 2015-08-26 | 深圳市智帽科技开发有限公司 | Eye movement and head movement interactive method for head display equipment |
| CN105955477A (en) * | 2016-04-29 | 2016-09-21 | 乐视控股（北京）有限公司 | Method and apparatus for adjusting display image of VR device and corresponding VR device |
| CN106056405A (en) * | 2016-05-27 | 2016-10-26 | 上海青研科技有限公司 | Advertisement directional-pushing technology based on virtual reality visual interest area |
| CN106020497A (en) * | 2016-07-11 | 2016-10-12 | 北京集创北方科技股份有限公司 | Display device and system and display processing method |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111159678A (en) * | 2019-12-26 | 2020-05-15 | 联想(北京)有限公司 | Identity recognition method, device and storage medium |
| CN111159678B (en) * | 2019-12-26 | 2023-08-18 | 联想(北京)有限公司 | Identity recognition method, device and storage medium |
| CN112836317A (en) * | 2021-03-05 | 2021-05-25 | 南昌工程学院 | Intelligent product design modeling method based on eye movement tracking technology |
| CN112836317B (en) * | 2021-03-05 | 2023-03-24 | 南昌工程学院 | Intelligent product design modeling method based on eye movement tracking technology |
| CN113069125A (en) * | 2021-03-18 | 2021-07-06 | 上海趣立信息科技有限公司 | Head-mounted equipment control system, method and medium based on brain wave and eye movement tracking |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP7253017B2 (en) | AUGMENTED REALITY SYSTEM AND METHOD USING REFLECTION | |
| JP7291841B2 (en) | multimodal eye tracking | |
| US10430985B2 (en) | Augmented reality systems and methods utilizing reflections | |
| US11537202B2 (en) | Methods for generating calibration data for head-wearable devices and eye tracking system | |
| US11340461B2 (en) | Devices, systems and methods for predicting gaze-related parameters | |
| US10831268B1 (en) | Systems and methods for using eye tracking to improve user interactions with objects in artificial reality | |
| US11556741B2 (en) | Devices, systems and methods for predicting gaze-related parameters using a neural network | |
| JP2019519053A (en) | Method and system for acquiring, analyzing and generating visual function data and modifying media based on the data | |
| US11393251B2 (en) | Devices, systems and methods for predicting gaze-related parameters | |
| WO2019050034A1 (en) | Autonomously acting robot staring at partner | |
| CN108334185A (en) | A kind of eye movement data reponse system for wearing display equipment | |
| JPWO2019207896A1 (en) | Information processing system, information processing method, and recording medium | |
| US20210275013A1 (en) | Method, System and Apparatus for Diagnostic Assessment and Screening of Binocular Dysfunctions | |
| US9760772B2 (en) | Eye image stimuli for eyegaze calibration procedures | |
| WO2024007364A1 (en) | Wearable-device-based light environment and posture detection method, apparatus and system | |
| Barakat et al. | Assistive technology for the visually impaired: Optimizing frame rate (freshness) to improve the performance of real-time objects detection application | |
| NZ758470B2 (en) | Augmented reality systems and methods utilizing reflections |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20180727 |
|
| RJ01 | Rejection of invention patent application after publication |